Skip to content

Add IO metrics#6429

Merged
guilload merged 1 commit into
mainfrom
guilload/io-metrics
May 19, 2026
Merged

Add IO metrics#6429
guilload merged 1 commit into
mainfrom
guilload/io-metrics

Conversation

@guilload
Copy link
Copy Markdown
Member

@guilload guilload commented May 13, 2026

Description

Keep track of bytes written in the WAL and add process level metrics.

How was this PR tested?

Tested on benchmark machine

@guilload guilload force-pushed the guilload/io-metrics branch 3 times, most recently from 66ce695 to e327f28 Compare May 14, 2026 15:21
@guilload guilload marked this pull request as ready for review May 14, 2026 15:24
@guilload guilload requested review from a team as code owners May 14, 2026 15:24
@guilload guilload force-pushed the guilload/io-metrics branch 2 times, most recently from fc1c4ca to 12fc7c0 Compare May 14, 2026 19:01
Comment thread quickwit/quickwit-common/src/metrics.rs Outdated
impl Default for IoMetrics {
fn default() -> Self {
Self {
read_bytes_total: new_counter(
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We're doing inc_by with deltas, but the names are _total - we should probably omit total.

let span = info_span!("mrecordlog.truncate", queue, position);
let queue = queue.to_string();
self.run_operation(span, move |mrecordlog| {
mrecordlog.truncate(&queue, position)
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why deos this change work? one passes a u64 and the other passes a RangeInclusive? Is there some magical promotion that takes place somewhere?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The API of mrecordlog has changed.

Copy link
Copy Markdown
Collaborator

@nadav-govari nadav-govari left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You have some merge conflicts

@guilload guilload force-pushed the guilload/io-metrics branch 3 times, most recently from cdf9501 to 00f45eb Compare May 19, 2026 18:10
@guilload guilload force-pushed the guilload/io-metrics branch from 00f45eb to aaa2d08 Compare May 19, 2026 18:16
@guilload guilload merged commit 964cba5 into main May 19, 2026
9 checks passed
@guilload guilload deleted the guilload/io-metrics branch May 19, 2026 18:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants