Skip to content

Optimize list fields#6439

Merged
guilload merged 1 commit into
mainfrom
guilload/list-fields
May 19, 2026
Merged

Optimize list fields#6439
guilload merged 1 commit into
mainfrom
guilload/list-fields

Conversation

@guilload
Copy link
Copy Markdown
Member

@guilload guilload commented May 17, 2026

Description

  • split code in multiple files
  • optimize de/serialization of list fields entries
  • remove de/serialization on cache get/put
  • move CPU-bound work out of tokio runtime
  • cap number of concurrent fields metadata downloads
  • pushdown filtering down to leaves
  • fix naming, clean up code, etc.

How was this PR tested?

Test locally: indexed on main, issued a bunch of list fields queries and then switched to branch and issued same queries with matching results.

@guilload guilload force-pushed the guilload/list-fields branch 6 times, most recently from 5f69e61 to a44b8c8 Compare May 18, 2026 14:46
Comment thread quickwit/quickwit-proto/protos/quickwit/search.proto
Comment thread quickwit/quickwit-indexing/src/actors/packager.rs
Comment thread quickwit/quickwit-proto/src/search/mod.rs
Comment thread quickwit/quickwit-search/src/list_fields/cache.rs
Comment thread quickwit/quickwit-search/src/list_fields/root.rs Outdated
Comment thread quickwit/quickwit-search/src/list_fields/leaf.rs
Comment thread quickwit/quickwit-proto/src/search/mod.rs
Comment thread quickwit/quickwit-proto/protos/quickwit/search.proto
Comment thread quickwit/quickwit-search/src/list_fields/cache.rs
@guilload guilload force-pushed the guilload/list-fields branch from 278edbd to e8a723e Compare May 19, 2026 19:33
@guilload guilload marked this pull request as ready for review May 19, 2026 19:34
@guilload guilload requested a review from a team as a code owner May 19, 2026 19:34
@guilload guilload force-pushed the guilload/list-fields branch from e8a723e to 0cd3d6c Compare May 19, 2026 19:43
@guilload guilload enabled auto-merge (squash) May 19, 2026 19:44
@guilload guilload merged commit 9a9e2eb into main May 19, 2026
9 checks passed
@guilload guilload deleted the guilload/list-fields branch May 19, 2026 19:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants