Skip to content

Commit 390de28

Browse files
zhuqi-lucasalamb
andauthored
Add benchmark for parquet reader with row_filter and project settings (#7401)
* Add benchmark for parquet reader with row_filter and project settings * fix clippy * change bench mark to use asyn read to trigger the page cache * fix * fix * Update comments, add background * incremently addressing the comments * Fix bool random * fixup * Add fn switch and project enum * Fix clippy * Address comment * Add float(half set) and int(full set) change * Address comments * Set compression * fix * Update comments * refactor filter column indexes * Read from in memory buffer * celanu * Test both sync and async readers --------- Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
1 parent 3ed9aed commit 390de28

2 files changed

Lines changed: 570 additions & 1 deletion

File tree

parquet/Cargo.toml

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -74,7 +74,7 @@ ring = { version = "0.17", default-features = false, features = ["std"], optiona
7474

7575
[dev-dependencies]
7676
base64 = { version = "0.22", default-features = false, features = ["std"] }
77-
criterion = { version = "0.5", default-features = false }
77+
criterion = { version = "0.5", default-features = false, features = ["async_futures"] }
7878
snap = { version = "1.0", default-features = false }
7979
tempfile = { version = "3.0", default-features = false }
8080
brotli = { version = "7.0", default-features = false, features = ["std"] }
@@ -211,6 +211,10 @@ name = "arrow_statistics"
211211
required-features = ["arrow"]
212212
harness = false
213213

214+
[[bench]]
215+
name = "arrow_reader_row_filter"
216+
required-features = ["arrow", "async"]
217+
harness = false
214218

215219
[[bench]]
216220
name = "compression"

0 commit comments

Comments
 (0)