Skip to content

Commit a00e736

Browse files
Declare pyarrow dependency for parquet read/write
split_documents, compute_metrics, postprocessing (*_from_df) and extract_mentions all read/write .parquet via pandas, but pandas>=2.2 does not pull a parquet engine automatically, so these functions (and their tests) fail at runtime without one. Add pyarrow as an explicit dependency. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
1 parent 26bbaa8 commit a00e736

1 file changed

Lines changed: 1 addition & 0 deletions

File tree

pyproject.toml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -29,6 +29,7 @@ keywords = ["chunking", "nlp", "rag", "document-splitting", "evaluation"]
2929
dependencies = [
3030
"tiktoken>=0.9.0",
3131
"pandas>=2.2.3",
32+
"pyarrow", # parquet engine: split_documents / compute_metrics / postprocessing read+write .parquet
3233
"numpy",
3334
"tqdm>=4.67.1",
3435
"python-dotenv>=1.1.0",

0 commit comments

Comments
 (0)