You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
docs: update README to reflect current implementation
- Correct ibis-framework version requirement to >=10,<11
- Document all connect() optional parameters with inline comments
- Add URL query string example with optional parameters
- Document schema-only create_table (empty table from schema)
- Document force=True on drop operations
- Note to_pyarrow_batches() downloads full result then splits locally
- Add in-memory tables (unsupported) and Arrow type mapping to feature table
Copy file name to clipboardExpand all lines: README.md
+36-7Lines changed: 36 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -2,7 +2,7 @@
2
2
3
3
Use [Ibis](https://ibis-project.org/) to create on-demand databases, upload data, and query with Python expressions — get pandas or Arrow results back without writing SQL.
con.drop_table("events", database=("analytics", "public"), force=True) # no-op if missing
147
+
123
148
con.drop_database("analytics")
149
+
con.drop_database("analytics", force=True) # no-op if missing
124
150
```
125
151
126
152
### Addressing summary
@@ -146,7 +172,7 @@ summary = (
146
172
)
147
173
```
148
174
149
-
`.execute()` returns a **pandas DataFrame**. Use `.to_pyarrow()`for an Arrow table or `.to_pyarrow_batches()`to stream batches without materializing the full result.
175
+
`.execute()` returns a **pandas DataFrame**. `.to_pyarrow()`returns an Arrow table. `.to_pyarrow_batches()`returns a `RecordBatchReader` — note that Hotdata returns a single Arrow IPC payload per query, so this method downloads the full result first and then splits it into local batches.
SQL compilation uses Ibis's Postgres dialect. Use `con.sql(...)` as a fallback for expressions that don't compile cleanly.
231
+
SQL compilation uses Ibis's Postgres dialect. Column types returned by Hotdata's information schema are resolved via PyArrow's type system, so Parquet-loaded tables with Arrow-native types (timestamps with time zones, decimals, lists, durations) are mapped correctly to Ibis types.
0 commit comments