Skip to content

Commit 7f6bfda

Browse files
committed
Remove Partitioned Tables section entirely
1 parent 94a836d commit 7f6bfda

1 file changed

Lines changed: 0 additions & 31 deletions

File tree

website/src/datafusion.md

Lines changed: 0 additions & 31 deletions
Original file line numberDiff line numberDiff line change
@@ -25,7 +25,6 @@ The `iceberg-datafusion` crate provides integration between Apache Iceberg and [
2525

2626
- **SQL DDL/DML**: `CREATE TABLE`, `INSERT INTO`, `SELECT`
2727
- **Metadata Tables**: Query snapshots and manifests
28-
- **Partitioned Tables**: Automatic partition routing for writes
2928

3029
## Dependencies
3130

@@ -99,42 +98,12 @@ Available metadata tables:
9998
- `table$snapshots` - Table snapshot history
10099
- `table$manifests` - Manifest file information
101100

102-
## Partitioned Tables
103-
104-
### Writing to Partitioned Tables
105-
106-
When inserting into a partitioned table, data is automatically routed to the correct partition directories:
107-
108-
```sql
109-
INSERT INTO catalog.namespace.partitioned_table VALUES
110-
(1, 'electronics', 'laptop'),
111-
(2, 'books', 'novel');
112-
-- Data files will be created under:
113-
-- data/category=electronics/
114-
-- data/category=books/
115-
```
116-
117-
### Write Modes
118-
119-
Two write modes are available for partitioned tables:
120-
121-
| Mode | Property Value | Description |
122-
|------|---------------|-------------|
123-
| **Fanout** (default) | `true` | Handles unsorted data, maintains open writers for all partitions |
124-
| **Clustered** | `false` | Requires sorted input, more memory efficient |
125-
126-
Configure via table property:
127-
```
128-
write.datafusion.fanout.enabled = true
129-
```
130-
131101
## Configuration Options
132102

133103
These table properties control write behavior. They must be set when creating the table via the Iceberg catalog API, as DataFusion SQL does not support `ALTER TABLE` for property changes.
134104

135105
| Property | Default | Description |
136106
|----------|---------|-------------|
137-
| `write.datafusion.fanout.enabled` | `true` | Use FanoutWriter (true) or ClusteredWriter (false) for partitioned writes |
138107
| `write.target-file-size-bytes` | `536870912` (512MB) | Target size for data files |
139108
| `write.format.default` | `parquet` | Default file format for new data files |
140109

0 commit comments

Comments
 (0)