You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
PyIceberg integrates with [Apache DataFusion](https://datafusion.apache.org/) through the Custom Table Provider interface ([FFI_TableProvider](https://datafusion.apache.org/python/user-guide/io/table_provider.html)) exposed through `iceberg-rust`.
1765
+
1766
+
<!-- prettier-ignore-start -->
1767
+
1768
+
!!! note "Requirements"
1769
+
This requires [`datafusion` to be installed](index.md).
1770
+
1771
+
<!-- prettier-ignore-end -->
1772
+
1773
+
<!-- markdownlint-disable MD046 -- Allowing indented multi-line formatting in admonition-->
1774
+
1775
+
!!! warning "Experimental Feature"
1776
+
The DataFusion integration is considered **experimental**.
1777
+
1778
+
The integration has a few caveats:
1779
+
1780
+
- Only works with `datafusion >= 45`
1781
+
- Depends directly on `iceberg-rust` instead of PyIceberg's implementation
1782
+
- Has limited features compared to the full PyIceberg API
1783
+
1784
+
The integration will improve as both DataFusion and `iceberg-rust` matures.
1785
+
1786
+
<!-- markdownlint-enable MD046 -->
1787
+
1788
+
PyIceberg tables can be registered directly with DataFusion's SessionContext using the table provider interface.
0 commit comments