File tree Expand file tree Collapse file tree
Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -95,6 +95,7 @@ Iceberg works with the concept of a FileIO which is a pluggable module for readi
9595- ** hdfs** : ` PyArrowFileIO `
9696- ** abfs** , ** abfss** : ` FsspecFileIO `
9797- ** oss** : ` PyArrowFileIO `
98+ - ** hf** : ` FsspecFileIO `
9899
99100You can also set the FileIO explicitly:
100101
@@ -193,6 +194,17 @@ PyIceberg uses [S3FileSystem](https://arrow.apache.org/docs/python/generated/pya
193194
194195<!-- markdown-link-check-enable-->
195196
197+ ### Hugging Face
198+
199+ <!-- markdown-link-check-disable -->
200+
201+ | Key | Example | Description |
202+ | ----------- | ------------------------ | --------------------------------------------------------- |
203+ | hf.endpoint | < https://huggingface.co > | Configure the endpoint for Hugging Face |
204+ | hf.token | hf_xxx | The Hugging Face token to access HF Datasets repositories |
205+
206+ <!-- markdown-link-check-enable-->
207+
196208### PyArrow
197209
198210<!-- markdown-link-check-disable -->
You can’t perform that action at this time.
0 commit comments