Support S3 session_token

[cfis]

When 2FA is enabled on an Amazon account, S3 access requires having a session_token. DataFusion seems to support this:

https://github.com/apache/datafusion/blob/ce835da93eaeee4a5e447b2bc2fb88cf0fd04d2c/datafusion-cli/src/object_storage.rs#L215

However, that attribute is not exposed in the Python bindings. Any plans to add it? Or would a PR be accepted that adds it?

[timsaucer]

PRs are always welcome, especially for things like this that already exist on the rust side and only need exposure!

[kylebarron]

As also mentioned in #899 (comment), I'd encourage the use of https://docs.rs/pyo3-object_store/, which supports all the underlying object_store configuration, not just session token.

I don't think I have time to make that PR though

[timsaucer]

As also mentioned in #899 (comment), I'd encourage the use of https://docs.rs/pyo3-object_store/, which supports all the underlying object_store configuration, not just session token.

I don't think I have time to make that PR though

Wholeheartedly endorse.