Skip to content

Allow setting ClientOptions for datafusion.object_store contexts #1082

@nathschmidt

Description

@nathschmidt

Is your feature request related to a problem or challenge? Please describe what you are trying to do.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
(This section helps Arrow developers understand the context and why for this feature, in addition to the what)

Currently, there doesn't seem to be a way to set the ClientOptions used by the object store contexts from Python. This limits configurability and can lead to issues like connection/request timeouts and incorrectly configured CA hampering usage in some setups - especially corporate or multi-cloud setups.

Describe the solution you'd like
A clear and concise description of what you want to happen.

Let's expose passing ClientOption in for all datafusion.object_store contexts (e.g. PyAmazonS3Context, PyGoogleCloudContext, etc).

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions