#Description / Background
As part of #7136 we added the ability to set the AWS DNS suffix from the region. DataFusion's object store uses the default AWS endpoint unless a AWS configuration object is passed from Java. At the moment this provides the ability to set the AWS endpoint, but also requires setting other credentials. We want to make this so the AWs endpoint can be set in isolation and other credentials are picked up from default credential provider.
Expected behaviour
ObjectStore should use the correctly configured endpoint.
Technical Notes / Implementation Details
We probably need to provide some way to make other fields in AWS configuration optional and then apply the ones specified.
#Description / Background
As part of #7136 we added the ability to set the AWS DNS suffix from the region. DataFusion's object store uses the default AWS endpoint unless a AWS configuration object is passed from Java. At the moment this provides the ability to set the AWS endpoint, but also requires setting other credentials. We want to make this so the AWs endpoint can be set in isolation and other credentials are picked up from default credential provider.
Expected behaviour
ObjectStore should use the correctly configured endpoint.
Technical Notes / Implementation Details
We probably need to provide some way to make other fields in AWS configuration optional and then apply the ones specified.