Skip to content

Commit 05ce180

Browse files
jackye1995claude
andauthored
feat: generalize dynamic object store credentials (#6609)
## Summary - generalize namespace-vended dynamic credentials across AWS, Azure, and GCP object_store backends - add a cached OpenDAL dynamic store wrapper and use it for OSS and HuggingFace - keep Azure and GCS OpenDAL paths static while cleaning up provider-specific option normalization --------- Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
1 parent 2939443 commit 05ce180

10 files changed

Lines changed: 1347 additions & 230 deletions

File tree

rust/lance-io/src/object_store.rs

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -34,9 +34,15 @@ use url::Url;
3434
use super::local::LocalObjectReader;
3535
#[cfg(target_os = "linux")]
3636
use crate::uring::{UringCurrentThreadReader, UringReader};
37+
#[cfg(any(feature = "aws", feature = "azure", feature = "gcp"))]
38+
pub(crate) mod dynamic_credentials;
39+
#[cfg(any(feature = "oss", feature = "huggingface"))]
40+
pub(crate) mod dynamic_opendal;
3741
mod list_retry;
3842
pub mod providers;
3943
pub mod storage_options;
44+
#[cfg(test)]
45+
pub(crate) mod test_utils;
4046
pub mod throttle;
4147
mod tracing;
4248
use crate::object_reader::SmallReader;

0 commit comments

Comments
 (0)