Skip to content

feat: add glue listNamespaces support#140

Merged
jackye1995 merged 3 commits into
lance-format:mainfrom
geruh:glue-ns
Jul 21, 2025
Merged

feat: add glue listNamespaces support#140
jackye1995 merged 3 commits into
lance-format:mainfrom
geruh:glue-ns

Conversation

@geruh

@geruh geruh commented Jul 21, 2025

Copy link
Copy Markdown
Contributor

This PR lays the initial groundwork for Lance namespace support in AWS Glue Catalog, starting with ListNamespaces.

In this approach, to support pagination correctly, I had to align Lance’s models to Glue’s bounds and restrictions. For example, Lance places no explicit bounds on pageSize, while Glue enforces a maximum of 100 results per call.
So I just fetches results from Glue in batches, continuing until either the requested page size is met or Glue has no more results.

Also, started the ground work for AWS clients by adding support for Static credentials, and fall back to default AWS credential provider chain.

Testing

  • manual testing
  • ./mvnw clean install

@github-actions github-actions Bot added enhancement New feature or request java Java features labels Jul 21, 2025
@jackye1995

Copy link
Copy Markdown
Collaborator

Thanks for the contribution! Mostly looks good to me, just a few nit comments. Also you might want to raise another PR to add a glue.md in the native implementations spec list: https://github.com/lancedb/lance-namespace/tree/main/docs/src/spec/impls

@jackye1995 jackye1995 left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good to me!

@jackye1995 jackye1995 merged commit b1d8ea7 into lance-format:main Jul 21, 2025
5 checks passed
@geruh geruh deleted the glue-ns branch July 25, 2025 21:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request java Java features

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants