Skip to content

plugin/gcs: enable Service Account impersonation and document ADC auth#119

Open
bschaatsbergen wants to merge 13 commits into
mainfrom
f/keyless-gcs
Open

plugin/gcs: enable Service Account impersonation and document ADC auth#119
bschaatsbergen wants to merge 13 commits into
mainfrom
f/keyless-gcs

Conversation

@bschaatsbergen

@bschaatsbergen bschaatsbergen commented Jun 27, 2026

Copy link
Copy Markdown
Member

Introduces SA impersonation and documents the use of ADC as Google recommends against persisted long-living keys.

image

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates the Google Cloud Storage (GCS) plugin to support keyless authentication via Application Default Credentials (ADC) by default, adds service account impersonation support, and refreshes related documentation to steer users away from long-lived exported service account keys.

Changes:

  • Add impersonate_service_account support to the GCS provider and log the resolved credential source.
  • Switch GCS authentication behavior to prefer ADC when explicit key material isn’t provided.
  • Update plugin documentation (GCS and multiple other plugins) to adjust authentication guidance and UI-guide linking.

Reviewed changes

Copilot reviewed 31 out of 31 changed files in this pull request and generated 5 comments.

Show a summary per file
File Description
web/docs/plugin-docs/Google Cloud Storage.md Reworks authentication docs to emphasize ADC/keyless flows and documents auth precedence/impersonation.
web/docs/docs/Plugins/Google Cloud Storage.md Mirrors the GCS auth documentation updates and adds impersonate_service_account to the config table.
internal/plugin/providers/gcs/source.go Implements ADC-default auth option resolution plus service account impersonation support.
internal/plugin/providers/gcs/source_test.go Adds tests for impersonation config parsing and credential-source precedence behavior.
web/docs/docs/Plugins/Trino.md Updates UI guide link wiring (docIdhref).
web/docs/docs/Plugins/SQS.md Updates UI guide link wiring (docIdhref).
web/docs/docs/Plugins/SNS.md Updates UI guide link wiring (docIdhref).
web/docs/docs/Plugins/S3.md Updates UI guide link wiring (docIdhref).
web/docs/docs/Plugins/Redpanda.md Updates UI guide link wiring (docIdhref).
web/docs/docs/Plugins/Redis.md Updates UI guide link wiring (docIdhref).
web/docs/docs/Plugins/PostgreSQL.md Updates UI guide link wiring (docIdhref).
web/docs/docs/Plugins/OpenSearch.md Updates UI guide link wiring (docIdhref).
web/docs/docs/Plugins/OpenAPI.md Updates UI guide link wiring (docIdhref).
web/docs/docs/Plugins/NATS.md Updates UI guide link wiring (docIdhref).
web/docs/docs/Plugins/MySQL.md Updates UI guide link wiring (docIdhref).
web/docs/docs/Plugins/MongoDB.md Updates UI guide link wiring (docIdhref).
web/docs/docs/Plugins/Lambda.md Updates UI guide link wiring (docIdhref).
web/docs/docs/Plugins/Kafka.md Updates UI guide link wiring (docIdhref).
web/docs/docs/Plugins/Iceberg.md Updates UI guide link wiring (docIdhref).
web/docs/docs/Plugins/Glue.md Updates UI guide link wiring (docIdhref).
web/docs/docs/Plugins/Elasticsearch.md Updates UI guide link wiring (docIdhref).
web/docs/docs/Plugins/DynamoDB.md Updates UI guide link wiring (docIdhref).
web/docs/docs/Plugins/DuckDB.md Updates UI guide link wiring (docIdhref).
web/docs/docs/Plugins/Delta Lake.md Updates UI guide link wiring (docIdhref).
web/docs/docs/Plugins/DBT.md Updates UI guide link wiring (docIdhref).
web/docs/docs/Plugins/Confluent Cloud.md Updates UI guide link wiring (docIdhref).
web/docs/docs/Plugins/ClickHouse.md Updates UI guide link wiring (docIdhref).
web/docs/docs/Plugins/BigQuery.md Updates UI guide link wiring (docIdhref).
web/docs/docs/Plugins/Azure Blob Storage.md Updates UI guide link wiring (docIdhref).
web/docs/docs/Plugins/AsyncAPI.md Updates UI guide link wiring (docIdhref).
web/docs/docs/Plugins/Airflow.md Updates UI guide link wiring (docIdhref).

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread internal/plugin/providers/gcs/source.go
Comment thread internal/plugin/providers/gcs/source.go
Comment thread web/docs/docs/Plugins/Google Cloud Storage.md Outdated
Comment thread web/docs/docs/Plugins/Google Cloud Storage.md Outdated
Comment thread web/docs/plugin-docs/Google Cloud Storage.md Outdated
bschaatsbergen and others added 3 commits June 27, 2026 23:00
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants