Skip to content

docs(destination-bigquery): update BigQuery destination docs#78303

Draft
devin-ai-integration[bot] wants to merge 1 commit into
masterfrom
docs/auto/destination-bigquery
Draft

docs(destination-bigquery): update BigQuery destination docs#78303
devin-ai-integration[bot] wants to merge 1 commit into
masterfrom
docs/auto/destination-bigquery

Conversation

@devin-ai-integration
Copy link
Copy Markdown
Contributor

@devin-ai-integration devin-ai-integration Bot commented May 20, 2026

Triggering Context

Run triggered by: API User requested the !connectordocs playbook for destination-bigquery after merged connector commit c03d43d.

Relevant context: Commit c03d43d came from merged PR #78333, which promoted destination-bigquery 3.0.19 from release candidate to main version and disabled progressive rollout.

Confidence impact: The trigger was a small merged release-promotion PR with clear scope, so the triggering-context score is high.

Documentation Confidence Assessment

Overall Confidence: 2/5 capped: too much code inference

Dimension Score Rationale
Code Comprehension 1/5 This is a Java/Kotlin destination with multi-file direct-load and bulk-load logic, so the rubric requires a low score even though the relevant spec fields were identifiable.
API Documentation Quality 5/5 Google provides comprehensive official BigQuery and Cloud Storage docs for auth, permissions, jobs, datasets, locations, quotas, and Cloud Storage HMAC keys.
Change Scope & Risk 3/5 The diff is a moderate docs update, with 87 additions and 39 deletions across setup, permissions, troubleshooting, reference content, and changelog.
Existing Doc Maturity 5/5 The baseline doc was mature at 512 lines and already covered prerequisites, setup, sync modes, output schema, troubleshooting, tutorials, namespace support, and changelog.
Connector Sensitivity 1/5 BigQuery is a top-tier certified destination, so documentation errors can affect many users.
Triggering Context 5/5 The task came from a small merged release-promotion PR with a clear changelog and metadata-only connector change.

What I Verified vs. What I Inferred

  • Verified from code: The connector spec exposes project_id, dataset_location, dataset_id, loading_method, credentials_json, cdc_deletion_mode, disable_type_dedupe, and raw_data_dataset; supported destination sync modes are overwrite, append, and append dedup; GCS staging uses HMAC credentials, a bucket name, a bucket path, and a temp-file post-processing option; the connector can create datasets and runs BigQuery load/query jobs; PR chore: cut release. #78333 promoted 3.0.19 and disabled progressive rollout.
  • Verified from API docs: BigQuery has dataset locations and dataset creation APIs; BigQuery jobs include query and load job configurations; service accounts and IAM roles are the documented Google Cloud auth model; Cloud Storage documents HMAC keys and Storage Object Admin permissions.
  • Inferred: The newly added API-style examples should help PyAirbyte, Terraform, and Airbyte API users because the fields match the connector spec, but I did not run an end-to-end BigQuery sync from those examples.

Areas of Concern

  • Because this is a high-impact Java/Kotlin destination, please review the new reference examples and the removal of the old transformation-query-priority and chunk-size guidance closely.
  • I did not edit docs/integrations/destinations/bigquery-migrations.md because the triggering change did not introduce or modify a breaking change.
  • I did not apply the auto-merge label because the confidence score is 2/5.

What

Updates the BigQuery destination documentation after reviewing connector commit c03d43d and recent connector source changes.

Reviewers: this is an AI-proposed documentation update based on recent destination-bigquery changes. You can merge this PR, modify it, or close it if you disagree with the proposed docs.

How

  • Removed outdated setup guidance for configuration fields that are no longer present in the connector spec.
  • Clarified BigQuery dataset and service account prerequisites based on the connector behavior and Google BigQuery docs.
  • Added configuration reference examples for Airbyte API, PyAirbyte, and Terraform users.
  • Corrected the 3.0.19 changelog PR/date and 3.0.19-rc.1 date to match the merged PRs that introduced those versions.

Review guide

  1. docs/integrations/destinations/bigquery.md setup guidance for removed configuration fields.
  2. docs/integrations/destinations/bigquery.md new Reference section and GCS Staging example.
  3. docs/integrations/destinations/bigquery.md changelog entries for 3.0.19 and 3.0.19-rc.1.

User Impact

Users get more accurate setup guidance for BigQuery permissions, loading methods, CDC deletion mode, advanced settings, and programmatic configuration. The changelog now points the 3.0.19 release entry to the release-promotion PR that introduced it.

Can this PR be safely reverted and rolled back?

  • YES
  • NO

Devin session

@devin-ai-integration
Copy link
Copy Markdown
Contributor Author

🤖 Devin AI Engineer

I'll be helping with this pull request! Here's what you should know:

✅ I will automatically:

  • Address comments on this PR. Add '(aside)' to your comment to have me ignore it.
  • Look at CI failures and help fix them

Note: I can only respond to comments from users who have write access to this repository.

⚙️ Control Options:

  • Disable automatic comment and CI monitoring

@github-actions
Copy link
Copy Markdown
Contributor

👋 Greetings, Airbyte Team Member!

Here are some helpful tips and reminders for your convenience.

💡 Show Tips and Tricks

PR Slash Commands

Airbyte Maintainers (that's you!) can execute the following slash commands on your PR:

  • 🛠️ Quick Fixes
    • /format-fix - Fixes most formatting issues.
    • /bump-version - Bumps connector versions, scraping changelog description from the PR title.
      • Bump types: patch (default), minor, major, major_rc, rc, promote.
      • The rc type is a smart default: applies minor_rc if stable, or bumps the RC number if already RC.
      • The promote type strips the RC suffix to finalize a release.
      • Example: /bump-version type=rc or /bump-version type=minor
    • /bump-progressive-rollout-version - Alias for /bump-version type=rc. Bumps with an RC suffix and enables progressive rollout.
  • ❇️ AI Testing and Review (internal link: AI-SDLC Docs):
    • /ai-prove-fix - Runs prerelease readiness checks, including testing against customer connections.
    • /ai-canary-prerelease - Rolls out prerelease to 5-10 connections for canary testing.
    • /ai-review - AI-powered PR review for connector safety and quality gates.
  • 📝 AI Documentation:
    • /ai-docs-review - AI-powered documentation review for PRs with connector changes.
    • /ai-create-docs-pr - Creates a documentation PR for connector changes, stacked on the current PR.
  • 🚀 Connector Releases:
    • /publish-connectors-prerelease - Publishes pre-release connector builds (tagged as {version}-preview.{git-sha}) for all modified connectors in the PR.
  • ☕️ JVM connectors:
    • /update-connector-cdk-version connector=<CONNECTOR_NAME> - Updates the specified connector to the latest CDK version.
      Example: /update-connector-cdk-version connector=destination-bigquery
  • 🐍 Python connectors:
    • /poe connector source-example lock - Run the Poe lock task on the source-example connector, committing the results back to the branch.
    • /poe source example lock - Alias for /poe connector source-example lock.
    • /poe source example use-cdk-branch my/branch - Pin the source-example CDK reference to the branch name specified.
    • /poe source example use-cdk-latest - Update the source-example CDK dependency to the latest available version.
  • ⚙️ Admin commands:
    • /force-merge reason="<REASON>" - Force merges the PR using admin privileges, bypassing CI checks. Requires a reason.
      Example: /force-merge reason="CI is flaky, tests pass locally"
📚 Show Repo Guidance

Helpful Resources

📝 Edit this welcome message.

@devin-ai-integration devin-ai-integration Bot added area/documentation Improvements or additions to documentation team/documentation labels May 20, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 20, 2026

Deploy preview for airbyte-docs ready!

Project:airbyte-docs
Status: ✅  Deploy successful!
Preview URL:https://airbyte-docs-1tgq2lkf6-airbyte-growth.vercel.app
Latest Commit:83f39b9

Deployed with vercel-action

@devin-ai-integration devin-ai-integration Bot force-pushed the docs/auto/destination-bigquery branch from 0dadf02 to 83f39b9 Compare May 22, 2026 17:48
you see networking or memory management problems with the sync (specifically on the
destination), try decreasing the chunk size. In that case, the sync will be slower but more
likely to succeed.
10. For **CDC deletion mode**, choose how the destination handles delete records from CDC sources.
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[markdownlint] reported by reviewdog 🐶
MD029/ol-prefix Ordered list item prefix [Expected: 1; Actual: 10; Style: 1/2/3]

10. For **CDC deletion mode**, choose how the destination handles delete records from CDC sources.
**Hard delete** propagates source deletes to the destination table. **Soft delete** keeps the
row and records the delete marker.
11. Optional: expand **Advanced** to configure **Legacy raw tables** or **Airbyte Internal Table
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[markdownlint] reported by reviewdog 🐶
MD029/ol-prefix Ordered list item prefix [Expected: 2; Actual: 11; Style: 1/2/3]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/documentation Improvements or additions to documentation team/documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants