Skip to content

Fix DynamoDB CDC S3 example startup failure in integration workflow#434

Closed
Copilot wants to merge 2 commits into
mainfrom
copilot/fix-integration-tests-dynamodb-cdc
Closed

Fix DynamoDB CDC S3 example startup failure in integration workflow#434
Copilot wants to merge 2 commits into
mainfrom
copilot/fix-integration-tests-dynamodb-cdc

Conversation

Copilot AI commented Jun 1, 2026

Copy link
Copy Markdown
Contributor

Integration Tests - dynamodb_cdc failed because to-s3.yaml initialized aws_s3 with an invalid empty canned ACL. This change makes the S3 output config explicitly valid so the example pipeline can start under current Redpanda Connect validation.

  • Root cause

    • aws_s3 output rejected an empty object_canned_acl value during pipeline initialization.
  • Change

    • Updated modules/cookbooks/examples/dynamodb_cdc/to-s3.yaml to set a valid canned ACL:
      • object_canned_acl: private
  • Why this is scoped

    • Single-line config correction in the failing example; no behavior changes outside the DynamoDB CDC to-s3 cookbook path.
output:
  aws_s3:
    bucket: ${S3_BUCKET}
    path: dynamodb-cdc/${DYNAMODB_TABLE}/${! @s3_path }/${! uuid_v4() }.json
    region: ${AWS_REGION}
    object_canned_acl: private

@netlify

netlify Bot commented Jun 1, 2026

Copy link
Copy Markdown

Deploy Preview for redpanda-connect ready!

Name Link
🔨 Latest commit 467a575
🔍 Latest deploy log https://app.netlify.com/projects/redpanda-connect/deploys/6a1d58995e539a0008794eb6
😎 Deploy Preview https://deploy-preview-434--redpanda-connect.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

Copilot AI changed the title [WIP] Fix failing GitHub Actions job for integration tests - dynamodb_cdc Fix DynamoDB CDC S3 example startup failure in integration workflow Jun 1, 2026
Copilot AI requested a review from JakeSCahill June 1, 2026 10:02
@JakeSCahill JakeSCahill marked this pull request as ready for review June 2, 2026 08:59
@JakeSCahill JakeSCahill requested a review from a team as a code owner June 2, 2026 08:59
JakeSCahill added a commit that referenced this pull request Jun 16, 2026
…L example

- Add gcp_bigquery_write_api cookbook with 7 tested example pipelines
  (basic stream, exactly-once, auto-create table, CDC upsert/upsert_delete,
  multi-table routing, throughput tuning) plus nav entry, test-config, README
- Fix doris_stream_load: correct introduced version to 4.96.0 and expand
  FE/BE acronyms (page + overrides.json)
- Set valid object_canned_acl on dynamodb_cdc to-s3 example (closes #434)

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants