chore: DO NOT MERGE - source-faker with CDK dev (cache pressure test) by devin-ai-integration[bot] · Pull Request #75610 · airbytehq/airbyte

devin-ai-integration · 2026-03-30T18:55:37Z

What

⚠️ DO NOT MERGE — This PR is a test vehicle only.

Pins source-faker's airbyte-cdk dependency to a prerelease dev version that includes cache/file-backed memory pressure testing (from airbyte-python-cdk#970). This will be used to create a dev image of source-faker and test the CDK's memory monitor dual-condition fail-fast via actor pinning.

The dev CDK version creates file-backed shared mmap pages on /tmp (overlay fs) for each consumed record, inflating cgroup memory usage without growing process anonymous RSS (RssAnon). This should not trigger the fail-fast — the monitor should log "pressure likely from file-backed or reclaimable pages" and continue normally.

Companion PR: #75609 (memory leak / positive case)

How

Pins airbyte-cdk in pyproject.toml to ==7.13.0.post13.dev23809747805 (the dev build from CDK PR Handle more than 100 fields to compute hashid #970).
Bumps dockerImageTag in metadata.yaml and version in pyproject.toml from 7.0.3 → 7.0.4 (required by the Connector Version Increment pre-release check).
Base image remains python-connector-base:4.0.2 (unchanged from master).

Updates since last revision

Reverted the earlier approach of swapping the base image to source-declarative-manifest. Source-faker is a Python connector (not manifest-only), so the SDM base image was incompatible with the Dockerfile.python-connector template. The new approach pins the CDK dependency directly instead.
Updated CDK dev version from 7.13.0.post12.dev23757371941 → 7.13.0.post13.dev23809747805. The new version fixes a SIGBUS crash (exit code 135) by switching the mmap backing store from /dev/shm (tmpfs, ~64 MB limit in Docker) to /tmp (overlay fs, no hard limit). File-backed pages on /tmp still count toward cgroup memory and go into RssFile (not RssAnon), preserving the dual-condition test. See CDK PR #970 fix commit.

Review guide

airbyte-integrations/connectors/source-faker/pyproject.toml — CDK version pin + version bump
airbyte-integrations/connectors/source-faker/metadata.yaml — version bump only (base image unchanged)
airbyte-integrations/connectors/source-faker/poetry.lock — regenerated for new CDK version (large diff due to 6.x → 7.x transitive dependency changes)

Human review checklist

Verify airbyte-cdk==7.13.0.post13.dev23809747805 is the correct dev version for CDK PR #970
Confirm version in pyproject.toml matches dockerImageTag in metadata.yaml
Confirm base_image in metadata.yaml is unchanged from master
Note: poetry.lock diff is large because CDK jumped from 6.x to 7.x — transitive dependency changes are expected

User Impact

None — this PR should not be merged. It exists solely to produce a dev image of source-faker for testing the memory fail-fast feature via actor-level version pinning.

Can this PR be safely reverted and rolled back?

YES 💚

Link to Devin session: https://app.devin.ai/sessions/070ecb51ceee4f9189e1c09a83ba31cb

…e pressure test) Updates source-faker base image to use source-declarative-manifest dev image 7.13.0.post12.dev23757371941 from CDK PR #970 (cache memory growth without process RSS growth). This is a test branch for validating the memory monitor dual-condition check does NOT trigger on file-backed memory pressure. DO NOT MERGE. Co-Authored-By: patrick.nilan@airbyte.io <patrick.nilan@airbyte.io>

devin-ai-integration · 2026-03-30T18:55:39Z

🤖 Devin AI Engineer

I'll be helping with this pull request! Here's what you should know:

✅ I will automatically:

Address comments on this PR. Add '(aside)' to your comment to have me ignore it.
Look at CI failures and help fix them

Note: I can only respond to comments from users who have write access to this repository.

⚙️ Control Options:

Disable automatic comment and CI monitoring

octavia-bot · 2026-03-30T18:55:49Z

Note

📝 PR Converted to Draft

More info...

Thank you for creating this PR. As a policy to protect our engineers' time, Airbyte requires all PRs to be created first in draft status. Your PR has been automatically converted to draft status in respect for this policy.

As soon as your PR is ready for formal review, you can proceed to convert the PR to "ready for review" status by clicking the "Ready for review" button at the bottom of the PR page.

To skip draft status in future PRs, please include [ready] in your PR title or add the skip-draft-status label when creating your PR.

github-actions · 2026-03-30T18:56:07Z

👋 Greetings, Airbyte Team Member!

Here are some helpful tips and reminders for your convenience.

💡 Show Tips and Tricks

PR Slash Commands

Airbyte Maintainers (that's you!) can execute the following slash commands on your PR:

🛠️ Quick Fixes
- /format-fix - Fixes most formatting issues.
- /bump-version - Bumps connector versions, scraping changelog description from the PR title.
❇️ AI Testing and Review (internal link: AI-SDLC Docs):
- /ai-prove-fix - Runs prerelease readiness checks, including testing against customer connections.
- /ai-canary-prerelease - Rolls out prerelease to 5-10 connections for canary testing.
- /ai-review - AI-powered PR review for connector safety and quality gates.
🚀 Connector Releases:
- /publish-connectors-prerelease - Publishes pre-release connector builds (tagged as {version}-preview.{git-sha}) for all modified connectors in the PR.
- /bump-progressive-rollout-version - Bumps connector version with an RC suffix (2.16.10-rc.1) for progressive rollouts (enableProgressiveRollout: true).
  - Example: /bump-progressive-rollout-version changelog="Add new feature for progressive rollout"
☕️ JVM connectors:
- /update-connector-cdk-version connector=<CONNECTOR_NAME> - Updates the specified connector to the latest CDK version.
  Example: /update-connector-cdk-version connector=destination-bigquery
🐍 Python connectors:
- /poe connector source-example lock - Run the Poe lock task on the source-example connector, committing the results back to the branch.
- /poe source example lock - Alias for /poe connector source-example lock.
- /poe source example use-cdk-branch my/branch - Pin the source-example CDK reference to the branch name specified.
- /poe source example use-cdk-latest - Update the source-example CDK dependency to the latest available version.
⚙️ Admin commands:
- /force-merge reason="<REASON>" - Force merges the PR using admin privileges, bypassing CI checks. Requires a reason.
  Example: /force-merge reason="CI is flaky, tests pass locally"

📚 Show Repo Guidance

Helpful Resources

Breaking Changes Guide - Breaking changes, migration guides, and upgrade deadlines
Developing Connectors Locally
Managing Connector Secrets
On-Demand Regression Tests
#connector-ci-issues
#connector-publish-updates
#connector-build-statuses

📝 Edit this welcome message.

github-actions · 2026-03-30T18:58:19Z

`source-faker` Connector Test Results

13 tests 10 ✅ 9s ⏱️
2 suites 3 💤
2 files 0 ❌

Results for commit 01f189c.

♻️ This comment has been updated with latest results.

Co-Authored-By: patrick.nilan@airbyte.io <patrick.nilan@airbyte.io>

Patrick Nilan (pnilan) · 2026-03-30T20:32:29Z

/publish-connectors-prerelease

Pre-release Connector Publish Started

Publishing pre-release build for connector source-faker.
PR: #75610

Pre-release versions will be tagged as {version}-preview.7cf0eb2
and are available for version pinning via the scoped_configuration API.

View workflow run
❌ Pre-release Publish FAILED for source-faker.

github-actions · 2026-03-30T20:38:34Z

❔ Pre-release Publish UNKNOWN for source-faker.

… dev version (cache pressure test) Co-Authored-By: patrick.nilan@airbyte.io <patrick.nilan@airbyte.io>

Co-Authored-By: patrick.nilan@airbyte.io <patrick.nilan@airbyte.io>

Patrick Nilan (pnilan) · 2026-03-30T23:25:22Z

/publish-connectors-prerelease

Pre-release Connector Publish Started

Publishing pre-release build for connector source-faker.
PR: #75610

Pre-release versions will be tagged as {version}-preview.7101641
and are available for version pinning via the scoped_configuration API.

View workflow run
Pre-release Publish: SUCCESS ✅

Docker image (pre-release):
airbyte/source-faker:7.0.4-preview.7101641

Docker Hub: https://hub.docker.com/layers/airbyte/source-faker/7.0.4-preview.7101641

Registry JSON:

OSS Registry

Cloud Registry

… from /dev/shm to /tmp) Co-Authored-By: patrick.nilan@airbyte.io <patrick.nilan@airbyte.io>

…with anon/usage fix) Co-Authored-By: patrick.nilan@airbyte.io <patrick.nilan@airbyte.io>

…prerelease) Co-Authored-By: patrick.nilan@airbyte.io <patrick.nilan@airbyte.io>

Patrick Nilan (pnilan) · 2026-03-31T22:00:06Z

/publish-connectors-prerelease

Pre-release Connector Publish Started

Publishing pre-release build for connector source-faker.
PR: #75610

Pre-release versions will be tagged as {version}-preview.08a10d4
and are available for version pinning via the scoped_configuration API.

View workflow run
Pre-release Publish: SUCCESS ✅

Docker image (pre-release):
airbyte/source-faker:7.0.4-preview.08a10d4

Docker Hub: https://hub.docker.com/layers/airbyte/source-faker/7.0.4-preview.08a10d4

Registry JSON:

OSS Registry

Cloud Registry

Patrick Nilan (pnilan) · 2026-04-01T00:38:29Z

Looks good in tests

octavia-bot Bot marked this pull request as draft March 30, 2026 18:55

Octavia Squidington III (octavia-squidington-iii) added the connectors/source/faker label Mar 30, 2026

chore: bump source-faker version to 7.0.4 for pre-release checks

7cf0eb2

Co-Authored-By: patrick.nilan@airbyte.io <patrick.nilan@airbyte.io>

devin-ai-integration Bot mentioned this pull request Mar 30, 2026

chore: DO NOT MERGE - source-faker with CDK dev image (memory leak test) #75609

Closed

3 tasks

This comment was marked as outdated.

Sign in to view

chore: revert base image to python-connector-base, pin airbyte-cdk to…

2bf9af4

… dev version (cache pressure test) Co-Authored-By: patrick.nilan@airbyte.io <patrick.nilan@airbyte.io>

devin-ai-integration Bot changed the title ~~chore: DO NOT MERGE - source-faker with SDM dev image (cache pressure test)~~ chore: DO NOT MERGE - source-faker with CDK dev (cache pressure test) Mar 30, 2026

chore: regenerate poetry.lock for dev CDK version

7101641

Co-Authored-By: patrick.nilan@airbyte.io <patrick.nilan@airbyte.io>

Patrick Nilan (pnilan) self-requested a review March 31, 2026 16:01

chore: update airbyte-cdk to 7.13.0.post13.dev23809747805 (SIGBUS fix…

01f189c

… from /dev/shm to /tmp) Co-Authored-By: patrick.nilan@airbyte.io <patrick.nilan@airbyte.io>

This comment was marked as outdated.

Sign in to view

devin-ai-integration Bot and others added 2 commits March 31, 2026 21:51

chore: update airbyte-cdk to 7.13.0.post12.dev23820904857 (CDK PR #962 …

a915870

…with anon/usage fix) Co-Authored-By: patrick.nilan@airbyte.io <patrick.nilan@airbyte.io>

chore: update airbyte-cdk to 7.13.0.post16.dev23821147586 (CDK PR #970 …

08a10d4

…prerelease) Co-Authored-By: patrick.nilan@airbyte.io <patrick.nilan@airbyte.io>

Patrick Nilan (pnilan) closed this Apr 1, 2026

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

chore: DO NOT MERGE - source-faker with CDK dev (cache pressure test)#75610

chore: DO NOT MERGE - source-faker with CDK dev (cache pressure test)#75610
devin-ai-integration[bot] wants to merge 7 commits into
masterfrom
devin/1774896873-source-faker-cache-pressure-test

devin-ai-integration Bot commented Mar 30, 2026 •

edited

Loading

Uh oh!

devin-ai-integration Bot commented Mar 30, 2026

Uh oh!

octavia-bot Bot commented Mar 30, 2026

Uh oh!

github-actions Bot commented Mar 30, 2026

PR Slash Commands

Helpful Resources

Uh oh!

github-actions Bot commented Mar 30, 2026 •

edited

Loading

Uh oh!

This comment was marked as outdated.

Patrick Nilan (pnilan) commented Mar 30, 2026 •

edited by github-actions Bot

Loading

Uh oh!

github-actions Bot commented Mar 30, 2026

Uh oh!

Patrick Nilan (pnilan) commented Mar 30, 2026 •

edited by github-actions Bot

Loading

Uh oh!

This comment was marked as outdated.

Patrick Nilan (pnilan) commented Mar 31, 2026 •

edited by github-actions Bot

Loading

Uh oh!

Patrick Nilan (pnilan) commented Apr 1, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

devin-ai-integration Bot commented Mar 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What

How

Updates since last revision

Review guide

Human review checklist

User Impact

Can this PR be safely reverted and rolled back?

Uh oh!

devin-ai-integration Bot commented Mar 30, 2026

🤖 Devin AI Engineer

Uh oh!

octavia-bot Bot commented Mar 30, 2026

Uh oh!

github-actions Bot commented Mar 30, 2026

👋 Greetings, Airbyte Team Member!

PR Slash Commands

Helpful Resources

Uh oh!

github-actions Bot commented Mar 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

source-faker Connector Test Results

Uh oh!

This comment was marked as outdated.

Patrick Nilan (pnilan) commented Mar 30, 2026 • edited by github-actions Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Mar 30, 2026

Uh oh!

Patrick Nilan (pnilan) commented Mar 30, 2026 • edited by github-actions Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

This comment was marked as outdated.

Patrick Nilan (pnilan) commented Mar 31, 2026 • edited by github-actions Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Patrick Nilan (pnilan) commented Apr 1, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

devin-ai-integration Bot commented Mar 30, 2026 •

edited

Loading

github-actions Bot commented Mar 30, 2026 •

edited

Loading

`source-faker` Connector Test Results

Patrick Nilan (pnilan) commented Mar 30, 2026 •

edited by github-actions Bot

Loading

Patrick Nilan (pnilan) commented Mar 30, 2026 •

edited by github-actions Bot

Loading

Patrick Nilan (pnilan) commented Mar 31, 2026 •

edited by github-actions Bot

Loading