Add a DVC example to the Storage Buckets S3 page#2625
Conversation
Documents using a bucket as a DVC remote via the S3-compatible gateway. Verified end-to-end (init -> add -> push -> fresh clone -> pull) with DVC 3.67.1. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
The checksum-error workaround did not reproduce against the gateway with DVC's client stack (push succeeds without the overrides, verified end-to-end incl. a real GitHub round-trip). The general client-config section already documents the setting for anyone who needs it. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update. |
|
Marking this ready — the example is verified end-to-end against the live gateway (DVC 3.67.1), not just eyeballed:
One change from my first draft: I removed a checksum-error The example is intentionally minimal — mirrors the existing boto3 / DuckDB / rclone recipes and links the page's own Credentials / Client / Addressing sections rather than restating them. Happy to adjust wording or placement. |
lhoestq
left a comment
There was a problem hiding this comment.
lgtm!
btw dvc was acquired by lakefs and will stay open source but I don't expect it to grow more
|
and if you use DVC, it's probably better to just switch to a HF git repo no? 🤔 |
Adds a Version data with DVC recipe to the Storage Buckets S3 page's Examples section, alongside the existing boto3 / DuckDB / rclone examples.
DVC can use a bucket as a DVC remote through the S3-compatible gateway — code and
.dvcpointers stay in git, the data lives in the bucket.Follows the existing example pattern; references the page's own Credentials / Client / Addressing sections instead of restating them. One section, no new page, no
_toctree.ymlchange.🤖 Generated with Claude Code
Note
Low Risk
Documentation-only change with no code, config, or runtime behavior impact.
Overview
Adds a Version data with DVC example to the Storage Buckets S3 Examples section, next to the existing
boto3, DuckDB, andrclonerecipes.The new section explains using a bucket as a DVC S3 remote via the gateway:
pip install 'dvc[s3]',dvc remote add/endpointurl/region, credentials via env or--local, and a shortdvc add→ commit →dvc pushflow. It links to the page’s Configuring a client, Generating S3 credentials, and Addressing buckets sections instead of duplicating them, and notes putting the namespace inendpointurland the bare bucket name in thes3://URL.Reviewed by Cursor Bugbot for commit cca2d7d. Bugbot is set up for automated code reviews on this repo. Configure here.