Docs: Inspect AI → Storage Buckets eval-log integration#2543
Merged
davanstrien merged 2 commits intoJun 24, 2026
Conversation
Inspect AI (inspect_ai) can now write eval logs directly to HF Storage Buckets via hf://buckets/ paths (inspect_ai#4155, merged 8165dd20). - Add an "Inspect AI" section to the Storage Buckets integrations page - Cross-link from eval-results.md so it's discoverable from the eval angle Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update. |
Inspect won't create the bucket and requires auth, so add `hf auth login` + `hf buckets create` to the example so it works end-to-end. Matches the upstream Inspect eval-logs guide.
davanstrien
marked this pull request as ready for review
June 22, 2026 14:13
Member
Author
|
cc @edbeeching |
Member
Author
|
@NathanHB I'll merge this already, but feel free to add comments if you want to improve / change anything |
Member
|
That's super nice! |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
Documents the new Inspect AI → Hugging Face Storage Buckets integration. Inspect can now write eval logs directly to buckets via
hf://buckets/<owner>/<bucket>/<path>fsspec paths, added ininspect_ai#4155(merged, commit8165dd20).storage-buckets-integrations.md— adds a terse## Inspect AIsection matching the existing per-tool pattern (setINSPECT_LOG_DIRto anhf://buckets/path;inspect eval/inspect view).eval-results.md— one-line cross-link so the bucket log target is discoverable from the eval docs.Why draft
The "See Inspect's eval logs guide" link deep-links to
eval-logs.html#sec-hugging-face-storage-buckets. That section is currently in Inspect's## Unreleasedchangelog and not yet on the published docs site — the anchor will resolve once Inspect ships a release including it. Holding as draft until then; will mark ready for review once the upstream section is live.🤖 Generated with Claude Code
Note
Low Risk
Documentation-only changes with no runtime, auth, or data-handling code.
Overview
Documents Inspect AI writing evaluation logs to Hugging Face Storage Buckets via
hf://buckets/paths.storage-buckets-integrations.mdadds an Inspect AI section (same style as pandas/Datasets): auth and bucket setup, setINSPECT_LOG_DIR, theninspect eval/inspect view; noteshuggingface_hub>=1.6.0and that Inspect does not create buckets.eval-results.mdextends the existing Inspect evaluation guide link with a one-line pointer to that bucket integration anchor for community eval workflows.Reviewed by Cursor Bugbot for commit 9b1aa58. Bugbot is set up for automated code reviews on this repo. Configure here.