Add databricks-serverless-storage-check skill#82
Open
GabbysCode wants to merge 6 commits into
Open
Conversation
GabbysCode
requested review from
a team,
lennartkats-db and
simonfaltum
as code owners
Collaborator
|
We will reach out directly about possible consolidation of this PR and one of our Field Eng maintainers will add a review once we feel its ready. |
GabbysCode
force-pushed
the
add-serverless-storage-check
branch
from
9fcbae3 to
a44f32f
Compare
|
Hi @GabbysCode - can you restructure to match the other skills. So for example, your markdown files should be references for |
jacksandom
reviewed
Jun 17, 2026
There was a problem hiding this comment.
Should be able to remove this and assets as it is captured in the main skill.
jacksandom
suggested changes
Jun 17, 2026
added 5 commits
June 23, 2026 15:09
…disk handoffs Adds a new skill `databricks-serverless-storage-check` that ships an executable preflight scanner for the antipattern where parent/child tasks share state through /local_disk0, /tmp, or trustedTemp paths -- the failure seen in serverless jobs that fail with `INTERNAL_ERROR: [Errno 13] Permission denied` on local-disk paths. The scanner (scripts/preflight.py, stdlib-only, AST + regex) supports five input modes (--notebook, --dir, --job-yaml, --job-id, --run-id) and 7 detection rules (FANOUT001-006 plus ENV001 which routes env-sync errors to support escalation). All 7 self-tests pass. Complementary to databricks-serverless-migration (single-notebook migration). Added a one-line cross-reference from that skill's data-access table pointing here for multi-task fan-out concerns. Includes the required agents/openai.yaml (hand-authored) and SKILL_METADATA entry in scripts/skills.py; manifest regenerated and `python3 scripts/skills.py validate` passes. Signed-off-by: GABRIELLE DOMPREH <Gabby.dompreh@databricks.com>
…ruth.yaml Adds generation_session_id and sources to all four test cases so stf lint passes cleanly (0 errors, 0 warnings). Co-authored-by: Isaac
…s-serverless-migration
Moves skills/databricks-serverless-storage-check/ →
skills/databricks-serverless-migration/databricks-serverless-storage-check/
to physically reflect the parent/sub-skill hierarchy.
- Update scripts/skills.py iter_skill_dirs() to yield one level of nested
skill directories (sub-skills alongside top-level skills)
- Fix relative SKILL.md links: ../databricks-serverless-migration/ → ../
and ../databricks-{dabs,jobs,core}/ → ../../databricks-{dabs,jobs,core}/
- Fix databricks-serverless-migration/SKILL.md links:
../databricks-serverless-storage-check/ → databricks-serverless-storage-check/
- Regenerate manifest.json (skill count unchanged: 9)
- Confirmed: python3 scripts/skills.py validate → Everything is up to date
- Confirmed: stf lint → 0 errors, 0 warnings
Co-authored-by: Isaac
…t skill structure - Merge pattern-catalog.md + remediation-guide.md into a single skills/databricks-serverless-migration/references/serverless-storage-check.md, matching how sibling reference docs are structured in the parent skill - Remove databricks-serverless-storage-check/references/ (now consolidated above) - Remove databricks-serverless-storage-check/agents/ and assets/ (captured at the parent skill level) - Update SKILL.md links from local references/ to ../references/serverless-storage-check.md - Regenerate manifest.json Co-authored-by: Isaac
- Add databricks-serverless-storage-check to metaplugin/plugin.meta.json skills map - Extend iter_skill_dirs in scripts/skillsgen/discovery.py to yield one level of nested sub-skill dirs (scoped to STABLE_REPO_DIR) - Regenerate manifest.json and all plugins/databricks/ bundles Co-authored-by: Isaac
GabbysCode
force-pushed
the
add-serverless-storage-check
branch
from
4607aa2 to
0253363
Compare
…kip codex-metadata for sub-skills Per reviewer request: sub-skills nested under a parent skill do not need their own agents/openai.yaml or assets/ — the parent skill covers them. - Remove agents/ and assets/ from skills/databricks-serverless-migration/databricks-serverless-storage-check/ - Add _is_sub_skill() helper to scripts/skillsgen/discovery.py - Skip nested sub-skills in ensure_codex_metadata and check_codex_metadata - Regenerate plugin bundles (12 fewer files per provider) Co-authored-by: Isaac
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
databricks-serverless-storage-checkas a nested sub-skill underskills/databricks-serverless-migration/, detecting cross-task local-disk (/local_disk0/tmp) handoffs that silently fail in Databricks Serverless/Workspace,taskValues,pipeline_task)skills/databricks-serverless-migration/references/serverless-storage-check.md(pattern catalog + remediation guide) matching parent skill structureagents/openai.yamlandassets/from sub-skill dir (inherited from parent)metaplugin/plugin.meta.jsonskills map,scripts/skillsgen/discovery.pynested sub-skill discovery, all four provider bundles regeneratedmain(post-generator-refactor:scripts/skills.pyfaçade,scripts/skillsgen/package,metaplugin/plugin.meta.json)stf lintpasses on all 4ground_truth.yamltest cases;python3 scripts/skills.py validatepasses cleanTest plan
python3 scripts/skills.py validatepassespython3 -m unittest discover -s tests -p '*_test.py'passesmanifest.jsonunderdatabricks-serverless-storage-checkplugins/databricks/claude/.claude-plugin/plugin.jsonincludesserverless-storage-checkkeyworddatabricks-serverless-migrationThis pull request and its description were written by Isaac.