Skip to content

Commit d2703ef

Browse files
skills(jobs): merge experimental ai-dev-kit content into stable
Merges the comprehensive jobs reference content from experimental/databricks-jobs/ into skills/databricks-jobs/ and removes the experimental copy. What's new in stable databricks-jobs (v0.2.0): - Full task-types reference (9 types: notebook, spark_python, python_wheel, sql, dbt, pipeline, spark_jar, run_job, for_each) - All 6 trigger types with examples (cron, periodic, file_arrival, table_update, continuous, manual) + combining + pause/resume - Notifications + health rules + retries + timeouts + queues - 7 end-to-end worked examples (ETL, warehouse refresh, event-driven, ML training, multi-env, streaming, cross-job orchestration) - run_if conditions, environments (serverless deps), permissions What's retained from the prior stable skill: - parent: databricks-core hierarchy - Compatibility note + version metadata (bumped 0.1.0 → 0.2.0) - Scaffolding workflow (databricks bundle init + CLAUDE.md/AGENTS.md template + project structure) - Unit testing + development workflow sections - agents/openai.yaml + assets/ Cleanups during the merge: - Replaced the trigger-spam description with a terse one - Normalized hard-coded /Workspace/Users/user@example.com/ paths in the imported reference files to /Workspace/Shared/ scripts/skills.py: updated SKILL_METADATA description for jobs to reflect the broader scope. Manifest regenerated; experimental count drops from 23 to 22. Resolves PR #73 TODO #1a. Co-authored-by: Isaac
1 parent 104ec87 commit d2703ef

12 files changed

Lines changed: 310 additions & 454 deletions

File tree

experimental/README.md

Lines changed: 3 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -8,9 +8,9 @@
88
> - They do not follow the same review / quality bar as the skills in
99
> [`../skills/`](../skills/).
1010
> - They may be out of date relative to upstream `ai-dev-kit`.
11-
> - They may overlap with stable skills (e.g. `databricks-jobs` exists in
12-
> both directories — see the install-path note below for how that's
13-
> resolved on disk).
11+
> - The on-disk install path always carries a `-experimental` suffix so
12+
> experimental skills never collide with stable skills of the same name
13+
> (see the install-path note below).
1414
> - They are not installed by `databricks experimental aitools skills install`
1515
> by default — you have to opt in (see the root README).
1616
>
@@ -61,7 +61,6 @@ See the root [README](../README.md) for details on the stable install path.
6161
- **databricks-dbsql** - Databricks SQL warehouse patterns
6262
- **databricks-iceberg** - Apache Iceberg tables (Managed/Foreign), UniForm, Iceberg REST Catalog, Iceberg Clients Interoperability
6363
- **databricks-spark-structured-streaming** - Spark Structured Streaming patterns
64-
- **databricks-jobs** - Multi-task workflows, triggers, schedules *(also available as a stable skill — see TODO #1a in PR #73)*
6564
- **databricks-synthetic-data-gen** - Realistic test data with Faker
6665
- **databricks-zerobus-ingest** - Zerobus ingest patterns
6766
- **spark-python-data-source** - Python data sources for Spark

experimental/databricks-jobs/SKILL.md

Lines changed: 0 additions & 341 deletions
This file was deleted.

experimental/databricks-jobs/agents/openai.yaml

Lines changed: 0 additions & 7 deletions
This file was deleted.
-15 KB
Binary file not shown.

experimental/databricks-jobs/assets/databricks.svg

Lines changed: 0 additions & 3 deletions
This file was deleted.

0 commit comments

Comments
 (0)