Skip to content

Use dbldatagen for synthetic data generation#193

Open
ghanse wants to merge 1 commit into
databricks:mainfrom
ghanse:synthetic-data
Open

Use dbldatagen for synthetic data generation#193
ghanse wants to merge 1 commit into
databricks:mainfrom
ghanse:synthetic-data

Conversation

@ghanse

@ghanse ghanse commented Jun 26, 2026

Copy link
Copy Markdown

Summary

This PR updates the databricks-synthetic-data-gen skill to use dbldatagen.

Documentation safety checklist

  • Examples use least-privilege permissions (no unnecessary ALL PRIVILEGES, admin tokens, or broad scopes)
  • Elevated permissions are explicitly called out where required
  • Sensitive values are obfuscated (placeholder workspace IDs, URLs, no real tokens)
  • No insecure patterns introduced (e.g. disabled TLS verification, hardcoded credentials)

@QuentinAmbard

QuentinAmbard commented Jul 6, 2026

Copy link
Copy Markdown
Contributor

👋 @ghanse — heads up: there's an FE vibe plugin, fe-databricks-tools:databricks-data-generation, that overlaps heavily with this skill — it already has a dbldatagen engine plus a Polars industry-generator library. Rather than maintain both, we'd like to merge that skill into this one to avoid the redundancy, and upgrade this DAS skill to cover the extra capability (dbldatagen as a big-data fallback with Spark Connect staying the default, and industry schemas linked out to a canonical repo). Then we retire the vibe copy.

I've written up the details and pinged you in the FE vibe repo — let's continue the discussion there so we land on a single DAS-owned skill.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants