ExampleHome

Versatile Data Kit (VDK) is a data framework that enables Data Engineers to

🧑‍💻 develop,
▶️ run,
📊 and manage data workloads, aka data jobs

What Problem Does Versatile Data Kit Solve?

• Ingest data from different sources.
• Use Python/SQL and VDK templates to transform data.
• Package, version, and deploy data applications while dealing with credentials, retries, and reconnects.
• Provide built-in monitoring and smart notification capabilities.
• Track code and data modifications for quicker troubleshooting and version rollback.

See our introduction blog post

Getting started

Extract data with VDK Ingester	Process data with SQL with VDK Managed Connection	Create a star schema with VDK Templates	Extract data incrementally with VDK Ingester and Properties	Trace your SQL provenience with with installing VDK lineage plugin

Installation

➡️ See the Installation for more details.

Main Concepts

➡️ See the Interfaces for more details.