Medallion Architecture for Data Engineering projects
-
Updated
Jan 12, 2026
Medallion Architecture for Data Engineering projects
databricks-dab-lab is an end-to-end lab that shows how to deploy Databricks Asset Bundles (DABs) with GitHub Actions, using Terraform to provision an Azure Databricks workspace + cluster, then deploying and running three jobs in sequence (data setup → ETL → ML training).
A compact, code-first reference implementation of a LinkedIn analytics medallion pipeline for Databricks.
Metadata-driven pipeline orchestration pattern on Databricks — dynamic DAG from a Delta control table, Jobs API v2.2, Unity Catalog, Lakeflow. Deployable via Databricks Asset Bundle.
Demo project for DAB CI/CD use cases in databricks
Production-grade Databricks project implementing Dev–Test–Prod workspace separation using Databricks Asset Bundles and automated CI/CD with GitHub Actions.
Databricks Asset Bundle demonstrating two-key envelope encryption (AES Key Wrap or AES-GCM around NIST FF1) for format-preserving encryption of sensitive identifiers like VINs, SSNs, and payment account numbers.
Example usage of Databricks Asset Bundles (using Databricks Free Edition)
Ingest Stripe data from API to Databricks with incremental loading and workflow orchestration.
Add a description, image, and links to the databricks-asset-bundle topic page so that developers can more easily learn about it.
To associate your repository with the databricks-asset-bundle topic, visit your repo's landing page and select "manage topics."