End-to-end data pipeline transforming Olist e-commerce data through Azure cloud services. Implements medallion architecture (Bronze-Silver-Gold) with multi-source ingestion, Spark-based processing, and OLTP-to-OLAP optimization for analytics-ready datasets.
distributed-systems ecommerce apache-spark distributed-computing data-engineering databricks etl-pipeline big-data-processing pysaprk kpi-dashboard azure-synapse-analytics parellel-processing medallion-architecture azure-data-lake-storage-gen2 azure-data-factoty data-pipeline-automation
-
Updated
Aug 27, 2026 - Jupyter Notebook