Results-driven Data Engineer with 4+ years of experience designing and optimizing cloud-native data platforms across Azure, AWS, and Snowflake ecosystems. I build scalable ETL/ELT pipelines, real-time streaming architectures, and data lakehouse solutions that power enterprise analytics and AI/ML initiatives.
| Metric | Value |
|---|---|
| ποΈ ETL/ELT Pipelines Built | 25+ |
| β‘ Pipeline Performance Improvement | up to 40% |
| π Streaming Latency Reduction | 50%+ |
| π Years of Experience | 4+ |
- Designed enterprise-scale data platforms on Azure Synapse, Databricks & Snowflake
- Built 25+ ETL/ELT pipelines integrating structured & semi-structured data
- Implemented Kafka streaming pipelines reducing latency by 50%+
- Created reusable DBT transformation frameworks across projects
- Automated infra with Terraform, Docker & Kubernetes
- Implemented data quality with Great Expectations
- Engineered pipelines on AWS S3, Glue, Redshift & Snowflake
- Built distributed Spark / PySpark workloads for large-scale analytics
- Designed Kafka streaming architectures for real-time ingestion
- Migrated legacy ETL workflows to cloud-native architectures
- Reduced SQL/Spark processing times by ~35%
- Automated CI/CD with GitHub Actions and Terraform
Cloud-native lakehouse using Azure Databricks + ADLS + DBT + Snowflake
- Implements Medallion Architecture (Bronze / Silver / Gold layers)
- Automated ingestion, transformation & reporting pipelines
- Data validation via Great Expectations
DatabricksDBTSnowflakeADLSGreat Expectations
Kafka + Spark Streaming for high-volume near real-time event processing
- Datadog monitoring & automated alerting
- High availability for mission-critical workloads
KafkaSpark StreamingDatadogPrometheus
M.S. Information Technology β University of Cincinnati Β· December 2024
- π§ saigolla0320@gmail.com
- π +1 (216) 302-8283
- πΌ LinkedIn