I am a Senior Data Engineer at Deloitte USI (formerly with TCS) with 4+ years of hands-on experience designing and operating production data platforms across enterprise environments. My primary focus is multi-cloud data engineering across AWS and Azure. Rather than sticking to a single ecosystem, I regularly build and optimize pipelines across both clouds—transitioning legacy architectures (such as Amazon Redshift and Hive Metastore) to modern Databricks Unity Catalog lakehouses, setting up config-driven Medallion frameworks, and implementing real-time streaming architectures. I have practical experience tackling the day-to-day engineering challenges that matter in production: tuning PySpark jobs for massive billion-record tables, handling schema evolution and CDC, orchestrating complex workflows, and automating deployments. Along the way, I have earned certifications including the Databricks Certified Data Engineer Professional and Microsoft Azure DP-203. Core Technical Focus: Engines & Processing: PySpark, Spark SQL, Python, Delta Lake Databricks Ecosystem: Unity Catalog migrations, Medallion Architecture, UniForm (Apache Iceberg), Databricks Workflows, Declarative Automation Bundles Cloud & Orchestration:Azure: Azure Data Factory (ADF), ADLS Gen2, Azure Event Hubs, Azure SQL, Azure DevOps AWS: Amazon Redshift, Amazon S3, AWS Glue Catalog, Aurora PostgreSQL Performance & Data Patterns: SCD Types 1 & 2, Change Data Capture (CDC), Query & Spark Optimization (AQE, Z-Ordering, broadcast joins, skew handling)