Hi, I’m Dibya 👋 I’m a Lead Data Engineer with 9+ years of experience designing and optimizing enterprise-scale distributed data platforms in BFSI and large enterprises. I’ve built ingestion and processing systems handling ~5TB/day, reduced critical batch runtimes from 16 hours to under 3 hours, and architected lakehouse solutions using Spark, Databricks, and cloud-native services. But here’s what most engineers struggle with: • Spark performance tuning beyond theory • Real-world partition strategy • Kafka architecture design decisions • Debugging production failures • Thinking like a Data Architect instead of a coder That’s where I help. If you book a session with me, we will work on: ✔ Production-grade Spark optimization ✔ Real-time & batch architecture design ✔ Databricks best practices ✔ Interview-level scenario deep dives ✔ Resume positioning for 15–40 LPA roles My goal is simple: Help you move from “learning tools” to “building real systems.”