👋 Hi, I’m Gautam Patidar, a Data Engineer with 5+ years of experience in building large-scale data systems and ML pipelines. I specialize in designing and optimizing ETL workflows, distributed data processing, and cloud-native solutions to turn raw data into actionable insights that drive business growth. I’ve worked across domains like Travel, AI/EdTech, and Document Intelligence, where I built scalable data platforms, semantic search pipelines, and LLM-powered applications. My focus is on delivering production-grade data products that are efficient, reliable, and future-ready. Key Competencies: 1️⃣ Designing & optimizing distributed ETL pipelines (batch + streaming) 2️⃣ Building scalable ML feature pipelines & post-processing frameworks 3️⃣ Cloud-native data engineering (AWS, GCP, Databricks) 4️⃣ Enhancing reliability with monitoring, fallback mechanisms & validations 5️⃣ Semantic search, RAG frameworks & LLM-powered apps 6️⃣ Collaboration, strategy execution & mentoring teams Technologies & Tools: 📍 Data & Orchestration: PySpark, Airflow, Databricks 📍 Programming & Databases: Python, SQL, Scala, Java 📍 Cloud Platforms: AWS (S3, EC2, Lambda), GCP (BigQuery, Vertex AI) 📍 ML & Libraries: Scikit-learn, TensorFlow, Transformers, Pandas, NumPy 📍 DevOps & Tools: Docker, Kubernetes, GitHub Actions, FastAPI, Datadog Highlights: 🚀 Optimized Expedia’s pipelines to reduce processing time by 30% & resource usage by 20% ⚡ Built a semantic search system using FAISS + Transformers, deployed with FastAPI 🔧 Reduced pipeline downtime from 15% → 5% with resilient Airflow workflows 📈 Google Cloud Certified Professional ML Engineer & AWS Solutions Architect Associate