As a seasoned Data Engineer and Team Lead with over 5 years of hands-on experience in Big Data technologies and 9 years in server and HPC support, I specialize in PySpark, Hadoop, and ETL processes. My expertise lies in building and optimizing data-intensive applications and designing scalable data pipelines that drive business insights and operational efficiency. At Wipro, I have successfully led a team of engineers in delivering high-impact projects, including the extraction, transformation, and loading (ETL) of customer network data, anomaly detection using Spark and PySpark, and data visualization with Grafana. My role also includes the seamless integration and automation of workflows using Apache Airflow and the efficient transfer of data across platforms using Apache NiFi. Skills: Big Data Engineering | Hadoop | Sqoop | Hive | Spark | PySpark | SQL | AWS | Airflow | NiFi | Kafka Proficiencies: Languages: Python, PySpark, SQL Technologies: AWS, Spark, HDFS, Hadoop, NiFi Tools: Confluence, GitHub, Jira, ServiceNow Data Visualization: Grafana, Tableau Operating Systems: Linux, Windows Optimization: Airflow, Hive, PySpark, SQL Responsibilities: Code Review | Workflow Scheduling | Data Pipeline Design | Development and Scheduling of Workflows: Cron, Queue, and Airflow Project Achievements: Focused on system improvements, ticket resolution, and implementing quality data alerts and optimization. Reduced ticket volume by 40% Reduced ticket volume by over 25% through task automation. Enhanced timely data delivery for ad-hoc requests by more than 25% through optimization and alert integration. Milestones & Achievements: Recognized as the Best Team Lead for exceptional leadership and improvement at Airtel. Successfully completed the People Manager Training program at Wipro. Awarded the Bravo Award for outstanding support to critical clients at Tata Elxsi.