Driving the Data pipelines for insights of key Walmart initiatives and helping the stakeholders take data driven decisions. Worked on distributed systems and creating efficient data pipelines along with orchestration of Jobs. Experience in Product Integrations, Building Spark/Hadoop based Applications, Scheduling Data Pipelines via Airflow, Implementation of AWS Services, Deployment on Kubernetes and Docker. Previously was involved in Building the Expense Management Product with planning the features, Product Roadmaps, Data Integrations, API Integrations, Product Implementation. Tech Stack - Apache Spark , Apache Hudi , Deltalake , Streaming ,Hive , Hadoop ,Apache airflow Data Platforms Handled - AWS EMR , AWS S3 , Bigquery , Dataproc , SFTP/FTP , HDFS , Kafka Languages - Python , SQL,Java , Scala , C