10+ years of hands-on expertise in Big Data, Python, Spark and JAVA technologies. Skilled in building Batch and Streaming pipelines using Kafka and Spark in Kubernetes environments. Extensive experience with the Hadoop ecosystem, focusing on Spark, Hive, Snowflake, Apache Phoenix, and Apache Atlas. Proficient in Docker-based applications, container orchestration with Kubernetes and Helm for deployment. Hands-on experience in AWS, Azure, and on-premises Airflow. Designed metadata-driven ingestion framework for banking solutions, ensuring efficiency and scalability. Strong background in both Java and Python-based frameworks. Designed real time streaming pipelines using Snowflake Streaming feature. Deployed pipelines on OpenShift using Helm Charts. Operational Data Store expertise in airport operations and analytics-driven data marts. 4+ years of experience with cloud platforms, including AWS and Azure DevOps. 5+ years working with Spark technologies, with a strong focus on performance and scalability. Adept in Agile methodologies (Scrum) for software development. Experienced in Big Data streaming, data ingestion patterns, and integration solutions.