Project Leadership and Architecture: Directed project architecture and design, delivering scalable and efficient solutions tailored to business needs. Real-time Data Solutions: Developed real-time data solutions using GCP Pub/Sub, enabling timely and actionable insights. End-to-End Data Pipelines: Designed and implemented comprehensive data pipelines, consolidating data from diverse sources such as Hive and Python-based applications via APIs and Pub/Sub. Quality Assurance: Implemented Behave and unit testing frameworks, automated alerts, and issue creation for job anomalies, enhancing the reliability of data processes. DevOps Collaboration: Assisted the DevOps team in designing CI/CD pipelines using GitLab and Octopus, ensuring reliable and efficient job deployment. Cloud Integration: Transitioned on-prem solutions to the cloud by making them compatible with GCP, utilizing GCP buckets, Dataproc, and Postgres to meet client requirements. Team Leadership: Leading a team of Data engineers, defining tasks, gathering stakeholder requirements, managing work pipelines, and executing Agile processes to ensure project success.