An accomplished Data Engineering professional with over 8 years of expertise in scaling data-driven products. Throughout my career, I have honed my skills in crafting robust data solutions and leveraging cutting-edge technologies to drive business success. I bring extensive experience in various data technology areas including Data Platforms, Data lake and warehousing, ETL Processes, Data Insights, Big Data, and Cloud Platforms. As an experienced professional, I am well-versed in creating robust data architectures that are scalable, secure, and efficient to tackle complex data challenges. With a deep understanding of Big Data technologies and Amazon Web Services, I have successfully implemented integration and advanced analytics projects that have delivered value to businesses. I am proficient in a wide range of technologies, including Python, Scala, SQL, NoSQL, Spark Batch & Streaming, Kafka, Apache Hudi, Apache Pinot, Docker, Kubernetes, and Airflow, among others, which enables me to design and implement custom solutions that cater to unique business requirements. Additionally, I have expertise in Data Integration, Data Quality, Data Catalog, Data Governance, Data Discovery, Spark on K8s, Informatica, Talend, Alteryx, Qlik Sense, Tableau, Superset, OpenMetadata, Airbyte, Amazon Web Services such as Glue, EMR, MSK, EKS, Kinesis, Redshift, Athena, S3, Lambda, DMS, EC2, Lake Formation, ECR. As a passionate Data Engineering career coach, my mission is to assist aspiring data engineers in finding the right answers and empowering mid-career professionals to unlock their full potential. I thrive on guiding individuals to navigate the complexities of the data engineering landscape, equipping them with the knowledge and strategies needed to excel in this dynamic field. Together, let's pave the way for innovation and excellence in the realm of data engineering.