As a seasoned Data Engineer with over 6.2 years of specialized experience in Big Data and Cloud (AWS) and over 8.6 years of comprehensive experience in Business Intelligence (BI) and Data Warehousing (DW), I excel in transforming complex data into strategic insights across Media, Insurance, and Finance sectors. My expertise includes the end-to-end lifecycle of data engineering projects—from analysis, design, and development to testing and implementation. I have a proven track record of delivering robust BI solutions using Data Warehouse, Data Mart, and Data Lake designs, employing advanced ETL processes and OLAP methodologies. I possess strong capabilities in Dimensional Modeling, employing both Star and Snowflake schemas, and have a deep understanding of identifying Facts and Dimensions, as well as physical and logical data modeling. My extensive experience includes ETL operations from diverse sources—relational, semi-structured files, and API calls—into staging areas, ODS, Data Warehouses, and Data Marts using tools like Informatica Power Center, IICS, Matillion, Alteryx and Python on MySQL, IBM Netezza, SQL Server, and Amazon Redshift databases. I am adept at leveraging Apache Spark for large-scale data processing, utilizing PySpark to implement complex data transformations and optimize processing pipelines. My experience with Spark includes developing and managing data workflows, ensuring high performance and scalability for data-intensive applications. My technical acumen extends to developing complex SQL queries, stored procedures, functions, and views, coupled with adeptness in performance tuning and resolving ongoing maintenance issues. I am proficient in monitoring and optimizing Informatica workflows, ensuring seamless and efficient data operations. Proven ability to lead teams, mentor junior engineers, and deliver high-quality, on-time technical solutions. Technologies: Big Data Technologies: Apache Spark, Pyspark , Apache Hudi Programming Languages: SQL, Python, Pyspark, Unix Shell script AWS Services: S3, Athena, EMR, EC2, DynamoDB, DMS, EKS, Lambda, QuickSight, CloudWatch, SNS, MWAA Scheduler : Apache Airflow ETL Tools: Informatica Power Center 9.1/10.2, Alteryx, Matillion, IICS BI Tool : Microstrategy , QuickSight Containerization : Docker, Kubernetes