Experienced Data Engineer with a strong background in designing and optimizing data solutions. Skilled in creating scalable data architectures, implementing advanced analytics, and ensuring data integrity for strategic decision- making. Committed to driving efficiency and innovation through collaborative problem-solving and the use of cutting-edge technology. **TECHNICAL SKILLS** BigData Platform : - AWS EMR,Huawei Fusion Insight, Cloudera, Azure Data Bricks BigData Technologies : - HDFS, Hive, Spark core, Spark SQL, Oozie, Spark Framework,Airflow Streaming (Real-time) : - Spark Streaming (DStream & Structured stream) & Kafka Languages : - Scala, Python (Pyspark), SQL, UNIX shell scripting Development tools : - Scala IDE, IntelliJ Cloud : - Azure Data Lake, Azure Data Factory, Azure Data Bricks Databases : - SnowFlake, Azure SQL DB, MS SQL Server, Oracle 11g ETL : - Talend Data Fabric (DI and Big data), TAC, Talend Cloud, TMC, Informatica Power Center, Informatica Cloud (IICS & ICAI) CICD : - Jenkins, Nexus, Maven, GIT