Currently working as Lead Data Engineer at Collabera with over 6.4 years experience in Business Intelligence, ETL Development, Data Warehousing, and Data Lake with extensive focus on handling big data and implementing medium and large-scale, complex Data Warehouse Applications / Data Migration projects. Languages: Scala, Python, Spark, Pyspark, SQL Big-Data Framework: HDFS, Hive, Sqoop, Delta-Lake, Snowflake and Airflow Streaming Framework: Kafka ,Spark Streaming ,Confluent ,Ksql-DB, kafka-Connect Azure Cloud:Databricks, Data Factory, Delta-lake, Synapse, SQL-server AWS Cloud: S3, Kinesis, Glue, CloudWatch, Redshift, Lambda, Emr, Athena Others: Docker, Jenkins, GitHub, CI/CD Data Pipelines