Committed, goal – driven individual with 11 Years of experience as a Data Engineer(Big data/ Cloud) in service industry handling multiple clients at a time with an exceptional track record that demonstrate self-motivation, creativity, and initiative to achieve both corporate and personal goals, responsible for enhancing skills and productivity of team member. • Experience in building Cloud Data-warehouse using WhereScape on Snowflake. • Experience in Cloud-based solution with AWS and Azure like S3, Athena, Glue, Redshift, Airflow, Azure data Factory, Azure Synapse Analytics. • Involved in developing Big data Application by using Hadoop and its ecosystem( YARN,MapReduce, Hive, Sqoop, Oozie, HDFS, Kafka, Zookeeper), Spark, Scala, Structured (DataSet & DataFrame) and Unstructured APIs (RDD), Spark Streaming. • Well versed with Spark optimisation be it Resource/Cluster Level Optimisation • Implemented various Hive Structure level and Query Level Optimisation • Hands on experience of Partitioning, Bucketing, Map Join, Bucket Map Join , Join Optimisation, Broad cast variables, Accumulators, Transformations, Action, Repatriation, Coalesce, Converting DataFame to Dataset and vice versa, Spark - Resource/Cluster level optimisation, Dynamic/Static Resource allocation , Joins with RDD and DataFrame, Sort/Hash Aggregate. • Experience in developing Data Pipeline in ADF using Linked services, Datasets, Mapping Dataflow (Join/ Filter/Sort /lookup/pivot transformation) between ASLS gen2, Azure SQL Database, Snowflake, S3, Web • Implemented Validation/ Conditional/Deletion activity, various types of triggers and Parametrised Data Pipeline in ADF. • Worked on processing data in the scale of terabytes of daily data volume. • Data migration from TERADATA, MONGO-DB, MySQL to HADOOP framework at the same time from On Prem to Cloud. • Worked on processing data in the scale of terabytes of daily data volume. • Build Snowflake Capability from scratch where in trained close to 100+ resources and help them cracking certification and make them project ready for any upcoming projects.