• Having 8+ years of diversified experience in Software Design & Development. Experience as Big Data Engineer solving business use cases for several clients. Experience in the field of software with expertise in backend applications. • Excellent understanding of Hadoop architecture and underlying framework including storage management • Developed mappings in Informatica to load the data including facts and dimensions from various sources into the Data Warehouse, using different transformations like Source Qualifier, JAVA, Expression, Lookup, Aggregate, Update Strategy and Joiner. • Experience in Data load management, importing & exporting data using SQOOP&FLUME. • Experienced in Managing Database, Azure Data Platform services (Azure Data Lake(ADLS), Data Factory(ADF), Data Lake Analytics, Stream Analytics, Azure SQL DW, HDInsight/Databricks, NoSQL DB), SQL Server, Oracle, Data Warehouse etc. Build multiple Data Lakes. • Strong experience in analyzing large amounts of data sets writing PySpark scripts and Hive queries. • Experience in dealing with log files to extract data and to copy into HDFS using flume. • Experience in cloud data migration using AWS and Snowflake. • Running of Apache Hadoop, CDH and Map-R distros, dubbed Elastic MapReduce(EMR) on (EC2) • Implemented advanced procedures like text analytics and processing using the in-memory computing capabilities like Apache Spark written in Scala. • Designed various Data Visualizations, Charts, Dashboard for Analytical Projects to various business teams. • Scheduled all Hadoop/hive/Sqoop/HBase jobs using Oozie • Solid experience on Big Data Analytics with hands on experience in installing, configuring and using ecosystem components like Hadoop Map reduce, HDFS, HBase, Zookeeper, Hive, Sqoop, Pig, Flume, Cassandra, Kafka and Spark, Oozie, Airflow, NiFi(ETL) • Experienced with cloud: Hadoop-On-Azure, AWS/EMR, Cloudera Manager (also Direct-Hadoop-EC2 (non EMR) • Experience in using to analyze data from multiple sources and creating reports with Interactive Dashboards using power BI. • Good Understanding of Hadoop architecture and Hands on experience with Hadoop components such as Job Tracker, Task Tracker, Name Node, Data Node and Map Reduce concepts and HDFS Framework. • Extensively worked on AWS services like EC2, S3, EMR, FSx, Lambda, Cloud watch, RDS, Auto scaling, Cloud Formation, SQS, ECS, EFS, DynamoDB, Route53, Glue etc. • Extensive knowledge on designing Reports, Scorecards, and Dashboards using Power BI