Experienced & Skilled in Big Data Technologies (Spark, Hadoop, Hive) Excellent understanding of Hadoop Architecture and underlying Hadoop framework including Storage Management. Managed data coming from different sources and involved loading of structured and semi structured data. Worked on Big Data Hadoop, Hive, Sqoop, Scala, Spark, Spark Core, Spark SQL. Experience in importing and exporting data using Sqoop from RDBMS to HDFS. Worked with Big Data distributions Cloudera. Expert in writing SQL Queries and query analysis for good performance. Written Spark SQL queries for structured data using different functions. Developed Spark scripts by using Scala shell commands as per the requirement. Implemented Spark using Scala and Spark SQL for faster testing and processing of data. Applied different types of transformations in Hive. Created Hive tables to store the processed results in a tabular format. Developed the Sqoop scripts in order to make the interaction between Hive and MySQL Database. Data Ingestion using Sqoop from MySQL to HDFS. Created Hive tables to store the processed results in a tabular format. Created Hive tables for Partitioning and Bucketing for better Performance using structured data.