Services

Video meeting . 15 mins
FREE
Video meeting . 30 mins
800
Video meeting . 30 mins
800
Popular
Priority DM . 2 days reply
FREE
Video meeting . 30 mins
800
Video meeting . 60 mins
1,300

About me

• Cloud Data Engineer professional with ~7 years of industry experience in Telecom, Pharmaceutical , Public sector and Automobile domain. • In my professional experience, I have worked on end-to-end analytics projects that involved Data Analysis, Data Engineering, Performance Optimization and Analytics Framework development for solving business problems. • Worked on predictive machine learning solutions like Random forest, XGBoost to enable meaningful insight of the data and business process. • Created robust and scalable enterprise data pipelines for one of the larger pharmaceutical client using AWS EMR, Pyspark and Snowflake. • Hands on Experience in developing Data Pipeline to extract incremental/delta data from RDBM like Oracle using Pyspark and hive . • Developed generic Airflow Docker image for aws ec2 instance as per the ETL workloads so as to make a decoupled architecture with high availability. • Have in-depth understanding of AWS EMR and created transient cluster to reduce project expenditure. Scripting : Python (Numpy, Pandas, Sklearn, Matplotlib), UNIX Shell scripting, C. Cloud Services : AWS (EMR, S3, RDS, EC2, Athena, Glue, Crawler), Azure(Synapse, SQL ) Big Data Stack : Pyspark, Hive, HDFS, Presto, Spark, Hadoop, Sqoop Database System : Snowflake, Oracle, Elasticsearch, MySQL Version Control System : Git, Bitbucket Orchestration : Control-M, Apache Airflow. Certifications • AWS Certified Cloud Practitioner • AWS Certified Solutions Architect Associate • AWS Certified Solution Architect Professional • AWS Certified Developer Associate • AWS Certified Data Analytics Specialty • SnowPro Core Certified • Azure Data Fundamentals • Azure AI Fundamentals • Azure Certified Data Engineer