Services
Video meeting . 15 mins
Video meeting . 30 mins
Video meeting . 30 mins
Priority DM . 2 days reply
Video meeting . 30 mins
Video meeting . 60 mins
About me
• Cloud Data Engineer professional with ~7 years of industry experience in Telecom, Pharmaceutical , Public sector and Automobile domain.
• In my professional experience, I have worked on end-to-end analytics projects that involved Data Analysis, Data Engineering, Performance Optimization and Analytics Framework development for solving business problems.
• Worked on predictive machine learning solutions like Random forest, XGBoost to enable meaningful insight of the data and business process.
• Created robust and scalable enterprise data pipelines for one of the larger pharmaceutical client using AWS EMR, Pyspark and Snowflake.
• Hands on Experience in developing Data Pipeline to extract incremental/delta data from RDBM like Oracle using Pyspark and hive .
• Developed generic Airflow Docker image for aws ec2 instance as per the ETL workloads so as to make a decoupled architecture with high availability.
• Have in-depth understanding of AWS EMR and created transient cluster to reduce project expenditure.
Scripting : Python (Numpy, Pandas, Sklearn, Matplotlib), UNIX Shell scripting, C.
Cloud Services : AWS (EMR, S3, RDS, EC2, Athena, Glue, Crawler), Azure(Synapse, SQL )
Big Data Stack : Pyspark, Hive, HDFS, Presto, Spark, Hadoop, Sqoop
Database System : Snowflake, Oracle, Elasticsearch, MySQL
Version Control System : Git, Bitbucket
Orchestration : Control-M, Apache Airflow.
Certifications
• AWS Certified Cloud Practitioner
• AWS Certified Solutions Architect Associate
• AWS Certified Solution Architect Professional
• AWS Certified Developer Associate
• AWS Certified Data Analytics Specialty
• SnowPro Core Certified
• Azure Data Fundamentals
• Azure AI Fundamentals
• Azure Certified Data Engineer