Testimonials
Mayank is very helpful and has cleared most of my doubt regarding the data engineering concepts. Appreciated...!!
I appreciate your advice today. Your ideas were priceless and have made me see things differently now.
About me
Author of the book - Ultimate Data Engineering with Databricks
https://amzn.eu/d/aTjizkz
With 8.5+ years of experience as a Data Engineering Specialist, I've honed my skills across various retail, banking, and finance sectors. My journey has equipped me with a robust toolkit to tackle data challenges headon. I specialize in the following data solutions:
Tools & Technologies:
⚙️PySpark
⚙️Databricks
⚙️SQL
⚙️Python
⚙️Apache Airflow
⚙️Hive
⚙️Unix
Cloud Platforms:
☁️ AWS Redshift, S3, and AWS Managed Airflow,
☁️ Azure ADLS, ADB, ADF, Synapse
I have worked on the following data solutions:
💼Proficient in optimizing (finetuning) Spark jobs for increased efficiency, cost effectiveness, and meeting SLAs promptly.
💼Data Cleaning, Analysing and Processing.
💼Creating Robust, scalable and optimized Data Pipelines following industry standards.
💼Data Migration
💼Data Modelling for optimized workloads as per requirements.
Certifications
🏅Databricks Certified Associate Developer for Apache Spark
🏅Databricks Certified Data Engineer Associate
🏅AWS CLF01
🏅 Azure AZ -900
🏅Data Architect Associate by MIT Professional Education
Achievements
🏆5X Certified in Databricks
🏆Authored book on Databricks