About me

As an accomplished Senior Data Engineer with over 13 years of IT Experience, I have a proven track record working in the data-driven, data-sensitive and data-centric projects. As a Senior Data Engineer I am currently responsible for the design and development of a scalable, optimized, reusable, maintainable and efficient Cloud data solution in the Azure Cloud. Core Skills: ▫️Azure Data Factory ▫️SQL & T- SQL ▫️Azure Databricks ▫️PySpak/Python ▫️Spark SQL ▫️Azure Blob/ADLS Gen2 ▫️Azure Synapse Analytics ▫️Azure Analysis Services ▫️Azure DevOps CI/CD pipeline Other Skills: ▫️ARM Template ▫️Azure Active Directory ▫️Data Modelling ▫️MS Power BI Soft Skills: ▫️Strong Communication Skills ▫️Mentoring Juniors ▫️Stakeholder Management Leadership: ▫️ Team lead ▫️ Mentor Juniors ▫️ Delegate Tasks Domain: ▫️ Financial Services ▫️ Banking ▫️ Insurance ▫️ Capital Market ▫️ Retail ▫️ Enterprise Application With my exceptional skills in Azure cloud technologies, I developed optimal ADF pipelines, batch processing, error handling and alerting mechanism, data load automation, Polybase technology and data transformations using Azure Databricks, PySpark and Spark SQL. Apart from technical implementations, I have also contributed in implementing RBAC security in AAD, code version control in ADO and release process using CI/CD Azure DevOps pipelines. I have also played a significant role in onboarding new and critical applications into Azure services, define application standards, identify areas of improvements and building support and operational model. Overall, these solutions were instrumental in creating seamless data ingestion, data transformation and dynamic PowerBI dashboard reports that provided valuable insights to business stakeholders, enabling them to make informed decisions.