-Well Versed in Azure Data Engineer and Spark Development Opportunity using Databricks. -Core expertise in Pyspark scripting, and Spark SQL. -Experience in ETL using Azure Data factory and an On-Premise tool called SSIS -Experience in working with Streaming datasets using Azure event hub and Azure IoT. -Hands-on Experience in Spark Core Framework, RDD, Data Frame, Dataset & Spark SQL. -Rich Experience in writing SQL scripts for Data validation and transformation. -Extensively worked on Spark SQL & Spark Streaming applications, Consuming real-time data from CSV files and performing various transformations on data using Spark SQL -Experience in CI/CD Deployment of workflows in Azure DevOps. -Experience in creating dashboards using the Power BI tool.