Services
Video meeting . 60 mins
Data Engineering Guidance
Guidance on Data Engineering
About me
With over 13 years in application development, I have extensive experience in requirements gathering, development, integration, migration, unit testing, client interaction, implementation, go-live, and production support. I have worked as a Lead Data Engineer, Technical Lead, Team Lead, and Senior Data Engineer across various projects in the telecom and banking industries.
My technical expertise includes strong development skills, robust database management (both relational and cloud-based), and proficiency in ELT tools like IBM DataStage and Informatica. I have collaborated with diverse teams globally, including over 3 years with India's largest telecom company and more than 5 years with Asia's largest bank.
I have executed projects in telecom, retail, and banking, with deep knowledge of Big Data, PySpark, SQL, Teradata, HDFS, Hive, Sqoop, Amazon S3, Informatica, TWS Scheduling, Airflow, DataStage, AIX/Linux shell scripting, Python, Azure Databricks, ADLS Gen 2, Delta Lake, and Control-M. My experience covers full lifecycle development, system analysis, unit testing, and implementation in Teradata, Hive, and Delta Lake.
I excel in providing solutions based on client requirements, tuning SQL queries, performance optimization, developing ETL batch structures, and maintaining historical data as per SCD2 models. My strong communication, interpersonal skills, self-motivation, quick learning ability, and teamwork make me a valuable asset to any project.