Passionate and dependable developer boasting 5+ years of extensive experience and a robust knowledge foundation. Proficiently manage and process large-scale data sets streaming and batch both. 1. Proficiently constructed Structured ETL Pipelines utilizing SPARK and AWS, alongside adept SQL database development skills, showcasing mastery in composing advanced SQL queries. 2. Demonstrated prowess in crafting Data Validation pipelines using Python. 3. Engineered dynamic pipeline generation through Airflow scripting. 4. Profound involvement in comprehensive data analysis, cleansing, modeling, and exploratory data analysis. Proficiently established SCD2 tables in PySpark. 5. Equipped with adeptness in statistical programming environments like Python/Pandas. 6. Well-acquainted with Amazon Cloud Services (AWS) landscape, including Kinesis and IoT Core, augmenting proficiency with AWS Lambda. 7. Proficiently employed Azure DevOps for streamlined development workflows. 8. Acquired knowledge in Machine Learning methodologies to derive valuable insights. Specialties: Database Management, Data Warehousing, Robust ETL Pipeline Design, and Insightful Data Visualization with Athena. Technical Proficiency: AWS Ecosystem (including Kinesis, IoT Core, Lambda), PySpark Expertise, Hadoop Familiarity, Airflow Competence, Hive Utilization, Proficiency in Python, SQL Mastery, Database Management, Azure DevOps, Machine Learning Integration, Tableau, Cloud Solutions. Methodological Approach: Adept in Software Development Life Cycle (SDLC), Proficient in Agile Methodologies.