Experienced Data Engineer with approximately 6 years of expertise in data analysis and big data technologies. Proficient in handling massive datasets, I have 5 years of experience in preprocessing, transforming, and visualizing large-scale data using various analytical tools. Key Highlights: • Big Data Technologies: Over 5 years of hands-on experience with technologies such as Databricks, Spark, Hadoop, BigQuery, Airflow, Composer, Elasticsearch and Logstash. • Database Expertise: Worked extensively with SQL, NoSQL and distributed databases, including MySQL, Postgres, Oracle, and Clickhouse. • POC Involvement: Successfully contributed to various proof-of-concept projects involving big data technologies and data pipelines. • Analytical Skills: Detail-oriented with a keen eye for data patterns and insights. Technical Background • Programming languages: PySpark, Python, Core Java • Website Designing: Django, Javascript, Flask • Cloud Azure, GCP • Database Management: Oracle, Postgres, Clickhouse, Spark Sql, Hive, Big Query, Delta Lake • Technologies: o Analytics tools: Microsoft Excel, Power BI, Pandas, Numpy o Orchestrator: Airflow, Google Composer o Big Data: Databricks, Spark, HDFS, Presto, Dremio, Apache Lucene, Elasticsearch, Logstash