As an Associate Technical Lead at Sigmoid, I work with a team of data engineers to provide innovative data solutions across industries. I have more than 9 years of experience working with multi-cloud services and various big data tools and technologies, such as Kafka, Spark, Redshift, Bigquery, Snowflake, DBT, Airflow, and Glue. I am also pursuing an Advanced Certification in Machine Learning and Cloud from the Indian Institute of Technology, Madras, to enhance my skills and knowledge in this domain. Previously, I completed a PG Diploma in Machine Learning and AI from the International Institute of Information Technology Bangalore, and a PG Certificate in Big Data and Analytics from the Birla Institute of Technology and Science, Pilani. I have a BTech degree in Electrical and Electronics Engineering from KiiT University. Experience in: • Hands-on development experience on Cloudera Hadoop Distribution. • Worked on Java, Scala, and Python languages. • Strong experience in Apache Kafka, Producer, and consumer. • Good Understanding of Apache Spark, Spark SQL, and Structured Streaming. • Worked on databases like Hive, Impala, BigQuery, Snowflake, and RedShift. • Experienced with Docker container and Kubernetes • Expertise in Amazon web Services like Redshift, EMR, S3, Lambda, Kinesis Stream, and DynamoDB. • Data Pipeline, DMS, Airflow, Glue ETL, DataFlow and StepFunction • Hands-on experience with Elastic search, Logstash, and Kibana. • Experience in relational database concepts with a solid knowledge of SQL, including the ability to write complex queries against one or more schemas.