• Senior Software Engineer at ZS and Lead Data Engineer at Dunnhumby with specialization in Big Data technologies like Spark and Presto as query engines, Hadoop as storage machines and cloud environments like AWS and GCP. • Built and implemented backend system using AWS technologies like Lambda, SQS, EC2, S3, Dynamo DB. • Deployed the AWS project as a container with endpoint exposed publically and securely using OAuth Authentication. • Worked on improving application reliability by optimising CPU and memory performance of applications using different techniques e.g. perf, bpfprofiler etc. • Worked on improving network performance and reliability by tracing network packets using tcpdump, wireshark and suggested improvements on congestion control algorithms. • Created statistical model using different optimization algorithms like Travelling Salesman, Non-negative Matrix Factorization, Alternating Least Squares, Simplex and Least Squares to optimize store layout given product performance for a major retailer based out of North America. • Created and trained ML models using different optimization algorithms like Travelling Salesman, Non-negative Matrix Factorization, Alternating Least Squares, Simplex and Least Squares to optimize store layout given product performance for a major retailer based out of North America. • Hands on experience with DevOps tools like Docker, Terraform, Kubernetes, RabbitMQ, Gitlab CI/CD for more than 3 years. Technical Skill: • Technology expertise spans traditional BI/DW, Reltio MDM Solution and Big Data Ecosystem. Significant hands-on experience in Informatica, Oracle, SQL, VBA, Hive, Spark and Excel • More than 7 years of hands-on experience in the areas of statistical modeling using machine learning algorithms and Design and Development of ETL processes, Data Warehousing, Data Migration and skilled in technologies like Hadoop, PySpark, Python, Hive and Google cloud platform (GCP). • Operating System: CentOS/Redhat, Windows, VMWare, Oracle Virtual Box • Computer Languages: Linux scripting in bash, Python, Scala, Java, Javascript, C/C++, C# • Networking: Static IP assignment, NIC management, FTP, NFS, NTP/Chronyd, HTTPD, DNS/Bind, rsyslog • Linux Sendmail, DNS, SSH, SCP, etc • Database: PostgreSQL, MySQL, Redshift, DynamoDB, Hive, Impala, Amazon RDS, ElastiCache • Cloud : AWS, GCP, Microsoft Azure