Big data Consultant - AWS Cloud

Subject matter expert with more than 7 years of building big data solutions on AWS.

1. AWS Athena - ELT pipeline
2. AWS Glue - Data Catalog, Crawler, ETL Spark Job
3. AWS EMR - Spark, HBase on S3, PrestoDB
4. AWS Redshift
5. Datalake on S3
6. Orchestration: AWS Lambda
7. Data visualization:- Apache Superset, Metabase, AWS QuickSight

Industry experience

CastLight Health

1. Claim data pipeline and processing using Greenplum

CreditVidya

1. Build infrastructure to manage 120 TB of data
2. HBase on S3 to manage production data of 16 TB +
3. Build Datalake on S3
4. AWS EMR elastic cluster to manage workload consisting of 3 TB RAM (peak time)

Acresium (DESHAW)

1. Spark Pipeline Job
2. SnowFlake