Data Engineering Consultation

Sumit Medhavi

profile
Popular
Data Engineering Consultation
profile
200
60 mins

Struggling to design scalable, high-performance data pipelines? I help teams and individuals build production-ready data solutions using modern cloud and big-data technologies.

Technologies I Work With

  1. Python (ETL, automation, data processing, charts, graphs)
  2. AWS (S3, Glue, Lambda, EC2, Redshift, API Gateway, Secrets Manager, DMS)
  3. Pandas (analysis, transformations, prototyping)
  4. PySpark (large-scale distributed processing)
  5. Databricks (Spark jobs, Delta Lake, optimization)
  6. FastAPI (High-performance data APIs & backend services)
  7. Snowflake (data modeling, performance tuning, procedures, snowpipe, data streams, task, report monitor, clustering)
  8. SQL (advanced analytics, optimization, warehousing, complex sql queries)

What I Can Help You With

  1. Designing scalable data pipelines (batch & streaming)
  2. ETL / ELT architecture for real-world production systems
  3. Creating and manipulating snowflake data warehouse.
  4. Performance optimization for Spark, SQL & Snowflake
  5. Cloud-native AWS data engineering solutions
  6. Debugging & improving existing data workflows
  7. Best practices used by industry-grade data teams