Data Lakehouse Architecture Review

mohammad atif

profile
Data Lakehouse Architecture Review
profile
5,000
30 mins

Building a modern data lakehouse with Iceberg, Trino, and Spark? I'll review your architecture, flag the gotchas, and help you build it right the first time — without expensive vendor lock-in.

  1. Apache Iceberg table design — partitioning, sort order, compaction strategy
  2. Trino + Iceberg stack — catalog setup, predicate pushdown, performance tuning
  3. Spark + Iceberg write patterns — CoW vs MoR, small file problem, merge strategy
  4. Open lakehouse vs Databricks/Snowflake — honest cost and capability comparison
  5. Catalog choice — Hive Metastore vs REST catalog vs AWS Glue vs Nessie

Data platform roadmap — what to build vs what to buy for your team size