Pipeline Review & Debug Session

In this session, I will take your through the following topics:

What is SQL and how its still relevant in modern sphere of data engineering.

SQL and modern ELT platforms.

Introduction to spark engine and how spark has speed up the computations.

SQL Wrappers and API build on spark.

Transformation from traditional database interaction to file based columnar storages.