Apache Spark Job Optimisation

I have more than 6 years of experience working with Apache Spark. I have processed TBs of data using Apache Spark (Pyspark and Spark SQL).

I will help you with:

1. Identify bottlenecks in the current Spark profile
2. Recommend various Spark Optimisation techniques
3. Fine Tune Spark Configuration