This is not the awesome PDF you'll see but this has a lot of tips and tricks to optimize your spark pipelines. I did it myself. 66% reduction in time/vcpu usage. You can too...