Concept
Batch Processing

Broadcast joins vs shuffle joins

Send a small table to every executor. Avoid the shuffle entirely.

✍️

This concept is being written.

The detailed explanation, examples, and diagrams for this topic are not published yet. In the meantime, here is what you can do: