spark/core
intermediate
Connecting…

Join strategies in Spark

Sort-merge shuffles both sides. Broadcast copies the small side. The wrong choice shuffles terabytes.

Explain it at my level

  1. Scan
  2. Strategy
  3. Join
orders · 2 TBfact · 8B rows
regions · 20 MBdimension · 12 rows