spark/performance
advanced
Connecting…

Adaptive Query Execution

AQE uses runtime stats to coalesce shuffle partitions, change join strategy, and split skewed partitions.

Explain it at my level

  1. Static 200
  2. Coalesce
  3. Join switch
  4. Skew split

200 shuffle partitions (static)