spark/performance
senior
Connecting…

Data skew

When one key owns most of the data, one task becomes the stage. Salt or AQE skew join.

Explain it at my level

  1. Even
  2. Hot key
  3. Straggler
  4. Salt

Reduce tasks

US · 25%2.1 min
EU · 12%2 min
IN · 5%2 min
BR · 3%2 min