Data
Yatri
Spark, seen under the hood
Home
Simulation
Lessons
Interview
Start Simulation
Simulate
Simulation
/
Spark
Educational simulation
Spark
AQE Simulator
Runtime coalesce, join switch, and skew split.
Play
Next
Reset
Step
1
of 4
1
Static
2
Coalesce
3
Join switch
4
Skew split
Watch the canvas:
shuffle partition
skewed partition
Live simulation
200 shuffle partitions (static default)
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
·
SortMergeJoin
planned from stale estimates
BroadcastHashJoin
build side measured at 8 MB
part-7a
quarter of the hot key
part-7b
quarter of the hot key
part-7c
quarter of the hot key
part-7d
quarter of the hot key
AQE re-plans between stages using measured sizes instead of estimates.
