Data
Yatri
Spark, seen under the hood
Home
Simulation
Lessons
Interview
Start Simulation
Simulate
Simulation
/
Spark
Educational simulation
Spark
Jobs, stages, tasks
One action, shuffle cuts, one task per partition.
Play
Next
Reset
Step
1
of 4
1
Job
2
Stage
3
Task
4
UI
Watch the canvas:
job
stage
task
Live simulation
Job 0 · show()
Stage 0
map / FileScan + filter
Stage 1
reduce / aggregate
Task 0
Task 1
Task 2
Task 3
The action is the job.
Job = action. Stage = shuffle slice. Task = one partition in that stage.