spark/internals
intermediate
Connecting…Jobs, stages, and tasks
An action creates a job. Shuffle boundaries split the job into stages. Each partition in a stage is a task.
Explain it at my level
- Job
- Stage
- Task
Loading execution simulation…
An action creates a job. Shuffle boundaries split the job into stages. Each partition in a stage is a task.
Explain it at my level