spark/fundamentals
beginner
Connecting…

What happens when Spark executes a job?

Trace a groupBy + show() from lazy code through Catalyst plans, stages, tasks, shuffle, and the final result.

Explain it at my level

  1. Code
  2. Plan
  3. Job
  4. Stages
  5. Tasks
  6. Executors
  7. Shuffle
  8. Result
Loading execution simulation…