spark/fundamentals
beginner
Connecting…

Lazy Evaluation — Code to Plan

Why groupBy does nothing until show(), and how Catalyst turns that code into a plan before any byte moves.

  1. Lazy Evaluation
  2. Catalyst to Job
  3. Job to Stages
  4. Stages to Tasks
  5. Shuffle & Result

Explain it at my level

  1. Code
  2. Plan
Loading execution simulation…