spark/fundamentals
beginner
Connecting…Catalyst to Job — the action and the boundary
show() submits Job 0. groupBy inserts an Exchange — the shuffle boundary that will split stages.
- ✓ Lazy Evaluation
- Catalyst to Job
- Job to Stages
- Stages to Tasks
- Shuffle & Result
Explain it at my level
- Plan
- Job
- Boundary
Loading execution simulation…