spark/fundamentals
beginner
Connecting…Narrow vs wide transformations
Narrow transformations stay inside a partition. Wide ones shuffle. That difference is the stage boundary.
Explain it at my level
- Narrow
- Wide
- Shuffle
Step 1 of 4
read parquet
→filter region
→groupBy region
→count() ⚡