DataYatriSpark, seen under the hood
Simulate
spark/fundamentals
beginner
Connecting…

Narrow vs wide transformations

Narrow transformations stay inside a partition. Wide ones shuffle. That difference is the stage boundary.

Lesson 7 of 29 · Spark path

Explain it at my level

  1. Narrow
  2. Wide
  3. Still lazy
  4. Action
Watch the canvas:narrow (no shuffle)wide (shuffle)Live simulation
filter / mapnarrowgroupBy(region)wide · Exchangeshow()actionfilter never asks another worker for rows.
Narrow stays put. Wide moves keys. Neither runs until an action.