spark/fundamentals
beginner
Connecting…

Actions that trigger jobs

Transformations build a DAG. Actions (count, show, collect, write) submit a job.

Lesson 8 of 29 · Spark path

Explain it at my level

  1. show()
  2. count()
  3. collect()
  4. write()
Watch the canvas:safe resultdriver pullwrite to storageLive simulation
show()few rowscount()one integercollect()all rows → driverwrite()files on S3A small pull. The shuffle underneath can still be huge.
show / count / collect / write — four actions, four different driver costs.