spark/internals
beginner
Connecting…Driver vs executors
The driver plans. Executors run tasks. collect() and toPandas() pull data to the driver — that is how it dies.
Explain it at my level
- Driver
- Executors
- Result
Step 1 of 4
Driver · SparkSession · DAG scheduler