spark/fundamentals
beginner
Connecting…Why Spark is lazy
Spark waits so Catalyst can push filters into scans and skip unused columns. Eager execution would waste I/O.
Explain it at my level
- Read
- Transform
- Action
Step 1 of 4
read parquet
→filter region
→groupBy region
→count() ⚡