spark/fundamentals
beginner
Connecting…

What is Apache Spark?

Spark is a distributed compute engine. You write a plan; a driver turns it into tasks that executors run on partitions.

Explain it at my level

  1. Driver
  2. Cluster
  3. Executors
  4. Result
Driver · SparkSession · DAG scheduler