spark/internals
advanced
Connecting…Tungsten execution engine
Tungsten stores rows off-heap and generates JVM bytecode for whole stages so Spark SQL is not a naive iterator of JVM objects.
Explain it at my level
- Off-heap
- Codegen
- Cache-aware
Step 1 of 4
Driver · SparkSession · DAG scheduler