DataYatriSpark, seen under the hood
Simulate
databricks
advanced
Connecting…

Photon

Photon is Databricks' native vectorized engine. Eligible operators run off-JVM; UDFs often fall back to Spark.

Explain it at my level

  1. JVM
  2. Photon
  3. Explain
  4. When
Watch the canvas:JVM SparkPhoton nativeUDF fallbackLive simulation
FileScanParquetFilterJVMHashAggregateJVMClassic Spark operators in the JVM — the baseline.
Photon is a native engine beside Spark — eligible operators only.