DataYatriSpark, seen under the hood
Simulate

Simulation/Spark

Educational simulation
Spark

Spark SQL & the catalog

A SQL string and a DataFrame converge on one physical plan.

Watch the canvas:DataFrame APISQL textcataloglogical planphysical planactionLive simulation
Two front doorsDataFrame APIdf.filter(col("region") == "US")SQL textSELECT * FROM orders WHERE region='US'Catalogname → plantemp view / Unity / HiveParseUnresolved logical plannot built yetAnalyzeAnalyzerlocked🔒OptimizeCatalyst optimizerlocked🔒ExecutePhysical planlocked🔒collect() — Job 0no action yet🔒A temp view is a name, not a copy. Session-scoped, zero bytes.
spark.sql() and df.filter() parse to the same tree, resolve against the same catalog, and end as one identical physical plan.