Simulation/Databricks

Educational simulation
Databricks

Workflows

A task DAG with fan-out, per-task retries, and skipped children.

Watch the canvas:ingest tasktransform taskserving taskjob cluster / serverlessretry + run_iffailed / all-purposeskippedrepair runLive simulation
Job DAG — orders_dailybronze_ingestAuto Loader → bronzeNBsilver_ordersdedupe + type · MERGENBsilver_customersdbt build · dim_customerDBTgold_metricsgold.daily_metricsSQLCompute per taskJob clustercreated per run · dies at the endJobs Compute rate · job_cluster_keyAll-purpose clusterinteractive · stays alive afterpremium rate · the quiet mistakeServerless jobsno provisioning waitper task · nothing to sizeEach task has its own type, parameters, and compute — that is the whole point.
Tasks, dependencies, per-task compute, per-task retries — and a repair that re-runs one branch.