4.1.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Connect
Spark Connect server
application UI
Details for Stage 4 (Attempt 0)
Submitted:
2026/05/11 04:30:02
Duration
28 ms
Resource Profile Id:
0
Total Time Across All Tasks:
13 ms
Locality Level Summary:
Process local: 1
Associated Job Ids:
4
DAG Visualization
digraph G { id="graph_4"; subgraph graph_stage_4 { id="graph_stage_4"; isCluster="true"; label="Stage 4"; subgraph cluster_48 { id="cluster_48"; isCluster="true"; label="parallelize"; 21 [id="node_21" labelType="html" label="ParallelCollectionRDD [21]<br>Spark Connect - session_id: "8c0de3c6-0219-44ff-b69c-319d15b20457"\nuser_context {\n user_id: "iqran"\n}\nplan {\n root {\n common {\n pla...}"]; } subgraph cluster_49 { id="cluster_49"; isCluster="true"; label="mapPartitionsInternal"; 22 [id="node_22" labelType="html" label="MapPartitionsRDD [22]<br>Spark Connect - session_id: "8c0de3c6-0219-44ff-b69c-319d15b20457"\nuser_context {\n user_id: "iqran"\n}\nplan {\n root {\n common {\n pla...}"]; } subgraph cluster_50 { id="cluster_50"; isCluster="true"; label="WholeStageCodegen (1)"; 23 [id="node_23" labelType="html" label="MapPartitionsRDD [23]<br>Spark Connect - session_id: "8c0de3c6-0219-44ff-b69c-319d15b20457"\nuser_context {\n user_id: "iqran"\n}\nplan {\n root {\n common {\n pla...}"]; } subgraph cluster_53 { id="cluster_53"; isCluster="true"; label="mapPartitionsInternal"; 24 [id="node_24" labelType="html" label="MapPartitionsRDD [24]<br>Spark Connect - session_id: "8c0de3c6-0219-44ff-b69c-319d15b20457"\nuser_context {\n user_id: "iqran"\n}\nplan {\n root {\n common {\n pla...}"]; } } 21->22; 22->23; 23->24; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time