4.1.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Connect
Spark Connect server
application UI
Details for Stage 9 (Attempt 0)
Submitted:
2026/05/11 04:36:10
Duration
47 ms
Resource Profile Id:
0
Total Time Across All Tasks:
29 ms
Locality Level Summary:
Process local: 1
Associated Job Ids:
9
DAG Visualization
digraph G { id="graph_9"; subgraph graph_stage_9 { id="graph_stage_9"; isCluster="true"; label="Stage 9"; subgraph cluster_107 { id="cluster_107"; isCluster="true"; label="parallelize"; 46 [id="node_46" labelType="html" label="ParallelCollectionRDD [46]<br>Spark Connect - session_id: "61ec31aa-ec60-4847-8384-fe1f77644a71"\nuser_context {\n user_id: "iqran"\n}\nplan {\n root {\n common {\n pla...}"]; } subgraph cluster_108 { id="cluster_108"; isCluster="true"; label="mapPartitionsInternal"; 47 [id="node_47" labelType="html" label="MapPartitionsRDD [47]<br>Spark Connect - session_id: "61ec31aa-ec60-4847-8384-fe1f77644a71"\nuser_context {\n user_id: "iqran"\n}\nplan {\n root {\n common {\n pla...}"]; } subgraph cluster_109 { id="cluster_109"; isCluster="true"; label="WholeStageCodegen (1)"; 48 [id="node_48" labelType="html" label="MapPartitionsRDD [48]<br>Spark Connect - session_id: "61ec31aa-ec60-4847-8384-fe1f77644a71"\nuser_context {\n user_id: "iqran"\n}\nplan {\n root {\n common {\n pla...}"]; } subgraph cluster_112 { id="cluster_112"; isCluster="true"; label="mapPartitionsInternal"; 49 [id="node_49" labelType="html" label="MapPartitionsRDD [49]<br>Spark Connect - session_id: "61ec31aa-ec60-4847-8384-fe1f77644a71"\nuser_context {\n user_id: "iqran"\n}\nplan {\n root {\n common {\n pla...}"]; } } 46->47; 47->48; 48->49; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time