4.1.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Connect
Spark Connect server
application UI
Details for Stage 6 (Attempt 0)
Submitted:
2026/05/11 04:34:17
Duration
27 ms
Resource Profile Id:
0
Total Time Across All Tasks:
12 ms
Locality Level Summary:
Process local: 1
Associated Job Ids:
6
DAG Visualization
digraph G { id="graph_6"; subgraph graph_stage_6 { id="graph_stage_6"; isCluster="true"; label="Stage 6"; subgraph cluster_74 { id="cluster_74"; isCluster="true"; label="parallelize"; 33 [id="node_33" labelType="html" label="ParallelCollectionRDD [33]<br>Spark Connect - session_id: "4ab3976b-dcbe-4020-b06b-15c63f8fd1c7"\nuser_context {\n user_id: "iqran"\n}\nplan {\n root {\n common {\n pla...}"]; } subgraph cluster_75 { id="cluster_75"; isCluster="true"; label="mapPartitionsInternal"; 34 [id="node_34" labelType="html" label="MapPartitionsRDD [34]<br>Spark Connect - session_id: "4ab3976b-dcbe-4020-b06b-15c63f8fd1c7"\nuser_context {\n user_id: "iqran"\n}\nplan {\n root {\n common {\n pla...}"]; } subgraph cluster_76 { id="cluster_76"; isCluster="true"; label="WholeStageCodegen (1)"; 35 [id="node_35" labelType="html" label="MapPartitionsRDD [35]<br>Spark Connect - session_id: "4ab3976b-dcbe-4020-b06b-15c63f8fd1c7"\nuser_context {\n user_id: "iqran"\n}\nplan {\n root {\n common {\n pla...}"]; } subgraph cluster_79 { id="cluster_79"; isCluster="true"; label="mapPartitionsInternal"; 36 [id="node_36" labelType="html" label="MapPartitionsRDD [36]<br>Spark Connect - session_id: "4ab3976b-dcbe-4020-b06b-15c63f8fd1c7"\nuser_context {\n user_id: "iqran"\n}\nplan {\n root {\n common {\n pla...}"]; } } 33->34; 34->35; 35->36; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time