Spark Connect server - Details for Query 32

Submitted Time: 2026/05/11 04:44:57
Duration: 0.3 s
Succeeded Jobs: 18

Download

Plan Visualization

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [id="node0" labelType="html" label=" CollectLimit " tooltip="CollectLimit 21"]; subgraph cluster1 { isCluster="true"; id="cluster1"; label="WholeStageCodegen (1)\n \nduration: 0 ms"; tooltip="WholeStageCodegen (1)"; 2 [id="node2" labelType="html" label=" Project " tooltip="Project [toprettystring(raw_id#368L, Some(Etc/UTC)) AS raw_id#381, toprettystring(session_id#369, Some(Etc/UTC)) AS session_id#382, toprettystring(record_hash#370, Some(Etc/UTC)) AS record_hash#383, toprettystring(security_token#371, Some(Etc/UTC)) AS security_token#384, toprettystring(category_id#372, Some(Etc/UTC)) AS category_id#385, toprettystring(status#373, Some(Etc/UTC)) AS status#386, toprettystring(ts#374, Some(Etc/UTC)) AS ts#387, toprettystring(padding_data#375, Some(Etc/UTC)) AS padding_data#388]"]; 3 [id="node3" labelType="html" label="ColumnarToRow number of output rows: 5,000 number of input batches: 1" tooltip="ColumnarToRow"]; } 4 [id="node4" labelType="html" label="BatchScan bronze.test.test number of row deletes applied: 0 number of skipped delete files: 0 number of skipped data files: 0 total data manifests: 1 total planning duration (ms): 16 number of scanned delete manifests: 0 number of file splits read: 4 number of output rows: 5,000 number of skipped delete manifest: 0 total delete manifests: 0 number of equality delete files: 0 total data file size (bytes): 335692 number of indexed delete files: 0 number of positional delete files: 0 number of result delete files: 0 total delete file size (bytes): 0 number of scanned data manifests: 1 number of result data files: 8 number of skipped data manifests: 0" tooltip="BatchScan bronze.test.test[raw_id#368L, session_id#369, record_hash#370, security_token#371, category_id#372, status#373, ts#374, padding_data#375] bronze.test.test (branch=null) [filters=, groupedBy=] RuntimeFilters: []"]; 2->0; 3->2; 4->3; }

Plan Details

== Physical Plan ==
CollectLimit (4)
+- * Project (3)
   +- * ColumnarToRow (2)
      +- BatchScan bronze.test.test (1)


(1) BatchScan bronze.test.test
Output [8]: [raw_id#368L, session_id#369, record_hash#370, security_token#371, category_id#372, status#373, ts#374, padding_data#375]
bronze.test.test (branch=null) [filters=, groupedBy=]

(2) ColumnarToRow [codegen id : 1]
Input [8]: [raw_id#368L, session_id#369, record_hash#370, security_token#371, category_id#372, status#373, ts#374, padding_data#375]

(3) Project [codegen id : 1]
Output [8]: [toprettystring(raw_id#368L, Some(Etc/UTC)) AS raw_id#381, toprettystring(session_id#369, Some(Etc/UTC)) AS session_id#382, toprettystring(record_hash#370, Some(Etc/UTC)) AS record_hash#383, toprettystring(security_token#371, Some(Etc/UTC)) AS security_token#384, toprettystring(category_id#372, Some(Etc/UTC)) AS category_id#385, toprettystring(status#373, Some(Etc/UTC)) AS status#386, toprettystring(ts#374, Some(Etc/UTC)) AS ts#387, toprettystring(padding_data#375, Some(Etc/UTC)) AS padding_data#388]
Input [8]: [raw_id#368L, session_id#369, record_hash#370, security_token#371, category_id#372, status#373, ts#374, padding_data#375]

(4) CollectLimit
Input [8]: [raw_id#381, session_id#382, record_hash#383, security_token#384, category_id#385, status#386, ts#387, padding_data#388]
Arguments: 21