Spark Connect Session

  • Session ID: 4ab3976b-dcbe-4020-b06b-15c63f8fd1c7
  • Started at: 2026/05/11 04:21:55
  • Time since start: 2 days 16 hours 38 minutes

User iqran , Session created at 2026/05/11 04:34:17 , Total run 5 Request(s)

Request Statistics

Page:
User Job ID SQL Query ID Start Time ▾ Finish Time Close Time Execution Time Duration Statement State Operation ID Job Tag Spark Session Tags Detail
iqran 2026/05/11 04:34:46 2026/05/11 04:34:46 2026/05/11 04:34:46 34 ms 65 ms sql_command { input { common { plan_id: 7 } sql { query: "SELECT count(*), status FROM bronze.test.test GROUP BY status" } } } CLOSED f014b0b5-826b-43a1-8b49-92b238e8c2dd SparkConnect_OperationTag_User_iqran_Session_4ab3976b-dcbe-4020-b06b-15c63f8fd1c7_Operation_f014b0b5-826b-43a1-8b49-92b238e8c2dd INTERNAL +details
iqran [7][8] [14][15] 2026/05/11 04:34:40 2026/05/11 04:34:42 2026/05/11 04:34:42 1 second 675 ms 1 second 689 ms sql_command { input { common { plan_id: 5 } sql { query: "\nCREATE TABLE bronze.test.test \nUSING iceberg \nAS\nWITH base_data AS (\n -- Generates 1,000 initial rows\n SELECT \n id as raw_id,\n uuid() as session_id,\n CAST(rand() * 10000 AS INT) as category_id,\n CASE WHEN rand() > 0.5 THEN \'ACTIVE\' ELSE \'INACTIVE\' END as status,\n current_timestamp() as ts\n FROM range(1000)\n),\nexploded_data AS (\n -- Cross join to explode 1,000 rows to 1,000,000 rows\n -- Increase the range(1000) to 10000 if you want 10M rows\n SELECT a.* \n FROM base_data a\n CROSS JOIN (SELECT id FROM range(1000)) b\n)\nSELECT \n raw_id,\n session_id,\n -- Complex hashing to stress CPU/Executors\n sha2(concat(CAST(raw_id AS STRING), session_id), 256) as record_hash,\n sha2(reverse(session_id), 512) as security_token,\n -- Analytical transformations\n category_id,\n status,\n ts,\n -- Add some junk data to increase file size (S3 stress)\n repeat(sha2(CAST(raw_id AS STRING), 256), 5) as padding_data\nFROM exploded_data;\n" } } } CLOSED 99c0fa8d-d144-4286-9401-592967857868 SparkConnect_OperationTag_User_iqran_Session_4ab3976b-dcbe-4020-b06b-15c63f8fd1c7_Operation_99c0fa8d-d144-4286-9401-592967857868
iqran [13] 2026/05/11 04:34:35 2026/05/11 04:34:35 2026/05/11 04:34:35 488 ms 506 ms sql_command { input { common { plan_id: 3 } sql { query: "CREATE NAMESPACE IF NOT EXISTS bronze.test" } } } CLOSED 875eb492-e7be-4e66-b9a6-30330230f4a4 SparkConnect_OperationTag_User_iqran_Session_4ab3976b-dcbe-4020-b06b-15c63f8fd1c7_Operation_875eb492-e7be-4e66-b9a6-30330230f4a4
iqran [6] [12] 2026/05/11 04:34:17 2026/05/11 04:34:17 2026/05/11 04:34:17 57 ms 72 ms common { plan_id: 2 } show_string { input { common { plan_id: 1 } sql { query: "SELECT \'READY\' AS STATUS" } } num_rows: 20 truncate: 20 } CLOSED ab7f8859-b372-4654-9343-a053ef0091e3 SparkConnect_OperationTag_User_iqran_Session_4ab3976b-dcbe-4020-b06b-15c63f8fd1c7_Operation_ab7f8859-b372-4654-9343-a053ef0091e3
iqran 2026/05/11 04:34:17 2026/05/11 04:34:17 2026/05/11 04:34:17 4 ms 18 ms sql_command { input { common { plan_id: 0 } sql { query: "SELECT \'READY\' AS STATUS" } } } CLOSED a1652f58-52d5-44d5-8437-205b3511b8ee SparkConnect_OperationTag_User_iqran_Session_4ab3976b-dcbe-4020-b06b-15c63f8fd1c7_Operation_a1652f58-52d5-44d5-8437-205b3511b8ee
Page: