tracking: improve log and error message

[bohutang]

Summary

• improve http handler log and error message chore: improve the http handler log and error message #17958
• chore(query): refine the log and error message #17993

[bohutang]

#18211

[forsaken628]

Let's take a closer look at this log

raw:

8eab8707-4c07-45a4-8a93-3f8ddcfd8bc5 2025-08-01T11:34:47.314390+08:00  INFO databend_query::pipelines::processors::transforms::aggregator::transform_single_key: transform_single_key.rs:177 [TRANSFORM-AGGREGATOR] Single key aggregation completed: 4 → 1 rows in 0.01s (real: 0.00s), throughput: 596.82 rows/sec, 8.88 KiB/sec, total: 61.00 B

explain:

query_id:  8eab8707-4c07-45a4-8a93-3f8ddcfd8bc5
time:      2025-08-01T11:34:47.314390+08:00
level:     INFO
target:    databend_query::pipelines::processors::transforms::aggregator::transform_single_key
file:      transform_single_key.rs:177
subsystem: [TRANSFORM-AGGREGATOR]
message:   Single key aggregation completed: 4 → 1 rows in 0.01s (real: 0.00s), throughput: 596.82 rows/sec, 8.88 KiB/sec, total: 61.00 B

We can see that subsystem actually contains the same information as target, so I recommend introducing a renderer to map high-cardinality targets into a limited set of semantic categories instead of maintaining them manually.

In addition, target is also used for log filtering, so we need to consider whether we need to improve the syntax of the filtering rules to make it easier to use.

Finally, it is also recommended to refactor the logs into structured logs for easier log post-processing.

databend/src/query/service/src/servers/http/v1/query/http_query.rs

Line 608 in 27b415c

info!(query_id = query_id, session_id = client_session_id, node_id = node_id, sql = sql; "[HTTP-QUERY] Creating new query");

0fefdede-05e4-4ca7-8ea4-1aa538174301 2025-08-01T12:10:37.510813+08:00  INFO databend_query::servers::http::v1::query::http_query: http_query.rs:608 [HTTP-QUERY] Creating new query query_id=0fefdede-05e4-4ca7-8ea4-1aa538174301 session_id=01986388-0d97-7113-952f-c4607affbe5f node_id=n5cygfGaSHhAGIs7bglKl1 sql=select listagg(s, '|') within group (order by s desc) from t3