Skip to content

Commit 31fe562

Browse files
evekhmevekhm
committed
Regenerate sample reports from live data
Ran both scripts against live BigQuery data to verify end-to-end: - quality_report.py --limit 20 --report --samples 3 - latency_report.py --limit 3 --report Sanitized project-specific details for the sample files. Stripped GFM trailing whitespace (L1).
1 parent f19670e commit 31fe562

2 files changed

Lines changed: 160 additions & 168 deletions

File tree

‎scripts/sample_latency_report.md‎

Lines changed: 96 additions & 88 deletions
Original file line numberDiff line numberDiff line change
@@ -1,134 +1,142 @@
11
# Latency Report
22

3-
Output of `./scripts/latency_report.sh --limit 3 --time-period 1h`:
3+
Markdown report generated by `./scripts/latency_report.sh --report --limit 3`.
44

5+
**Generated:** 2026-05-19 12:00:00
56
**Project:** my-gcp-project
67
**Dataset:** agent_logs.agent_events
78
**Location:** us-central1
9+
**Sessions:** 3
810

911
```
10-
Fetching traces from my-gcp-project.agent_logs.agent_events...
11-
Found 3 trace(s)
12-
Stitched hr_calculator: 4 spans from A2A session load_47a21376...
13-
Stitched policy_agent: 5 spans from A2A session load_84bf65b0...
14-
Stitched hr_calculator: 3 spans from A2A session load_cc569bfe...
15-
16-
Session: load_47a21376
17-
Time: 04:35:12 Total: 5.2s
12+
Session: 36b5aa50-b033-4036-9398-c5c881a59773
13+
Time: 22:21:44 Total: 6.5s
1814
──────────────────────────────────────────────────────────────────────
1915
├── knowledge_supervisor > USER_MESSAGE_RECEIVED
2016
├── knowledge_supervisor > INVOCATION_STARTING
21-
└── knowledge_supervisor > INVOCATION_COMPLETED [5.2s]
17+
└── knowledge_supervisor > INVOCATION_COMPLETED [6.5s]
2218
├── knowledge_supervisor > AGENT_STARTING
23-
└── knowledge_supervisor > AGENT_COMPLETED [5.2s]
19+
└── knowledge_supervisor > AGENT_COMPLETED [6.5s]
2420
├── knowledge_supervisor > LLM_REQUEST
25-
├── knowledge_supervisor > LLM_RESPONSE [1.7s, ttft=1.7s]
21+
├── knowledge_supervisor > LLM_RESPONSE [1.1s, ttft=1.1s]
2622
├── knowledge_supervisor > TOOL_STARTING (transfer_to_agent)
2723
├── knowledge_supervisor > TOOL_COMPLETED (transfer_to_agent) [0ms]
28-
├── knowledge_supervisor ──► hr_calculator [A2A]
29-
├── hr_calculator > AGENT_STARTING
30-
└── hr_calculator > AGENT_COMPLETED [3.5s]
31-
┄┄┄ remote session (hr_calculator) ┄┄┄
32-
├── hr_calculator > LLM_REQUEST [A2A]
33-
├── hr_calculator > LLM_RESPONSE [1.2s, ttft=1.2s] [A2A]
34-
├── hr_calculator > TOOL_COMPLETED (calculate_pto_details) [45ms] [A2A]
35-
└── hr_calculator > LLM_RESPONSE [0.8s] [A2A]
24+
├── google_search_agent > AGENT_STARTING
25+
└── google_search_agent > AGENT_COMPLETED [5.4s]
26+
├── google_search_agent > LLM_REQUEST
27+
└── google_search_agent > LLM_RESPONSE [5.4s, ttft=5.4s]
3628
3729
Waterfall:
38-
──────────────────────────────────────────────────────────────────────────────────
39-
knowledge_supervisor > LLM_RESPONSE ██████████████ 1.7s
40-
knowledge_supervisor > TOOL_COMPLETED (transfer_to_agent) █ 0ms
41-
hr_calculator > AGENT_COMPLETED ██████████████████████████ 3.5s
42-
hr_calculator > LLM_RESPONSE [A2A] █████████ 1.2s
43-
hr_calculator > TOOL_COMPLETED (calculate_pto_details) [A2A] █ 45ms
44-
hr_calculator > LLM_RESPONSE #2 [A2A] ██████ 0.8s
45-
──────────────────────────────────────────
46-
0 2.6s 5.2s
47-
48-
══════════════════════════════════════════════════════════════════════════════════
30+
───────────────────────────────────────────────────────────────────────────────────────────────────────────────
31+
knowledge_supervisor > LLM_RESPONSE ███████ 1.1s
32+
knowledge_supervisor > TOOL_COMPLETED (transfer_to_agent) █ 0ms
33+
google_search_agent > LLM_RESPONSE █ 5.4s
34+
google_search_agent > AGENT_COMPLETED █ 5.4s
35+
knowledge_supervisor > AGENT_COMPLETED █ 6.5s
36+
knowledge_supervisor > INVOCATION_COMPLETED █ 6.5s
37+
────────────────────────────────────────
38+
0 3.3s 6.5s
39+
```
4940

50-
Session: load_84bf65b0
51-
Time: 04:36:08 Total: 3.7s
41+
```
42+
Session: 4321f44b-7adf-4b04-8db4-02dea23ad9f9
43+
Time: 22:21:09 Total: 17.6s
5244
──────────────────────────────────────────────────────────────────────
5345
├── knowledge_supervisor > USER_MESSAGE_RECEIVED
5446
├── knowledge_supervisor > INVOCATION_STARTING
55-
└── knowledge_supervisor > INVOCATION_COMPLETED [3.7s]
47+
└── knowledge_supervisor > INVOCATION_COMPLETED [17.6s]
5648
├── knowledge_supervisor > AGENT_STARTING
57-
└── knowledge_supervisor > AGENT_COMPLETED [3.7s]
49+
└── knowledge_supervisor > AGENT_COMPLETED [17.6s]
5850
├── knowledge_supervisor > LLM_REQUEST
59-
├── knowledge_supervisor > LLM_RESPONSE [1.4s, ttft=1.4s]
51+
├── knowledge_supervisor > LLM_RESPONSE [3.0s, ttft=3.0s]
6052
├── knowledge_supervisor > TOOL_STARTING (transfer_to_agent)
6153
├── knowledge_supervisor > TOOL_COMPLETED (transfer_to_agent) [0ms]
62-
├── knowledge_supervisor ──► policy_agent [A2A]
63-
├── policy_agent > AGENT_STARTING
64-
└── policy_agent > AGENT_COMPLETED [2.2s]
65-
┄┄┄ remote session (policy_agent) ┄┄┄
66-
├── policy_agent > LLM_REQUEST [A2A]
67-
├── policy_agent > LLM_RESPONSE [0.9s, ttft=0.9s] [A2A]
68-
├── policy_agent > TOOL_COMPLETED (lookup_company_policy) [120ms] [A2A]
69-
├── policy_agent > TOOL_COMPLETED (get_current_date) [5ms] [A2A]
70-
└── policy_agent > LLM_RESPONSE [0.7s] [A2A]
54+
├── bigquery_data_agent > AGENT_STARTING
55+
└── bigquery_data_agent > AGENT_COMPLETED [14.5s]
56+
├── bigquery_data_agent > LLM_REQUEST
57+
├── bigquery_data_agent > LLM_RESPONSE [10.3s, ttft=10.3s]
58+
├── bigquery_data_agent > TOOL_STARTING (execute_sql)
59+
├── bigquery_data_agent > TOOL_COMPLETED (execute_sql) [799ms]
60+
├── bigquery_data_agent > LLM_REQUEST
61+
└── bigquery_data_agent > LLM_RESPONSE [3.4s, ttft=3.4s]
7162
7263
Waterfall:
73-
──────────────────────────────────────────────────────────────────────────────────
74-
knowledge_supervisor > LLM_RESPONSE ███████████████████ 1.4s
75-
knowledge_supervisor > TOOL_COMPLETED (transfer_to_agent) █ 0ms
76-
policy_agent > AGENT_COMPLETED ██████████████████████████████ 2.2s
77-
policy_agent > LLM_RESPONSE [A2A] ████████████ 0.9s
78-
policy_agent > TOOL_COMPLETED (lookup_company_policy) [A2A] ██ 120ms
79-
policy_agent > TOOL_COMPLETED (get_current_date) [A2A] █ 5ms
80-
policy_agent > LLM_RESPONSE #2 [A2A] █████████ 0.7s
81-
──────────────────────────────────────────
82-
0 1.9s 3.7s
83-
84-
══════════════════════════════════════════════════════════════════════════════════
64+
───────────────────────────────────────────────────────────────────────────────────────────────────────────────
65+
knowledge_supervisor > LLM_RESPONSE ██████ 3.0s
66+
knowledge_supervisor > TOOL_COMPLETED (transfer_to_agent) █ 0ms
67+
bigquery_data_agent > LLM_RESPONSE #1 ██████████ 10.3s
68+
bigquery_data_agent > TOOL_COMPLETED (execute_sql) █ 799ms
69+
bigquery_data_agent > LLM_RESPONSE #2 █ 3.4s
70+
bigquery_data_agent > AGENT_COMPLETED █ 14.5s
71+
knowledge_supervisor > AGENT_COMPLETED █ 17.6s
72+
knowledge_supervisor > INVOCATION_COMPLETED █ 17.6s
73+
────────────────────────────────────────
74+
0 8.8s 17.6s
75+
```
8576

86-
Session: load_cc569bfe
87-
Time: 04:37:22 Total: 3.0s
77+
```
78+
Session: 636c3277-2102-4e14-b38e-327d0adbfc8b
79+
Time: 22:21:27 Total: 17.2s
8880
──────────────────────────────────────────────────────────────────────
8981
├── knowledge_supervisor > USER_MESSAGE_RECEIVED
9082
├── knowledge_supervisor > INVOCATION_STARTING
91-
└── knowledge_supervisor > INVOCATION_COMPLETED [3.0s]
83+
└── knowledge_supervisor > INVOCATION_COMPLETED [17.2s]
9284
├── knowledge_supervisor > AGENT_STARTING
93-
└── knowledge_supervisor > AGENT_COMPLETED [3.0s]
85+
└── knowledge_supervisor > AGENT_COMPLETED [17.2s]
9486
├── knowledge_supervisor > LLM_REQUEST
95-
├── knowledge_supervisor > LLM_RESPONSE [1.5s, ttft=1.5s]
87+
├── knowledge_supervisor > LLM_RESPONSE [2.6s, ttft=2.6s]
9688
├── knowledge_supervisor > TOOL_STARTING (transfer_to_agent)
9789
├── knowledge_supervisor > TOOL_COMPLETED (transfer_to_agent) [0ms]
98-
├── knowledge_supervisor ──► hr_calculator [A2A]
99-
├── hr_calculator > AGENT_STARTING
100-
└── hr_calculator > AGENT_COMPLETED [1.5s]
101-
┄┄┄ remote session (hr_calculator) ┄┄┄
102-
├── hr_calculator > LLM_REQUEST [A2A]
103-
├── hr_calculator > LLM_RESPONSE [0.7s, ttft=0.7s] [A2A]
104-
├── hr_calculator > TOOL_COMPLETED (get_remaining_working_days) [30ms] [A2A]
105-
└── hr_calculator > LLM_RESPONSE [0.5s] [A2A]
90+
├── internal_docs_agent > AGENT_STARTING
91+
└── internal_docs_agent > AGENT_COMPLETED [14.6s]
92+
├── internal_docs_agent > LLM_REQUEST
93+
├── internal_docs_agent > LLM_RESPONSE [4.5s, ttft=4.5s]
94+
├── internal_docs_agent > TOOL_STARTING (search_internal_docs)
95+
├── internal_docs_agent > TOOL_COMPLETED (search_internal_docs) [119ms]
96+
├── internal_docs_agent > TOOL_STARTING (search_internal_docs)
97+
├── internal_docs_agent > TOOL_COMPLETED (search_internal_docs) [127ms]
98+
├── internal_docs_agent > LLM_REQUEST
99+
├── internal_docs_agent > LLM_RESPONSE [5.6s, ttft=5.6s]
100+
├── internal_docs_agent > TOOL_STARTING (search_internal_docs)
101+
├── internal_docs_agent > TOOL_COMPLETED (search_internal_docs) [127ms]
102+
├── internal_docs_agent > LLM_REQUEST
103+
└── internal_docs_agent > LLM_RESPONSE [4.1s, ttft=4.1s]
106104
107105
Waterfall:
108-
──────────────────────────────────────────────────────────────────────────────────
109-
knowledge_supervisor > LLM_RESPONSE ██████████████████████████ 1.5s
110-
knowledge_supervisor > TOOL_COMPLETED (transfer_to_agent) █ 0ms
111-
hr_calculator > AGENT_COMPLETED ██████████████████████████ 1.5s
112-
hr_calculator > LLM_RESPONSE [A2A] ████████████ 0.7s
113-
hr_calculator > TOOL_COMPLETED (get_remaining_working_days) [A2A] █ 30ms
114-
hr_calculator > LLM_RESPONSE #2 [A2A] █████████ 0.5s
115-
──────────────────────────────────────────
116-
0 1.5s 3.0s
106+
────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
107+
knowledge_supervisor > LLM_RESPONSE ██████ 2.6s
108+
knowledge_supervisor > TOOL_COMPLETED (transfer_to_agent) █ 0ms
109+
internal_docs_agent > LLM_RESPONSE #1 ██████████ 4.5s
110+
internal_docs_agent > TOOL_COMPLETED (search_internal_docs) #1 █ 119ms
111+
internal_docs_agent > TOOL_COMPLETED (search_internal_docs) #2 █ 127ms
112+
internal_docs_agent > LLM_RESPONSE #2 ██████████ 5.6s
113+
internal_docs_agent > TOOL_COMPLETED (search_internal_docs) #3 █ 127ms
114+
internal_docs_agent > LLM_RESPONSE #3 █ 4.1s
115+
internal_docs_agent > AGENT_COMPLETED █ 14.6s
116+
knowledge_supervisor > AGENT_COMPLETED █ 17.2s
117+
knowledge_supervisor > INVOCATION_COMPLETED █ 17.2s
118+
────────────────────────────────────────
119+
0 8.6s 17.2s
120+
```
117121

118-
══════════════════════════════════════════════════════════════════════════════════
122+
## Summary
123+
124+
```
119125
120126
======================================================================
121127
Summary
122128
======================================================================
123129
Sessions: 3
124-
Avg: 4.0s
125-
P50: 3.7s
126-
P95: 5.2s
127-
Min: 3.0s
128-
Max: 5.2s
130+
Avg: 13.7s
131+
P50: 17.2s
132+
P95: 17.6s
133+
Min: 6.5s
134+
Max: 17.6s
129135
130136
Per-agent latency (avg):
131-
knowledge_supervisor 3.3s (n=9)
132-
hr_calculator 2.1s (n=6)
133-
policy_agent 1.8s (n=3)
137+
knowledge_supervisor 9.9s (n=9)
138+
bigquery_data_agent 7.3s (n=4)
139+
google_search_agent 5.4s (n=2)
140+
internal_docs_agent 4.2s (n=7)
134141
```
142+

0 commit comments

Comments
 (0)