Commit 6e53b68
committed
fix(qwen35): populate result.prefill_s/decode_s so daemon log telemetry is real
Daemon's bare-prompt and RESTORE success path printed
ok N=24237 gen=128 prefill_s=0.000 decode_s=0.000 decode_tok_s=128000000000.0
because GenerateResult.prefill_s/decode_s were never populated by
Qwen35Backend::generate() or restore_and_generate(). The format-string
math then printed nonsense (128 / 1e-9 = 1.28e11 tok/s).
Time both phases with std::chrono::steady_clock, store on result, so
the daemon log shows real numbers and downstream tools (server.py log
parsers, bench-style metric scrapers) get truthful values.1 parent 350bfcb commit 6e53b68
1 file changed
Lines changed: 12 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
321 | 321 | | |
322 | 322 | | |
323 | 323 | | |
| 324 | + | |
324 | 325 | | |
325 | 326 | | |
326 | 327 | | |
327 | 328 | | |
328 | 329 | | |
| 330 | + | |
| 331 | + | |
329 | 332 | | |
330 | 333 | | |
331 | 334 | | |
| 335 | + | |
332 | 336 | | |
333 | 337 | | |
334 | 338 | | |
335 | 339 | | |
| 340 | + | |
| 341 | + | |
336 | 342 | | |
337 | 343 | | |
338 | 344 | | |
| |||
368 | 374 | | |
369 | 375 | | |
370 | 376 | | |
| 377 | + | |
371 | 378 | | |
372 | 379 | | |
373 | 380 | | |
374 | 381 | | |
375 | 382 | | |
376 | 383 | | |
| 384 | + | |
| 385 | + | |
377 | 386 | | |
378 | 387 | | |
379 | 388 | | |
| |||
383 | 392 | | |
384 | 393 | | |
385 | 394 | | |
| 395 | + | |
386 | 396 | | |
387 | 397 | | |
388 | 398 | | |
389 | 399 | | |
| 400 | + | |
| 401 | + | |
390 | 402 | | |
391 | 403 | | |
392 | 404 | | |
| |||
0 commit comments