Commit 2499159
authored
feat(AutoModelVLLM): warn when a single audio input is too long to decode in one pass (#3033)
Fun-ASR-Nano is a segment-level (LLM-)ASR model. Feeding very long audio (e.g. a
2-minute meeting recording) directly to AutoModelVLLM decodes it in a single pass,
which hits max_new_tokens long before the audio ends -> the user gets a silently
truncated transcript with no error (verified: a 126s clip returns ~half the text
of the VAD-segmented decode, 328 vs 680 chars).
Add a one-time warning when an input exceeds a safe length, pointing users to VAD
pre-segmentation or the high-level AutoModel (which segments automatically). This
does not change any output; it just makes the truncation visible instead of silent.
Refs #3031 (the catastrophic repetition reported there was the old hardcoded
repetition_penalty=1.3 crash in prompt-embeds mode, already fixed in #2974/1.3.10;
the remaining issue on long audio is this silent truncation).
Co-authored-by: LauraGPT <LauraGPT@users.noreply.github.com>1 parent f17ed67 commit 2499159
1 file changed
Lines changed: 39 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
296 | 296 | | |
297 | 297 | | |
298 | 298 | | |
| 299 | + | |
299 | 300 | | |
300 | 301 | | |
| 302 | + | |
| 303 | + | |
| 304 | + | |
| 305 | + | |
| 306 | + | |
| 307 | + | |
| 308 | + | |
| 309 | + | |
| 310 | + | |
| 311 | + | |
| 312 | + | |
| 313 | + | |
| 314 | + | |
| 315 | + | |
| 316 | + | |
| 317 | + | |
| 318 | + | |
| 319 | + | |
| 320 | + | |
| 321 | + | |
| 322 | + | |
| 323 | + | |
| 324 | + | |
| 325 | + | |
| 326 | + | |
| 327 | + | |
| 328 | + | |
| 329 | + | |
| 330 | + | |
| 331 | + | |
| 332 | + | |
| 333 | + | |
| 334 | + | |
| 335 | + | |
| 336 | + | |
| 337 | + | |
| 338 | + | |
| 339 | + | |
301 | 340 | | |
302 | 341 | | |
303 | 342 | | |
| |||
0 commit comments