Commit 8107365
authored
fix(fun_asr_nano): warn when vLLM dtype=fp16 (degraded output) (#2980)
Fun-ASR-Nano vLLM inference produces degraded/garbage transcription in
fp16 due to numerical overflow in the audio embedding path (reproduced:
degenerate repeated tokens). bf16 and fp32 are correct. Add a clear
warning recommending bf16 (or fp32 on V100-class GPUs without bf16) so
users do not hit silent garbage output.
Refs #2976.
Co-authored-by: LauraGPT <LauraGPT@users.noreply.github.com>1 parent e6ab4c3 commit 8107365
1 file changed
Lines changed: 7 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
175 | 175 | | |
176 | 176 | | |
177 | 177 | | |
| 178 | + | |
| 179 | + | |
| 180 | + | |
| 181 | + | |
| 182 | + | |
| 183 | + | |
| 184 | + | |
178 | 185 | | |
179 | 186 | | |
180 | 187 | | |
| |||
0 commit comments