Commit 06f6c76
Bump nemotron-speech-streaming-en-0.6b-generic-cpu to v3 (#4985)
Update genai_config.json with session_options to disable intra-op spinning
for encoder, decoder, and joiner. This improves performance by adding:
"session_options": {"session.intra_op.allow_spinning": "0"}
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>1 parent 72cb4d7 commit 06f6c76
2 files changed
Lines changed: 5 additions & 5 deletions
File tree
- assets/models/foundrylocal/nemotron-speech-streaming-en-0.6b-generic-cpu
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | | - | |
| 3 | + | |
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
| |||
Lines changed: 4 additions & 4 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | | - | |
| 3 | + | |
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
| |||
12 | 12 | | |
13 | 13 | | |
14 | 14 | | |
15 | | - | |
| 15 | + | |
16 | 16 | | |
17 | 17 | | |
18 | 18 | | |
| |||
30 | 30 | | |
31 | 31 | | |
32 | 32 | | |
33 | | - | |
34 | | - | |
| 33 | + | |
| 34 | + | |
0 commit comments