Commit ada1fb7
committed
Tune default embedding max batch size to 1024
- Lower EmbeddingRetryOptions.MaxEmbeddingBatchSize default from 2048 to 1024
- Align appsettings default (AIOptions:EmbeddingRetry:MaxEmbeddingBatchSize) to 10241 parent 920c021 commit ada1fb7
2 files changed
Lines changed: 2 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
39 | 39 | | |
40 | 40 | | |
41 | 41 | | |
42 | | - | |
| 42 | + | |
43 | 43 | | |
44 | 44 | | |
45 | 45 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
25 | 25 | | |
26 | 26 | | |
27 | 27 | | |
28 | | - | |
| 28 | + | |
29 | 29 | | |
30 | 30 | | |
31 | 31 | | |
| |||
0 commit comments