Commit f5800a5
committed
Pass timeout to OpenAI client object
Not doing this makes client use the default 10 minute timeout. It causes client to stop generation after 10 minutes even if timeout option is higher, making models with slow inference unusable.1 parent 8d4df7a commit f5800a5
1 file changed
Lines changed: 1 addition & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
38 | 38 | | |
39 | 39 | | |
40 | 40 | | |
| 41 | + | |
41 | 42 | | |
42 | 43 | | |
43 | 44 | | |
| |||
0 commit comments