feat: add model_input_context for transient context in LLM requests #442
| Job | Run time |
|---|---|
| 3m 50s | |
| 32s | |
| 57s | |
| 33s | |
| 2m 2s | |
| 32s | |
| 1m 58s | |
| 3m 44s | |
| 3m 50s | |
| 36s | |
| 3m 37s | |
| 3m 30s | |
| 40s | |
| 1m 39s | |
| 2m 10s | |
| 30m 10s |
| Job | Run time |
|---|---|
| 3m 50s | |
| 32s | |
| 57s | |
| 33s | |
| 2m 2s | |
| 32s | |
| 1m 58s | |
| 3m 44s | |
| 3m 50s | |
| 36s | |
| 3m 37s | |
| 3m 30s | |
| 40s | |
| 1m 39s | |
| 2m 10s | |
| 30m 10s |