Commit acb014a
fix(router): forward extra /sleep query params (level, mode) to upstream (#969)
Fixes #953.
`route_sleep_wakeup_request` consumed only the router-internal `id`
query parameter and dropped everything else, so `POST /sleep?id=X&level=2`
silently degraded to `level=1` because vLLM never saw `level=2`.
Same defect for `mode` on `/sleep` and `tags` on `/wake_up`.
Build a dict of all query params minus `id` and pass it as the aiohttp
`params=` argument to each upstream request. `id` is router-only (used
above to pick the target engine), so excluding it is correct.
Signed-off-by: HumphreySun98 <humphreysun98@gmail.com>
Co-authored-by: Rui Zhang <51696593+ruizhang0101@users.noreply.github.com>1 parent c92350d commit acb014a
1 file changed
Lines changed: 19 additions & 6 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
517 | 517 | | |
518 | 518 | | |
519 | 519 | | |
520 | | - | |
521 | | - | |
522 | | - | |
| 520 | + | |
| 521 | + | |
| 522 | + | |
| 523 | + | |
| 524 | + | |
523 | 525 | | |
524 | 526 | | |
525 | 527 | | |
| |||
1064 | 1066 | | |
1065 | 1067 | | |
1066 | 1068 | | |
| 1069 | + | |
| 1070 | + | |
| 1071 | + | |
| 1072 | + | |
| 1073 | + | |
1067 | 1074 | | |
1068 | 1075 | | |
1069 | | - | |
| 1076 | + | |
| 1077 | + | |
| 1078 | + | |
1070 | 1079 | | |
1071 | 1080 | | |
1072 | 1081 | | |
1073 | 1082 | | |
1074 | 1083 | | |
1075 | 1084 | | |
1076 | 1085 | | |
1077 | | - | |
| 1086 | + | |
| 1087 | + | |
| 1088 | + | |
1078 | 1089 | | |
1079 | 1090 | | |
1080 | 1091 | | |
1081 | | - | |
| 1092 | + | |
| 1093 | + | |
| 1094 | + | |
1082 | 1095 | | |
1083 | 1096 | | |
1084 | 1097 | | |
| |||
0 commit comments