fix(vllm): use max prompt length for batch context-length check#1209
Closed
JKDasondee wants to merge 1 commit intohuggingface:mainfrom
Closed
fix(vllm): use max prompt length for batch context-length check#1209JKDasondee wants to merge 1 commit intohuggingface:mainfrom
JKDasondee wants to merge 1 commit intohuggingface:mainfrom
