Skip to content

[AMD][ROCM] Fix benchmark_serving Rust Tokenizer Crash via Direct transformers AutoTokenizer#1253

Closed
ChangLiu0709 wants to merge 1 commit into
mainfrom
chang/fix-bench-serving-rust-tokenizer-crash
Closed

[AMD][ROCM] Fix benchmark_serving Rust Tokenizer Crash via Direct transformers AutoTokenizer#1253
ChangLiu0709 wants to merge 1 commit into
mainfrom
chang/fix-bench-serving-rust-tokenizer-crash

fix(bench_serving): replace vllm get_tokenizer with direct transforme…

4de7ce5
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar