Skip to content

Commit 40d8fdc

Browse files
authored
fix: set chat_template on inner tokenizer for multimodal models (#1257)
1 parent 0ad2ab5 commit 40d8fdc

1 file changed

Lines changed: 4 additions & 1 deletion

File tree

lightllm/server/build_prompt.py

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,10 @@ def init_tokenizer(args):
1616
if chat_path is not None:
1717
with open(chat_path, "r", encoding="utf-8") as f:
1818
chat_template_str = f.read()
19-
tokenizer.chat_template = chat_template_str
19+
if hasattr(tokenizer, "tokenizer"):
20+
tokenizer.tokenizer.chat_template = chat_template_str
21+
else:
22+
tokenizer.chat_template = chat_template_str
2023
return
2124

2225
# 如果 tokenizer 目录下存在chat_template.json, 同时不存在 chat_template.jinja,

0 commit comments

Comments
 (0)