Skip to content

Commit 04a9744

Browse files
fix: diable thinking
1 parent c2bc691 commit 04a9744

1 file changed

Lines changed: 1 addition & 0 deletions

File tree

graphgen/models/llm/local/vllm_wrapper.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -102,6 +102,7 @@ async def generate_topk_per_token(
102102
temperature=0,
103103
max_tokens=1,
104104
logprobs=self.top_k,
105+
chat_template_kwargs={"enable_thinking": False}
105106
)
106107

107108
try:

0 commit comments

Comments
 (0)