Skip to content

Commit f51f924

Browse files
windreamerCopilot
andauthored
Update lmdeploy/serve/openai/api_server.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
1 parent 587bff8 commit f51f924

1 file changed

Lines changed: 10 additions & 4 deletions

File tree

lmdeploy/serve/openai/api_server.py

Lines changed: 10 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -414,11 +414,17 @@ async def chat_completions_v1(request: ChatCompletionRequest, raw_request: Reque
414414
request.messages += format_section
415415
else:
416416
messages = request.messages
417+
appended_to_system = False
417418
for msg in messages:
418-
if msg['role'] == 'system':
419-
msg['content'] += format_section
420-
break
421-
else:
419+
if msg.get('role') == 'system':
420+
content = msg.get('content')
421+
if content is None:
422+
content = ''
423+
if isinstance(content, str):
424+
msg['content'] = content + format_section
425+
appended_to_system = True
426+
break
427+
if not appended_to_system:
422428
system_msg = {
423429
'role': 'system',
424430
'content': f'You must follow the specified response format.{format_section}'

0 commit comments

Comments
 (0)