Skip to content

Commit 98d1dba

Browse files
committed
tighten timings
1 parent c9983a7 commit 98d1dba

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

koboldcpp.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -527,7 +527,7 @@ async def handle_sse_stream(self, api_format):
527527

528528
current_token = 0
529529
incomplete_token_buffer = bytearray()
530-
await asyncio.sleep(0.1) #anti race condition, prevent check from overtaking generate
530+
await asyncio.sleep(0.05) #anti race condition, prevent check from overtaking generate
531531
while True:
532532
streamDone = handle.has_finished() #exit next loop on done
533533
tokenStr = ""

0 commit comments

Comments
 (0)