LocalAI version:
LocalAI v3.12.1 (fcecc12)
latest-aio-cpu
Environment, CPU architecture, OS, and Version:
ubuntu 24.04 . x86)64 r9 9950x . 89 GB DDR5
Linux linshyv 7.0.0-27-generic #27-Ubuntu SMP PREEMPT_DYNAMIC Thu Jun 18 19:13:49 UTC 2026 x86_64 GNU/Linux
Describe the bug
i can ask one question using the chat tab to a model before it spits out a rpc error on the second question
To Reproduce
1start the aio cpu image. let it download everything until it's done.
2 install the qwythos-9b-claude-mythos-5-1m model
3/4 just send it hi twice and on the second message it'll spit out
Internal error: rpc error: code = InvalidArgument desc = Unable to generate parser for this template. Automatic parser generation failed:
While executing CallExpression at line 151, column 28 in source:
... {%- else %}↵ {{- raise_exception('Unexpected message role.') }}↵ {%- ...
^
Error: Jinja Exception: Unexpected message role.
Expected behavior
i expected the model to just keep answering questions as it did on the first one while keeping in mind previous questions(context)
Logs
Additional context
gpt 4 and gpt4o do not exhibit this behavior
this is on default settings nothing altered
LocalAI version:
LocalAI v3.12.1 (fcecc12)
latest-aio-cpu
Environment, CPU architecture, OS, and Version:
ubuntu 24.04 . x86)64 r9 9950x . 89 GB DDR5
Linux linshyv 7.0.0-27-generic #27-Ubuntu SMP PREEMPT_DYNAMIC Thu Jun 18 19:13:49 UTC 2026 x86_64 GNU/Linux
Describe the bug
i can ask one question using the chat tab to a model before it spits out a rpc error on the second question
To Reproduce
1start the aio cpu image. let it download everything until it's done.
2 install the qwythos-9b-claude-mythos-5-1m model
3/4 just send it hi twice and on the second message it'll spit out
Internal error: rpc error: code = InvalidArgument desc = Unable to generate parser for this template. Automatic parser generation failed:
While executing CallExpression at line 151, column 28 in source:
... {%- else %}↵ {{- raise_exception('Unexpected message role.') }}↵ {%- ...
^
Error: Jinja Exception: Unexpected message role.
Expected behavior
i expected the model to just keep answering questions as it did on the first one while keeping in mind previous questions(context)
Logs
Additional context
gpt 4 and gpt4o do not exhibit this behavior
this is on default settings nothing altered