feat: Stream output text and tool calls

[marcelklehr]

• Stream text content
• Stream tool calls
• CI test
• Tested manually

🤖 AI (if applicable)

• The content of this PR was partly or fully generated using AI

[julien-nc]

In my tests, an empty string output is reported multiple times before actually getting some text. This makes the message animated placeholder disappear.

Maybe something could be changed in the assistant to prevent that. I think it would be good if context_agent would not report empty output strings as well. Wdyt?

Otherwise, works like a charm!

[marcelklehr]

an empty string output is reported multiple times before actually getting some text.

Is it maybe calling tools?

[marcelklehr]

Is it maybe calling tools?

That was it

[marcelklehr]

CI changes depend on nextcloud/llm2#253 to pass

[julien-nc]

Not sure if it's a context_agent or assistant issue but i get the list of all the tools that were used in the conversation. Not just the ones used to produce the message. Is it intended?

[marcelklehr]

Nope, I thought I had fixed this. Are you on the latest commit?

[julien-nc]

Yep, last commit. To reproduce, just create a new conversation, ask 2 things (in 2 separate messages) that require tools. The tool list of the second answer includes the tools that were used for the first answer.

[marcelklehr]

Fixed

[julien-nc]

Works like a charm