Skip to content

Add async APIs, cancellation support, and typed metrics accessors#188

Merged
bernardladenthin merged 15 commits into
mainfrom
claude/upbeat-hypatia-wPdK5
May 23, 2026
Merged

Add async APIs, cancellation support, and typed metrics accessors#188
bernardladenthin merged 15 commits into
mainfrom
claude/upbeat-hypatia-wPdK5

Add completeBatch / chatBatch parallel dispatch (§2.4)

de457b2
Select commit
Loading
Failed to load commit list.
GitHub Advanced Security / CodeQL succeeded May 23, 2026 in 3s

2 new alerts

New alerts in code changed by this pull request

  • 2 notes

See annotations below for details.

View all branch alerts.

Annotations

Check notice on line 119 in src/main/java/net/ladenthin/llama/LlamaModel.java

See this annotation in the file changed.

Code scanning / CodeQL

Spurious Javadoc @param tags Note

@param tag "parameters" does not match any actual parameter of method "completeBatch()".

Check notice on line 120 in src/main/java/net/ladenthin/llama/LlamaModel.java

See this annotation in the file changed.

Code scanning / CodeQL

Spurious Javadoc @param tags Note

@param tag "token" does not match any actual parameter of method "completeBatch()".