Skip to content

fix(llamacpp-upstream): backend path resolution, tests, and reasoning toggle#124

Open
yanalialiuk wants to merge 6 commits into
AtomicBot-ai:mainfrom
yanalialiuk:feat/ide-editor-integrations
Open

fix(llamacpp-upstream): backend path resolution, tests, and reasoning toggle#124
yanalialiuk wants to merge 6 commits into
AtomicBot-ai:mainfrom
yanalialiuk:feat/ide-editor-integrations

Conversation

@yanalialiuk

Copy link
Copy Markdown
Contributor

Summary

Follow-up after #108 (IDE integrations). Four focused commits rebased on current main:

  • fix(llamacpp): resolve llama-server when archive unpacks with an extra top-level folder (both llamacpp and llamacpp-upstream backends)
  • feat(reasoning): tri-state reasoning toggle (off / on / auto) in chat UI and transport
  • test(llamacpp-upstream): fix stale llamacppllamacpp-upstream backend paths in unit tests
  • test(llamacpp-upstream): fix manifest fetch call-count assertion after proxy-aware fetch path

Changes

Area Files
Backend resolution extensions/llamacpp-extension/src/backend.ts, extensions/llamacpp-upstream-extension/src/backend.ts
Tests extensions/llamacpp-upstream-extension/src/test/backend.test.ts
Reasoning UI ReasoningToggle.tsx, MessageItem.tsx, custom-chat-transport.ts, useGeneralSetting.ts, common.json

Test plan

  • yarn test:run src/test/backend.test.ts in extensions/llamacpp-upstream-extension (10/10 passed)
  • Manual: download a backend whose archive has an extra top-level folder; confirm llama-server starts
  • Manual: toggle reasoning off / on / auto in chat and verify model behavior

Made with Cursor

…op-level folder

isBackendInstalled/getBackendExePath only checked <dir>/build/bin/llama-server
and <dir>/llama-server. ggml-org ubuntu tarballs can unpack with an extra
top-level folder, so the exe lands deeper and detection fails -> UI shows the
backend as not installed and re-prompts download in a loop. Add a bounded
recursive fallback that locates llama-server at any depth. Applied to both the
upstream and turboquant extensions; adds a regression test.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants