Skip to content

fix(worker): report RAM alongside GPU memory - #11167

Merged
mudler merged 2 commits into
masterfrom
bot/issue-11051-available-ram-sdd
Jul 28, 2026
Merged

fix(worker): report RAM alongside GPU memory#11167
mudler merged 2 commits into
masterfrom
bot/issue-11051-available-ram-sdd

Conversation

@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

Summary

  • report system RAM during worker registration even when GPU memory is visible
  • refresh available_ram on every heartbeat so GPU detection changes cannot leave a stale RAM metric
  • add deterministic GPU-visible regression coverage and document unified-memory expectations

Fixes #11051

Testing

  • go test -count=1 ./core/services/worker
  • git diff --check HEAD^ HEAD

Documentation

Updated docs/content/features/distributed-mode.md to explain independent RAM/VRAM reporting and unified-memory behavior.

@mudler

mudler commented Jul 28, 2026

Copy link
Copy Markdown
Owner

@localai-org-maint-bot surface this in the UI as well

@localai-org-maint-bot
localai-org-maint-bot force-pushed the bot/issue-11051-available-ram-sdd branch from 12b60ee to 9c1b0c0 Compare July 28, 2026 18:03
@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator Author

Done in 20a83b61: the Nodes roster and node detail view now show used / total system RAM alongside VRAM when the worker reports RAM capacity. Added Playwright coverage for both views; focused UI lint has 0 errors, the React production build passes, and go test -count=1 ./core/services/worker passes. Playwright could not run locally because this environment has no browser and its Chromium download is blocked with HTTP 403, so the PR run will exercise those browser assertions.

@mudler
mudler merged commit 034df6c into master Jul 28, 2026
68 of 69 checks passed
@mudler
mudler deleted the bot/issue-11051-available-ram-sdd branch July 28, 2026 21:55
@localai-bot localai-bot added the bug Something isn't working label Aug 1, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working

Projects

None yet

Development

Successfully merging this pull request may close these issues.

distributed: node reports available_ram that matches nothing on the host

3 participants