Skip to content

feat: add openclaw-training-free — zero-GPU experience loop for LLMs#6

Open
zcyynl wants to merge 1 commit into
Gen-Verse:mainfrom
zcyynl:feat/openclaw-training-free
Open

feat: add openclaw-training-free — zero-GPU experience loop for LLMs#6
zcyynl wants to merge 1 commit into
Gen-Verse:mainfrom
zcyynl:feat/openclaw-training-free

Conversation

@zcyynl

@zcyynl zcyynl commented Mar 5, 2026

Copy link
Copy Markdown

openclaw-training-free improves LLM responses over time without any model parameter updates, forming a self-improving experience loop:

intercept → extract hint → store → inject → repeat

Every user follow-up is an implicit training signal. A Judge LLM makes it explicit; the experience store makes it persistent.

Components:

  • training_free_server.py: OpenAI-compatible FastAPI proxy (streaming)
  • experience_extractor.py: Judge LLM hint extraction via httpx
  • experience_store.py: keyword-indexed JSON experience library
  • prompt_injector.py: injects retrieved hints into system prompt

openclaw-training-free improves LLM responses over time without any
model parameter updates, forming a self-improving experience loop:

  intercept → extract hint → store → inject → repeat

Every user follow-up is an implicit training signal. A Judge LLM makes
it explicit; the experience store makes it persistent.

Unlike openclaw-rl and openclaw-opd which require a self-hosted model
with GPU, this module works as a drop-in proxy for any OpenAI-compatible
endpoint (cloud APIs included) — zero GPU, zero training cost.

Cost comparison:
- openclaw-rl  (GRPO): ~$10,000/run — parameter updates + GPU
- openclaw-opd (OPD):  ~$18/run     — parameter updates
- openclaw-training-free: ~$0       — no parameter updates

Especially suited for open-ended dialogue where reward functions are
hard to define and RL training is unstable.
@zcyynl
zcyynl force-pushed the feat/openclaw-training-free branch from cc3f76e to 5d42c00 Compare March 5, 2026 12:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant