Skip to content

Commit e482814

Browse files
Shi-DongShi Dongguapisoloclaude
authored
Add blog post: No Token Left Behind — TITO in Miles (#335)
* Add blog post: No Token Left Behind — TITO in Miles Introduces the Token-In-Token-Out (TITO) design principle in the Miles RL framework: three common failure modes (detokenize-retokenize mismatch, chat-template cut-thinking, lossy re-rendering) and the four-component implementation (inference session server, append-only enforcement at three levels, pluggable TITO tokenizer with per-model splice-point patches, and a token-sequence comparator with CI verification). * Update author to RadixArk Miles RL Team * Shorten author to Miles Team * Add captions to Qwen3 / GLM-4.7 splice-point diagrams * Update session-server and scenario2 cut-think diagrams * Replace author with full contributor list * Add caption for inference session server diagram * Update session-server diagram * Prefix author line with 'Miles Team:' * Drop pad-token early-stopping bullet from assistant-text failure modes * Add DeepSeek-V4 to supported models (tool-role only) * Clarify thinking/non-thinking wording and add GLM-5.1 to supported models * Move DeepSeek-v4 tool-role caveat below the role-surface list * Mark Deepseek-v4 exception inline in role-surface intro * Update date to June 5; combine closing paragraph into a proper ending * Update scenario2-cut-think.png blog image Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> * Add link to miles agentic chat-template doc in TITO blog Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> * Correct Deepseek tool-surface scope: v3.2 also only supports {tool} Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> * Update scenario2-cut-think.png: drop (user message) line from harness output box Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> * Update scenario2-cut-think.png blog image * Reword and bold the closing try-it-out CTA line --------- Co-authored-by: Shi Dong <shi.dong@radixark.ai> Co-authored-by: Jiajun Li <guapisolo@gmail.com> Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
1 parent f56dbe8 commit e482814

8 files changed

Lines changed: 190 additions & 0 deletions

blog/2026-05-13-no-token-left-behind.md

Lines changed: 190 additions & 0 deletions
Large diffs are not rendered by default.
894 KB
Loading
872 KB
Loading
928 KB
Loading
915 KB
Loading
1.16 MB
Loading
112 KB
Loading
181 KB
Loading

0 commit comments

Comments
 (0)