Commit ebd4785
docs(bpe): cite Incremental BPE Tokenization paper
Add a reference to Jiang and Gong, "Incremental BPE Tokenization"
(ICML 2026), in the tokenizer comparison section of the bpe README,
linking to the paper's full runtime analysis and the authors'
implementation at ModelTC/mtc-inc-bpe.
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>1 parent 2c3ff25 commit ebd4785
1 file changed
Lines changed: 3 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
300 | 300 | | |
301 | 301 | | |
302 | 302 | | |
| 303 | + | |
| 304 | + | |
| 305 | + | |
0 commit comments