Skip to content

fix: keep word boundaries when a chunk token repeats the final token#404

Open
Mubashirrrr wants to merge 1 commit into
morphik-org:mainfrom
Mubashirrrr:fix/chunker-duplicate-token-separator
Open

fix: keep word boundaries when a chunk token repeats the final token#404
Mubashirrrr wants to merge 1 commit into
morphik-org:mainfrom
Mubashirrrr:fix/chunker-duplicate-token-separator

Commits

Commits on Jun 3, 2026