Skip to content

Add Malayalam characters to char classes so periods tokenize correctly (#12898)#13978

Open
vineethsaivs wants to merge 2 commits into
explosion:masterfrom
vineethsaivs:fix/ml-tokenizer-period
Open

Add Malayalam characters to char classes so periods tokenize correctly (#12898)#13978
vineethsaivs wants to merge 2 commits into
explosion:masterfrom
vineethsaivs:fix/ml-tokenizer-period

Commits

Commits on Jun 13, 2026

Commits on Jun 19, 2026