@@ -39,17 +39,6 @@ The minimum requirement is now Python 3.9.
3939- ` pythainlp.is_read_only_mode() ` helper function;
4040 use ` PYTHAINLP_READ_ONLY=1 ` to prevent all write operations
4141
42- ### Fixed
43-
44- - ` newmm ` tokenization engine: fix exponential-time BFS path explosion when
45- tokenizing text with many ambiguous breaking points (e.g., repeated words
46- like "ด้านหน้า" that can be split multiple ways). The internal
47- ` _bfs_paths_graph ` function now uses a visited set, reducing worst-case
48- complexity from exponential to O(V + E). The ambiguity graph is now also
49- cleared after each commit point, preventing unbounded accumulation for long
50- inputs. The ` Trie.prefixes() ` method accepts an optional `` start `` offset to
51- avoid creating large string copies on each call. (#893 )
52-
5342### Changed
5443
5544- Lazy load dictionaries to reduce memory usage (#1186 )
@@ -91,8 +80,11 @@ The minimum requirement is now Python 3.9.
9180- Kho Khon alphabet issue in ` tltk ` transliteration (#1187 )
9281- Suppress Gensim duplicate-word warnings when loading word2vec
9382 binary files (#1316 )
94- - ` db.json ` is no longer created on import; it is created lazily only
83+ - ` db.json ` is no longer created on import; created lazily only
9584 when a corpus is first downloaded (#1317 )
85+ - Fix exponential-time explosion in "newmm" tokenization
86+ engine when tokenizing text with many ambiguous
87+ breaking points (#1319 )
9688
9789## [ 5.2.0] - 2025-12-20
9890
0 commit comments