Skip to content

Commit 98511de

Browse files
authored
Update CHANGELOG.md
1 parent fd1885c commit 98511de

1 file changed

Lines changed: 4 additions & 12 deletions

File tree

CHANGELOG.md

Lines changed: 4 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -39,17 +39,6 @@ The minimum requirement is now Python 3.9.
3939
- `pythainlp.is_read_only_mode()` helper function;
4040
use `PYTHAINLP_READ_ONLY=1` to prevent all write operations
4141

42-
### Fixed
43-
44-
- `newmm` tokenization engine: fix exponential-time BFS path explosion when
45-
tokenizing text with many ambiguous breaking points (e.g., repeated words
46-
like "ด้านหน้า" that can be split multiple ways). The internal
47-
`_bfs_paths_graph` function now uses a visited set, reducing worst-case
48-
complexity from exponential to O(V + E). The ambiguity graph is now also
49-
cleared after each commit point, preventing unbounded accumulation for long
50-
inputs. The `Trie.prefixes()` method accepts an optional ``start`` offset to
51-
avoid creating large string copies on each call. (#893)
52-
5342
### Changed
5443

5544
- Lazy load dictionaries to reduce memory usage (#1186)
@@ -91,8 +80,11 @@ The minimum requirement is now Python 3.9.
9180
- Kho Khon alphabet issue in `tltk` transliteration (#1187)
9281
- Suppress Gensim duplicate-word warnings when loading word2vec
9382
binary files (#1316)
94-
- `db.json` is no longer created on import; it is created lazily only
83+
- `db.json` is no longer created on import; created lazily only
9584
when a corpus is first downloaded (#1317)
85+
- Fix exponential-time explosion in "newmm" tokenization
86+
engine when tokenizing text with many ambiguous
87+
breaking points (#1319)
9688

9789
## [5.2.0] - 2025-12-20
9890

0 commit comments

Comments
 (0)