Description
very much appreciate this package as Japanese, Chinese have tokenizers but Thai was always lagging behind but seems like problem is pretty much solved unlike Khmer.
Installing collected packages: python-crfsuite, pythainlp, numpy, fire, ssg, nptyping, attacut
Attempting uninstall: numpy
Found existing installation: numpy 2.1.3
Uninstalling numpy-2.1.3:
Successfully uninstalled numpy-2.1.3
Successfully installed attacut-1.0.6 fire-0.7.1 nptyping-2.5.0 numpy-1.26.4 pythainlp-5.3.4 python-crfsuite-0.9.12 ssg-0.0.8
perhaps this all gets solved in 6.0 version so just bear with it. I only need to do tokenization on Thai.
THAI_THRESHOLDS = {6: 400, 5: 320, 4: 260, 3: 200, 2: 130}
Expected results
doesn't depend on such an older version
Current results
installs much older version of numpy
Steps to reproduce
pip3 install pythainlp[attacut]
PyThaiNLP version
5.3.4
Python version
Python 3.13.1
Operating system and version
mac 15.7.3
More info
No response
Possible solution
No response
Files
No response
Description
very much appreciate this package as Japanese, Chinese have tokenizers but Thai was always lagging behind but seems like problem is pretty much solved unlike Khmer.
Installing collected packages: python-crfsuite, pythainlp, numpy, fire, ssg, nptyping, attacut
Attempting uninstall: numpy
Found existing installation: numpy 2.1.3
Uninstalling numpy-2.1.3:
Successfully uninstalled numpy-2.1.3
Successfully installed attacut-1.0.6 fire-0.7.1 nptyping-2.5.0 numpy-1.26.4 pythainlp-5.3.4 python-crfsuite-0.9.12 ssg-0.0.8
perhaps this all gets solved in 6.0 version so just bear with it. I only need to do tokenization on Thai.
THAI_THRESHOLDS = {6: 400, 5: 320, 4: 260, 3: 200, 2: 130}
Expected results
doesn't depend on such an older version
Current results
installs much older version of numpy
Steps to reproduce
pip3 install pythainlp[attacut]
PyThaiNLP version
5.3.4
Python version
Python 3.13.1
Operating system and version
mac 15.7.3
More info
No response
Possible solution
No response
Files
No response