21 lines (17 loc) · 636 Bytes

Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog and this project adheres to Semantic Versioning.

Unreleased

Added

TIKTOKEN_R50K.LINEAR_ALL model
TIKTOKEN_R50K.LINEAR_ENGLISH model

Changed

README.md updated

0.1 - 2025-08-30

Added

RULE_BASED.UNIVERSAL model
RULE_BASED.GPT_4 model
RULE_BASED.GPT_3_5 model