File tree Expand file tree Collapse file tree
Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -4,9 +4,13 @@ A high-performance, header-only C++17/20 text tokenizer for NLP and machine lear
44
55Unlike HuggingFace Tokenizers (Python) or ICU, this is a lightweight C++ alternative with no dependencies.
66
7- ![ CI Status] ( https://github.com/Mecanik/Modern-Text-Tokenizer/workflows/CI/badge.svg )
8- ![ License] ( https://img.shields.io/badge/license-MIT-blue.svg )
9- ![ C++ Standard] ( https://img.shields.io/badge/C%2B%2B-17%2F20-blue.svg )
7+ [ ![ CI] ( https://github.com/Mecanik/Modern-Text-Tokenizer/actions/workflows/ci.yaml/badge.svg )] ( https://github.com/Mecanik/Modern-Text-Tokenizer/actions/workflows/ci.yaml )
8+ [ ![ License: MIT] ( https://img.shields.io/github/license/Mecanik/Modern-Text-Tokenizer.svg )] ( https://github.com/Mecanik/Modern-Text-Tokenizer/blob/main/LICENSE )
9+ [ ![ C++ Standard] ( https://img.shields.io/badge/C%2B%2B-17%20%7C%2020-blue )] ( # )
10+ [ ![ Lines of Code] ( https://img.shields.io/tokei/lines/github/Mecanik/Modern-Text-Tokenizer )] ( https://github.com/Mecanik/Modern-Text-Tokenizer )
11+ [ ![ Repo Size] ( https://img.shields.io/github/repo-size/Mecanik/Modern-Text-Tokenizer )] ( https://github.com/Mecanik/Modern-Text-Tokenizer )
12+ [ ![ Last Commit] ( https://img.shields.io/github/last-commit/Mecanik/Modern-Text-Tokenizer )] ( https://github.com/Mecanik/Modern-Text-Tokenizer/commits/main )
13+ [ ![ Stars] ( https://img.shields.io/github/stars/Mecanik/Modern-Text-Tokenizer?style=social )] ( https://github.com/Mecanik/Modern-Text-Tokenizer/stargazers )
1014
1115## Features
1216
You can’t perform that action at this time.
0 commit comments