feat(tokens): add in-process text token counting#11247

localai-org-maint-bot wants to merge 1 commit into

mastermudler/LocalAI:masterfrom

maint/issue-9537-token-countermudler/LocalAI:maint/issue-9537-token-counterCopy head branch name to clipboard