The max query length is 2048 tokens so the userContext + q should be under 2048 Cohere tokens. https://docs.cohere.com/v2/docs/tokens-and-tokenizers#what-is-a-token One word tends to be about 2-3 tokens A paragraph is about 128 tokens
The max query length is 2048 tokens so the userContext + q should be under 2048 Cohere tokens.
https://docs.cohere.com/v2/docs/tokens-and-tokenizers#what-is-a-token
One word tends to be about 2-3 tokens
A paragraph is about 128 tokens