fix: Remove all_special_tokens_extended for transformers v5 compatibility in OpenAI frontend - #8817
Merged
all_special_tokens_extended for transformers v5 compatibility in OpenAI frontend - #8817