You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
feat: Reduce whitespace in tool responses by not formatting JSON (#284)
Based on my research, formatted JSON (i.e. using indentation) does not
seem to lead to improved LLM performance. This indicates that whitespace
tokens within JSON basically have no effect and can be removed safely.
By removing whitespaces, we can save on the overall token consumption
for affected tool calls.
0 commit comments