[FEATURE]: Token Per Second(TPS) being displayed in the assistant footer and sidebar

[atmikshetty]

Feature hasn't been suggested before.

• I have verified this feature I'm about to request hasn't been suggested before.

Describe the enhancement you want to request

• The current TUI does not display the TPS anywhere, although there is an implementation present for the base of it.
• Simply stream the tokens while the model is thinking or generating the response.
• Helps in understanding which provider is giving high throughput and the users can instantly switch to other providers and check as well.

[github-actions]

This issue might be a duplicate of existing issues. Please check:

• [FEATURE]: Adding Experimental Calculation and Display of Tokens per second #6096: Adding Experimental Calculation and Display of Tokens per second
• [FEATURE]: show tokens / second #5374: show tokens / second
• [FEATURE]: Real-time token display in TUI footer/header #17449: Real-time token display in TUI footer/header

Please review the above issues and consider whether your request is already covered. If so, consider closing this one and adding a thumbs-up or comment to the existing issue instead.

[atmikshetty]

I saw some similar PRs, but they do not seem to display the TPS in the sidebar.
Raised a PR for this issue: #21133

[ariane-emory]

The sidebar seems like the wrong place for this information: what would go there, the last agent message's TPS or some sort of averaged figure? The latter is clearly inappropriate: the session may have already been going for days or weeks, and I wouldn't want TPS measurements from weeks ago being factored in the displayed number.

It would make a lot more sense to display the TPS measurements on the individual agent messages.