Chat Session View for Observability

[mmabrouk]

Summary

Add a view that displays entire chat sessions in one place. Currently, when a user traces a chat session with an agent, each trace appears in a separate tab. We want to consolidate these into a single chat session view.

Technical Challenges

1. Session Propagation via LLM Gateway
How do users propagate session attributes through OpenTelemetry when using our LLM gateway?

2. Attribute Storage
What should we name this session attribute? Where should we store it?

3. Backend Changes
What modifications do we need to fetch and group traces by session?

Design Questions

1. UI/UX Design
How should we design the chat session view?

2. Merging Chat Histories
When multiple traces share the same session ID, each trace may contain the full chat history up to that point. Should we merge these into a single conversation view? If so, how do we handle deduplication and ordering?

[ashrafchowdury]

Thank you for opening the discussion, @mmabrouk. The chat session support was implemented with the release of v0.72.0 and is now available in observability.