You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: modules/ai-agents/pages/observability/concepts.adoc
+7-14Lines changed: 7 additions & 14 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,12 +1,12 @@
1
1
= Transcripts and AI Observability
2
-
:description: Understand how Redpanda captures execution transcripts using OpenTelemetry.
2
+
:description: Understand how Redpanda captures end-to-end execution transcripts on an immutable distributed log for agent governance and observability.
:learning-objective-1: Explain how transcripts and spans capture execution flow
6
6
:learning-objective-2: Interpret transcript structure for debugging and monitoring
7
7
:learning-objective-3: Distinguish between transcripts and audit logs
8
8
9
-
Redpanda automatically captures glossterm:transcript[,transcripts] (also referred to as execution logs or traces) for both AI agentsand MCP servers, providing complete glossterm:observability (o11y)[,observability] into how your agentic systems operate.
9
+
Redpanda automatically captures glossterm:transcript[,transcripts] for AI agents, MCP servers, and AI Gateway operations. A transcript is the end-to-end execution record of an agentic behavior. It may span multiple agents, tools, and models and last from minutes to days. Redpanda's immutable distributed log stores every transcript, providing a correct record with no gaps. Transcripts form the keystone of Redpanda's governance for agents.
10
10
11
11
After reading this page, you will be able to:
12
12
@@ -16,7 +16,7 @@ After reading this page, you will be able to:
16
16
17
17
== What are transcripts
18
18
19
-
The AI Gateway and every glossterm:AI agent[,agent] and glossterm:MCP server[] in your Agentic Data Plane (ADP) automatically emit OpenTelemetry traces to a glossterm:topic[] called `redpanda.otel_traces`. These traces provide detailed observability into operations, creating complete transcripts.
19
+
A transcript records the complete execution of an agentic behavior from start to finish. It captures every step — across multiple agents, tools, models, and services — in a single, traceable record. The AI Gateway and every glossterm:AI agent[,agent] and glossterm:MCP server[] in your Agentic Data Plane (ADP) automatically emit OpenTelemetry traces to a glossterm:topic[] called `redpanda.otel_traces`. Redpanda's immutable distributed log stores these traces.
20
20
21
21
Transcripts capture:
22
22
@@ -27,7 +27,7 @@ Transcripts capture:
27
27
* Error conditions
28
28
* Performance metrics
29
29
30
-
With 100% sampling, every operation is captured, enabling comprehensive debugging, monitoring, and performance analysis.
30
+
With 100% sampling, every operation is captured with no gaps. The underlying storage uses a distributed log built on Raft consensus (with TLA+ proven correctness), giving transcripts a trustworthy, immutable record for governance, debugging, and performance analysis.
31
31
32
32
== Traces and spans
33
33
@@ -322,23 +322,16 @@ Transcripts may contain sensitive information from your tool inputs and outputs.
322
322
323
323
== Transcripts compared to audit logs
324
324
325
-
// TODO: Ask SME to review and confirm whether we want to rephrase or change
326
-
// "not designed for audit logging or compliance"
327
-
Transcripts are designed for observability and debugging, not audit logging or compliance.
325
+
Transcripts and audit logs serve different but complementary purposes.
328
326
329
327
Transcripts provide:
330
328
329
+
* A complete, immutable record of every execution step, stored on Redpanda's distributed log with no gaps
331
330
* Hierarchical view of request flow through your system (parent-child span relationships)
332
331
* Detailed timing information for performance analysis
333
332
* Ability to reconstruct execution paths and identify bottlenecks
334
-
* Insights into how operations flow through distributed systems
335
333
336
-
Transcripts are not:
337
-
338
-
* Immutable audit records for compliance purposes
339
-
* Designed for "who did what" accountability tracking
340
-
341
-
For compliance and audit requirements, use the session and task topics for agents, which provide records of agent conversations and execution.
334
+
Transcripts are optimized for execution-level observability and governance. For user-level accountability tracking ("who initiated what"), use the session and task topics for agents, which provide records of agent conversations and task execution.
Copy file name to clipboardExpand all lines: modules/ai-agents/pages/observability/ingest-custom-traces.adoc
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,5 +1,5 @@
1
1
= Ingest OpenTelemetry Traces from Custom Agents
2
-
:description: Configure a Redpanda Connect pipeline to ingest OTEL traces from custom agents into Redpandafor unified observability.
2
+
:description: Configure a Redpanda Connect pipeline to ingest OpenTelemetry traces from custom agents into Redpanda's immutable log for unified governance and observability.
3
3
:page-topic-type: how-to
4
4
:learning-objective-1: Configure a Redpanda Connect pipeline to receive OpenTelemetry traces from custom agents via HTTP and publish them to `redpanda.otel_traces`
5
5
:learning-objective-2: Validate trace data format and compatibility with existing MCP server traces
Copy file name to clipboardExpand all lines: modules/ai-agents/pages/observability/transcripts.adoc
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,12 +1,12 @@
1
1
= View Transcripts
2
-
:description: Learn how to filter and navigate the Transcripts interface to investigate execution traces using multiple detail views and interactive timeline navigation.
2
+
:description: Filter and navigate the Transcripts interface to investigate end-to-end agent execution records stored on Redpanda's immutable log.
3
3
:page-topic-type: how-to
4
4
:personas: agent_developer, platform_admin
5
5
:learning-objective-1: Filter transcripts to find specific execution traces
6
6
:learning-objective-2: Use the timeline interactively to navigate to specific time periods
7
7
:learning-objective-3: Navigate between detail views to inspect span information at different levels
8
8
9
-
Use the Transcripts view to investigate agent, MCP server, and AI Gateway execution traces. Filter by operation type, inspect span details, and trace issues across your agentic systems.
9
+
Use the Transcripts view to investigate end-to-end execution records for agents, MCP servers, and AI Gateway. Each transcript captures the complete lifecycle of an agentic behavior on Redpanda's immutable distributed log. Filter by operation type, inspect span details, and trace issues across your agentic systems.
10
10
11
11
For conceptual background on spans and trace structure, see xref:ai-agents:observability/concepts.adoc[].
0 commit comments