Skip to content

Commit c40ab32

Browse files
dbrian57anastasiaguspanwandb-docs-pr-writer[bot]
authored
WEAVE: Integrates feedback for Weave Agents GA (#2778)
## Description This updates the Getting Started section and landing page to be more Agent-centric and produce a smoother onboarding experience. --------- Co-authored-by: anastasiaguspan <aguspan@coreweave.com> Co-authored-by: wandb-docs-pr-writer[bot] <281709622+wandb-docs-pr-writer[bot]@users.noreply.github.com>
1 parent 08ebbfb commit c40ab32

28 files changed

Lines changed: 384 additions & 927 deletions

docs.json

Lines changed: 20 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -531,8 +531,8 @@
531531
{
532532
"group": "Get Started",
533533
"pages": [
534-
"weave/agents-quickstart",
535-
"weave/quickstart"
534+
"weave/agent-integration-quickstart",
535+
"weave/custom-agents-quickstart"
536536
]
537537
},
538538
{
@@ -546,6 +546,7 @@
546546
"weave/guides/tracking/trace-agent-integrations",
547547
"weave/guides/tracking/view-agent-activity",
548548
"weave/guides/tracking/view-agent-signals",
549+
"weave/guides/tracking/trace-agents-attributes",
549550
"weave/guides/tracking/trace-agents-batch",
550551
"weave/guides/tracking/trace-sub-agents"
551552
]
@@ -556,6 +557,7 @@
556557
{
557558
"group": "Tracing basics",
558559
"pages": [
560+
"weave/quickstart",
559561
"weave/guides/tracking/tracing",
560562
"weave/guides/tracking/create-call",
561563
"weave/guides/tracking/trace-tree",
@@ -687,18 +689,14 @@
687689
{
688690
"group": "Frameworks",
689691
"pages": [
690-
"weave/guides/integrations/openai_agents",
691692
"weave/guides/integrations/openai-realtime-audio",
692-
"weave/guides/integrations/claude_agent",
693-
"weave/guides/integrations/claude_code",
694693
"weave/guides/integrations/langchain",
695694
"weave/guides/integrations/llamaindex",
696695
"weave/guides/integrations/dspy",
697696
"weave/guides/integrations/instructor",
698697
"weave/guides/integrations/crewai",
699698
"weave/guides/integrations/smolagents",
700699
"weave/guides/integrations/pydantic_ai",
701-
"weave/guides/integrations/google_adk",
702700
"weave/guides/integrations/vercel_ai_sdk",
703701
"weave/guides/integrations/haystack",
704702
"weave/guides/integrations/agno",
@@ -1997,7 +1995,6 @@
19971995
{
19981996
"group": "Premiers pas",
19991997
"pages": [
2000-
"fr/weave/agents-quickstart",
20011998
"fr/weave/quickstart"
20021999
]
20032000
},
@@ -3382,7 +3379,6 @@
33823379
{
33833380
"group": "スタートガイド",
33843381
"pages": [
3385-
"ja/weave/agents-quickstart",
33863382
"ja/weave/quickstart"
33873383
]
33883384
},
@@ -4767,7 +4763,6 @@
47674763
{
47684764
"group": "시작하기",
47694765
"pages": [
4770-
"ko/weave/agents-quickstart",
47714766
"ko/weave/quickstart"
47724767
]
47734768
},
@@ -7060,6 +7055,22 @@
70607055
"destination": "/weave/guides/evaluation/monitors",
70617056
"source": "/weave/guides/evaluation/guardrails_and_monitors"
70627057
},
7058+
{
7059+
"destination": "/weave/guides/integrations/agents/claude-agents-sdk",
7060+
"source": "/weave/guides/integrations/claude_agent"
7061+
},
7062+
{
7063+
"destination": "/weave/guides/integrations/agents/claude-code-harness",
7064+
"source": "/weave/guides/integrations/claude_code"
7065+
},
7066+
{
7067+
"destination": "/weave/guides/integrations/agents/google-adk",
7068+
"source": "/weave/guides/integrations/google_adk"
7069+
},
7070+
{
7071+
"destination": "/weave/guides/integrations/agents/openai-agents-sdk",
7072+
"source": "/weave/guides/integrations/openai_agents"
7073+
},
70637074
{
70647075
"destination": "weave/concepts/what-is-weave",
70657076
"source": "weave/concepts/fundamental-components"
Lines changed: 23 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,23 @@
1+
## Agent harnesses
2+
3+
Agent harnesses are end-user agent runtimes, such as coding agents and developer tools. Install the plugin or extension, then start a session in the harness to begin tracing:
4+
5+
- [Claude Code plugin](/weave/guides/integrations/agents/claude-code-harness)
6+
- [Codex plugin](/weave/guides/integrations/agents/codex-harness)
7+
- [OpenClaw plugin](/weave/guides/integrations/agents/openclaw-harness)
8+
- [Pi extension](/weave/guides/integrations/agents/pi-dev-harness)
9+
10+
## Agent SDKs
11+
12+
Agent SDKs are libraries for building agents and multi-agent workflows in your own application code. Add `weave.init("[YOUR-TEAM]/[YOUR-PROJECT]")` to your script and Weave autopatches the SDK:
13+
14+
- [OpenAI Agents SDK](/weave/guides/integrations/agents/openai-agents-sdk)
15+
- [Google Agent Development Kit (ADK)](/weave/guides/integrations/agents/google-adk)
16+
- [Claude Agent SDK](/weave/guides/integrations/agents/claude-agents-sdk)
17+
18+
## Custom agents and OpenTelemetry
19+
20+
If your agent isn't built with one of the SDKs above, or it already emits OpenTelemetry spans, use the Weave SDK directly. Weave accepts any OTel span and gives special handling to [GenAI semantic-convention attributes](https://opentelemetry.io/docs/specs/semconv/gen-ai/gen-ai-agent-spans/) so spans render in the **Agents** view:
21+
22+
- [Quickstart: Manually instrument an agent](/weave/custom-agents-quickstart) — a walkthrough of a small multi-turn agent.
23+
- [Trace your agents](/weave/guides/tracking/trace-agents) — the full reference of agent helpers and concepts.

weave.mdx

Lines changed: 16 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -4,9 +4,10 @@ description: "Track, test, and improve language model apps with W&B Weave"
44
mode: wide
55
---
66

7-
W&B Weave is an observability and evaluation platform that helps you track, evaluate, and improve your LLM application. With Weave, you can:
7+
W&B Weave is an observability and evaluation platform that helps you track, evaluate, and improve your agents and LLM applications. With Weave, you can:
88

9-
* [Observe and debug](/weave/quickstart) your LLM application
9+
* [Trace and collect metrics about your agent built with popular SDKs and harnesses](/weave/agent-integration-quickstart)
10+
* [Manually instrument custom-built agents to collect traces and metrics](/weave/custom-agents-quickstart)
1011
* [Evaluate](/weave/tutorial-eval) your application’s responses using LLM judges and custom scorers
1112

1213
## Get started
@@ -15,28 +16,29 @@ The following docs guide you through the basics of how to use Weave's suite of t
1516

1617
<CardGroup cols={3}>
1718
<Card
18-
title="Quickstart: Track LLM inputs & outputs"
19-
icon="chart-line"
20-
href="/weave/quickstart"
19+
title="Integrate Weave with an agent"
20+
icon="plug"
21+
href="/weave/agent-integration-quickstart"
2122
>
22-
Start by tracing a basic call to an LLM and reviewing the data in your W&B account.
23+
Pick a built-in integration for your agent SDK or harness and start tracing sessions, turns, LLM calls, and tool calls in the Agents view.
2324
</Card>
2425

2526
<Card
26-
title="Get started evaluating your app"
27-
icon="clipboard-check"
28-
href="/weave/tutorial-eval"
27+
title="Set up custom agent observability"
28+
icon="code"
29+
href="/weave/custom-agents-quickstart"
2930
>
30-
Learn how to build an evaluation pipeline using Weave scorers to test and track your application's performance.
31+
Trace a custom multi-turn agent with the Weave SDK to capture sessions, LLM calls, and tool calls as OpenTelemetry spans.
3132
</Card>
3233

3334
<Card
34-
title="Evaluate a RAG application"
35-
icon="search"
36-
href="/weave/tutorial-rag"
35+
title="View agent metrics in Weave UI"
36+
icon="chart-line"
37+
href="/weave/guides/tracking/view-agent-activity"
3738
>
38-
Build and evaluate RAG applications using Weave with LLM judges to measure retrieval quality.
39+
Trace a basic call to an LLM and review the inputs, outputs, and code in your W&B account.
3940
</Card>
41+
4042
</CardGroup>
4143

4244
## Install Weave
Lines changed: 20 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,20 @@
1+
---
2+
title: "Choose an agent integration"
3+
description: Pick a built-in Weave integration for your agent SDK or harness and start sending sessions, turns, LLM calls, and tool calls to the Agents view.
4+
keywords: ["agent integrations", "autopatch", "agent SDKs", "agent harnesses", "tracing"]
5+
---
6+
7+
import AgentsPreview from '/snippets/_includes/agents-public-preview.mdx';
8+
import AgentIntegrationPaths from '/snippets/_includes/agent-integration-paths.mdx';
9+
10+
<AgentsPreview />
11+
12+
W&B Weave traces multi-turn agents built with popular SDKs and harnesses without hand-instrumenting each turn. Install a plugin for your agent harness, or call `weave.init()` in code that uses a supported agent SDK, and Weave autopatches the framework. Sessions, turns, LLM calls, and tool calls render in the **Agents** view of your project.
13+
14+
Choose from one of the following supported integrations.
15+
16+
<AgentIntegrationPaths />
17+
18+
## Next steps
19+
20+
Once your first session reaches Weave, see [View activity in the Agents view](/weave/guides/tracking/view-agent-activity) to explore sessions, turns, and tool calls.

weave/concepts/what-is-weave.mdx

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -23,7 +23,7 @@ Weave provides the following core functionality:
2323

2424
Weave provides agentic observability for the full lifecycle of agent conversations, including sessions, LLM calls, and tool executions.
2525

26-
If you're building an agent, follow the [agent tracing quickstart](weave/agents-quickstart.mdx) or learn to use the Weave SDK to [trace your agents](/weave/guides/tracking/trace-agents).
26+
If you're building an agent, start with the [agent integration quickstart](/weave/agent-integration-quickstart) to pick a built-in integration, or follow the [custom agents quickstart](/weave/custom-agents-quickstart) to manually instrument your own. To learn how the Weave SDK models agents, see [Trace your agents](/weave/guides/tracking/trace-agents).
2727

2828
If you're using a supported third-party agent harness, such as Claude Code or OpenAI Agent SDK, Weave instruments it automatically with no additional code. See [Integrations](/weave/guides/integrations) for all supported frameworks.
2929

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
---
2-
title: "Quickstart: Trace an agent"
2+
title: "Quickstart: Set up custom agent observability"
33
description: Trace a multi-turn agent with the Weave SDK. Sessions, turns, LLM calls, and tool calls render in the Agents view of your project.
44
keywords: ["OpenTelemetry", "OTel spans", "multi-turn agent", "tool calls", "tracing"]
55
---

weave/guides/evaluation/custom-monitors.mdx

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -3,6 +3,10 @@ title: "Set up custom monitors"
33
description: "Passively score production traffic to surface trends and issues"
44
---
55

6+
<Note>
7+
Custom monitors are the previous approach to monitoring production traffic. For new implementations, use **Signals** under Weave for Agents. See [View agent signals](/weave/guides/tracking/view-agent-signals).
8+
</Note>
9+
610
This page shows you how to set up custom monitors in W&B Weave so you can passively score production traffic and surface trends and issues in your LLM applications. Use this guide when you want to define your own evaluation criteria, beyond Weave's preset signals, for production traces.
711

812
Monitors use LLM judges to passively score production traffic to surface trends and issues in your LLM applications. For example, you can monitor your application's responses for correctness or helpfulness, or you can monitor user input to identify trends in what users ask your agents about. Monitors automatically store all scoring results in Weave's database, so you can analyze historical trends and patterns.

weave/guides/evaluation/monitors.mdx

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ keywords: ["signals", "monitors", "LLM-as-a-judge", "hallucination", "production
55
---
66

77
<Note>
8-
When tracing agentic applications, use the **Signals** tab on the **Agents** page. See [Signals for agents](/weave/guides/tracking/view-agent-signals).
8+
This page covers a previous approach to monitoring production traffic. For new implementations, use **Signals** under Weave for Agents. See [View agent signals](/weave/guides/tracking/view-agent-signals).
99
</Note>
1010

1111

weave/guides/integrations.mdx

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -46,9 +46,9 @@ LLM providers are the vendors that offer access to large language models to gene
4646

4747
Frameworks help orchestrate the execution pipelines in AI applications. They provide tools and abstractions for building complex workflows. Weave integrates with these frameworks to trace the entire pipeline:
4848

49-
- **[OpenAI Agents SDK (call-level tracing)](/weave/guides/integrations/openai_agents)**
50-
- **[Claude Agent SDK (call-level tracing)](/weave/guides/integrations/claude_agent)**
51-
- **[Claude Code (call-level tracing)](/weave/guides/integrations/claude_code)**
49+
- **[OpenAI Agents SDK](/weave/guides/integrations/agents/openai-agents-sdk)**
50+
- **[Claude Agent SDK](/weave/guides/integrations/agents/claude-agents-sdk)**
51+
- **[Claude Code](/weave/guides/integrations/agents/claude-code-harness)**
5252
- **[LangChain](/weave/guides/integrations/langchain)**
5353
- **[LlamaIndex](/weave/guides/integrations/llamaindex)**
5454
- **[Haystack](/weave/guides/integrations/haystack)**
@@ -57,7 +57,7 @@ Frameworks help orchestrate the execution pipelines in AI applications. They pro
5757
- **[CrewAI](/weave/guides/integrations/crewai)**
5858
- **[Smolagents](/weave/guides/integrations/smolagents)**
5959
- **[PydanticAI](/weave/guides/integrations/pydantic_ai)**
60-
- **[Google Agent Development Kit (ADK, call-level tracing)](/weave/guides/integrations/google_adk)**
60+
- **[Google Agent Development Kit (ADK)](/weave/guides/integrations/agents/google-adk)**
6161
- **[AutoGen](/weave/guides/integrations/autogen)**
6262
- **[Verdict](/weave/guides/integrations/verdict)**
6363
- **[TypeScript SDK](/weave/guides/integrations/js)**

0 commit comments

Comments
 (0)