You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/hub/data-studio.md
+20-16Lines changed: 20 additions & 16 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -27,14 +27,14 @@ You can search for a word in the dataset by typing it in the search bar at the t
27
27
28
28
## Run SQL queries on the dataset
29
29
30
-
You can run SQL queries on the dataset in the browser using the SQL Console. This feature also leverages our [auto-conversion to Parquet](data-studio#access-the-parquet-files).
30
+
You can run SQL queries on the dataset in the browser using the SQL Console. This feature also leverages our [auto-conversion to Parquet](data-studio#access-the-parquet-files).
Drop raw JSONL traces from tools like Claude Code, Codex, or Pi into a dataset (or a [Storage Bucket](./storage-buckets)), and Data Studio swaps the default table view for a dedicated trace viewer for stepping through sessions, turns, tool calls, and model responses. See [Agent Traces](./datasets-agent-traces) for supported agents and viewing traces.
51
+
48
52
## Large scale datasets
49
53
50
54
The Dataset Viewer supports large scale datasets, but depending on the data format it may only show the first 5GB of the dataset:
@@ -101,12 +105,12 @@ You can specify which files to display in the Dataset Viewer by adding a YAML co
101
105
```yaml
102
106
---
103
107
configs:
104
-
- config_name: default
105
-
data_files:
106
-
- split: train
107
-
path: "data.csv"
108
-
- split: test
109
-
path: "holdout.csv"
108
+
- config_name: default
109
+
data_files:
110
+
- split: train
111
+
path: "data.csv"
112
+
- split: test
113
+
path: "holdout.csv"
110
114
---
111
115
```
112
116
@@ -115,14 +119,14 @@ You can also select multiple files per split or use glob patterns:
<imgsrc="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/datasets/agent-traces-session.webp"alt="Agent trace session viewer showing user and assistant turns with expanded tool calls."/>
5
+
</div>
6
+
7
+
Agent traces from Claude Code, Codex, and Pi Agent are natively supported on the Hugging Face Hub. Upload the raw JSONL sessions to a dataset or a [Storage Bucket](./storage-buckets) and Data Studio opens them in a dedicated trace viewer.
8
+
9
+
## Find your traces
10
+
11
+
Each supported agent writes JSONL sessions to a known directory:
12
+
13
+
| Agent | Local session directory |
14
+
| ----------- | ----------------------- |
15
+
| Claude Code |`~/.claude/projects`|
16
+
| Codex |`~/.codex/sessions`|
17
+
| Pi |`~/.pi/agent/sessions`|
18
+
19
+
These trace files are supported out of the box, so you can upload them without modifying or converting them first.
20
+
21
+
<Tip>
22
+
23
+
The easiest way to upload is to ask your agent itself: point it at the directory above and tell it to upload the `.jsonl` files to a Hub dataset or bucket.
24
+
25
+
Buckets are especially useful if you want to keep syncing traces as new sessions land.
26
+
27
+
</Tip>
28
+
29
+
## View your traces
30
+
31
+
Once you have traces in a dataset or bucket, open them in Data Studio and click a row. The trace viewer shows the session timeline, prompts, assistant messages, tool calls, and results.
32
+
33
+
For a public example like the one above, open [`TeichAI/DeepSeek-v4-Pro-Agent`](https://huggingface.co/datasets/TeichAI/DeepSeek-v4-Pro-Agent). You can also browse more datasets tagged as [`traces`](https://huggingface.co/datasets?format=format%3Aagent-traces).
0 commit comments