You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@@ -171,12 +171,3 @@ See the [contributing guide](CONTRIBUTING.md) for details.
171
171
## Terms of Service
172
172
173
173
`agents-cli` leverages Google Cloud APIs. When you deploy agents, you'll be deploying resources in your own Google Cloud project and will be responsible for those resources. Please review the [Google Cloud Service Terms](https://cloud.google.com/terms/service-terms) for details.
174
-
175
-
## Preview
176
-
177
-
This feature is subject to the "Pre-GA Offerings Terms" in the General Service
178
-
Terms section of the
179
-
[Service Specific Terms](https://cloud.google.com/terms/service-terms#1).
180
-
Pre-GA features are available "as is" and might have limited support. For more
Copy file name to clipboardExpand all lines: RELEASE_NOTES.md
+7Lines changed: 7 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -2,6 +2,13 @@
2
2
3
3
All notable changes to this project will be documented in this file.
4
4
5
+
## [1.2.0] - 2026-07-21
6
+
7
+
-**Cloud telemetry moved to ADK's `otel_to_cloud`, across the CLI and deploys.**`playground` and `run` gain an `--otel-to-cloud` flag that forwards ADK's current `--otel_to_cloud`; the old `--trace-to-cloud` stays as a hidden, still-functional alias that warns when used. On the deployment side, Agent Runtime now exports through `otel_to_cloud` (gated on `GOOGLE_CLOUD_AGENT_ENGINE_ENABLE_TELEMETRY`) and generated projects configure Cloud telemetry declaratively in Terraform instead of at runtime. Bundled `google-adk` moves to `>=2.2.0` with the `otel-gcp` extra, and the observability skill was updated to match.
8
+
- Scaffolds now default to `gemini-3.6-flash`.
9
+
-**Agent Analytics now captures GenAI completions on Agent Runtime.** The BigQuery telemetry log sink is configured per deployment target, so Agent Runtime deployments route their GenAI request/response logs into BigQuery instead of leaving the completions view empty.
10
+
-**Managed Agents guidance in the ADK code skill.** The bundled ADK cheatsheet gained a Managed Agents section covering when to use `ManagedAgent`, Gemini API vs Agent Platform (GEAP) setup, and a runnable create-and-use example.
11
+
5
12
## [1.1.0] - 2026-07-10
6
13
7
14
-**Guided brainstorming for new agents.** The workflow skill's Phase 0 is now an interactive brainstorming dialogue that helps you shape an agent's spec before any code is written, and surfaces its assumptions for review when it can't ask.
Each custom metric must conform to either the **Code Execution Metric** or **LLM-as-a-Judge Metric** (`LLMMetric`) schema:
94
94
- **Code Execution Metric**: Used to run custom Python code for evaluation. Must have a `name` and a `custom_function` (containing a `def evaluate(instance):` signature). By default, the function executes **locally in the CLI process** — no GCP project or region is required, but the user-supplied code runs with the CLI's privileges. Add `"execution": "remote"` to opt into Vertex AI's sandboxed `CodeExecutionMetric` (server-side), which requires a configured GCP project + region.
95
-
- **LLM-as-a-Judge Metric**: Used to evaluate responses using an LLM judge. Must have a `name` and a `prompt_template`. Optional fields include `rubric_group_name`, `judge_model` (e.g., `gemini-flash-latest`), and `judge_model_sampling_count` (between `1` and `32`).
95
+
- **LLM-as-a-Judge Metric**: Used to evaluate responses using an LLM judge. Must have a `name` and a `prompt_template`. Optional fields include `rubric_group_name`, `judge_model` (e.g., `gemini-3.6-flash`), and `judge_model_sampling_count` (between `1` and `32`).
Copy file name to clipboardExpand all lines: docs/src/guide/observability/cloud-trace.md
+17-7Lines changed: 17 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -27,7 +27,7 @@ Open the Google Cloud Console and navigate to **Trace > Trace explorer**. You sh
27
27
28
28
### 3. Verify Prompt-Response Logging (Optional)
29
29
30
-
Prompt-response logging captures model interactions to GCS and BigQuery. It's enabled by default in deployed environments.
30
+
Prompt-response logging to GCS and BigQuery is provisioned by Terraform (`agents-cli infra single-project` or `agents-cli infra cicd`), which creates the logs bucket and dataset and sets `LOGS_BUCKET_NAME` — it's enabled automatically there. A bare `agents-cli deploy` does **not** create these resources, so the checks below apply only to Terraform-provisioned deployments.
31
31
32
32
```bash
33
33
PROJECT_ID="your-dev-project-id"
@@ -51,11 +51,17 @@ If data isn't appearing:
51
51
52
52
## Enable Prompt-Response Logging Locally
53
53
54
-
By default, `agents-cli playground` runs **without** prompt-response logging. To enable it locally (ADK agents only):
54
+
By default, `agents-cli playground` runs **without** prompt-response logging. Telemetry is
55
+
declarative (there's no runtime `setup_telemetry()`), so to enable completions logging locally set
56
+
the same vars Terraform sets for deployed agents (ADK agents only):
|`LOGS_BUCKET_NAME`| GCS bucket path | Required for prompt-response logging. If not set, logging is disabled. |
89
-
|`OTEL_INSTRUMENTATION_GENAI_CAPTURE_MESSAGE_CONTENT`|`false`, `NO_CONTENT`, `true`|`false` = disabled, `NO_CONTENT` = metadata only (default), `true` = full content |
90
-
|`GENAI_TELEMETRY_PATH`| Path within bucket | Override upload path for prompt-response logs |
94
+
|`LOGS_BUCKET_NAME`| GCS bucket **name** (no `gs://`) | Required for prompt-response logging. If not set, logging is disabled. |
95
+
|`OTEL_INSTRUMENTATION_GENAI_CAPTURE_MESSAGE_CONTENT`|`NO_CONTENT`, `EVENT_ONLY`, `SPAN_ONLY`, `SPAN_AND_EVENT`| Controls content in **traces/events only** (not the GCS/BigQuery completions, which always capture full content when a bucket is set). Experimental semconv (we set `OTEL_SEMCONV_STABILITY_OPT_IN`): `NO_CONTENT` = none in spans/events (default); `EVENT_ONLY` = content in Cloud Logging events; `SPAN_*` = content in trace spans. **`true`/`false` are invalid** — rejected, fall back to `NO_CONTENT`. |
96
+
|`OTEL_INSTRUMENTATION_GENAI_COMPLETION_HOOK`|`upload`| Enables uploading completion records |
97
+
|`OTEL_INSTRUMENTATION_GENAI_UPLOAD_BASE_PATH`|`gs://<bucket>/completions`| Destination for completion records |
98
+
|`OTEL_INSTRUMENTATION_GENAI_UPLOAD_FORMAT`|`jsonl`| Upload format |
99
+
|`OTEL_SEMCONV_STABILITY_OPT_IN`|`gen_ai_latest_experimental`| Required for the GenAI completion/upload semconv |
100
+
|`ADK_CAPTURE_MESSAGE_CONTENT_IN_SPANS`|`false`, `true`| Keep prompt/response content out of trace spans (`false`, the default we set) |
-**No configuration required** — works out-of-the-box in all environments.
9
9
10
-
For ADK-based agents, **prompt-response logging** is also available. It captures model interactions (prompts, responses, tokens) and exports them to GCS, BigQuery, and Cloud Logging. Disabled locally by default, enabled automatically in deployed environments.
10
+
For ADK-based agents, **prompt-response logging** captures full model interactions (prompts, responses, tokens) and uploads them to **GCS** (JSONL) + a **BigQuery**`completions` table. It's enabled whenever a logs bucket is configured (`LOGS_BUCKET_NAME` + the `OTEL_INSTRUMENTATION_GENAI_*` upload vars), which Terraform-provisioned deployments do by default.
11
+
12
+
> **Two independent tiers.** Prompt-response logging (GCS/BigQuery completions) captures **full content**. Whether content *also* appears in **Cloud Trace spans / Cloud Logging events** is governed separately by `OTEL_INSTRUMENTATION_GENAI_CAPTURE_MESSAGE_CONTENT` (default `NO_CONTENT` — content kept **out** of traces/events) and `ADK_CAPTURE_MESSAGE_CONTENT_IN_SPANS=false`. So by default: **full content in GCS/BigQuery, no content in traces.**
0 commit comments