Informational ATIF mapping docs and sample output colocation (no functional changes) (#1844)

This PR consolidates ATIF/IntermediateStep documentation and sample artifacts to make trajectory analysis easier to understand and reproduce. It is educational/documentation-focused and introduces no functional/runtime behavior changes.

**What this PR includes**

- Moves and clarifies ATIF contract guidance:
  - Relocates/maintains the Step.extra contract guide under ATIF ownership (nvidia_nat_atif) and updates related references.
- Adds generic mapping documentation:
  - Introduces a generic IntermediateStep -> ATIF mapping guide under nvidia_nat_eval, including ID/name/timing mapping semantics.
- Adds per-sample comparison docs with concrete IDs:
  - Creates concise intermediate_step-vs-atif.md files in sample output folders (nested, branching, trajectory) with concrete mapping checks and flagged oddities.
- Adds ATA sample outputs and related informational markdowns:
  - Captures and documents ATA output samples for side-by-side comparison.
- Co-locates observability assets with outputs:
  - Copies Phoenix trace screenshots into corresponding output_samples/* directories and updates path references for easier joint inspection with workflow outputs.
- Adds an ATIF-oriented ATA eval config


## By Submitting this PR I confirm:
- I am familiar with the [Contributing Guidelines](https://github.com/NVIDIA/NeMo-Agent-Toolkit/blob/develop/docs/source/resources/contributing/index.md).
- We require that all contributors "sign-off" on their commits. This certifies that the contribution is your original work, or you have rights to submit it under the same license, or a compatible license.
  - Any contribution which contains commits that are not Signed-Off will not be accepted.
- When the PR is ready for review, new or existing tests cover these changes.
- When the PR is ready for review, the documentation is up to date with these changes.




## Summary by CodeRabbit

* **Documentation**
  * Enhanced ATIF step guidance with publisher ID requirements and alignment specifications.
  * Added comprehensive mapping documentation for converting intermediate steps to ATIF trajectories.
  * Updated asset paths and references in evaluation guides.

* **New Features**
  * Added offline ATIF evaluation configuration for alert triage workflows.

* **Chores**
  * Updated evaluation and profiling example output samples with new data artifacts.

Authors:
  - Anuradha Karuppiah (https://github.com/AnuradhaKaruppiah)

Approvers:
  - Yuchen Zhang (https://github.com/yczhang-nv)
  - https://github.com/Salonijain27

URL: #1844

Author: AnuradhaKaruppiah

examples/advanced_agents/alert_triage_agent/src/nat_alert_triage_agent/configs/config_offline_atif.yml

@@ -0,0 +1,146 @@
+# SPDX-FileCopyrightText: Copyright (c) 2025-2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
+# SPDX-License-Identifier: Apache-2.0
+#
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+
+
+general:
+  telemetry:
+    tracing:
+      phoenix:
+        _type: phoenix
+        endpoint: http://localhost:6006/v1/traces
+        project: alert_triage_agent_offline_atif
+
+functions:
+  hardware_check:
+    _type: hardware_check
+    llm_name: tool_reasoning_llm
+    offline_mode: true
+  host_performance_check:
+    _type: host_performance_check
+    llm_name: tool_reasoning_llm
+    offline_mode: true
+  monitoring_process_check:
+    _type: monitoring_process_check
+    llm_name: tool_reasoning_llm
+    offline_mode: true
+  network_connectivity_check:
+    _type: network_connectivity_check
+    llm_name: tool_reasoning_llm
+    offline_mode: true
+  telemetry_metrics_host_heartbeat_check:
+    _type: telemetry_metrics_host_heartbeat_check
+    llm_name: tool_reasoning_llm
+    offline_mode: true
+    metrics_url: http://your-monitoring-server:9090 # Replace with your monitoring system URL if running in live mode
+  telemetry_metrics_host_performance_check:
+    _type: telemetry_metrics_host_performance_check
+    llm_name: tool_reasoning_llm
+    offline_mode: true
+    metrics_url: http://your-monitoring-server:9090 # Replace with your monitoring system URL if running in live mode
+  telemetry_metrics_analysis_agent:
+    _type: telemetry_metrics_analysis_agent
+    tool_names:
+      - telemetry_metrics_host_heartbeat_check
+      - telemetry_metrics_host_performance_check
+    llm_name: telemetry_metrics_analysis_agent_llm
+  maintenance_check:
+    _type: maintenance_check
+    llm_name: maintenance_check_llm
+    static_data_path: examples/advanced_agents/alert_triage_agent/data/maintenance_static_dataset.csv
+  categorizer:
+    _type: categorizer
+    llm_name: categorizer_llm
+
+workflow:
+  _type: alert_triage_agent
+  tool_names:
+    - hardware_check
+    - host_performance_check
+    - monitoring_process_check
+    - network_connectivity_check
+    - telemetry_metrics_analysis_agent
+  llm_name: ata_agent_llm
+  offline_mode: true
+  # The below paths are only used if offline_mode is true
+  offline_data_path: examples/advanced_agents/alert_triage_agent/data/offline_data.csv
+  benign_fallback_data_path: examples/advanced_agents/alert_triage_agent/data/benign_fallback_offline_data.json
+
+llms:
+  ata_agent_llm:
+    _type: nim
+    model_name: nvidia/nemotron-3-nano-30b-a3b
+    temperature: 0
+    max_tokens: 16384
+
+  tool_reasoning_llm:
+    _type: nim
+    model_name: nvidia/nemotron-3-nano-30b-a3b
+    temperature: 0
+    max_tokens: 16384
+
+  telemetry_metrics_analysis_agent_llm:
+    _type: nim
+    model_name: nvidia/nemotron-3-nano-30b-a3b
+    temperature: 0
+    max_tokens: 16384
+
+  maintenance_check_llm:
+    _type: nim
+    model_name: nvidia/nemotron-3-nano-30b-a3b
+    temperature: 0
+    max_tokens: 16384
+
+  categorizer_llm:
+    _type: nim
+    model_name: nvidia/nemotron-3-nano-30b-a3b
+    temperature: 0
+    max_tokens: 16384
+
+  nim_rag_eval_llm:
+    _type: nim
+    model_name: nvidia/nemotron-3-nano-30b-a3b
+    max_tokens: 8
+
+  nim_trajectory_eval_llm:
+    _type: nim
+    model_name: nvidia/nemotron-3-nano-30b-a3b
+    max_tokens: 1024
+
+eval:
+  general:
+    output:
+      dir: .tmp/nat/examples/advanced_agents/alert_triage_agent/output/offline_atif/
+      write_atif_workflow_output: true
+      workflow_output_step_filter: []
+    workflow_alias: alert_triage_agent_offline_atif
+    dataset:
+      _type: json
+      # JSON representation of the offline CSV data (including just the alerts, the expected output, and the label)
+      file_path: examples/advanced_agents/alert_triage_agent/data/offline_data.json
+      filter:
+        allowlist:
+          field:
+            id: ["0"]
+    profiler:
+      base_metrics: true
+
+  evaluators:
+    accuracy:
+      _type: ragas
+      enable_atif_evaluator: true
+      metric: AnswerAccuracy
+      llm_name: nim_rag_eval_llm
+    classification_accuracy:
+      _type: classification_accuracy

examples/advanced_agents/alert_triage_agent/src/nat_alert_triage_agent/data/output_samples/ata_phoenix_trace.png

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:832a5311fb051c545b3b0d3862bf432ef6345f93a6c030250f9b98436cc33145
+size 993205

examples/advanced_agents/alert_triage_agent/src/nat_alert_triage_agent/data/output_samples/workflow_output.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7c615d3d082705efd85e01e1a89e9294cb98b1723dfba658faaeb8f9ae2588fe
+size 104469

examples/advanced_agents/alert_triage_agent/src/nat_alert_triage_agent/data/output_samples/workflow_output_atif.json

@@ -66,6 +66,7 @@ eval:
   general:
     max_concurrency: 1
     output:
+      workflow_output_step_filter: []
       dir: .tmp/nat/examples/simple_calculator/branching-nested-eval
       write_atif_workflow_output: true
       cleanup: true

examples/evaluation_and_profiling/simple_calculator_eval/src/nat_simple_calculator_eval/configs/config-branching-nested-trajectory-eval.yml

@@ -61,9 +61,11 @@ eval:
   general:
     max_concurrency: 1
     output:
+      workflow_output_step_filter: []
       dir: .tmp/nat/examples/simple_calculator/nested-eval
       write_atif_workflow_output: true
       cleanup: true
+
     dataset:
       _type: json
       file_path: examples/evaluation_and_profiling/simple_calculator_eval/data/simple_calculator_power_of_two.json

examples/evaluation_and_profiling/simple_calculator_eval/src/nat_simple_calculator_eval/configs/config-nested-trajectory-eval.yml

@@ -60,6 +60,7 @@ eval:
   general:
     max_concurrency: 1
     output:
+      workflow_output_step_filter: []
       dir: .tmp/nat/examples/simple_calculator/trajectory-eval
       write_atif_workflow_output: true
       cleanup: true

examples/evaluation_and_profiling/simple_calculator_eval/src/nat_simple_calculator_eval/configs/config-trajectory-eval.yml

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cd88c9facac84eb2ac78f6285591f5219cfda8dada95d1ce694da559cdca26d3
+size 3807

examples/evaluation_and_profiling/simple_calculator_eval/src/nat_simple_calculator_eval/data/output_samples/branching_nested_trajectory_eval/intermediate_step-vs-atif.md

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:59aecb3bf7bdb0f0d82e76d49b20ce22f820335a659c578f99388f7ec97262f4
+size 121904