You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Forward-merge triggered by push to release/1.6 that creates a PR to keep
develop up-to-date. If this PR is unable to be immediately merged due to
conflicts, it will remain open for the team to manually merge. See
[forward-merger
docs](https://docs.rapids.ai/maintainers/forward-merger/) for more info.
Copy file name to clipboardExpand all lines: CHANGELOG.md
+82Lines changed: 82 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -18,6 +18,88 @@ limitations under the License.
18
18
# Changelog
19
19
All notable changes to this project will be documented in this file.
20
20
21
+
## [1.6.0] - 2026-04-09
22
+
### 🚀 Notable Features and Improvements
23
+
* Adds ATIF-based evaluation, including a standalone evaluator class that can evaluate ATIF trajectories generated by any system
24
+
25
+
## What's Changed
26
+
### 🚨 Breaking Changes
27
+
* NAT Eval Dependency Reduction by @AnuradhaKaruppiah in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1690
28
+
* Migrate nvidia_nat_ragas to Ragas v0.4 by @AnuradhaKaruppiah in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1780
29
+
* Add support for optionally disabling SSL/TLS verification by @dagardner-nv in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1640
30
+
* Add centralized user identity management and custom WebSocket authentication by @ericevans-nv in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1775
31
+
* Feat/optimizer package extraction by @bhuvan002 in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1637
32
+
* Decouple ATIF schemas from core and make nvidia-nat-eval lightweight by default by @AnuradhaKaruppiah in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1833
33
+
### ✨ New Features
34
+
* Add TimeoutMiddleware by @ericevans-nv in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1677
35
+
* feat(agent): stream tool call chunks by @MylesShannon in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1717
36
+
* Add ATIF adapter: `IntermediateStep` to Harbor ATIF v1.6 trajectory conversion by @yczhang-nv in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1663
37
+
* feat(control_flow): add built-in parallel_executor with example by @antoniomtz in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1733
38
+
* Restore TimeoutMiddleware reverted by #1710 by @ericevans-nv in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1753
39
+
* Add ATIF-native evaluator interface and runtime dual-lane dispatch by @AnuradhaKaruppiah in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1747
40
+
* Add LLM error recovery, retry logic, and diagnostic logging to Tool Calling Agent by @ericevans-nv in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1757
41
+
* Add ATIF-only custom evaluator example and docs by @AnuradhaKaruppiah in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1766
42
+
* feat(profiler): ATIF-native profiler by @afourniernv in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1751
43
+
* Add pre-tool verifier defense middleware for input instruction violation detection by @lidan-capsule in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1605
44
+
* Add MemMachine memory integration for NeMo Agent toolkit by @Charlie-Yi-2002 in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1460
45
+
* Nested ATIF lineage by @AnuradhaKaruppiah in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1814
46
+
### 🔧 Improvements
47
+
* Forward-merge release/1.5 into develop by @willkill07 in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1676
48
+
* Add user attribution to Weave traces and feedback by @thepatrickchin in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1668
49
+
* Move eval callbacks to nvidia_nat_eval and guard core shim path by @AnuradhaKaruppiah in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1748
50
+
* Refactor eval file output into FileEvalCallback for Python API support by @yczhang-nv in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1743
51
+
* Add AtifBaseEvaluator for reusable concurrent ATIF custom evaluators by @AnuradhaKaruppiah in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1769
52
+
* Use nvidia-nat-eval from PyPI in the custom evaluator notebook by @AnuradhaKaruppiah in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1778
53
+
* chore(pre-commit): any `pyproject.toml` changes should trigger `uv lock` checks by @willkill07 in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1790
54
+
* Remove unneeded warning filter by @dagardner-nv in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1789
55
+
* Remove old/unused compatibility code by @dagardner-nv in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1794
56
+
* fix: handle Anthropic-style tool schemas in LangchainProfilerHandler by @cluster2600 in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1770
57
+
* Add ATIF-native evaluators for nvidia-nat-profiler runtime metrics by @afourniernv in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1791
58
+
* Update old CI variable names by @dagardner-nv in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1813
59
+
* Explicitly set `framework_wrappers` for LangChain tools by @dagardner-nv in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1820
60
+
* Report installed packages when testing built wheels by @dagardner-nv in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1821
61
+
* chore: pin LiteLLM to known good version by @willkill07 in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1823
62
+
* Ensure file paths are properly quoted in `gitutils.py` by @dagardner-nv in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1832
63
+
* Update `LICENSE-3rd-party.txt` by @dagardner-nv in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1840
64
+
* Informational ATIF mapping docs and sample output colocation (no functional changes) by @AnuradhaKaruppiah in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1844
65
+
* fix: guard nim_langchain against ChatNVIDIA model lookup crash by @bbednarski9 in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1843
66
+
* Document that MemMachine integration is Experimental by @AnuradhaKaruppiah in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1854
67
+
* Restore profiler intermediate-step compatibility by rolling back selected ATIF-native changes by @AnuradhaKaruppiah in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1853
68
+
### 🐛 Bug Fixes
69
+
* Fix Simple Calculator MCP example to return consistent timezone results by @dagardner-nv in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1708
70
+
* fix: preserve nested Pydantic models when unpacking multi-arg functions by @MylesShannon in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1696
71
+
* Fix `_running_workflow_task` always being `None` due to method chaining by @AjayThorve in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1744
72
+
* Fix LoRA inference routing in OpenPipe ART cookbook by @aslanshi in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1662
73
+
* Add profiler callback to sequential executor for LLM observability by @thepatrickchin in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1786
74
+
* Enhance chat completion functionality to support OpenAI-style message history by @mdemoret-nv in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1674
75
+
* fix(crewai): CrewAI Profiler Handler logic `>=1.1.0` by @willkill07 in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1803
76
+
* fix: add missing dependencies and repair logic for some tests by @willkill07 in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1815
77
+
* Fix urls in pypi markdown files by @dagardner-nv in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1828
78
+
* Fix default values for datetime fields in `JobInfo` objects by @dagardner-nv in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1829
79
+
* add targeted MCP OAuth2 diagnostics for redirect URI mismatches by @AnuradhaKaruppiah in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1830
80
+
* Ensure proper cancellation of in-flight workflow tasks by @thepatrickchin in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1819
81
+
* Ensure HTTP request attributes are propagated into eval and async requests by @dagardner-nv in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1838
82
+
* Update weave version to pickup fixes for tracing LangChain workflows by @dagardner-nv in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1841
83
+
* fix(middleware): improve pre-tool middleware guarding logic by @cparadis-nvidia in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1824
84
+
### 📝 Documentation Updates
85
+
* Add notebooks demonstrating standalone ATIF evaluation via Python API by @yczhang-nv in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1752
86
+
* Add notebook demonstrating end-to-end interoperability between third-party agent frameworks and the NeMo Agent toolkit evaluation harness by @yczhang-nv in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1799
87
+
* docs: add LangSmith to list of supported observability platforms by @abhisawa-Nvidia in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1825
88
+
* Fix license header in memmachine's README.md by @Charlie-Yi-2002 in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1831
89
+
* add memmachine into docs/ by @Charlie-Yi-2002 in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1839
90
+
* Document Otel endpoints for custom LangSmith deployments by @dagardner-nv in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1845
91
+
92
+
## New Contributors
93
+
*@AjayThorve made their first contribution in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1744
94
+
*@cluster2600 made their first contribution in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1770
95
+
*@afourniernv made their first contribution in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1791
96
+
*@bhuvan002 made their first contribution in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1637
97
+
*@lidan-capsule made their first contribution in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1605
98
+
*@abhisawa-Nvidia made their first contribution in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1825
99
+
*@Charlie-Yi-2002 made their first contribution in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1460
100
+
*@cparadis-nvidia made their first contribution in https://github.com/NVIDIA/NeMo-Agent-Toolkit/pull/1824
Copy file name to clipboardExpand all lines: docs/source/release-notes.md
+4-9Lines changed: 4 additions & 9 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -18,18 +18,13 @@ limitations under the License.
18
18
# NVIDIA NeMo Agent Toolkit Release Notes
19
19
This section contains the release notes for [NeMo Agent Toolkit](./index.md).
20
20
21
-
## Release 1.5.0
21
+
## Release 1.6.0
22
22
### Summary
23
-
This release expands runtime intelligence, framework-level performance acceleration, and production observability in the toolkit, while making workflow publishing to MCP ecosystems easier.
23
+
This release introduces ATIF-based evaluation support and streamlines trajectory evaluation workflows in the toolkit.
24
24
25
-
**Migration notice:** Release `1.5.0` includes packaging and compatibility refactors (including meta-package changes, eval package split, and import-path updates). Review the [Migration Guide](./resources/migration-guide.md#v150) before upgrading.
25
+
- Adds a standalone evaluator class for evaluating ATIF trajectories generated by any system.
26
26
27
-
-[**Dynamo Runtime Intelligence:**](https://github.com/NVIDIA/NeMo-Agent-Toolkit/blob/release/1.5/examples/dynamo_integration/latency_sensitivity_demo/README.md) Automatically infer per-request latency sensitivity from agent profiles and apply runtime hints for cache control, load-aware routing, and priority-aware serving.
28
-
-[**Agent Performance Primitives (APP):**](https://github.com/NVIDIA/NeMo-Agent-Toolkit/blob/release/1.5/packages/nvidia_nat_app/src/meta/pypi.md) Introduce framework-agnostic performance primitives that accelerate graph-based agent frameworks such as LangChain, CrewAI, and Agno with parallel execution, speculative branching, and node-level priority routing.
29
-
-[**LangSmith Native Integration:**](https://github.com/NVIDIA/NeMo-Agent-Toolkit/blob/release/1.5/docs/source/run-workflows/observe/observe-workflow-with-langsmith.md) Observe end-to-end agent execution with native LangSmith tracing, run evaluation experiments, compare outcomes, and manage prompt versions across development and production workflows.
30
-
-[**FastMCP Workflow Publishing:**](https://github.com/NVIDIA/NeMo-Agent-Toolkit/blob/release/1.5/docs/source/run-workflows/fastmcp-server.md) Publish NeMo Agent Toolkit workflows as MCP servers using the FastMCP runtime to simplify MCP-native deployment and integration.
31
-
32
-
Refer to the [changelog](https://github.com/NVIDIA/NeMo-Agent-Toolkit/blob/release/1.5/CHANGELOG.md) for the complete list of changes.
27
+
Refer to the [changelog](https://github.com/NVIDIA/NeMo-Agent-Toolkit/blob/release/1.6/CHANGELOG.md) for the complete list of changes.
33
28
34
29
## Known Issues
35
30
- Refer to [https://github.com/NVIDIA/NeMo-Agent-Toolkit/issues](https://github.com/NVIDIA/NeMo-Agent-Toolkit/issues) for an up to date list of current issues.
0 commit comments