Skip to content

Commit f6d02cb

Browse files
author
semantic-release
committed
chore: release 0.57.0
1 parent 2953be1 commit f6d02cb

2 files changed

Lines changed: 40 additions & 1 deletion

File tree

CHANGELOG.md

Lines changed: 39 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,45 @@
11
# CHANGELOG
22

33

4+
## v0.57.0 (2026-03-21)
5+
6+
### Documentation
7+
8+
- Add GRPO training troubleshooting guide
9+
([`2953be1`](https://github.com/OpenAdaptAI/openadapt-evals/commit/2953be12fad6fcb0544d6729104ba9b877733072))
10+
11+
Common errors, VRAM requirements, training paths (TRL vs standalone), monitoring, checkpointing, and
12+
diagnostic flowchart.
13+
14+
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
15+
16+
### Features
17+
18+
- Add monotonic progress bias and pluggable alignment strategy to DemoLibrary
19+
([`c85b28a`](https://github.com/OpenAdaptAI/openadapt-evals/commit/c85b28abde0032fc08a327380503ec2189041809))
20+
21+
Add three major improvements to demo-guided alignment:
22+
23+
1. Pluggable AlignmentStrategy protocol with PHashAlignmentStrategy (default), CLIPAlignmentStrategy
24+
(optional, requires open-clip-torch), and HybridAlignmentStrategy (pHash top-K + CLIP re-rank).
25+
26+
2. Monotonic progress bias that penalizes backward jumps in step matching to prevent oscillating
27+
alignment. Configurable via backward_penalty parameter (default 0.3).
28+
29+
3. Adaptive guidance disabling that turns off demo guidance after N consecutive low-confidence
30+
alignments (default 3 at threshold 0.3), preventing the "demo hurts" failure mode.
31+
32+
Also adds AlignmentTraceEntry dataclass for post-hoc analysis of alignment quality, stored in
33+
DemoGuidance.metadata["alignment_trace"].
34+
35+
DemoGuidedAgent now calls reset_alignment_state() on task change and episode reset to clear
36+
monotonic progress tracking.
37+
38+
All 77 tests pass (20 existing + 31 enrichment + 26 new).
39+
40+
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
41+
42+
443
## v0.56.0 (2026-03-21)
544

645
### Features

pyproject.toml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ build-backend = "hatchling.build"
44

55
[project]
66
name = "openadapt-evals"
7-
version = "0.56.0"
7+
version = "0.57.0"
88
description = "Evaluation infrastructure for GUI agent benchmarks"
99
readme = "README.md"
1010
requires-python = ">=3.10"

0 commit comments

Comments
 (0)