Skip to content

Commit 1e7da2f

Browse files
author
semantic-release
committed
chore: release 0.59.0
1 parent 006688c commit 1e7da2f

2 files changed

Lines changed: 26 additions & 1 deletion

File tree

CHANGELOG.md

Lines changed: 25 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,31 @@
11
# CHANGELOG
22

33

4+
## v0.59.0 (2026-03-21)
5+
6+
### Features
7+
8+
- Add OpenAI embedding-based alignment strategy for DemoLibrary
9+
([#179](https://github.com/OpenAdaptAI/openadapt-evals/pull/179),
10+
[`006688c`](https://github.com/OpenAdaptAI/openadapt-evals/commit/006688c7ead71254ed84264ffac9e6ad657bfdfd))
11+
12+
Add OpenAIEmbeddingAlignment class that implements the AlignmentStrategy protocol using OpenAI's VLM
13+
(gpt-4o-mini) for screenshot description and text-embedding-3-small for semantic embedding. This
14+
provides a cloud-based alternative to local CLIP models for demo step alignment.
15+
16+
Key changes: - OpenAIEmbeddingAlignment: two-step pipeline (VLM describe + embed) with cosine
17+
similarity matching against pre-computed demo embeddings - create_alignment_strategy() factory:
18+
accepts string names ("phash", "clip", "hybrid", "openai") for easy construction - DemoLibrary
19+
constructor now accepts string alignment_strategy names with automatic fallback to pHash on
20+
failure - enrich_demo() pre-computes OpenAI embeddings when strategy is "openai" - Embeddings
21+
persist to demo.json as plain lists for serialization - Pure-Python cosine similarity fallback
22+
when numpy is not installed
23+
24+
Cost: ~$0.001 per screenshot (~$0.06 for 61 demos total).
25+
26+
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
27+
28+
429
## v0.58.1 (2026-03-21)
530

631
### Bug Fixes

pyproject.toml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ build-backend = "hatchling.build"
44

55
[project]
66
name = "openadapt-evals"
7-
version = "0.58.1"
7+
version = "0.59.0"
88
description = "Evaluation infrastructure for GUI agent benchmarks"
99
readme = "README.md"
1010
requires-python = ">=3.10"

0 commit comments

Comments
 (0)