Skip to content

Commit b1a59a4

Browse files
authored
chore: remove outdated AIEB benchmark (#99)
The benchmark/ suite was an early Hermes-vs-odek comparison and no longer reflects the project. Remove it entirely, along with its mentions in AGENTS.md, the landing page (hero stat, carousel slide, meta keywords), and the .dockerignore entry.
1 parent fabbddd commit b1a59a4

27 files changed

Lines changed: 1 addition & 2094 deletions

.dockerignore

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,4 +8,3 @@ odek-bin
88
.hermes/
99
docker/.env
1010
docker/workspace/
11-
benchmark/

AGENTS.md

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,6 @@ It provides context about the project's architecture, conventions, and how to up
1111
- **What it is:** Minimal Go autonomous agent runtime — ReAct (Reasoning + Acting) loop with zero frameworks (stdlib + a few focused packages).
1212
- **Binary:** `odek` — single static binary, ~12 MB, instant startup.
1313
- **Config:** Five-layer priority: `~/.odek/secrets.env``~/.odek/config.json``./odek.json``ODEK_*` env vars → CLI flags.
14-
- **Benchmark:** AIEB v2.0 — 80.3% (highest published agent score on the Autonomous Intelligence Engineering Benchmark).
1514
- **Releases:** see [GitHub Releases](https://github.com/BackendStack21/odek/releases) for the current version and changelog.
1615

1716
## Source Layout
@@ -78,7 +77,6 @@ internal/
7877
transport/ Shared HTTP transport with connection pooling
7978
ws/ RFC 6455 WebSocket framing
8079
docs/ Documentation (CLI, API, CONFIG, MCP, MEMORY, TELEGRAM, SECURITY, etc.)
81-
benchmark/ AIEB v2.0 benchmark suite (9 tasks, 4 tiers, automated scoring)
8280
```
8381

8482
## How It Works

benchmark/.gitignore

Lines changed: 0 additions & 7 deletions
This file was deleted.

benchmark/AGENTS.md

Lines changed: 0 additions & 34 deletions
This file was deleted.

benchmark/README.md

Lines changed: 0 additions & 40 deletions
This file was deleted.

0 commit comments

Comments
 (0)