Skip to content

Commit 6dac272

Browse files
test: bump conformance referee to 0.2.0-alpha.10, unbaseline server-stateless (#2557)
Co-authored-by: Felix Weinberger <3823880+felixweinberger@users.noreply.github.com>
1 parent 470678d commit 6dac272

4 files changed

Lines changed: 21 additions & 31 deletions

File tree

pnpm-lock.yaml

Lines changed: 5 additions & 5 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

test/conformance/expected-failures.2026-07-28.yaml

Lines changed: 1 addition & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -28,17 +28,8 @@ client: []
2828
# --- Same gaps as the 2025 baseline (fail identically when forced to 2026-07-28) ---
2929
# (empty: SEP-2468/2352/2350/837 burned by the auth bundle; SEP-2106 burned earlier)
3030

31-
server:
31+
server: []
3232
# --- Carried-forward scenarios (also run by the 2025 legs) ---
3333
# (json-schema-2020-12 burned by the SEP-2106 fixture;
3434
# sep-2164-resource-not-found burned by the spec#2907 error-code renumber +
3535
# alpha.5 referee.)
36-
#
37-
# --- spec PR #3002 — referee pinned at alpha.9 asserts the OLD shape ---
38-
# Same three failing checks as the 2025-leg baseline entry
39-
# (sep-2575-request-meta-invalid-missing-client-info, the
40-
# missing-client-info iteration of sep-2575-http-server-meta-invalid-400,
41-
# and sep-2575-server-implements-discover which requires body serverInfo):
42-
# this SDK follows the final revision. Remove when the pin bumps to a
43-
# conformance release that incorporates #3002 (alpha.10+).
44-
- server-stateless

test/conformance/expected-failures.yaml

Lines changed: 14 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22
# CI exits 0 if only these fail, exits 1 on unexpected failures or stale entries.
33
#
44
# Baseline established against the published @modelcontextprotocol/conformance
5-
# release pinned in package.json (0.2.0-alpha.9). Newer conformance releases
5+
# release pinned in package.json (0.2.0-alpha.10). Newer conformance releases
66
# are adopted by deliberately bumping the package.json pin and reconciling
77
# this file in the same change.
88
#
@@ -17,25 +17,24 @@
1717
# corresponding scenarios start passing and MUST be removed from this list (the
1818
# runner fails on stale entries), so the baseline burns down per milestone.
1919

20-
client: []
20+
client:
2121
# --- Draft-spec scenarios (in `--suite draft`, also part of `--suite all`) ---
22-
# (empty: SEP-2468/2352/2350/837/2207/990 burned by the auth bundle; the
22+
# (none: SEP-2468/2352/2350/837/2207/990 burned by the auth bundle; the
2323
# last referee-side gap — conformance#361 callback-iss — closed at alpha.6)
24+
#
25+
# --- SEP-1932 (DPoP) / SEP-1933 (WIF) — extension-tagged auth scenarios, new in the alpha.10 referee ---
26+
# The OAuth client implements neither DPoP proofs (RFC 9449) nor the
27+
# urn:ietf:params:oauth:grant-type:jwt-bearer grant, so every check in
28+
# these scenarios fails. Client-side extension scenarios are selected only
29+
# by `--suite all`; the 2026 leg cannot flag them stale (extension
30+
# scenarios never match a --spec-version filter).
31+
- auth/dpop
32+
- auth/dpop-nonce
33+
- auth/wif-jwt-bearer
2434

2535
server:
26-
# --- spec PR #3002 — referee pinned at alpha.9 asserts the OLD shape ---
27-
# The alpha.9 `server-stateless` scenario still enforces the pre-#3002
28-
# spec: clientInfo required in the envelope, serverInfo a DiscoverResult
29-
# body field. This SDK follows the final revision (clientInfo optional;
30-
# identity in the result _meta), so exactly three checks fail:
31-
# - sep-2575-request-meta-invalid-missing-client-info
32-
# - sep-2575-http-server-meta-invalid-400 (the missing-client-info iteration)
33-
# - sep-2575-server-implements-discover (requires body serverInfo)
34-
# Remove this entry when the pin bumps to a conformance release that
35-
# incorporates #3002 (alpha.10+).
36-
- server-stateless
3736
# --- SEP-2663 (io.modelcontextprotocol/tasks) — server SDK does not implement the tasks extension ---
38-
# Extension-tagged scenarios; selected only by `--suite all` (the alpha.9 referee
37+
# Extension-tagged scenarios; selected only by `--suite all` (the alpha.10 referee
3938
# has no server-side `--suite extensions`). The active/draft/2026 legs never select
4039
# them, so they cannot flag these entries as stale. `tasks-status-notifications` is
4140
# intentionally absent: the referee SKIPs it unconditionally (harness rewrite pending

test/conformance/package.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -38,7 +38,7 @@
3838
"test:conformance:all": "pnpm run test:conformance:client:all && pnpm run test:conformance:server:all"
3939
},
4040
"devDependencies": {
41-
"@modelcontextprotocol/conformance": "0.2.0-alpha.9",
41+
"@modelcontextprotocol/conformance": "0.2.0-alpha.10",
4242
"@modelcontextprotocol/client": "workspace:^",
4343
"@modelcontextprotocol/server": "workspace:^",
4444
"@modelcontextprotocol/core-internal": "workspace:^",

0 commit comments

Comments
 (0)