Skip to content

v1.59.1.0 codex: refresh model docs to GPT-5.6 family (+ max reasoning level)#2213

Open
garrytan wants to merge 7 commits into
mainfrom
cat/codex-5.6-models
Open

v1.59.1.0 codex: refresh model docs to GPT-5.6 family (+ max reasoning level)#2213
garrytan wants to merge 7 commits into
mainfrom
cat/codex-5.6-models

Conversation

@garrytan

Copy link
Copy Markdown
Owner

Continues #2211 by @cathrynlavery from a base-repo branch. Fork PRs don't receive the repo's eval CI secrets, so the eval shards on #2211 could never authenticate (empty ANTHROPIC_API_KEYerror_api / login timeouts). Her commits are preserved with her authorship; four follow-up commits from us ride on top.

What this ships (her work)

Documentation-only refresh of /codex for the GPT-5.6 model family (sol > terra > luna): -m examples updated from gpt-5.1-codex-max / gpt-5.2, Model & Reasoning section names the current frontier, and the new max reasoning level is documented. No behavior change — /codex still hardcodes no model. Contributed by @cathrynlavery.

Follow-up commits (ours)

  • chore: sync package.json to 1.59.1.0 — the branch bumped VERSION only; test/gen-skill-docs.test.ts:256 asserts they match, so bun test failed as submitted.
  • fix(codex): usable-today caveats, from live API probes (2026-07-09):
    • -c model_reasoning_effort=max needs codex CLI >= 0.144 AND an explicit 5.6 model (-m gpt-5.6-sol → works; default model → API 400; CLI 0.136 rejects the value at config parse).
    • Bare -m gpt-5.6 is rejected for Codex with ChatGPT sign-in even though the API-level alias to sol is real (OpenAI API changelog 2026-07-09).
    • Notes the ultra tier above max on some surfaces.
  • docs(changelog): model-status accuracy + credit + voicegpt-5.2 is deprecated-but-selectable, not "retired" (only gpt-5.1-codex-max is retired, API shutdown 2026-07-23); adds the contributor credit line; release-summary voice cleanup.
  • docs(todos): fail-fast fork-PR secret detection in evals.yml — filed from this run's CI diagnosis (a fork shard burned 31m timing out on an empty key).

Verification

  • Fact-check: family/ladder/pricing/context verified against OpenAI's official model docs, pricing page, and API changelog, then passed an adversarial refutation round. Live codex probes: -m gpt-5.6-sol / -terra / -luna all work; =max works on 0.144.1 with -m gpt-5.6-sol.
  • bun test: fully green after the package.json sync.
  • Diff-selected evals (16/181 via eval:select): 46 pass / 2 fail / 324 skip. Both failures reproduce identically on clean origin/main (autoplan-dual-voice Phase-1 claude-voice assertion; gemini live adapter fails on local gemini CLI auth: IneligibleTierError). Pre-existing with receipts, not this diff.
  • Hygiene: gen:skill-docs zero drift; CHANGELOG ordering clean; VERSION 1.59.1.0 confirmed against the open-PR queue (queue-advanced past v1.59.0.0 feat: /land skill + trunk.io merge-queue integration #1815's claimed 1.59.0.0).

🤖 Generated with Claude Code

cathrynlavery and others added 7 commits July 9, 2026 15:26
Keeps the no-hardcode default (auto-frontier). Updates the illustrative
model names in the Model & Reasoning section to the current GPT-5.6
family (sol/terra/luna, bare gpt-5.6 -> sol) and documents the new
`max` reasoning-effort level above xhigh.
The branch bumped VERSION without package.json; test/gen-skill-docs.test.ts:256
asserts they match, so bun test failed on the branch as submitted.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
…-5.6 alias

Live probes against the OpenAI API (2026-07-09):
- -c model_reasoning_effort=max works only on codex CLI >= 0.144 AND an explicit
  GPT-5.6 model (-m gpt-5.6-sol). Installed 0.136 rejects the config value
  ('unknown variant max'); non-5.6 default models return API 400.
- Bare '-m gpt-5.6' is rejected for Codex with ChatGPT sign-in even though the
  API-level alias to gpt-5.6-sol is real (OpenAI API changelog 2026-07-09).
- An 'ultra' tier exists above max on some surfaces (ChatGPT model picker,
  codex-rs ReasoningEffort enum).

Template + regenerated SKILL.md in one commit (check-freshness bisect invariant).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
…r credit, voice

- gpt-5.2 is deprecated but still selectable (survived the 2026-04-14 Codex
  retirement wave; no API shutdown for the base model) — only gpt-5.1-codex-max
  is retired (API shutdown 2026-07-23). Entry no longer calls both 'retired'.
- max escape hatch now carries the codex >= 0.144 + explicit-5.6-model caveats;
  notes the ultra tier above max.
- Adds 'Contributed by @cathrynlavery' per repo convention.
- Release-summary prose aligned with voice rules (no em dashes).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Filed from the PR #2211 full-checks run: fork shards burned 31m48s timing out
on an empty ANTHROPIC_API_KEY before failing, and the contributor re-triggered
the doomed run reading it as flakiness.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@trunk-io

trunk-io Bot commented Jul 10, 2026

Copy link
Copy Markdown

Merging to main in this repository is managed by Trunk.

  • To merge this pull request, check the box to the left or comment /trunk merge below.

After your PR is submitted to the merge queue, this comment will be automatically updated with its status. If the PR fails, failure details will also be posted here

@github-actions

Copy link
Copy Markdown

E2E Evals: ✅ PASS

2/2 tests passed | $1.16 total cost | 13 parallel runners

Suite Result Status Cost
e2e-review 1/1 $0.58
e2e-review 1/1 $0.58

13x ubicloud-standard-8 (Docker: pre-baked toolchain + deps) | wall clock ≈ slowest suite

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants