fix(schema): reject stale authored skill and trajectory graders

[christso]

Summary

Authored eval YAML now hard-rejects the stale AgentV-only skill-trigger and tool-trajectory assertion types with migration guidance to the Promptfoo-compatible skill-used, not-skill-used, and trajectory:* shapes.

The migration script can rewrite the supported stale forms, while latency-specific tool-trajectory checks are left for explicit validation failure because there is no Promptfoo-compatible equivalent yet. Existing examples and AI-facing skill-data guidance now teach the replacement assertions, while private runtime compatibility types/tests remain in place.

Validation

• bun test scripts/migrate-hard-deprecations.test.ts packages/core/test/evaluation/loaders/grader-parser.test.ts packages/core/test/evaluation/validation/eval-file-schema.test.ts packages/core/test/evaluation/validation/eval-validator.test.ts packages/core/test/evaluation/validation/eval-schema-sync.test.ts
• bun run typecheck
• bun run lint
• bun run validate:examples
• git diff --check

Live dogfood was not run because this PR changes authored YAML validation/parsing, codemod migration, examples, and guidance only. It does not change eval execution or grader runtime behavior beyond rejecting stale authored config before runtime.

Post-Deploy Monitoring & Validation

• Watch CI for schema, parser, validator, and example validation coverage.
• Re-run agentv validate against migrated downstream evals that previously authored skill-trigger or tool-trajectory.
• Follow-up public docs/deprecation cleanup remains in the broader Promptfoo-alignment docs Beads.

Related

Related: av-kfik.45.1

---

[cloudflare-workers-and-pages]

Deploying agentv with    Cloudflare Pages

Latest commit:	12232f6
Status:	✅  Deploy successful!
Preview URL:	https://547a2fa7.agentv.pages.dev
Branch Preview URL:	https://promptfoo-stale-grader-depre.agentv.pages.dev

View logs