Skip to content

docs(grading): align reference answers and artifacts#1694

Merged
christso merged 1 commit into
mainfrom
docs/av-kfik-28-7-grading-authoring
Jul 6, 2026
Merged

docs(grading): align reference answers and artifacts#1694
christso merged 1 commit into
mainfrom
docs/av-kfik-28-7-grading-authoring

Conversation

@christso

@christso christso commented Jul 6, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • update public eval-authoring docs and examples to use vars.expected_output plus explicit llm-rubric consumption
  • document public grading artifacts as pass/score/reason with recursive component_results, optional assertion, named_scores, and metadata
  • update Promptfoo parity, README/SDK README, Autoevals/batch/custom-grader docs, and AI-facing eval-writer guidance to avoid legacy authoring/result shapes

Validation

  • git diff --check
  • bun run validate:examples (108/108)
  • bun --filter @agentv/web build
  • bun --filter @agentv/web check:routes

Note: bun install was run in this worktree only after the first docs build failed with astro: command not found; it hydrated dependencies and did not modify tracked files.

Tracker

  • av-kfik.28.7
  • final live provider + real LLM grader dogfood remains tracked by av-kfik.16

@cloudflare-workers-and-pages

Copy link
Copy Markdown

Deploying agentv with  Cloudflare Pages  Cloudflare Pages

Latest commit: f54dd8d
Status: ✅  Deploy successful!
Preview URL: https://dc8d517f.agentv.pages.dev
Branch Preview URL: https://docs-av-kfik-28-7-grading-au.agentv.pages.dev

View logs

@christso christso merged commit bb4cc2b into main Jul 6, 2026
8 checks passed
@christso christso deleted the docs/av-kfik-28-7-grading-authoring branch July 6, 2026 06:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant