Skip to content

docs(transform): publish promptfoo file transform example#1661

Merged
christso merged 1 commit into
mainfrom
promptfoo-transform-docs-xlsx
Jul 5, 2026
Merged

docs(transform): publish promptfoo file transform example#1661
christso merged 1 commit into
mainfrom
promptfoo-transform-docs-xlsx

Conversation

@christso

@christso christso commented Jul 5, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • Publishes transform as the canonical public output-shaping surface in Promptfoo parity docs, eval docs, grader docs, and AI-facing eval writer/migration guidance.
  • Converts the file-output example to default_test.options.transform: file://../scripts/transforms/xlsx-to-csv.ts and built-in cli target config.
  • Adds a live OpenAI-compatible grader target for the xlsx/file-output transform dogfood path while keeping a deterministic local grader target for fast validation.

Validation

  • bun run build
  • bun apps/cli/src/cli.ts validate examples/features/file-transforms/evals/suite.yaml
  • bun apps/cli/src/cli.ts eval examples/features/file-transforms/evals/suite.yaml --target file_output -> 1/1 pass, 100%
  • bun run validate:examples -> 108/108 valid
  • bun run lint

Live Dogfood Evidence

Private evidence branch: EntityProcess/agentv-private:evidence/av-kfik-34-2-transform-docs-xlsx
Private evidence commit: 37eede4

Live command:

LOCAL_OPENAI_PROXY_BASE_URL=http://127.0.0.1:10531/v1 \
LOCAL_OPENAI_PROXY_API_KEY=dummy-local-key \
LOCAL_OPENAI_PROXY_MODEL=gpt-5.4-mini \
bun apps/cli/src/cli.ts eval examples/features/file-transforms/evals/suite.yaml --target file_output_live

Result: 1/1 pass, mean score 100%, canonical bundle .agentv/results/2026-07-05T03-45-04-693Z.

Evidence includes the run bundle, source eval/targets/transform files, artifact tree, and manifest. The raw transcript preserves the .xlsx ContentFile, outputs/answer.md contains transformed spreadsheet text, and grading.json shows the real local-openai-grader llm-rubric passed both required checks.

Notes

  • Historical versioned docs under docs/v4.42.4 are intentionally unchanged.
  • Do not merge until CI is green and coordinator review is complete.

@cloudflare-workers-and-pages

Copy link
Copy Markdown

Deploying agentv with  Cloudflare Pages  Cloudflare Pages

Latest commit: 5cf2fed
Status: ✅  Deploy successful!
Preview URL: https://81199ed5.agentv.pages.dev
Branch Preview URL: https://promptfoo-transform-docs-xls.agentv.pages.dev

View logs

@christso christso marked this pull request as ready for review July 5, 2026 03:51
@christso christso merged commit 6b4d014 into main Jul 5, 2026
8 checks passed
@christso christso deleted the promptfoo-transform-docs-xlsx branch July 5, 2026 04:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant