fix(targets): add Pi SDK OpenAI target#1361
Merged
Merged
Conversation
Deploying agentv with
|
| Latest commit: |
07ae6f7
|
| Status: | ✅ Deploy successful! |
| Preview URL: | https://6d85e070.agentv.pages.dev |
| Branch Preview URL: | https://fix-pi-sdk-openai-target.agentv.pages.dev |
7a19b13 to
d9b1f5f
Compare
d9b1f5f to
07ae6f7
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
pi-sdktarget to the standard OpenAI-compatible endpoint withgpt-5.5andthinking: low.pi-sdk-openaitarget with the same OpenAI-compatible Pi SDK config.gpt-5.5,thinking: low, andstream_log: rawon Pi SDK targets touched in this PR.toolsallowlists from Pi SDK targets so Pi uses its default tool set.log_format: jsonusages withstream_log: raw.log_formatcompatibility in code, but allowstream_login validation for providers that already consume it.Verification
NODE_PATH=/home/entity/.local/lib/node_modules bun apps/cli/src/cli.ts eval examples/features/basic/evals/dataset.eval.yaml \ --targets .agentv/targets.yaml --target pi-sdk --test-id shorthand-string-example \ --output .agentv/verification/age-33/basic-shorthand-pi-sdk-live-gpt55pi-sdk, provider log written.NODE_PATH=/home/entity/.local/lib/node_modules bun apps/cli/src/cli.ts eval examples/features/basic/evals/dataset.eval.yaml \ --targets .agentv/targets.yaml --target pi-sdk-openai --test-id shorthand-string-example \ --output .agentv/verification/age-33/basic-shorthand-pi-sdk-openai-live-gpt55pi-sdk-openai, provider log written.NODE_PATH=/home/entity/.local/lib/node_modules bun apps/cli/src/cli.ts eval examples/showcase/export-screening/evals/dataset.eval.yaml \ --targets .agentv/targets.yaml --target pi-sdk --test-id exp-high-001 \ --output .agentv/verification/age-33/export-exp-high-001-pi-sdk-live-gpt55riskLevel: High.response.md; this is an eval/grader compatibility issue for agent targets, not target execution failure.bun --filter @agentv/core build bun apps/cli/src/cli.ts eval examples/features/basic/evals/dataset.eval.yaml \ --targets .agentv/targets.yaml --target copilot-sdk --test-id shorthand-string-example --dry-run \ --output .agentv/verification/age-33/basic-shorthand-copilot-sdk-stream-log-dry-run-fixed-rebuiltlog_formatdeprecation warning and noUnknown setting 'stream_log'warning.bun --filter @agentv/core typecheckbun --filter @agentv/phoenix-adapter typecheckbun --filter agentv typecheckbiome check .Notes
For strict JSON classification evals, direct LLM targets are still a better fit than agent targets because agent target artifacts may include tool transcripts in addition to the final assistant answer.