Skip to content

Question: try an external Voice Agent TestOps regression suite? #2

@monkeyin92

Description

@monkeyin92

Hi Vapi team! I saw this repo is already about running a voice agent test script against evaluator agents, so this felt like the most relevant place to ask. If Issues are not the right place for this, please feel free to close it.

I’m building a small open-source Voice Agent TestOps tool for pre-launch regression testing: https://github.com/monkeyin92/voice-agent-testops

It automatically chats with a voice agent through an HTTP/OpenClaw-compatible endpoint and checks for:

  • unsafe pricing / over-promising
  • missed lead fields like phone or preferred time
  • wrong handoff intent
  • latency over threshold
  • JSON + HTML/PDF reports for CI or sales review

I’m looking for a few real voice agents to test this week. If there is a Vapi example/dev endpoint that can accept a test turn, the trial should take about 10-30 minutes.

Example command:

npm run voice-test -- --suite examples/voice-testops/openclaw-suite.json --agent http --endpoint <your-test-endpoint>

Would anyone here be open to running one suite or pointing me to a better Vapi community channel for this kind of validation? I’m happy to adapt the suite to a Vapi demo domain and share the report back.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions