Add soitto/convoprobe plugin v0.0.17

[ShuntaroOkuma]

Plugin Submission Form

1. Metadata

• Plugin Author: soitto
• Plugin Name: convoprobe
• Repository URL: https://github.com/ShuntaroOkuma/convoprobe-plugin

2. Submission Type

• New plugin submission
• Version update for existing plugin

3. Description

ConvoProbe is a multi-turn chatbot QA testing tool. The Dify plugin lets users execute a saved ConvoProbe scenario against any Chat-type app in their workspace via Reverse Invocation, then post the resulting transcript back to ConvoProbe for LLM-as-Judge scoring. Useful for regression-testing chatbots, comparing prompts, and producing reviewable QA evidence.

The Tool plugin (run_scenario) takes a scenario_id and a target app-selector and returns the run id + transcript URL.

4. Checklist

• I have read and followed the Publish to Dify Marketplace guidelines
• I have read and comply with the Plugin Developer Agreement
• I confirm my plugin works properly on both Dify Community Edition and Cloud Version
• I confirm my plugin has been thoroughly tested for completeness and functionality
• My plugin brings new value to Dify

5. Documentation Checklist

• Step-by-step setup instructions
• Detailed usage instructions
• All required APIs and credentials are clearly listed
• Connection requirements and configuration details
• Link to the repository for the plugin source code

6. Privacy Protection Information

Data Collection

The plugin transfers:

• Scenario definitions from the ConvoProbe Backend to the plugin runtime (read direction)
• Chatbot prompts and responses, plus latency/error metadata and the resulting transcript, from the plugin to the ConvoProbe Backend (write direction) for LLM-as-Judge scoring and review

No personally identifiable information is collected by the plugin itself. The plugin does NOT transfer Dify workspace API keys, workspace member identities, or files/attachments outside the test scenario. Full details are in PRIVACY.md, bundled in the .difypkg.

Privacy Policy

• I confirm that I have prepared and included a privacy policy in my plugin package based on the Plugin Privacy Protection Guidelines