Summary
When using opslevel-mcp, the Checks API does not appear to return Scorecard checks in its “list” response. This prevents programmatic discovery/sync of scorecard-related checks via MCP.
Environment
- opslevel-mcp version:2026.5.15
- Deployment: installed from Homebrew
- MCP client: VS Code
- Date observed: 2026-05-29
Steps to Reproduce
- Configure and connect opslevel-mcp to an OpsLevel account.
- In the OpsLevel UI, create a Scorecard assigned to a Team that has one or more Checks.
- Call the AI tool with usage of opslevel-mcp to retrieve all checks.
- Compare the returned list to what is visible in the OpsLevel UI under Reports → Checks.
Expected Behavior
The checks listing should include Scorecard checks (or provide an explicit way to request them), so clients can:
- enumerate all checks,
- map checks to scorecards,
- map checks to components
Actual Behavior
The list response includes Rubric checks, but Scorecard checks are not present.
Impact
- Cannot retrieve/iterate over scorecard checks via MCP.
- Workflows that depend on “list all checks → update/compare → apply changes” are blocked.
Questions
- Is there currently an API/tool method to retrieve Scorecard checks (even if not returned by the generic checks list)?
- If yes, what endpoint/tool should be used, and what fields identify a check as a scorecard check?
- If not, would you accept a change that either:
- includes scorecard checks in the existing checks list, or
- adds a dedicated method?
Summary
When using opslevel-mcp, the Checks API does not appear to return Scorecard checks in its “list” response. This prevents programmatic discovery/sync of scorecard-related checks via MCP.
Environment
Steps to Reproduce
Expected Behavior
The checks listing should include Scorecard checks (or provide an explicit way to request them), so clients can:
Actual Behavior
The list response includes Rubric checks, but Scorecard checks are not present.
Impact
Questions