Skip to content

fix(llm): raise OpenRouter Qwen3 verification budget#2633

Open
r266-tech wants to merge 2 commits into
vectorize-io:mainfrom
r266-tech:r266/openrouter-qwen3-verify-budget
Open

fix(llm): raise OpenRouter Qwen3 verification budget#2633
r266-tech wants to merge 2 commits into
vectorize-io:mainfrom
r266-tech:r266/openrouter-qwen3-verify-budget

Conversation

@r266-tech

Copy link
Copy Markdown
Contributor

Summary

  • keep the normal OpenAI-compatible startup verification budget at 100 tokens
  • raise it to 512 only for OpenRouter qwen/qwen3... model IDs, where hidden reasoning can consume the small budget before visible ok content is emitted
  • add boundary coverage for Qwen3 positives plus Qwen2.5, near-miss aliases, and ordinary custom gateways staying on the default budget

Fixes #2630.

Tests

  • python3 -m py_compile hindsight-api-slim/hindsight_api/engine/providers/openai_compatible_llm.py hindsight-api-slim/tests/test_openai_compatible_response_hardening.py

Focused pytest could not run in this local sparse checkout because tests/conftest.py imports project dependencies not installed in the cron environment (asyncpg). Ruff is also not installed in the local Python environment.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

OpenAI-compatible verification can fail on reasoning models because max_tokens=100 is exhausted by reasoning

1 participant