Skip to content

Commit 9afa6c0

Browse files
tbitcsoz-agent
andcommitted
docs(site): add model-intel + suggest-profiles + endpoint-presets to commands.md
Adds readthedocs command reference entries for: - specsmith model-intel sync/scores/recommendations/connection (REQ-263..269) - specsmith agent suggest-profiles (REQ-280) - specsmith agent endpoint-presets (REQ-278) Co-Authored-By: Oz <oz-agent@warp.dev>
1 parent b60e3e4 commit 9afa6c0

1 file changed

Lines changed: 79 additions & 0 deletions

File tree

docs/site/commands.md

Lines changed: 79 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -824,3 +824,82 @@ specsmith agent ask "check compliance gaps" --json-output
824824
**JSON output:** `{"reply": "...", "action": "...", "prompt": "..."}`
825825

826826
**Exit code:** always 0 (the dispatcher is best-effort).
827+
828+
829+
---
830+
831+
## model-intel
832+
833+
AI model intelligence — HuggingFace Open LLM Leaderboard sync, bucket scoring, and recommendations.
834+
835+
### model-intel sync
836+
837+
```bash
838+
specsmith model-intel sync [--json] [--project-dir DIR]
839+
```
840+
841+
Fetch benchmark data from the HF Datasets Server and compute bucket scores for all models.
842+
Falls back to 40+ built-in static scores when HF is unreachable. Exits 0 even without network access.
843+
844+
**JSON output:** `{"synced": N, "errors": 0, "message": "..."}`
845+
846+
### model-intel scores
847+
848+
```bash
849+
specsmith model-intel scores [--model MODEL] [--bucket BUCKET] [--json] [--project-dir DIR]
850+
```
851+
852+
List all cached bucket scores or show scores for a specific model.
853+
854+
**Without --model:** `{"scores": [{"model_name": ..., "reasoning_score": ..., "conversational_score": ..., "longform_score": ...}]}`
855+
856+
**With --model:** `{"score": {"model_name": ..., "reasoning_score": ..., "conversational_score": ..., "longform_score": ...}}`
857+
858+
### model-intel recommendations
859+
860+
```bash
861+
specsmith model-intel recommendations [--bucket BUCKET] [--top-k N] [--json] [--project-dir DIR]
862+
```
863+
864+
Return the top-k models for a given bucket (reasoning/conversational/longform), sorted descending by score.
865+
Default bucket: `reasoning`. Default top-k: 10.
866+
867+
**JSON output:** `{"recommendations": [{"model": ..., "score": ..., "reasoning": ..., "conversational": ..., "longform": ...}], "bucket": "..."}`
868+
869+
### model-intel connection
870+
871+
```bash
872+
specsmith model-intel connection [--json] [--project-dir DIR]
873+
```
874+
875+
Probe HuggingFace API connectivity and validate `SPECSMITH_HF_TOKEN`.
876+
877+
**JSON output:** `{"valid": bool, "token_set": bool, "token_valid": bool, "rate_limit_tier": "...", "dataset_server_ok": bool, "message": "..."}`
878+
879+
---
880+
881+
## agent suggest-profiles
882+
883+
```bash
884+
specsmith agent suggest-profiles [--json] [--project-dir DIR]
885+
```
886+
887+
Suggest optimal model profiles based on available API keys and hardware (Ollama, BYOE endpoints).
888+
Suggestions are **read-only** — never persisted to providers.json.
889+
890+
Each suggestion includes: `provider_type`, `model`, `bucket`, `role`, `notes`.
891+
892+
---
893+
894+
## agent endpoint-presets
895+
896+
```bash
897+
specsmith agent endpoint-presets [--json] [--project-dir DIR]
898+
```
899+
900+
List all built-in endpoint presets for common OpenAI-compatible LLM providers.
901+
902+
Includes: `vllm`, `lm_studio`, `llama_cpp`, `openrouter`, `together`, `groq`,
903+
`fireworks`, `deepinfra`, `perplexity`, `azure_openai` (10+ presets).
904+
905+
Each preset: `{"id": ..., "label": ..., "base_url": ..., "endpoint_kind": ..., "needs_key": bool}`

0 commit comments

Comments
 (0)