Skip to content

Commit e9d5ae6

Browse files
committed
docs(plan): add leaderboard enhancements plan with red-team review and validation
4-phase plan: DB + Vote API, Sort/Filter/Preview, Favorites/Votes UI, Scoring updates. Red-teamed (13 findings, 10 accepted) and validated (4 decisions confirmed). Reordered roadmap Phase 3 milestones by implementation readiness.
1 parent 10f87eb commit e9d5ae6

8 files changed

Lines changed: 1694 additions & 28 deletions

File tree

docs/project-roadmap.md

Lines changed: 56 additions & 28 deletions
Original file line numberDiff line numberDiff line change
@@ -82,40 +82,38 @@ MVP launched with all foundational features:
8282

8383
**Status:** Planned
8484
**Duration:** 7-9 weeks
85-
**Goals:** MCP server mode, skill marketplace discovery, sandbox execution, references & scripts
85+
**Goals:** Leaderboard enhancements, skill references & scripts, MCP server, sandbox execution
8686

8787
### Milestones
8888

89-
#### 3.1 MCP Server Implementation (Weeks 1-3)
90-
- [ ] Design MCP protocol for skill discovery
91-
- [ ] Implement MCP server in CLI tool
92-
- [ ] `skillx-mcp-server` package
93-
- [ ] Claude integration via MCP
94-
- [ ] Skill result formatting (JSON/markdown)
95-
96-
Example usage:
97-
```bash
98-
npx skillx-mcp-server
99-
# Server listens on stdio
100-
# Claude makes requests: { method: 'tools/call', name: 'search', args: { query } }
101-
```
89+
> **Implementation order:** Ready-to-implement plans first (3.1, 3.2), then features with external dependencies (3.3-3.6).
10290
103-
#### 3.2 Skill Execution Sandbox (Weeks 3-5)
104-
- [ ] Research: Deno Deploy, AWS Lambda, or Cloudflare Workers
105-
- [ ] Design execution environment (timeouts, resource limits)
106-
- [ ] Implement skill runner (fetch SKILL.md, parse commands)
107-
- [ ] Output capture (stdout, stderr, exit code)
108-
- [ ] Security: sandboxing, env var isolation
91+
#### 3.1 Leaderboard Enhancements (Weeks 1-2) — NEXT UP
92+
**Implementation plan:** [plans/260213-1558-leaderboard-enhancements/plan.md](../plans/260213-1558-leaderboard-enhancements/plan.md)
93+
**Status:** Plan complete (red-teamed + validated), ready to implement
94+
**Why first:** No external dependencies, high user impact, uses migration `0007`
10995

110-
#### 3.3 Skillmark Integration (Weeks 5-6)
111-
- [ ] Fetch radar charts from Skillmark.sh API
112-
- [ ] Embed in skill detail page
113-
- [ ] Cache radar charts (30 min TTL)
114-
- [ ] Display skill verification badge
96+
4 phases: DB + Vote API → Sort/Filter/Preview → Favorites/Votes UI → Scoring updates
11597

116-
#### 3.4 Skill References & Scripts (Weeks 6-7)
98+
Key decisions (validated):
99+
- Reddit-style votes (up/down/none) coexist with 0-10 ratings
100+
- Votes as 8th search signal (7%, RRF reduced 50%→43%)
101+
- Votes as 7th leaderboard signal (10%, rating 35%→30%, installs 25%→20%)
102+
- Sort tabs (5 modes) + category filter dropdown
103+
- Author links to GitHub profile (with username validation)
104+
- Preview modal (description, category, stats)
105+
- Client-side overlay for per-user vote/favorite state
106+
- DB-based rate limiting (10 votes/min per user)
107+
108+
- [ ] Phase 1: Database migration (`votes` table + skills columns) + Vote API
109+
- [ ] Phase 2: Sort/filter controls + clickable author + preview modal
110+
- [ ] Phase 3: Favorites button + vote arrows + auth overlay
111+
- [ ] Phase 4: Scoring algorithm updates + bulk recompute
112+
113+
#### 3.2 Skill References & Scripts (Weeks 2-4)
117114
**Implementation plan:** [plans/260213-1218-skill-references-scripts/plan.md](../plans/260213-1218-skill-references-scripts/plan.md)
118115
**Status:** Plan complete (red-teamed + validated), ready to implement
116+
**Why second:** Ready to implement, uses migration `0006` (order-independent with 3.1), depends on GitHub API
119117

120118
6 phases: DB migration → GitHub fetcher → Seed pipeline → API updates → UI → CLI
121119

@@ -132,7 +130,34 @@ Key decisions (validated):
132130
- [ ] Phase 5: UI skill detail page (references + scripts sections)
133131
- [ ] Phase 6: CLI updates (`--include-refs`, `--include-scripts` for raw mode)
134132

135-
#### 3.5 Skill Publishing Workflow (Weeks 7-9)
133+
#### 3.3 MCP Server Implementation (Weeks 4-6)
134+
- [ ] Design MCP protocol for skill discovery
135+
- [ ] Implement MCP server in CLI tool
136+
- [ ] `skillx-mcp-server` package
137+
- [ ] Claude integration via MCP
138+
- [ ] Skill result formatting (JSON/markdown)
139+
140+
Example usage:
141+
```bash
142+
npx skillx-mcp-server
143+
# Server listens on stdio
144+
# Claude makes requests: { method: 'tools/call', name: 'search', args: { query } }
145+
```
146+
147+
#### 3.4 Skillmark Integration (Weeks 6-7)
148+
- [ ] Fetch radar charts from Skillmark.sh API
149+
- [ ] Embed in skill detail page
150+
- [ ] Cache radar charts (30 min TTL)
151+
- [ ] Display skill verification badge
152+
153+
#### 3.5 Skill Execution Sandbox (Weeks 7-8)
154+
- [ ] Research: Deno Deploy, AWS Lambda, or Cloudflare Workers
155+
- [ ] Design execution environment (timeouts, resource limits)
156+
- [ ] Implement skill runner (fetch SKILL.md, parse commands)
157+
- [ ] Output capture (stdout, stderr, exit code)
158+
- [ ] Security: sandboxing, env var isolation
159+
160+
#### 3.6 Skill Publishing Workflow (Weeks 8-9)
136161
- [ ] Creator dashboard (publish new skill)
137162
- [ ] SKILL.md validation
138163
- [ ] Auto-generate skill card
@@ -146,6 +171,9 @@ Key decisions (validated):
146171
- [ ] Radar charts loading & caching
147172
- [ ] References & scripts displayed on skill detail pages
148173
- [ ] CLI `skillx info` shows references & scripts
174+
- [ ] Leaderboard sort/filter/preview working
175+
- [ ] Vote system functional with rate limiting
176+
- [ ] Scoring algorithm updated with vote signal
149177

150178
---
151179

@@ -266,5 +294,5 @@ Jan 2025 Feb 2025 Mar 2025 Apr 2025 May 2025
266294

267295
---
268296

269-
**Last Updated:** Feb 2025
297+
**Last Updated:** Feb 13, 2026
270298
**Next Review:** Feb 20, 2025

plans/260213-1218-skill-references-scripts/plan.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -43,6 +43,10 @@ Enrich SkillX skills with **references** (markdown docs indexed in Vectorize for
4343
- Phase 4 → unlocks Phase 5, 6 (UI/CLI consume API)
4444
- Phase 5 and 6 can run in parallel
4545

46+
## Cross-Plan Dependencies
47+
48+
**[Leaderboard Enhancements plan](../260213-1558-leaderboard-enhancements/plan.md)** also adds a D1 migration and columns to `skills` table. No code conflicts — different columns (`upvote_count`/`downvote_count`/`net_votes` vs `scripts`/`fts_content`). Migration numbering: this plan = `0006`, leaderboard plan = `0007`. The leaderboard plan also modifies scoring files (`boost-scoring.ts`, `leaderboard-scoring.ts`) which this plan does NOT touch.
49+
4650
## Risks
4751

4852
| Risk | Likelihood | Impact | Mitigation |

0 commit comments

Comments
 (0)