You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
feat(analysis): dampen initial/bulk commits in Automation axis
Add weighted averaging for the Automation Heaviness axis to prevent
initial project commits and bulk operations from skewing results:
- First commit: weight = 0.25 (likely scaffolding)
- Bulk commits (>50% of max files, when max > 20): weight = 0.5
- Normal commits: weight = 1.0
This addresses feedback where users with small repos got high Automation
scores due to a single large initial commit.
Documentation updated:
- docs/how-vibed-works.md
- docs/architecture/vibe-metrics-v2.md
- apps/web/src/app/methodology/page.tsx
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
To prevent initial project commits and bulk operations from skewing the Automation score, we apply weight dampening when calculating `weighted_avg_files_changed`:
52
+
53
+
```typescript
54
+
// Weight assignment per commit:
55
+
weight=1.0; // default
56
+
if (isFirstCommit) weight=0.25; // scaffolding likely
57
+
elseif (files_changed>maxFiles*0.5&&maxFiles>20) weight=0.5; // bulk op
This ensures small repos with large initial commits (e.g., committing an entire create-react-app scaffold) don't get marked as "AI-heavy" based on that single data point.
Copy file name to clipboardExpand all lines: docs/how-vibed-works.md
+15-1Lines changed: 15 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -76,13 +76,27 @@ Six deterministic axes (0-100 scores) capture your workflow style:
76
76
77
77
| Axis | What It Measures |
78
78
|------|------------------|
79
-
|**Automation Heaviness**| How much you rely on AI agents and tools for generating code |
79
+
|**Automation Heaviness**| How much you rely on AI agents and tools for generating code (initial/bulk commits dampened) |
80
80
|**Guardrail Strength**| How closely tests, CI, and docs follow your AI-generated changes |
81
81
|**Iteration Loop Intensity**| How often you run prompt-fix-run loops to refine AI output |
82
82
|**Planning Signal**| How much structure you define before prompting AI to generate code |
83
83
|**Surface Area per Change**| How many parts of the codebase your typical prompt or change touches |
84
84
|**Shipping Rhythm**| Your coding session pattern — steady output vs intense vibe sessions |
85
85
86
+
#### Automation Axis: Initial Commit Dampening
87
+
88
+
The Automation Heaviness axis measures how "agentic" your workflow looks based on commit size and breadth. However, initial project commits (scaffolding an entire codebase at once) and bulk operations can skew this metric, especially for small repos.
89
+
90
+
To address this, we apply **commit weight dampening**:
91
+
92
+
| Commit Type | Weight | Rationale |
93
+
|-------------|--------|-----------|
94
+
| First commit | 0.25 | Often includes project scaffolding, framework setup |
95
+
| Bulk commits (>50% of max files, when max > 20) | 0.5 | Large refactors, dependency updates |
96
+
| Normal commits | 1.0 | Typical development work |
97
+
98
+
This means a repo with 7 commits where the first commit touched 800 files won't be marked as "AI-heavy" just because of the initial setup. The weighted average better reflects actual day-to-day patterns.
99
+
86
100
### Step 5: Detect Persona
87
101
Based on your axes, we match you to one of 7 Vibe Personas:
0 commit comments