Commit 272128f
Rename "MCP-unique" terminology to "org-scale" across codebase
Org suites are organizational use-case benchmarks (cross-repo discovery,
compliance, incident triage, migration, etc.) that both baseline and MCP
agents can solve — they are not MCP-dependent. This commit:
- Renames mcp_unique=true to org_scale=true in 241 task.toml files
- Updates 241 oracle_checks.py docstrings and 241 eval.sh comments
- Renames docs/MCP_UNIQUE_TASKS.md → docs/ORG_TASKS.md
- Renames docs/MCP_UNIQUE_CALIBRATION.md → docs/ORG_CALIBRATION.md
- Updates script variable names (MCP_UNIQUE_SUITES → ORG_SUITES, etc.)
- Adds 41 missing org tasks to selected_benchmark_tasks.json (T.7 PASS)
- All 20 suites remain Grade A with zero failures
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>1 parent b2b168b commit 272128f
File tree
741 files changed
+1440
-769
lines changed- benchmarks
- backups
- csb_org_compliance_doe_trim
- ccx-compliance-057
- tests
- ccx-compliance-188
- tests
- csb_org_compliance_extra/ccx-compliance-057-ds
- tests
- csb_org_crossorg_doe_trim
- ccx-crossorg-061
- tests
- ccx-crossorg-066
- tests
- ccx-crossorg-210
- tests
- ccx-crossorg-212
- tests
- ccx-crossorg-215
- tests
- csb_org_crossrepo_doe_trim
- ccx-dep-trace-255
- tests
- ccx-dep-trace-256
- tests
- ccx-dep-trace-257
- tests
- ccx-dep-trace-259
- tests
- ccx-dep-trace-269
- tests
- ccx-dep-trace-270
- tests
- csb_org_org_doe_trim
- ccx-agentic-226
- tests
- ccx-agentic-227
- tests
- ccx-agentic-228
- tests
- ccx-agentic-230
- tests
- ccx-agentic-231
- tests
- csb_org_platform_doe_trim
- ccx-platform-247
- tests
- ccx-platform-252
- tests
- csb_org_platform_extra/ccx-explore-091-ds
- tests
- csb_org_compliance
- ccx-compliance-051
- tests
- ccx-compliance-052
- tests
- ccx-compliance-053
- tests
- ccx-compliance-115
- tests
- ccx-compliance-118
- tests
- ccx-compliance-124
- tests
- ccx-compliance-182
- tests
- ccx-compliance-183
- tests
- ccx-compliance-184
- tests
- ccx-compliance-185
- tests
- ccx-compliance-186
- tests
- ccx-compliance-187
- tests
- ccx-compliance-189
- tests
- ccx-compliance-190
- tests
- ccx-compliance-191
- tests
- ccx-compliance-192
- tests
- ccx-compliance-193
- tests
- ccx-compliance-194
- tests
- ccx-compliance-286
- tests
- ccx-compliance-292
- tests
- csb_org_crossorg
- ccx-crossorg-062
- tests
- ccx-crossorg-121
- tests
- ccx-crossorg-132
- tests
- ccx-crossorg-208
- tests
- ccx-crossorg-209
- tests
- ccx-crossorg-211
- tests
- ccx-crossorg-213
- tests
- ccx-crossorg-214
- tests
- ccx-crossorg-216
- tests
- ccx-crossorg-217
- tests
- ccx-crossorg-218
- tests
- ccx-crossorg-219
- tests
- ccx-crossorg-220
- tests
- ccx-crossorg-221
- tests
- ccx-crossorg-222
- tests
- ccx-crossorg-280
- tests
- ccx-crossorg-288
- tests
- ccx-crossorg-295
- tests
- csb_org_crossrepo_tracing
- ccx-config-trace-003
- tests
- ccx-config-trace-010
- tests
- ccx-dep-trace-001
- tests
- ccx-dep-trace-002
- tests
- ccx-dep-trace-004
- tests
- ccx-dep-trace-102
- tests
- ccx-dep-trace-116
- tests
- ccx-dep-trace-123
- tests
- ccx-dep-trace-133
- tests
- ccx-dep-trace-171
- tests
- ccx-dep-trace-172
- tests
- ccx-dep-trace-173
- tests
- ccx-dep-trace-174
- tests
- ccx-dep-trace-175
- tests
- ccx-dep-trace-176
- tests
- ccx-dep-trace-177
- tests
- ccx-dep-trace-178
- tests
- ccx-dep-trace-179
- tests
- ccx-dep-trace-180
- tests
- ccx-dep-trace-181
- tests
- ccx-dep-trace-272
- tests
- ccx-dep-trace-273
- tests
- ccx-dep-trace-293
- tests
- csb_org_crossrepo
- ccx-dep-trace-106
- tests
- ccx-dep-trace-253
- tests
- ccx-dep-trace-254
- tests
- ccx-dep-trace-258
- tests
- ccx-dep-trace-260
- tests
- ccx-dep-trace-261
- tests
- ccx-dep-trace-262
- tests
- ccx-dep-trace-263
- tests
- ccx-dep-trace-264
- tests
- ccx-dep-trace-265
- tests
- ccx-dep-trace-266
- tests
- ccx-dep-trace-267
- tests
- ccx-dep-trace-268
- tests
- ccx-dep-trace-271
- tests
- csb_org_domain
- ccx-domain-071
- tests
- ccx-domain-072
- tests
- ccx-domain-073
- tests
- ccx-domain-074
- tests
- ccx-domain-101
- tests
- ccx-domain-112
- tests
- ccx-domain-120
- tests
- ccx-domain-129
- tests
- ccx-domain-137
- tests
- ccx-domain-140
- tests
- ccx-domain-151
- tests
- ccx-domain-152
- tests
- ccx-domain-153
- tests
- ccx-domain-154
- tests
- ccx-domain-155
- tests
- ccx-domain-156
- tests
- ccx-domain-157
- tests
- ccx-domain-158
- tests
- ccx-domain-159
- tests
- ccx-domain-160
- tests
- csb_org_incident
- ccx-incident-031
- tests
- ccx-incident-032
- tests
- ccx-incident-033
- tests
- ccx-incident-034
- tests
- ccx-incident-037
- tests
- ccx-incident-108
- tests
- ccx-incident-110
- tests
- ccx-incident-113
- tests
- ccx-incident-125
- tests
- ccx-incident-131
- tests
- ccx-incident-139
- tests
- ccx-incident-142
- tests
- ccx-incident-143
- tests
- ccx-incident-144
- tests
- ccx-incident-145
- tests
- ccx-incident-146
- tests
- ccx-incident-147
- tests
- ccx-incident-148
- tests
- ccx-incident-149
- tests
- ccx-incident-150
- tests
- csb_org_migration
- ccx-migration-022
- tests
- ccx-migration-025
- tests
- ccx-migration-026
- tests
- ccx-migration-027
- tests
- ccx-migration-107
- tests
- ccx-migration-114
- tests
- ccx-migration-117
- tests
- ccx-migration-195
- tests
- ccx-migration-196
- tests
- ccx-migration-197
- tests
- ccx-migration-198
- tests
- ccx-migration-199
- tests
- ccx-migration-200
- tests
- ccx-migration-201
- tests
- ccx-migration-202
- tests
- ccx-migration-203
- tests
- ccx-migration-204
- tests
- ccx-migration-205
- tests
- ccx-migration-206
- tests
- ccx-migration-207
- tests
- ccx-migration-274
- tests
- ccx-migration-275
- tests
- ccx-migration-276
- tests
- ccx-migration-277
- tests
- ccx-migration-278
- tests
- ccx-migration-279
- tests
- ccx-migration-289
- tests
- ccx-migration-294
- tests
- csb_org_onboarding
- ccx-explore-042-ds
- tests
- ccx-onboard-041
- tests
- ccx-onboard-042
- tests
- ccx-onboard-043
- tests
- ccx-onboard-044
- tests
- ccx-onboard-050-ds
- tests
- ccx-onboard-050
- tests
- ccx-onboard-103
- tests
- ccx-onboard-109
- tests
- ccx-onboard-128
- tests
- ccx-onboard-134
- tests
- ccx-onboard-136
- tests
- ccx-onboard-138
- tests
- ccx-onboard-280
- tests
- csb_org_org
- ccx-agentic-081
- tests
- ccx-agentic-082
- tests
- ccx-agentic-083
- tests
- ccx-agentic-122
- tests
- ccx-agentic-127
- tests
- ccx-agentic-223
- tests
- ccx-agentic-224
- tests
- ccx-agentic-225
- tests
- ccx-agentic-229
- tests
- ccx-agentic-232
- tests
- ccx-agentic-233
- tests
- ccx-agentic-234
- tests
- ccx-agentic-235
- tests
- ccx-agentic-236
- tests
- ccx-agentic-237
- tests
- ccx-agentic-290
- tests
- csb_org_platform
- ccx-platform-091
- tests
- ccx-platform-094
- tests
- ccx-platform-100
- tests
- ccx-platform-104
- tests
- ccx-platform-119
- tests
- ccx-platform-238
- tests
- ccx-platform-239
- tests
- ccx-platform-240
- tests
- ccx-platform-241
- tests
- ccx-platform-242
- tests
- ccx-platform-243
- tests
- ccx-platform-244
- tests
- ccx-platform-245
- tests
- ccx-platform-246
- tests
- ccx-platform-248
- tests
- ccx-platform-249
- tests
- ccx-platform-250
- tests
- ccx-platform-251
- tests
- ccx-platform-285
- tests
- ccx-platform-291
- tests
- csb_org_security
- ccx-vuln-remed-011
- tests
- ccx-vuln-remed-012
- tests
- ccx-vuln-remed-013
- tests
- ccx-vuln-remed-014
- tests
- ccx-vuln-remed-105
- tests
- ccx-vuln-remed-111
- tests
- ccx-vuln-remed-126
- tests
- ccx-vuln-remed-130
- tests
- ccx-vuln-remed-135
- tests
- ccx-vuln-remed-141
- tests
- ccx-vuln-remed-161
- tests
- ccx-vuln-remed-162
- tests
- ccx-vuln-remed-163
- tests
- ccx-vuln-remed-164
- tests
- ccx-vuln-remed-165
- tests
- ccx-vuln-remed-166
- tests
- ccx-vuln-remed-167
- tests
- ccx-vuln-remed-168
- tests
- ccx-vuln-remed-169
- tests
- ccx-vuln-remed-170
- tests
- ccx-vuln-remed-281
- tests
- ccx-vuln-remed-282
- tests
- ccx-vuln-remed-283
- tests
- ccx-vuln-remed-284
- tests
- ccx-vuln-remed-287
- tests
- ccx-vuln-remed-296
- tests
- configs
- docs
- assets/blog/medium
- reference
- scripts
Some content is hidden
Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
741 files changed
+1440
-769
lines changedLines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
15 | 15 | | |
16 | 16 | | |
17 | 17 | | |
18 | | - | |
| 18 | + | |
19 | 19 | | |
20 | 20 | | |
21 | 21 | | |
| |||
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | | - | |
| 2 | + | |
3 | 3 | | |
4 | 4 | | |
5 | 5 | | |
| |||
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | | - | |
| 2 | + | |
3 | 3 | | |
4 | 4 | | |
5 | 5 | | |
| |||
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
15 | 15 | | |
16 | 16 | | |
17 | 17 | | |
18 | | - | |
| 18 | + | |
19 | 19 | | |
20 | 20 | | |
21 | 21 | | |
| |||
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | | - | |
| 2 | + | |
3 | 3 | | |
4 | 4 | | |
5 | 5 | | |
| |||
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | | - | |
| 2 | + | |
3 | 3 | | |
4 | 4 | | |
5 | 5 | | |
| |||
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
15 | 15 | | |
16 | 16 | | |
17 | 17 | | |
18 | | - | |
| 18 | + | |
19 | 19 | | |
20 | 20 | | |
21 | 21 | | |
| |||
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | | - | |
| 2 | + | |
3 | 3 | | |
4 | 4 | | |
5 | 5 | | |
| |||
0 commit comments