Rename mcp-named scripts and add org-scale support to scaffold-task skill

- Rename generate_mcp_unique_tasks.py → generate_csb_org_tasks.py
- Rename register_new_mcp_tasks.py → register_new_org_tasks.py
- Rename validate_mcp_task_instance.py → validate_org_task_instance.py
- Rename remirror_mcp_unique_repos.sh → remirror_org_repos.sh
- Update all references in docs, registry, and scripts
- Add org-scale task support to /scaffold-task skill:
  - New "Add org-scale task" and "Create new org-scale suite" modes
  - Org-specific templates: task.toml (with org_scale=true),
    multi-repo Dockerfile, artifact-based instruction.md,
    eval.sh, oracle_checks.py, task_spec.json
  - Org-specific registration entry format
- Regenerate script registry and index

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Author: sjarmak

docs/EXTENSIBILITY.md

@@ -90,13 +90,13 @@ cannot do. See `docs/ORG_TASKS.md` for the full authoring guide.
 
 ```bash
 # 1. Generate from use case registry
-python3 scripts/generate_mcp_unique_tasks.py --use-case-ids <N> --curate-oracle --validate
+python3 scripts/generate_csb_org_tasks.py --use-case-ids <N> --curate-oracle --validate
 
 # 2. Register in selection file
 #    configs/selected_benchmark_tasks.json
 
 # 3. Validate
-python3 scripts/validate_mcp_task_instance.py --task-dir benchmarks/csb_org_<suite>/<task>
+python3 scripts/validate_org_task_instance.py --task-dir benchmarks/csb_org_<suite>/<task>
 python3 scripts/validate_tasks_preflight.py --suite csb_org_<suite>
 ```
 

docs/ORG_TASKS.md

@@ -39,7 +39,7 @@ cross-repo tasks — not whether MCP can access information the baseline can't.
 │  configs/use_case_registry.json        (100 use cases)     │
 │         │                                                   │
 │         ▼                                                   │
-│  scripts/generate_mcp_unique_tasks.py  (task generator)    │
+│  scripts/generate_csb_org_tasks.py  (task generator)    │
 │         │                                                   │
 │         ▼                                                   │
 │  benchmarks/csb_org_<suite>/<task>/                        │
@@ -57,7 +57,7 @@ cross-repo tasks — not whether MCP can access information the baseline can't.
 │                                                             │
 │  scripts/csb_metrics/retrieval.py      (KPI extractor)     │
 │  scripts/curate_oracle.py              (oracle auto-curator)│
-│  scripts/validate_mcp_task_instance.py (validity gate)     │
+│  scripts/validate_org_task_instance.py (validity gate)     │
 └────────────────────────────────────────────────────────────┘
 ```
 
@@ -106,16 +106,16 @@ source of truth for which repos a task uses and at what version.
 
 ```bash
 # Generate a task for use case ID 1 (dry run to preview)
-python3 scripts/generate_mcp_unique_tasks.py --use-case-ids 1 --dry-run
+python3 scripts/generate_csb_org_tasks.py --use-case-ids 1 --dry-run
 
 # Generate with oracle curation
-python3 scripts/generate_mcp_unique_tasks.py --use-case-ids 1 --curate-oracle
+python3 scripts/generate_csb_org_tasks.py --use-case-ids 1 --curate-oracle
 
 # Generate all category A tasks
-python3 scripts/generate_mcp_unique_tasks.py --category A
+python3 scripts/generate_csb_org_tasks.py --category A
 
 # Generate and validate
-python3 scripts/generate_mcp_unique_tasks.py --use-case-ids 1 --validate
+python3 scripts/generate_csb_org_tasks.py --use-case-ids 1 --validate
 ```
 
 The generator reads `configs/use_case_registry.json` to fill
@@ -138,7 +138,7 @@ print(uc['customer_prompt'])
 
 **Step 2: Generate the task skeleton**
 ```bash
-python3 scripts/generate_mcp_unique_tasks.py \
+python3 scripts/generate_csb_org_tasks.py \
   --use-case-ids 1 \
   --out benchmarks/ \
   --verbose
@@ -159,7 +159,7 @@ to discover all files matching the task's `seed_prompt`. It writes:
 
 **Step 4: Validate the oracle (fail2pass gate)**
 ```bash
-python3 scripts/validate_mcp_task_instance.py \
+python3 scripts/validate_org_task_instance.py \
   --task-dir benchmarks/csb_org_crossrepo_tracing/ccx-dep-trace-001 \
   --verbose
 ```
@@ -471,7 +471,7 @@ See `configs/use_case_registry.json` — entries with
 
 1. Set `"verification_modes": ["artifact", "direct"]` in the registry entry.
 2. Ensure the fixture has `local_checkout_repos` (direct mode needs full repo).
-3. Run `generate_mcp_unique_tasks.py` — creates `direct_verifier.sh` placeholder.
+3. Run `generate_csb_org_tasks.py` — creates `direct_verifier.sh` placeholder.
 4. Run `customize_mcp_skeletons.py` — generates dual-mode `test.sh` and copies
    parent verifier if the task has SDLC lineage.
 5. Manually curate `direct_verifier.sh` for task-specific verification logic.

docs/assets/blog/medium/post_codescalebench_engineering_diary.md

@@ -69,7 +69,7 @@ Oracle quality was gated before task inclusion with the fail2pass check.
 
 Implementation anchors:
 - `configs/use_case_registry.json`
-- `scripts/generate_mcp_unique_tasks.py`
+- `scripts/generate_csb_org_tasks.py`
 - `scripts/customize_mcp_skeletons.py`
 - `docs/technical_reports/TECHNICAL_REPORT.md` (Section 5)
 

docs/ops/SCRIPT_INDEX.md

@@ -67,8 +67,8 @@ Generated from `scripts/registry.json` by `scripts/generate_script_index.py`.
 - `scripts/official_runs.py` - QA/validation script for official runs.
 - `scripts/quarantine_invalid_tasks.py` - QA/validation script for quarantine invalid tasks.
 - `scripts/validate_artifact_golden.py` - QA/validation script for validate artifact golden.
-- `scripts/validate_mcp_task_instance.py` - QA/validation script for validate mcp task instance.
 - `scripts/validate_official_integrity.py` - QA/validation script for validate official integrity.
+- `scripts/validate_org_task_instance.py` - QA/validation script for validate org task instance.
 
 ## Data Management
 
@@ -97,13 +97,13 @@ Generated from `scripts/registry.json` by `scripts/generate_script_index.py`.
 
 - `scripts/curate_oracle.py` - Task creation/selection script for curate oracle.
 - `scripts/customize_mcp_skeletons.py` - Task creation/selection script for customize mcp skeletons.
+- `scripts/generate_csb_org_tasks.py` - Task creation/selection script for generate csb org tasks.
 - `scripts/generate_dependeval_tasks.py` - Task creation/selection script for generate dependeval tasks.
-- `scripts/generate_mcp_unique_tasks.py` - Task creation/selection script for generate mcp unique tasks.
 - `scripts/generate_pytorch_expected_diffs.py` - Task creation/selection script for generate pytorch expected diffs.
 - `scripts/materialize_dependeval_repos.py` - Task creation/selection script for materialize dependeval repos.
 - `scripts/materialize_sdlc_suites.py` - Task creation/selection script for materialize sdlc suites.
 - `scripts/mine_bug_tasks.py` - Task creation/selection script for mine bug tasks.
-- `scripts/register_new_mcp_tasks.py` - Task creation/selection script for register new mcp tasks.
+- `scripts/register_new_org_tasks.py` - Task creation/selection script for register new org tasks.
 - `scripts/rename_tasks.py` - Task creation/selection script for rename tasks.
 - `scripts/select_benchmark_tasks.py` - Task creation/selection script for select benchmark tasks.
 - `scripts/select_dependeval_tasks.py` - Task creation/selection script for select dependeval tasks.
@@ -228,7 +228,7 @@ Generated from `scripts/registry.json` by `scripts/generate_script_index.py`.
 - `scripts/push_base_images_ghcr.sh` - Utility script for push base images ghcr.
 - `scripts/regenerate_artifact_dockerfiles.py` - Utility script for regenerate artifact dockerfiles.
 - `scripts/rehost_sweap_images.py` - Utility script for rehost sweap images.
-- `scripts/remirror_mcp_unique_repos.sh` - Utility script for remirror mcp unique repos.
+- `scripts/remirror_org_repos.sh` - Utility script for remirror org repos.
 - `scripts/rename_project.py` - Utility script for rename project.
 - `scripts/repair_h3_trajectories.py` [one_off] - Historical one-off script: repair h3 trajectories.
 - `scripts/rerun_crossrepo_2tasks.sh` [one_off] - Historical one-off script: rerun crossrepo 2tasks.

scripts/curate_oracle.py

@@ -1099,7 +1099,7 @@ def main() -> int:
         json.dump(log_data, f, indent=2)
 
     if args.verify:
-        validator = project_root / "scripts" / "validate_mcp_task_instance.py"
+        validator = project_root / "scripts" / "validate_org_task_instance.py"
         if validator.exists():
             result = subprocess.run(
                 [sys.executable, str(validator), "--task-dir", str(task_dir), "--verbose"],

scripts/generate_mcp_unique_tasks.py scripts/generate_csb_org_tasks.pyscripts/generate_mcp_unique_tasks.py renamed to scripts/generate_csb_org_tasks.py

@@ -3,14 +3,14 @@
 
 Reads configs/use_case_registry.json and fixtures/repo_sets/*.json, fills
 templates from templates/csb-org/, and writes task directories under
-benchmarks/<mcp_suite>/<task_slug>/.
+benchmarks/<org_suite>/<task_slug>/.
 
 Usage:
-    python3 scripts/generate_mcp_unique_tasks.py --use-case-ids 1 4 10
-    python3 scripts/generate_mcp_unique_tasks.py --category A
-    python3 scripts/generate_mcp_unique_tasks.py --family cross-repo-dep-trace
-    python3 scripts/generate_mcp_unique_tasks.py --all --dry-run
-    python3 scripts/generate_mcp_unique_tasks.py --category A --curate-oracle --verbose
+    python3 scripts/generate_csb_org_tasks.py --use-case-ids 1 4 10
+    python3 scripts/generate_csb_org_tasks.py --category A
+    python3 scripts/generate_csb_org_tasks.py --family cross-repo-dep-trace
+    python3 scripts/generate_csb_org_tasks.py --all --dry-run
+    python3 scripts/generate_csb_org_tasks.py --category A --curate-oracle --verbose
 """
 
 import argparse

scripts/generate_script_registry.py

@@ -47,7 +47,7 @@
         "abc_criteria.py",
         "validate_official_integrity.py",
         "quarantine_invalid_tasks.py",
-        "validate_mcp_task_instance.py",
+        "validate_org_task_instance.py",
         "validate_artifact_golden.py",
     },
     "data_management": {
@@ -77,8 +77,8 @@
         "generate_pytorch_expected_diffs.py",
         "select_dependeval_tasks.py",
         "generate_dependeval_tasks.py",
-        "generate_mcp_unique_tasks.py",
-        "register_new_mcp_tasks.py",
+        "generate_csb_org_tasks.py",
+        "register_new_org_tasks.py",
         "materialize_dependeval_repos.py",
         "materialize_sdlc_suites.py",
         "curate_oracle.py",

scripts/register_new_mcp_tasks.py scripts/register_new_org_tasks.pyscripts/register_new_mcp_tasks.py renamed to scripts/register_new_org_tasks.py

@@ -1,5 +1,5 @@
 #!/usr/bin/env python3
-"""Register 20 new MCP-unique tasks in both selection files."""
+"""Register new org-scale tasks in both selection files."""
 
 import json
 import os

scripts/registry.json

@@ -650,6 +650,14 @@
       "language": "python",
       "summary": "Generation script for generate coverage gap configs."
     },
+    {
+      "name": "generate_csb_org_tasks.py",
+      "path": "scripts/generate_csb_org_tasks.py",
+      "category": "task_creation_selection",
+      "status": "maintained",
+      "language": "python",
+      "summary": "Task creation/selection script for generate csb org tasks."
+    },
     {
       "name": "generate_dependeval_tasks.py",
       "path": "scripts/generate_dependeval_tasks.py",
@@ -698,14 +706,6 @@
       "language": "python",
       "summary": "Rebuilds `MANIFEST.json` from on-disk run results."
     },
-    {
-      "name": "generate_mcp_unique_tasks.py",
-      "path": "scripts/generate_mcp_unique_tasks.py",
-      "category": "task_creation_selection",
-      "status": "maintained",
-      "language": "python",
-      "summary": "Task creation/selection script for generate mcp unique tasks."
-    },
     {
       "name": "generate_pytorch_expected_diffs.py",
       "path": "scripts/generate_pytorch_expected_diffs.py",
@@ -1171,12 +1171,12 @@
       "summary": "Utility script for regenerate artifact dockerfiles."
     },
     {
-      "name": "register_new_mcp_tasks.py",
-      "path": "scripts/register_new_mcp_tasks.py",
+      "name": "register_new_org_tasks.py",
+      "path": "scripts/register_new_org_tasks.py",
       "category": "task_creation_selection",
       "status": "maintained",
       "language": "python",
-      "summary": "Task creation/selection script for register new mcp tasks."
+      "summary": "Task creation/selection script for register new org tasks."
     },
     {
       "name": "rehost_sweap_images.py",
@@ -1195,12 +1195,12 @@
       "summary": "Analysis/comparison script for reliability analysis."
     },
     {
-      "name": "remirror_mcp_unique_repos.sh",
-      "path": "scripts/remirror_mcp_unique_repos.sh",
+      "name": "remirror_org_repos.sh",
+      "path": "scripts/remirror_org_repos.sh",
       "category": "misc",
       "status": "maintained",
       "language": "shell",
-      "summary": "Utility script for remirror mcp unique repos."
+      "summary": "Utility script for remirror org repos."
     },
     {
       "name": "rename_project.py",
@@ -1546,14 +1546,6 @@
       "language": "python",
       "summary": "Validation script for validate enterprise readiness."
     },
-    {
-      "name": "validate_mcp_task_instance.py",
-      "path": "scripts/validate_mcp_task_instance.py",
-      "category": "qa_quality",
-      "status": "maintained",
-      "language": "python",
-      "summary": "QA/validation script for validate mcp task instance."
-    },
     {
       "name": "validate_official_integrity.py",
       "path": "scripts/validate_official_integrity.py",
@@ -1570,6 +1562,14 @@
       "language": "python",
       "summary": "Validation script for validate on contextbench."
     },
+    {
+      "name": "validate_org_task_instance.py",
+      "path": "scripts/validate_org_task_instance.py",
+      "category": "qa_quality",
+      "status": "maintained",
+      "language": "python",
+      "summary": "QA/validation script for validate org task instance."
+    },
     {
       "name": "validate_submission.py",
       "path": "scripts/validate_submission.py",

scripts/remirror_mcp_unique_repos.sh scripts/remirror_org_repos.shscripts/remirror_mcp_unique_repos.sh renamed to scripts/remirror_org_repos.sh

@@ -3,7 +3,7 @@
 # These repos already exist on GitHub — we shallow-clone at the correct tag,
 # create an orphan commit, and force-push to overwrite.
 #
-# Usage: bash scripts/remirror_mcp_unique_repos.sh
+# Usage: bash scripts/remirror_org_repos.sh
 set -euo pipefail
 
 SG_ORG="sg-evals"