chore: Mark US-005 as complete, update progress log

Author: LoCoBench Bot

ralph-gapfill-docgen/prd.json

@@ -70,8 +70,8 @@
         "Task registered"
       ],
       "priority": 5,
-      "passes": false,
-      "notes": "Cilium: pkg/maps/ (Go wrappers), bpf/ (C definitions). Map lifecycle: creation, pinning, GC via pkg/maps/ctmap/, pkg/maps/lbmap/."
+      "passes": true,
+      "notes": "Cilium at commit ad6b298d (main 2026-02-16). 29 api_methods items (Map struct, creation/lifecycle, CRUD, iteration, BatchIterator, pinning, Key/Value interfaces, events, LoadCollection). 13 behavioral_notes items (pinning semantics, DeleteLocked, BatchIterator retry, event cleanup, MapKey/Value New() requirement, per-CPU maps). 5 usage_examples items. Registered in selected_benchmark_tasks.json (mcp_benefit_score=0.853) and docgen_2config.sh."
     },
     {
       "id": "US-006",
@@ -104,7 +104,7 @@
     {
       "id": "US-008",
       "title": "Create docgen-migration-002: Migration guide from Envoy version upgrade",
-      "description": "As a benchmark developer, I want a migration guide task for an Envoy version upgrade with known API changes (e.g., v2 → v3 xDS API migration).",
+      "description": "As a benchmark developer, I want a migration guide task for an Envoy version upgrade with known API changes (e.g., v2 \u2192 v3 xDS API migration).",
       "acceptanceCriteria": [
         "benchmarks/ccb_docgen/docgen-migration-002/ has complete task files",
         "language=cpp, ground_truth has specific API changes and migration steps",
@@ -113,7 +113,7 @@
       ],
       "priority": 8,
       "passes": false,
-      "notes": "Envoy xDS v2→v3 migration is well-documented. Choose a narrower scope — e.g., changes in a specific filter's config proto between two versions."
+      "notes": "Envoy xDS v2\u2192v3 migration is well-documented. Choose a narrower scope \u2014 e.g., changes in a specific filter's config proto between two versions."
     }
   ]
-}
+}

ralph-gapfill-docgen/progress.txt

@@ -100,3 +100,26 @@
   - MCP benefit for API reference (0.84) is slightly lower than architecture (0.86) due to narrower cross-file scope (0.85 vs 0.93), but higher semantic_search_potential (0.90 vs 0.88) and task_category_weight (0.70 vs 0.65)
   - ground_truth.json weight validation is critical: all per-category items must sum to 1.0, all category weights must sum to 1.0
 ---
+## 2026-02-16 - US-005
+- Created docgen-api-002: Cilium eBPF Map API reference doc task
+- Files created:
+  - benchmarks/ccb_docgen/docgen-api-002/task.toml (category=api_reference, language=go, difficulty=hard, time_limit_sec=1200)
+  - benchmarks/ccb_docgen/docgen-api-002/instruction.md (covers Map lifecycle, CRUD operations, BatchIterator, pinning/persistence, Key/Value interfaces, Event system, LoadCollection)
+  - benchmarks/ccb_docgen/docgen-api-002/tests/ground_truth.json (29 api_methods, 13 behavioral_notes, 5 usage_examples, 8 documentation_structure items)
+  - benchmarks/ccb_docgen/docgen-api-002/tests/test.sh (copied from docgen-api-001, generic Python-based verifier)
+  - benchmarks/ccb_docgen/docgen-api-002/environment/Dockerfile (blobless clone of cilium/cilium at commit ad6b298d, sparse checkout of pkg/bpf, pkg/maps, pkg/datapath/maps)
+- Files modified:
+  - configs/docgen_2config.sh (added docgen-api-002 to ALL_TASK_IDS and TASK_SG_REPO_NAMES)
+  - configs/selected_benchmark_tasks.json (registered task with mcp_benefit_score=0.853, total_selected: 194→195)
+- **Learnings for future iterations:**
+  - Cilium eBPF Map API has 7 major areas: Core Map Type (NewMap, OpenMap, OpenOrCreate, lifecycle), CRUD Operations (Lookup/Update/Delete + batch), Iteration (DumpWithCallback, BatchIterator), Pinning/Persistence (BPFFSRoot, MapPath), Key/Value Interfaces (MapKey, MapValue, MapPerCPUValue), Event System (DumpAndSubscribe, Event types), Collection Loading (LoadCollection)
+  - Used WebSearch and WebFetch to research Cilium's pkg/bpf package API surface from pkg.go.dev
+  - Found specific commit (ad6b298dbd) from GitHub's main branch via WebFetch
+  - Ground truth covers pkg/bpf/ (Map, BatchIterator, EndpointKey, LoadCollection), pkg/maps/, pkg/datapath/maps/ (MapSweeper for GC)
+  - Same 4-category scoring pattern as docgen-api-001: api_methods (0.40), behavioral_notes (0.30), usage_examples (0.20), documentation_structure (0.10)
+  - API reference tasks focus on behavioral semantics: Create vs CreateUnpinned (pinning), OpenOrCreate (existing map behavior), DeleteLocked (must use within DumpCallback), BatchIterator retry on ENOSPC, event cleanup via Handle.Close()
+  - MCP benefit score (0.853) is slightly higher than docgen-api-001 (0.84) due to higher semantic_search_potential (0.92 vs 0.90) but lower cross_file_deps (0.88 vs 0.85)
+  - Weight validation is CRITICAL: ran into api_methods summing to 1.07 and behavioral_notes to 0.98. Fixed by adjusting individual item weights iteratively until all categories sum to 1.0
+  - Sparse checkout pattern for Cilium: --filter=blob:none --no-checkout + sparse-checkout set pkg/bpf pkg/maps pkg/datapath/maps
+  - Cilium eBPF map lifecycle: Map creation (NewMap), opening (OpenMap, OpenOrCreate), CRUD (Lookup/Update/Delete), iteration (BatchIterator with ENOSPC retry), pinning to BPF filesystem (/sys/fs/bpf), event subscription (DumpAndSubscribe), GC via MapSweeper
+---