docs: refresh MT-MIA public asset state#296
Conversation
There was a problem hiding this comment.
Code Review
This pull request adds a 'Public Asset Refresh' section to the MT-MIA documentation, detailing a metadata check performed on 2026-05-25. The update confirms that the repository state and the previous decision regarding its status remain unchanged. Feedback was provided regarding a potential inconsistency in the listed result paths, specifically the inclusion of 'rtf', which contradicts the claim that the asset surfaces remain the same as previous assessments.
| The refreshed recursive tree still exposes the same public split, synthetic | ||
| table, and result-packet surfaces: `data/*/split/{mem,non_mem,ref}/`, | ||
| `synth_data/{clava_synth,reldiff_synth}/*/seed_{42,43,44}/`, and | ||
| `results/{clava_ddpm,reldiff,rtf}/*/mtmia_seed_*.jsonl`. A path-name scan for |
There was a problem hiding this comment.
The path pattern now includes rtf in the results/ directory, which was not present in the initial assessment (see lines 15, 46, and 47). This addition contradicts the statement that the tree "still exposes the same" surfaces. If rtf is a newly discovered generator or result set, it should be documented in the 'Candidate' table and 'Parsed Metric Summary' sections to maintain consistency. If it is a typo, it should be removed.
| `results/{clava_ddpm,reldiff,rtf}/*/mtmia_seed_*.jsonl`. A path-name scan for | |
| `results/{clava_ddpm,reldiff}/*/mtmia_seed_*.jsonl`. A path-name scan for |
Summary
full.resultsandfull.scoresarrays without per-score row IDsDecision
Checks
git diff --checkpython -X utf8 scripts/check_public_surface.pypython -X utf8 scripts/check_markdown_links.pypython -X utf8 scripts/export_admitted_evidence_bundle.py --checkpython -X utf8 scripts/run_pr_checks.py