Skip to content

Commit 4d814fa

Browse files
author
Atome LM Team
committed
Post-audit fixes from launch review
HONEST_RESULTS.md "Files of record": drop the stale "trained checkpoints not shipped" claim — they ARE shipped now (the 944K Atome blob and PyTorch source, plus the vanilla FP32 baseline used in the reversal A/B). The 60K ab_sweep stays unshipped because it's 24 throwaway runs reproducible in ~20 min of CPU. scripts/demo.py + scripts/evaluate.py docstrings: point at the bundled atome_1m_v1.pt as the example checkpoint, so a fresh clone can run them without training first. (train_demo.py still defaults to atome_demo.pt because that's the train-from-scratch flow.)
1 parent e770e01 commit 4d814fa

3 files changed

Lines changed: 16 additions & 10 deletions

File tree

HONEST_RESULTS.md

Lines changed: 13 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -103,14 +103,20 @@ row (negligible % overhead at 944K).
103103

104104
## Files of record
105105

106-
Trained checkpoints (`*.pt`, `checkpoints/ab_sweep/`) are **not shipped** in
107-
this public repository — Atome LM is train-from-scratch (see README). The
108-
training *logs* below ship, so every reported number stays auditable
109-
step-by-step:
110-
111-
- `checkpoints/atome_1m_v1.train.json` — 944K Atome, every-1000-step log.
112-
- `checkpoints/vanilla_1m_v1.train.json` — 944K vanilla FP32, same.
106+
The trained 944K checkpoints and their training logs ship with the kit, so
107+
every reported number is auditable step-by-step *and* re-evaluable directly:
108+
109+
- `checkpoints/atome_944k.bin` — packed C-engine blob (ATOME01 format).
110+
- `checkpoints/atome_1m_v1.pt` — 944K Atome PyTorch source.
111+
- `checkpoints/vanilla_1m_v1.pt` — 944K vanilla FP32 baseline (for the
112+
reversal A/B above).
113+
- `checkpoints/atome_1m_v1.train.json` — every-1000-step training log.
114+
- `checkpoints/vanilla_1m_v1.train.json` — same for the vanilla baseline.
113115
- `ab_results.json` — exact 60K A/B result row.
114116
- `FRONTIER.md` — frontier writeup with full 944K disclosure.
115117
- `PAPER.md` — architecture writeup.
116118
- `tests/` — 146 green tests.
119+
120+
The 60K sweep itself (`checkpoints/ab_sweep/`) is **not** shipped — that
121+
was 24 throwaway training runs. Reproducing the sweep takes ~20 minutes
122+
of CPU using the included `scripts/`.

scripts/demo.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@
1111
1212
Usage
1313
-----
14-
python scripts/demo.py --checkpoint checkpoints/atome_demo.pt
14+
python scripts/demo.py --checkpoint checkpoints/atome_1m_v1.pt
1515
python scripts/demo.py --random # random-init,
1616
# for plumbing checks
1717
python scripts/demo.py --random --temperature 1.0 --top-p 0.9

scripts/evaluate.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -11,8 +11,8 @@
1111
1212
Usage:
1313
python scripts/evaluate.py \\
14-
--checkpoint checkpoints/atome_demo.pt \\
15-
--data data/tinystories.txt \\
14+
--checkpoint checkpoints/atome_1m_v1.pt \\
15+
--data data/sample.txt \\
1616
--max-bytes 100000
1717
"""
1818
from __future__ import annotations

0 commit comments

Comments
 (0)