Skip to content

Commit e770e01

Browse files
author
Atome LM Team
committed
Ship trained weights in the kit; refocus moat on integration + V2
Weights now Apache-2.0 alongside the rest of the kit. The license-as-moat strategy was already broken (Apache 2.0, ~$1-2 reproduction cost); a weights-as-moat strategy was thin for the same reasons. Shipping them makes the kit actually runnable and makes the HONEST_RESULTS reversal reproducible end-to-end. Files added to checkpoints/: - atome_944k.bin (271 KB) packed C-engine blob (ATOME01 format) - atome_1m_v1.pt (3.7 MB) PyTorch source checkpoint (for fine-tune) - vanilla_1m_v1.pt (3.7 MB) FP32 vanilla baseline (for the 944K A/B reversal in HONEST_RESULTS.md) .gitignore: keep `checkpoints/*.pt` and `checkpoints/*.bin` as the default, with explicit `!` allow-list for the three released files. Future random checkpoints stay ignored. README: drop the "trained model weights are not in this release" line; add a Weights section explaining what each file is, plus an honest caveat that the 944K is a research-demo artifact, narrow and sometimes incoherent, here to make the architecture runnable, not to set a quality bar. PROJECT_CONTENT.md "What's open vs. what's not" table rewritten so the moat columns reflect reality: weights and architecture are open; the defensible value is silicon bring-up, the Secure Boot Pack, per-platform hardening, and the larger internal V2 (3M-param, mixed-domain) model which stays proprietary.
1 parent 120bd17 commit e770e01

6 files changed

Lines changed: 36 additions & 12 deletions

File tree

.gitignore

Lines changed: 7 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,11 +5,17 @@ __pycache__/
55
.pytest_cache/
66
build/
77

8-
# Trained checkpoints — too big and binary
8+
# Trained checkpoints — too big and binary, EXCEPT the three released artifacts
9+
# (944K demo blob + its PyTorch source + the vanilla FP32 baseline used for
10+
# the HONEST_RESULTS reversal A/B). These are tracked.
911
checkpoints/*.pt
1012
checkpoints/*.atome
1113
checkpoints/*.atome2
14+
checkpoints/*.bin
1215
checkpoints/ab_sweep/
16+
!checkpoints/atome_944k.bin
17+
!checkpoints/atome_1m_v1.pt
18+
!checkpoints/vanilla_1m_v1.pt
1319

1420
# Generated corpus + on-disk fetch cache (sample.txt is intentionally tracked)
1521
data/*.txt

PROJECT_CONTENT.md

Lines changed: 10 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -91,14 +91,16 @@ That's the only signal that matters before declaring done. If you change anythin
9191

9292
## What's open vs. what's not
9393

94-
| Open (this repo, Apache 2.0) | Not open (commercial) |
95-
|-------------------------------------------|----------------------------------------|
96-
| Architecture, training code, C engine | Trained model weights (e.g. the 944K) |
97-
| Export format + parity tests | Per-customer MCU bring-up |
98-
| Sample data, A/B sweep harness | Atome Secure Boot Pack (signed blobs) |
99-
| All docs (PAPER, HONEST_RESULTS, etc.) | Per-platform hardening playbooks |
100-
101-
The architecture is public by design and the training cost is ~$1–2 — a license-as-moat strategy was never going to work. The actual value sits in the weights, the per-deployment integration work, and the security hardening, none of which are in this repo.
94+
| Open (this repo, Apache 2.0) | Not open (commercial) |
95+
|-----------------------------------------------------|-----------------------------------------------|
96+
| Architecture, training code, C engine | Silicon bring-up (per-platform integration) |
97+
| 944K trained weights (`checkpoints/atome_944k.bin`) | Atome Secure Boot Pack (signed `.atome` blobs)|
98+
| PyTorch source `atome_1m_v1.pt` + vanilla baseline | Per-platform hardening + attestation flows |
99+
| Export format + parity tests | Larger internal V2 model (3M params, mixed-domain) |
100+
| Sample data, A/B sweep harness | Custom fine-tuning + per-customer integration |
101+
| All docs (PAPER, HONEST_RESULTS, etc.) | Marketing / live-demo site at atomelm.com |
102+
103+
The architecture is public by design and the training cost is ~$1–2 — a license-as-moat strategy was never going to work, and weights-as-moat would have been thin. The actual defensible value is the per-deployment integration work, the security hardening, and the larger V2 model kept proprietary — none of which sit in this repo.
102104

103105
## If you need to dig deeper
104106

README.md

Lines changed: 19 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -22,8 +22,24 @@ own checkpoint with `scripts/train_demo.py` in ~30 min on a CPU.
2222
**MCU status:** QEMU ARM (Cortex-M3, MPS2-AN385) parity passes to FP32
2323
epsilon. **Silicon bring-up is not done in this repository.** For real
2424
device deployment we sell integration — silicon bring-up, the Atome Secure
25-
Boot Pack, per-platform hardening — at [atomelm.com](https://atomelm.com).
26-
Trained model weights are not part of this open-source release.
25+
Boot Pack (signed `.atome` blobs, dev/prod flags, per-platform secure-boot,
26+
attestation), per-platform hardening — at [atomelm.com](https://atomelm.com).
27+
28+
**Weights are included** in `checkpoints/`:
29+
30+
- `atome_944k.bin` (271 KB) — the packed C-engine blob (`ATOME01` format),
31+
loadable directly by the inference engine.
32+
- `atome_1m_v1.pt` (3.7 MB) — the PyTorch source checkpoint that produced
33+
it; use this to fine-tune or to re-export at different `#define`s.
34+
- `vanilla_1m_v1.pt` (3.7 MB) — the FP32 vanilla GPT baseline used for
35+
the 944K A/B reversal in [`HONEST_RESULTS.md`](HONEST_RESULTS.md);
36+
shipped so you can reproduce the comparison end-to-end.
37+
38+
The 944K checkpoint is a research-demo artifact, not a product: it is
39+
narrow, sometimes incoherent, and trained on a single corpus. It is here
40+
to make the architecture *runnable*, not to set a quality bar. Reproduction
41+
is ~$1–2 of CPU/GPU using the included training code; nothing in this kit
42+
is a reproduction barrier.
2743

2844
---
2945

@@ -163,7 +179,7 @@ Apache License 2.0 — see [`LICENSE`](LICENSE) and [`NOTICE`](NOTICE).
163179

164180
The kit is fully open: use, modify, redistribute, and ship in commercial products without per-seat or per-device fees. The Apache 2.0 patent grant covers the 3-pathway routed-ternary architecture as released here.
165181

166-
Trained model weights are not in this release. Commercial integration, the Atome Secure Boot Pack (signed model blobs, secure-boot guidance for ESP32/STM32/RP2040), and per-customer MCU bring-up are available at [atomelm.com](https://atomelm.com).
182+
The released checkpoints in `checkpoints/` (atome_944k.bin, atome_1m_v1.pt, vanilla_1m_v1.pt) are likewise Apache-2.0. They are reference / research artifacts, not products. Commercial integration — silicon bring-up, the Atome Secure Boot Pack (signed `.atome` blobs, dev/prod flags, per-platform secure-boot, attestation), per-platform hardening, custom-domain fine-tuning of the larger internal V2 model — is available at [atomelm.com](https://atomelm.com).
167183

168184
## Citation
169185

checkpoints/atome_1m_v1.pt

3.63 MB
Binary file not shown.

checkpoints/atome_944k.bin

270 KB
Binary file not shown.

checkpoints/vanilla_1m_v1.pt

3.64 MB
Binary file not shown.

0 commit comments

Comments
 (0)