Skip to content

Commit 28f9a8f

Browse files
fluffy314cursoragent
authored andcommitted
Mac M4 K1.D smoke evidence
Co-authored-by: Cursor <cursoragent@cursor.com>
1 parent 8791722 commit 28f9a8f

2 files changed

Lines changed: 77 additions & 0 deletions

File tree

Lines changed: 64 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,64 @@
1+
{
2+
"schema_version": 1,
3+
"kind": "k1d_dlm_restored_verifier_smoke",
4+
"model": "google/gemma-3-1b-it",
5+
"device": "mps",
6+
"dtype": "torch.bfloat16",
7+
"seq_len": 256,
8+
"configs": [
9+
{
10+
"name": "oracle_full_attention",
11+
"shape": [
12+
1,
13+
256,
14+
262144
15+
],
16+
"last_token_norm": 1232.609130859375,
17+
"last_token_argmax": 52564,
18+
"last_token_max": 10.875,
19+
"last_token_min": -9.6875,
20+
"any_nan": false,
21+
"any_inf": false,
22+
"elapsed_s": 0.3479745000367984
23+
},
24+
{
25+
"name": "v04_sink_4_window_64",
26+
"shape": [
27+
1,
28+
256,
29+
262144
30+
],
31+
"last_token_norm": 1232.609130859375,
32+
"last_token_argmax": 52564,
33+
"last_token_max": 10.875,
34+
"last_token_min": -9.6875,
35+
"any_nan": false,
36+
"any_inf": false,
37+
"elapsed_s": 0.5252928750123829,
38+
"kl_vs_oracle": 0.0,
39+
"argmax_matches_oracle": true
40+
},
41+
{
42+
"name": "v04_no_eviction",
43+
"shape": [
44+
1,
45+
256,
46+
262144
47+
],
48+
"last_token_norm": 1232.609130859375,
49+
"last_token_argmax": 52564,
50+
"last_token_max": 10.875,
51+
"last_token_min": -9.6875,
52+
"any_nan": false,
53+
"any_inf": false,
54+
"elapsed_s": 0.4693464580923319,
55+
"kl_vs_oracle": 0.0,
56+
"argmax_matches_oracle": true
57+
}
58+
],
59+
"smoke_gate": {
60+
"pass": true,
61+
"failures": [],
62+
"no_eviction_kl_threshold": 0.001
63+
}
64+
}
Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,13 @@
1+
==> PR-K1.D smoke test corrected runner
2+
Report: results/research/k1d_smoke_1780909208.json
3+
[k1d] device=mps
4+
[k1d] loading google/gemma-3-1b-it
5+
[k1d] input shape: (1, 256) dtype=torch.int64
6+
[k1d] (a) running standard model.forward (oracle)
7+
[k1d] elapsed 0.35s, last argmax=52564
8+
[k1d] (b) running DLMRestoredVerifier sink=4 window=64
9+
[k1d] elapsed 0.53s, last argmax=52564 (oracle argmax=52564), KL vs oracle=0.0000 nats
10+
[k1d] (c) running DLMRestoredVerifier sink=10000 window=10000 (no eviction)
11+
[k1d] elapsed 0.47s, last argmax=52564, KL vs oracle=0.0000e+00 nats (should be ~0)
12+
[k1d] report -> results/research/k1d_smoke_1780909208.json
13+
[k1d] SMOKE GATE: PASS

0 commit comments

Comments
 (0)