Skip to content

Commit 6bfe897

Browse files
physicsrobclaude
andcommitted
binary_increment: default compile width d=512
At d=256 the optimize=1 schedule needs 17 layers; from d=512 up it sits at the 16-layer optimum (d_head and further widening don't move it). Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
1 parent 6576300 commit 6bfe897

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

examples/binary_increment.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -35,7 +35,7 @@
3535
from torchwright.ops.swiglu.map_select import map_to_table, select
3636
from torchwright.ops.swiglu.sequence_ops import output_sequence, remove_leading_0s
3737

38-
D_MODEL = 256
38+
D_MODEL = 512
3939
# Rotary width the graph is built against; must match the d_head it is
4040
# compiled at (the token-example harness compiles at this d_head).
4141
D_HEAD = 16

0 commit comments

Comments
 (0)