Skip to content

Commit 9edac0a

Browse files
More orojenesis interperetation
1 parent ed39f5d commit 9edac0a

1 file changed

Lines changed: 5 additions & 1 deletion

File tree

notebooks/tutorials/memory_size_vs_access_tradeoff.ipynb

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -182,7 +182,11 @@
182182
"\n",
183183
"The curve slowly flattens out, rather than quickly, because each Einsum has a different\n",
184184
"shape, and some Einsums enter the no-refetch, fusion-helpful region at smaller on-chip\n",
185-
"memory sizes."
185+
"memory sizes.\n",
186+
"\n",
187+
"Finally, there is a steep drop-off for the fused case at larger on-chip memory sizes.\n",
188+
"This occurs when it becomes feasible to fuse all attention Einsums at once, giving a\n",
189+
"substantial reduction in off-chip accesses."
186190
]
187191
},
188192
{

0 commit comments

Comments
 (0)