Commit 8236e1e
committed
Correct the
The key generated for looking up the tokamax autotune cache in maxtext was a list, `"group_sizes":[1024, 1024, ...]`, while in the cache file, it is `"group_sizes":{"num_groups":256,"total_size":262144}`, causing the autotune cache miss.
Change it to `inputs.shape[0]` only will produce the key that has `"group_sizes":{"num_groups":256,"total_size":262144}`
PiperOrigin-RevId: 948385403tokamax.RaggedDotGroupSizes configs1 parent 15f281b commit 8236e1e
1 file changed
Lines changed: 1 addition & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1401 | 1401 | | |
1402 | 1402 | | |
1403 | 1403 | | |
1404 | | - | |
1405 | 1404 | | |
1406 | 1405 | | |
1407 | | - | |
| 1406 | + | |
1408 | 1407 | | |
1409 | 1408 | | |
1410 | 1409 | | |
| |||
0 commit comments