Add heads_per_tile (multi-head-per-tile) support to Ulysses ring attention
#966
| Job | Run time |
|---|---|
| -1s | |
| 0s | |
| -6s | |
| -9s | |
| -11s | |
| -27s |
heads_per_tile (multi-head-per-tile) support to Ulysses ring attention
#966
| Job | Run time |
|---|---|
| -1s | |
| 0s | |
| -6s | |
| -9s | |
| -11s | |
| -27s |