Add benchmarks for transposed vs standard KV cache layout #29730
| Job | Run time |
|---|---|
| 10m 20s | |
| 20m 54s | |
| 6m 2s | |
| 16m 43s | |
| 7m 14s | |
| 7m 20s | |
| 6m 46s | |
| 6m 17s | |
| 7m 17s | |
| 8m 6s | |
| 8m 20s | |
| 8m 43s | |
| 7m 5s | |
| 8m 9s | |
| 7m 8s | |
| 2h 16m 24s |
| Job | Run time |
|---|---|
| 10m 20s | |
| 20m 54s | |
| 6m 2s | |
| 16m 43s | |
| 7m 14s | |
| 7m 20s | |
| 6m 46s | |
| 6m 17s | |
| 7m 17s | |
| 8m 6s | |
| 8m 20s | |
| 8m 43s | |
| 7m 5s | |
| 8m 9s | |
| 7m 8s | |
| 2h 16m 24s |