Skip to content

Use unfused SDPA for short sequences (q_len <= 128 or kv_len <= 128) #73016

Use unfused SDPA for short sequences (q_len <= 128 or kv_len <= 128)

Use unfused SDPA for short sequences (q_len <= 128 or kv_len <= 128) #73016

Job Run time
0s
35m 23s
11m 50s
30m 48s
-1s
25m 50s
15m 19s
14m 15s
14m 40s
9m 42s
13m 48s
9m 56s
9m 28s
9m 39s
11m 0s
14m 9s
16m 13s
10m 22s
11m 8s
19m 9s
11m 54s
13m 42s
16m 14s
12m 5s
58m 27s
19m 12s
4m 54s
11m 23s
20m 2s
16m 43s
9m 35s
9m 13s
50m 15s
9m 10s
9m 59s
10m 4s
43m 26s
9m 50s
9m 33s
10m 1s
13m 52s
22m 36s
11m 2s
9m 34s
9m 34s
13m 53s
11m 3s
52m 40s
10m 58s
9m 15s
11m 52s
11m 40s
13m 36s
32m 55s
17m 26s
22m 56s
45m 42s
9m 23s
40m 48s
47m 49s
8m 17s
55m 2s
9m 1s
10m 39s
27m 25s
37m 7s
9m 32s
8m 4s
12m 34s
13m 25s
8m 20s
12m 54s
15m 50s
14m 19s
11m 17s
13m 58s
20m 42s
8m 51s
6m 4s
8m 47s
20m 37s
12m 7s
16m 11s
30m 37s
1h 4m 22s
1h 0m 30s
1h 17m 47s
14m 37s
1h 6m 46s
9m 45s
19m 27s
1h 16m 35s
6m 28s
1h 0m 40s
37m 27s
8m 51s
11m 23s
11m 54s
12m 19s
57m 0s
9m 12s
9m 18s
10m 35s
18m 30s
11m 8s
14m 32s
8m 42s
19m 11s
55m 54s
2h 11m 34s
2m 21s
1d 14h 55m 22s