Skip to content

Use unfused SDPA for short sequences (q_len <= 128 or kv_len <= 128) #70923

Use unfused SDPA for short sequences (q_len <= 128 or kv_len <= 128)

Use unfused SDPA for short sequences (q_len <= 128 or kv_len <= 128) #70923

Job Run time
17m 31s
17m 46s
18m 18s
17m 38s
9m 16s
35m 22s
26m 28s
11m 47s
31m 41s
9m 18s
17m 4s
10m 7s
11m 4s
12m 21s
16m 38s
19m 6s
0s
9m 14s
13m 19s
9m 39s
12m 12s
10m 29s
17m 43s
9m 54s
9m 11s
9m 13s
52m 45s
52m 36s
8m 50s
9m 44s
11m 14s
21m 51s
13m 5s
10m 0s
13m 50s
9m 5s
10m 4s
10m 28s
11m 45s
41m 8s
9m 17s
35m 1s
9m 23s
9m 10s
19m 10s
10m 22s
9m 21s
10m 52s
19m 45s
34m 21s
16m 59s
5m 7s
58m 55s
9m 58s
9m 33s
10m 36s
8m 48s
9m 5s
14m 47s
9m 19s
10m 18s
34m 54s
18m 16s
2h 0m 26s
8m 34s
52m 53s
59m 0s
1h 9m 12s
40m 40s
8m 36s
14m 24s
20m 2s
20m 21s
10m 46s
5m 58s
1h 3m 15s
2h 0m 26s
20m 28s
14m 47s
13m 43s
30m 59s
15m 19s
4m 57s
27m 57s
6m 36s
14m 59s
31m 14s
14m 17s
22m 48s
13m 23s
54m 42s
43m 40s
9m 53s
36m 15s
8m 54s
12m 21s
12m 1s
13m 42s
10m 1s
10m 10s
3h 12m 23s
1d 14h 12m 3s