Skip to content

Commit c34f6a8

Browse files
fix a typo?
Signed-off-by: Sudhakar Singh <sudhakars@nvidia.com>
1 parent 952b92f commit c34f6a8

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

  • transformer_engine/pytorch/attention/dot_product_attention

transformer_engine/pytorch/attention/dot_product_attention/utils.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -680,7 +680,7 @@ def _is_fa3_supported(num_heads, num_gqa_groups, head_dim_qk, head_dim_v, qkv_dt
680680
"Disabling FlashAttention for qkv_format = thd when there is "
681681
"padding between sequences, i.e. [a, a, PAD, b, b, b, PAD, c, PAD]"
682682
)
683-
use_flash_attention = False
683+
use_flash_attention = False
684684
if use_flash_attention_3 and FlashAttentionUtils.v3_is_installed:
685685
# Turn on FlashAttention 3 for thd when there is padding between
686686
# sequences, i.e. [a, a, PAD, b, b, b, PAD, c, PAD].

0 commit comments

Comments
 (0)