Skip to content

Commit 1ed113b

Browse files
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
1 parent 75f8a3c commit 1ed113b

1 file changed

Lines changed: 2 additions & 2 deletions

File tree

  • transformer_engine/common/util

transformer_engine/common/util/math.h

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -13,8 +13,8 @@ struct Empty {};
1313

1414
struct ClampedSwiGLUParam {
1515
float limit;
16-
float alpha = 1.702f; // Default value for QuickGELU
17-
float glu_linear_offset = 1.0f; // Offset added to the linear (gate) component after clamping
16+
float alpha = 1.702f; // Default value for QuickGELU
17+
float glu_linear_offset = 1.0f; // Offset added to the linear (gate) component after clamping
1818
};
1919

2020
template <typename OType, typename IType>

0 commit comments

Comments
 (0)