Skip to content

Commit eb4ebae

Browse files
committed
cleanup code
Signed-off-by: Ceng23333 <441651826@qq.com>
1 parent dd39eab commit eb4ebae

File tree

2 files changed

+1
-175
lines changed

2 files changed

+1
-175
lines changed

test/infinicore/ops/gla_attention.py

Lines changed: 0 additions & 174 deletions
This file was deleted.

test/infinicore/ops/test_simple_gla_decode_recurrent.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -40,7 +40,7 @@
4040

4141

4242
def _torch_simple_gla_recurrent_ref(q, k, v, g_gamma, scale: float) -> torch.Tensor:
43-
"""Reference recurrence (same as gla_attention.py / InfiniCore header)."""
43+
"""Reference recurrence (HF LightningAttention Simple GLA; matches InfiniLM/InfiniCore math)."""
4444
dtype = q.dtype
4545
qf = q.transpose(1, 2).float()
4646
kf = k.transpose(1, 2).float()

0 commit comments

Comments
 (0)