Skip to content

Commit 0c7ce52

Browse files
authored
add tot_score inf mask to make training stable (#2019)
I find there are some inf in tot_score, it makes model cannot converge, add inf mask can make training more stable.
1 parent 34fc1fd commit 0c7ce52

1 file changed

Lines changed: 1 addition & 0 deletions

File tree

icefall/mmi.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -124,6 +124,7 @@ def _compute_mmi_loss_exact_non_optimized(
124124
den_tot_scores = den_lats.get_tot_scores(log_semiring=True, use_double_scores=True)
125125

126126
tot_scores = num_tot_scores - den_scale * den_tot_scores
127+
tot_scores = tot_scores.masked_fill(torch.isinf(tot_scores), 0.0)
127128

128129
loss = -1 * tot_scores.sum()
129130
return loss

0 commit comments

Comments
 (0)