Commit 6058ec5
committed
fix: remove useless warmup from __init__ (model on CPU, no compilation)
Warmup at init time runs before Lightning moves the model to GPU,
so Triton cannot compile kernels there. Remove the calls entirely;
compilation happens naturally on the first real training step.
Also fix default glu_type to softsign_glu in both tasks.1 parent 06cc355 commit 6058ec5
1 file changed
Lines changed: 1 addition & 4 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
121 | 121 | | |
122 | 122 | | |
123 | 123 | | |
124 | | - | |
125 | | - | |
126 | | - | |
127 | | - | |
| 124 | + | |
128 | 125 | | |
129 | 126 | | |
130 | 127 | | |
| |||
0 commit comments