Skip to content

Commit 7b830ea

Browse files
mikepapadimCopilot
andauthored
Update src/main/java/org/beehive/gpullama3/tornadovm/layers/type/q8_0/Phi3Q8_0FFNLayers.java
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
1 parent b7bf484 commit 7b830ea

File tree

1 file changed

+8
-8
lines changed

1 file changed

+8
-8
lines changed

src/main/java/org/beehive/gpullama3/tornadovm/layers/type/q8_0/Phi3Q8_0FFNLayers.java

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -236,14 +236,14 @@ TaskGraph setupSinglePhi3Q8_0FFNLayer(Phi3TornadoWeights weights, int layerIndex
236236
phi3Config.rmsNormEps(), // epsilon
237237
phi3State.localSize); // local memory size
238238

239-
if (shouldUseFinalNormalization()) {
240-
unifiedLayer.task("attn_rms_finalize",
241-
TransformerComputeKernelsLayered::reductionFinalNormalization,
242-
context,
243-
state.temp,
244-
config.dim(),
245-
config.rmsNormEps());
246-
}
239+
if (shouldUseFinalNormalization()) {
240+
unifiedLayer.task("attn_rms_finalize",
241+
TransformerComputeKernelsLayered::reductionFinalNormalization,
242+
context,
243+
state.temp,
244+
config.dim(),
245+
config.rmsNormEps());
246+
}
247247

248248
// Fused: RMS apply + Q8 QKV matmul + direct Q/K/V split
249249
unifiedLayer.task("attn_rms_qkv_projection_q8",

0 commit comments

Comments
 (0)