Commit c486f35
authored
### Details:
- Revert PR #36504 which forces all RMS normalization nodes to FP32
- This change causes significant global LLM performance regression.
### Root Cause
PR #36504 was introduced to fix NaN in ParlerTTS Mini (CVS-187992) by
keeping RMS nodes in FP32. However, it unconditionally marks ALL RMS
nodes across all models, adding FP16↔FP32 conversion overhead on every
transformer layer.
### Tickets:
- *190812*
1 parent d8047fb commit c486f35
2 files changed
Lines changed: 1 addition & 66 deletions
File tree
- src/common/transformations
- src/transformations/fp16_compression
- tests/common_optimizations
Lines changed: 0 additions & 24 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
49 | 49 | | |
50 | 50 | | |
51 | 51 | | |
52 | | - | |
53 | 52 | | |
54 | 53 | | |
55 | 54 | | |
| |||
400 | 399 | | |
401 | 400 | | |
402 | 401 | | |
403 | | - | |
404 | | - | |
405 | | - | |
406 | | - | |
407 | | - | |
408 | | - | |
409 | | - | |
410 | | - | |
411 | | - | |
412 | | - | |
413 | | - | |
414 | | - | |
415 | | - | |
416 | | - | |
417 | | - | |
418 | | - | |
419 | | - | |
420 | | - | |
421 | | - | |
422 | | - | |
423 | | - | |
424 | | - | |
425 | 402 | | |
426 | 403 | | |
427 | 404 | | |
| |||
493 | 470 | | |
494 | 471 | | |
495 | 472 | | |
496 | | - | |
497 | 473 | | |
498 | 474 | | |
499 | 475 | | |
| |||
Lines changed: 1 addition & 42 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
28 | 28 | | |
29 | 29 | | |
30 | 30 | | |
31 | | - | |
32 | 31 | | |
33 | 32 | | |
34 | 33 | | |
| |||
1385 | 1384 | | |
1386 | 1385 | | |
1387 | 1386 | | |
1388 | | - | |
1389 | | - | |
1390 | | - | |
1391 | | - | |
1392 | | - | |
1393 | | - | |
1394 | | - | |
1395 | | - | |
1396 | | - | |
1397 | | - | |
1398 | | - | |
1399 | | - | |
1400 | | - | |
1401 | | - | |
1402 | | - | |
1403 | | - | |
1404 | | - | |
1405 | | - | |
1406 | | - | |
1407 | | - | |
1408 | | - | |
1409 | | - | |
1410 | | - | |
1411 | | - | |
1412 | | - | |
1413 | | - | |
1414 | | - | |
1415 | | - | |
1416 | | - | |
1417 | | - | |
1418 | | - | |
1419 | | - | |
1420 | | - | |
1421 | | - | |
1422 | | - | |
1423 | | - | |
1424 | | - | |
1425 | | - | |
1426 | | - | |
1427 | | - | |
1428 | | - | |
| 1387 | + | |
0 commit comments