Commit 41757f2
authored
refactor(training): remove unused learning_rate_dict multitask handling (#5278)
Remove the unused learning_rate_dict configuration option that allowed
per-task learning rate settings in multitask training. This simplifies
the code by using a single learning_rate configuration for all tasks.
Changes:
- Remove learning_rate_dict branch in loss initialization
- Remove per-task lr_schedule dictionary creation
- Remove isinstance(dict) check in training loop
- Unify single-task and multi-task code paths
Both PyTorch and Paddle backends are updated consistently.
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
* **Refactor**
* Streamlined learning rate scheduling in multi-task training scenarios
to ensure consistent initialization and computation of learning rates
across all models.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->1 parent a3db25a commit 41757f2
2 files changed
Lines changed: 6 additions & 34 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
302 | 302 | | |
303 | 303 | | |
304 | 304 | | |
305 | | - | |
306 | | - | |
307 | | - | |
308 | | - | |
| 305 | + | |
309 | 306 | | |
310 | 307 | | |
311 | 308 | | |
| |||
476 | 473 | | |
477 | 474 | | |
478 | 475 | | |
479 | | - | |
480 | | - | |
481 | | - | |
482 | | - | |
483 | | - | |
484 | | - | |
485 | | - | |
486 | | - | |
| 476 | + | |
487 | 477 | | |
488 | 478 | | |
489 | 479 | | |
| |||
806 | 796 | | |
807 | 797 | | |
808 | 798 | | |
809 | | - | |
810 | | - | |
811 | | - | |
812 | | - | |
813 | | - | |
| 799 | + | |
814 | 800 | | |
815 | 801 | | |
816 | 802 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
365 | 365 | | |
366 | 366 | | |
367 | 367 | | |
368 | | - | |
369 | | - | |
370 | | - | |
371 | | - | |
| 368 | + | |
372 | 369 | | |
373 | 370 | | |
374 | 371 | | |
| |||
548 | 545 | | |
549 | 546 | | |
550 | 547 | | |
551 | | - | |
552 | | - | |
553 | | - | |
554 | | - | |
555 | | - | |
556 | | - | |
557 | | - | |
558 | | - | |
| 548 | + | |
559 | 549 | | |
560 | 550 | | |
561 | 551 | | |
| |||
1027 | 1017 | | |
1028 | 1018 | | |
1029 | 1019 | | |
1030 | | - | |
1031 | | - | |
1032 | | - | |
1033 | | - | |
1034 | | - | |
| 1020 | + | |
1035 | 1021 | | |
1036 | 1022 | | |
1037 | 1023 | | |
| |||
0 commit comments