chore: Merge set of changes for release v3.1.0 by dushyantbehl · Pull Request #630 · foundation-model-stack/fms-hf-tuning

dushyantbehl · 2025-11-10T11:50:00Z

Description of the change

Related issue number

How to verify the PR

Was the PR tested

I have added >=1 unit test(s) for every new method I have added.
I have ensured all unit tests pass

Signed-off-by: Dushyant Behl <dushyantbehl@users.noreply.github.com>

Signed-off-by: Dushyant Behl <dushyantbehl@in.ibm.com>

…593) Signed-off-by: Dushyant Behl <dushyantbehl@in.ibm.com>

…ncessary memory overhead (#592) * Added use_cache in the model args Signed-off-by: romit <romit@ibm.com> * Removed model args use_cache Signed-off-by: r0 <11757603+romitjain@users.noreply.github.com> Signed-off-by: romit <romit@ibm.com> * Update sft_trainer.py, default use_cache Signed-off-by: r0 <11757603+romitjain@users.noreply.github.com> Signed-off-by: romit <romit@ibm.com> * Updated cache usage in vision models Signed-off-by: romit <romit@ibm.com> --------- Signed-off-by: romit <romit@ibm.com> Signed-off-by: r0 <11757603+romitjain@users.noreply.github.com> Co-authored-by: Dushyant Behl <dushyantbehl@users.noreply.github.com>

Signed-off-by: Padmanabha V Seshadri <seshapad@in.ibm.com>

Signed-off-by: Dushyant Behl <dushyantbehl@in.ibm.com>

Signed-off-by: yashasvi <yashasvi@ibm.com>

…603) Signed-off-by: Dushyant Behl <dushyantbehl@in.ibm.com>

* restructure README Signed-off-by: Dushyant Behl <dushyantbehl@in.ibm.com> * split readme Signed-off-by: Dushyant Behl <dushyantbehl@in.ibm.com> * Update README.md Co-authored-by: Praveen Jayachandran <praveenj83@users.noreply.github.com> Signed-off-by: Dushyant Behl <dushyantbehl@users.noreply.github.com> * update readme Signed-off-by: Dushyant Behl <dushyantbehl@in.ibm.com> * Update README.md Co-authored-by: Praveen Jayachandran <praveenj83@users.noreply.github.com> Signed-off-by: Dushyant Behl <dushyantbehl@users.noreply.github.com> Signed-off-by: Dushyant Behl <dushyantbehl@in.ibm.com> --------- Signed-off-by: Dushyant Behl <dushyantbehl@in.ibm.com> Signed-off-by: Dushyant Behl <dushyantbehl@users.noreply.github.com> Co-authored-by: Praveen Jayachandran <praveenj83@users.noreply.github.com>

Signed-off-by: yashasvi <yashasvi@ibm.com>

Signed-off-by: Dushyant Behl <dushyantbehl@in.ibm.com>

fix: typos

* Updated LoraConfig to subclass from peft.LoraConfig Signed-off-by: romit <romit@ibm.com> * Added some fields under custom dataclass to let is pass through HfArgumentParser Signed-off-by: romit <romit@ibm.com> * Lint and fmt fixes Signed-off-by: romit <romit@ibm.com> * Updated config utils Signed-off-by: romit <romit@ibm.com> * Update comment in LoraConfig Signed-off-by: r0 <11757603+romitjain@users.noreply.github.com> * Lint changes Signed-off-by: romit <romit@ibm.com> * Updated comment Signed-off-by: romit <romit@ibm.com> --------- Signed-off-by: romit <romit@ibm.com> Signed-off-by: r0 <11757603+romitjain@users.noreply.github.com> Co-authored-by: Dushyant Behl <dushyantbehl@users.noreply.github.com>

Signed-off-by: yashasvi <yashasvi@ibm.com>

Fix image in README. Signed-off-by: Dushyant Behl <dushyantbehl@users.noreply.github.com>

* feat: add ckpt conversion script fp32-bf16 Signed-off-by: yashasvi <yashasvi@ibm.com> * feat: add remove optim func to checkpoint_util.py Signed-off-by: yashasvi <yashasvi@ibm.com> * feat: add inplace file deletion capability Signed-off-by: yashasvi <yashasvi@ibm.com> --------- Signed-off-by: yashasvi <yashasvi@ibm.com>

…615) Signed-off-by: yashasvi <yashasvi@ibm.com>

feat: add odm plugin Signed-off-by: Mehant Kammakomati <mehant.kammakomati2@ibm.com> --------- Signed-off-by: Mehant Kammakomati <mehant.kammakomati2@ibm.com>

* feat: resume functionality Signed-off-by: Mehant Kammakomati <mehant.kammakomati2@ibm.com> * feat: resume functionality Signed-off-by: Mehant Kammakomati <mehant.kammakomati2@ibm.com> * feat: resume functionality Signed-off-by: Mehant Kammakomati <mehant.kammakomati2@ibm.com> * feat: resume functionality Signed-off-by: Mehant Kammakomati <mehant.kammakomati2@ibm.com> * feat: resume functionality Signed-off-by: Mehant Kammakomati <mehant.kammakomati2@ibm.com> * fix: refactor code Signed-off-by: Mehant Kammakomati <mehant.kammakomati2@ibm.com> * fix: refactor code Signed-off-by: Mehant Kammakomati <mehant.kammakomati2@ibm.com> * fix: refactor code Signed-off-by: Mehant Kammakomati <mehant.kammakomati2@ibm.com> * fix: refactor sampling weight Signed-off-by: Mehant Kammakomati <mehant.kammakomati2@ibm.com> --------- Signed-off-by: Mehant Kammakomati <mehant.kammakomati2@ibm.com>

feat: Alora migration to PEFT upstream. Signed-off-by: yashasvi <yashasvi@ibm.com> --------- Signed-off-by: yashasvi <yashasvi@ibm.com>

…620) Signed-off-by: yashasvi <yashasvi@ibm.com>

Signed-off-by: yashasvi <yashasvi@ibm.com>

Signed-off-by: Dushyant Behl <dushyantbehl@in.ibm.com>

* Add free up disk space to gh runners Signed-off-by: Dushyant Behl <dushyantbehl@in.ibm.com> * Build flash attn without cache to avoid problems Signed-off-by: Dushyant Behl <dushyantbehl@in.ibm.com> --------- Signed-off-by: Dushyant Behl <dushyantbehl@in.ibm.com>

github-actions · 2025-11-10T11:50:07Z

Thanks for making a pull request! 😃
One of the maintainers will review and advise on the next steps.

Signed-off-by: Dushyant Behl <dushyantbehl@in.ibm.com>

dushyantbehl and others added 29 commits July 24, 2025 21:28

Update offline-data-preprocessing.md (#589)

048a0e8

Signed-off-by: Dushyant Behl <dushyantbehl@users.noreply.github.com>

use default dataprocessor if one is not provided (#590)

7258505

Signed-off-by: Dushyant Behl <dushyantbehl@in.ibm.com>

fix data processing job exiting with failure even though successful (#…

5d49c76

…593) Signed-off-by: Dushyant Behl <dushyantbehl@in.ibm.com>

fix: Rank is set to zero by default (#594)

5951c9a

Signed-off-by: Padmanabha V Seshadri <seshapad@in.ibm.com>

upgrade trl (#601)

9c7858e

Signed-off-by: Dushyant Behl <dushyantbehl@in.ibm.com>

Add changes to support granite 4 models (#599)

607984c

Signed-off-by: yashasvi <yashasvi@ibm.com>

feat: Support gpt-oss class of models with flash attention 3 support (#…

7e261d2

…603) Signed-off-by: Dushyant Behl <dushyantbehl@in.ibm.com>

fix: add default optim arg in training arg (#607)

f41eb2c

Signed-off-by: yashasvi <yashasvi@ibm.com>

fix typo in dockerfile

8232e63

Signed-off-by: Dushyant Behl <dushyantbehl@in.ibm.com>

fix typo which ignored qlora config

47e80ce

Signed-off-by: Dushyant Behl <dushyantbehl@in.ibm.com>

fix typos in data handler names

b6aa877

Signed-off-by: Dushyant Behl <dushyantbehl@in.ibm.com>

Merge pull request #610 from dushyantbehl/main

2949a3a

fix: typos

fix: update fms-accel to main (#608)

384d424

Signed-off-by: yashasvi <yashasvi@ibm.com>

Update advanced-data-preprocessing.md (#613)

d6dc4c9

Fix image in README. Signed-off-by: Dushyant Behl <dushyantbehl@users.noreply.github.com>

feat: Allow chat template to be specified via a path in data config. (#…

f337875

…615) Signed-off-by: yashasvi <yashasvi@ibm.com>

feat: add online data mixing plugin (#612)

4ec1340

feat: add odm plugin Signed-off-by: Mehant Kammakomati <mehant.kammakomati2@ibm.com> --------- Signed-off-by: Mehant Kammakomati <mehant.kammakomati2@ibm.com>

feat: Alora migration to PEFT upstream. (#618)

5187516

feat: Alora migration to PEFT upstream. Signed-off-by: yashasvi <yashasvi@ibm.com> --------- Signed-off-by: yashasvi <yashasvi@ibm.com>

feat: ensure fms-acceleration callbacks run before TrainerController (#…

ebf5743

…620) Signed-off-by: yashasvi <yashasvi@ibm.com>

fix: add on_init_end before adding tc callback (#621)

6f2134d

Signed-off-by: yashasvi <yashasvi@ibm.com>

fix: add hf compatible path update (#622)

7ff1ce9

Signed-off-by: yashasvi <yashasvi@ibm.com>

fix: avoid updating path kwarg (#624)

3344193

Signed-off-by: yashasvi <yashasvi@ibm.com>

fix: directly save final ckpt in save_model_dir (#626)

1e844d3

Signed-off-by: yashasvi <yashasvi@ibm.com>

Add free up disk space to gh runners (#628)

faea400

Signed-off-by: Dushyant Behl <dushyantbehl@in.ibm.com>

dushyantbehl requested a review from anhuong as a code owner November 10, 2025 11:50

dushyantbehl requested review from aluu317, fabianlim and kmehant as code owners November 10, 2025 11:50

github-actions Bot added the chore label Nov 10, 2025

Merge tag 'v3.1.0-rc3' into v3.1.0-rc3

8c7566f

Signed-off-by: Dushyant Behl <dushyantbehl@in.ibm.com>

dushyantbehl force-pushed the v3.1.0-rc3 branch from 42511d8 to 8c7566f Compare November 10, 2025 11:50

ashokponkumar approved these changes Nov 10, 2025

View reviewed changes

dushyantbehl merged commit 8659901 into release Nov 10, 2025
10 of 11 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

chore: Merge set of changes for release v3.1.0#630

chore: Merge set of changes for release v3.1.0#630
dushyantbehl merged 30 commits into
releasefrom
v3.1.0-rc3

dushyantbehl commented Nov 10, 2025

Uh oh!

github-actions Bot commented Nov 10, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

Conversation

dushyantbehl commented Nov 10, 2025

Description of the change

Related issue number

How to verify the PR

Was the PR tested

Uh oh!

github-actions Bot commented Nov 10, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants