File tree Expand file tree Collapse file tree
Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -65,3 +65,23 @@ This [PR](https://github.com/Modalities/modalities/pull/236) removes all code re
6565
6666** Breaking changes:**
6767* None
68+ *
69+
70+ ## PR #254 Warmstart infrastructure switch
71+
72+ This PR mainly addresses the warmstart of model training, e.g., after GPU crashes.
73+
74+ ** General Changes**
75+ * Fixes issue #242
76+ * Warmstarts with changing infrastructure (e.g.,. different number of GPUs) are now supported.
77+ * Restructures the settings part of the configs to
78+ * Adds various checks for consistency of model training (e.g., target tokens and number of dataset tokens mismatch)
79+ * Refactors all configs to be runnable again
80+ * Adds an interactive jupyter notebook-based Tutorial on how to use Modalities. (merged from PR #239 )
81+ * Adds a warmstart tutorial
82+ * TrainingReportGenerator that creates a report on the training setup and prints out warnings in case of inconsistencies.
83+ * Activation Checkpointing is now a component
84+ * Added further NumberConversion routines
85+
86+ ** Breaking Changes**
87+ * the settings part of the configs have been completely refactored
You can’t perform that action at this time.
0 commit comments