v0.8.1

What's Changed

• 🐛 Fix inference pad token id missing bug by @gkumbhat in #198

Full Changelog: v0.8.0...v0.8.1

v0.8.0

What's Changed

• Print Timestamp and Resource Usage by @cfsarmiento in #193
• Fix import in DPP by @lupalby in #195
• add_mistral_support by @Ssukriti in #196 (Refer to PR description for an example on how to run. Also refer to common errors in README to avoid tokenizer issue with Mistral)
• Add optional tokenizer argument to scripts/drive_paged_programs.py to allow passing custom tokenizer
• ✨ Add granite 4.1 8b support to DPP by @gkumbhat in #197

New Contributors

• @cfsarmiento made their first contribution in #193

Full Changelog: v0.7.1...v0.8.0

v0.7.1

What's Changed

• 📦 Update torch to 2.10 by @gkumbhat in #190

Full Changelog: v0.7.0...v0.7.1

v0.7.0

What's Changed

• [DPP] Refactor DPP script by @rafvasq in #168
• [Fix] AttributeError when skipping CPU validation by @rafvasq in #184
• [Fix] Add missing used_keys.add() by @rafvasq in #189

Full Changelog: v0.6.0...v0.7.0

v0.6.0

What's Changed

• ✨ add script to manually save CPU validation data by @prashantgupta24 in #172
• Refactor get valid prompts - for memory optimization by @Ssukriti in #170
• Add Model Config to allow default env variables per model architecture by @Ssukriti in #178

Full Changelog: v0.5.0...v0.6.0

v0.5.0

What's Changed

• dpp custom dataset now uses directory by @JRosenkranz in #163
• fix for #164 paged.py get head_size from model.config head_dim when defined by @rzbhatti in #165
• Add non-AIU utility tests as part of github action by @Abhishek-TAMU in #155
• Force static kv cache for DPP+fp8+chunked prefill by @ani300 in #167
• Add padding to chunk size and update env vars by @ani300 in #160
• Chunked debug by @Ssukriti in #176
• Allow any multiple of 64 during chunked prefill by @JRosenkranz in #169
• Fix IndexError: list index out of range when no prompt is found by @Abhishek-TAMU in #177

New Contributors

• @rzbhatti made their first contribution in #165
• @Ssukriti made their first contribution in #176

Full Changelog: v0.4.4...v0.5.0

v0.4.4

What's Changed

• Chunked prefill support for paged attention by @ani300 in #122
• fixed bug with loading validation info outputs by @JRosenkranz in #161

Full Changelog: v0.4.3...v0.4.4

v0.4.3

What's Changed

• fixed test_scripts program assertions by @JRosenkranz in #151
• Refactor Decoder Tests by @alex-jw-brooks in #93
• 🍱 include scripts with AFTU installs by @joerunde in #140
• Extend transformers support by @joerunde in #159

New Contributors

• @alex-jw-brooks made their first contribution in #93

Full Changelog: v0.4.2...v0.4.3

v0.4.2

What's Changed

• Prefix rewrite by @kcirred in #148

Full Changelog: v0.4.1...v0.4.2

v0.4.1

What's Changed

• [utils] decrement_version fix by @kcirred in #146
• DPP: check valid prompt shapes until one is available in the dataset by @lupalby in #145
• added dpp to test_scripts by @JRosenkranz in #147
• [dpp] store enforce_sizes in log name and added generic kwargs to get_default_validation_prefix by @kcirred in #136
• update llama model expectations tests by @JRosenkranz in #150

Full Changelog: v0.4.0...v0.4.1