Commit ad8cf9a
fix lm-eval version conflict in puzzletron requirements (#1257)
## Summary
- lm-eval 0.4.10 has API changes that break `lm_eval_hf.py`, which
monkey-patches `HFLM.create_from_arg_obj`
- Pin `examples/puzzletron/requirements.txt` from `lm-eval==0.4.10` to
`lm-eval==0.4.8` to match `examples/llm_eval/requirements.txt`
- Add version compatibility warning to `lm_eval_hf.py` for early
detection if versions drift again
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
* **Chores**
* Updated the lm-eval dependency version to 0.4.8 in the Puzzletron
example
* Added compatibility version checking to the LM Eval example with
appropriate notifications
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
Signed-off-by: jrausch <jrausch@nvidia.com>
Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>
Co-authored-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>1 parent 3f41819 commit ad8cf9a
2 files changed
Lines changed: 8 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
40 | 40 | | |
41 | 41 | | |
42 | 42 | | |
| 43 | + | |
43 | 44 | | |
44 | 45 | | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
45 | 52 | | |
46 | 53 | | |
47 | 54 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | | - | |
| 1 | + | |
2 | 2 | | |
3 | 3 | | |
4 | 4 | | |
| |||
0 commit comments