Skip to content

Commit 2c705a3

Browse files
committed
[Create PR]:
- Add link to lm-evaluation-harness
1 parent 27e93a2 commit 2c705a3

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

examples/mmlu_benchmark/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -56,4 +56,4 @@ DISCO Predicted Full Benchmark Accuracy:
5656
| `--disco_transform_path` | Path to DISCO PCA transform `.pkl` or `.npz` (for local DISCO model when using `--pca`) ||
5757
| `--pca` | PCA dimension for DISCO embeddings ||
5858
| `--pad_to_size` | Pad predictions to this size with -inf ||
59-
| `--use_lmeval_batching` | Use lm-evaluation-harness-style batching for exact numerical match with DISCO repo | off |
59+
| `--use_lmeval_batching` | Use [lm-evaluation-harness-style](https://github.com/EleutherAI/lm-evaluation-harness) batching for exact numerical match with DISCO repo | off |

0 commit comments

Comments
 (0)