We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent fb99ad6 commit 5f8b0ffCopy full SHA for 5f8b0ff
1 file changed
src/tfbench/evaluation.py
@@ -130,6 +130,16 @@ def prover_evaluate(
130
"""evaluate all generation results using GHC to prove equivalence
131
132
NOTE: currently only support the `base` split
133
+
134
+ Args:
135
+ tasks (list[BenchmarkTask]): list of benchmark tasks
136
+ results (list[LMAnswer | None]): list of generation results
137
+ pure (bool, optional): whether to evaluate on the `pure` split or not.
138
+ Since we use TypeOperators to *prove type equivalence,
139
+ we need to define all custom types in the `pure` split.
140
+ Defaults to False.
141
+ nproc (int, optional): number of processes to use.
142
+ Defaults to cpu_count() to use all available CPUs.
143
"""
144
assert len(tasks) == len(results)
145
0 commit comments