Skip to content

Commit 4d9dc3d

Browse files
author
Raphael Mitsch
committed
test: Relax test thresholds.
1 parent 36d5d26 commit 4d9dc3d

2 files changed

Lines changed: 2 additions & 2 deletions

File tree

sieves/tests/tasks/predictive/test_question_answering.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -213,4 +213,4 @@ def test_evaluation(batch_runtime) -> None:
213213
])
214214
report_partial = task_multi.evaluate([doc_partial], judge=batch_runtime.model)
215215
# Expected to be somewhere in the middle
216-
assert 0.2 < report_partial.metrics[task_multi.metric] < 0.8
216+
assert 0.2 <= report_partial.metrics[task_multi.metric] <= 0.8

sieves/tests/tasks/predictive/test_translation.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -170,4 +170,4 @@ def test_evaluation(batch_runtime) -> None:
170170
doc_partial.results["trans"] = Result(translation="Hola", score=1.0)
171171
doc_partial.gold["trans"] = Result(translation="Hola mundo", score=1.0)
172172
report_partial = task.evaluate([doc_partial], judge=batch_runtime.model)
173-
assert 0.3 < report_partial.metrics[task.metric] < 0.8
173+
assert 0.3 <= report_partial.metrics[task.metric] <= 0.8

0 commit comments

Comments
 (0)