Skip to content

Commit 2fd9a20

Browse files
committed
Add ConformalRiskCalibrator and ConformalRiskPredictor for conformal risk control prediction sets
Signed-off-by: Colin Son <txmed82@users.noreply.github.com>
1 parent 15f5073 commit 2fd9a20

4 files changed

Lines changed: 797 additions & 0 deletions

File tree

docs/source/metrics.rst

Lines changed: 20 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -203,6 +203,26 @@ Metrics
203203
:members:
204204

205205

206+
`Conformal Risk Control`
207+
------------------------
208+
.. autoclass:: ConformalRiskCalibrator
209+
:members:
210+
211+
.. autoclass:: ConformalRiskPredictor
212+
:members:
213+
:special-members: __call__
214+
215+
.. autoclass:: Coverage
216+
:members:
217+
218+
.. autoclass:: SetSize
219+
:members:
220+
221+
.. autofunction:: compute_coverage
222+
223+
.. autofunction:: compute_set_size
224+
225+
206226
Utilities
207227
---------
208228
.. automodule:: monai.metrics.utils

monai/metrics/__init__.py

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -14,6 +14,14 @@
1414
from .active_learning_metrics import LabelQualityScore, VarianceMetric, compute_variance, label_quality_score
1515
from .average_precision import AveragePrecisionMetric, compute_average_precision
1616
from .calibration import CalibrationErrorMetric, CalibrationReduction, calibration_binning
17+
from .conformal_risk import (
18+
ConformalRiskCalibrator,
19+
ConformalRiskPredictor,
20+
Coverage,
21+
SetSize,
22+
compute_coverage,
23+
compute_set_size,
24+
)
1725
from .confusion_matrix import ConfusionMatrixMetric, compute_confusion_matrix_metric, get_confusion_matrix
1826
from .cumulative_average import CumulativeAverage
1927
from .embedding_collapse import EmbeddingCollapseMetric, compute_embedding_collapse

0 commit comments

Comments
 (0)