SCODRiskAt80Cov#

class torch_uncertainty.metrics.classification.SCODRiskAt80Cov(ood_cost=0.5, **kwargs)[source]#

Calculate the SCOD risk at 80% coverage.

This is the fixed-coverage variant of SCODRiskAtxCov with \(\gamma=0.8\). For \(N\) samples, it reports

\[\operatorname{SCOD\text{-}Risk@80Cov} = r\left( \frac{\lceil 0.8N\rceil}{N} \right).\]

Samples are ordered from lowest to highest OOD score before the risk is evaluated.

Parameters:

  • ood_cost (float) – Relative cost \(c_{\mathrm{OOD}}\) of accepting an OOD sample. The cost of accepting a misclassified ID sample is 1 - ood_cost. Defaults to 0.5.

  • kwargs – Additional keyword arguments passed to torchmetrics.Metric.

References

[1] Xia & Bouganis. Augmenting Softmax Information for Selective Classification with Out-of-Distribution Data. ACCV, 2022..

[2] Narasimhan et al. Plugin Estimators for Selective Classification with Out-of-Distribution Detection..

See also

SCODRiskAtxCov:

General metric with configurable coverage.