CalibrationError

class torch_uncertainty.metrics.classification.CalibrationError(task, adaptive=False, num_bins=10, norm='l1', num_classes=None, ignore_index=None, validate_args=True, **kwargs)

Top-label Calibration Error.

See CalibrationError for details. Our version of the metric is a wrapper around the original metric providing a plotting functionality.

Reference:

Naeini et al. “Obtaining well calibrated probabilities using Bayesian

binning.” In AAAI, 2015.

Initialize task metric.