ConformalClsAPS#

class torch_uncertainty.post_processing.ConformalClsAPS(alpha, model=None, randomized=True, ts_init_val=1, ts_lr=0.1, ts_max_iter=100, enable_ts=True, device=None)[source]#

Conformal prediction with APS scores.

Parameters:

  • alpha (float) – The confidence level meaning we allow \(1-\alpha\) error.

  • model (Module | None) – Trained classification model. Defaults to None.

  • randomized (bool) – Whether to use randomized smoothing in APS. Defaults to True.

  • ts_init_val (float) – Initial value for the temperature. Defaults to 1.0.

  • ts_lr (float) – Learning rate for the temperature scaling optimizer. Defaults to 0.1.

  • ts_max_iter (int) – Maximum number of iterations for the temperature scaling optimizer. Defaults to 100.

  • enable_ts (bool) – Whether to scale the logits. Defaults to False.

  • device (Union[Literal['cpu', 'cuda'], device, None]) – device. Defaults to None.

Warning

This implementation only works in the multiclass setting. Raise an issue if binary is needed.

Reference:

  • TODO:

Code inspired by TorchCP.

conformal(inputs)[source]#

Compute the prediction set for each input.

Return type:

Tensor

fit(dataloader)[source]#

Calibrate the APS threshold q_hat on a calibration set.

Return type:

None

model_forward(inputs)[source]#

Apply the model and return the scores.

Return type:

Tensor