pycalib.benchmark Module

Benchmark classes for calibration methods.

Classes

Benchmark(run_dir, cal_methods, …[, …])

A benchmarking class for calibration methods.

CIFARData(run_dir, clf_output_dir, …[, …])

Model evaluation using the benchmark vision dataset CIFAR-100.

ImageNetData(run_dir, clf_output_dir, …[, …])

Model evaluation using the benchmark vision dataset ImageNet.

KITTIBinaryData(run_dir, clf_output_dir, …)

Model evaluation using the (binary) KITTI benchmark dataset.

MNISTData(run_dir, clf_output_dir, …[, …])

Model evaluation using the benchmark vision dataset MNIST.

OrderedDict

Dictionary that remembers insertion order

PCamData(run_dir, clf_output_dir, …[, …])

Model evaluation using the PCam benchmark dataset.

SyntheticBeta(run_dir, cal_methods, …[, …])

Model evaluation using synthetic data sampled from a Beta distribution.