P. L. Bartlett and M. H. Wegkamp, Classification with a reject option using a hinge loss, J. Mach. Learn. Res, 2008.

C. Blundell, J. Cornebise, K. Kavukcuoglu, and D. Wierstra, Weight uncertainty in neural network. In ICML, 2015.

L. Breiman, Bagging predictors, Mach. Learn, 1996.

C. K. Chow, An optimum character recognition system using decision functions, 1957.

C. K. Chow, On optimum recognition error and reject tradeoff, IEEE Trans. Inf. Theory, 1970.

C. Cortes, G. Desalvo, and M. Mohri, Learning with rejection, ALT, 2016.

A. Der-kiureghian and O. Ditlevsen, Aleatory or epistemic ? Does it matter ? Struct, 2009.

R. El-yaniv and Y. Wiener, On the foundations of noise-free selective classification, J. Mach. Learn. Res, 2010.

Y. Gal and Z. Ghahramani, Dropout as a Bayesian approximation : representing model uncertainty in Deep Learning, ICML, 2016.

Y. Geifman, G. Uziel, and R. El-yaniv, Bias-reduced uncertainty estimation for deep neural classifiers, In ICLR, 2019.

P. Germain, A. Lacasse, F. Laviolette, M. Marchand, and J. Roy, Risk bounds for the majority vote : from a PAC-Bayesian analysis to a learning algorithm, J. Mach. Learn. Res, 2015.

T. Gneiting and A. E. Raftery, Strictly proper scoring rules, prediction, and estimation, J. Am. Stat. Assoc, 2007.

S. Hanneke, Theory of disagreement-based active learning, Found. and Trends R in Mach. Learn, 2014.

R. Herbei and M. H. Wegkamp, Classification with reject option, Can. J. Stat, 2006.

A. Kendall and Y. Gal, What uncertainties do we need in Bayesian Deep Learning for Computer Vision ? In NeurIPS, 2017.

B. Lakshminarayanan, A. Pritzel, and C. Blundell, Simple and scalable predictive uncertainty estimation using deep ensembles, NeurIPS, 2017.

A. Mandelbaum and D. Weinshall, Distance-based confidence score for neural network classifiers, 2017.

R. M. Neal, Bayesian learning for neural networks, vol.118, 2012.

D. J. Rezende, S. Mohamed, and D. Wierstra, Stochastic backpropagation and approximate inference in deep generative models, ICML, 2014.

R. E. Schapire and Y. Singer, Improved boosting algorithms using confidence-rated predictions, Mach. Learn, 1999.

B. Settles, Active learning, Synthesis Lectures on Artificial Intelligence and Machine Learning, 2012.

K. Trapeznikov and V. Saligrama, Supervised sequential classification under budget constraints, AISTATS, 2013.

Y. Wiener and R. El-yaniv, Agnostic selective classification, NeurIPS, 2011.

Y. Wiener and R. El-yaniv, Agnostic pointwise-competitive selective classification, J. Artif. Intell. Res, 2015.

M. Yuan and M. Wegkamp, Classification methods with reject option based on convex risk minimization, J. Mach. Learn. Res, 2010.