Skip to Main content Skip to Navigation
Journal articles

The Costs of Indeterminacy: How to Determine Them?

Abstract : Indeterminate classifiers are cautious models able to predict more than one class in case of high uncertainty. A problem that arises when using such classifiers is how to evaluate their performances. This problem has already been considered in the case where all prediction errors have equivalent costs (that we will refer as the ''0/1 costs'' or accuracy setting). The purpose of this paper is to study the case of generic cost functions. We provide some properties that the costs of indeterminate predictions could or should follow, and review existing proposals in the light of those properties. This allows us to propose a general formula fitting our properties that can be used to produce and evaluate indeterminate predictions. Some experiments on the cost-sensitive problem of ordinal regression illustrate the behavior of the proposed evaluation criterion.
Document type :
Journal articles
Complete list of metadata
Contributor : Laboratoire Heudiasyc Connect in order to contact the contributor
Submitted on : Monday, June 21, 2021 - 9:22:53 PM
Last modification on : Tuesday, November 16, 2021 - 4:29:36 AM
Long-term archiving on: : Wednesday, September 22, 2021 - 7:10:37 PM


Files produced by the author(s)




Gen Yang, Sébastien Destercke, Marie-Hélène Masson. The Costs of Indeterminacy: How to Determine Them?. IEEE Transactions on Cybernetics, IEEE, 2017, 47 (12), pp.4316-4327. ⟨10.1109/TCYB.2016.2607237⟩. ⟨hal-01378361⟩



Record views


Files downloads