Skip to Main content Skip to Navigation
Journal articles

The Costs of Indeterminacy: How to Determine Them?

Abstract : Indeterminate classifiers are cautious models able to predict more than one class in case of high uncertainty. A problem that arises when using such classifiers is how to evaluate their performances. This problem has already been considered in the case where all prediction errors have equivalent costs (that we will refer as the ''0/1 costs'' or accuracy setting). The purpose of this paper is to study the case of generic cost functions. We provide some properties that the costs of indeterminate predictions could or should follow, and review existing proposals in the light of those properties. This allows us to propose a general formula fitting our properties that can be used to produce and evaluate indeterminate predictions. Some experiments on the cost-sensitive problem of ordinal regression illustrate the behavior of the proposed evaluation criterion.
Document type :
Journal articles
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-01378361
Contributor : Laboratoire Heudiasyc Connect in order to contact the contributor
Submitted on : Monday, June 21, 2021 - 9:22:53 PM
Last modification on : Tuesday, November 16, 2021 - 4:29:36 AM
Long-term archiving on: : Wednesday, September 22, 2021 - 7:10:37 PM

File

comparisonClassifiers_Final_IE...
Files produced by the author(s)

Identifiers

Collections

Citation

Gen Yang, Sébastien Destercke, Marie-Hélène Masson. The Costs of Indeterminacy: How to Determine Them?. IEEE Transactions on Cybernetics, IEEE, 2017, 47 (12), pp.4316-4327. ⟨10.1109/TCYB.2016.2607237⟩. ⟨hal-01378361⟩

Share

Metrics

Record views

69

Files downloads

22