Skip to Main content Skip to Navigation
New interface
Journal articles

On the behavior of information theoretic criteria for model order selection

Abstract : The Akaike (1974) information criterion (AIC) and the minimum description length (MDL) are two well-known criteria for model order selection in the additive white noise case. Our aim is to study the influence on their behavior of a large gap between the signal and the noise eigenvalues and of the noise eigenvalue dispersion. Our results are mostly qualitative and serve to explain the behavior of the AIC and the MDL in some cases of great practical importance. We show that when the noise eigenvalues are not clustered sufficiently closely, then the AIC and the MDL may lead to overmodeling by ignoring an arbitrarily large gap between the signal and the noise eigenvalues. For fixed number of data samples, overmodeling becomes more likely for increasing the dispersion of the noise eigenvalues. For fixed dispersion, overmodeling becomes more likely for increasing the number of data samples. Undermodeling may happen in the cases where the signal and the noise eigenvalues are not well separated and the noise eigenvalues are clustered sufficiently closely. We illustrate our results by using simulations from the effective channel order determination area
Document type :
Journal articles
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-01345076
Contributor : Médiathèque Télécom SudParis & Institut Mines-Télécom Business School Connect in order to contact the contributor
Submitted on : Wednesday, July 13, 2016 - 10:24:41 AM
Last modification on : Tuesday, March 8, 2022 - 1:32:02 PM

Links full text

Identifiers

Citation

Athanasios P. Liavas, Phillip Regalia. On the behavior of information theoretic criteria for model order selection. IEEE Transactions on Signal Processing, 2001, 49 (8), pp.1689 - 1695. ⟨10.1109/78.934138⟩. ⟨hal-01345076⟩

Share

Metrics

Record views

30