Multispectral constancy for illuminant invariant representation of multispectral images

Abstract : A conventional color imaging system provides high resolution spatial information and low resolution spectral data. In contrast, a multispectral imaging system is able to provide both the spectral and spatial information of a scene in high resolution. A multispectral imaging system is complex and it is not easy to use it as a hand held device for acquisition of data in uncontrolled conditions. The use of multispectral imaging for computer vision applications has started recently but is not very efficient due to these limitations. Therefore, most of the computer vision systems still rely on traditional color imaging and the potential of multispectral imaging for these applications has yet to be explored.With the advancement in sensor technology, hand held multispectral imaging systems are coming in market. One such example is the snapshot multispectral filter array camera. So far, data acquisition from multispectral imaging systems require specific imaging conditions and their use is limited to a few applications including remote sensing and indoor systems. Knowledge of scene illumination during multispectral image acquisition is one of the important conditions. In color imaging, computational color constancy deals with this condition while the lack of such a framework for multispectral imaging is one of the major limitation in enabling the use of multispectral cameras in uncontrolled imaging environments.In this work, we extend some methods of computational color imaging and apply them to the multispectral imaging systems. A major advantage of color imaging is the ability of providing consistent color of objects and surfaces across varying imaging conditions. In this work, we extend the concept of color constancy and white balancing from color to multispectral images, and introduce the term multispectral constancy.The validity of proposed framework for consistent representation of multispectral images is demonstrated through spectral reconstruction of material surfaces from the acquired images. We have also presented a new hyperspectral reflectance images dataset in this work. The framework of multispectral constancy will make it one step closer for the use of multispectral imaging in computer vision applications, where the spectral information, as well as the spatial information of a surface will be able to provide distinctive useful features for material identification and classification tasks.
Document type :
Theses
Complete list of metadatas

Cited literature [429 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/tel-01894385
Contributor : Abes Star <>
Submitted on : Thursday, April 25, 2019 - 8:56:28 AM
Last modification on : Friday, May 17, 2019 - 9:23:45 AM

File

77497_KHAN_2018_archivage.pdf
Version validated by the jury (STAR)

Identifiers

  • HAL Id : tel-01894385, version 2

Citation

Haris Ahmad Khan. Multispectral constancy for illuminant invariant representation of multispectral images. Image Processing [eess.IV]. Université Bourgogne Franche-Comté; Norwegian university of science and technology (Trondheim, Norvège), 2018. English. ⟨NNT : 2018UBFCK028⟩. ⟨tel-01894385v2⟩

Share

Metrics

Record views

209

Files downloads

65