Fine-Grained Object Recognition in Underwater Visual Data

Abstract : In this paper we investigate the fine-grained object categorization problem of determining fish species in low-quality visual data (images and videos) recorded in real-life settings. We first describe a new annotated dataset of about 35,000 fish images (MA-35K dataset), derived from the Fish4Knowledge project, covering 10 fish species from the Eastern Indo-Pacific bio-geographic zone. We then resort to a label propagation method able to transfer the labels from the MA-35K to a set of 20 million fish images in order to achieve variability in fish appearance. The resulting annotated dataset, containing over one million annotations (AA-1M), was then manually checked by removing false positives as well as images with occlusions between fish or showing partially fish. Finally, we randomly picked more than 30,000 fish images distributed among ten fish species and extracted from about 400 10-minute videos, and used this data (both images and videos) for the fish task of the LifeCLEF 2014 contest. Together with the fine-grained visual dataset release, we also present two approaches for fish species classification in, respectively, still images and videos. Both approaches showed high performance (for some fish species the precision and recall were close to one) in object classification and outperformed state-of-the-art methods. In addition, despite the fact that dataset is unbalanced in the number of images per species, both methods (especially the one operating on still images) appear to be rather robust against the long-tail curse of data, showing the best performance on the less populated object classes.
Document type :
Journal articles
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01323129
Contributor : Diane Lingrand <>
Submitted on : Monday, May 30, 2016 - 10:47:43 AM
Last modification on : Tuesday, December 18, 2018 - 5:20:11 PM

Identifiers

Collections

Citation

Concetto Spampinato, Simone Palazzo, Pierre-Hughes Joalland, Sébastien Paris, Hervé Glotin, et al.. Fine-Grained Object Recognition in Underwater Visual Data. Multimedia Tools and Applications, Springer Verlag, 2016, 75 (3), pp.1701-1720. ⟨http://link.springer.com/article/10.1007%2Fs11042-015-2601-x⟩. ⟨10.1007/s11042-015-2601-x⟩. ⟨hal-01323129⟩

Share

Metrics

Record views

334