Skip to Main content Skip to Navigation
New interface
Journal articles

Standardized evaluation system for left ventricular segmentation algorithms in 3D echocardiography

Olivier Bernard 1 J.G.H. Bosch 2 B Heyde 3 M. Alessandrini 3 D. Barbosa 4 S. Camarasu-Pop 5, 1 F. Cervenansky 5 Sébastien Valette 6 O. Mirea 3 M. Bernier 7 P.-M. Jodoin 7 J.-S. Domingos 8 R.V Stebbing 8 K Keraudren 9 O. Oktay 9 J. Caballero 9 W. Shi 9 D. Rueckert 9 F. Milletari 10 F. Ahmadi 11 E. Smistad 12 F. Lindseth 12 M van Stralen 13 Chen Wang 14, 15 O. Smedby 15, 14 Erwan Donal 16 M. Monaghan 17 A. Papachristidis 17 M.L. Geleijnse 2 Elena Galli 16 J. d'Hooge 3 
Abstract : Real-time 3D Echocardiography (RT3DE) has been proven to be an accurate tool for left ventricular (LV) volume assessment. However, identification of the LV endocardium remains a challenging task, mainly because of the low tissue/blood contrast of the images combined with typical artifacts. Several semi and fully automatic algorithms have been proposed for segmenting the endocardium in RT3DE data in order to extract relevant clinical indices, but a systematic and fair comparison between such methods has so far been impossible due to the lack of a publicly available common database. Here, we introduce a standardized evaluation framework to reliably evaluate and compare the performance of the algorithms developed to segment the LV border in RT3DE. A database consisting of 45 multivendor cardiac ultrasound recordings acquired at different centers with corresponding reference measurements from 3 experts are made available. The algorithms from nine research groups were quantitatively evaluated and compared using the proposed online platform. The results showed that the best methods produce promising results with respect to the experts’ measurements for the extraction of clinical indices, and that they offer good segmentation precision in terms of mean distance error in the context of the experts’ variability range. The platform remains open for new submissions.
Document type :
Journal articles
Complete list of metadata
Contributor : Béatrice Rayet Connect in order to contact the contributor
Submitted on : Wednesday, February 10, 2016 - 4:38:16 PM
Last modification on : Tuesday, October 18, 2022 - 4:21:23 AM



Olivier Bernard, J.G.H. Bosch, B Heyde, M. Alessandrini, D. Barbosa, et al.. Standardized evaluation system for left ventricular segmentation algorithms in 3D echocardiography. IEEE Transactions on Medical Imaging, 2016, 35 (4), pp.967-977. ⟨10.1109/TMI.2015.2503890⟩. ⟨hal-01272359⟩



Record views