A novel adaptive scoring system for segmentation validation with multiple reference masks

Jan Hendrik Moltz; Jan Rühaak; Horst Karl Hahn; Heinz-Otto Peitgen

doi:10.1117/12.877813

11 March 2011 A novel adaptive scoring system for segmentation validation with multiple reference masks

Jan Hendrik Moltz, Jan Rühaak, Horst Karl Hahn, Heinz-Otto Peitgen

Proceedings Volume 7962, Medical Imaging 2011: Image Processing; 796214 (2011) https://doi.org/10.1117/12.877813
Event: SPIE Medical Imaging, 2011, Lake Buena Vista (Orlando), Florida, United States

Abstract

The development of segmentation algorithms for different anatomical structures and imaging protocols is an important task in medical image processing. The validation of these methods, however, is often treated as a subordinate task. Since manual delineations, which are widely used as a surrogate for the ground truth, exhibit an inherent uncertainty, it is preferable to use multiple reference segmentations for an objective validation. This requires a consistent framework that should fulfill three criteria: 1) it should treat all reference masks equally a priori and not demand consensus between the experts; 2) it should evaluate the algorithmic performance in relation to the inter-reference variability, i.e., be more tolerant where the experts disagree about the true segmentation; 3) it should produce results that are comparable for different test data. We show why current state-of-the-art frameworks as the one used at several MICCAI segmentation challenges do not fulfill these criteria and propose a new validation methodology. A score is computed in an adaptive way for each individual segmentation problem, using a combination of volume- and surface-based comparison metrics. These are transformed into the score by relating them to the variability between the reference masks which can be measured by comparing the masks with each other or with an estimated ground truth. We present examples from a study on liver tumor segmentation in CT scans where our score shows a more adequate assessment of the segmentation results than the MICCAI framework.

Citation Download Citation

Jan Hendrik Moltz, Jan Rühaak, Horst Karl Hahn, and Heinz-Otto Peitgen "A novel adaptive scoring system for segmentation validation with multiple reference masks", Proc. SPIE 7962, Medical Imaging 2011: Image Processing, 796214 (11 March 2011); https://doi.org/10.1117/12.877813

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available