Probabilistic model for 3D interactive segmentation

Tsachi Hershkovich, Tamar Shalmon, Ohad Shitrit, Nir Halay, Bjoern H. Menze, Irit Dolgopyat, Itamar Kahn, Ilan Shelef, Tammy Riklin Raviv

Research output: Contribution to journalArticlepeer-review


Fully-automated segmentation algorithms offer fast, objective, and reproducible results for large data collections. However, these techniques cannot handle tasks that require contextual knowledge not readily available in the images alone. Thus, the supervision of an expert is necessary. We present a generative model for image segmentation, based on a Bayesian inference. Not only does our approach support an intuitive and convenient user interaction subject to the bottom-up constraints introduced by the image intensities, it also circumvents the main limitations of a human observer—3D visualization and modality fusion. The user “dialogue” with the segmentation algorithm via several mouse clicks in regions of disagreement, is formulated as a continuous probability map, that represents the user's certainty to whether the current segmentation should be modified. Considering this probability map as the voxel-vise Bernoulli priors on the image labels allows spatial encoding of the user-provided input. The method is exemplified for the segmentation of cerebral hemorrhages (CH) in human brain CT scans; ventricles in degenerative mice brain MRIs, and tumors in multi-modal human brain MRIs and is shown to outperform three interactive, state-of-the-art segmentation methods in terms of accuracy, efficiency and user-workload.

Original languageEnglish
Pages (from-to)47-60
Number of pages14
JournalComputer Vision and Image Understanding
StatePublished - 1 Oct 2016


  • Image segmentation
  • MR & CT Brain imaging
  • Modality fusion
  • Probabilistic model
  • User interaction

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition


Dive into the research topics of 'Probabilistic model for 3D interactive segmentation'. Together they form a unique fingerprint.

Cite this