A Topological Loss Function for Deep-Learning Based Image Segmentation Using Persistent Homology

James R. Clough*, Nicholas Byrne, Ilkay Oksuz, Veronika A. Zimmer, Julia A. Schnabel, Andrew P. King

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

91 Citations (Scopus)

Abstract

We introduce a method for training neural networks to perform image or volume segmentation in which prior knowledge about the topology of the segmented object can be explicitly provided and then incorporated into the training process. By using the differentiable properties of persistent homology, a concept used in topological data analysis, we can specify the desired topology of segmented objects in terms of their Betti numbers and then drive the proposed segmentations to contain the specified topological features. Importantly this process does not require any ground-truth labels, just prior knowledge of the topology of the structure being segmented. We demonstrate our approach in four experiments: one on MNIST image denoising and digit recognition, one on left ventricular myocardium segmentation from magnetic resonance imaging data from the UK Biobank, one on the ACDC public challenge dataset and one on placenta segmentation from 3-D ultrasound. We find that embedding explicit prior knowledge in neural network segmentation tasks is most beneficial when the segmentation task is especially challenging and that it can be used in either a semi-supervised or post-processing context to extract a useful training gradient from images without pixelwise labels.

Original languageEnglish
Pages (from-to)8766-8778
Number of pages13
JournalIEEE Transactions on Pattern Analysis and Machine Intelligence
Volume44
Issue number12
DOIs
Publication statusPublished - 1 Dec 2022

Bibliographical note

Publisher Copyright:
© 1979-2012 IEEE.

Keywords

  • convolutional neural networks
  • medical imaging
  • persistent homology
  • Segmentation
  • topology

Fingerprint

Dive into the research topics of 'A Topological Loss Function for Deep-Learning Based Image Segmentation Using Persistent Homology'. Together they form a unique fingerprint.

Cite this