Enhancing resolution and contrast in fibre bundle-based fluorescence microscopy using generative adversarial network

Amir Mohammad Ketabchi*, Berna Morova, Yiğit Uysalli, Musa Aydin, Furkan Eren, Nima Bavili, Dariusz Pysz, Ryszard Buczynski, Alper Kiraz

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)

Abstract

Fibre bundle (FB)-based endoscopes are indispensable in biology and medical science due to their minimally invasive nature. However, resolution and contrast for fluorescence imaging are limited due to characteristic features of the FBs, such as low numerical aperture (NA) and individual fibre core sizes. In this study, we improved the resolution and contrast of sample fluorescence images acquired using in-house fabricated high-NA FBs by utilising generative adversarial networks (GANs). In order to train our deep learning model, we built an FB-based multifocal structured illumination microscope (MSIM) based on a digital micromirror device (DMD) which improves the resolution and the contrast substantially compared to basic FB-based fluorescence microscopes. After network training, the GAN model, employing image-to-image translation techniques, effectively transformed wide-field images into high-resolution MSIM images without the need for any additional optical hardware. The results demonstrated that GAN-generated outputs significantly enhanced both contrast and resolution compared to the original wide-field images. These findings highlight the potential of GAN-based models trained using MSIM data to enhance resolution and contrast in wide-field imaging for fibre bundle-based fluorescence microscopy. Lay Description: Fibre bundle (FB) endoscopes are essential in biology and medicine but suffer from limited resolution and contrast for fluorescence imaging. Here we improved these limitations using high-NA FBs and generative adversarial networks (GANs). We trained a GAN model with data from an FB-based multifocal structured illumination microscope (MSIM) to enhance resolution and contrast without additional optical hardware. Results showed significant enhancement in contrast and resolution, showcasing the potential of GAN-based models for fibre bundle-based fluorescence microscopy.

Original languageEnglish
Pages (from-to)236-242
Number of pages7
JournalJournal of Microscopy
Volume295
Issue number3
DOIs
Publication statusPublished - Sept 2024

Bibliographical note

Publisher Copyright:
© 2024 Royal Microscopical Society.

Keywords

  • GAN
  • biological imaging
  • deep learning model
  • fibre bundle-based fluorescence microscopy
  • image-to-image translation
  • multifocal structured illumination microscopy (MSIM)

Fingerprint

Dive into the research topics of 'Enhancing resolution and contrast in fibre bundle-based fluorescence microscopy using generative adversarial network'. Together they form a unique fingerprint.

Cite this