Noise removal of thermal images using deep learning approach

Ahmet Çapcı*, H. Emre Güven, B. Uğur Töreyin

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

With the widespread use of thermal cameras in various fields such as medical, military, surveillance, astronomy, fire detection etc., image distortion caused by the structure of thermal sensors has become an important problem. Since every detector or pixel in the sensor reacts differently even when fed the same signal, the correction is necessary for good imaging, and this correction is known as non-uniformity correction (NUC). Because the response of each detector/pixel drifts slowly and randomly over time, a one-time or a single fabric correction in the array is not enough. Traditional methods are not sufficient for operational uses. Calibration based approaches are undesirable because of the shutter sound for uncooled thermal imagers, as well as causing time-gaps during imaging for a period for cooled thermal imagers. Scene-based approaches, on the other hand, are not preferred due to high computational cost or rather unrealistic assumptions about the scene. In this study, we propose a deep learning based approach proposed for both cooled and uncooled thermal imagers. We created various thermal datasets to train models for temporal noise for both cooled and uncooled thermal imagers and compared the results. In a thermal system, many operations such as NUC, BPR, IOP are applied in sequence, from the detector raw output to the final output shown to the user. Our deep learning model accounts for the entirety of these operations. We also show that the optical artifacts or distortions can be eliminated using deep learning. As such, we demonstrate this with different system architectures that are suitable for embedded systems.

Original languageEnglish
Title of host publicationApplications of Digital Image Processing XLV
EditorsAndrew G. Tescher, Touradj Ebrahimi
PublisherSPIE
ISBN (Electronic)9781510654365
DOIs
Publication statusPublished - 2022
EventApplications of Digital Image Processing XLV 2022 - San Diego, United States
Duration: 22 Aug 202224 Aug 2022

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume12226
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

ConferenceApplications of Digital Image Processing XLV 2022
Country/TerritoryUnited States
CitySan Diego
Period22/08/2224/08/22

Bibliographical note

Publisher Copyright:
© 2022 SPIE.

Keywords

  • BPR
  • CNN
  • Deep Learning
  • IOP
  • IR
  • noise
  • NUC
  • thermal

Fingerprint

Dive into the research topics of 'Noise removal of thermal images using deep learning approach'. Together they form a unique fingerprint.

Cite this