A COMPARISON BETWEEN CYCLE-GAN BASED FEATURE TRANSLATION AND OPTICAL-SAR VEGETATION INDICES

E. Çolak*, F. Sunar

*Corresponding author for this work

Research output: Contribution to journalConference articlepeer-review

Abstract

Optical and microwave remote sensing technologies have become key tools for local and global change detection applications. Generally, optical data has been the focus of remote sensing for change detection because of the varied spatial and temporal resolutions that allow for reliable information. However, the dependence of optical data on weather conditions prevents continuous and up-to-date information. On the other hand, Synthetic Aperture Radar (SAR) data can record all-weather and all-time polarization information which is critical for change detection in poor weather conditions; nonetheless, SAR is not precise as optical data for forestry change detection applications as it cannot provide the spectral features of interest. The combined processing of optical and SAR images allow for the retrieval of information of interest with a precision that none of them could achieve alone. In this context, Cycle-Consistent Generative Adversarial Networks (CycleGAN) based deep feature translation method was proposed in this study for change detection. The CycleGAN transfers images from one domain (optical) to another domain (SAR) into the same feature space using a cyclic structure. Thus, it can provide continuous and up-to-date information for change detection while keeping its spectral features. The accuracy of the fake images generated from CycleGAN was evaluated by correlating them with spectral indices (e.g., Normalized Difference Vegetation Index (NDVI), Modified Radar Vegetation Index (mRVI), and Modified Radar Forest Degradation Index (mRFDI)) directly obtained from optical and SAR data. As a result, the best correlation coefficients (R) were found between real NDVI (optical data) and fake NDVI (CycleGAN) with 0.98 and 0.97 for two different dated datasets.

Original languageEnglish
Pages (from-to)583-588
Number of pages6
JournalInternational Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives
Volume43
Issue numberB3-2022
DOIs
Publication statusPublished - 30 May 2022
Externally publishedYes
Event2022 24th ISPRS Congress on Imaging Today, Foreseeing Tomorrow, Commission III - Nice, France
Duration: 6 Jun 202211 Jun 2022

Bibliographical note

Publisher Copyright:
© Authors 2022

Keywords

  • Change Detection
  • Cycle-GAN
  • Deep Learning
  • Feature Translation
  • Vegetation Indices

Fingerprint

Dive into the research topics of 'A COMPARISON BETWEEN CYCLE-GAN BASED FEATURE TRANSLATION AND OPTICAL-SAR VEGETATION INDICES'. Together they form a unique fingerprint.

Cite this