TY - JOUR
T1 - A comprehensive review on deep learning based remote sensing image super-resolution methods
AU - Wang, Peijuan
AU - Bayram, Bulent
AU - Sertel, Elif
N1 - Publisher Copyright:
© 2022 Elsevier B.V.
PY - 2022/9
Y1 - 2022/9
N2 - Satellite imageries are an important geoinformation source for different applications in the Earth Science field. However, due to the limitation of the optic and sensor technologies and the high cost to update the sensors and equipments, the spectral and spatial resolution of the Earth Observation satellites may not meet the desired requirements. Thus, Remote Sensing Image Super-resolution (RSISR) which aims at restoring the high-resolution (HR) remote sensing images from the given low-resolution (LR) images has drawn considerable attention and witnessed the rapid development of the deep learning (DL) algorithms. In this research, we aim to comprehensively review the DL-based single image super-resolution (SISR) methods on optical remote sensing images. First, we introduce the DL techniques utilized in SISR. Second, we summarize the RSISR algorithms thoroughly, including the DL models, commonly used remote sensing datasets, loss functions, and performance evaluation metrics. Third, we present a new multi-sensor dataset that consists of Very High-Resolution satellite images from different satellites of various landscapes and evaluate the performance of some state-of-the-art super-resolution methods on this dataset. Finally, we envision the challenges and future research in the RSISR field.
AB - Satellite imageries are an important geoinformation source for different applications in the Earth Science field. However, due to the limitation of the optic and sensor technologies and the high cost to update the sensors and equipments, the spectral and spatial resolution of the Earth Observation satellites may not meet the desired requirements. Thus, Remote Sensing Image Super-resolution (RSISR) which aims at restoring the high-resolution (HR) remote sensing images from the given low-resolution (LR) images has drawn considerable attention and witnessed the rapid development of the deep learning (DL) algorithms. In this research, we aim to comprehensively review the DL-based single image super-resolution (SISR) methods on optical remote sensing images. First, we introduce the DL techniques utilized in SISR. Second, we summarize the RSISR algorithms thoroughly, including the DL models, commonly used remote sensing datasets, loss functions, and performance evaluation metrics. Third, we present a new multi-sensor dataset that consists of Very High-Resolution satellite images from different satellites of various landscapes and evaluate the performance of some state-of-the-art super-resolution methods on this dataset. Finally, we envision the challenges and future research in the RSISR field.
KW - Deep learning
KW - Remote sensing
KW - Super-resolution
UR - http://www.scopus.com/inward/record.url?scp=85134841429&partnerID=8YFLogxK
U2 - 10.1016/j.earscirev.2022.104110
DO - 10.1016/j.earscirev.2022.104110
M3 - Review article
AN - SCOPUS:85134841429
SN - 0012-8252
VL - 232
JO - Earth-Science Reviews
JF - Earth-Science Reviews
M1 - 104110
ER -