Abstract
Semantic segmentation of terrain images plays a critical role in military, agricultural, and logistics applications. The fusion of images obtained from different spectral bands enables more accurate and comprehensive analyses. In this study, a dual-stream fully convolutional segmentation network is proposed, which takes both RGB and thermal images as input. The model processes each modality with independent encoders, extracts high-level features, and transforms them into a unified representation. In the transmission from the encoder to the decoder, learnable inter-convolutional connections are employed instead of traditional skip connections, ensuring a more effective fusion of RGB and thermal feature maps. As a result, significant improvements in segmentation performance have been observed, particularly under low-light and foggy conditions. Experimental results demonstrate that the proposed method achieves up to a 16.58% mIoU score improvement compared to approaches using only RGB or thermal images.
| Translated title of the contribution | Multispectral Image Fusion for Terrain Segmentation |
|---|---|
| Original language | Turkish |
| Title of host publication | 33rd IEEE Conference on Signal Processing and Communications Applications, SIU 2025 - Proceedings |
| Publisher | Institute of Electrical and Electronics Engineers Inc. |
| ISBN (Electronic) | 9798331566555 |
| DOIs | |
| Publication status | Published - 2025 |
| Externally published | Yes |
| Event | 33rd IEEE Conference on Signal Processing and Communications Applications, SIU 2025 - Istanbul, Turkey Duration: 25 Jun 2025 → 28 Jun 2025 |
Publication series
| Name | 33rd IEEE Conference on Signal Processing and Communications Applications, SIU 2025 - Proceedings |
|---|
Conference
| Conference | 33rd IEEE Conference on Signal Processing and Communications Applications, SIU 2025 |
|---|---|
| Country/Territory | Turkey |
| City | Istanbul |
| Period | 25/06/25 → 28/06/25 |
Bibliographical note
Publisher Copyright:© 2025 IEEE.