Abstract
The success of Transformers, including in the field of image processing, has recently attracted the attention of researchers. Some of the researchers tried to design Transformer- based or Convolutional Neural Network-based models separately, while others tried to combine them to produce hybrid models. A significant amount of hybrid model studies have examined the sub-model design and/or the applicability of self-attention in Convolutional Neural Networks. However, position embedding, another contribution from Transformers, has received much less attention. In this study, the effect of position information on Convolutional Neural Networks was analyzed. As a result of the experiments, it has been observed that the use of position information affects performance. In the AgeDB-30, CALFW, and LFW test sets, models with different position information usage have been able to surpass the performance of the model without position information by achieving 95.12%, 93.95%, and 99.52% accuracy, respectively.
Translated title of the contribution | How Positional Information Affect Convolutional Neural Networks? |
---|---|
Original language | Turkish |
Title of host publication | UBMK 2023 - Proceedings |
Subtitle of host publication | 8th International Conference on Computer Science and Engineering |
Publisher | Institute of Electrical and Electronics Engineers Inc. |
Pages | 526-531 |
Number of pages | 6 |
ISBN (Electronic) | 9798350340815 |
DOIs | |
Publication status | Published - 2023 |
Event | 8th International Conference on Computer Science and Engineering, UBMK 2023 - Burdur, Turkey Duration: 13 Sept 2023 → 15 Sept 2023 |
Publication series
Name | UBMK 2023 - Proceedings: 8th International Conference on Computer Science and Engineering |
---|
Conference
Conference | 8th International Conference on Computer Science and Engineering, UBMK 2023 |
---|---|
Country/Territory | Turkey |
City | Burdur |
Period | 13/09/23 → 15/09/23 |
Bibliographical note
Publisher Copyright:© 2023 IEEE.