Abstract
We propose compact and effective network layer Rotational Duplicate Layer (RDLayer) that takes the place of regular convolution layer resulting up to 128 × in memory saving. Along with network accuracy, memory and power constraints affect design choices of computer vision tasks performed on resource-limited devices such as FPGAs (Field Programmable Gate Array). To overcome this limited availability, RDLayers are trained in a way that whole layer parameters are obtained from duplication and rotation of smaller learned kernel. Additionally, we speed up the forward pass via partial decompression methodology for data compressed with JPEG(Joint Photograpic Expert Group)2000. Our experiments on remote sensing scene classification showed that our network achieves ∼ 4 × reduction in model size in exchange of ∼ 4.5 % drop in accuracy, ∼ 27 × reduction with the cost of ∼ 10 % drop in accuracy, along with ∼ 2.6 × faster evaluation time on test samples.
Original language | English |
---|---|
Title of host publication | Advances in Computational Collective Intelligence - 13th International Conference, ICCCI 2021, Proceedings |
Editors | Krystian Wojtkiewicz, Jan Treur, Elias Pimenidis, Marcin Maleszka |
Publisher | Springer Science and Business Media Deutschland GmbH |
Pages | 669-678 |
Number of pages | 10 |
ISBN (Print) | 9783030881122 |
DOIs | |
Publication status | Published - 2021 |
Event | 13th International Conference on Computational Collective Intelligence, ICCCI 2021 - Virtual, Online Duration: 29 Sept 2021 → 1 Oct 2021 |
Publication series
Name | Communications in Computer and Information Science |
---|---|
Volume | 1463 |
ISSN (Print) | 1865-0929 |
ISSN (Electronic) | 1865-0937 |
Conference
Conference | 13th International Conference on Computational Collective Intelligence, ICCCI 2021 |
---|---|
City | Virtual, Online |
Period | 29/09/21 → 1/10/21 |
Bibliographical note
Publisher Copyright:© 2021, Springer Nature Switzerland AG.
Keywords
- 1-bit DCNN
- Compressed domain
- Remote sensing
- Rotational duplicate layer
- Scene classification