Optimizing Data Availability and Utilization in Deep Learning Accelerator SoCs

Cagla Irmak Rumelili Koksal*, Nihat Mert Cicek, Ayse Yilmazer Metin, Berna Ors

*Bu çalışma için yazışmadan sorumlu yazar

Araştırma sonucu: ???type-name???Konferans katkısıbilirkişi

Özet

Deep learning accelerators are pivotal in accelerating computation-intensive tasks in modern AI applications. Optimizing the utilization of system resources, including shared cache, on-chip SRAM, and data movement mechanisms, is crucial for achieving superior performance and energy efficiency. In this study, we propose an efficient system architecture specifically tailored for deep learning workloads. Our architecture enables to reconfigure the last level cache as a scratchpad with prefetch capability, which eliminates cache misses and thereby offers resource efficiency, improved performance, and energy efficiency. By implementing a strategy to overlap accelerator execution with data movement, we achieved remarkable results, including a 14× speedup and %5 reduction in energy consumption for the ResNet50 benchmark when compared to the base system configuration. These findings demonstrate the substantial benefits of incorporating prefetch support and scratchpad reconfiguration in the last level cache, leading to enhanced performance and energy efficiency in real-world deep learning accelerator applications.

Orijinal dilİngilizce
Ana bilgisayar yayını başlığıICECS 2023 - 2023 30th IEEE International Conference on Electronics, Circuits and Systems
Ana bilgisayar yayını alt yazısıTechnosapiens for Saving Humanity
YayınlayanInstitute of Electrical and Electronics Engineers Inc.
ISBN (Elektronik)9798350326499
DOI'lar
Yayın durumuYayınlandı - 2023
Etkinlik30th IEEE International Conference on Electronics, Circuits and Systems, ICECS 2023 - Istanbul, Turkey
Süre: 4 Ara 20237 Ara 2023

Yayın serisi

AdıICECS 2023 - 2023 30th IEEE International Conference on Electronics, Circuits and Systems: Technosapiens for Saving Humanity

???event.eventtypes.event.conference???

???event.eventtypes.event.conference???30th IEEE International Conference on Electronics, Circuits and Systems, ICECS 2023
Ülke/BölgeTurkey
ŞehirIstanbul
Periyot4/12/237/12/23

Bibliyografik not

Publisher Copyright:
© 2023 IEEE.

Parmak izi

Optimizing Data Availability and Utilization in Deep Learning Accelerator SoCs' araştırma başlıklarına git. Birlikte benzersiz bir parmak izi oluştururlar.

Alıntı Yap