Model-Based FPGA AI Accelerator Design Using Vitis AI with In-Depth Performance and Energy Efficiency Analysis

Gozde Ozdil*, Berna Ors

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

This paper presents a model-based design of AI accelerator following the Vitis TRD flow, implemented on the AMD Kria KV260 Vision AI Starter Kit. The ResNet-18 model, developed in PyTorch, was quantized, compiled with Vitis AI, and deployed to the FPGA via PYNQ. We deeply analyzed different DPU configurations and frequencies, focusing on resource utilization, power, FPS, and energy efficiency. Results show that resource utilization remains constant across frequencies, but lower frequencies increase energy consumption. For optimal performance and energy efficiency, high-MAC DPU configurations should be used at higher frequencies. To our knowledge, no prior research has fully detailed the Vitis TRD flow within Vitis AI. Most rely on Vivado TRD, which requires PetaLinux. This work offers a comprehensive guide for deploying AI models on FPGAs using Ubuntu, eliminating the need for PetaLinux expertise.

Original languageEnglish
Title of host publication2024 32nd Telecommunications Forum, TELFOR 2024 - Proceedings of Papers
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798350391053
DOIs
Publication statusPublished - 2024
Event32nd Telecommunications Forum, TELFOR 2024 - Belgrade, Serbia
Duration: 26 Nov 202427 Nov 2024

Publication series

Name2024 32nd Telecommunications Forum, TELFOR 2024 - Proceedings of Papers

Conference

Conference32nd Telecommunications Forum, TELFOR 2024
Country/TerritorySerbia
CityBelgrade
Period26/11/2427/11/24

Bibliographical note

Publisher Copyright:
© 2024 IEEE.

Keywords

  • AI accelerator
  • DPU
  • FPGA
  • Kria KV260
  • MPSoC
  • PYNQ
  • Vitis AI
  • Vitis TRD

Fingerprint

Dive into the research topics of 'Model-Based FPGA AI Accelerator Design Using Vitis AI with In-Depth Performance and Energy Efficiency Analysis'. Together they form a unique fingerprint.

Cite this