A Novel Heuristic Neuron Grouping Algorithm for Deep Neural Network Accelerators


Cakin A., Dilek S., Tosun S., Nacar F.

JOURNAL OF CIRCUITS, SYSTEMS AND COMPUTERS, cilt.34, sa.7, ss.1-18, 2024 (SCI-Expanded) identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 34 Sayı: 7
  • Basım Tarihi: 2024
  • Doi Numarası: 10.1142/s0218126625501786
  • Dergi Adı: JOURNAL OF CIRCUITS, SYSTEMS AND COMPUTERS
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Academic Search Premier, Applied Science & Technology Source, Compendex, Computer & Applied Sciences, INSPEC
  • Sayfa Sayıları: ss.1-18
  • Hacettepe Üniversitesi Adresli: Evet

Özet

Deep neural networks (DNNs) have witnessed widespread adoption across various domains. However, their computational demands pose significant challenges due to the extensive inter-neuron communication within the network. Moreover, the energy consumption of DNNs is substantial, primarily driven by the vast data movement and computational requirements. To overcome these challenges, novel accelerator architectures are essential. In this study, we present a novel heuristic algorithm for neuron grouping, catering to both fully connected and partially pruned DNN models. Our algorithm aims to minimize the overall data communication cost among neuron groups while also considering computational load balance. It outperforms existing heuristic neuron grouping methods classified into three main approaches from the literature by an average improvement in communication cost ranging from 33.01% to 47.11%. By optimizing neuron grouping, our approach may be used to enhance the efficiency of DNN accelerators, enabling improved performance and reduced energy consumption.