Structured Compression of Convolutional Neural Networks for Specialized Tasks

Freddy Gabbay*, Benjamin Salomon, Gil Shomron

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Convolutional neural networks (CNNs) offer significant advantages when used in various image classification tasks and computer vision applications. CNNs are increasingly deployed in environments from edge and Internet of Things (IoT) devices to high-end computational infrastructures, such as supercomputers, cloud computing, and data centers. The growing amount of data and the growth in their model size and computational complexity, however, introduce major computational challenges. Such challenges present entry barriers for IoT and edge devices as well as increase the operational expenses of large-scale computing systems. Thus, it has become essential to optimize CNN algorithms. In this paper, we introduce the S-VELCRO compression algorithm, which exploits value locality to trim filters in CNN models utilized for specialized tasks. S-VELCRO uses structured compression, which can save costs and reduce overhead compared with unstructured compression. The algorithm runs in two steps: a preprocessing step identifies the filters with a high degree of value locality, and a compression step trims the selected filters. As a result, S-VELCRO reduces the computational load of the channel activation function and avoids the convolution computation of the corresponding trimmed filters. Compared with typical CNN compression algorithms that run heavy back-propagation training computations, S-VELCRO has significantly fewer computational requirements. Our experimental analysis shows that S-VELCRO achieves a compression-saving ratio between 6% and 30%, with no degradation in accuracy for ResNet-18, MobileNet-V2, and GoogLeNet when used for specialized tasks.

Original languageEnglish
Article number3679
JournalMathematics
Volume10
Issue number19
DOIs
StatePublished - Oct 2022
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2022 by the authors.

Keywords

  • convolutional neural network
  • deep neural networks
  • machine learning
  • structured compression

Fingerprint

Dive into the research topics of 'Structured Compression of Convolutional Neural Networks for Specialized Tasks'. Together they form a unique fingerprint.

Cite this