Skip to Main content Skip to Navigation
Conference papers

DNNZip: Selective Layers Compression Technique in Deep Neural Network Accelerators

Abstract : In Deep Neural Network (DNN) accelerators, the on-chip traffic and memory traffic accounts for a relevant fraction of the inference latency and energy consumption. A major component of such traffic is due to the moving of the DNN model parameters from the main memory to the memory interface and from the latter to the processing elements (PEs) of the accelerator. In this paper, we present DNNZip, a technique aimed at compressing the model parameters of a DNN, thus resulting in significant energy and performance improvement. DNNZip implements a lossy compression whose compression ratio is tuned based on the maximum tolerated error on the model parameters provided by the user. DNNZip is assessed on several convolutional NNs and the trade-off inference energy saving vs. inference latency reduction vs. network accuracy degradation is discussed. We found that up to 64% energy saving, and up to 67% latency reduction can be obtained with a limited impact on the accuracy of the network.
Document type :
Conference papers
Complete list of metadatas

Cited literature [18 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02906973
Contributor : Habiba Lahdhiri <>
Submitted on : Sunday, July 26, 2020 - 10:39:10 PM
Last modification on : Thursday, July 30, 2020 - 3:50:24 AM

File

DNNZip_DSD20.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02906973, version 1

Citation

Habiba Lahdhiri, Maurizio Palesi, Salvatore Monteleone, Davide Patti, Giuseppe Ascia, et al.. DNNZip: Selective Layers Compression Technique in Deep Neural Network Accelerators. Euromicro Conference on Digital System Design DSD, Aug 2020, Portorož, Slovenia. ⟨hal-02906973⟩

Share

Metrics

Record views

20

Files downloads

43