• Laser & Optoelectronics Progress
  • Vol. 59, Issue 24, 2415003 (2022)
Jinghui Chu, Meng Li, and Lü Wei*
Author Affiliations
  • School of Electrical and Information Engineering, Tianjin University, 300072, China
  • show less
    DOI: 10.3788/LOP202259.2415003 Cite this Article Set citation alerts
    Jinghui Chu, Meng Li, Lü Wei. Adaptive Dynamic Filter Pruning Approach Based on Deep Learning[J]. Laser & Optoelectronics Progress, 2022, 59(24): 2415003 Copy Citation Text show less

    Abstract

    Model compression can significantly improve the deployment of convolutional neural networks on limited-resource devices. Filter pruning has gradually drawn attention from academia and industry as a research hotspot. The essence of filter pruning is the selection and retention of important filters. Existing research has primarily focused on static and interlayer filter selection, which still has redundancy in the compressed model. We propose an adaptive dynamic filter pruning approach in this paper wherein an activation weight generation module is introduced to generate the activation weight of each filter. The importance of filters in global convolutional layers is dynamically evaluated by embedding the activation weight generation module in various classical networks, and the filters that extract richer information are adaptively selected to reconstruct the pruned networks. Experiments are performed on CIFAR-10 and AUC datasets using different convolutional neural networks, among which the proposed method has better performance than several mainstream pruning methods on CIFAR-10 dataset. The accuracy decreased by 0.3 percentage points when the computation was compressed by ~70% before and after pruning on the AUC dataset. Experiments on various networks demonstrate the proposed method's ability to generalize to different models.
    Jinghui Chu, Meng Li, Lü Wei. Adaptive Dynamic Filter Pruning Approach Based on Deep Learning[J]. Laser & Optoelectronics Progress, 2022, 59(24): 2415003
    Download Citation