• Laser & Optoelectronics Progress
  • Vol. 56, Issue 22, 221001 (2019)
Yanni Wang, Danna Zhu*, Huiqin Wang, and Ke Wang
Author Affiliations
  • School of Information and Control Engineering, Xi'an University of Architecture and Technology, Xi'an, Shaanxi 710055, China
  • show less
    DOI: 10.3788/LOP56.221001 Cite this Article Set citation alerts
    Yanni Wang, Danna Zhu, Huiqin Wang, Ke Wang. Multispectral Image Classification of Mural Pigments Based on Convolutional Neural Network[J]. Laser & Optoelectronics Progress, 2019, 56(22): 221001 Copy Citation Text show less
    Basic structure of CNN
    Fig. 1. Basic structure of CNN
    Convolution process
    Fig. 2. Convolution process
    Designed CNN model
    Fig. 3. Designed CNN model
    Principles of dropout. (a) Network without dropout; (b) network with dropout
    Fig. 4. Principles of dropout. (a) Network without dropout; (b) network with dropout
    Multispectral images of the pigment true silver
    Fig. 5. Multispectral images of the pigment true silver
    Flow chart of spectral feature reorganization
    Fig. 6. Flow chart of spectral feature reorganization
    Flow chart of classification experiment for mural pigments
    Fig. 7. Flow chart of classification experiment for mural pigments
    Multispectral images of standard mural paint board
    Fig. 8. Multispectral images of standard mural paint board
    Multispectral images of simulated mural
    Fig. 9. Multispectral images of simulated mural
    Sample units after spectral feature recombination of standard pigment
    Fig. 10. Sample units after spectral feature recombination of standard pigment
    Classification renderings of different models. (a) Original mural; (b) statistical manifold-SVM model; (c) CNN model (without dropout); (d) CNN model (with dropout)
    Fig. 11. Classification renderings of different models. (a) Original mural; (b) statistical manifold-SVM model; (c) CNN model (without dropout); (d) CNN model (with dropout)
    Pigment typeMercuric sulfideCoal blackTetra greenFirst greenLazuriteMiniumChrome yellowGypsum
    Sample No.54612641261170538776702821155287858882586
    Table 1. Number of samples of each pigment
    CategoryMercuric sulfideCoal blackTetra greenFirst greenLazuriteMiniumChrome yellowGypsum
    Mercuric sulfide93.48000.751.723.6500
    Coal black081.1302.9515.52000
    Tetra green0090.379.630000
    First green0029.2670.740000
    Lazurite2.161.3805.8790.59000
    Minium13.04000086.9600
    Chrome yellow3.670001.12095.210
    Gypsum0003.026.2402.5288.22
    Table 2. Confusion matrix of classification effect of CNN model (with dropout)%
    CategorySVMCNN(no-dropout)CNN(dropout)
    Mercuric sulfide93.3793.4993.48
    Coal black80.0180.1581.13
    Tetra green90.4290.3590.37
    First green67.6570.7170.74
    Lazurite86.2190.5790.59
    Minium63.7889.9286.96
    Chrome yellow88.0295.1895.21
    Gypsum84.3688.0688.22
    Table 3. Comparison of classification accuracy of each pigment for three models%
    Yanni Wang, Danna Zhu, Huiqin Wang, Ke Wang. Multispectral Image Classification of Mural Pigments Based on Convolutional Neural Network[J]. Laser & Optoelectronics Progress, 2019, 56(22): 221001
    Download Citation