• Spectroscopy and Spectral Analysis
  • Vol. 41, Issue 9, 2742 (2021)
Hao-guang LI*, Yun-hua YU1; 2;, Yan PANG1;, and Xue-feng SHEN1; 2;
Author Affiliations
  • 1. College of Mechanical and Control Engineering, Shandong Institute of Petrochemical and Chemical Technology, Dongying 257061, China
  • show less
    DOI: 10.3964/j.issn.1000-0593(2021)09-2742-06 Cite this Article
    Hao-guang LI, Yun-hua YU, Yan PANG, Xue-feng SHEN. Research of Parameter Optimization of Preprocessing and Feature Extraction for NIRS Qualitative Analysis Based on PSO Method[J]. Spectroscopy and Spectral Analysis, 2021, 41(9): 2742 Copy Citation Text show less

    Abstract

    In the qualitative analysis of near-infrared spectroscopy, preprocessing and feature extraction are indispensable to achieve good recognition results. Preprocessing is mainly to eliminate the influence of various interference factors on the spectral data. The common preprocessing methods include smoothing, first-order derivatives, normalization, etc., while the feature extraction methods can eliminate the irrelevant information in the data and retain the effective information. The common feature extraction methods include partial least squares, principal component analysis, linear discriminant analysis, etc. Different preprocessing and feature extraction methods have different characteristics. When building a qualitative analysis model, it is often difficult to achieve ideal results by using a single preprocessing or feature extraction method. It is often necessary to use a combination of multiple preprocessing and feature extraction methods to improve the model's performance. Variable parameters such as feature extraction dimension need to be set in each preprocessing and feature extraction process. These variable parameters have an important impact on the performance of the model. Therefore, multiple parameters need to be determined in multiple preprocessing and multiple feature extraction methods. In practice, the trial and error method is often used to find the optimal value of each parameter. In order to get the optimal value of one of the parameters, it is necessary to fix the other parameter values according to experience. Then a parameter to be optimized is substituted into the NIR qualitative analysis model for trial and error to get the corresponding parameter value of the optimal recognition rate of the model, and take it as the optimal value. After several parameters to be optimized are obtained one by one by trial and error method, the combination of parameters is set into the qualitative analysis model, and finally, qualitative identification is carried out. However, the combination of parameters obtained by the trial and error method is difficult to guarantee the optimal optimal solution. In addition to the trial and error method, the multiple loops nesting method can also be used to obtain the optimal combination of parameters in the preprocessing and feature extraction of the near qualitative analysis model. However, this method consumes a lot of computer memory and computing time and has the disadvantage of low efficiency. In this paper, a method based on particle swarm optimization (PSO) is proposed to optimize the parameters of pre-processing and feature extraction of the NIR qualitative analysis model, which can quickly obtain the optimal parameter combination of pre-processing and feature extraction and ensure that the qualitative analysis model with the optimal parameter combination has the best recognition performance. The experimental results show that the method is effective.
    Hao-guang LI, Yun-hua YU, Yan PANG, Xue-feng SHEN. Research of Parameter Optimization of Preprocessing and Feature Extraction for NIRS Qualitative Analysis Based on PSO Method[J]. Spectroscopy and Spectral Analysis, 2021, 41(9): 2742
    Download Citation