• Spectroscopy and Spectral Analysis
  • Vol. 43, Issue 10, 3193 (2023)
WANG Yu-chen1, KONG Ling-qin2, ZHAO Yue-jin2, DONG Li-quan2, LIU Ming2, and HUI Mei1
Author Affiliations
  • 1[in Chinese]
  • 2[in Chinese]
  • show less
    DOI: 10.3964/j.issn.1000-0593(2023)10-3193-09 Cite this Article
    WANG Yu-chen, KONG Ling-qin, ZHAO Yue-jin, DONG Li-quan, LIU Ming, HUI Mei. Hyperspectral Reconstruction From RGB Images for Tissue Oxygen Saturation Assessment[J]. Spectroscopy and Spectral Analysis, 2023, 43(10): 3193 Copy Citation Text show less

    Abstract

    Tissue Oxygenation is an important indicator of blood perfusion and oxygenation in tissues and blood. It is of great significance in clinical diagnosis and daily monitoring. Hyperspectral imaging is a new method to evaluate StO2 because of its non-contact and abundant spectral information. However, hyperspectral imaging equipment is expensive and complex to operate. These disadvantages limit its use environment and development. Traditional industrial cameras have a high spatial resolution of RGB images of skin tissue, but their spectral resolution is low. If the spectral resolution can be improved, it is possible to measure physiological parameters with high precision. This paper proposes a new method for estimating StO2 based on hyperspectral reconstruction of RGB images. Based on the depth learning method, the reconstruction model from RGB image to the hyperspectral image of skin tissue is constructed, and the hyperspectral image of skin tissue with high reliability is obtained. Then, the spatial two-dimensional distribution of StO2 is obtained using the improved Beer Lambert law formulations. This paper collected RGB images and hyperspectral images of hands of 49 subjects under different blood perfusion conditions using a common visible light camera and a hyperspectral camera as data sets. Based on the dimensionality reduction and denoising of hyperspectral images, the 450~600 nm (including 31 spectral channels) bands were selected as the reconstructed spectral bands according to the characteristic spectra of oxyhemoglobin and deoxyhemoglobin. The convolutional neural networks for spectral reconstruction of skin tissue based on depth learning is constructed. The experimental results show that the skin reflectance spectra obtained by the reconstructed model are in good agreement with those obtained by the hyperspectral camera, and the mean absolute error (MAE) between the two in the test set is 0.009 38, the root mean square error (RMSE) was 0.014 81. Then the similarity between the StO2 measurements from the reconstructed model and those from the hyperspectral camera was quantitatively evaluated. We used the samples in the test set to generate the StO2 spatial distribution maps by two methods respectively, and the two-dimensional correlation coefficients between them were in the reliable range (greater than 94%). These results show that the proposed method based on hyperspectral reconstruction of visible light images is reliable. This study provided a simple and low-cost method of StO2 monitoring for clinical diagnosis and monitoring of various diseases.
    WANG Yu-chen, KONG Ling-qin, ZHAO Yue-jin, DONG Li-quan, LIU Ming, HUI Mei. Hyperspectral Reconstruction From RGB Images for Tissue Oxygen Saturation Assessment[J]. Spectroscopy and Spectral Analysis, 2023, 43(10): 3193
    Download Citation