• Infrared and Laser Engineering
  • Vol. 49, Issue 5, 20190413 (2020)
Yang Guoqing1、2、*, Li Zhou1, Zhao Chen1、2, Yu Yi1, Qiao Yanfeng1, and He Fengyun1
Author Affiliations
  • 1[in Chinese]
  • 2[in Chinese]
  • show less
    DOI: 10.3788/irla20190413 Cite this Article
    Yang Guoqing, Li Zhou, Zhao Chen, Yu Yi, Qiao Yanfeng, He Fengyun. Nonlinear atmospheric correction based on neural network for infrared target radiometry[J]. Infrared and Laser Engineering, 2020, 49(5): 20190413 Copy Citation Text show less

    Abstract

    Infrared radiometry technology is an important means to characterize the infrared signature of targets, and atmospheric correction is a requisite step to obtain the real radiance of targets. A nonlinear atmospheric correction (NLAC) method was proposed to improve the infrared radiometric accuracy for long distance targets in this paper. This method used near-range standard reference source measurement (NRSRM) to calculate the actual atmospheric transmittance and path radiation simultaneously at different locations in a real-time environment. And the theoretical atmospheric transmission and path radiation under the corresponding conditions could be obtained from the atmospheric radiation transmission software as well. Neural network technology was applied to fit the non-linear relationship between them. Thus, the atmospheric transmittance and path radiation over long distances could be predicted to achieve atmospheric correction. Simpler linear atmospheric correction (LAC) and linear enhancement atmospheric correction (LEAC) were also carried out for comparison. The experimental results indicate that the infrared radiometric average error of the proposed method is 6.45%, which is much lower than that of the conventional method, LAC and LEAC that are 16.17%, 11.27% and 7.44%, respectively.

    0 Introduction

    With the development of infrared detectors and radiometry technology, IR radiometric systems have gradually become active[1]. Infrared radiometry based on image grayscale is an indirect method[2]. For a target with a certain distance in space, the transmitted infrared radiation of the target is attenuated, due to the absorption and scattering of water vapor, carbon dioxide, aerosol and other components in the atmosphere[3]. The atmospheric transmittance is brought forward to describe this process. The radiation emitted by various components of the atmosphere is superimposed on the target radiation and transfer into the measurement system, and this process can be described as the atmospheric path radiation as well[4]. For high-precision radiometry, these two factors mentioned above should be considered as important influences affecting the measurement accuracy. Existing measurement methods of the atmospheric transmittance include software calculation, theoretical numerical calculation and standard reference source measurement, etc. The software calculation is a widely used approach by inputting relevant atmospheric environmental parameters. The atmospheric transmittance is simply and expediently obtained from the atmospheric radiation transfer software. It is the most direct way but the real-time measurement error is relatively mediocre even more than 20% sometimes. With known parameters, such as atmospheric component content and spectral line intensity, numerical calculation with use of radiation transfer model is the most accurate method, such as line-by-line integration method[5]. However, the large amount of calculation and time-consuming are not suitable for practical application. Near-range standard reference source measurement (NRsrM) is the calculation of atmospheric transmittance using a standard reference target known for temperature or infrared radiance with a measurement precision of 5%[6]. However, the measurement range of this method is extremely limited so that it is only suitable for close range measurement, and the reference source cannot be placed near the target in practical application.

    The real-time measurement method based on NRsrM is relatively simple, and meets the accuracy requirements in practical application. The transmittance and path radiation obtained from the atmospheric radiation transfer software according to historical data are also well-founded. Therefore, a nonlinear atmospheric correction (NLAC) method based on NRsrM and software calculation is proposed to achieve measuring the atmospheric transmittance and path radiation simultaneously in this paper. The main advantage of this method is that it can realize infrared radiation measurement of long distance targets using the nonlinear fitting technology of neural network. Long-range atmospheric transmittance and path radiation are corrected by near-range measurement, thus it can improve the accuracy of target radiation measurement compared to the result obtained from the software. Linear atmospheric correction (LAC) method and linear enhancement atmospheric correction (LEAC) are compared with the method presented as well in this paper, the accuracy of infrared radiation measurement is improved obviously based on the analysis of the experimental data.

    1 Infrared radiometric principle

    The target infrared radiation process is shown in Fig. 1. The sources of radiation energy received by infrared system include target radiation attenuated through atmosphere, target reflection radiation to surrounding environment attenuated through atmosphere, also called equivalent background radiation, and atmospheric self-radiation between optical system and target[7- 8]. For an opaque target, the infrared radiance entering infrared system can be described as following formula:

    where ${\tau _{\rm{atm}}}$ is the atmospheric transmission, $\varepsilon $ is the measured target emissivity, ${L_{t,\rm{atm}}}$ is the infrared radiance entering infrared system, $L({T_t})$ stands for the radiative contribution from the target, $L({T_e})$ stands for the radiative contribution from the surrounding environment, and ${L_{\rm{path}}}$ stands for the atmospheric self-radiation between the infrared system and the target.

    Schematic diagram of radiative transfer process in the atmosphere

    Figure 1.Schematic diagram of radiative transfer process in the atmosphere

    The radiation flux received by a detector element through the optical system is

    where ${\tau _{\rm{opt}}}$ is the transmittance of the optical system, $D$ is the diameter of the optical system, $f$ is the focal length, ${A_{\rm{d}}}$ is sensitive area of a detector element, hence ${k_t} = (\text{π} \cdot {\tau _{\rm{opt}}}/4){(D/f)^2} \cdot {A_{\rm d}}$ is constant for a given infrared system.

    When the infrared radiation measurement system imagines a target at a certain distance, the gray image can be obtained from the electrical signal converted from the infrared radiation. Infrared systems, in many applications, are operated in a range of radiance within which detectors exhibit linear input–output characteristics. The output gray value [digital number (DN)] at a preselected integration time is given by the approximate linear relation:

    where ${G_{i,j}}$ is the gray value of the $(i,j)$th detector in the array, ${K_{i,j}} = {k_{i,j}} \cdot {k_t}$ is the incident radiance response of infrared measurement system, ${B_{i,j}}$ is the offset, originating from the stray radiation that strike the detector element, and internal factors of the detector, such as dark current. The following formula can be written according to Eq. (1) and (3):

    The inverted radiance of the target obtained from Eq. (4) can be described as follows:

    where ${{\rm{K}}_{i,j}}$and ${B_{i,j}}$can be accurately measured by the near-extend-source method for calibration at a preselected integration time[9- 10]. The geometric model of calibration is illustrated in Fig. 2. If the measured target emissivity $\varepsilon $ is known in advance, and the equivalent background radiation $L({T_e})$ can be measured as well, the target radiation can be calculated from Eq. (5) by collecting the target image ${G_{i,j}}$ and measuring the atmospheric transmission ${\tau _{{\rm{atm}}}}$ and path radiation ${L_{{\rm{path}}}}$.

    Schematic diagram of radiometric calibration using extended area blackbody

    Figure 2.Schematic diagram of radiometric calibration using extended area blackbody

    2 Atmospheric correction principle

    It is known from the measurement principle that the accuracy of the atmospheric transmittance and path radiation play an extremely crucial role in infrared radiometry compared to other parameters, such as the response and offset, which are determined by a given infrared measurement system. In the conventional radiometric method, the atmospheric transmittance and path radiation are calculated by atmospheric radiation transfer software. However, the error of this method is not able to meet the application requirements. Atmospheric correction method for the atmospheric transmittance and path radiation is desirable to improve the infrared radiometric accuracy.

    2.1 Measurement of atmospheric transmittance and path radiation by NRsrM

    Figure 3 shows the schematic of an experimental setup for NRsrM. An ideal blackbody whose emissivity is close to 1 as a standard reference source is placed at a distance of ${l_0}$ from the infrared imaging system. Infrared images of the ideal blackbody can be captured at temperatures of ${T_l}$ and ${T_h}$ , respectively. Ignoring the index of the detector element above, the gray value of the ideal blackbody can be described as follows simplified from Eq. (4).

    Schematic diagram of the infrared radiation measurement

    Figure 3.Schematic diagram of the infrared radiation measurement

    where ${G_l}$ and ${G_h}$ are the gray value of the ideal blackbody at temperatures of ${T_l}$ and ${T_h}$, respectively, $K$ and $B$ are the response and offset of infrared measurement system, ${\tau _{{\rm{atm}},{l_0}}}$ and ${L_{{\rm{path}},{l_0}}}$ denote the atmospheric transmittance and path radiation between the measured blackbody and the infrared system, respectively, $L({T_l})$ and $L({T_h})$ denote the in-band radiance of the ideal blackbody at the same absolute temperature ${T_l}$ and ${T_h}$, respectively, which can be calculated by Planck’s formula integral. The actual atmospheric transmittance and path radiation can be calculated at the distance ${l_0}$ from Eq. (6) and Eq. (7).

    2.2 Measurement of atmospheric transmittance by LAC

    MODTRAN (moderate resolution atmospheric transmission) is a commercial atmospheric radiative transfer model developed by the U.S. Air Force[11]. The theoretical atmospheric transmittance and path radiation at the distance ${l_0}$ calculated by MODTRAN4.0 are $\tau _{{\rm{atm}},{l_0}}'$ and $L_{{\rm{path}},{l_0}}'$ under the standard atmospheric model. Due to the different nature of atmospheric transmittance and path radiation, linear correction of atmospheric transmittance and path radiation, at the same time, has opposite effect on infrared radiation measurement results of targets. Previous experiments have proved that it is even more important to improve the measurement accuracy of atmospheric transmittance when measuring long distant targets. Therefore, LAC factor can be obtained as follows:

    According to the quantitative relation of distance, LEAC factor can be obtained[12]:

    For any distance $l$, the theoretical atmospheric transmittance and path radiation obtained from MODTRAN are $\tau _{{\rm{atm}},l}'$ and $L_{{\rm{path}},l}'$, respectively. The corrective atmospheric transmittance can be calculated at the distance $l$ by LAC factor or LEAC factor:

    2.3 Measurement of atmospheric transmittance and path radiation by NLAC of neural network

    The neural network is a gradient descent back-propagation algorithm, which permits the solution of regression problems by estimating a transfer function from a set of known situations. It constitutes the priori information which is necessary for solution of the problem[13]. The database that is used to train the network is built from the measured atmospheric transmittance and path radiation related to the radiation transfer model of MODTRAN4.0. In other words, the input layer is the theoretical atmospheric transmittance and path radiation obtained from MODTRAN4.0 at different distances $({l_1},{l_2},{l_3} \ldots )$. And the output layer is the measured atmospheric transmittance and path radiation calculated by NRsrM at the corresponding distances. A three-layer neural network structure is established as shown in Fig. 4.

    Illustration of the neural network

    Figure 4.Illustration of the neural network

    For atmospheric transmittance and path radiation at arbitrary distances $l$, the constructed neural network can be used to predict the network output values by inputting theoretical values.

    3 Experiments and discussions

    To verify the feasibility of this method, experiments were performed with a long-wave infrared (LWIR) camera of forward looking infrared (FLIR) systems. The infrared detector operates in the 7.7-9.3 μm waveband, and it is composed of 320 pixel×256 pixel with a 14-bit digital output. The extended area blackbody selected as the reference source has a 100 mm×100 mm size and exhibits high effective emissivity (0.97 in the 7.7-9.3 μm waveband). Its temperature accuracy is 0.01 ℃ over an operating temperature range of 0-125 ℃.

    3.1 Calibration of infrared measurement system

    The experimental setup used for radiometric calibration based on the calibration principle shown in Fig. 2 is sketched in Fig. 5. The relationship between the gray value and the radiation brightness of the blackbody shows a linear characteristic, when the integration time of the infrared system is constant, as described above. Corresponding radiance can be calculated by Planck’s formula integral as the temperatures of the blackbody are set from 35 ℃ to 65 ℃ with an interval of 5 ℃. The gray value of the blackbody can be obtained from infrared imaging system. The result is shown in Fig. 6. The calibration equation can be fitted as

    It can be known that the response $K$of infrared measurement system is 268.987 6 ${\rm{DN/W}} \cdot {{\rm{m}}^{ - 2}} \cdot {\rm{s{r}}^{ - 1}}$ and the offset $B$ of infrared measurement system is 3194.2214 ${\rm{DN}}$.

    Experimental setup for calibration

    Figure 5.Experimental setup for calibration

    Result of calibration

    Figure 6.Result of calibration

    3.2 LAC and NLAC

    In the conventional radiometric method, the atmospheric transmittance and path radiation are calculated by MODTRAN4.0. During the experiment, the ground average temperature is about 10 ℃; the pressure is about 1 021 kPa ; the relative humidity is about 20%; the angle of pitch is 0°; the altitude is 210 m and the visibility is about 9.7 km. The theoretical average atmospheric transmittance and path radiation in waveband 7.7-9.3 μm at the distance of 10 m to 100 m with the interval of 10 m are shown by the black line in Fig. 7, which are obtained from MODTRAN4.0 using the above measured parameters.

    In order to obtain the LAC factor and LEAC factor, NRsrM is carried out to calculate the actual atmospheric transmittance and path radiation. The blackbody as a standard reference source is placed at a distance of ${l_0}$=10 m from the infrared system. The gray value ${G_l}$ and ${G_h}$of the black body infrared image are 9149 ${\rm{DN}}$ and 10132 ${\rm{DN}}$ at the temperature of 50 ℃ and 60 ℃, respectively. Thus, the actual atmospheric transmittance and path radiation at the distance of 10 m can be calculated from Eq.(8)−(9) and Planck’s formula as follows.

    Atmospheric correction result at different distances. (a) Atmospheric transmittance at different distances; (b) path radiation at different distances

    Figure 7.Atmospheric correction result at different distances. (a) Atmospheric transmittance at different distances; (b) path radiation at different distances

    The theoretical atmospheric transmittance is 0.989 8 at the distance of 10 m obtained from MODTRAN4.0. Thus, the LAC factor calculated from Eq.(10) is $c{\tau _{{\rm{atm}},{\rm{LAC}}}}$=0.944 9. According to the LAC factor, the corrected atmospheric transmittance at each distance can be calculated from Eq.(12), shown by the green line in Fig. 7(a). The LEAC factor can be calculated from Eq.(11) and the corrected atmospheric transmittance can be calculated from Eq.(13), shown by the orange line in Fig.7(a).

    In order to achieve NLAC, multiple sets of experiments are carried out at the distance of 10 to 100 m with an interval of 10 m, which adopt the NRsrM. The measured atmospheric transmittance and path radiation at each distance can be calculated from Eq.(8) and (9), shown by the blue line in Fig.7. Interpolation method is used to process 10 sets of measured data into 19 sets, which are distributed between 10 m and 100 m with the interval of 5 m. The database contained theoretical data at corresponding distances obtained from MODTRAN4.0 as an input layer and 19 sets of measured data as an output layer are used to train the network with the use of the constructed neural network in Fig.4. The network output value of the atmospheric transmittance and path radiation at each distance after training are shown by the red line in Fig.7.

    3.3 Radiometry of an infrared target

    In order to verify the improvement of infrared radiation measurement accuracy, images of the blackbody as an infrared target are collected at the distance of 130 m as shown in Fig.8. The theoretical atmospheric transmittance and path radiation obtained from MODTRAN4.0 are 0.918 8 and 0.812 1 ${\rm{W}} \cdot {{\rm{m}}^{ - 2}} \cdot {\rm{s{r^{ - 1}}}}$, respectively. The corrected atmospheric transmittance calculated by the LAC factor and LEAC factor are 0.868 1 and 0.832 2, respectively. The atmospheric transmittance and the path radiation predicted by NLAC of the constructed neural network are 0.694 7 and 3.917 2 ${\rm{W}} \cdot {{\rm{m}}^{ - 2}} \cdot {\rm{s{r^{ - 1}}}}$, respectively. The temperatures of the target are from 40 ℃ to 80 ℃ with the interval of 10 ℃. The inversion results of radiation measurements calculated from Eq.(5) at different temperatures are shown in Fig.9.

    Infrared target image at the distance of 130 m

    Figure 8.Infrared target image at the distance of 130 m

    Radiometric result. (a) Inversion of radiation brightness result with the use of different methods; (b) Radiometric error with the use of different methods

    Figure 9.Radiometric result. (a) Inversion of radiation brightness result with the use of different methods; (b) Radiometric error with the use of different methods

    As can be seen from the error curve, the errors of LAC and LEAC are smaller than MODTRAN, and the error trend is the same. The reason for this result is that they only make a simple linear correction for atmospheric transmittance. NLAC method modifies atmospheric transmittance and path radiation by near-rang measurement. Its error is relatively stable and the error size is mainly determined by the neural network algorithm. At 40 ℃, the error of LEAC is less than NLAC. The reason is that the relative error of 40 ℃ is less affected by the uncorrected path radiation, and it would be better just to correct the transmittance. NLAC method introduces the error of the path radiation correction. When the temperature is higher than 40 ℃, the influence of uncorrected path radiation gradually increases and the advantages of NLAC method are reflected. The maximum error and the average error of MODTRAN4.0, LAC, LEAC and NLAC are all listed in Tab. 1. The method of NLAC shows both lowest maximum error and average error. In summary, the method proposed in this paper, yielding high accuracy of radiometry, is valid for the infrared measurement system.

    ErrorMODTRAN4.0LACLEACNLAC
    Maximum error19.32%14.61%10.92%6.87%
    Average error16.17%11.27%7.44%6.45%

    Table 1. Radiometric error of different methods

    4 Conclusions

    This paper presents a method to improve the infrared radiometric accuracy based on atmospheric correction. Compared with the conventional radiometric method, near-range atmospheric transmittance and path radiation can be calculated simultaneously by NRsrM. Using NLAC of neural network technology, long-range atmospheric transmittance and path radiation are relatively accurately predicted through the nonlinear relationship between theoretical data obtained from MODTRAN4.0 and actual data calculated by NRsrM. Therefore, atmospheric correction is achieved to improve the infrared radiometric accuracy. Preliminary experiments have shown that the infrared radiometric average errors of the conventional method, LAC, LEAC and the proposed NLAC method are 16.17%, 11.27%, 7.44% and 6.45%, respectively. The infrared radiometric accuracy of LAC (or LEAC) method is improved compared with the conventional software calculation method. And it requires only a set of near-range measurement parameters by NRsrM, which is simple and easy to be obtained. Through NLAC of neural network, multiple sets of actual measurement results are needed. The process of atmosphere correction is more complicated before the target measurement, but the infrared radiometric accuracy can be further improved.

    References

    [1] L-H Cai, F-Y He, S-T Chang. A wide dynamic range NUC algorithm for IRCS systems. Journal of the Korean Physical Society, 73, 1821-1826(2018).

    [2] X Xue, C Liu, J Qiao. The research about radiometric technology of two-dimensional rotary table based on image gray level. EURASIP Journal on Image and Video Processing, 2019(2019).

    [3] Y Ata, K C Nakiboğlu. IR signature estimation of an object or a target by taking into account atmospheric effects. Optics Communications, 283, 3901-3910(2010).

    [4] L H Cai, Z Li, Y Yu. Direct atmospheric correction for high precision radiometry on infrared small target. Infrared and Laser Engineering, 47, S104002(2018).

    [5] H L Wei, X H Chen, R Z Rao. A moderate-spectral-resolution transmittance model based on fitting the line-by-line calculation. Optics Express, 15, 8360(2007).

    [6] Z Huang, L Yin, J Wang. Atmospheric attenuation correction based on a constant reference for high-precision infrared radiometry. Applied Sciences, 7, 1165(2017).

    [7] B Tardy, V Rivalland, M Huc. A software tool for atmospheric correction and surface temperature estimation of landsat infrared thermal data. Remote Sensing, 8, 696(2016).

    [8] J Dumoulin, V Boucher. Infrared thermography system for transport infrastructures survey with inline local atmospheric parameter measurements and offline model for radiation attenuation evaluations. Journal of Applied Remote Sensing, 8, 084978(2014).

    [9] M D Mermelstein, K A Snail, R G Priest. Spectral and radiometric calibration of midwave and longwave infrared cameras. Optical Engineering, 39, 574-579(2000).

    [10] S Chang, Y Zhang, Z Sun. Method to remove the effect of ambient temperature on radiometric calibration. Appl Opt, 53, 6274-6279(2014).

    [11] erson G P, Berk A, Aya P K, et al. MODTRAN4: multiple scattering bidirectional reflectance distribution function (BRDF) upgrades to MODTRAN [C]SPIE, 2000, 4049:176–183.

    [12] L H Guo, H Z Guo, C Y Yang. Improvement of radiation measurement precision for target by using atmosphere corrected coefficients. Optics and Precision Engineering, 24, 1871-1877(2016).

    [13] C Cathy, H L Juliette, P Sébastien. Retrieval of CO from nadir remote-sensing measurements in the infrared by use of four different inversion algorithms. Appl Opt, 41, 7068-7078(2002).

    Yang Guoqing, Li Zhou, Zhao Chen, Yu Yi, Qiao Yanfeng, He Fengyun. Nonlinear atmospheric correction based on neural network for infrared target radiometry[J]. Infrared and Laser Engineering, 2020, 49(5): 20190413
    Download Citation