• Journal of Infrared and Millimeter Waves
  • Vol. 43, Issue 3, 421 (2024)
Xiang-Bo JIN1、2 and Yue-Ming WANG1、2、*
Author Affiliations
  • 1Key Laboratory of Space Active Opto-Electronics Technology,Shanghai Institute of Technical Physics,Chinese Academy of Sciences,Shanghai 200083,China
  • 2University of Chinese Academy of Sciences,Beijing 100049,China
  • show less
    DOI: 10.11972/j.issn.1001-9014.2024.03.017 Cite this Article
    Xiang-Bo JIN, Yue-Ming WANG. Pixel gradient-based adaptive iterative median filter for image impulse noise removal[J]. Journal of Infrared and Millimeter Waves, 2024, 43(3): 421 Copy Citation Text show less

    Abstract

    Image impulse noise removal is essential for obtaining high-quality images. A novel pixel gradients-based adaptive iterative median filter is proposed to remove image impulse noise by utilizing the principles of thermal infrared camera imaging. Firstly, the maximum pixel gradient of the original image is computed based on the camera's modulation transfer function (MTF), and a corresponding set of pixel gradients is established. Subsequently, the gradient weight root-mean-square error (GWRMSE) set of the original image and the corresponding pixel gradient filtered image is computed, and the optimal pixel gradient is determined as the one corresponding to the maximum value of Gaussian distribution of the GWRMSE set. Finally, the adaptive window size and number of iterations for the proposed filter are determined according to the density and complexity of the impulse noise in the image. Extensive experimental results demonstrate that the proposed filter exhibits excellent robustness in removing 8-bit and 16-bit single-channel impulse noise images. In comparison with other state-of-the-art methods, the proposed method can remove low-density random-valued impulse noise (RVIN) and salt-and-pepper noise (SAPN) in real thermal infrared camera-acquired images in real-time while preserving more than 99.5% of original pixels during the noise removal process. Additionally, for high-density SAPN removal, the proposed method achieves competitive results, demonstrating better peak signal-to-noise ratio (PSNR) and structural similarity index (SSIM) in comparison with filtering methods of faster running time and faster execution time in comparison with denoising methods of superior PSNR and SSIM. Moreover, it can recover meaningful image details even for images severely damaged by extreme SAPN (99%).

    Introduction

    Image impulse noise removal is a crucial preprocessing step for obtaining high-quality images in various digital image processing applications,including aerospace,biomedical engineering,industrial inspection,and robot vision. Impulse noise contamination can occur during acquisition,transmission,and recording due to different factors such as detector and circuit systems,channel transmission errors,non-ideal media between the scene and the imaging system,and memory location errors in the hardware components1. Impulse noise affects only some of the pixels of an image while leaving others unaffected. Two major impulse noise models,namely the Salt-and-Pepper Noise (SAPN) model,where the noise pixels assume only the highest and lowest values of the digital number (DN) in the dynamic range of the image,and the Random-Valued Impulse Noise (RVIN) model,where the noise pixels can assume value in the dynamic range of the image with equal probability,have been described in the literature 2.

    The median filter (MF) 3 has gained wide application due to its simple structure,fast execution time,and ability to preserve edge information. However,a limitation of the MF is its poor noise removal performance since it replaces the DN value of each pixel with the median found within a specific window. Therefore,various variants of the MF have been developed,such as the weighted median filter (WMF)4,center-weighted median filter (CWMF) 5,adaptive median filter (AMF) 6,adaptive switching median filter (ASMF) 7-9,progressive switching median filter (PSMF) 10,adaptive dual-threshold median filter (ADTMF) 11,directional difference-based switching median filter (DD-SMF) 12,decision-based filters 13,spatially varying median filter (SVMF) 14,and three-state median filter (TSMF) 15. These methods improve the MF's ability to remove high-density impulse noise by detecting noisy pixels within the window. Furthermore,some enhanced versions,such as the effectively improved boundary discriminative noise detection filter (IBDNDF) 16,the switching adaptive median and fixed weighted mean filter17,the unsymmetric trimmed adaptive median filter (UTAMF) 18,and the median-type noise detectors and the detail-preserving regularization method19,also exhibit better performance and can successfully recover meaningful image details even from images damaged by 90% SAPN.

    Of course,researchers have also contributed excellent image-denoising strategies from other theoretical aspects. Chen20 proposed a weighted coupled sparse representation model with classified regularization to remove impulse noise in images by dividing image pixels into clear,slightly damaged,and severely damaged pixels. The low-rank Hankel matrix based on the annihilating filter is a compelling image restoration method. Jin21 extended this idea and proposed a sparse and low-rank decomposition of a Hankel-structured matrix for impulse noise removal. In Ref. [22],the authors presented an adaptive detail-preserving filter based on a cloud model that can remove up to 95% of SAPN while preserving good image details. Fuzzy theory is often used to solve uncertainty problems and has profound implications for image denoising. For example,the adaptive network-based fuzzy inference system filter and the regression-based neuro-fuzzy network trained by the ABC algorithm can eliminate impulse noise 23-24. Besides,Ahmed1 proposed an iterative adaptive fuzzy filter using alpha-trimmed mean that can retrieve meaningful details even at up to 97% SAPN. Singh25 achieved excellent results on standard test images with 20% to 99% SAPN damage using their proposed adaptive type-2 fuzzy filter.

    In recent years,deep learning has been widely applied to image denoising,particularly for Gaussian noise,Gaussian additive white noise,and Gaussian-impulse mixture noise 26-30. However,only a few deep-learning models have been used for impulse noise removal. Notable examples include the denoising framework based on deep convolutional neural network (CNN) for suppressing impulse noise in color images 31,the efficient CNN with particle swarm optimization (PSO) model for high-density impulse noise removal 32,the CNN-based image restoration method for impulse noise removal 33,and the switching filtering technique using deep learning for impulse noise removal 34. They accomplish image denoising through two main processes: 1) utilizing neural networks to detect impulse noise in the image and 2) inputting the detection results into the denoising module to reconstruct the denoised image.

    Although various variants of median filters,fuzzy filters,and image denoising and restoration models based on deep learning have been developed by previous researchers,only some have explored image noise removal strategies from the fundamental level of digital camera imaging principles. Digital cameras are complex products that integrate optics,mechanical structures,and electronics. During imaging,the image sensor (CCD or CMOS) converts light signals into discrete electronic signals,which are further converted into digital signals. The number of pixels on the image sensor is represented as a matrix of rows and columns,where the numerical signal in each cell corresponds to the DN value in the digital image. Due to design errors in optical devices,the resolution of the image sensor,the wave-particle duality of light,and the complexity of the observed area,neighboring pixels exhibit subtle differences,which can be understood as pixel gradients between adjacent pixels. Therefore,by exploring the camera imaging model,we propose an adaptive iterative median filter based on pixel gradients,summarized as follows.

    1) The modulation transfer function (MTF),as a performance indicator of the camera,can calculate the maximum pixel gradient of the captured image and establish a pixel gradient set. Subsequently,the gradient weight root-mean-square error (GWRMSE) set of the original image and the corresponding pixel gradient filtered image is computed. The Gaussian distribution of the GWRMSE set is calculated using a Gaussian function. Finally,the pixel gradient corresponding to the Gaussian distribution's maximum value is considered the optimal pixel gradient for removing the impulse noise in the image.

    2) Our proposed filter consists of two types of median filters. The first type includes two orthogonal judgment-based median filters with window sizes 3×3,combined with the optimal pixel gradient for real-time removal of the image's discrete,low-density RVIN and SAPN. The second type is an adaptive window size median filter combined with the optimal pixel gradient and SAPN attribute set for removing high-density SAPN.

    3) The adaptive window size and number of iterations are determined based on the density and complexity of the impulse noise in the image,and the proposed filter is used to achieve noise removal.

    1 Methods

    Digital images are represented using a two-dimensional array,where the rows and columns determine the position of each pixel in the image. The DN value of a pixel represents the grayscale value with statistical spatial characteristics. During the imaging process,the camera discretizes the shape of objects into points,lines,and surfaces. Uniformly distributed objects in the scene should have the same DN value for all pixels in the image. However,due to limitations imposed by the camera's optical system and image sensor materials and design techniques,each pixel only represents the statistical properties of the corresponding region. In other words,the DN values of pixels representing the same object can vary,as shown in Fig. 1. Therefore,we propose using pixel gradients to describe the fluctuation range in non-uniform DN values.

    Distribution of pixel DN values in a uniform region and an edge region on the image.

    Figure 1.Distribution of pixel DN values in a uniform region and an edge region on the image.

    1.1 Modulation Transfer Function (MTF)

    The MTF35 provides an intuitive description of the transfer process of light information through optical media and devices. It comprehensively and objectively characterizes the sharpness of images. The corresponding formula is as follows:

    MTF(ωx,ωy)=H(ωx,ωy)=I(ωx,ωy)O(ωx,ωy),

    where I(ωx,ωy) and O(ωx,ωy) are the spatial spectrum of the image and object,respectively. H(ωx,ωy) is the Fourier transform of the point spread function,called the optical transfer function. ωx and ωy are 2D spatial frequencies expressed in terms of circular frequencies.

    The light distribution of an optical image can be regarded as a combination of countless spatial frequency sinusoidal wave distributions. Specific frequency sinusoidal grating stripes define the modulation depth of the sinusoidal distribution,and testing requires projection brightness with a sinusoidal variation as the target. However,this poses a significant challenge for production. To facilitate laboratory MTF testing,a square wave target corresponding to the limiting spatial frequencies is commonly used36,as shown in Fig. 2(a).

    (a) The square wave target;(b) MTF calibration of mid-wave infrared camera using a square wave target.:(a) (b)

    Figure 2.(a) The square wave target;(b) MTF calibration of mid-wave infrared camera using a square wave target.:(a) (b)

    When a mid-wave infrared imaging system captures an image of a square wave target,the system outputs the peak intensity Imax corresponding to the transparent slits and the valley intensity Imin corresponding to the target surface patterns,as shown in Fig. 2(b). In this way,the Contrast Transfer Function (CTF) can be represented as the ratio between the amplitude of signal fluctuations and the average signal level,as follows:

    CTF=Imax-IminImax+Imin,

    Since the square wave signal can be expanded into a Fourier series of its fundamental frequency and its multiples of AC signals,the CTF can also be expressed as the sum of the MTF of the fundamental frequency and its multiples of the square wave signal as the following:

    CTF=4πMTF-MTF3+MTF5-MTF7+,

    When the frequency of the square wave signal exceeds 1/3 the cut-off frequency,the higher order terms MTF can be ignored. CTF is redefined as:

    CTF=4πMTF,

    1.2 Optimal pixel gradient

    Once the optical calibration of the imaging system is completed in the laboratory,the optimal MTF value of the camera is determined. This allows for the calculation of the maximum gradient gmax between adjacent pixels,as mentioned below:

    gmax=Imax-Imin=4π(Imax+Imin)×MTF,

    In practical scenarios,due to losses during light propagation,the relative brightness values of the highlights in the image are lower than those of the scene. Conversely,due to the effects of stray light,scattering,and diffraction,the relative brightness values of the shadows in the image are higher than those of the scene. However,for an ideal optical system without aberrations,stray light,scattering,reflection,or absorption,the described situation would not occur. Nonetheless,they all satisfy the following equation:

    (Imax+Imin)Imaxdr-Imindr,

    where Imaxdr denotes the maximum value of the dynamic range of the image acquired by the camera in the corresponding spectral range. Similarly,Imindr represents the minimum value of the dynamic range of the image captured by the camera in the corresponding spectral range.

    By utilizing the optimal MTF value of the camera,we can calculate the maximum gradient gmax between adjacent pixels. This allows for the representation of the pixel gradient set of the camera's captured image G,as mentioned below:

    G=gk1gkgmax,gkN,

    where gk is the k-th pixel gradient of the set G.

    In addition to the factors influencing the brightness values of the image mentioned earlier,the optical system is also affected by the presence of objects and background in the imaging area. Each pixel captures the DN value corresponding to the imaged area. Specifically,when the pixel's imaged area corresponds to an object's surface,the DN value represents the light information from the object,and the optical system solely influences the gradient between adjacent pixels. However,when the pixel's imaged area falls on the edge of an object,the DN value represents both the light information from the object and the background. The optical system and the background brightness values influence the gradient between adjacent pixels. Therefore,it is necessary to determine an optimal pixel gradient for a specific optical imaging system.

    Firstly,based on the proposed filter,we calculated the root-mean-square error rk between the pixel gradient gk corresponding to the filtered image Ik and the original image Io,as shown below:

    rk(Ik)=i=1Mj=1N(Io(i,j)-Ik(i,j))2M×N,

    where M×N is the image size.

    To ensure a more precise assessment of the optimal pixel gradient based on the computed rk(Ik) for different pixel gradients gk,we have conducted further calculations of rk(Ik) within a unit pixel gradient,as follows:

    hk(rk,gk)=rk(Ik)gk,

    where hk(rk,gk) denotes the GWRMSE of rk(Ik) with respect to the pixel gradient gk.

    In this manner,we can represent the pixel gradients set G corresponding to the GWRMSE set H as follows:

    H=((rk,gk),hk(rk,gk)),rkgkG,

    Subsequently,we have employed a Gaussian function to establish a Gaussian distribution model A for the GWRMSE set H,which can be expressed as:

    fk(hk)=e-hk-μ2σ2,
    μ=k=1nhkn,
    σ=k=1n(hk-μ)n,
    A=(hk,fk(hk)),hkH,

    where fk is the Gaussian function corresponding to the GWRMSE hk. μ denotes the mean value of the set H. σ denotes the standard deviation of the set H. n denotes the full number of elements of the setH.

    Finally,we designate the maximum element in set A to correspond to the hk element in set H,which in turn corresponds to the gk element in the set G,as the optimal pixel gradient gopt for image filtering,as follows:

    gopt=gkmax(A)hkgk,hkH,gkG,

    1.3 Theory of the proposed filter

    Based on the calculated optimal pixel gradient,we can determine the optimal fluctuation range among neighboring pixels in the original image,including the surface and edge of the feature. In other words,when the pixel gradient between the central pixel and its neighboring pixels is less than the optimal pixel gradient,we consider the central pixel to be not impulse noise; otherwise,it is classified as impulse noise.

    The proposed filter utilizes two types of MFs. The first type is primarily employed for real-time removal of dispersed,low-density RVIN and SAPN,employing two orthogonal-based MFs,F1 and F2,with window sizes of 3×3,as depicted in Fig. 3. F1 considers the pixels above,below,left,and right of the center pixel as neighbors to form the orthogonal setup. Similarly,F2uses the pixels in the top-left,bottom-left,top-right,and bottom-right positions as neighbors to establish the orthogonal configuration. By establishing these two orthogonal relationships,we can determine if the center pixel satisfies the range defined by the optimal pixel gradient,allowing for rapid identification of whether the center pixel corresponds to impulse noise.

    (a) Orthogonal-based MF F1; (b) (a) Orthogonal-based MF F2

    Figure 3.(a) Orthogonal-based MF F1; (b) (a) Orthogonal-based MF F2

    The decision formula for the center pixel,neighboring pixels,and optimal pixel gradient associated with F1 is expressed as follows:

    Δg111=pi,j-pi-1,j-goptΔg121=pi,j-pi+1,j-goptΔg131=pi,j-pi,j-1-goptΔg141=pi,j-pi,j+1-gopt,
    Δg211=pi-1,j-pi,j-goptΔg221=pi+1,j-pi,j-goptΔg231=pi,j-1-pi,j-goptΔg241=pi,j+1-pi,j-gopt,

    where Δg111Δg121Δg131Δg141Δg211Δg221Δg231,and Δg241 are the differences between the gradient of the central pixel pi,j and the adjacent pixels pi-1,jpi+1,jpi,j-1 or pi,j+1 minus the optimal pixel gradient gopt.

    The decision formula for the center pixel,neighboring pixels,and optimal pixel gradient associated with F2 is expressed as follows:

    Δg112=pi,j-pi-1,j-1-goptΔg122=pi,j-pi+1,j-1-goptΔg132=pi,j-pi-1,j+1-goptΔg142=pi,j-pi+1,j-1-gopt,
    Δg212=pi-1,j-1-pi,j-goptΔg222=pi+1,j-1-pi,j-goptΔg232=pi-1,j+1-pi,j-goptΔg242=pi+1,j-1-pi,j-gopt,

    where Δg112Δg122Δg132Δg142Δg212Δg222Δg232,and Δg242 are the differences between the gradient of the central pixel pi,j and the adjacent pixels pi-1,j-1pi+1,j-1pi+1,j-1 or pi+1,j+1 minus the optimal pixel gradient gopt.

    When Δg1110Δg1210Δg1310,and Δg1410,or Δg2110Δg2210Δg2310,and Δg2410,or Δg1120Δg1220Δg1320,and Δg1420,or Δg2120Δg2220Δg2320,and Δg2420,the central pixelpi,j is classified as impulse noise. Subsequently,we need to establish a 3×3 window centered at pi,j,where all the pixels within the window are utilized to restore the central pixel pi,j quickly. The corresponding set of pixel intensities Wi,j,as follows:

    Wi,j=pi+k,j+l-1k,l1,k,lZ,,

    Finally,we use the median value vi,j of the set Wi,j instead of the center noise pixel pi,j,as follows:

    vi,j=median(Wi,j),

    where median denotes the median model for computing the set Wi,j.

    The second type of MF is primarily designed to remove high-density SAPN. It is an adaptive median filter F3,which employs a variable window size,as illustrated in Fig. 4. The adaptive window size of F3 is established around the central pixel pi,j as a (2T+1)×(2T+1) neighborhood,where the selection of the window size T depends on the SAPN density. The set of pixel intensities within the window is represented as Wi,jT,and it is expressed as follows:

    Wi,jT=pi+k,j+l-Tk,lT,k,l,TN,

    MF F3 with an adaptive window size,left window size T=1,next window size T=2

    Figure 4.MF F3 with an adaptive window size,left window size T=1,next window size T=2

    Then,the median value vi,jT of Wi,jT can be computed,and the SAPN within Wi,jT can be effectively removed to form a new set WneT,as described in the following:

    vi,jT=median(Wi,jT),
    WneT=Wi,jTSWi,jTP,

    where S denotes the salt noise set S=Imaxdr,ImaxdrN. P denotes the pepper noise set P=Imindr,ImindrN.

    Subsequently,we can establish a weight set C to determine whether the center pixel pi,j is a noisy pixel based on the median value vi,jT and the optimal pixel gradient gopt,as shown below:

    C=cvi,jT-gopt<c<vi,jT+gopt,cR,

    where c denotes the element in the weight set C. When vi,jT-gopt<Imindrvi,jT-gopt=Imindr. When vi,jT+gopt>Imaxdrvi,jT+gopt=Imaxdr.

    Finally,we decide whether the center pixel pi,j is a noisy pixel. If pi,jC or WneT=,then pi,j is considered non-noisy. Otherwise,pi,j is a noisy pixel. We utilize the median value vneT from the set WneT to restorepi,j,as illustrated below:

    vneT=median(WneT),

    By proposing the pixel gradient-based adaptive median filter,we can effectively remove dispersed,low-density RVIN and SAPN in remote sensing images in real time and eliminate high-density SAPN in the image. The entire noise removal process is outlined in Algorithm 1. In general,for impulse noise images captured by the same camera,the pixel gradients for noise removal remain consistent due to the fixed MTF. When applying Algorithm 1 for the first time on an impulse noise image,the proposed filter does not damage the regions unaffected by impulse noise interference. Similarly,successfully removed areas of impulse noise are not compromised during the iterative filtering process until all noise within the image is eliminated. It is important to emphasize that the number of iterations (Iters) and the adaptive window size (T) of Algorithm 1 are determined by the SAPN density (D),as indicated in Table 1.

    ParametersMWIRLWIR
    Spectral range3-5 μm8-12 μm
    Array size640×512320×256
    Focal length120 mm
    Clear aperture52 mm
    Pixel pitch15 μm30 μm
    Field of view (FOV)4.58°×3.67°
    Instantaneous FOV125 μrad250 μrad

    Table 2. Main parameters of the thermal infrared array scanning camera

    Algorithm 1 Pixel gradient-based adaptive iterative MF

    算法1 基于像素梯度的自适应迭代中值滤波器

    Input: Impulse noise image Io,optimal pixel gradient gopt,adaptive window size T,impulse noise density D.

    Output: Filtered image Ib.

    1. For all pixels pi,j in Iodo

    2.  Calculate Δg111Δg121Δg131Δg141,according to Ep. (16).

    3.  IfΔg1110andΔg1210andΔg1310andΔg1410

    4.   Calculate vi,j according to Eps. (20) - (21). pi,jb=vi,j.

    5.  Calculate Δg211Δg221Δg231Δg241,according to Ep. (17).

    6.  ElseifΔg2110andΔg2210andΔg2310andΔg2410

    7.     Calculate vi,j according to Eps. (20) - (21). pi,jb=vi,j.

    8.  Calculate Δg112Δg122Δg132Δg142,according to Ep. (18).

    9.  ElseifΔg1120andΔg1220andΔg1320andΔg1420

    10.    Calculate vi,j according to Eps. (20) - (21). pi,jb=vi,j.

    11. Calculate Δg212Δg222Δg232Δg242,according to Ep. (19).

    12. ElseifΔg2120andΔg2220andΔg2320andΔg2420

    13.    Calculate vi,j according to Eps. (20) - (21). pi,jb=vi,j.

    14. Else

    15.   If D1%

    16.   pi,jb=pi,j

    17.   Else

    18.   Calculate Wi,jTvi,jTWneTCvneT according to

           Eps. (22) - (26).

    19.     Ifpi,jC

    20.      pi,jb=pi,j

    21.     ElseifWneT=

    22.        pi,jb=vi,jT

    23.     Else

    24.       pi,jb=vneT.

    25.     End if

    26.    End if

    27.  End if

    28. End for

    29. All pixels pi,jb in Ib.

    Table 0.

    2 Results and Discussions

    In this section,we use mid-wave infrared (MWIR) images,long-wave infrared (LWIR) images captured by real cameras,and open-access available datasets to validate the effectiveness of the proposed filters and compare them with state-of-the-art impulse noise filters. All experiments are conducted on an Intel Core i7-10700F 2.9 GHz processor with 16 GB RAM and NVIDIA GeForce GTX 1 660 Ti,running MATLAB 2019a.

    2.1 Optimal pixel gradients of camera

    To validate the optimal pixel gradient gopt computation model,we utilized 100 640×512,16-bit MWIR raw images and 100 320×256,16-bit LWIR raw images acquired by a thermal infrared array scanning camera,and the noise distribution models corresponding to the partial MWIR and LWIR raw images are shown in Fig. 5. The optical system of the thermal infrared array scanning camera is shown in Fig. 6,with corresponding parameters listed in Table 2. After laboratory optical calibration of the MWIR camera,the average MTF was measured to be 0.281 0 (the mean MTF value for the eight directions and centers of the image sensor). We are considering the maximum dynamic range of the MWIR camera as Imaxdr=11 000 and the minimum dynamic range as Imindr=8 000; the maximum pixel gradient achievable by this camera is gmax=1 073. Consequently,the pixel gradient set G=1gk1 073is established. Subsequently,utilizing the proposed method,we compute the GWRMSE set H and the corresponding Gaussian distribution set A. By analyzing the distribution curves of the GWRMSE function hk(rk,gk) and the Gaussian function fk(hk) with respect to the pixel gradient gk,we determined that the optimal pixel gradient gopt for a single MWIR raw image is 142,as depicted in Fig. 7.

    (a) Impulse noise distribution of selected test images from 100 MWIR raw images; (b) Impulse noise distribution of selected test images from 100 LWIR raw images. The first column is the original images. The second column is the original image's pixel values distribution models. The third column is the second column's localized pixel value distribution models

    Figure 5.(a) Impulse noise distribution of selected test images from 100 MWIR raw images; (b) Impulse noise distribution of selected test images from 100 LWIR raw images. The first column is the original images. The second column is the original image's pixel values distribution models. The third column is the second column's localized pixel value distribution models

    The internal framework of the thermal infrared array scanning camera

    Figure 6.The internal framework of the thermal infrared array scanning camera

    ImagesMethods
    MFBdCNNHONTV-OGS -OGSTVDTNDCNNALOHAProposed
    MWIR67.643484.524882.050978.674261.52557.23194.39210.2449
    LWIR73.323686.445583.694380.691663.75868.84443.07360.2284

    Table 3. Comparison of the mean ratio (%) of inconsistent pixels for 100 MWIR raw images and the corresponding denoised images by different state-of-the-art methods.

    Distribution curves of pixel gradient gk corresponding to gradient weight RMSE hk(rk,gk) and Gaussian function fk(hk) for a single MWIR raw image,and the computed optimal pixel gradient gopt

    Figure 7.Distribution curves of pixel gradient gk corresponding to gradient weight RMSE hk(rk,gk) and Gaussian function fk(hk) for a single MWIR raw image,and the computed optimal pixel gradient gopt

    To validate the optimal pixel gradient gopt computation model,we utilized 100 640×512,16-bit MWIR raw images and 100 320×256,16-bit LWIR raw images acquired by a thermal infrared array scanning camera,as shown in Fig. 5. The optical system of the thermal infrared array scanning camera is shown in Fig. 6,with corresponding parameters listed in Table 2. After laboratory optical calibration of the MWIR camera,the average MTF was measured to be 0.2810 (the mean MTF value for the eight directions and centers of the image sensor). We are considering the maximum dynamic range of the MWIR camera as Imaxdr=11 000 and the minimum dynamic range as Imindr=8 000; the maximum pixel gradient achievable by this camera is gmax=1 073. Consequently,the pixel gradient set G=1gk1 073 is established.

    Subsequently,utilizing the proposed method,we compute the GWRMSE set H and the corresponding Gaussian distribution set A. By analyzing the distribution curves of the GWRMSE function hk(rk,gk) and the Gaussian function fk(hk) with respect to the pixel gradient gk,we determined that the optimal pixel gradient gopt for a single MWIR raw image is 142,as depicted in Fig. 7.

    Since the MTF of an optical imaging system remains constant,we assert that the optimal pixel gradient for the MWIR camera is also fixed. We analyzed the optimal pixel gradients of 100 MWIR raw images to substantiate this claim. As depicted in Fig. 8(a),all tested images exhibited an optimal pixel gradient of 142. This further validates that our proposed method can consistently compute the optimal pixel gradient for impulse noise removal in the raw images based on the MTF calibrated of the optical imaging system.

    (a) Optimal pixel gradient gopt of 100 MWIR raw images; (b) running time of 100 MWIR raw images with noise removed; (c) Inconsistent pixels ratio (%) of the 100 MWIR raw images corresponding to the denoised image.:(a) (b) (c)

    Figure 8.(a) Optimal pixel gradient gopt of 100 MWIR raw images; (b) running time of 100 MWIR raw images with noise removed; (c) Inconsistent pixels ratio (%) of the 100 MWIR raw images corresponding to the denoised image.:(a) (b) (c)

    Upon obtaining the optimal pixel gradient for impulse noise removal in the raw images,we applied our proposed filter to remove low-density impulse noise from 100 raw images. The impulse noise density D[0,1],the adaptive window size T=0,and the partial filtering results are illustrated in Fig. 9. Through comparison,and it is evident that the proposed pixel gradient-based filter effectively eliminates impulse noise while preserving and restoring the fine details of the raw images. To provide a quantitative assessment,we conducted statistical analysis on the inconsistent pixels between the original and denoised images. For the 100 test images,the maximum proportion of inconsistent pixels was 0.396 7%,the minimum proportion was 0.221 1%,and the average proportion was 0.244 9%,as shown in Fig. 8(b). This indicates that the proposed filter preserves over 99.5% of the pixels without compromising their integrity during impulse noise removal. The denoised image corresponding to the maximum proportion is depicted in Fig. 9(b),exhibiting complex high-intensity features such as buildings with significant variations among adjacent pixels. The denoised image corresponding to the minimum proportion is illustrated in Fig. 9(d),characterized by homogeneous low-intensity features like farmlands and mountains with minimal fluctuation between neighboring pixels. Throughout the entire noise removal process,the average computation time for all the images was 0.0080s,with a maximum of 0.0170s and a minimum of 0s,as displayed in Fig. 8(c). Therefore,our proposed filter enables real-time impulse noise removal in MWIR images,yielding excellent denoising results.

    (a) and (c) are the MWIR raw images; (b) and (d) are correspondingly noise-removed images.

    Figure 9.(a) and (c) are the MWIR raw images; (b) and (d) are correspondingly noise-removed images.

    Similarly,after laboratory optical calibration of the LWIR camera,the average MTF was measured to be 0.2704. Considering the maximum dynamic range of the LWIR camera as Imaxdr=12000 and the minimum dynamic range as Imindr=9000,the maximum pixel gradient achievable by this camera is gmax=1033. Consequently,the pixel gradient set G=1gk1033is established for the LWIR camera. Therefore,the optimal pixel gradient for the 100 LWIR raw images is 137,as illustrated in Fig. 10(a).

    (a)Optimal pixel gradient gopt of 100 LWIR raw images; (b)running time of 100 LWIR raw images with noise removed; (c)Inconsistent pixels ratio (%) of the 100 LWIR raw images corresponding to the denoised image

    Figure 10.(a)Optimal pixel gradient gopt of 100 LWIR raw images; (b)running time of 100 LWIR raw images with noise removed; (c)Inconsistent pixels ratio (%) of the 100 LWIR raw images corresponding to the denoised image

    The impulse noise density D[0,1] of the LWIR raw images,so the adaptive window size of the proposed filter to be T=0. Through quantitative analysis and visual inspection of the denoised images from the 100 LWIR raw images,the maximum proportion of inconsistent pixels was found to be 0.319 4%,the minimum proportion was 0.215 4%,and the average proportion was 0.228 4%,as shown in Fig. 10(b). This indicates that over 99.5% of the LWIR image pixels remain intact,largely preserving the original pixel while effectively removing the impulse noise in the images,as illustrated in Fig. 11. Specifically,because there is a stripe noise37 in Fig. 11 (a),Fig. 11(b) represents the denoised image corresponding to the maximum proportion. At the same time,Fig. 11(d) depicts the denoised image corresponding to the minimum proportion. Throughout the entire noise removal process,the average computation time for all the images was 0.001 6 s,with a maximum of 0.016 0 s and a minimum of 0s,as displayed in Fig. 10(c). Therefore,the proposed optimal pixel gradient model and filter demonstrate real-time impulse noise removal in LWIR camera-captured images.

    (a) and (c) are the LWIR raw images; (b) and (d) are correspondingly noise-removed images

    Figure 11.(a) and (c) are the LWIR raw images; (b) and (d) are correspondingly noise-removed images

    2.2 Comparison with other state-of-the-art methods through MWIR and LWIR images

    In this section,we compare the proposed method with seven filtering methods,including Median Filter (MF) 3,Blind Denoising Convolutional Neural Network (BdCNN) 38,High-order Nonconvex Total Variation and Overlapping Group Sparsity (HONTV-OGS) fusion method 39𝓁0 Overlapping Group Sparse Total Variation (𝓁0-OGSTV) method40,Distribution Transformation Network (DTN) 41,Deep Convolutional Neural Network (DCNN) 33,and Rank-deficient Hankel Matrix-based Low-rank Approximation (ALOHA) method 21,using the MWIR and LWIR raw images. The denoised results of the MWIR and LWIR raw images are presented in Fig. 12 and 13,respectively. It is evident that all seven advanced filtering methods and our proposed method effectively remove discrete and low-density RVIN from the images while restoring rich image details. Additionally,we computed the average proportion of inconsistent pixels before and after denoising for 100 MWIR and 100 LWIR original images,as shown in Table 3. It is clear that our proposed pixel gradient-based method successfully removes RVIN in the original images while preserving over 99.5% of the original pixels. In contrast,the other methods have caused varying degrees of damage to the original pixels in the images.

    Different state-of-the-art methods for denoising MWIR raw images: (a) raw image; (b) MF; (c) BdCNN; (d) HONTV-OGS; (e) 𝓁0-OGSTV; (f) DTN; (g) DCNN; (h) ALOHA; (i) Proposed

    Figure 12.Different state-of-the-art methods for denoising MWIR raw images: (a) raw image; (b) MF; (c) BdCNN; (d) HONTV-OGS; (e) 𝓁0-OGSTV; (f) DTN; (g) DCNN; (h) ALOHA; (i) Proposed

    Different state-of-the-art methods for denoising LWIR raw images: (a) raw image; (b) MF; (c) BdCNN; (d) HONTV-OGS; (e) 𝓁0-OGSTV; (f) DTN; (g) DCNN; (h) ALOHA; (i) Proposed

    Figure 13.Different state-of-the-art methods for denoising LWIR raw images: (a) raw image; (b) MF; (c) BdCNN; (d) HONTV-OGS; (e) 𝓁0-OGSTV; (f) DTN; (g) DCNN; (h) ALOHA; (i) Proposed

    MethodPSNR (dB)SSIM
    Image
    (a)(b)(c)(d)(e)(f)(a)(b)(c)(d)(e)(f)

    D=20%

    NOISY

    MF

    BdCNN

    HONTV-OGS

    l0-OGSTV

    DTN

    DCNN

    ALOHA

    Proposed

    12.43

    31.18

    38.43

    39.25

    40.72

    42.63

    43.13

    45.23

    39.58

    12.24

    24.68

    30.55

    32.16

    33.53

    32.48

    33.02

    32.43

    31.63

    12.31

    31.38

    33.79

    38.99

    40.53

    40.16

    42.10

    43.61

    38.55

    12.54

    22.33

    29.47

    29.76

    31.08

    29.62

    30.68

    31.44

    28.95

    12.45

    27.92

    35.29

    37.41

    38.91

    38.49

    39.56

    42.70

    35.58

    12.38

    24.21

    33.49

    32.41

    33.69

    34.07

    40.13

    44.95

    30.59

    0.083 2

    0.909 7

    0.965 8

    0.961 4

    0.972 5

    0.988 6

    0.984 0

    0.994 2

    0.984 7

    0.177 3

    0.717 7

    0.927 8

    0.945 1

    0.958 6

    0.961 2

    0.946 8

    0.961 7

    0.951 1

    0.083 9

    0.909 3

    0.938 3

    0.954 0

    0.967 8

    0.980 2

    0.980 2

    0.990 1

    0.981 8

    0.215 4

    0.640 3

    0.931 5

    0.934 9

    0.948 9

    0.952 3

    0.968 8

    0.965 4

    0.938 3

    0.113 9

    0.831 9

    0.945 2

    0.954 3

    0.966 4

    0.975 4

    0.972 1

    0.990 9

    0.968 0

    0.138 7

    0.747 0

    0.956 9

    0.938 8

    0.950 4

    0.969 4

    0.982 1

    0.993 8

    0.955 9

    D=50%

    NOISY

    MF

    BdCNN

    HONTV-OGS

    l0-OGSTV

    DTN

    DCNN

    ALOHA

    Proposed

    8.46

    24.89

    32.71

    34.33

    38.91

    36.36

    36.55

    38.61

    33.58

    8.26

    21.17

    25.51

    27.30

    29.98

    27.70

    28.38

    27.64

    26.45

    8.31

    25.09

    32.03

    35.17

    38.60

    37.93

    35.35

    37.63

    32.38

    8.57

    19.75

    23.32

    24.70

    26.85

    24.95

    26.44

    26.10

    24.03

    8.49

    23.03

    29.50

    32.44

    35.89

    32.72

    34.20

    35.32

    29.86

    8.43

    22.03

    27.70

    26.57

    28.42

    27.67

    33.18

    38.94

    25.75

    0.025 0

    0.807 3

    0.914 8

    0.920 6

    0.967 6

    0.954 6

    0.950 0

    0.975 8

    0.946 2

    0.0549

    0.5171

    0.7551

    0.8201

    0.9130

    0.8751

    0.8978

    0.8781

    0.8422

    0.026 3

    0.832 5

    0.899 4

    0.913 4

    0.959 7

    0.963 6

    0.946 4

    0.962 4

    0.938 5

    0.069 0

    0.432 8

    0.710 9

    0.775 5

    0.882 4

    0.843 5

    0.880 2

    0.876 6

    0.804 7

    0.349

    0.682 6

    0.860 6

    0.886 2

    0.949 6

    0.921 5

    0.923 1

    0.958 1

    0.897 1

    0.044 8

    0.637 1

    0.840 4

    0.801 2

    0.896 3

    0.887 7

    0.958 7

    0.978 0

    0.859 2

    D=80%

    NOISY

    MF

    BdCNN

    HONTV-OGS

    l0-OGSTV

    DTN

    DCNN

    ALOHA

    Proposed

    6.43

    18.75

    22.52

    26.98

    31.96

    30.18

    32.46

    32.44

    28.68

    6.21

    17.20

    19.84

    18.64

    24.90

    23.70

    24.58

    23.89

    22.58

    6.27

    18.07

    22.14

    21.83

    31.56

    29.46

    31.29

    32.26

    27.78

    6.53

    16.72

    18.41

    20.20

    22.41

    21.26

    22.31

    22.08

    20.56

    6.44

    17.67

    20.86

    21.33

    28.63

    27.18

    29.14

    28.82

    25.60

    6.37

    18.53

    20.98

    22.41

    24.88

    23.59

    26.28

    31.57

    22.61

    0.009 3

    0.661 9

    0.661 2

    0.726 0

    0.921 7

    0.870 3

    0.918 7

    0.921 6

    0.864 0

    0.016 9

    0.309 5

    0.414 1

    0.350 0

    0.753 5

    0.674 7

    0.750 4

    0.687 3

    0.646 7

    0.009 6

    0.687 2

    0.679 8

    0.632 1

    0.914 5

    0.866 0

    0.886 7

    0.904 8

    0.851 6

    0.021 0

    0.268 5

    0.339 3

    0.338 2

    0.674 7

    0.600 3

    0.652 1

    0.651 6

    0.553 8

    0.012 3

    0.501 8

    0.567 1

    0.507 4

    0.860 8

    0.796 2

    0.846 2

    0.851 4

    0.762 9

    0.013 8

    0.515 1

    0.549 2

    0.550 8

    0.770 7

    0.716 9

    0.832 9

    0.924 0

    0.707 8

    Table 4. Compared the proposed method with seven state-of-the-art filtering methods by PSNR (dB) and SSIM for D=20%,50%,80%SAPN

    2.3 Comparison of high-density SAPN with state-of-the-art methods

    This section compares the proposed filter with seven advanced impulse noise filtering methods through simulation experiments to evaluate its denoising performance on high-density SAPN. The quality of the denoised images is quantitatively evaluated using the Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index (SSIM). PSNR measures the noise density relative to the original image42. SSIM,which approximates human visual perception,assesses the similarity between the processed and original images42. Generally,higher values of PSNR and SSIM indicate that the quality of the processed image approaches that of the original image. The definitions of PSNR and SSIM are as follows:

    PSNR=10×log10((Imaxdr-Imindr)2MSE)

    where MSE is the mean square error of the original image Io and the processed image Ip.

    SSIM=(2μIoμIp+C1)(2σIoIp+C2)(μIo2+μIp2+C1)(σIo2+σIp2+C2),

    where μIoμIpσIoσIp,and σIoIp are the local means,standard deviations,and cross-covariance for images Ioand Ip,respectively. C1and C2are two constants,C1=0.01(Imaxdr-Imindr)2C2=0.03(Imaxdr-Imindr)2.

    Firstly,we selected six different types of 512x512,8-bit publicly available grayscale test images for SAPN simulation,as shown in Fig. 14. Since the camera's MTF of the simulated images is unknown,use SPAN to destroy the standard test images. Then,according to the characteristics of SAPN,the optimal pixel gradient gopt=255 for all test images and the salt noise set S=255 and pepper noise set P=0. Finally,the proposed method and seven comparative denoising methods are applied to the standard test images for SAPN removal,and the quality of the resulting images is quantitatively evaluated using PSNR and SSIM. Meanwhile,the computational efficiency of all denoising methods is assessed based on their running time under the same conditions.

    Test images: (a) Lena; (b) Bridge; (c) Pepper; (d) Baboon; (e) Boat; (f) Barbara

    Figure 14.Test images: (a) Lena; (b) Bridge; (c) Pepper; (d) Baboon; (e) Boat; (f) Barbara

    Figs. 1516,and 17 present the restoration results of the test images after being contaminated with SAPN for both the comparative and proposed methods. For the 20% SAPN corrupted test image,all the methods can effectively remove the impulse noise from the image and maintain good image details,except for the MF method restored image,which suffers from severe smoothing. For the test images damaged by 50% SAPN,the MF and BdCNN methods recovery results suffer

    Denoised results of Baboon test images: (a) Clean image; (b) noisy image with 20% SAPN; (c) MF; (d) BdCNN; (e) HONTV-OGS; (f) 𝓁0-OGSTV; (g) DTN; (h) DCNN; (i) ALOHA; (j) Proposed

    Figure 15.Denoised results of Baboon test images: (a) Clean image; (b) noisy image with 20% SAPN; (c) MF; (d) BdCNN; (e) HONTV-OGS; (f) 𝓁0-OGSTV; (g) DTN; (h) DCNN; (i) ALOHA; (j) Proposed

    Denoised results of Bridge test images: (a) Clean image; (b) noisy image with 50% SAPN; (c) MF; (d) BdCNN; (e) HONTV-OGS; (f) 𝓁0-OGSTV; (g) DTN; (h) DCNN; (i) ALOHA; (j) Proposed

    Figure 16.Denoised results of Bridge test images: (a) Clean image; (b) noisy image with 50% SAPN; (c) MF; (d) BdCNN; (e) HONTV-OGS; (f) 𝓁0-OGSTV; (g) DTN; (h) DCNN; (i) ALOHA; (j) Proposed

    from severe smoothing. For the test images damaged by 80% SAPN,the restoration results of the MF,BdCNN,and HONTV-OGS methods exhibit severe distortion. In contrast,the other methods produce excellent denoising results,maintaining the integrity of the image content,including our proposed method. However,our method exhibits poor recovery results compared to the other four methods. Although the object's structure in the image is intact,the gradient of the pixels at the object's edges falls off so much that the replacement pixels are easily affected by the neighboring pixels and do not reach the gray value of the original pixels. Moreover,our proposed method can effectively restore meaningful image details even for images severely damaged by extreme SAPN. As demonstrated in Fig. 18,although the image's texture suffers severe damage and smoothing,the edges of the objects in the image are well restored and preserved,and the visual analysis can still distinguish different features.

    Denoised results of Lena test images: (a) Clean image; (b) noisy image with 80% SAPN; (c) MF; (d) BdCNN; (e) HONTV-OGS; (f) 𝓁0-OGSTV; (g) DTN; (h) DCNN; (i) ALOHA; (j) Proposed

    Figure 17.Denoised results of Lena test images: (a) Clean image; (b) noisy image with 80% SAPN; (c) MF; (d) BdCNN; (e) HONTV-OGS; (f) 𝓁0-OGSTV; (g) DTN; (h) DCNN; (i) ALOHA; (j) Proposed

    Denoising results of Boat test images at extreme SAPN: (a) clean image; (b) noisy image with 97% SAPN; (c) recovered image of the proposed method; (d) noisy image with 99% SAPN; (e) recovered image of the proposed method

    Figure 18.Denoising results of Boat test images at extreme SAPN: (a) clean image; (b) noisy image with 97% SAPN; (c) recovered image of the proposed method; (d) noisy image with 99% SAPN; (e) recovered image of the proposed method

    Table 4 presents the PSNR and SSIM of all test images after being corrupted by SAPN and restored using all filtering methods. Correspondingly,Table 5 provides the average running time of all filtering methods for denoising all test images. Through comprehensive analysis,our proposed method demonstrates excellent denoising results compared to the MF,BdCNN,and HONTV-OGS methods.

    D (%)Methods
    MFBdCNNHONTV-OGSl0-OGSTVDTNDCNNALOHAProposed
    20%0.001 10.563 334.121 712.379 16.376 47.842 14 721.424 20.622 7
    50%0.001 10.564 634.442 114.974 56.404 97.839 63 328.851 11.303 9
    80%0.001 10.560 336.056 919.057 66.405 57.830 41 780.774 51.944 0

    Table 5. Compared the proposed method with seven state-of-the-art filtering methods by running time (s) for D=20%,50%,80%SAPN

    Table Infomation Is Not Enable

    Compared to the 𝓁0-OGSTV,DTN,DCNN,and ALOHA methods,although our proposed method does not exhibit superior image restoration,it requires less denoising time. In summary,our proposed denoising method performs well,showing excellent PSNR and SSIM compared to some faster methods. In terms of methods with superior PSNR and SSIM performance,our proposed method demonstrates a speedier computation time. Besides,our proposed method can remove SAPN from 0% to 99%.

    3 Conclusion

    This paper proposes a pixel gradients-based adaptive iterative median filter to remove low-density impulse noise and 0% to 99% SAPN in single-channel images. Firstly,based on the imaging principle of optical cameras,we utilize the camera’s MTF to obtain the maximum pixel gradient of the original image and establish the pixel gradients set of that camera. Next,we calculate the GWRMSE between the original image and the corresponding pixel gradient filtered image. Finally,the optimal pixel gradient is determined as the one corresponding to the maximum value of the Gaussian distribution of the GWRMSE set. By considering the noise density and complexity of the impulse noise,we can determine the adaptive window size of the proposed filter and the required number of iterations to remove the impulse noise in the image. Extensive experimental results demonstrate that the developed filter exhibits robustness in removing 8-bit and 16-bit single-channel impulse noise images,effectively removing low-density RVIN from real thermal infrared camera-acquired images in real-time. Compared to other advanced methods,this approach achieves a preservation rate of 99.5% of the original pixels during denoising. Furthermore,for high-density SAPN in images,our proposed filter obtains competitive results compared to advanced filtering methods,showing better PSNR and SSIM compared to faster filtering methods and faster computation time compared to methods with superior PSNR and SSIM. Additionally,for images severely damaged by extreme SAPN,the proposed method can recover meaningful image details.

    References

    [1] F Ahmed, S Das. Removal of high-density salt-and-pepper noise in images with an iterative adaptive fuzzy filter using alpha-trimmed mean. IEEE Transactions on fuzzy systems, 22, 1352-1358(2013).

    [2] N I Petrovic, V Crnojevic. Universal impulse noise filter based on genetic programming. IEEE Transactions on Image Processing, 17, 1109-1120(2008).

    [3] T Nodes, N Gallagher. Median filters: Some modifications and their properties. IEEE Transactions on Acoustics, Speech, and Signal Processing, 30, 739-746(1982).

    [4] DR Brownrigg. The weighted median filter. Communications of the ACM, 27, 807-818(1984).

    [5] S J Ko, Y H Lee. Center weighted median filters and their applications to image enhancement. IEEE transactions on circuits and systems, 38, 984-993(1991).

    [6] H Hwang, R A Haddad. Adaptive median filters: new algorithms and results. IEEE Transactions on image processing, 4, 499-502(1995).

    [7] A Fabijańska, D Sankowski. Noise adaptive switching median-based filter for impulse noise removal from extremely corrupted images. IET image processing, 5, 472-480(2011).

    [8] S Akkoul, R Ledee, R Leconge, R Harba. A new adaptive switching median filter. IEEE Signal Processing Letters, 17, 587-590(2010).

    [9] H L Eng, K K Ma. Noise adaptive soft-switching median filter. IEEE Transactions on image processing, 10, 242-251(2001).

    [10] Z Wang, D Zhang. Progressive switching median filter for the removal of impulse noise from highly corrupted images. IEEE Transactions on Circuits and Systems II: Analog and Digital Signal Processing, 46, 78-80(1999).

    [11] V Gupta, V Chaurasia, M Shandilya. Random-valued impulse noise removal using adaptive dual threshold median filter. Journal of visual communication and image representation, 26, 296-304(2015).

    [12] Y Hashimoto, Y Kajikawa, Y Nomura. Directional difference-based switching median filters. Electronics and Communications in Japan (Part III: Fundamental Electronic Science), 85, 22-32(2002).

    [13] K S Srinivasan, D Ebenezer. A new fast and efficient decision-based algorithm for removal of high-density impulse noises. IEEE signal processing letters, 14, 189-192(2007).

    [14] T Chen, H R Wu. Space variant median filters for the restoration of impulse noise corrupted images. IEEE transactions on circuits and systems II: analog and digital signal processing, 48, 784-789(2001).

    [15] T Chen, K K Ma, L H Chen. Tri-state median filter for image denoising. IEEE Transactions on Image processing, 8, 1834-1838(1999).

    [16] I F Jafar, R A AlNa'mneh, K A Darabkh. Efficient improvements on the BDND filtering algorithm for the removal of high-density impulse noise. IEEE Transactions on Image Processing, 22, 1223-1232(2012).

    [17] M Mafi, H Rajaei, M Cabrerizo, M Adjouadi. A robust edge detection approach in the presence of high impulse noise intensity through switching adaptive median and fixed weighted mean filtering. IEEE Transactions on Image Processing, 27, 5475-5490(2018).

    [18] S Esakkirajan, T Veerakumar, AN Subramanyam, CH PremChand. Removal of high-density salt and pepper noise through modified decision based unsymmetric trimmed median filter. IEEE Signal processing letters, 18, 287-290(2011).

    [19] R H Chan, C W Ho, M Nikolova. Salt-and-pepper noise removal by median-type noise detectors and detail-preserving regularization. IEEE Transactions on image processing, 14, 1479-1485(2005).

    [20] C L Chen, L Liu, L Chen et al. Weighted couple sparse representation with classified regularization for impulse noise removal. IEEE Transactions on Image Processing, 24, 4014-4026(2015).

    [21] K H Jin, J C Ye. Sparse and low-rank decomposition of a Hankel structured matrix for impulse noise removal. IEEE Transactions on Image Processing, 27, 1448-1461(2017).

    [22] Z Zhou. Cognition and removal of impulse noise with uncertainty. IEEE transactions on image processing, 21, 3157-3167(2012).

    [23] P Civicioglu. Using uncorrupted neighborhoods of the pixels for impulsive noise suppression with ANFIS. IEEE Transactions on Image Processing, 16, 759-773(2007).

    [24] A Caliskan, Z A Cil, H Badem, D Karaboga. Regression-based neuro-fuzzy network trained by ABC algorithm for high-density impulse noise elimination. IEEE Transactions on Fuzzy Systems, 28, 1084-95(2020).

    [25] V Singh, R Dev, N K Dhar, P Agrawal, N K Verma. Adaptive type-2 fuzzy approach for filtering salt and pepper noise in grayscale images. IEEE transactions on fuzzy systems, 26, 3170-3176(2018).

    [26] K Zhang, W Zuo, Y Chen, D Meng, L Zhang. Beyond a gaussian denoiser: Residual learning of deep CNN for image denoising. IEEE transactions on image processing, 26, 3142-3155(2017).

    [27] J Xu, Y Huang, M M Cheng, L Liu, F Zhu, Z Xu, L Shao. Noisy-as-clean: Learning self-supervised denoising from corrupted image. IEEE Transactions on Image Processing, 29, 9316-9329(2020).

    [28] M El Helou, S Süsstrunk. Blind universal Bayesian image denoising with Gaussian noise level learning [9]. IEEE Transactions on Image Processing, 4885-4897(2020).

    [29] D Liu, B Wen, J Jiao, X Liu, Z Wang, T S Huang. Connecting Image Denoising and High-Level Vision Tasks via Deep Learning. IEEE Transactions on Image Processing, 29, 3695-3706(2020).

    [30] C Tian, Y Xu, W Zuo. Image denoising using deep CNN with batch renormalization. Neural Networks, 121, 461-73(2020).

    [31] W Zhang, L Jin, E Song, X Xu. Removal of impulse noise in color images based on convolutional neural network. Applied Soft Computing, 82, 105558(2019).

    [32] H Y Khaw, F C Soon, J H Chuah, C O Chow. High-density impulse noise detection and removal using deep convolutional neural network with particle swarm optimization. IET image processing, 13, 365-374(2019).

    [33] L Jin, W Zhang, G Ma, E Song. Learning deep CNNs for impulse noise removal in images. Journal of Visual Communication and Image Representation, 62, 193-205(2019).

    [34] K Radlak, L Malinski, B Smolka. Deep learning-based switching filter for impulsive noise removal in color images. Sensors, 20, 2782(2020).

    [35] W Zhang, K Aljasem, H Zappe, A Seifert. Highly flexible MTF measurement system for tunable micro lenses. Optics Express, 18, 12458-112469(2010).

    [36] D Cabib, A Rahav, T Barak. Broad-band optical test bench (OPTISHOP) to measure MTF and transmittance of visible and IR optical components. Infrared Imaging Systems: Design, Analysis, Modeling, and Testing XVIII, 6543, 365-372(2007).

    [37] J Jia, Y Wang, X Cheng, L Yuan, D Zhao, Q Ye, X Zhuang, R Shu, J Wang. Destriping algorithms based on statistics and spatial filtering for visible-to-thermal infrared pushbroom hyperspectral imagery. IEEE Transactions on Geoscience and Remote Sensing, 57, 4077-91(2019).

    [38] R Abiko, M Ikehara. Blind denoising of mixed Gaussian-impulse noise by single CNN, 1717-1721(2019).

    [39] T Adam, R Paramesran, Y Mingming, K Ratnavelu. Combined higher order non-convex total variation with overlapping group sparsity for impulse noise removal. Multimedia Tools and Applications, 80, 18503-30(2021).

    [40] M Yin, T Adam, R Paramesran, M F Hassan. An ℓ0-overlapping group sparse total variation for impulse noise image restoration. Signal Processing: Image Communication, 102, 116620(2022).

    [41] G Li, F Zhang, Q Liu. Distribution-Transformed Network for Impulse Noise Removal. Journal of Shanghai Jiaotong University (Science), 26, 543-53(2021).

    [42] Z Wang, A C Bovik, H R Sheikh et al. Image quality assessment: from error visibility to structural similarity. IEEE transactions on image processing, 13, 600-12(2004).

    Xiang-Bo JIN, Yue-Ming WANG. Pixel gradient-based adaptive iterative median filter for image impulse noise removal[J]. Journal of Infrared and Millimeter Waves, 2024, 43(3): 421
    Download Citation