• Acta Photonica Sinica
  • Vol. 50, Issue 3, 22 (2021)
Jie SU1, Aiping ZHAI2, Wenjing ZHAO2, Qing HAN1, and Dong WANG1、2
Author Affiliations
  • 1Key Laboratory of Advanced Transducers and Intelligent Control Systems, Ministry of Education and Shanxi Province, Taiyuan University of Technology, Taiyuan030024, China
  • 2College of Physics and Optoelectronics, Taiyuan University of Technology, Taiyuan03004, China
  • show less
    DOI: 10.3788/gzxb20215003.0311003 Cite this Article
    Jie SU, Aiping ZHAI, Wenjing ZHAO, Qing HAN, Dong WANG. Hadamard Single-pixel Imaging Using Adaptive Oblique Zigzag Sampling[J]. Acta Photonica Sinica, 2021, 50(3): 22 Copy Citation Text show less

    Abstract

    Single-pixel imaging has made significant progress in imaging quality and speed. However, how to improve the imaging speed while ensuring the imaging quality is still a problem to be solved. Based on the finding that the average value of the absolute value of the Hadamard coefficients of each oblique line declines rapidly, an adaptive oblique zigzag sampling method is proposed to achieve the expected imaging speed and quality. Experimental results show that the number of sampling and the amount of data acquisition can be effectively reduced using the proposed method, improving the imaging speed while ensuring the imaging quality. Compared with the single-pixel imaging using sequential sampling, the imaging quality of the proposed method is better under the same sampling rate.

    0 Introduction

    Single-pixel Imaging (SPI), which is different from traditional imaging, has its advantages. For example, in infrared and terahertz imaging, traditional array-based imaging sensors and systems are relatively bulky, complicated, and usually demand additional auxiliary modules which make them expensive. In contrast, SPI provides a better solution in which only a single point detector is needed, and the setup of the system is simple, which significantly reduces the costs. It is developed with the advent of the Compressed Sensing (CS) theory. In 2006, DONOHO D L 1and CANDÈS E J 2 proposed the CS theory. In 2008, DUARTE M F 3 realized the SPI based on CS, which suggested that CS 1-6 had a broad prospect in the field of SPI. In addition to CS, Hadamard Transform (HT) 7-15, Fast Fourier Transform (FFT) 14-21, Wavelet transform 1522 and so on have been used in SPI to reconstruct the object, due to the low hardware requirements, short imaging time, and good imaging performance. Among them, HT has the merits of deterministic orthogonal basis patterns and can produce binary patterns that can be conveniently implemented by a Spatial Light Modulator (SLM) such as a digital Micro-Mirror Device (DMD). Therefore, it is widely utilized in SPI.

    However, with the increase of the imaging resolution, the measurements of SPI increase greatly, thus the imaging speed is limited. To solve this problem, current solutions are mainly to improve the sampling speed of the equipment or optimize the algorithm. At present, the generation of spatially structured light mainly depends on the SLM, but as its performance increases, its costs will increase. Therefore, XU Zihao et al.23 proposed a computational ghost imaging scheme using LED-based high-speed lighting modules, which is a low-cost SPI scheme. However, it is only suitable for short-distance and low-resolution imaging, and its imaging resolution is limited. Reducing samplings through algorithm optimization is a cost-effective way to improve the imaging speed of SPI. The potential solution is to use the sparsity or compressibility of the signal to make a smaller number of measurements i.e. reducing the sampling rate of the SPI.

    Here, based on the collected Hadamard spectrum, it is found that the distribution of the Hadamard spectrum has sparse characteristics, and the average value of the absolute value of the Hadamard coefficients in the oblique line shows a decreasing trend from the upper left to the lower right of the Hadamard spectrum. When it drops to a certain value, its implication on SPI is relatively weak. Taking this fact into consideration, an adaptive oblique zigzag sampling method is proposed and demonstrated to achieve a balance between the expected imaging fidelity and speed. It averages each oblique line of the absolute value of Hadamard coefficients along the oblique zigzag direction from the upper left corner to the lower right corner of the spectrum and compares the results with a threshold set by the user to automatically discard high-frequency signals and noises according to the expected imaging fidelity. Because only when the average values are larger than the set threshold, the Hadamard coefficients are collected, the sampling rate will be adaptively reduced to achieve a balance between imaging speed and the expected imaging fidelity.

    1 Principle

    1.1 SPI based on HT

    Assuming that a digital image is represented as and its resolution is , then its sparse representation in Hadamard domain can be expressed as

    IH(u,v)=H{O(x,y)}=1MNx=0M-1y=0N-1O(x,y)(-1)i=0N-1bi(x)bi(u)+bi(y)bi(v)

    inverse Hadamard transformation of the Hadamard coefficients matrix can be expressed as

    O(x,y)=x=0M-1y=0N-1H{O(x,y)}(-1)i=0N-1bi(x)bi(u)+bi(y)bi(v)

    where are the coordinates in Hadamard domain. is the HT calculation. are the coordinates in spatial domain. is the kth bit of the binary representation of .

    Based on the above-mentioned HT, the orthogonal Hadamard basis patterns can be generated using the inverse HT calculation, which can be set and expressed as

    Θu,v=1u=u0,v=v00otherwise

    The generated Hadamard basis patterns are normalized, and can be expressed as

    ϕH(x,y)=12[1+H-1{Θ(u,v)}]

    where is the inverse HT calculation, , and each pattern corresponds to a unique 'Hadamard-frequency' component.

    To further improve the imaging fidelity, we adopt a differential algorithm9 to suppress noise and improve the system of signal-to-noise. The basis pattern generated by Eq.(4) is projected onto the object, and the reflected light signal is detected. Then, reversing the basic pattern , the reflected light signal is detected. The absolute value of Hadamard coefficients matrix can be obtained by

    S(u,v)=D+1u,v-D-1u,v

    therefore, the object can be reconstructed by calculating the inverse HT of it.

    1.2 Adaptive oblique zigzag sampling

    The proposed method makes full use of the fact that the low frequencies of Hadamard single-pixel imaging are concentrated on the upper left corner as shown in Fig. 1(b) and (c). Fig. 1(a) is the target image to be restored. Fig. 1(b) is the sequential sampling. After carefully investigating the Hadamard spectrum in Fig. 1(c), we found that the average value of the absolute value of the Hadamard coefficients for each oblique line has the characteristic that it decreases rapidly as shown in Fig. 1(d), which inspired us to propose the adaptive oblique zigzag sampling method to achieve a balance between the imaging fidelity and speed.

    Most information on a natural object normally concentrates on the low-frequency components, and the subtle details and noise concentrate on the high-frequency components 14. Therefore, effectively collecting the low-frequency components in the upper left corner and ignoring a few high-frequency components can reduce the sampling rate, and improve the imaging speed of the single-pixel camera.

    As shown in Fig. 1(c), the low-frequency components are concentrated on the upper left corner of the Hadamard spectrum. We found that in the oblique zigzag direction from the upper left to the lower right of the spectrum, the average value of the absolute value of the Hadamard coefficients for each oblique line can be calculated as

    Ci=u+v=i-1|S(u,v)|i

    in which the oblique line , is the absolute value of the Hadamard coefficients. The evolution curve is plotted in Fig. 1(d), which shows that the rapidly decreases with the increase of the oblique line . Therefore, sampling is performed in an oblique zigzag direction from the upper left corner to the lower right corner of the spectrum. A threshold can be set to perform the adaptively sampling according to the desired imaging fidelity. Only when the average values are larger than the set threshold, the Hadamard coefficients are collected, the sampling rate will be adaptively reduced to achieve a balance between imaging speed and the expected imaging fidelity.

    2 Experimental setup

    As shown in Fig. 2, light emitted from an ultra-high-pressure mercury lamp incidents on the DMD coded by the basis of Hadamard patterns, which projects the coded illuminations onto the object. The light reflected from the illuminated object is detected by a photodetector (PD KG-PR-200K-A-FS), which converts the optical signal into an electrical signal. The electrical signal is collected by a digital acquisition card (NI USB-6216) to convert it to be a digital signal for computer processing. Finally, the image of the object can be reconstructed computationally.

    3 Results and discussion

    We adopt the differential algorithm to improve the performance of Hadamard SPI and enhance the anti-interference ability to the system noise. Fig. 3(a) shows the object to be reconstructed. Fig. 3(b) is the image reconstructed without the differential algorithm. Due to the influence of the noise, the edge of the image is blurry. Fig. 3(c) is the reconstructed image after noise reduction by the difference algorithm, thus the contrast of it is better as compared to the reconstruction shown in Fig. 3(b). Besides, the reconstructed image has a better fidelity, which shows that the differential algorithm has a strong anti-interference ability. In the experiments, we adopted the differential algorithm.

    To verify the effectiveness of the proposed oblique zigzag adaptive sampling method, the same object as shown in Fig. 3(a) was reconstructed by using the method in which the threshold was set to be 0, 200, 300, and 400. The corresponding experimental results are given in Fig. 4, in which the horizontal coordinate is the oblique line, and the vertical coordinate calculated by Eq.(6), is the average value of the absolute value of the Hadamard coefficients for each oblique line. Besides, there are two inserts, the left one is a zoom-in of the part indicated by the dashed ellipse and the right one is the reconstructed image of the object with a resolution of 128×128 pixels. As can be seen in Fig.4, the evolution curves decrease with the increase of the oblique line , and there is a sharp decrease within which suggests that the low-frequency components are concentrated within a small area () at the upper left corner of the Hadamard spectrum matrix as predicted and shown in Fig. 1(c). It can be seen from the comparison of the evolution curves shown in Fig. 4(a)~(d) that, for the chosen threshold equals to 0, 200, 300 and 400, the sampling rates are respectively 100%, 46.17%, 36.92% and 22.04%, and the object can be successfully reconstructed, which suggests that, by setting different thresholds according to the expected imaging fidelity, the proposed method can adaptively sample along the oblique zigzag path in Hadamard spectrum domain. Therefore, without the need for CS algorithms, it can efficiently collect the low-frequency components in the upper left corner and ignore a few high-frequency components to adaptively reduce the sampling rate for improving the imaging speed of the single-pixel camera.

    Fig. 5 gives the results reconstructed using the proposed method and the sequential sampling method with the same sampling rates which are respectively 100%, 46.17%, 36.92%,and 22.04%. SSIM and PSNR 14 are used for assessing the reconstructed results in Fig. 5. The corresponding results are presented in Fig. 6(a) and (b). The red triangle and blue square lines respectively correspond to the proposed method and the sequential sampling method. As can be observed in Fig. 5, as the threshold increases from 0, 200, 300 to 400, both PSNR and SSIM parameters show a downward trend. As predicted in Fig. 5(a), when the threshold is 0, the corresponding sampling rate is 100%, and the quality of the reconstructed images is the best. The PSNR is close to positive infinity, and the SSIM is close to 1. As the threshold increases, PSNR and SSIM show a decreasing tendency. Under the same threshold, the red triangle line is always higher than the blue square line. Therefore, under the same sampling rate or threshold, the adaptive oblique zigzag sampling method is better than the sequential sampling method. Besides, the red triangle line decreases more slowly than the blue square line. As the threshold increases, the gap between the PSNR and SSIM parameters of the two sampling methods gradually increases. Therefore, by increasing the threshold (i.e. reducing the sampling rate), the image quality reconstructed by the adaptive zigzag sampling method is better.

    To further investigate the influence of the dark noise of the PD on SPI using the proposed method. We measured the dark noise signals of two different PDs as shown in Fig. 7(a). The tortoise image with the resolution of 128×128 is reconstructed using the two PDs. The results are shown in Fig. 7(b). The smaller the dark noise of the PD, the better the quality of the reconstructed image, which suggests that the much of dark noise of the detection system can not be suppressed using the differential algorithm 14. In this situation, during the experiments, it can be predicted from Fig. 7 that as the dark noise of the detector increases, the imaging quality will gradually deteriorate. When a PD with high dark noise, such as PD1, is used, the high frequencies of the object to be reconstructed will be drowned in the high-frequency noise, which means SPI using the fully sequential or zigzag sampling will not give a satisfactory result, this can be seen in Fig. 8(a) in which more samplings give poorer results due to the high-frequency dark noise. In this case, SPI using the proposed adaptive zigzag sampling is necessary and can automatically get rid of the high-frequency noise by setting an appropriate threshold to get better reconstructions as shown in Fig. 8(b) and (c), at the same time a balance between imaging quality and speed can be achieved. As shown in Fig. 8, the three restored pictures are marked with a red dashed frame in the same place. As the threshold increases, the dark noise gradually decreases.

    A Hadamard SPI using the proposed adaptive oblique zigzag sampling method has been proposed and demonstrated. Hadamard transform is one of the orthogonal transforms, therefore, the proposed method not only can apply to other orthogonal transform based SPIs, but also inherits the advantages of orthogonal transform based SPIs.

    As indicated in Ref.[21], compared with the traditional compressed sensing method, orthogonal transform based SPIs’ advantages are as follows: First, it can reconstruct the object image without distortion. Second, it can also make better use of the sparsity of natural images in the transform domain to reconstruct high-quality object images by only obtaining larger coefficients in the transform domain, while the compressed sensing method reconstructs object images by dealing with coefficients corresponding to the random patterns without distinction. Third, it is only a simple two-dimensional inverse transformation, so the operation time can be ignored. By contrast, a compressed sensing algorithm takes more time to reconstruct the image.

    Besides, our method has the following advantages: First, a threshold can be adaptively set according to the expected imaging fidelity. The method can achieve a balance between imaging speed and the expected imaging fidelity. Second, it can adaptively reduce the sampling rate, thus it can adaptively improve the imaging speed of the SPI significantly. Third, we can further investigate the influence of the dark noise of the PD on SPI. Experimental results show that the proposed adaptive zigzag sampling is capable of automatically reducing the influence of the high-frequency dark noise on the reconstruction quality by setting an appropriate threshold to get better reconstructions.

    4 Conclusion

    We proposed and demonstrated the Hadamard SPI using the proposed adaptive oblique zigzag sampling method. Experimental results show that it can adaptively reduce the sampling rate while meeting the fidelity required by users by setting a threshold. In other words, it can adaptively achieve a balance between imaging quality and speed. When the dark noise of the PD is high, the advantage of the proposed method is highlighted. Since when the dark noise of the imaging system is high and the high-frequencies of the object to be reconstructed are drowned in the noise, SPI using the fully sequential or zigzag sampling will not give a satisfactory result. However, SPI using the proposed method can automatically discard the high-frequency noise by setting an appropriate threshold to get a better reconstruction, at the same time a balance between imaging quality and speed can be achieved.

    References

    [1] D L DONOHO. Compressed sensing. IEEE Transactions on Information Theory, 52, 1289-1306(2006).

    [2] E J CANDÈS, J ROMBERG, T TAO. Robust uncertainty principles : exact signal frequency information. IEEE Transactions on Information Theory, 52, 489-509(2006).

    [3] M F DUARTE, M A DAVENPORT, D TAKHAR. Single-pixel imaging via compressive sampling. IEEE Signal Processing Magazine, 25, 83-91(2008).

    [4] W L CHAN, K CHARAN, D TAKHAR. A single-pixel terahertz imaging system based on compressed sensing. Applied Physics Letters, 93(2008).

    [5] H RYOICHI, M HIROAKI. Single-pixel compressive diffractive imaging. Applied Optics, 56, 4085-4089(2017).

    [6] Shan JIANG, Xianye LI, Zexin ZHANG. Scan efficiency of structured illumination in iterative single pixel imaging. Optics Express, 27, 22499(2019).

    [7] Haiyu MA, Aijun SANG, Cheng ZHOU. A zigzag scanning ordering of four-dimensional Walsh basis for single-pixel imaging. Optics Communications, 443, 69-75(2019).

    [8] W K PRATT, J KANE, H C ANDREWS. Hadamard transform image coding. Proceedings of the IEEE, 57, 58-68(1969).

    [9] J J A DECKER. Hadamard-transform image scanning. Applied Optics, 9, 1392-1395(1970).

    [10] M P EDGAR, G M GIBSON, R W BOWMAN. Simultaneous real-time visible and infrared video with single-pixel detectors. Scientific Reports, 5, 745-755(2015).

    [11] Mingjie SUN, M P EDGAR, D B PHILLIPS. Improving the signal-to-noise ratio of single-pixel imaging using digital microscanning. Optics Express, 24, 10476-10485(2016).

    [12] Zibang ZHANG, Shuming JIAO, Manhong YAO. Secured single-pixel broadcast imaging. Optics Express, 26, 14578(2018).

    [13] B LOCHOCKI, A GAMBÍN, S MANZANERA. Single pixel camera ophthalmoscope. Optica, 3, 1056-1059(2016).

    [14] Zibang ZHANG, Xueying WANG, Guoan ZHENG. Hadamard single-pixel imaging versus Fourier single-pixel imaging. Optics Express, 25, 19619-19639(2017).

    [15] G GIBSON, S JOHNSON, M PADGETT. Single-pixel imaging 12 years on:a review. Optics Express, 28, 28190-28207(2020).

    [16] Zibang ZHANG, Shijie LIU, Junzheng PENG. Simultaneous spatial, spectral, and 3D compressive imaging via efficient Fourier single-pixel measurements. Optica, 5, 315-319(2018).

    [17] Zibang ZHANG, Xiao MA, Jingang ZHONG. Single-pixel imaging by means of Fourier spectrum acquisition. Nature Communications, 6, 6225(2014).

    [18] Zibang ZHANG, Jingang ZHONG. Three-dimensional single-pixel imaging with far fewer measurements than effective image pixels. Optics Letters, 41, 2497(2016).

    [19] Hongzhi JIANG, Shuguang ZHU, Huijie ZHAO. Adaptive regional single-pixel imaging based on the Fourier slice theorem. Optics Express, 25, 15118-15130(2017).

    [20] Zibang ZHANG, Xueying WANG, Guoan ZHENG. Fast Fourier single-pixel imaging via binary illumination. Scientific Reports, 7, 12029(2017).

    [21] Zibang ZHANG, Tianao LU, Junzheng PENG. Fourier single-pixel imaging techniques and applications. Infrared and Laser Engineering, 48, 0603002(2019).

    [22] M ALEMOHAMMAD, J R STROUD, B T BOSWORTH. High-speed all-optical Haar wavelet transform for real-time image compression. Optics Express, 25, 9802(2017).

    [23] Zihao XU, Wen CHEN, P JOSÉ. 1000 fps computational ghost imaging using LED-based structured illumination. Optics Express, 26, 2427-2434(2018).

    Jie SU, Aiping ZHAI, Wenjing ZHAO, Qing HAN, Dong WANG. Hadamard Single-pixel Imaging Using Adaptive Oblique Zigzag Sampling[J]. Acta Photonica Sinica, 2021, 50(3): 22
    Download Citation