Depth resolution improvement of streak tube imaging lidar system using three laser beams

Zhaodong Chen; Rongwei Fan; Guangchao Ye; Tong Luo; Jiayu Guan; Zhigang Zhou; Deying Chen

doi:10.3788/COL201816.041101

Abstract

The work proposes a three-laser-beam streak tube imaging lidar system. Besides the main measuring laser beam, the second beam is used to decrease the error of time synchronization. The third beam has

n + 0.5

pixels’ difference compared to the main measuring beam on a CCD, and it is used to correct the error caused by CCD discrete sampling. A three-dimensional (3D) imaging experiment using this scheme is carried out with time bin size of 0.066 ns (i.e., corresponding to a distance of 9.9 mm). An image of a 3D model is obtained with the depth resolution of

< 2 mm

, which corresponds to

～ 0.2 pixel

The three-dimensional (3D) lidar technique has been widely used in a variety of fields, such as city construction, topographic mapping, underwater detection, and robotics^[1–5]. Streak tube imaging lidar (STIL) is one of the main kinds of lidar. It has attracted a great deal of attention in recent years because of its high accuracy, wide field of view, and fast data rate^[6–12].

A typical schematic of the STIL system is shown in Fig. 1^[13]. The laser is shaped into a fan beam by a cylindrical lens and forms a thin strip footprint on the target. The returned optical signal from the target is collected and imaged on the photocathode of the streak tube; then, the optical signal is converted into electrons. When the electron beam is accelerated to the phosphor screen by a high voltage, it will be deflected by a pair of linear sweep voltages. Finally, the electrons hit the screen of the streak tube and form a streak image. The signature position in the time-resolved channel on the screen is relative to the arrival time of the signal, i.e., we can obtain the target range from the image. Usually the images are intensified by a microchannel plate (MCP) and recorded by a CCD. The horizontal position represents the spatial information of the target, and the vertical position represents the range information.

Figure 1.Schematic of the STIL system. (a) Schematic of the data collection process. (b) The work principle of the streak array detector. (c) The streak image on the CCD.

Depth resolution is one of the most critical issues of a lidar system^[14–21]. In this Letter, we propose a three-laser-beam STIL system to improve the depth resolution of the STIL system. The optical emission part of three-laser-beam STIL system is shown in Fig. 2.

Sign up for Chinese Optics Letters TOC. Get the latest issue of Chinese Optics Letters delivered right to you！Sign up now

Figure 2.Optical emission part of the three-laser-beam STIL system.

In essence, streak tube imaging is a process of measuring time-of-flight (TOF) of a laser pulse, so the timing control is crucial to the depth resolution. In a typical STIL system, the timing of the laser source, sweep voltages, MCP, and CCD are triggered by a timing control unit. Usually, timing jitters exist in the units mentioned above. The time gates of MCP and CCD are adopted to promote the signal-to-noise ratio (SNR), and the time jitters of their delays do not influence the depth resolution of the STIL system seriously if the signal can go through the time gates. However, the time jitters of the timing control unit, laser source, and sweep voltages influence the depth resolution significantly. According to the error transfer formula, the error caused by time jitter is given by $Δ = \sqrt{Δ_{ctr}^{2} + Δ_{laser}^{2} + Δ_{sweep}^{2}},$ (1)where $Δ$ is the time jitter of the whole system, $Δ_{ctr}$ is the time jitter of the timing control unit, $Δ_{laser}$ is the time jitter of the laser source, and $Δ_{sweep}$ is the time jitter of sweep voltages.

As shown in Fig. 2, Beam A is the main measuring beam to image the target, and Beam B is utilized to decrease the time jitters. Beam B is used to illuminate a reference target fixed on the STIL system. In every single signal period, the measured results of Beam A and Beam B have the same jitter, thus, we can use the obtained jitter of beam B to correct the results of Beam A for every signal period: $L = L_{A} - Δ_{B},$ (2)where $L$ is the corrected distance, $L_{A}$ is the distance measured by Beam $A$ , and $Δ_{B}$ is the jitter of the distance measured by Beam B.

A simple experiment without a scan is carried out to prove that Beam B is beneficial for depth resolution. In the experiment, the target is a simple plane, the timing control unit is a digital delay generator (DG645, Stanford Research Systems Inc.) with the maximum jitter of 25 ps, the maximum jitter of laser source trigger to output is 400 ps, and the jitter of the sweep voltage is $\sim 500 ps$ . With all conditions remaining the same, the streak signals obtained on the screen of the CCD have jitters. We measure the target for 50 times in the situation, and the result is shown in Fig. 3.

Figure 3.Streak image of a simple plane.

As shown in Fig. 3, if Beam B is not used to modify the streak image of Beam A, the standard deviation of the measurement result is 4.3 pixels. If we use Beam B to assist the measurement, the standard deviation is low at 0.3 pixel. It is obvious that the effect of Beam B on correcting errors caused by timing jitter is significant.

In general, the shape of the streak signal on the time-resolved axis can be approximated using a Gaussian function^[19], $I (t) = I_{0} e^{- \frac{{(x - x_{0})}^{2}}{2 τ^{2}}},$ (3)where $I_{0}$ is the peak gray value of the streak signal, $τ$ is the signal width, and $x_{0}$ is the center of the streak signal. Meanwhile, the theoretical distance can be calculated by $R_{0} = \frac{1}{2} c t_{TOF} = \frac{1}{2} c x_{0} t_{bin},$ (4)where $R_{0}$ is the theoretical distance, $c$ is light speed in the air, $t_{TOF}$ is the TOF of the laser pulse, and $t_{bin}$ is the time bin size.

For the $i$ th pixel, the gray value is the integral of $I (t)$ in the interval $[x_{i} - 0.5, x_{i} + 0.5]$ , $I_{i} = I_{0} \int_{x_{i} - 0.5}^{x_{i} + 0.5} e^{- \frac{{(x - x_{0})}^{2}}{2 τ^{2}}} d x,$ (5)where $I_{i}$ is the gray value of the $i$ th pixel.

In general, we obtain the gray values and calculate the centroid on the time-resolved axis as the coordinate of the signal^[19,20]: $x_{cal} = \frac{\sum_{i = 1}^{N} i I_{i}}{\sum_{i = 1}^{N} I_{i}} = \frac{\sum_{i = 1}^{N} i \int_{i - 0.5}^{i + 0.5} e^{- \frac{{(x - x_{0})}^{2}}{2 τ^{2}}} d x}{\sum_{i = 1}^{N} \int_{i - 0.5}^{i + 0.5} e^{- \frac{{(x - x_{0})}^{2}}{2 τ^{2}}} d x},$ (6)where $x_{cal}$ is the calculated coordinate value of the signal on the time-resolved axis, and $N$ is the number of pixels on the time-resolved axis. Similarly, the calculated distance can be obtained by $R_{cal} = \frac{\sum_{i = 1}^{N} \frac{i c t_{bin}}{2} \cdot \int_{i - 0.5}^{i + 0.5} e^{- \frac{{(x c t_{bin} - 2 R_{0})}^{2}}{2 c^{2} τ^{2} t_{b in}^{2}}} d x}{\sum_{i = 1}^{N} \int_{i - 0.5}^{i + 0.5} e^{- \frac{{(x c t_{bin} - 2 R_{0})}^{2}}{2 c^{2} τ^{2} t_{b in}^{2}}} d x},$ (7)where $R_{cal}$ is the calculated distance of the target.

Because of the pulse width of the laser, the width of the laser beam, the resolution of the optical receiving system, and the dispersion of streak tube and MCP, the streak signal has a size of several pixels on the CCD. The distance of the target is obtained by calculating the centroid of the streak signal on the time-resolved axis. Because the pixel is the minimum measurement unit of a CCD, and it cannot be separated, we cannot get the accuracy distance by calculating the centroid with a limited number of discrete gray values. There is an error between the calculated value and theoretical value, as shown in Fig. 4.

Figure 4.Error between the calculated value and theoretical value.

The error $E$ between the calculated distance of Beam A and the theoretical distance can be obtained by $E_{A} = R_{cal} - R_{0} = \frac{\sum_{i = 1}^{N} \frac{i c t_{bin}}{2} \cdot \int_{i - 0.5}^{i + 0.5} e^{- \frac{{(x c t_{bin} - 2 R_{0})}^{2}}{2 c^{2} τ^{2} t_{b in}^{2}}} d x}{\sum_{i = 1}^{N} \int_{i - 0.5}^{i + 0.5} e^{- \frac{{(x c t_{bin} - 2 R_{0})}^{2}}{2 c^{2} τ^{2} t_{b in}^{2}}} d x} - R_{0} .$ (8)

To decrease the error caused by discrete sampling by the CCD, Beam C is utilized, as shown in Fig. 2. There is a preset optical path difference (OPD) between Beam C and Beam A, and the OPD leads to $n + 0.5$ pixels’ difference between the two returned signals on the CCD: $L_{OPD} = (n + 0.5) c t_{bin},$ (9)where $L_{OPD}$ is the OPD between Beam A and Beam C, and $n$ is a positive integer. The corrected distance is the mean value of the result measured by Beam A and Beam C, and the error can be obtained by Eq. (10). The simulation results are shown in Fig. 5, $E_{A + C} = \frac{1}{2} (E_{A} + E_{C}) .$ (10)

In the simulation, $t_{bin} = 1 ns$ , $τ = 0.5$ , $N = 500$ , and the theoretical distance is 5.8–6.1 m. From Fig. 5, it can be seen that $E_{A}$ , $E_{C}$ , and $E_{A + C}$ vary with $R_{0}$ periodically, and the error of Beam A and the error of Beam C are almost opposite to each other, so mean value of them is close to zero. The standard deviation of $E_{A}$ and $E_{C}$ is 9.6 mm, and the standard deviation of $E_{A + C}$ is 0.1 mm. The results show that the error of the measured distance can be decreased to $\sim 1 %$ of the initial value using this solution. This method can improve the depth accuracy of the STIL system significantly. In addition, the mean of two measured results can reduce the random error.

Figure 5.Distance error with the theoretical distance.

To validate the feasibility of the three-laser-beam STIL system, an indoor 3D imaging experiment using the scheme is carried out, as shown in Fig. 6(a). The parameters of the system are shown in Table 1. A $Q$ -switched solid-state laser is employed as the illumination source. The laser beam is divided into three beams: Beam A, Beam B, and Beam C. As stated above, Beam A is the main measuring beam, Beam B is used to decrease the jitter of the signal, and Beam C is utilized to correct the error caused by discrete sampling. The streak signals of the three beams are shown in Fig. 6(b).

Parameter	Value
Wavelength of the laser	532 nm
Repetition rate of the laser	1000 Hz
Pulse width of the laser	1 ns
Power of the laser	∼30 mW
CCD resolution(spatial-resolved × time-resolved)	1000×500
CCD grayscale	0–255
Time bin size, tbin	0.066 ns
Target distance	∼6.98 m
Jitter of DG645	<25 ps
Jitter of sweep voltages	∼500 ps
Jitter of the laser output	<400 ps
Field-of-view	∼1.2°

Table 1. Parameters of the STIL System

View all Tables

Figure 6.(a) Schematic of the three-laser-beam STIL system. (b) The streak signal of Beam A, Beam B, and Beam C on the CCD.

The target is a model made by a 3D printer with the printing accuracy of 0.1 mm. There are some letters (“H”, “I”, “T”) and a punctuation mark (“!”) on a base plate, and their heights are 2, 5, 10, and 20 mm, respectively, as shown in Fig. 4(a). The main size of the model is shown in Figs. 7(b) and 7(c).

Figure 7.(a) Photograph of the model. (b) Size of the base. The unit is millimeters. (c) Heights of “H”, “I”, “T”, and “!”. They are 2, 5, 10, and 20 mm, respectively.

Using the three-laser-beam STIL system, the 3D image of the model is obtained. We present three processing results of the 3D imaging to compare the imaging quality obtained by one beam (Beam A), two beams (Beam A and Beam B), and three beams (Beam A, Beam B, and Beam C). Furthermore, the cutaway drawings of the three results are presented to study the quality intuitively. The results are shown in Fig. 8.

Figure 8.Results of the 3D imaging experiment. Different colors are used to represent distances. (a) The image obtained using only Beam A, (c) the image obtained using Beam A and Beam B, and (e) the image obtained using Beam A, Beam B, and Beam C. (b), (d), and (f) are the cutaway drawings of (a), (c), and (e) near the blue line separately.

As shown in Fig. 8, there are peaks on the left edge of the letters in the figures. It is due to the extreme change of the laser incident angle on the left edge. When the angle of incidence is zero, the returned light will be much stronger, and the streak signals will be saturated and distorted. Therefore, the range images deform on the edge of the letters. Because the outline of “!” is curved and not perpendicular to the incident light in most cases, there are no obvious peaks on the edge of “!”.

The distance of the base plate of the model is $\sim 6.98 m$ . Fig. 8(a) is the image obtained with only Beam A. It is obvious that the letter “H” in Fig. 8(a) cannot be separated from the base, and the quality of the other letters is very poor. The quality of Fig. 8(c) is much better than that of Fig. 8(a). Thus, it can be concluded that the depth resolution of the STIL system is improved significantly using Beam B. However, the image in Fig. 8(c) is rough, and the base plate and the letters contain many line-type concave and convex surfaces, which will influence the resolution of the image. The image of “H” in Fig. 8(e) is the clearest, and the outline of the cutaway drawing in Fig. 8(f) is the smoothest. Accordingly, Beam C can assist in improving the depth resolution. Using the three-laser-beam STIL system, the height of letter “H” can be separated from the base clearly. It means that this system has a resolution of $< 2 mm$ .

In conclusion, this Letter proposes a three-laser-beam STIL system to improve depth resolution. The scheme can effectively decrease the timing jitter and errors caused by discrete sampling. The experimental results show that when the time bin size is 0.066 ns (i.e., corresponding to distance of 9.9 mm), the depth resolution is better than 2 mm, which corresponds to $\sim 0.2 pixel$ . The three-laser-beam STIL system is an effective approach to obtain high resolution 3D images.

References

[1] Z. Tao, D. Liu, Z. Zhong, B. Shi, M. Nie, X. Ma, J. Zhou. Chin. Opt. Lett., 10, 050101(2012).

[2] J. Cao, Q. Hao, Y. Cheng, Y. Peng, K. Zhang, J. Zhang, J. Mu, P. Wang. Appl. Opt., 55, ED2(2016).

[3] W. Gao, Z. Lu, Y. Dong, W. He. Chin. Opt. Lett., 4, 428(2006).

[4] Z. Bian, C. Huang, D. Chen, J. Peng, M. Gao, Z. Dong, J. Liu, H. Cai, R. Qu, S. Gong. Chin. Opt. Lett., 10, 091405(2012).

[5] D. He, G. Seet. Opt. Eng., 43, 3(2004).

[6] Z. Jiang, B. Guo. Appl. Opt., 53, E26(2014).

[7] A. D. Gleckler, A. Gelbart. Proc. SPIE, 4377, 175(2001).

[8] Y. Guang, S. Li, Q. Wang, J. Liu. Proc. SPIE, 6279, 62790C(2007).

[9] R. T. Eagleton, S. F. James. Rev. Sci. Instrum., 74, 2215(2003).

[10] A. J. Nevis, R. J. Hilton, J. J. S. Taylor, B. Cordes, J. W. McLean. Proc. SPIE, 5089, 225(2003).

[11] W. Xia, S. Han, N. Ullah, J. Cao, L. Wang, J. Cao, Y. Cheng, H. Yu. Appl. Opt., 56, ED3(2017).