• Journal of Infrared and Millimeter Waves
  • Vol. 42, Issue 1, 50 (2023)
Shi-Jie LIU1、2, Xing-Yu ZHANG1, Hao ZHOU1, Chun-Lai LI1、2, Dong Jing LI1, Hong-Xing QI1、2、*, and Jian-Yu WANG1、2、3、**
Author Affiliations
  • 1Hangzhou Institute for Advanced Study,University of Chinese Academy of Sciences,Hangzhou 310024,China
  • 2Key Laboratory of Space Active Opto-Electronics Technology,Shanghai Institute of Technical Physics,Chinese Academy of Sciences,Shanghai 200083,China
  • 3University of Chinese Academy of Sciences,Beijing 100049,China
  • show less
    DOI: 10.11972/j.issn.1001-9014.2023.01.008 Cite this Article
    Shi-Jie LIU, Xing-Yu ZHANG, Hao ZHOU, Chun-Lai LI, Dong Jing LI, Hong-Xing QI, Jian-Yu WANG. Efficient information acquisition spectral imaging system based on multi-field slits[J]. Journal of Infrared and Millimeter Waves, 2023, 42(1): 50 Copy Citation Text show less

    Abstract

    Video spectral imaging technology is an important direction in the development of remote sensing detection. It can achieve 4-dimensional information acquisition (two-dimensional space + spectrum + time), which is of great significance for application such as dynamic target detection. The current technical means are mainly based on the filter method, and do not have the high-resolution advantage of grating. Uncoupled Slit Array Scan Hyperspectral imager (uSASHI) and Coded Slit Array Scan Hyperspectral imager (cSASHI) are proposed in this paper, both use multiple slits to achieve simultaneous acquisition of multiple fields of view information to improve the information acquisition rate, and enables video-level spectral imaging. The information obtained by each slit of uSASHI will not be coupled, and n slits can achieve n times the improvement of information acquisition efficiency. The slits of cSASHI are arranged according to the compressed sensing theory, which can achieve under-sampling conditions (sampling rate α≤ 1) video spectral imaging, the information acquisition efficiency can be improved by n/α times. The system designed in this paper finally realizes the 1024*490*30 spectral data cube 10 Hz video spectral imaging method, and cSASHI achieves a higher frame rate. The proposed system provides a new direction for the video spectral imaging technology and lays a better foundation for future applications.

    Introduction

    The satellite-based hyperspectral imaging technology was one of the important optical remote sensing methods for Earth observation,and it is increasingly recognized by the remote sensing community because of its ability to acquire spectral and image information in three dimensions simultaneously. Hyperspectral imaging systems in traditional remote sensing can be roughly divided into two categories:the push-broom scanning hyperspectral imaging(PSHI)system and the staring hyperspectral imaging(SHI)system. The PSHI system used gratings or prisms,while the SHI system used a tunable optical filter as a splitting device. The latest representative PSHI systems are OSIRIS-REx Visible and Infrared Spectrometer(OVIRS)1,Advanced Hyperspectral Imager(AHSI)2. In addition,there are Environmental Mapping and Analysis Program(EnMAP)hyperspectral imager,NASA Hyperspectral InfraRed Imager(HyspIRI). In the field of deep space exploration,there are also some typical hyperspectral imagers,such as Compact reconnaissance Imaging Spectrometer for Mars(CRISM)on Mars Reconnaissance Orbiter(MRO)and the OSIRIS-REx Visible and InfraRed Spectrometer(OVIRS). MicrOmega3,Visible & Near Infrared Spectrometer(VNIS)onboard Yutu-24 are SHI systems. PSHI can achieve high spectral resolution,because of the use of gratings or prisms,but it is push-based form of platform or scanning mirror makes it only suitable for applications that are carried on mobile platforms,such as airborne and space-borne applications. The StHI system is suited to the detection in-situ,but it has failed to achieve high spectral resolution. It is because those tunable filter devices(e.g.,Acousto-optical tunable filter)are not equipped with excellent dispersion capabilities.

    As the performance requirements of hyperspectral technology gradually increase,it is desired to simultaneously combine high detection sensitivity,high spatial resolution,high spectral resolution,and high temporal resolution. And the above two ways were obviously difficult to achieve. The development of snapshot hyperspectral technology with face-field imaging capability is increasingly focused on,and various new spectroscopic techniques have emerged. It can acquire spatial information and spectral information simultaneously in one sampling period directly or through recovery algorithms. Bowen's integrated field spectral(IFS)imaging technique,based on polygon mirror integration,was the first proposed snapshot spectral imaging concept5. This was followed by computed tomography spectroscopy(CTIS)6-7,Fourier-based hyperspectral imager(FHI),based on the Michelson interferometer8,the multispectral Sagnac interferometer(MSI)9,image mapping spectrometer(IMS)10,and image-replicating imaging spectrometer(IRIS)11. In addition,there are spectral imaging systems based on filter arrays and continuous tunable filters(CVF). One example is the optically replicating and remapping imaging spectrometer(ORRIS)12. With the proposal of computational information processing theory,such as compressed sensing13-14,snapshot imaging spectrometers based on coded aperture have emerged. They include coded aperture snapshot spectral imagers(CASSI)15-17,compressive sensing hyper-spectral imagers(CHSI)18,compressive hyper-spectral imaging by random separable projections in both the spatial and the spectral domains(CHSISS)19,and systems that have evolved on this basis. These systems use a two-dimensional random coding board to modulate the target information to achieve "compressed sensing," and use the reconstruction algorithm to recover all spectral and spatial information.

    This paper firstly intends to propose a slit-scanning hyperspectral imaging(SSHI)system. Instead of being driven by the movement of the platform or scanning mirror,the slit is moved and the one-dimensional spatial information perpendicular to the slit is scanned. This allows the apparatus to detect the in-situ scene while keeping the instrument stationary. On the other hand,the SSHI system has the same components as the PSHI system except for the addition of a moving slit,which maintains the advantage of using a grating,prism,or the like,that is,high spectral resolution can be guaranteed. On this basis,Uncoupled Slit Array Scan Hyperspectral imager(uSASHI)is proposed whose time-resolution is improved. Go a step further,Coded Slit Array Scan Hyperspectral imager(cSASHI)is proposed. Its multiple slits are combined into a coding array,and the system obtains the encoded information of the detection target. Coding is transformed by moving the micro-displacement platform to improve the sampling rate. cSASHI has a similar acquisition and recovery process as the CASSI system. The difference is that we have changed the two-dimensional random coding into the slit’s combination coding,so that the coding board only needs one-dimensional movement. This makes the mathematical model easier to establish as coding complexity becomes lower,and engineering is easier to implement.

    1 Multi-field-of-view slit spectral imaging model

    The SSHI system is proposed here first. Hyperspectral imaging technology ultimately must acquire two-dimensional spatial information and one-dimensional spectral information. Since existing devices only have two-dimensional detection capability,three-dimensional information acquisition needs to be completed by spatial scanning or temporal scanning. The essence of spatial scanning is the completion of the inter-movement of the target 2D spatial information with the imaging detector. As mentioned above,hyperspectral imagers based on push-broom imaging type are currently the mainstream solution in aerospace. And what they accomplish is the relative motion of the entire imaging system to the target. In fact,in addition to scanning with the help of platform motion or scanning mirror,3D data cube acquisition can also be achieved by using slit movement scanning. As shown in Fig. 1,the system is distinguished from the conventional PHI system. It is referred to here as a single slit scan imaging spectrometer system(SSHI. Slit Scan Hyperspectral imager). Unlike PHI,where the whole system moves relative to the target in a different way,SSHI accomplishes the relative motion of the slit to the detector. This is the essential difference between the two approaches.

    The schematic diagram of the detector display under the slit scanning mode of the SSHI system

    Figure 1.The schematic diagram of the detector display under the slit scanning mode of the SSHI system

    SSHI achieves spatial self-scanning,which can eliminate the need for platform pushing and scanning or scanning mirror scanning,and the entire spectral imaging instrument can remain stationary for system detection. The SSHI and PHI can use the same optical components except for the addition of a control module for continuous conversion slit control,i.e.,the high-resolution characteristics of the grating and prism can be maintained. In SSHI,it has step or continuous scanning. For each unit distance the system moves,the two-dimensional information received by the detector(one-dimensional space and one-dimensional spectrum)will move one image element in the corresponding direction,i.e.,the different field-of-view positions of the detection target correspond to different positions in the detector dispersion direction. Ultimately,it is necessary to obtain a data cube by determining the spatial location and spectral position of the spectral data,and then stitching them together.

    In the SSHI system,the speed of the slit shift scan is determined by the detector frame frequency and pixel size. If the slit moving speed is v,the detector frame frequency is f,and the pixel size is d,then v = d ×f. This has the same computational relationship as the speed of the platform in PHI.

    For a data cube of M×N×L(horizontal × vertical × spectral),the slit must be moved N times in the dispersion direction to complete the acquisition of all information. The effective detection area of the detector,i.e.,the specification should be at least M×(N + L-1). The acquisition time of the whole data cube is N / f for a detector with a frame frequency of f. In other words,SSHI can be considered as a video hyperspectral imager with f / N frame frequency detection,which is sufficient for some scenarios.

    The SSHI system achieves the acquisition of spectral information at different line-of-view positions by a single slit scan,and one detection time unit corresponds to one line-column field of view. In fact,without changing the optical system and detector system,the scanning efficiency can be greatly improved by changing a single slit into multiple slits and achieving simultaneous scanning of multiple slits to obtain spectral information. The arrangement of the slits ensures that the dispersions corresponding to adjacent slits do not overlap. That is,the interval between the two slits is at least L image elements in size under the condition that the slit-to-detector optical imaging ratio is 1:1,while not considering different dispersions corresponding to different fields of view. Usually,due to reasons such as non-ideal factors of optical components,such as the cut-off wavelength position of the cut-off filter still exists part of the energy. It is necessary to set the adjacent slit interval appropriately larger than L to avoid the occurrence of spectral mixing of different fields of view. The system is called the uncoupled Slit Array Scanning Spectral Imaging System(uSASHI,Uncoupled Slit Array Scan Hyperspectral imager). The distance between two adjacent slits is D image elements,and there are P slits in the slit array,and there exists the relationship:N  PD. The whole slit array only needs to move D image elements to achieve the acquisition of information corresponding to the whole field of view. The scanning efficiency can be improved N/D (P) times compared to SSHI. Apparently,SASHI is a video hyperspectral imaging system with a frame rate of f / D,which is about P times the frame rate of SSHI. Obviously,this is a major enhancement and greatly expands the usefulness of the system.

    The SSHI and uSASHI systems have a one-to-one correspondence between the detector image element reception information and the target information,and the information is processed under the Nyquist sampling theorem. In fact,compressive sensing as a novel information processing theory can inspire us to explore new imaging systems. The slit arrays are arranged via a certain coded form rather than at equal intervals,the detector's single acquisition is a superposition of spectral imaging information from multiple slits at different locations. The system maps the 3D data cube onto the 2D detector surface array,forming a mixed stack of encoded information and realizing data dimensionality reduction. The set encoding form corresponds to the detection matrix to be created. The established detection matrix should satisfy the Restricted Isometry property(RIP),which is necessary to obtain the full information,if it corresponds to the appropriate vectorized detection data. The acquisition of the full spatial spectral image can be achieved by a suitable reconstruction algorithm. The system is called the coded slit array scanning spectral imaging system(cSASHI,Coded Slit Array Scan Hyperspectral imager).

    Since the dispersion only occurs in the horizontal direction,and the vertical direction does not participate in encoding,only one line of data is analyzed for the sake of simplicity22. Fig. 2 shows the process of constructing a solution model for a cube of 1×4×3. cij l stands for the ith row,jth column,and the lth spectral band of data cube C.mik stands for the ith slit position data(0 or 1)in code mask M of the kth sample,and the detector D receives data as dijk which is the data of the ith row and the jth column on the detector of the kth measurement.

    The process of constructing a solution model

    Figure 2.The process of constructing a solution model

    As shown in Fig. 3

    mk=m4k,m3k,m2k,c1=cr41,cr32,cr23T

    Comparison of three spectral imaging methods,(a)the slit scanning mode of the SSHI system,(b)the uncoupled slit array scanning of uSASHI,(c)the coded slit array scanning of cSASHI

    Figure 3.Comparison of three spectral imaging methods,(a)the slit scanning mode of the SSHI system,(b)the uncoupled slit array scanning of uSASHI,(c)the coded slit array scanning of cSASHI

    Then:

    dr4k=mkc1

    Written as:

    dr4=dr41...dr4k...dr4pT,m=m1...mk...mpT

    Then:

    dr4=mc1 .

    Equation(1) shows the computing relationship between sample dr4and target informationc1. The other corresponding vectors have the same construction process. In the case of under-sampling,m is a "fat matrix”,which has a few rows smaller than the number of columns. When m satisfies the RIP,the above matrix becomes a compressed sensing measurement model,and c1can be reconstructed by a refinement algorithm such as sparse optimization 17-18

    c^1=arg minc1dr4-mc122+τc1l .

    When m is full rank,it corresponds to a full sampling situation:

    c^1=m-1dr4 .

    Which is equivalent to:

    c^1=arg minc1dr4-mc122 .

    Under one exposure,cSASHI has the same effective detection area as the SSHI detector. When n coding measurements are performed,the corresponding sample data amount is n ×M× (N + L - 1). The sampling rate is (n×(N+L-1))/ (N×L),and the duration of an entire data cube is n/f. So,cSASHI system can be seen as a hyperspectral video imager with a frame rate detection capability of f/n. As n ≤ N,cSASHI usually has a higher detection frequency than SSHI. It can be seen from the mathematical model that the information obtained by one exposure of the cSASHI system is the linear sum of several single sampling results in SSHI. This guarantees the feasibility of the mathematical model.

    It should be noted that the imaging field of view in an optical imaging system is limited,and the design also tends to preserve a better portion of the image quality by limiting the field of view. Therefore,in the encoding system,it is sufficient to ensure that the information in the field of view is encoded. An appropriately sized encoding mask can be set up to match the field-of-view diaphragm so that the encoding sub-region strictly matches the position of the imaging field-of-view region. This subregion is obviously smaller than the area of the mask plate. By moving the mask while the diaphragm,which is used to limit the field of view,remains unchanged,the "code" for the location of the imaging area will change,thus achieving multiple exposures with different codes. Fig. 3 shows the schematic diagram of the three spectral imaging methods.

    2 Imaging experiment system

    2.1 Overview

    The schematic diagram and mechanical structure design diagram of the 2-imaging experiment system are shown in Fig. 4 and Fig. 5,respectively. The system is divided into a panchromatic imaging channel(with high spatial resolution)and a spectral imaging channel through the dichroic sheet. The two can form a good complement of information and are both good data sources for applications such as imaging and detection. As mentioned above,the image modulator is located at the primary image plane of the imaging system,and can have different forms to achieve different information acquisition methods.

    The schematic diagram

    Figure 4.The schematic diagram

    Mechanical design

    Figure 5.Mechanical design

    The design parameters of this system are shown in the following table.

    ParametersPanchromatic imaging channelSpectral imaging channel
    Wavelength0.45~0.85 μm0.45~0.9 μm
    Focal length1 725 mm1 725 mm
    Working F number5.55.5
    Spectral sampling15 nm
    Field of view±0.370°×±0.278°±0.221°×±0.111°
    Spatial resolution

    0.002 mrad

    (1 m@500 km)

    0.007 6 mrad

    (3.8 m@500 km)

    Spectral resolution18 nm
    Spectrometer magnification
    Detector array size6 464×4 8521 024×512
    Detector pixel size3.45 μm13 μm

    Table 1. Specifications of the system

    The core of the system is the spectral imaging channel,which mainly consists of the spectrometer assembly and the front optical path combined by the telescope and the relay mirror set. In order to meet the specificity of the computational optics,it is necessary to expand the traditional push-scan type line-field spectrometer into a snapshot type face-field spectrometer. At this time,the object surface of the spectrometer is extended in the spectral direction and is rectangular. It also changes from a single slit to a movable array of coded slits,requiring a larger field of view along the track compared to ordinary imaging spectrometers. The parameters of the designed spectrometer components are shown in Table 2,and the specific components are shown in Fig. 6,which mainly consist of a collimating mirror set,a focusing mirror set,and a prism pair used as a beam splitting element. The use of prisms as beam splitting elements can effectively avoid the overlap between the advanced sub spectrum of the grating and the signal light of the same wavelength in different along-track fields of view. Although its spectral dispersion has a certain nonlinearity,the signal energy is strong,while prism pairs of different material combinations can be used to reduce the smile and keystone of the spectrometer. The system is designed to use N-BAF3 as well as N-BASF64 in Schott glass for matching,as shown in Fig. 8,to obtain a better spectral effect. The collimator and focus mirror use a spherical lens set to meet the needs of a larger field of view. The converging light at the primary focal plane of the front optical path of the telescope is changed to parallel light by the collimator set to ensure the consistency of the prism pair splitting. After using prism spectroscopy,secondary imaging and aberration compensation are performed by the focusing mirror set to obtain better multispectral blended images for subsequent data processing.

    ParametersSpectrometer components
    Spectral range0.45~0.9 μm
    Spectrometer magnification
    Object size±6.656 mm×±3.328 mm
    Spectroscopic elementPrism pairs
    Spectral sampling15 nm
    RMS radius of spot≤4.5 μm
    Smile<3.1 μm
    Keystone<4.2 μm
    MTF(@38.46 lp/mm)

    >0.73@0.45 μm;>0.73@0.65 μm;

    >0.69@0.9 μm

    Table 2. Specifications of the spectrometer components

    The optical layout of the spectrometer components

    Figure 6.The optical layout of the spectrometer components

    Physical view of different types of slits (a) single slit, (b) uniform array slit, (c) coded array slit

    Figure 7.Physical view of different types of slits (a) single slit, (b) uniform array slit, (c) coded array slit

    Center field spectral calibration results

    Figure 8.Center field spectral calibration results

    The image modulation components are realized by laser etching on the chrome-plated quartz substrate,and the etching accuracy can reach 0.1-micron level,which can well meet the system accuracy requirements. At the same time,the quartz substrate has a good optical utilization rate in the visible band,and the chromium layer has a good light blocking effect,so the component has a good contrast performance.

    3 Experiments and results

    3.1 Calibration

    The system still uses the traditional monochromatic parallel light calibration method for spectral calibration. The difference is that this system is a multi-field spectral imaging system in the spectral dimension. The imaging quality and spectral performance of different fields of view are different,and even have great differences,such as the most peripheral field of view and the center field of view. The calibration for each field of view can obtain very accurate calibration data. However,due to the large number of fields of view and the small single-color step size required for calibration,a lot of calibration data will be generated and need post-processing. The central wavelength or bandwidth corresponding to the field of view at different positions in the spectral dimension direction has a certain relationship. This relationship can be easily obtained by linear or nonlinear fitting. Therefore,it is often necessary to select several representative fields of view positions for spectral calibration. The central wavelength or bandwidth of other positions can be linearly interpolated.

    The standard monochromator is HORIBA's iHR320 when calibrating,using halogen tungsten lamp as light source,and with parallel light path,the monochromator's light output slit width is 0.1 mm,the scanning step is 0.5 nm,and the wavelength scanning range is 450~900 nm. After calibration,the spectral resolution calibration,and fitting results at the center of the field of view are shown in the figure below.

    The system uses multiple slits for surface target imaging. Different positions of the surface target will enter the optical system with different angles of incidence. In order to reduce the influence of dispersion inconsistency,the prism is installed in the optical system at the minimum deflection angle. Position,which is often a way to reduce sensitivity to non-parallelism of incident light rays. The spectral calibration of 5 different fields of view was carried out respectively. From the data fitting effect of center wavelength and spectral resolution,the spectral dispersion characteristics of different fields of view are almost the same.

    Spectral calibration results for 5 typical fields of view (a) center wavelength, (b) spectral resolution

    Figure 9.Spectral calibration results for 5 typical fields of view (a) center wavelength, (b) spectral resolution

    In fact,even with large inconsistencies across different fields of view,spectral position and resolution can be quantified simply by calibration. Another aspect is the quantification and calibration of smile quantification. As shown in the table,the spectral curvature data of the three fields of view are given,and the smile of the system is not very large.

    Slit positionWavelengthSmile/mm
    Top edge450 nm0.003 56
    650 nm0.002 84
    850 nm0.002 67
    Centre450 nm0.002 95
    650 nm0.004 44
    850 nm0.004 86
    Bottom edge450 nm0.002 95
    650 nm0.004 44
    850 nm0.004 86

    Table 4. Smile of the system

    As for the radiation calibration:It can be seen from the above system model that the corresponding relationship between the received data of the uSASHI detector and the target radiation is clear,just like PHI. The data received by the detector in the cSASHI system is the linear superposition of the corresponding single information elements,so the radiation calibration of the system proposed in this paper has no special requirements with the traditional method.

    3.2 Imaging results

    3.2.1 Indoor imaging

    Small telescopes are used(F#1,f:18 mm)in indoor experiments,to solve and verify problems that may arise in engineering practice.

    Synchronized exposure settings for mechanical modulator and detector information acquisition in the proposed system are critical for imaging. The micro motor can have two modes:continuous movement and step movement. In the continuous system mode,the slit continuously scans the image surface of the target,which is like the information acquisition method of traditional PHI. The only difference is that PHI scans the object surface,which does not affect the essential correspondence of information acquisition. In the step movement mode,a detector unit and the ground imaging unit have a clearer one-to-one correspondence,so the system adopts the latter method,and the micro-motor moves one pixel and sends a pulse signal,trigger the detector exposure.

    On the other hand,during the imaging process,the movement of the micromotor has non-uniformity,which will lead to non-uniform response of the detector to receive information. The Fig. 10(c) shows the imaging results caused by this reason,while Fig. 10(a) is the imaging target,and Fig. 10(b) is the sampling data of a certain frame on the detector. Fortunately,we can obtain the precise movement curve of the displacement motor,and fully adjust the exposure difference caused by the difference between the actual moving position curve and the ideal curve,which can achieve very good image correction,this step is called synchronization correction.

    Imaging objectives and preliminary imaging results (a) RGB Image, (b) sampling images, (c) imaging without synchronization correction

    Figure 10.Imaging objectives and preliminary imaging results (a) RGB Image, (b) sampling images, (c) imaging without synchronization correction

    An integrating sphere that can be traced to a standard source is used as the illumination source. When the micromotor moves 13 μm,a pulse signal is sent,which is the exposure trigger signal of the detector. The exposure of the detector is completed,and the next unit information acquisition cycle is started. That is,the sampling frame rate Fr of the system depends on the motion period T of the micro-motor and the exposure time τ of the detector:Fr=1/(T +τ). In the experiment,the V-408 high-precision motor of PI company is used as the moving part,the maximum moving speed can reach 1.1m/s,and the displacement accuracy can reach 1 μm. By setting the speed,T=1ms is achieved,and τ=9 ms is set according to the brightness of the scene,that is,the system achieves a sampling frame rate of 10 Hz,which is the imaging frame rate of cSASHI,and the imaging frame rate of uSASHI can be higher,as mentioned above.

    The reflectivity profiles in different wavelengths are important features for detecting targets. Because the light source is traceable,the reflectivity of the target can be well inverted. As shown in Fig. 11. Their peak wavelengths are 600 nm and 580 nm,respectively. This is in accordance with the actual.

    Different wavelength images

    Figure 11.Different wavelength images

    Reflectance curves (a)~(d): reflectance curves corresponding to positions 1~4 respectively

    Figure 12.Reflectance curves (a)~(d): reflectance curves corresponding to positions 1~4 respectively

    3.2.2 Outdoor imaging

    The system is designed for remote sensing applications,and large telescopes are used for long-range imaging,with test targets approximately 500 m away. The panchromatic and spectral channels of the system are simultaneously imaged,and after a simple atmospheric correction,as shown in the figure,the structure of the panchromatic imaging and the imaging results of the 30 spectral channels of uSASHI are given.

    Outdoor imaging physical picture (a) target in the red box, (b) system physical

    Figure 13.Outdoor imaging physical picture (a) target in the red box, (b) system physical

    Outdoor panchromatic channel imaging and spectral imaging results (a) panchromatic channel imaging, (b) single-band image of 30 channels

    Figure 14.Outdoor panchromatic channel imaging and spectral imaging results (a) panchromatic channel imaging, (b) single-band image of 30 channels

    Results of 10 Hz video spectral imaging implemented by uSASHI (a)-(e) are the results of continuous 1s spectral imaging(half of them)

    Figure 15.Results of 10 Hz video spectral imaging implemented by uSASHI (a)-(e) are the results of continuous 1s spectral imaging(half of them)

    Spectral imaging results of cSASHI at different sampling rates (a)-(e) Spectral imaging results at 16.6 Hz for 60% sampling rate, 14.3 Hz for 70% sampling rate, 12.5 Hz for 80% sampling rate, 11 Hz for 90% sampling rate, and 10 Hz for 100% sampling rate, respectively

    Figure 16.Spectral imaging results of cSASHI at different sampling rates (a)-(e) Spectral imaging results at 16.6 Hz for 60% sampling rate, 14.3 Hz for 70% sampling rate, 12.5 Hz for 80% sampling rate, 11 Hz for 90% sampling rate, and 10 Hz for 100% sampling rate, respectively

    The spatial resolution of the spectral imaging channel is about 4 times that of the panchromatic channel,and the two channels can realize the complementation of spatial information and spectral information. The spatial resolution of spectral imaging in this experiment is 512×245,and the panchromatic channel achieves 2560×2450 information acquisition. Part of the imaging results are shown in Fig. 14. The panchromatic channel obtains high spatial resolution data. According to the design,the field of view is about 5×5 times that of the single imaging of the spectral imaging channel. The data obtained by the latter is the "sub-field of view" spectral data of the former. "Scanning" can obtain more dimensional information of the corresponding target in a targeted manner,that is to say,the panchromatic channel can realize an overview,and the spectral channel can realize further fine detection based on this,which can play a crucial role in many application scenarios. As mentioned above,uSASHI and cSASHI are two high-efficiency information acquisition systems,which have video characteristics. With the same settings,the system can achieve 10 Hz video spectral imaging. As shown in Fig. 15 and Fig. 16(b),dynamic target in the imaging scene(wind-swept tree)is selected .The results of partial video spectral imaging in one second are given. The figure shows the spectral imaging results of a certain frame of cSASHI under the conditions of 60%,70%,80%,90%,and 100% sampling rates,respectively. The corresponding imaging frame frequencies are 16.6 Hz,14.3 Hz,12.5 Hz,11 Hz,10 Hz.

    4 Conclusions

    In summary,we investigated the imaging methods via comparative study of single slit,uncoupled slit arrays,and coded slit arrays. We achieved frame rate 10 Hz for uncoupled slit array spectral imaging and up to 16.6 Hz frame rate transmission characteristics for coded slit array spectral imaging at five sampling rates. The slit array coding is used to replace the line field of view with a surface field of view and to increase the sampling efficiency,ultimately increasing the speed of spectral imaging of external dynamic targets,A new type of spectral imaging system was then realized. The system proposed in this paper uses a prism as the spectroscopic device,which can be replaced by a grating or a combination of the two in future research,retaining the advantages of high spectral resolution of the spectroscopic device to accommodate more applications. The essence of uSASHI is to collect and process information under the traditional information processing framework. It can realize flexible conversion of spatial,spectral and temporal resolutions by adjusting system parameter settings. It is suitable for application scenarios that require high reliability of remote sensing data. cSASHI is based on the sparsity of imaging data,information acquisition under the framework of compressed sensing,an emerging information theory,can achieve higher data acquisition efficiency than uSASHI,and will lose some detailed information,but can retain the principal component information of the target,which is suitable for dynamic targets,scenarios such as tracking and recognition,which do not require complete information. In addition,the modulation component of the system acquires information by scanning,which can achieve good information acquisition for static targets,but it is unavoidable that there will be problems caused by the difference in scanning time for dynamic target scenes. The adjustment of the synchronization method of detector acquisition and modulator can improve this problem and is also one of the future research directions.

    References

    [1] D C Reuter, A A Simon, J Hair et al. The OSIRIS-REx Visible and Infrared Spectrometer (OVIRS): Spectral Maps of the Asteroid Bennu. Space Science Reviews, 214, 1-22(2017).

    [2] Y Liu. Visible-shortwave Infrared Hyperspectral Imager of GF-5 Satellite. Spacecraft Recovery & Remote Sensing, 39, 25-28(2018).

    [3] J P Bibring, V Hamm, Y Langevin et al. The MicrOmega Investigation Onboard Hayabusa2. Space Science Reviews, 208, 401-412(2017).

    [4] C Li, D Liu, B Liu et al. Chang'E- 4 initial spectroscopic identification of lunar far-side mantle-derived materials. Nature, 569, 378-382(2019).

    [5] Z D Gao, H X Gao, Y Y Zhu et al. Review of snapshot spectral imaging technologies. Optics and Precision Engineering, 28, 1323-1343(2020).

    [6] T Okamoto, I Yamaguchi. Simultaneous acquisition of spectral image information. Optics Letters, 16, 1277-1279(1991).

    [7] B Ford, M Descour, R Lynch. Large-image-format computed tomography imaging spectrometer for fluorescence microscopy. Optics Express, 9, 444-453(2001).

    [8] M W Kudenov, E L Dereniak. Compact snapshot birefringent imaging Fourier transform spectrometer. Proceedings of SPIE - The International Society for Optical Engineering, 781206(2010).

    [9] J Allington-Smith. Basic principles of integral field spectroscopy. New Astronomy Reviews, 50, 244-251(2006).

    [10] A Bodkin, A Sheinis, A Norton et al. Snapshot hyperspectral imaging: the hyper pixel array camera. Proceedings of SPIE - The International Society for Optical Engineering, -73340H(2009).

    [11] Y Wang, M E Pawlowski, T S Tkaczyk. High spatial sampling light-guide snapshot spectrometer. Optical Engineering, 56, 081803(2017).

    [12] T Mu, F Han, D Bao et al. Compact snapshot optically replicating and remapping imaging spectrometer (ORRIS) using a focal plane continuous variable filter. Optics Letters, 44, 1281-1284(2019).

    [13] D L Donoho. Compressed sensing. IEEE Transactions on Information Theory, 52, 1289-1306(2006).

    [14] E J Candes, J Romberg, T Tao. Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information. IEEE Transactions on Information Theory, 52, 489-509(2006).

    [15] A A Wagadarikar, P J Bones, M A Fiddy et al. SPIE Proceedings [SPIE Optical Engineering + Applications - San Diego, California, USA (Sunday 10 August 2008)] Image Reconstruction from Incomplete Data V - Spectral image estimation for coded aperture snapshot spectral imagers, 707602(2008).

    [16] D Kittle, K Choi, A Wagadarikar et al. Multiframe image estimation for coded aperture snapshot spectral imagers. Applied Optics, 49, 6824-6833(2010).

    [17] M E Gehm, R John, D J Brady et al. Single-shot compressive spectral imaging with a dual-disperser architecture. Optics Express, 15, 14013-14027(2007).

    [18] T Sun, K Kelly. Compressive sensing hyperspectral imager, CTuA5(2009).

    [19] Y August, C Vachman, Y Rivenson et al. Compressive hyperspectral imaging by random separable projections in both the spatial and the spectral domains. Applied Optics, 52, 46-54(2013).

    [20] S J Liu, X D Zhang, Y Zhang et al. Multi-frame image coded aperture snapshot spectral image technology. Journal of Infrared and Millimeter Waves, 36, 799-804(2017).

    [21] J Sun, S Wang, Y Dong. Sparse block circulant matrices for compressed sensing. Iet Communications, 7, 1412-1418(2013).

    [22] R Chartrand, W Yin. Iteratively reweighted algorithms for compressive sensing(2008).

    Shi-Jie LIU, Xing-Yu ZHANG, Hao ZHOU, Chun-Lai LI, Dong Jing LI, Hong-Xing QI, Jian-Yu WANG. Efficient information acquisition spectral imaging system based on multi-field slits[J]. Journal of Infrared and Millimeter Waves, 2023, 42(1): 50
    Download Citation