• Opto-Electronic Engineering
  • Vol. 51, Issue 7, 240078 (2024)
Yanqiong Shi, Yonghui Yang*, Zhao Zha, Guang Zhu, and Yu Zheng
Author Affiliations
  • School of Mechanical and Electrical Engineering, Anhui Jianzhu University, Hefei, Anhui 230601, China
  • show less
    DOI: 10.12086/oee.2024.240078 Cite this Article
    Yanqiong Shi, Yonghui Yang, Zhao Zha, Guang Zhu, Yu Zheng. Color space focusing evaluation algorithm for color overlay microscopy[J]. Opto-Electronic Engineering, 2024, 51(7): 240078 Copy Citation Text show less
    Ideal focus evaluation curve
    Fig. 1. Ideal focus evaluation curve
    RGB pixel mapping grayscale pixels
    Fig. 2. RGB pixel mapping grayscale pixels
    RGB color space
    Fig. 3. RGB color space
    Simulated image sequence
    Fig. 4. Simulated image sequence
    Normalized focused evaluation curve for simulation images. (a) Table pixel focusing evaluation curve; (b) Boxes pixel focus evaluation curve; (c) Sideboard pixel focus evaluation curve
    Fig. 5. Normalized focused evaluation curve for simulation images. (a) Table pixel focusing evaluation curve; (b) Boxes pixel focus evaluation curve; (c) Sideboard pixel focus evaluation curve
    Simulated image with noise
    Fig. 6. Simulated image with noise
    Normalized focusing evaluation curve of noisy simulation images. (a) Table pixel focusing evaluation curve; (b) Boxes pixel focus evaluation curve; (c) Sideboard pixel focus evaluation curve
    Fig. 7. Normalized focusing evaluation curve of noisy simulation images. (a) Table pixel focusing evaluation curve; (b) Boxes pixel focus evaluation curve; (c) Sideboard pixel focus evaluation curve
    Comparison between all-in-focus reference image and stacked focal fusion image. (a) Reference image; (b) Proposed fusion image; (c) SML fusion image; (d) Tenengrad fusion image; (e) GLV fusion image; (f) DCT fusion image; (g) SWAV fusion image; (h) Bre4d_var fusion image; (i) FMC fusion image
    Fig. 8. Comparison between all-in-focus reference image and stacked focal fusion image. (a) Reference image; (b) Proposed fusion image; (c) SML fusion image; (d) Tenengrad fusion image; (e) GLV fusion image; (f) DCT fusion image; (g) SWAV fusion image; (h) Bre4d_var fusion image; (i) FMC fusion image
    Microscopic image acquisition. (a) Digital microscopy system; (b) Wafer samples; (c) Chip samples
    Fig. 9. Microscopic image acquisition. (a) Digital microscopy system; (b) Wafer samples; (c) Chip samples
    Multi focus image sequence captured by microscope
    Fig. 10. Multi focus image sequence captured by microscope
    Normalized focusing evaluation curve of microscopic images. (a) Pixel focusing evaluation curve of wafer surface; (b) Chip bonding wire pixel focusing evaluation curve
    Fig. 11. Normalized focusing evaluation curve of microscopic images. (a) Pixel focusing evaluation curve of wafer surface; (b) Chip bonding wire pixel focusing evaluation curve
    Chip bonding wire overlay fusion image. (a) Proposed; (b) SML; (c) Tenengrad;(d) GLV; (e) DCT; (f) SWAV; (g) Bre4d_var; (h) FMC
    Fig. 12. Chip bonding wire overlay fusion image. (a) Proposed; (b) SML; (c) Tenengrad;(d) GLV; (e) DCT; (f) SWAV; (g) Bre4d_var; (h) FMC
    Wafer surface overlay fusion image. (a) Proposed; (b) SML; (c) Tenengrad; (d) GLV; (e) DCT; (f) SWAV; (g) Bre4d_var; (h) FMC
    Fig. 13. Wafer surface overlay fusion image. (a) Proposed; (b) SML; (c) Tenengrad; (d) GLV; (e) DCT; (f) SWAV; (g) Bre4d_var; (h) FMC
    AlgorithmSeSpSv
    TableBoxesSideboardTableBoxesSideboardTableBoxesSideboard
    SML[15]0.03140.44680.50890.15160.15230.16030.04070.05660.0434
    Tenengrad[16]0.01850.40890.13570.27300.03630.0279
    GLV[19]0.01800.50200.13340.27470.04080.0275
    DCT[18]0.14680.10990.0557
    SWAV[17]0.04340.61110.64790.19420.21350.18860.04460.04990.0469
    Bre4d_var[25]0.04300.94200.19950.32480.02750.0211
    FMC[21]1.64601.54130.32640.20900.03750.0652
    Proposed0.05651.70561.69630.34370.35620.33720.01380.01860.0144
    Table 1. Performance comparison of focusing evaluation algorithms in simulated images
    AlgorithmSeSpSv
    TableBoxesSideboardTableBoxesSideboardTableBoxesSideboard
    SML[15]1.14290.37310.40450.06660.20730.10520.11090.18120.1343
    Tenengrad[16]0.21840.13560.0607
    GLV[19]0.20070.47340.13350.20330.06640.0441
    DCT[18]
    SWAV[17]1.17980.73840.41530.16490.22010.18920.07680.11500.1290
    Bre4d_var[25]0.39971.32920.20020.23810.04080.0275
    FMC[21]2.29690.52920.0933
    Proposed1.55842.78642.32090.34500.52840.53030.02630.02660.0173
    Table 2. Performance comparison of focused evaluation algorithms for noisy simulated images
    AlgorithmSSIMMSE/103PSNR/dB
    TableBoxesSideboardTableBoxesSideboardTableBoxesSideboard
    SML[15]0.98070.96120.91251.1931.4546.00334.44732.32126.989
    Tenengrad[16]0.97890.94930.92671.7651.8613.52834.05132.24727.795
    GLV[19]0.97180.95330.92031.6071.7442.75134.20433.00927.863
    DCT[18]0.96450.92370.91321.7742.1562.98833.22132.11928.017
    SWAV[17]0.97090.95630.95181.1511.5755.27234.69133.15127.552
    Bre4d_var[25]0.97910.96550.95490.9861.4602.76534.83533.12730.355
    FMC[21]0.97980.96540.95910.9291.4702.52535.09133.09830.749
    Proposed0.98240.97020.96340.8561.4042.25435.44733.29730.827
    Table 3. Objective evaluation indicators for image fusion quality with reference
    AlgorithmSeSpSv
    WaferWireWaferWireWaferWire
    SML[15]0.0692110.0538870.1315350.1452140.0383500.057453
    Tenengrad[16]0.1646690.1316340.1958860.2262350.0204960.033131
    GLV[19]0.0939960.0997310.1970760.2148170.0197430.036844
    DCT[18]0.0634700.0949700.1988030.1998340.0172330.034720
    SWAV[17]0.0850890.1249620.103253
    Bre4d_var[25]0.3039900.3522390.2215130.1968650.0371800.038064
    FMC[21]0.2792250.2202620.019089
    Proposed0.5405210.4904540.2325810.2857450.0067710.013223
    Table 4. Performance comparison of focusing evaluation algorithms in microscopic images
    AlgorithmVG¯E
    WaferWireWaferWireWaferWire
    SML[15]53.030056.64245.21577.312922.370724.0012
    Tenengrad[16]51.423355.88145.50697.202522.359523.3725
    GLV[19]51.565055.84635.02377.092822.512722.5874
    DCT[18]53.992855.00125.36717.036422.296723.1296
    SWAV[17]52.772756.31654.86816.962121.123123.5237
    Bre4d_var[25]53.524356.60695.60327.285122.344123.9367
    FMC[21]52.692055.93065.54437.312622.358323.9773
    Proposed54.270658.38825.70127.387723.355725.1254
    Table 5. Objective evaluation indicators for image fusion quality without reference
    Yanqiong Shi, Yonghui Yang, Zhao Zha, Guang Zhu, Yu Zheng. Color space focusing evaluation algorithm for color overlay microscopy[J]. Opto-Electronic Engineering, 2024, 51(7): 240078
    Download Citation