• Journal of Infrared and Millimeter Waves
  • Vol. 40, Issue 1, 108 (2021)
Wen-Jun SHI1, Deng-Wei WANG2、3、*, Wan-Suo LIU1, and Da-Gang JIANG2、3
Author Affiliations
  • 1Aviation Maintenance School for NCO,Air Force Engineering University,Xinyang 464000,China
  • 2School of Aeronautics and Astronautics,University of Electronic Science and Technology of China,Chengdu 611731,China
  • 3Aircraft Swarm Intelligent Sensing and Cooperative Control Key Laboratory of Sichuan Province,Chengdu 611731,China
  • show less
    DOI: 10.11972/j.issn.1001-9014.2021.01.016 Cite this Article
    Wen-Jun SHI, Deng-Wei WANG, Wan-Suo LIU, Da-Gang JIANG. GPU accelerated level set model solving by lattice boltzmann method with application to image segmentation[J]. Journal of Infrared and Millimeter Waves, 2021, 40(1): 108 Copy Citation Text show less
    Explanation of how to adaptively determine the weight coefficient of global fitting term
    Fig. 1. Explanation of how to adaptively determine the weight coefficient of global fitting term
    Spatial structure of the D2Q9 LBM lattic
    Fig. 2. Spatial structure of the D2Q9 LBM lattic
    The flowchart the proposed GPU accelerated segmentation model
    Fig. 3. The flowchart the proposed GPU accelerated segmentation model
    Segmentation comparisons of C-V model, K-means model, PCNN model and our method on five laser radar range images.The first row: Input images along with initial contours,the second row: C-V model, the third row: K-means model,the fourth row: PCNN model;the fifth row: our model.
    Fig. 4. Segmentation comparisons of C-V model, K-means model, PCNN model and our method on five laser radar range images.The first row: Input images along with initial contours,the second row: C-V model, the third row: K-means model,the fourth row: PCNN model;the fifth row: our model.
    The segmentation results on several sampleimagesof the PASCAL VOC 2012 dataset.The first column shows the input images along with initial contours, and the second to fifth columns is the segmentation results by using C-V, K-means, PCNNand our models respectively
    Fig. 5. The segmentation results on several sampleimagesof the PASCAL VOC 2012 dataset.The first column shows the input images along with initial contours, and the second to fifth columns is the segmentation results by using C-V, K-means, PCNNand our models respectively
    Quantitative evaluation results of four different comparison algorithms on VOC 2012 dataset.The sub-graphs (a) and (b) are the statistical distributions of the two metrics JS and DSC, respectively. Any single boxplot corresponds to the comprehensive response results of an algorithm participating in the comparison on the VOC 2012 dataset.
    Fig. 6. Quantitative evaluation results of four different comparison algorithms on VOC 2012 dataset.The sub-graphs (a) and (b) are the statistical distributions of the two metrics JS and DSC, respectively. Any single boxplot corresponds to the comprehensive response results of an algorithm participating in the comparison on the VOC 2012 dataset.
    Segmentation comparisons of our model with LBF model on an infrared human body image under three different initializations.The first row: Input images along with initial contours; the second row: Final segmentation results of LBF model; the third row:Final segmentation results of our model
    Fig. 7. Segmentation comparisons of our model with LBF model on an infrared human body image under three different initializations.The first row: Input images along with initial contours; the second row: Final segmentation results of LBF model; the third row:Final segmentation results of our model
    Segmentation comparisons of our model with LBF model on an infrared pig image under three different initializations.The first row: Input images along with initial contours; the second row: Final segmentation results of LBF model; the third to fifth rows: Three intermediate results of our model; the sixth row:Final segmentation results of our model
    Fig. 8. Segmentation comparisons of our model with LBF model on an infrared pig image under three different initializations.The first row: Input images along with initial contours; the second row: Final segmentation results of LBF model; the third to fifth rows: Three intermediate results of our model; the sixth row:Final segmentation results of our model
    The statistical results corresponding to the evolution process shown in Fig. 8.The first row is the global mean image at convergence state, the second to third rows are the numerical distribution images of e1 and e2at convergence state, the fourth row is the energy variation curve with respect to the evolution time, and the fifth row is the evolution process of three-dimensional stacking form.
    Fig. 9. The statistical results corresponding to the evolution process shown in Fig. 8.The first row is the global mean image at convergence state, the second to third rows are the numerical distribution images of e1 and e2at convergence state, the fourth row is the energy variation curve with respect to the evolution time, and the fifth row is the evolution process of three-dimensional stacking form.
    A set of experiments to test the rapidity of evolution process.The first row is the input images along with initial curves, the second to fourth rows are three intermediate results of the evolution process, and the fifth row is the final segmentation results.
    Fig. 10. A set of experiments to test the rapidity of evolution process.The first row is the input images along with initial curves, the second to fourth rows are three intermediate results of the evolution process, and the fifth row is the final segmentation results.
    The statistical results corresponding to the experimental process shown in Fig. 10.The first row is the global mean image at convergence state, the second to third rows are the numerical distribution images of e1 and e2at convergence state, the fourth row is the energy variation curve with respect to the evolution time, and the fifth row is the evolution process of three-dimensional stacking form.
    Fig. 11. The statistical results corresponding to the experimental process shown in Fig. 10.The first row is the global mean image at convergence state, the second to third rows are the numerical distribution images of e1 and e2at convergence state, the fourth row is the energy variation curve with respect to the evolution time, and the fifth row is the evolution process of three-dimensional stacking form.
    The test image used to verify the effect of adaptive weighting coefficient on segmentation results and the different expressions of adaptive weighting coefficients. (a) Example image with two sampling points A and B; (b) The image representation form of the adaptive weighting matrix and the coefficient values corresponding to the two sampling points in (a); (c) The 3D surface representation of adaptive weighting coefficient matrix.
    Fig. 12. The test image used to verify the effect of adaptive weighting coefficient on segmentation results and the different expressions of adaptive weighting coefficients. (a) Example image with two sampling points A and B; (b) The image representation form of the adaptive weighting matrix and the coefficient values corresponding to the two sampling points in (a); (c) The 3D surface representation of adaptive weighting coefficient matrix.
    A verification experiment used to test the effect of adaptive weighting coefficients on segmentation results (a) Input image along with initial contour; (b) Segmentation result when regional term plays a dominant role; (c) Segmentation result when edge term plays a dominant role; (d) Segmentation result returned by the proposed model.
    Fig. 13. A verification experiment used to test the effect of adaptive weighting coefficients on segmentation results (a) Input image along with initial contour; (b) Segmentation result when regional term plays a dominant role; (c) Segmentation result when edge term plays a dominant role; (d) Segmentation result returned by the proposed model.
    The relationship between function δεnewx and its independent variable x under different parameter ε
    Fig. 14. The relationship between function δεnewx and its independent variable x under different parameter ε
    MethodLevel set equationτand F
    C-V modelϕt=δεϕμdivϕϕ-ν-        λ1CVI-Min2+λ2CVI-Mout2

    τ=94μδεϕ+0.5,

    F=δεϕ-ν-λ1CVI-Min2+     λ2CVI-Mout2

    LBF modelϕt=-δεϕλ1LBFe1-λ2LBFe2/
    Our modelϕt=       wδεϕ-λ1CVI-Min2+λ2CVI-Mout2-       δεϕλ1LBFe1-λ2LBFe2+       μΔϕ-divϕϕ+      νδεϕdivϕϕ

    τ=94νδεϕ-μ+0.5,

    F=wδεϕ-λ1CVI-Min2+      λ2CVI-Mout2-      δεϕλ1LBFe1-λ2LBFe2+      μΔϕ

    Table 1. Corresponding forms of τ and F in D2Q9 LBM equation for level set methods
    Image No.AlgorithmMetrics (JS-DSC)
    image #1CV0.6533 0.7903
    K-means0.5172 0.6818
    PCNN0.5625 0.7200
    Our method0.9757 0.9877
    image #2CV0.7285 0.8429
    K-means0.7340 0.8466
    PCNN0.7290 0.8432
    Our method0.9598 0.9795
    image #3CV0.5026 0.6690
    K-means0.6124 0.7596
    PCNN0.6676 0.8007
    Our method0.9897 0.9948
    image #4CV0.6713 0.8033
    K-means0.7292 0.8434
    PCNN0.7043 0.8265
    Our method0.9807 0.9903
    image #5CV0.4389 0.6100
    K-means0.2642 0.4180
    PCNN0.5068 0.6726
    Our method0.9726 0.9861
    Table 2. Segmentation metrics for the five images in Fig. 4numberedin order from left to right
    Input No.AlgorithmIterationsTime cost (s)Accelerated rate

    image #1

    (320×240 pixels)

    HFE27223.1671.0
    HFE +LBM+CPU1139.6532.4
    HFE +LBM+GPU1130.209110.7

    image #2

    (320×240 pixels)

    HFE18213.1951.0
    HFE +LBM+CPU584.2563.1
    HFE +LBM+GPU580.110120.5

    image #3

    (320×240 pixels)

    HFE39934.5171.0
    HFE +LBM+CPU13711.9022.9
    HFE +LBM+GPU1370.293117.9
    Table 3. Comparisons of speed metrics of evolution process for the three images in Fig. 10 numbered in order from left to right
    Wen-Jun SHI, Deng-Wei WANG, Wan-Suo LIU, Da-Gang JIANG. GPU accelerated level set model solving by lattice boltzmann method with application to image segmentation[J]. Journal of Infrared and Millimeter Waves, 2021, 40(1): 108
    Download Citation