• Laser & Optoelectronics Progress
  • Vol. 59, Issue 8, 0810012 (2022)
Yunzuo Zhang*, Wenxuan Li, and Panliang Yang
Author Affiliations
  • School of Information Science and Technology, Shijiazhuang Tiedao University, Shijiazhuang , Hebei 050043, China
  • show less
    DOI: 10.3788/LOP202259.0810012 Cite this Article Set citation alerts
    Yunzuo Zhang, Wenxuan Li, Panliang Yang. Segmentation of Surveillance Video of Motion Segments Based on Spatiotemporal Flow[J]. Laser & Optoelectronics Progress, 2022, 59(8): 0810012 Copy Citation Text show less
    Schematic of spatio-temporal flow model
    Fig. 1. Schematic of spatio-temporal flow model
    Flow of surveillance video motion segment segmentation based on spatio-temporal flow
    Fig. 2. Flow of surveillance video motion segment segmentation based on spatio-temporal flow
    Video frame boundaries and spatio-temporal profiles. (a) Frame boundaries; (b) spatio-temporal profiles
    Fig. 3. Video frame boundaries and spatio-temporal profiles. (a) Frame boundaries; (b) spatio-temporal profiles
    Video spatio-temporal profiles
    Fig. 4. Video spatio-temporal profiles
    Viewing the video profile as a video
    Fig. 5. Viewing the video profile as a video
    Spatio-temporal profiles after target extraction
    Fig. 6. Spatio-temporal profiles after target extraction
    Schematic of the sub-boundary
    Fig. 7. Schematic of the sub-boundary
    ‍Video spatio-temporal flow curve and accumulative spatio-temporal flow curve. (a) Video spatio-temporal flow curve; (b) video accumulative spatio-temporal flow curve
    Fig. 8. ‍Video spatio-temporal flow curve and accumulative spatio-temporal flow curve. (a) Video spatio-temporal flow curve; (b) video accumulative spatio-temporal flow curve
    Corrected video spatio-temporal flow curve and corrected accumulative spatio-temporal flow curve. (a) Corrected video spatio-temporal flow curve; (b) corrected video accumulative spatio-temporal flow curve
    Fig. 9. Corrected video spatio-temporal flow curve and corrected accumulative spatio-temporal flow curve. (a) Corrected video spatio-temporal flow curve; (b) corrected video accumulative spatio-temporal flow curve
    Schematic of self-collected surveillance videos
    Fig. 10. Schematic of self-collected surveillance videos
    Video4's spatio-temporal flow curve and accumulative spatio-temporal flow curve. (a) Spatio-temporal flow curve; (b) accumulative spatio-temporal flow curve
    Fig. 11. Video4's spatio-temporal flow curve and accumulative spatio-temporal flow curve. (a) Spatio-temporal flow curve; (b) accumulative spatio-temporal flow curve
    Some of Video4's frames correspond to the spatio-temporal flow jumps
    Fig. 12. Some of Video4's frames correspond to the spatio-temporal flow jumps
    Video5's accumulative spatio-temporal flow curve and partial video frames
    Fig. 13. Video5's accumulative spatio-temporal flow curve and partial video frames
    Video sequenceFrame rate /(frame⋅s-1Resolution ratioNumber of frames
    Video128720×4801679
    Video228544×9601342
    Video329720×480975
    Video429720×576569
    Video529720×480578
    Video630720×480390
    Video727960×544180
    Video829960×544552
    Video9291920×10805887
    Video10291920×10804002
    Video1125720×480892
    Video1225160×120741
    Video1325384×288293
    Video1425384×288381
    Video1525384×2882358
    Table 1. Basic information of experimental videos
    MethodAverage accuracy/%Average recall/%Average F1/%Average run time/s
    Pixel difference484.4380.9582.38357.30
    PMHI668.1094.5477.16706.82
    Improved optical flow1883.6284.7683.78468.51
    Proposed method89.1188.8188.2561.67
    Table 2. Comparison of experimental results
    Yunzuo Zhang, Wenxuan Li, Panliang Yang. Segmentation of Surveillance Video of Motion Segments Based on Spatiotemporal Flow[J]. Laser & Optoelectronics Progress, 2022, 59(8): 0810012
    Download Citation