Action Recognition Based on Adaptive Fusion of RGB and Skeleton Features

Fuzheng Guo; Jun Kong; Min Jiang

doi:10.3788/LOP57.201506

[1] Wang H, Schmid C. Action recognition with improved trajectories[C]∥2013 IEEE International Conference on Computer Vision, December 1-8, 2013, Sydney, NSW, Australia., 3551-3558(2013).

[2] Li C J, Liu Y. Abnormal driving behavior detection based on covariance manifold and LogitBoost[J]. Laser & Optoelectronics Progress, 55, 111503(2018).

[3] Xu H Y, Kong J, Jiang M. Human action recognition based on quaternion 3D skeleton representation[J]. Laser & Optoelectronics Progress, 55, 021002(2018).

[4] Xu H Y, Kong J, Jiang M et al. Action recognition based on histogram of spatio-temporal oriented principal components[J]. Laser & Optoelectronics Progress, 55, 061009(2018).

[5] Hu J F, Zheng W S, Lai J H et al. Jointly learning heterogeneous features for RGB-D activity recognition[C]∥2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 7-12, 2015, Boston, MA, USA., 5344-5352(2015).

[6] Liu T S, Kong J, Jiang M. RGB-D action recognition using multimodal correlative representation learning model[J]. IEEE Sensors Journal, 19, 1862-1872(2019). http://www.researchgate.net/publication/329391711_RGB-D_Action_Recognition_Using_Multimodal_Correlative_Representation_Learning_Model

[7] Chéron G, Laptev I. Cordelia. P-, 3218-3226(2015).

[8] Baradel F, Wolf C. -08-07)[2019-12-18]. https: ∥arxiv., org/abs/1703, 10106(2017).

[9] ChoutasV, WeinzaepfelP, RevaudJ, et al.PoTion: pose MoTion representation for action recognition[C]∥2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 18-23, 2018, Salt Lake City, UT, USA. New York: IEEE Press, 2018: 7024- 7033.

[10] Luvizon D C, Picard D, Tabia H. 2D/3D pose estimation and action recognition using multitask deep learning[C]∥2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 18-23, 2018, Salt Lake City, UT, USA., 5137-5146(2018).

[11] El-Ghaish H, Hussien M E, Shoukry A et al. Human action recognition based on integrating body pose, part shape, and motion[J]. IEEE Access, 6, 49040-49055(2018). http://www.researchgate.net/publication/327408986_Human_Action_Recognition_Based_on_Integrating_Body_Pose_Part_Shape_and_Motion

[12] Luvizon D C, Tabia H, action recognition[EB/OL]. -12-15)[2019-12-18]. https: ∥arxiv., org/abs/1912, 08077(2019).

[13] Cai Z, Neher H, Vats K, Optical Flows[EB/OL] et al. -12-22)[2019-12-18]. https: ∥arxiv.org/pdf/1812.09533.pdf.(2018).

[14] Simonyan K. -04-10)[2019-12-18]. https: ∥arxiv., org/abs/1409, 1556(2015).

[15] Cao Z, Simon T, Wei S et al. Realtime multi-person 2D pose estimation using part affinity fields[C]∥2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 21-26, 2017, Honolulu, HI, USA., 1302-1310(2017).

[16] Nie B X, Xiong C M, Zhu S C. Joint action recognition and pose estimation from video[C]∥2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 7-12, 2015, Boston, MA, USA., 1293-1301(2015).

[17] ZhangW, ZhuM, Derpanis KG. From actemes to action: a strongly-supervised representation for detailed action understanding[C]∥Proceedings of the IEEE International Conference on Computer Vision, December 1-8, 2013, Sydney, NSW, Australia. New York: IEEE Press, 2013: 2248- 2255.

[18] Cao C, Zhang Y, Zhang C et al. Action recognition with joints-pooled 3D deep convolutional descriptors. [C]∥ Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence. New York: ACM, 3324-3330(2016).

[19] Iqbal U, Garbade M, Gall J. Pose for action-action for pose[C]∥2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017), May 30 - June 3, 2017, Washington, DC, USA., 438-445(2017).

[20] Khalid M U, Yu J. Multi-modal three-stream network for action recognition[C]∥2018 24th International Conference on Pattern Recognition (ICPR), August 20-24, 2018, Beijing, China., 3210-3215(2018).

[21] Du WB, Wang YL, QiaoY. RPAN: an end-to-end recurrent pose-attention network for action recognition in videos[C]∥2017 IEEE International Conference on Computer Vision (ICCV), October 22-29, 2017, Venice, Italy. New York: IEEE Press, 2017: 3745- 3754.

[22] Liu M Y, Meng F Y, Chen C et al. Joint dynamic pose image and space time reversal for human action recognition from videos. [C]∥Proceedings of the AAAI Conference on Artificial Intelligence, Reston, VA: AIAA, 33, 8762-8769(2019).

[23] Peng X, Schmid C. Multi-region two-stream R-CNN for action detection. [C]∥European Conference on Computer Vision. Cham: Springer, 744-759(2016).

[24] McNally W, Wong A, McPhee J. STAR-, 49-56(2019).

[25] Javidani A. -02-19) [2019-12-18]. https: ∥arxiv., org/abs/1802, 06724(2018).

[26] Song S J, Lan C L, Xing J L et al. -11-18)[2019-12-18]. https: ∥arxiv., org/abs/1611, 06067(2016).

[27] Zhang P F, Lan C L, Xing J L et al[J]. View adaptive recurrent neural networks for high performance human action recognition from skeleton data 2017 IEEE International Conference on Computer Vision (ICCV), October 22-29, 2017, Venice, Ital, 2136-2145(2017).

[28] Yan S J, Xiong Y J. -01-23)[2019-12-18]. https: ∥arxiv., org/abs/1801, 07455(2018).

[29] Li C, Zhong Q Y, Xie D et al. Skeleton-based action recognition with convolutional neural networks[C]∥2017 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), July 10-14, 2017, Hong Kong, China., 597-600(2017).

[31] Li C, Zhong Q Y, Xie D, detection with hierarchical aggregation[EB/OL] et al. -04-17)[2019-12-18]. https: ∥arxiv., org/abs/1804, 06055(2018).

[32] Si C Y, Jing Y, Wang W et al. Skeleton-based action recognition with spatial reasoning and temporal stack learning network[J]. Pattern Recognition, 107, 107511(2020).