• Laser & Optoelectronics Progress
  • Vol. 58, Issue 24, 2410002 (2021)
Ming Yu, Jijun Zhang, Yingchun Guo*, Meng Zhang, and Dan Wang
Author Affiliations
  • School of Artificial Intelligence, Hebei University of Technology, Tianjin 300401, China
  • show less
    DOI: 10.3788/LOP202158.2410002 Cite this Article Set citation alerts
    Ming Yu, Jijun Zhang, Yingchun Guo, Meng Zhang, Dan Wang. Image Aesthetics Retargeting Algorith Based on Multi-Level Attention Fusion[J]. Laser & Optoelectronics Progress, 2021, 58(24): 2410002 Copy Citation Text show less
    References

    [1] Avidan S, Shamir A. Seam carving for content-aware image resizing[J]. ACM Transactions on Graphics, 26, 10-18(2007).

    [2] Mansfield A, Gehler P, van Gool L et al. Scene carving: scene consistent image retargeting[M]. // Daniilidis K, Maragos P, Paragios N. Computer vision-ECCV 2010. Lecture notes in computer science, 6311, 143-156(2010).

    [3] Wu J Y, Yang S, Du J et al. Image retargeting with seam-carving combining saliency and depth information[J]. Acta Electronica Sinica, 47, 1547-1550(2019).

    [4] Guo Y C, Liang Y H, Yu M et al. An improved seam carving algorithm based on image blocking and optimized cumulative energy map[J]. Journal of Electronics & Information Technology, 40, 331-337(2018).

    [5] Wang Y S, Tai C L, Sorkine O et al. Optimized scale-and-stretch for image resizing[C]. //ACM SIGGRAPH Asia 2008 papers on-SIGGRAPH Asia’08, December 10-13, 2008. Singapore., 110-118(2008).

    [6] Zhang G X, Cheng M M, Hu S M et al. A shape-preserving approach to image resizing[J]. Computer Graphics Forum, 28, 1897-1906(2009).

    [7] Lin S S, Yeh I C, Lin C H et al. Patch-based image warping for content-aware retargeting[J]. IEEE Transactions on Multimedia, 15, 359-368(2013).

    [8] Rubinstein M, Shamir A, Avidan S. Multi-operator media retargeting[J]. ACM Transactions on Graphics, 28, 1-11(2009).

    [9] Cui J, Cai Q Q, Lu H J et al. Distortion-aware image retargeting based on continuous seam carving model[J]. Signal Processing, 166, 107242(2020).

    [10] Zhou Y, Chen Z B, Li W P. Weakly supervised reinforced multi-operator image retargeting[J]. IEEE Transactions on Circuits and Systems for Video Technology, 31, 126-139(2021).

    [11] Hwang D S, Chien S Y. Content-aware image resizing using perceptual seam carving with human attention model[C]. //2008 IEEE International Conference on Multimedia and Expo, June 23-April 26, 2008, Hannover, Germany., 1029-1032(2008).

    [12] Cho D, Park J, Oh T H et al. Weakly- and self-supervised learning for content-aware deep image retargeting[C]. //2017 IEEE International Conference on Computer Vision (ICCV), October 22-29, 2017, Venice, Italy., 4568-4577(2017).

    [13] Lin J X, Zhou T K, Chen Z B. DeepIR: a deep semantics driven framework for image retargeting[C]. //2019 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), July 8-12, 2019, Shanghai, China, 54-59(2019).

    [14] Zhou Y Z, Zhang L M, Zhang C et al. Perceptually aware image retargeting for mobile devices[J]. IEEE Transactions on Image Processing, 27, 2301-2313(2018).

    [15] Tan W M, Yan B, Lin C M et al. Cycle-IR: Deep cyclic image retargeting[J]. IEEE Transactions on Multimedia, 22, 1730-1743(2020).

    [16] Shocher A, Bagon S, Isola P et al. InGAN: capturing and retargeting the “DNA” of a natural image[C]. //2019 IEEE/CVF International Conference on Computer Vision (ICCV), October 27-November 2, 2019, Seoul, Korea (South), 4491-4500(2019).

    [17] Zeiler M D, Fergus R. Visualizing and understanding convolutional networks[M]. //Fleet D, Pajdla T, Schiele B, et al. Computer vision-ECCV 2014. Lecture notes in computer science, 8689, 818-833(2014).

    [18] Datta R, Joshi D, Li J et al. Studying aesthetics in photographic images using a computational approach[M]. //Leomardis A, Bischof H, Pinz A. Computer vision-ECCV 2006. Lecture notes in computer science, 3953, 288-301(2006).

    [19] Murray N, Marchesotti L, Perronnin F. AVA: A large-scale database for aesthetic visual analysis[C]. //2012 IEEE Conference on Computer Vision and Pattern Recognition, June 16-21, 2012, Providence, RI, USA, 2408-2415(2012).

    [20] Kao Y Y, He R, Huang K Q. Deep aesthetic quality assessment with semantic information[J]. IEEE Transactions on Image Processing, 26, 1482-1495(2017).

    [21] Zhang L M, Yin J W, Li P et al. Flickr image community analytics by deep noise-refined matrix factorization[J]. IEEE Transactions on Multimedia, 22, 1273-1284(2020).

    [22] Hosu V, Goldlücke B, Saupe D. Effective aesthetics prediction with multi-level spatially pooled features[C]. //2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 15-20, 2019, Long Beach, CA, USA., 9367-9375(2019).

    [23] Kao Y Y, He R, Huang K Q. Automatic image cropping with aesthetic map and gradient energy map[C]. //2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), March 5-9, 2017, New Orleans, LA, USA., 1982-1986(2017).

    [24] Li D B, Wu H K, Zhang J G et al. A2-RL: Aesthetics aware reinforcement learning for image cropping[C]. //2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 18-23, 2018, Salt Lake City, UT, USA, 8193-8201(2018).

    [25] Wang W G, Shen J B, Ling H B. A deep network solution for attention and aesthetics aware photo cropping[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 41, 1531-1544(2019).

    [26] Itti L, Koch C, Niebur E. A model of saliency-based visual attention for rapid scene analysis[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20, 1254-1259(1998).

    [27] Schölkopf B, Platt J, Hofmann T. Graph-based visual saliency[M]. //Advances in neural information processing systems, 545-552(2007).

    [28] Zhu W J, Liang S, Wei Y C et al. Saliency optimization from robust background detection[C]. //2014 IEEE Conference on Computer Vision and Pattern Recognition, June 23-28, 2014, Columbus, OH, USA., 2814-2821(2014).

    [29] Ramponi G. Warped distance for space-variant linear image interpolation[J]. IEEE Transactions on Image Processing, 8, 629-639(1999).

    [30] Talebi H, Milanfar P. NIMA: neural image assessment[J]. IEEE Transactions on Image Processing, 27, 3998-4011(2018).

    [31] Lu X, Lin Z, Shen X H et al. Deep multi-patch aggregation network for image style, aesthetics, and quality estimation[C]. //2015 IEEE International Conference on Computer Vision (ICCV), December 7-13, 2015, Santiago, Chile., 990-998(2015).

    [32] Hii Y L, See J, Kairanbay M et al. Multigap: Multi-pooled inception network with text augmentation for aesthetic prediction of photographs[C]. //2017 IEEE International Conference on Image Processing (ICIP), September 17-20, 2017, Beijing, China, 1722-1726(2017).

    [33] Mai L, Jin H L, Liu F. Composition-preserving deep photo aesthetics assessment[C]. //2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27-30, 2016, Las Vegas, NV, USA., 497-506(2016).

    [34] Kong S, Shen X H, Lin Z et al. Photo aesthetics ranking network with attributes and content adaptation[M]. //Leibe B, Matas J, Sebe N, et al. Computer vision-ECCV 2016. Lecture notes in computer science, 9905, 662-679(2016).

    [35] Ma S, Liu J, Chen C W. A-lamp: Adaptive layout-aware multi-patch deep convolutional neural network for photo aesthetic assessment[C]. //2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 21-26, 2017, Honolulu, HI, USA, 722-731(2017).

    [36] Liu Y J, Luo X, Xuan Y M et al. Image retargeting quality assessment[J]. Computer Graphics Forum, 30, 583-592(2011).

    Ming Yu, Jijun Zhang, Yingchun Guo, Meng Zhang, Dan Wang. Image Aesthetics Retargeting Algorith Based on Multi-Level Attention Fusion[J]. Laser & Optoelectronics Progress, 2021, 58(24): 2410002
    Download Citation