Real-Time Indoor Layout Estimation Method Based on Multi-Task Supervised Learning

Rongze Huang; Qinghao Meng; Yinbo Liu

doi:10.3788/LOP202158.1410023

[1] Izadinia H, Shan Q, Seitz S M. IM2CAD[C]. //2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 21-26, 2017, Honolulu, HI, USA., 2422-2431(2017).

[2] Liu C X, Schwing A G, Kundu K et al. Rent3D: floor-plan priors for monocular layout estimation[C]. //2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 7-12, 2015, Boston, MA, USA, 3413-3421(2015).

[3] Hedau V, Hoiem D, Forsyth D. Thinking inside the box: using appearance models and context based on room geometry[M]. //Daniilidis K, Maragos P, Paragios N. Computer vision-ECCV 2010 Lecture notes in computer science, 6316, 224-237(2010).

[4] Hedau V, Hoiem D, Forsyth D. Recovering the spatial layout of cluttered rooms[C]. //2009 IEEE 12th International Conference on Computer Vision, September 29-October 2, 2009, Kyoto, Japan., 1849-1856(2009).

[5] Wang H Y, Gould S, Koller D. Discriminative learning with latent variables for cluttered indoor scene understanding[M]. //Daniilidis K, Maragos P, Paragios N. Computer vision-ECCV 2010 Lecture notes in computer science, 6314, 497-510(2010).

[6] Mallya A, Lazebnik S. Learning informative edge maps for indoor scene layout prediction[C]. //2015 IEEE International Conference on Computer Vision (ICCV), December 7-13, 2015, Santiago, Chile., 936-944(2015).

[7] Long J, Shelhamer E, Darrell T. Fully convolutional networks for semantic segmentation[C]. //2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 7-12, 2015, Boston, MA, USA., 3431-3440(2015).

[8] Dai P Q, Ding L X, Liu L J et al. Tree species identification based on FCN using the visible images obtained from an unmanned aerial vehicle[J]. Laser & Optoelectronics Progress, 57, 101001(2020).

[9] Lee C Y, Badrinarayanan V, Malisiewicz T et al. RoomNet: end-to-end room layout estimation[C]. //2017 IEEE International Conference on Computer Vision (ICCV), October 22-29, 2017, Venice, Italy, 4875-4884(2017).

[10] Dasgupta S, Fang K, Chen K et al. DeLay: robust spatial layout estimation for cluttered indoor scenes[C]. //2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27-30, 2016, Las Vegas, NV, USA, 616-624(2016).

[11] Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition[EB/OL]. (2015-04-10)[2020-08-28]. https://arxiv.org/abs/1409.1556

[12] Wang E D, Qi K, Li X P et al. Semantic segmentation of remote sensing image based on neural network[J]. Acta Optica Sinica, 39, 1210001(2019).

[13] Romera E, Álvarez J M, Bergasa L M et al. ERFNet: efficient residual factorized ConvNet for real-time semantic segmentation[J]. IEEE Transactions on Intelligent Transportation Systems, 19, 263-272(2018). http://ieeexplore.ieee.org/document/8063438

[14] Yu F, Seff A, Zhang Y et al. Lsun: construction of a large-scale image dataset using deep learning with humans in the loop[EB/OL]. (2016-06-04)[2020-08-28]. https://arxiv.org/abs/1506.03365

[15] Yu F, Koltun V. Multi-scale context aggregation by dilated convolutions[EB/OL]. (2016-04-30)[2020-08-28]. https://arxiv.org/abs/1511.07122

[16] Cai Y, Huang X G, Zhang Z A et al. Real-time semantic segmentation algorithm based on feature fusion technology[J]. Laser & Optoelectronics Progress, 57, 021011(2020).

[17] Srivastava N, Hinton G, Krizhevsky A et al. Dropout: a simple way to prevent neural networks from overfitting[J]. The Journal of Machine Learning Research, 15, 1929-1958(2014). http://dl.acm.org/citation.cfm?id=2670313&preflayout=flat

[18] He K M, Zhang X Y, Ren S Q et al. Deep residual learning for image recognition[C]. //2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27-30, 2016, Las Vegas, NV, USA., 770-778(2016).

[19] Gao Z T, Wang L M, Wu G S. LIP: local importance-based pooling[C]. //2019 IEEE/CVF International Conference on Computer Vision (ICCV), October 27-November 2, 2019, Seoul, Korea (South), 3354-3363(2019).

[20] Ioffe S, Szegedy C. Batch normalization: accelerating deep network training by reducing internal covariate shift[EB/OL]. (2015-03-02)[2020-08-28]. https://arxiv.org/abs/1502.03167

[21] Chen L C, Barron J T, Papandreou G et al. Semantic image segmentation with task-specific edge detection using CNNs and a discriminatively trained domain transform[C]. //2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27-30, 2016, Las Vegas, NV, USA., 4545-4554(2016).

[22] Liu T L, Gu Y Q, Cao D D et al. A coarse-to-fine estimation method for spatial layout of indoor scenes[J]. Robot, 41, 58-64(2019).

[23] Zhang W D, Zhang W, Liu K et al. Learning to predict high-quality edge maps for room layout estimation[J]. IEEE Transactions on Multimedia, 19, 935-943(2017).

[24] Ren Y Z, Li S W, Chen C et al. A coarse-to-fine indoor layout estimation (CFILE) method[M]. //Leibe B, Matas J, Sebe N, et al. Computer vision-ACCV 2016 Lecture notes in computer science, 10115, 36-51(2017).