Journals
Advanced Photonics
Photonics Insights
Advanced Photonics Nexus
Photonics Research
Advanced Imaging
View All Journals
Chinese Optics Letters
High Power Laser Science and Engineering
Articles
Optics
Physics
Geography
View All Subjects
Conferences
CIOP
HPLSE
AP
View All Events
News
About CLP
Search by keywords or author
Login
Registration
Login in
Registration
Search
Search
Articles
Journals
News
Advanced Search
Top Searches
metasurface
laser
polarization
nir
lithium niobate
optical coherence tomography
Journals >
Opto-Electronic Engineering >
Volume 49 >
Issue 7 >
Page 210429 > Article
Opto-Electronic Engineering
Vol. 49, Issue 7, 210429 (2022)
Interactive instance proposal network for HOI detection
Lixia Xue, Kaijian Yin, Ronggui Wang, and Juan Yang
*
Author Affiliations
School of Computer and Information, Hefei University of Technology, Hefei, Anhui 230031, China
show less
DOI:
10.12086/oee.2022.210429
Cite this Article
Lixia Xue, Kaijian Yin, Ronggui Wang, Juan Yang. Interactive instance proposal network for HOI detection[J]. Opto-Electronic Engineering, 2022, 49(7): 210429
Copy Citation Text
EndNote(RIS)
BibTex
Plain Text
show less
Fig. 1.
Pipeline of human object interaction detection
Download full size
|
View in the Article
Fig. 2.
Overview of human object interaction detection based on interactive instance proposal network
Download full size
|
View in the Article
Fig. 3.
Interactive instance proposal network
Download full size
|
View in the Article
Fig. 4.
Structure of cross-modal information fusion module
Download full size
|
View in the Article
Fig. 5.
Comparison of IIPN (bottom row) with Faster-RCNN (upper row)
Download full size
|
View in the Article
Fig. 6.
Visualization of detection results on HICO-DET
Download full size
|
View in the Article
Fig. 7.
Visualization of fusion attention
Download full size
|
View in the Article
Method
Default
Known Object
Full
Rare
Non-Rare
Full
Rare
Non-Rare
Shen et al.
[
27
]
6.46
4.24
7.12
-
-
-
HO-RCNN
[
9
]
7.81
5.37
8.54
10.41
8.94
10.85
iCAN
[
8
]
14.84
10.45
16.15
16.26
11.33
17.73
RPNN
[
11
]
17.35
12.78
18.71
-
-
-
PMFNet
[
31
]
17.46
15.65
18.00
20.34
17.47
21.20
DRG
[
7
]
19.26
17.74
19.71
23.40
21.75
23.89
Peyre et al.
[
32
]
19.40
14.60
20.90
-
-
-
VCL
[
10
]
19.43
16.55
20.29
22.00
19.09
22.87
BaseLine
19.05
14.72
20.35
21.22
18.06
22.88
IIPN(Ours)
19.90
15.84
21.12
23.13
19.08
24.33
Table 1.
Experimental results on HICO-DET test set of different approaches
View in the Article
Method
mAPa
role
Gupta et al.
[
39
]
31.8
GPNN
[
24
]
44.0
iCAN
[
8
]
45.3
RPNN
[
11
]
47.5
VCL
[
10
]
48.3
PMFNet w/o human pose
[
31
]
48.6
PMFNet
[
31
]
52.0
IIPN(Ours)
50.3
Table 2.
Experimental results on V-COCO test set of different approaches
View in the Article
Method
Default(Full)
Known Object(Full)
BaseLine
19.05
21.22
BaseLine + IIPN w/o attention
19.33
21.92
BaseLine + IIPN with attention
19.72
22.33
BaseLine + CIFM w/o attention
19.26
21.74
BaseLine + CIFM with attention
19.60
21.89
BaseLine + IIPN + CIFM (Ours)
19.90
23.13
Table 3.
Ablation studies of the proposed module on HICO-DET
View in the Article
Default
Full
Rare
Non-Rare
M
=6,
N
=2
19.53
15.12
20.43
M
=6,
N
=3
19.77
15.74
20.99
M
=6,
N
=4
19.56
15.71
20.03
M
=8,
N
=2
19.66
15.67
20.86
M
=8,
N
=3
19.90
15.84
21.12
M
=8,
N
=4
19.60
15.70
20.76
Table 4.
Effects of different
M
and
N
on experimental results
View in the Article
f
h
f
o
SP
f
u
f
sem
mAP
✓
✗
✗
✗
✗
19.03
✓
✓
✗
✗
✗
19.35
✓
✓
✓
✗
✗
19.63
✓
✓
✗
✓
✗
19.78
✓
✓
✗
✓
✓
19.90
Table 5.
Influence of different characteristics on experimental results
View in the Article
Number of
k
Result on V-COCO
Result on HICO-DET
k
=1
49.4
19.81
k
=2
50.3
19.90
k
=3
49.9
19.85
Table 6.
Influence of different
k
on experimental results
View in the Article
Abstract
Get PDF(in Chinese)
Figures&Tables (13)
Equations (0)
References (38)
Get Citation
Copy Citation Text
Lixia Xue, Kaijian Yin, Ronggui Wang, Juan Yang. Interactive instance proposal network for HOI detection[J]. Opto-Electronic Engineering, 2022, 49(7): 210429
Download Citation
EndNote(RIS)
BibTex
Plain Text
Tools
Share
Save the article for my favorites
Paper Information
Category: Research Articles
Received: Jan. 10, 2022
Accepted: --
Published Online: Jul. 25, 2022
The Author Email: Yang Juan (yangjuan6985@163.com)
DOI:
10.12086/oee.2022.210429
Recommended Topics
laser devices and laser physics
Lasers and Laser Optics
Laser physics
laser manufacturing
Instrumentation, Measurement and Metrology
Set citation alerts for the article
Please enter your email address
Cancel
Confirm