Skip to content
Free planNo credit card requiredStart writing
AI for Research home
AI for Research home
Dashboard
Sign inGet started

article · IEEE Consumer Electronics Magazine · 2023

Human–Object Interaction Detection: An Overview

Jia Wang, Hong-Han Shuai, Yung‐Hui Li, Hao‐Wen Cheng

Cited by 6Abstract and details only

Abstract

This paper systematically summarizes and discusses recent research on image-based human-object interaction (HOI) detection, which aims to detect human-object pairs and recognize the interactive behaviors between humans and objects in an image. It has plenty of applications and can serve as the basis to assist higher-level tasks of visual understanding. We introduce existing methods by categorizing them into two main groups based on the model structure: one-stage and two-stage approaches. We further divide one-stage methods into point-based, region-based, and query-based methods. Similarly, the two-stage methods are divided into HOI detection with multi-stream modeling, HOI detection with human parts and pose, HOI detection with compositional learning, HOI detection with graph-based modeling, and HOI detection with query-based modeling. According to this taxonomy, we also summarize and analyze the core ideas behind each strategy. Then, we present the details of the experimental protocols, evaluation metrics, datasets, and the evaluation results of the most recent representative methods. Finally, we discuss the HOI detection task's main open challenges and future trends.

Cite this paper

APA 7

Wang, J., Shuai, H.-H., Li, Y., & Cheng, H. (2023). Human–Object Interaction Detection: An Overview. IEEE Consumer Electronics Magazine, 13(6), 56–72. https://doi.org/10.1109/mce.2023.3343919

MLA 9

Wang, Jia, et al. “Human–Object Interaction Detection: An Overview.” IEEE Consumer Electronics Magazine, vol. 13, no. 6, 2023, pp. 56–72, https://doi.org/10.1109/mce.2023.3343919.

Chicago

Wang, Jia, Hong-Han Shuai, Yung‐Hui Li, and Hao‐Wen Cheng. 2023. “Human–Object Interaction Detection: An Overview.” IEEE Consumer Electronics Magazine 13 (6): 56–72. https://doi.org/10.1109/mce.2023.3343919.

Harvard

Wang, J. et al. (2023) ‘Human–Object Interaction Detection: An Overview’, IEEE Consumer Electronics Magazine, 13(6), pp. 56–72. Available at: https://doi.org/10.1109/mce.2023.3343919.

BibTeX
@article{wang2023human,
  title = {{Human–Object Interaction Detection: An Overview}},
  author = {Wang, Jia and Shuai, Hong-Han and Li, Yung‐Hui and Cheng, Hao‐Wen},
  journal = {IEEE Consumer Electronics Magazine},
  volume = {13},
  number = {6},
  pages = {56--72},
  year = {2023},
  doi = {10.1109/mce.2023.3343919}
}

Made from the index record. Check names, capitalisation and page numbers against the paper. Need another style? AI for Research has over 10,000.

Related papers