Human interaction behavior modeling using Generative Adversarial Networks

Neural Netw. 2020 Dec:132:521-531. doi: 10.1016/j.neunet.2020.09.019. Epub 2020 Sep 30.

Abstract

Recently, considerable research has focused on personal assistant robots, and robots capable of rich human-like communication are expected. Among humans, non-verbal elements contribute to effective and dynamic communication. However, people use a wide range of diverse gestures, and a robot capable of expressing various human gestures has not been realized. In this study, we address human behavior modeling during interaction using a deep generative model. In the proposed method, to consider interaction motion, three factors, i.e., interaction intensity, time evolution, and time resolution, are embedded in the network structure. Subjective evaluation results suggest that the proposed method can generate high-quality human motions.

Keywords: Generative Adversarial Networks; Human behavior during dialog; Human motion modeling; Human robot interaction.

MeSH terms

  • Computer Simulation
  • Gestures*
  • Humans
  • Neural Networks, Computer*
  • Robotics / methods*