Building high-performing human-like tactical agents through observation and experience

IEEE Trans Syst Man Cybern B Cybern. 2011 Jun;41(3):792-804. doi: 10.1109/TSMCB.2010.2091955. Epub 2010 Dec 17.

Abstract

This paper describes a two-phase approach for automating the agent-building process when the agent is to perform tactical tasks. The research is inspired by how humans learn-first by observation of a teacher's performance and then by practicing the performance themselves. The objectives of this approach are to produce a high-performing agent that 1) approaches or exceeds the proficiency of a human and 2) does so in a human-like manner. We accomplish these objectives by combining observational learning with experiential learning. These processes are executed sequentially, with the former creating a competent but somewhat limited human-like model from scratch, and the latter improving its performance without significantly eroding its human-like qualities. The process is described in detail, and test results confirming our hypothesis are described.

MeSH terms

  • Algorithms*
  • Artificial Intelligence*
  • Biomimetics / methods*
  • Computer Simulation
  • Decision Support Techniques*
  • Humans
  • Models, Theoretical*
  • Pattern Recognition, Automated / methods*
  • Robotics / methods*