Risk-aware control

Neural Comput. 2014 Dec;26(12):2669-91. doi: 10.1162/NECO_a_00662. Epub 2014 Aug 22.

Abstract

Human movement differs from robot control because of its flexibility in unknown environments, robustness to perturbation, and tolerance of unknown parameters and unpredictable variability. We propose a new theory, risk-aware control, in which movement is governed by estimates of risk based on uncertainty about the current state and knowledge of the cost of errors. We demonstrate the existence of a feedback control law that implements risk-aware control and show that this control law can be directly implemented by populations of spiking neurons. Simulated examples of risk-aware control for time-varying cost functions as well as learning of unknown dynamics in a stochastic risky environment are provided.

Publication types

  • Research Support, N.I.H., Extramural
  • Research Support, Non-U.S. Gov't

MeSH terms

  • Action Potentials / physiology
  • Awareness*
  • Computer Simulation
  • Feedback, Physiological*
  • Humans
  • Learning
  • Models, Neurological*
  • Movement / physiology*
  • Neurons / physiology
  • Risk
  • Robotics
  • Uncertainty