Continuous evaluation of cost-to-go for flexible reaching control and online decisions

PLoS Comput Biol. 2023 Sep 27;19(9):e1011493. doi: 10.1371/journal.pcbi.1011493. eCollection 2023 Sep.

Abstract

Humans consider the parameters linked to movement goal during reaching to adjust their control strategy online. Indeed, rapid changes in target structure or disturbances interfering with their initial plan elicit rapid changes in behavior. Here, we hypothesize that these changes could result from the continuous use of a decision variable combining motor and cognitive components. We combine an optimal feedback controller with a real-time evaluation of the expected cost-to-go, which considers target- and movement-related costs, in a common theoretical framework. This model reproduces human behaviors in presence of changes in the target structure occurring during movement and of online decisions to flexibly change target following external perturbations. It also predicts that the time taken to decide to select a novel goal after a perturbation depends on the amplitude of the disturbance and on the rewards of the different options, which is a direct result of the continuous monitoring of the cost-to-go. We show that this result was present in our previously collected dataset. Together our developments point towards a continuous evaluation of the cost-to-go during reaching to update control online and make efficient decisions about movement goal.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Feedback, Sensory
  • Humans
  • Movement*
  • Psychomotor Performance*
  • Reward

Associated data

  • Dryad/10.5061/dryad.79cnp5hx8

Grants and funding

ADC and PL are supported by BELSPO (Belgian Federal Science Policy Office) and the European Space Agency. ADC is supported by a K. Lisa Yang Integrative Computational Neuroscience (ICoN) Postdoctoral Fellowship. The funders had no role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.