Curiosity-driven recommendation strategy for adaptive learning via deep reinforcement learning

Br J Math Stat Psychol. 2020 Nov;73(3):522-540. doi: 10.1111/bmsp.12199. Epub 2020 Feb 21.

Abstract

The design of recommendation strategies in the adaptive learning systems focuses on utilizing currently available information to provide learners with individual-specific learning instructions. As a critical motivate for human behaviours, curiosity is essentially the drive to explore knowledge and seek information. In a psychologically inspired view, we propose a curiosity-driven recommendation policy within the reinforcement learning framework, allowing for an efficient and enjoyable personalized learning path. Specifically, a curiosity reward from a well-designed predictive model is generated to model one's familiarity with the knowledge space. Given such curiosity rewards, we apply the actor-critic method to approximate the policy directly through neural networks. Numerical analyses with a large continuous knowledge state space and concrete learning scenarios are provided to further demonstrate the efficiency of the proposed method.

Keywords: Markov decision problem; adaptive learning; curiosity-driven exploration; recommendation system; reinforcement learning.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Adaptation, Psychological
  • Algorithms
  • Computer Simulation
  • Computer-Assisted Instruction / statistics & numerical data
  • Educational Measurement / statistics & numerical data
  • Exploratory Behavior*
  • Humans
  • Learning*
  • Models, Psychological
  • Neural Networks, Computer
  • Reinforcement, Psychology*
  • Reward