Rapid acquisition of bias in signal detection: dynamics of effective reinforcement allocation

J Exp Anal Behav. 2012 Jan;97(1):29-49. doi: 10.1901/jeab.2012.97-29.

Abstract

We investigated changes in bias (preference for one response alternative) in signal detection when relative reinforcer frequency for correct responses varied across sessions. In Experiment 1, 4 rats responded in a two-stimulus, two-response identification procedure employing temporal stimuli (short vs. long houselight presentations). Relative reinforcer frequency varied according to a 31-step pseudorandom binary sequence and stimulus duration difference varied over two values across conditions. In Experiment 2, 3 rats responded in a five-stimulus, two-response classification procedure employing temporal stimuli. Relative reinforcer frequency was varied according to a 36-step pseudorandom ternary sequence. Results of both experiments were analyzed according to a behavioral model of detection. The model was extended to incorporate the effects of current and previous session reinforcer frequency ratios on current-session performance. Similar to findings with concurrent schedules, effects on bias of relative reinforcer frequency were highest for the current session. However, carryover from reinforcer ratios of previous sessions was evident. Generally, the results indicate that bias can come under control of frequent changes in relative reinforcer frequency in both identification and classification procedures.

Keywords: acquisition; classification; discriminability; effective reinforcement; identification; lever press; rats; signal detection; temporal discrimination.

MeSH terms

  • Animals
  • Association Learning
  • Attention*
  • Choice Behavior*
  • Conditioning, Operant
  • Discrimination Learning*
  • Humans
  • Male
  • Motivation
  • Probability Learning
  • Rats
  • Rats, Long-Evans
  • Reinforcement Schedule*
  • Signal Detection, Psychological*
  • Time Perception*
  • Visual Perception*