A Photoelectric Spiking Neuron for Visual Depth Perception

Adv Mater. 2022 May;34(20):e2201895. doi: 10.1002/adma.202201895. Epub 2022 Apr 11.

Abstract

The biological visual system encodes optical information into spikes and processes them by the neural network, which enables the perception with high throughput of visual processing with ultralow energy budget. This has inspired a wide spectrum of devices to imitate such neural process, while precise mimicking such procedure is still highly required. Here, a highly bio-realistic photoelectric spiking neuron for visual depth perception is presented. The firing spikes generated by the TaOX memristive spiking encoders have a biologically similar frequency range of 1-200 Hz and sub-micro watts power. Such spiking encoder is integrated with a photodetector and a network of neuromorphic transistors, for information collection and recognition tasks, respectively. The distance-dependent response and eye fatigue of biological visual systems have been mimicked based on such photoelectric spiking neuron. The simulated depth perception shows a recognition improvement by adapting to sights at different distances. The results can advance the technologies in bioinspired or robotic systems that may be endowed with depth perception and power efficiency at the same time.

Keywords: TaOX memristors; artificial visual systems; leaky integrate-and-fire neurons; photoelectric spiking neuron.

MeSH terms

  • Depth Perception
  • Neural Networks, Computer*
  • Neurons* / physiology
  • Visual Perception