Information Entropy Production of Maximum Entropy Markov Chains from Spike Trains

Entropy (Basel). 2018 Jan 9;20(1):34. doi: 10.3390/e20010034.

Abstract

The spiking activity of neuronal networks follows laws that are not time-reversal symmetric; the notion of pre-synaptic and post-synaptic neurons, stimulus correlations and noise correlations have a clear time order. Therefore, a biologically realistic statistical model for the spiking activity should be able to capture some degree of time irreversibility. We use the thermodynamic formalism to build a framework in the context maximum entropy models to quantify the degree of time irreversibility, providing an explicit formula for the information entropy production of the inferred maximum entropy Markov chain. We provide examples to illustrate our results and discuss the importance of time irreversibility for modeling the spike train statistics.

Keywords: Gibbs measures; discrete Markov chains; information entropy production; maximum entropy principle; spike train statistics.