Inference, Prediction, & Entropy-Rate Estimation of Continuous-Time, Discrete-Event Processes

Entropy (Basel). 2022 Nov 17;24(11):1675. doi: 10.3390/e24111675.

Abstract

Inferring models, predicting the future, and estimating the entropy rate of discrete-time, discrete-event processes is well-worn ground. However, a much broader class of discrete-event processes operates in continuous-time. Here, we provide new methods for inferring, predicting, and estimating them. The methods rely on an extension of Bayesian structural inference that takes advantage of neural network's universal approximation power. Based on experiments with complex synthetic data, the methods are competitive with the state-of-the-art for prediction and entropy-rate estimation.

Keywords: Poisson process; Shannon entropy rate; hidden Markov chain; hidden semi-Markov process; minimal predictor; optimal predictor; renewal process; ϵ-machine.