Mixtures of conditional Gaussian scale mixtures applied to multiscale image representations

PLoS One. 2012;7(7):e39857. doi: 10.1371/journal.pone.0039857. Epub 2012 Jul 31.

Abstract

We present a probabilistic model for natural images that is based on mixtures of Gaussian scale mixtures and a simple multiscale representation. We show that it is able to generate images with interesting higher-order correlations when trained on natural images or samples from an occlusion-based model. More importantly, our multiscale model allows for a principled evaluation. While it is easy to generate visually appealing images, we demonstrate that our model also yields the best performance reported to date when evaluated with respect to the cross-entropy rate, a measure tightly linked to the average log-likelihood. The ability to quantitatively evaluate our model differentiates it from other multiscale models, for which evaluation of these kinds of measures is usually intractable.

MeSH terms

  • Algorithms
  • Computer Graphics*
  • Computer Simulation
  • Image Processing, Computer-Assisted
  • Likelihood Functions
  • Markov Chains
  • Models, Statistical*
  • Multivariate Analysis
  • Normal Distribution
  • Software

Grants and funding

This study was financially supported by the German Ministry of Education, Science, Research and Technology through the Bernstein award (BMBF; FKZ: 01GQ0601) and the German Research Foundation (DFG; priority program 1527, Sachbeihilfe BE 3848/2-1). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.