On the influence of low-level visual features in film classification

PLoS One. 2019 Feb 22;14(2):e0211406. doi: 10.1371/journal.pone.0211406. eCollection 2019.

Abstract

Background: In this paper we present a model of parameters to aesthetically characterize films using a multi-disciplinary approach: by combining film theory, visual low-level video descriptors (modeled in order to supply aesthetic information) and classification techniques using machine and deep learning.

Methods: Four different tests have been developed, each for a different application, proving the model's usefulness. These applications are: aesthetic style clustering, prediction of production year, genre detection and influence on film popularity.

Results: The results are compared against high-level information to determine the accuracy of the model to classify films without knowing such information previously. The main difference with other film characterization approaches is that we are able to isolate the influence of high-level descriptors to really understand the relevance of low-level features and, accordingly propose a useful set of low-level visual descriptors for that purpose. This model has been tested with a representative number of films to prove that it can be used for different applications.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Cluster Analysis
  • Databases, Factual
  • Deep Learning
  • Esthetics
  • Humans
  • Machine Learning
  • Models, Theoretical
  • Motion Pictures / classification*
  • Motion Pictures / statistics & numerical data
  • Sound
  • Video Recording
  • Visual Perception

Grants and funding

This work was supported in part by the Spanish Ministry of Economy and Competitiveness, by means of project “RECOPUBLI” (IPT- 2012-0152-430000), and project HORFI (TEC2012-38402-C04-01).