The impact of visual display of human motion on observers' perception of music performance

PLoS One. 2023 Mar 8;18(3):e0281755. doi: 10.1371/journal.pone.0281755. eCollection 2023.

Abstract

In investigating the influence of body movement in multimodal perception, human motion displays are frequently used as a means of visual standardization and control of external confounders. However, no principle is established regarding the selection of an adequate display for specific study purposes. The aim of this study was to evaluate the effects of adopting 4 visual displays (point-light, stick figure, body mass, skeleton) on the observers' perception of music performances in 2 expressive conditions (immobile, projected expressiveness). Two hundred eleven participants rated 8 audio-visual samples in expressiveness, match between movement and music, and overall evaluation. The results revealed significant isolated main effects of visual display and expressive condition on the observers' ratings (in both, p < 0.001), and interaction effects between the two factors (p < 0.001). Displays closer to a human form (mostly skeleton, sometimes body mass) exponentiated the evaluations of expressiveness and music-movement match in the projected expressiveness condition, and of overall evaluation in the immobile condition; the opposite trend occurred with the simplified motion display (stick figure). Projected expressiveness performances were higher rated than immobile performances. Although the expressive conditions remained distinguishable across displays, the more complex ones potentiated the attribution of subjective qualities. We underline the importance of considering the variable display as an influencing factor in perceptual studies.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Humans
  • Motion
  • Motion Perception*
  • Movement
  • Music*
  • Social Perception
  • Visual Perception

Grants and funding

The author NM received funding for this work by the Portuguese Foundation for Science and Technology, Programa Operacional Regional do Norte, and co-funded by the European Union through the European Social Fund. Individual grant reference: SFRH/BD/05257/2020. Funder's website: https://www.fct.pt/ The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.