Adding pluggable and personalized natural control capabilities to existing applications

Sensors (Basel). 2015 Jan 28;15(2):2832-59. doi: 10.3390/s150202832.

Abstract

Advancements in input device and sensor technologies led to the evolution of the traditional human-machine interaction paradigm based on the mouse and keyboard. Touch-, gesture- and voice-based interfaces are integrated today in a variety of applications running on consumer devices (e.g., gaming consoles and smartphones). However, to allow existing applications running on desktop computers to utilize natural interaction, significant re-design and re-coding efforts may be required. In this paper, a framework designed to transparently add multi-modal interaction capabilities to applications to which users are accustomed is presented. Experimental observations confirmed the effectiveness of the proposed framework and led to a classification of those applications that could benefit more from the availability of natural interaction modalities.

MeSH terms

  • Computers*
  • Humans
  • Software*
  • User-Computer Interface*
  • Voice