Web version of the protocol of the orofacial myofunctional evaluation with scores: usability and learning

Codas. 2023 Apr 21;35(2):e20220026. doi: 10.1590/2317-1782/20232022026. eCollection 2023.

Abstract

Purpose: The Orofacial Myofunctional Evaluation with Scores (OMES) protocol has been validated and used in clinical practice and research. The goals of this study were to develop, analyze and improve a version of OMES for the Web and to investigate the relationship between the usability judgments and the prior experience of the evaluators and whether using the interface promotes learning, as shown by the task completion time (TCT).

Methods: Study steps: 1) inspection of the prototype by the team; 2) evaluation of usability by three experienced speech-language pathologists (SLPs); and 3) evaluation of its usability by 12 SLPs with varying levels of experience in the use of OMES. Participants answered the Heuristic evaluation (HE), the Computer System Usability Questionnaire (CSUQ), and expressed free comments. The TCT was recorded.

Results: The OMES-Web reached excellent usability levels, and the participants were highly satisfied. The correlations between the participants' experience and the HE and CSUQ scores were not significant. The TCT decreased significantly throughout the tasks.

Conclusion: OMES-Web meets the usability criteria, and participants feel satisfied with the system regardless of their level of experience. The fact that it is easy to learn favors its adoption by professionals.

Objetivo: O Protocolo de Avaliação Miofuncional Orofacial com Escores (AMIOFE) é validado e usado na prática clínica e pesquisas. Os objetivos deste estudo foram desenvolver, analisar e aprimorar a versão do AMIOFE para a Web e investigar a relação entre os julgamentos de usabilidade e a prévia experiência dos avaliadores, e se o manuseio da interface promove o aprendizado, baseado no tempo para completar a tarefa (TCT).

Método: Passos do estudo: 1) inspeção do protótipo pela equipe; 2) avaliação de usabilidade por três fonoaudiólogos experientes; e 3) avaliação de usabilidade por 12 fonoaudiólogos com variados níveis de experiência no uso do AMIOFE. Avaliação heurística (HE), Computer System Usability Questionnaire (CSUQ) e livre expressão dos participantes foram realizadas. O TCT foi registrado.

Resultados: O AMIOFE-Web atingiu ótimos níveis de usabilidade e os participantes mostram-se altamente satisfeitos (Escala geral do CSUQ; Média= 1,31, DP= 0,31). A relação da experiência dos participantes e a HE e o CSUQ não foi significativa. O TCT decresceu significantemente ao longo das tarefas, mostrando que o sistema é fácil de aprender e usar.

Conclusão: O AMIOFE-Web atende os critérios de usabilidade e os participantes sentiram-se satisfeitos com o sistema, independentemente de seus níveis de experiência. O fato de ser de fácil aprendizado é um fator favorável para a sua adoção por profissionais.

MeSH terms

  • Humans
  • Learning*
  • Movement Disorders*
  • Reproducibility of Results
  • Severity of Illness Index

Grants and funding

Financial support: National Council for Scientific and Technological Development - Brazilian Ministry of Science and Technology (Process No. 30.8689/2016-0); Provost’s Office for Research of the University of São Paulo (Process No. 11.1.21626.01.7). The first author received fellowships from the Unified Scholarship Program for the Support and Training of Graduation Students - University of São Paulo (USP) and from the Coordination of Improvement of Higher Education Personnel, Brazil. This study was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - Brasil (CAPES) - Finance Code 001.