A pilot study to evaluate the face & construct validity of an orthopaedic virtual reality simulator

Injury. 2021 Jul;52(7):1715-1720. doi: 10.1016/j.injury.2021.04.045. Epub 2021 Apr 16.

Abstract

Aims: This study aimed to identify the face and construct validity of the Precision OS trauma module proximal femoral nail procedure. Secondary outcomes included perceived use of simulation in surgical training, with structured feedback from participants.

Methods: A comparative interventional study was carried out in a regional orthopaedics trauma unit hospital. Volunteers were stratified into novice, intermediate and expert groups based on self-reported levels of experience. Each participant carried out a simulated proximal femoral nail on an immersive virtual platform following instruction on its use, with objective metrics such as time and x-rays, and novel metrics calculated by the simulation module recorded. Face validity was also assessed.

Results: The proximal femoral nail module demonstrated construct validity. Kruskal Wallis test demonstrated a statistically significant difference across all group's novel performance (p=.018). Intermediate surgeons performed significantly better than novices (P=.022), with shorter procedural times (P=.018) Three of the intermediate group achieved the proficiency level set by the expert group, with no significant difference noted between these two groups (=.06). Time taken to completion for expert surgeons was less than intermediate group, although this did not reach significance (P=.19).

Conclusion: The proximal femoral nail module on the Precision OS platform demonstrated good face, and construct validity. Further research evaluating use of virtual platform simulation in surgical trauma training is needed.

Keywords: Construct validity; Simulation; Trauma module; Virtual reality.

MeSH terms

  • Clinical Competence
  • Computer Simulation
  • Humans
  • Orthopedics*
  • Pilot Projects
  • Reproducibility of Results
  • User-Computer Interface
  • Virtual Reality*