Using objective robotic automated performance metrics and task-evoked pupillary response to distinguish surgeon expertise

Jessica H Nguyen; Jian Chen; Sandra P Marshall; Saum Ghodoussipour; Andrew Chen; Inderbir S Gill; Andrew J Hung

doi:10.1007/s00345-019-02881-w

Using objective robotic automated performance metrics and task-evoked pupillary response to distinguish surgeon expertise

World J Urol. 2020 Jul;38(7):1599-1605. doi: 10.1007/s00345-019-02881-w. Epub 2019 Jul 25.

Authors

Jessica H Nguyen¹, Jian Chen¹, Sandra P Marshall², Saum Ghodoussipour¹, Andrew Chen¹, Inderbir S Gill¹, Andrew J Hung³

Affiliations

¹ Center for Robotic Simulation and Education, Catherine and Joseph Aresty Department of Urology, University of Southern California Institute of Urology, 1441 Eastlake Avenue, Suite 7416, Los Angeles, CA, 90033, USA.
² EyeTracking, Inc., 512 Via De La Valle, Suite 200, Solana Beach, CA, 92075, USA.
³ Center for Robotic Simulation and Education, Catherine and Joseph Aresty Department of Urology, University of Southern California Institute of Urology, 1441 Eastlake Avenue, Suite 7416, Los Angeles, CA, 90033, USA. Andrew.Hung@med.usc.edu.

Abstract

Purpose: In this study, we investigate the ability of automated performance metrics (APMs) and task-evoked pupillary response (TEPR), as objective measures of surgeon performance, to distinguish varying levels of surgeon expertise during generic robotic surgical tasks. Additionally, we evaluate the association between APMs and TEPR.

Methods: Participants completed ten tasks on a da Vinci Xi Surgical System (Intuitive Surgical, Inc.), each representing a surgical skill type: EndoWrist^® manipulation, needle targeting, suturing/knot tying, and excision/dissection. Automated performance metrics (instrument motion tracking, EndoWrist^® articulation, and system events data) and TEPR were recorded by a systems data recorder (Intuitive Surgical, Inc.) and Tobii Pro Glasses 2 (Tobii Technologies, Inc.), respectively. The Kruskal-Wallis test determined significant differences between groups of varying expertise. Spearman's rank correlation coefficient measured associations between APMs and TEPR.

Results: Twenty-six participants were stratified by robotic surgical experience: novice (no prior experience; n = 9), intermediate (< 100 cases; n = 9), and experts (≥ 100 cases; n = 8). Several APMs differentiated surgeon experience including task duration (p < 0.01), time active of instruments (p < 0.03), linear velocity of instruments (p < 0.04), and angular velocity of dominant instrument (p < 0.04). Task-evoked pupillary response distinguished surgeon expertise for three out of four task types (p < 0.04). Correlation trends between APMs and TEPR revealed that expert surgeons move more slowly with high cognitive workload (ρ < - 0.60, p < 0.05), while novices move faster under the same cognitive experiences (ρ > 0.66, p < 0.05).

Conclusions: Automated performance metrics and TEPR can distinguish surgeon expertise levels during robotic surgical tasks. Furthermore, under high cognitive workload, there can be a divergence in robotic movement profiles between expertise levels.

Keywords: Automated performance metrics; Robotic surgical training; Surgeon assessment; Task-evoked pupillary response.

MeSH terms

Adult
Benchmarking / standards*
Clinical Competence / standards*
Humans
Middle Aged
Reflex, Pupillary*
Robotic Surgical Procedures / standards*
Task Performance and Analysis*
Young Adult

Abstract

MeSH terms

Grants and funding