Labour shortages and costly operator training are driving the need for digital on-board robotic crane operator support in forestry and construction. This simulator study investigated the effects of sonification (auditory, pitch/loudness) and continuous visual (brightness/size) feedback on aiming movements with a robotic crane for low and high performers. The feedback was designed non-linear and linear. Thirty-six participants controlled a robotic crane bimanually using joysticks across 320 movements. Performance and skill indicators (movement time, accuracy, trajectory, smoothness) as well as satisfaction, and usefulness were assessed. Low-performing participants showed higher movement accuracy, particularly with non-linear pitch feedback compared to visual feedback. High performers exhibited no significant performance improvement in movement time, accuracy, or smoothness. There was no effect of linear or non-linear mapping of the feedback. Additionally, perceived satisfaction was lower with auditory than visual feedback. These results suggest that real-time auditory feedback can enhance operator accuracy whereas acceptance remains challenging.
Keywords: Concurrent visual feedback; Machine operator; Sonification.
Copyright © 2023 Elsevier Ltd. All rights reserved.