An efficient framework of developing video-based driving simulation for traffic sign evaluation

Abstract

Introduction: The driving simulator is a widely adopted experimental platform for investigating human-factors questions related to traffic signs and other traffic control devices in a safe environment. This paper presents a methodological framework for developing a video-based simulation program for traffic-sign evaluation.

Method: We firstly collected video data and vehicle movement data from on-road driving. Secondly, the signs on the collected video footage were detected and tracked automatically using image processing techniques. Images of newly designed signs were integrated onto the video footage and placed onto the real-world sign locations. The inserted image properties were fused to fit into the video background to yield a natural visual effect. Thirdly, the vehicle-movement data collected during the drive-through were incorporated into the video sequence as well as the motion of the driving simulator. Using throttle and brake pedals of the driving simulator, participants drove through the video sequence with control over the video's playback speed and the simulator's movement to achieve a comparable visualization and motion experience as real-world driving. Results Conclusions: This framework was used to investigate drivers' visual attention and understanding of various newly proposed changeable message signs (CMSs). The results prove that this framework effectively engaged drivers in the driving task in the realistic traffic scene and successfully evaluated drivers' perception and understanding of the traffic signs.

Practical applications: With this methodological framework, a driving simulation program based on real-world video data from specified road environment and vehicle-movement information can be quickly established and used for testing a variety of traffic control devices, especially traffic signs, in the study of human-machine interaction.

Keywords: Changeable message signs; Driving simulation program; Image processing; Methodological framework; Traffic sign evaluation; Vehicle motion.