Improvement of Driving Simulator Eye Tracking Software
Brian Davis, Research Fellow, Mechanical Engineering
- Nichole Morris, Research Associate, Mechanical Engineering
This study focuses on improving the eye tracking tools used with the HumanFIRST driving simulator. Eye tracking is an important feature for simulation-based projects. It allows researchers to understand where participants are focusing their visual attention while driving the simulator.
Currently, the eye tracking system is capable of providing a nearly continuous record of the direction in which the driver is looking with respect to real-world coordinates. However, this by itself does not give any information about which objects the driver was looking at. To collect this type of information, additional processing is necessary. Current methods to process the raw eye tracking data are time intensive, requiring a human to go through eye tracking data and system video by hand in order to extract useful data. This project seeks to examine the process by which the eye tracking data is processed in order to identify and implement software tools to make the process more efficient.
One method that will be examined is to use the eye tracking system's 3D vision vector and apply that to known information about the simulator's state (i.e., the position and speeds of different elements relative to the driver/vehicle. That information could then be combined to calculate with what and for how long the driver's line of sight intersects with virtual and real-world objects. A successful project outcome will be the software tools and associated documentation for reducing or eliminating the amount of human intervention when processing the eye tracking data.