Study Investigates AR’s Potential for Enhancing Self-Driving Car Safety
As self-driving cars become more common on our roads, a key question for future road safety is how to balance passengers’ desire to relax during their trip with remaining aware of road hazards and being ready to retake control.
Researchers from the University of Glasgow have been testing the potential of augmented reality technology to allow drivers to enjoy the benefits of being driven by an autonomous vehicle while enabling them to quickly take the wheel if required.
Their results suggest that placing attention-grabbing graphics over real-world views through car windscreens using augmented reality heads-up displays (HUDs) could help drivers to use entertainment apps while still maintaining awareness of the road. However, their design needs to be carefully managed to avoid overwhelming users with information at critical moments.
Their findings inform the development of safety features in future generations of self-driving cars as they move towards the full autonomous control planned by manufacturers.
Thomas Goodge, of the University of Glasgow’s School of Computing Science, is one of the paper’s coauthors. He said: “One of the main attractions of autonomous vehicles is that drivers will eventually be able take their focus off the road and place it on non-driving-related tasks like reading, playing games, or watching TV.
“Drivers can do that to some extent at the moment, but they still have to maintain an awareness of road conditions so they can take control in emergencies. It will likely be years before they’re capable of driving themselves entirely without human intervention.
“In the meantime, the people sitting behind the wheel are somewhere between drivers and passengers – not actively involved in steering but still required to supervise their vehicle to make sure they get safely to their destination.
“One big problem with that is that humans don’t deal very well with sustained supervisory tasks. They get bored, they get distracted, and when they do they lose their awareness of the road. That could be dangerous if they react too slowly to a sudden change of the road conditions around them.
“What we wanted to do with this study was explore whether attention-grabbing augmented reality systems could allow people to perform non-driving tasks but quickly switch focus at critical moments.”
The team’s lab experiment put study participants in a driver’s seat in front of a steering wheel and computer monitors to simulate their view out of a car window. The screens displayed a series of 40 video clips of real road situations and asked them to complete tasks on either a tablet screen, similar to the large dashboard displays of current-generation vehicles, or while using an augmented reality display overlaying tasks on top of the road scene.
One task was a simple game where users tracked and ‘collected’ gems moving across the screen by gazing at them. The second task presented the participants with a more complicated number pad app on which they had to correctly copy a phone number.
In both scenarios, the video stopped abruptly before a potentially hazardous situation like a pedestrian stepping into the road, to test situational awareness. The participants were asked to select from one of four predictions about what would happen next based on their understanding of the road conditions at the point the video cut off.
Their ability to correctly guess the outcome of the hazard was measured against an initial control experiment where they made predictions without performing a task. In both the heads-down portion of the task using the tablet and the heads-up section using the AR headset, participants were able to maintain some awareness of the conditions on the road. However, their ability to reliably predict what would happen next was significantly reduced in both setups.
In another section of the experiment, the AR headset displayed special visual cues in participants’ eyelines to draw their attention to developing road situations several seconds before the video stopped. Here, the participants showed increased awareness of the road conditions, with performance improving more in the gem-collecting game than in the more demanding keypad app.
Study co-author Professor Frank Pollick, of the University’s School of Psychology & Neuroscience, said: “An important aspect of road safety is something called the ‘look but fail to see’ phenomenon, which happens when people fail to adequately process what’s right in front of their eyes. This study aimed to replicate that in a simulated driving situation, where participants had all the relevant information on the screen in front of them but were being distracted to one degree or another, blurring their ability to judge the road conditions correctly.
“Augmented reality tech really does put information right in front of people’s eyes, so it could be a good fit for tackling the look but fail to see problem. The study shows that adding visual cues to draw drivers’ attention to situations does seem to improve their ability to quickly focus and understand situations. However, the level of demand on their attention is important – they were more able to read the road correctly in the less cognitively-challenging task.”
Professor Stephen Brewster leads the Multimodal Interaction Group at the University of Glasgow and is a co-author of the paper. He said: “Offering people the opportunity to distract themselves while in a self-driving car is something that comes with potentially catastrophic risks, so it’s important that we understand as much as possible about how drivers can be supported to travel responsibly.
“What this study suggests is that there may be a kind of ‘goldilocks’ zone where people can be engaged in a task while still being kept in the loop on developing road conditions.
“Much more research will be required to delve into how augmented reality can help support users of self-driving cars in the future, but we hope that the outcomes of this study will help inform the development of augmented reality systems in the years to come.”
The team’s paper, titled ‘Can You Hazard a Guess? Evaluating the Effects of Augmented Reality Cues on Driver Hazard Prediction’, will be presented at the Association of Computing Machinery CHI conference on Human Factors in Computing Systems next month.
The research was supported by funding from the UKRI Centre for Doctoral Training in Socially Intelligent Artificial Agents and the European Research Council.