Communication of Hazards in Mixed-Reality Telerobotic Systems: The Usage of Naturalistic Avoidance Cues in Driving Tasks

This study investigates the effect of naturalistic visual cues on human avoidance behavior for a potential use in telerobotic user interfaces incorporating mixed-reality environments (e.g., augmented reality).

Telerobotic systems used in hazardous environments require interfaces that draw operators’ attention to potential dangers. Existing means of hazard notification can often distract or induce stress in operators. In the design and implementation of such interfaces, visual semiotics plays a critical role in creating more effective interfaces. Naturalistic visual cues such as Aposematism or Kindchenschema have proven effective to communicate danger or caution in nature, but the application of these cues in visual systems have yet to be thoroughly investigated.

A study was conducted where 40 volunteering participants were asked to control a remote vehicle in a simulated environment. The environment contained a set of neutral and visually augmented obstacles that were designed to provoke avoidance behavior.

The use of visual cues triggered greater avoidance behaviors in participants compared to neutral obstacles. The distance of avoidance was correlated with the type of cue present, with obstacles augmented by Aposematism (Cue A) having a greater participant–obstacle distance than Kindchenschema (Cue K).

This study shows the potential for the incorporation of naturalistic visual cues as a means to designate warning or caution in telerobotic environments.

The findings can offer practical guidelines for the design of visual cues in telerobotic interfaces. The further incorporation of such cues may reduce operator stress and the amount of human errors in telerobotic operations.