Page 32 - Use cases and requirements for the vehicular multimedia networks - Focus Group on Vehicular Multimedia (FG-VM)

8.2 Gesture control in vehicular multimedia system

Applying gesture recognition as part of intelligent human machine interface (HMI) and of ADAS can
improve driving safety. Drivers can use gesture to control various functions, including in-vehicular
multi-media functions, or change various settings, such as the temperature of air-conditioners or
sound volume in the vehicle, thus paying more attention to the road and reducing the occurrence of
traffic accidents.

Through a simple and easy to use gesture control system, drivers can interact with multimedia system
functions while looking directly at the road ahead.

8.3 Eye-movement control in vehicular multimedia system

8.3.1 Real time eye gaze tracking scenario
Eye gaze tracking is the process of measuring either the point of gaze (where one is looking) or the
motion of an eye relative to the head. An eye tracker is a device for measuring eye positions and eye
movement. With the progress in processor speed and image processing algorithms, it is now also
possible to use the gaze tracking technology in real time to control a screen pointer in a direct
manipulation interface. Eye gaze tracking technology is well explored for consumer electronics and
gradually making way to the automotive and aviation sector. It has already been explored for the
attention analysis of drivers and pilots and designing cockpits to minimize eye gaze movement,
highlighting critical elements and so on. The following use cases emphasize real time use of eye
tracking in a moving vehicle as a direct controller of electronic displays inside a car and to analyse
drivers’ cognitive load while driving.
– Driver wants to change radio channel or accept a call. He does not need to take his eyes off
the road nor look down at the dashboard, and neither to take his hands off the steering wheel.
The whole dashboard is reflected on a heads up display and he operates the display just like
any graphical user interface through fixating attention on the required icons. The fixation
duration is less than 2 seconds and even when he is operating the display, he can use his
peripheral vision to observe the road.
https://en.wikipedia.org/wiki/Two-second_rule

– Driver is distracted, feeling stressed or bored, eye tracker detects driver's state from ocular
parameters like pupil dilation or fixation rate. Based on the gaze tracker inputs the ADAS
system that will trigger the VMS to reduce secondary task load (e.g., VMS media playback)
and alerts driver and passengers.
– Eye tracker tracks eyes of passengers of an autonomous vehicle. The VMS uses it to operate
entertainment systems on back seats and can be used to alerts passengers if the passenger in
driver's seat is distracted or stressed.

22 FGVM-01R1 (2019)