BMW demonstrates the multimodal interaction between car, driver and outdoor at WMC
Once again, the BMW Group is revolutionising how drivers interact with their vehicles.
At Mobile World Congress in Barcelona the company presented BMW Natural Interaction. The new system combines the most advanced voice command technology available with expanded gesture control and gaze recognition to enable genuine multimodal operation for the first time.
Just like in interpersonal dialogue, BMW Natural Interaction allows the driver to use their voice, gestures and gaze at the same time in various combinations to interact with their vehicle. The preferred mode of operation can be selected intuitively, according to the situation and context.
But not enough: thanks to intelligent networking, the area of interaction extends beyond the vehicle interior. For example, the driver can point a finger at objects in their field of vision and give related voice commands, such as asking for information about opening hours or customer ratings, or reserving a table at a restaurant.
Thanks to the vehicle’s depth of connectivity, extensive environmental data and artificial intelligence enable BMW Natural Interaction to connect digital services to expand the scope of interaction. For example, when the driver spots a parking space, they will easily be able to find out whether they are allowed to park there and what it costs, and then reserve and pay for it directly without ever pushing a button.
The first BMW Natural Interaction functions will be available in the BMW iNext from 2021.