In-Car Voice Assistants Get An AI Boost At VW, Mercedes, BMW

The driving experience is getting smarter. At the CES 2024 tech conference in Las Vegas this week, several car companies announced upgrades to infotainment systems, including a ChatGPT integration in new Volkswagen vehicles.  

Carmakers are teaming up with major tech companies to add extra features that attempt to make it easier to drive and make it more comfortable and enjoyable to work with voice assistants and other digital features. Even Sony Honda Mobility’s Afeela prototype got an on-stage mention Monday evening about Microsoft developing an in-car, AI-based infotainment system for the EV.

There are many familiar names and apps that drivers likely use outside the car, but now they’ve been adapted for the driver’s seat. 

Volkswagen and Cerence with ChatGPT  

Starting with VW vehicles produced starting next quarter like the ID.7, ID.4, ID.5 and ID.3 and Tiguan, Passat and Golf in Europe and potentially in the U.S. vehicles soon thereafter, voice control software company Cerence is working with VW’s IDA voice assistant. Cerence’s Chat Pro software will pull in ChatGPT to use the AI query program for general knowledge questions. VW’s existing system can handle requests for infotainment, navigation and climate control. 

But now the voice assistant can tap into ChatGPT’s vast knowledge if it’s a request beyond its scope. VW and Cerence assure that ChatGPT won’t have access to any vehicle data and requests will be anonymous. Questions and answers will be deleted. The voice system will look the same as before, but now IDA will have access to ChatGPT. VW sees this as an opportunity to complement in-car conversations and ask more complicated questions while both hands are still on the wheel.

Mercedes-Benz and Amazon 

Mercedes already has a big awe-factor with its sprawling optional Hyperscreen (all 56 inches) on the front dash. It’s adding to its Mercedes-Benz Operating System (MB.OS) to its upcoming 40.4-inch Superscreen with upgrades to its MBUX Virtual Assistant and audio experience with Amazon integrations with Audible and Amazon Music. 

The voice assistant claims to be more “human-like” and uses generative AI and 3D graphics with four different emotions. For example, during route guidance better visualizations will help lead the way. 

BMW and Amazon

Among a slew of in-car digital updates, some of the most notable infotainment features for BMW involve a voice assistant. Using Amazon Alexa and generative AI, BMW and Amazon show how the BMW Intelligent Personal Assistant can almost converse with drivers with more complex interactions. The voice assistant can answer questions and also help with some vehicle functions only through voice. 

BMW’s iDrive will now use Amazon Alexa Custom Assistant for the next-gen BMW voice assistant for its BMW Operating System 9 coming in the next year. 

Polestar and Google 

Polestar is already linked to Google with Google built-in quite literally built into the infotainment system, but on Tuesday new features were revealed for the upcoming Polestar 3 and 4 and new models of the Polestar 2 hatchback sedan. 

Polestars will be even more connected with drivers’ smartphones with route planning from iOS and Android devices sent to Google Maps in the car. Drivers will have this feature starting Tuesday. Then a beta version of the Chrome browser will be available in-car, much like the lesser-used Vivaldi browser. While parked users will be able to use the Chrome browser for, well, browsing the internet, much like they do on phones and other devices. 

The CES show is open to the public at the Las Vegas Convention Center and other locations from Tuesday through Friday.