The Mercedes-Benz CLA will be the first vehicle to feature Google Cloud’s new Automotive AI Agent, enhancing the MBUX virtual assistant with advanced conversational capabilities. This integration, announced Monday, promises a more intuitive and personalized in-car experience.
Mercedes previewed its next-generation MBUX assistant at CES 2024, but details about the underlying language model remained undisclosed until now. The new system represents a significant leap from the current MBUX, which offers around two dozen voice commands and information sourced from ChatGPT and Bing. While the current system responds to “Hey, Mercedes,” its functionality is closer to Siri or Google Assistant, providing static responses rather than engaging in conversation.
The Mercedes MBUX
Google’s Automotive AI Agent, powered by the Gemini large language model (LLM) and leveraging Vertex AI, is designed to revolutionize in-car interactions. It supports multimodal and multilingual inputs, enables follow-up questions, and offers a more dynamic conversational experience. For instance, drivers can inquire about nearby Italian restaurants, access reviews, and even discover popular dishes. The agent is designed for multi-turn dialogues, remembering details from previous conversations for a more personalized interaction.
Enhanced Navigation and Personalized Information
The enhanced MBUX will access real-time data from Google Maps, providing comprehensive information on over 250 million points of interest globally and current traffic conditions. This integration aims to deliver a seamless and informative navigation experience.
A Partnership Focused on the Future of In-Car Experiences
“At Mercedes-Benz, we seek to offer our customers an exceptional digital experience,” stated Ola Källenius, CEO of Mercedes-Benz Group AG. The collaboration with Google Cloud signifies a commitment to enhancing in-car navigation by combining advanced location data with the power of generative AI.
Expanding the Reach of the New MBUX
While the CLA leads the charge, Mercedes-Benz plans to integrate the new MBUX assistant into additional models in the future, though specific models have not yet been announced. This strategic partnership positions Mercedes-Benz at the forefront of in-car AI innovation.
The integration of Google Cloud’s Automotive AI Agent into the MBUX system marks a significant step towards a more intelligent and conversational in-car experience. This partnership underscores Mercedes-Benz’s dedication to providing cutting-edge technology and personalized experiences for its drivers.