CES 2024: Mercedes Benz Is Getting An LLM Powered AI Assistant

Mercedes-Benz is embracing the large language model (LLM) trend at CES 2024, joining a host of automotive giants who are integrating generative AI into their in-car experiences. Volkswagen Group and Hyundai Motor Group have already announced LLM integrations, and now Mercedes-Benz is introducing the MBUX Virtual Assistant. This assistant, a part of the forthcoming MB.OS, promises to deliver a voice assistant experience that is strikingly human-like. Modern LLM-powered voice assistants, such as ChatGPT Plus and Inflexion AI's Pie, already demonstrate a realistic and engaging conversational ability. This new technology represents a significant advancement over existing voice assistants like Siri, Alexa, and Google Assistant, which, despite their effectiveness, still retain a robotic quality and have limited interactive capabilities.

Mercedes-Benz is championing features such as predictive behaviour, enabling the assistant to understand and adapt to the user's habits. The familiar "Hey Mercedes" command will continue to be used, followed by a directive to perform tasks such as adjusting the vehicle’s temperature, navigating to a destination, or placing a phone call. While many of these functions are present in current vehicles, their performance is often subpar. LLMs and generative foundational models are set to enhance these functionalities substantially.

However, Mercedes-Benz has not yet disclosed its LLM provider, unlike Volkswagen, which has confirmed its collaboration with OpenAI. "Mercedes-Benz is committed to working with the best partners in the industry to ensure that the MBUX system remains at the forefront of automotive technology," stated Cathleen Decker of Mercedes-Benz.

The new Mercedes assistant, based on LLM technology, will exhibit four personality traits: natural, predictive, personal, and empathetic. It will be customisable to suit the driver's preferences, including tone and speaking style. To power MB.OS, Mercedes is relying on Nvidia’s water-cooled chipsets. Nvidia has gained significant prominence as the world's most valuable semiconductor company, thanks to its role in the generative AI wave. Its super GPUs are not only pivotal in data centres but are also key in automotive chips and gaming GPUs.

In addition to this, Mercedes-Benz is developing its own modular architecture, set to debut in 2025. Collaborations are also underway with Microsoft to incorporate Microsoft Teams and with Sony to integrate Sony Pictures Ridevu. A new surround navigation system is also in the works, offering enhanced spatial awareness. This system will be presented in 3D, utilising the Unity engine.