Automotive XR (Extended Reality) is an innovative technology that integrates VR (Virtual Reality), AR (Augmented Reality) and MR (Mixed Reality) technologies into vehicle systems. It can bring drivers and passengers richer and more intuitive information interaction experiences. It is an important embodiment of differentiation between intelligent cockpits of the future.
XR is integrated with IVI and smartphones to create multi-terminal integration experience.
In March 2023, Rokid and Li Auto announced Rokid Max, their cooperative AR glasses which support L series models. Li Auto’s IVI APP can be projected onto VR glasses for viewing, gaming, online office, etc. In addition, it allows handheld game consoles to be projected onto the center console screen and then to the glasses, so that users can control IVI and play games through gesture interaction.
![XR 1.png](/UpLoads/Article/2024/XR%201.png)
In November 2023, Xingji Meizu released MYVU intelligent AR glasses based on Flyme AR OS. The integration with Meizu smartphones via Flyme Link (a smartphone-IVI integration solution) not only allows for circulation of phone calls, music, videos, navigation, important application notifications and more to the AR glasses, but also makes it share computing power and network with the smartphone, thereby reducing the power consumption of the glasses and enabling a long cruising range. In the future, MYVU AR glasses will be integrated with cars and smartphones to create multi-terminal integration experience through seamless flow of applications and data.
Therefore, at the “Meizu Flyme Ecosystem Launch”, Xingji Meizu upgraded the operating system Flyme to FlymeOS. Composed of Flyme 10 (smartphone OS), Flyme Auto (Meizu IVI system), and Flyme AR (AR glasses OS), FlymeOS covers three major areas: smartphone, XR and intelligent vehicle. FlymeOS features "Internet of Everything, Boundless and Infinite", and becomes the base for connecting all terminals.
![XR 2.png](/UpLoads/Article/2024/XR%202.png)
AI+AR to enhance voice interaction experience
At CES 2024, Rayneo unveiled Rayneo X2 Lite, a stereo full-color MicroLED optical waveguide AR glasses that introduce Rayneo AI (released in December 2023), a foundation model voice assistant. With Rayneo AI, Rayneo X2 Lite enables multiple capabilities including multi-round natural language conversations, trip planning, easy encyclopedic Q&A and brainstorming, and supports AI-assisted translation, 3D spatial navigation, and first-person perspective video creation. In March 2024, Rayneo Technology closed a new funding round and raised RMB100 million which will be used to develop and spawn next-generation AR glasses and expedite the construction of the AI+AR glasses ecosystem.
Xingji Meizu is also laying out AI+AR. In November 2023, Xingji Meizu released two MYVU series AR glasses, connected to the Flyme AI foundation model. Based on AI, AI assistant can be awakened in real time to provide travel tips, study plans, business analysis, and other daily life and work collaboration. At the same time, AR glasses can realize scenario functions such as teleprompter, real-time translation (in Chinese and English), and cycling navigation.
![XR 3.png](/UpLoads/Article/2024/XR%203.png)
Automotive XR scenarios expand from entertainment to driving assistance and vehicle control.
Currently, XR mainly caters to users’ needs for cockpit entertainment, for example, viewing and gaming. Moreover suppliers are also exploring other application scenarios such as driving assistance and vehicle control.
At CES 2024, BMW and XREAL together demonstrated XREAL Air 2 AR glasses, a device which integrates vehicle information, infotainment, vehicle electronic and electrical information, BMW cloud information and other data. Wearing the glasses, users can see how navigation instructions, hazard warnings, entertainment content, information on charging stations and supporting visualizations in parking situations are embedded perfectly into the real-world environment by the “XREAL Air 2”.
![XR 4.png](/UpLoads/Article/2024/XR%204.png)
At CES 2023, Audi presented activesphere, a concept car which is equipped with four AR headsets. Wearing Magic Leap 2 AR glasses, the driver can view trip data, road conditions, location and navigation information in real time the MR visual interface with a 70° FOV; the passengers can control air conditioning temperature, airflow, and audio system next to their seats via gestures.
Furthermore, AR technology can be available beyond the cockpit. In off-road scenarios, the topographic map can be projected into the surroundings; in commuting, traffic information, routes and safety warnings can be projected in layers into the driver's view.
Chinese OEMs (Passenger Car) Going Overseas Report, 2024--Germany
Keywords of Chinese OEMs going to Germany: electric vehicles, cost performance, intelligence, ecological construction, localization
The European Union's temporary tariffs on electric vehicles in Chi...
Analysis on DJI Automotive’s Autonomous Driving Business, 2024
Research on DJI Automotive: lead the NOA market by virtue of unique technology route.
In 2016, DJI Automotive’s internal technicians installed a set of stereo sensors + vision fusion positioning syst...
BYD’s Layout in Electrification, Connectivity, Intelligence and Sharing and Strategy Analysis Report, 2023-2024
Insight: BYD deploys vehicle-mounted drones, and the autonomous driving charging robot market is expected to boom.
BYD and Dongfeng M-Hero make cross-border layout of drones.
In recent years,...
Great Wall Motor’s Layout in Electrification, Connectivity, Intelligence and Sharing and Strategy Analysis Report, 2023-2024
Great Wall Motor (GWM) benchmarks IT giants and accelerates “Process and Digital Transformation”.
In 2022, Great Wall Motor (GWM) hoped to use Haval H6's huge user base to achieve new energy transfo...
Cockpit AI Agent Research Report, 2024
Cockpit AI Agent: Autonomous scenario creation becomes the first step to personalize cockpits
In AI Foundation Models’ Impacts on Vehicle Intelligent Design and Development Research Report, 2024, Res...
Leading Chinese Intelligent Cockpit Tier 1 Supplier Research Report, 2024
Cockpit Tier1 Research: Comprehensively build a cockpit product matrix centered on users' hearing, speaking, seeing, writing and feeling.
ResearchInChina released Leading Chinese Intelligent Cockpit ...
Global and China Automotive Wireless Communication Module Market Report, 2024
Communication module and 5G research: 5G module installation rate reaches new high, 5G-A promotes vehicle application acceleration
5G automotive communication market has exploded, and 5G FWA is evolv...
ADAS and Autonomous Driving Tier 1 Suppliers Research Report, 2024 – Chinese Companies
ADAS Tier1s Research: Suppliers enter intense competition while exploring new businesses such as robotics
In China's intelligent driving market, L2 era is dominated by foreign suppliers. Entering era...
Automotive Gateway Industry Report, 2024
Automotive gateway research: 10BASE-T1S and CAN-XL will bring more flexible gateway deployment solutions
ResearchInChina released "Automotive Gateway Industry Report, 2024", analyzing and researching...
Global and China Electronic Rearview Mirror Industry Report, 2024
Research on electronic rearview mirrors: electronic internal rearview mirrors are growing rapidly, and electronic external rearview mirrors are facing growing pains
ResearchInChina released "Global a...
Next-generation Zonal Communication Network Topology and Chip Industry Research Report, 2024
The in-vehicle communication architecture plays a connecting role in automotive E/E architecture. With the evolution of automotive E/E architecture, in-vehicle communication technology is also develop...
Autonomous Delivery Industry Research Report, 2024
Autonomous Delivery Research: Foundation Models Promote the Normal Application of Autonomous Delivery in Multiple Scenarios
Autonomous Delivery Industry Research Report, 2024 released by ResearchInCh...
Global Autonomous Driving Policies & Regulations and Automotive Market Access Research Report, 2024
Intelligent driving regulations and vehicles going overseas: research on regional markets around the world and access strategies. "Going out”: discussion about regional markets aroun...
China Passenger Car HUD Industry Report, 2024
HUD research: AR-HUD accounted for 21.1%; LBS and optical waveguide solutions are about to be mass-produced. The automotive head-up display system (HUD) uses the principle of optics to display s...
Ecological Domain and Automotive Hardware Expansion Research Report, 2024
Automotive Ecological Domain Research: How Will OEM Ecology and Peripheral Hardware Develop? Ecological Domain and Automotive Hardware Expansion Research Report, 2024 released by ResearchInChina ...
C-V2X and CVIS Industry Research Report, 2024
C-V2X and CVIS Research: In 2023, the OEM scale will exceed 270,000 units, and large-scale verification will start.The pilot application of "vehicle-road-cloud integration” commenced, and C-V2X entere...
Automotive Intelligent Cockpit Platform Configuration Strategy and Industry Research Report, 2024
According to the evolution trends and functions, the cockpit platform has gradually evolved into technical paths such as cockpit-only, cockpit integrated with other domains, cockpit-parking integratio...
Analysis on Huawei's Electrification, Connectivity, Intelligence and Sharing,2023-2024
Analysis on Huawei's Electrification, Connectivity, Intelligence and Sharing: Comprehensive layout in eight major fields and upgrade of Huawei Smart Selection
The “Huawei Intelligent Driving Business...