Automotive XR (Extended Reality) is an innovative technology that integrates VR (Virtual Reality), AR (Augmented Reality) and MR (Mixed Reality) technologies into vehicle systems. It can bring drivers and passengers richer and more intuitive information interaction experiences. It is an important embodiment of differentiation between intelligent cockpits of the future.
XR is integrated with IVI and smartphones to create multi-terminal integration experience.
In March 2023, Rokid and Li Auto announced Rokid Max, their cooperative AR glasses which support L series models. Li Auto’s IVI APP can be projected onto VR glasses for viewing, gaming, online office, etc. In addition, it allows handheld game consoles to be projected onto the center console screen and then to the glasses, so that users can control IVI and play games through gesture interaction.
![XR 1.png](/UpLoads/Article/2024/XR%201.png)
In November 2023, Xingji Meizu released MYVU intelligent AR glasses based on Flyme AR OS. The integration with Meizu smartphones via Flyme Link (a smartphone-IVI integration solution) not only allows for circulation of phone calls, music, videos, navigation, important application notifications and more to the AR glasses, but also makes it share computing power and network with the smartphone, thereby reducing the power consumption of the glasses and enabling a long cruising range. In the future, MYVU AR glasses will be integrated with cars and smartphones to create multi-terminal integration experience through seamless flow of applications and data.
Therefore, at the “Meizu Flyme Ecosystem Launch”, Xingji Meizu upgraded the operating system Flyme to FlymeOS. Composed of Flyme 10 (smartphone OS), Flyme Auto (Meizu IVI system), and Flyme AR (AR glasses OS), FlymeOS covers three major areas: smartphone, XR and intelligent vehicle. FlymeOS features "Internet of Everything, Boundless and Infinite", and becomes the base for connecting all terminals.
![XR 2.png](/UpLoads/Article/2024/XR%202.png)
AI+AR to enhance voice interaction experience
At CES 2024, Rayneo unveiled Rayneo X2 Lite, a stereo full-color MicroLED optical waveguide AR glasses that introduce Rayneo AI (released in December 2023), a foundation model voice assistant. With Rayneo AI, Rayneo X2 Lite enables multiple capabilities including multi-round natural language conversations, trip planning, easy encyclopedic Q&A and brainstorming, and supports AI-assisted translation, 3D spatial navigation, and first-person perspective video creation. In March 2024, Rayneo Technology closed a new funding round and raised RMB100 million which will be used to develop and spawn next-generation AR glasses and expedite the construction of the AI+AR glasses ecosystem.
Xingji Meizu is also laying out AI+AR. In November 2023, Xingji Meizu released two MYVU series AR glasses, connected to the Flyme AI foundation model. Based on AI, AI assistant can be awakened in real time to provide travel tips, study plans, business analysis, and other daily life and work collaboration. At the same time, AR glasses can realize scenario functions such as teleprompter, real-time translation (in Chinese and English), and cycling navigation.
![XR 3.png](/UpLoads/Article/2024/XR%203.png)
Automotive XR scenarios expand from entertainment to driving assistance and vehicle control.
Currently, XR mainly caters to users’ needs for cockpit entertainment, for example, viewing and gaming. Moreover suppliers are also exploring other application scenarios such as driving assistance and vehicle control.
At CES 2024, BMW and XREAL together demonstrated XREAL Air 2 AR glasses, a device which integrates vehicle information, infotainment, vehicle electronic and electrical information, BMW cloud information and other data. Wearing the glasses, users can see how navigation instructions, hazard warnings, entertainment content, information on charging stations and supporting visualizations in parking situations are embedded perfectly into the real-world environment by the “XREAL Air 2”.
![XR 4.png](/UpLoads/Article/2024/XR%204.png)
At CES 2023, Audi presented activesphere, a concept car which is equipped with four AR headsets. Wearing Magic Leap 2 AR glasses, the driver can view trip data, road conditions, location and navigation information in real time the MR visual interface with a 70° FOV; the passengers can control air conditioning temperature, airflow, and audio system next to their seats via gestures.
Furthermore, AR technology can be available beyond the cockpit. In off-road scenarios, the topographic map can be projected into the surroundings; in commuting, traffic information, routes and safety warnings can be projected in layers into the driver's view.
Ecological Domain and Automotive Hardware Expansion Research Report, 2024
Automotive Ecological Domain Research: How Will OEM Ecology and Peripheral Hardware Develop? Ecological Domain and Automotive Hardware Expansion Research Report, 2024 released by ResearchInChina ...
C-V2X and CVIS Industry Research Report, 2024
C-V2X and CVIS Research: In 2023, the OEM scale will exceed 270,000 units, and large-scale verification will start.The pilot application of "vehicle-road-cloud integration” commenced, and C-V2X entere...
Automotive Intelligent Cockpit Platform Configuration Strategy and Industry Research Report, 2024
According to the evolution trends and functions, the cockpit platform has gradually evolved into technical paths such as cockpit-only, cockpit integrated with other domains, cockpit-parking integratio...
Analysis on Huawei's Electrification, Connectivity, Intelligence and Sharing,2023-2024
Analysis on Huawei's Electrification, Connectivity, Intelligence and Sharing: Comprehensive layout in eight major fields and upgrade of Huawei Smart Selection
The “Huawei Intelligent Driving Business...
Li Auto’s Layout in Electrification, Connectivity, Intelligence and Sharing and Strategy Analysis Report, 2023-2024
Li Auto overestimates the BEV market trend and returns to intensive cultivation.
In the MPV market, Denza D9 DM-i with the highest sales (8,030 units) in January 2024 is a hybrid electric vehicle (H...
Analysis on NIO’s Layout in Electrification, Connectivity, Intelligence and Sharing, 2023
Analysis on NIO’s Layout in Electrification, Connectivity, Intelligence and Sharing, 2023
Because of burning money and suffering a huge loss, many people thought NIO would soon go out of business. NI...
Monthly Monitoring Report on China Automotive Sensor Technology and Data Trends (Issue 3, 2024)
Insight into intelligent driving sensors: “Chip-based” reduces costs, and the pace of installing 3-LiDAR solutions in cars quickens. LiDARs were installed in 173,000 passenger cars in China in Q1 2024...
Autonomous Driving Simulation Industry Report, 2024
Autonomous Driving Simulation Research: Three Trends of Simulation Favoring the Implementation of High-level Intelligent Driving.
On November 17, 2023, the Ministry of Industry and Information Techno...
Mobile Charging Robot Research Report, 2024
Research on mobile charging robot: more than 20 companies have come in and have implemented in three major scenarios.
Mobile Charging Robot Research Report, 2024 released by ResearchInChina highlight...
End-to-end Autonomous Driving (E2E AD) Research Report, 2024
End-to-end Autonomous Driving Research: status quo of End-to-end (E2E) autonomous driving
1. Status quo of end-to-end solutions in ChinaAn end-to-end autonomous driving system refers to direct mappi...
Monthly Monitoring Report on China Automotive Intelligent Driving Technology and Data Trends (Issue 2, 2024)
Insight into intelligent driving: ECARX self-develops intelligent driving chips, and L2.5 installation soared by 175% year on year.
Based on the 2023 version, the 2024 version of Monthly...
Monthly Monitoring Report on China Automotive Intelligent Cockpit Technology and Data Trends (Issue 2, 2024)
Insight into intelligent cockpit: the trend towards large screens is obvious, with >10" center console screens sweeping over 80%.
Based on the 2023 Edition, the 2024 Edition of Monthly Monitoring...
China Intelligent Driving Fusion Algorithm Research Report, 2024
Intelligent Driving Fusion Algorithm Research: sparse algorithms, temporal fusion and enhanced planning and control become the trend.
China Intelligent Driving Fusion Algorithm Research Report, 2024 ...
Automotive Electronics OEM/ODM/EMS Industry Report, 2024
Automotive electronics OEM/ODM/EMS research: top players’ revenue has exceeded RMB10 billion, and new entrants have been coming in.
At present, OEMs in the Chinese automotive electronics indus...
Analysis on Xpeng’s Layout in Electrification, Connectivity, Intelligence and Sharing, 2023
Research on Xpeng’s layout in electrification, connectivity, intelligence and sharing: in the innovation-driven rapid development, secured orders for 100 flying cars.
NIO, Xp...
Automotive Cockpit SoC Research Report, 2024
Automotive Cockpit SoC Research: Automakers quicken their pace of buying SoCs, and the penetration of domestic cockpit SoCs will soar
Mass production of local cockpit SoCs is accelerating, and the l...
Automotive Integrated Die Casting Industry Report, 2024
Integrated Die Casting Research: adopted by nearly 20 OEMs, integrated die casting gains popularity.
Automotive Integrated Die Casting Industry Report, 2024 released by ResearchInChina summari...
China Passenger Car Cockpit Multi/Dual Display Research Report, 2023-2024
In intelligent cockpit era, cockpit displays head in the direction of more screens, larger size, better looking, more convenient interaction and better experience. Simultaneously, the conventional “on...