China Automotive Human-Machine Interaction (HMI) Research Report, 2020
Automotive HMI refers to the process of information exchange between humans and the car through interaction means such as voice, gesture, face, AR, holographic display and fingerprint recognition.
Over a decade of development, in-car voice interaction was installed to 28.7% of vehicles and even a higher share of new models on the market in the first half of 2019. Voice interaction is extending from infotainment (navigation, multimedia, etc.) to body control (windows, sunroof, lights, wipers, trunk, etc.) and life services (car-home connectivity, in-car shopping, etc.), and voice technology is getting through to infotainment protocols and in-car ecology.
Gesture recognition was first found in BMW model in 2015, and has been successively available in China-made models such as the Traum SEEK 5, Chery 5X, Xpeng G3 Premium, etc. It is mainly used to control the display system in the car, such as music play, volume regulation, map zoom, etc., as a supplementary interactive mode in a quiet environment.
Face recognition, unveiled in China in 2018, has been seen in Leapmotor S01, Chery’s EXEED TX, WEY VV6, WM Motor’s EX5, Geely Xing Yue and other models, showing a rosy prospect. Face recognition is mostly for personalized settings (seat position, ambient light preference, rearview mirror position, music recommendation, etc.) and driver status detection. EXEED TX supports to buy movie tickets by face scanning and heads toward face payment.
In addition, new interactive modes like window interaction (WM Motor's EX5), body interaction (BAIC BJEV's LITE), vein recognition (Leapmotor SO1), fingerprint recognition (Hyundai’s New SantaFe), and AR navigation (Roewe Marvel X) have been available onto production vehicles.

Foreign automotive HMI systems include BMW iDrive, Mercedes-Benz MBUX, Audi MMI, Ford SYNC +, etc. Among them, BMW iDrive has iterated to 7.0, with 6 interaction modes covering button, knob, touch, gesture, voice and cellphone. BMW iDrive is the first system in the world that adds gesture interaction, which can control phone calls, music playback, volume, map, menu, etc.
Chinese automotive HMI systems mainly embrace Geely GKUI, BYD DiLink, GAC ADiGO, SAIC Banma, Chery Lion, NextEV NIO OS, Xpeng Xmart OS, etc. Among them, Geely GKUI has been upgraded to GKUI2019 with 8 interaction modes via button, knob, touch, voice, cellphone, HUD, face recognition, and smart watch, where unique features are watch interaction (mainly ideal for remote car control and vehicle information inquiry like mobile phone interaction) and face recognition (FACE ID personalized settings).
In short, automotive HMI has entered the multi-modal (voice, gesture, face, etc.) interaction stage and is heading toward functional enrichment and multi-modal fusion. Moreover, HMI will transfer from in-vehicle interaction to multi-scenario interaction, from "passive interaction" to "active interaction".
China Automotive Human-Machine Interaction (HMI) Research Report, 2020 highlights the followings:
HMI (definition and development history), automotive HMI (design, development course, etc.);
Automotive HMI modes (voice interaction, face recognition, gesture recognition, and display inside and outside the vehicle);
Development history and modes of HMI systems of automakers at home and abroad, such as BMW iDrive, Mercedes-Benz MBUX, Audi MMI, Geely GKUI, SAIC Banma SmartDrive, Chery Lion, BYD DiLink, GAC ADiGO, NextEV NIO OS, etc.
Development trends of automotive HMI.
China Automotive Fragrance and Air Purification Systems Research Report, 2023
Automotive fragrance and air purification systems: together to create a comfortable and healthy cockpitTechnology trend: intelligence of fragrance system and integration of air purification system
In...
Global and China Solid State Battery Industry Report, 2023
Solid state battery research: semi-solid state battery has come out, is all-solid state battery still far away?In recent years, the new energy vehicle market has been booming, and the penetration of n...
Global and China Passenger Car T-Box Market Report, 2023
T-Box industry research: the market will be worth RMB10 billion and the integration trend is increasingly clear.
ResearchInChina released "Global and China Passenger Car T-Box Market Report, 2023", w...
Analysis Report on Auto Shanghai 2023
Analysis on 75 Trends at Auto Shanghai 2023: Unprecedented Prosperity of Intelligent Cockpits and Intelligent Driving Ecology
After analyzing the intelligent innovation trends at the Auto Shanghai 20...
Chinese Emerging Carmakers’ Telematics System and Entertainment Ecosystem Research Report, 2022-2023
Telematics service research (III): emerging carmakers work on UI design, interaction, and entertainment ecosystem to improve user cockpit experience.
ResearchInChina released Chinese Emerging Carmake...
China Passenger Car Cockpit-Parking Industry Report, 2023
Cockpit-parking integration research: cockpit-parking vs. driving-parking, which one is the optimal solution for cockpit-driving integration?Cockpit-parking vs. driving-parking, which one is the optim...
Automotive Sensor Chip Industry Report, 2023
Sensor chip industry research: driven by the "more weight on perception" route, sensor chips are entering a new stage of rapid iterative evolution.
At the Auto Shanghai 2023, "more weight on percepti...
Automotive Electronics OEM/ODM/EMS Industry Report, 2023
Automotive electronics OEM/ODM/EMS research: amid the disruption in the division of labor mode in the supply chain, which auto parts will be covered by OEM/ODM/EMS mode? Consumer electronic manu...
China Automotive Smart Glass Research Report, 2023
Smart glass research: the automotive smart dimming canopy market valued at RMB127 million in 2022 has a promising future.Smart dimming glass is a new type of special optoelectronic glass formed by com...
Automotive Ultrasonic Radar and OEM Parking Roadmap Development Research Report, 2023
Automotive Ultrasonic Radar Research: as a single vehicle is expected to carry 7 units in 2025, ultrasonic radars will evolve to the second generation.
As a single vehicle is expec...
Autonomous Driving SoC Research Report, 2023
Research on autonomous driving SoC: driving-parking integration boosts the industry, and computing in memory (CIM) and chiplet bring technological disruption.
“Autonomous Driving SoC Research ...
China ADAS Redundant System Strategy Research Report, 2023
Redundant System Research: The Last Line of Safety for Intelligent VehiclesRedundant design refers to a technology adding more than one set of functional channels, components or parts that enable the ...
Intelligent Steering Key Components Report, 2023
Research on intelligent steering key components: four development trends of intelligent steering
The automotive chassis consists of four major systems: transmission system, steering system, driving ...
Automotive Digital Instrument Cluster Operating System Report, 2023
Digital Instrument Cluster Operating System Report: QNX commanded 71% of the Chinese intelligent vehicle cluster operating system market.
Amid the trend for the integration of digital cluster and cen...
800V High Voltage Platform Research Report, 2023
How to realize the commercialization of 800V will play a crucial part in the strategy of OEMs.
As new energy vehicles and battery technology boom, charging and battery swapping in the new energy vehi...
Automotive Intelligent Cockpit Platform Research Report, 2023
Intelligent cockpit platform research: the boundaries between vehicles and PCs are blurring, and there are several feasible paths for cockpit platforms.
Automotive Intelligent Cockpit Platform Resea...
Global and China Automotive Wireless Communication Module Industry Report,2023
Vehicle communication module research: 5G R16+C-V2X module, smart SiP module and other new products spring up.
In 2022, 4G modules swept 84.3% of the vehicle communication module market....
Intelligent Vehicle Cockpit-Driving Integration Research Report, 2023
Cockpit-Driving Integration Research: many companies are making layout and may implement it during 2024-2025.
1. What is the real cockpit-driving integration?
At present, automotive electroni...