Automotive Vision Industry Chain Report (II) Binocular and Others
  • May 2020
  • Hard Copy
  • USD $3,600
  • Pages:210
  • Single User License
    (PDF Unprintable)       
  • USD $3,400
  • Code: TY003
  • Enterprise-wide License
    (PDF Printable & Editable)       
  • USD $5,000
  • Hard Copy + Single User License
  • USD $3,800
      

Visual Perception Algorithms Become Crucial

Automotive cameras are divided into perception cameras and video cameras, according to Sunny Optical.

Perception camera, used for active safety (generally for forward and inward view), captures images accurately. Video camera, suitable for passive safety (typically surround view and rear view), stores or sends the captured images to the user. They are totally different in imaging quality and temperature reliability.

For lane detection, signal light detection, road sign recognition, in-vehicle monitoring, etc., any errors in the images taken by perception cameras will issue in software calculation errors and inevitable consequences. In this sense, perception camera is less sensitive to price.

Video cameras, with not so high a demanding on performance, are very sensitive to price; there exists a price war in this market where numerous Chinese companies are fiercely scrambling for meager profits but the vast majority do not make money. As per the pattern of Chinese passenger-car-use surround-view camera OEM market in 2019, the market share of vendors is quite scattered, a sharp contrast to the top 6 players holding a combined over 90% of the front-view monocular camera market.

双目1_副本.png

Forward-view cameras require complex algorithms and chips. A forward-view monocular camera costs nearly RMB1,000, and a forward-view binocular camera over RMB1,000. Rear-view, side-view and in-built cameras has the unit price at RMB200 or so.

Breakthroughs in Binocular Camera

Chinese startups have made dramatic breakthroughs in binocular cameras, especially for commercial vehicle and special vehicle.

Smarter Eye has shipped more than 10,000 binocular cameras, mainly available in Apollo autonomous vehicles, JMC small buses, sanitation vehicles, autonomous boats, tractors, patrol vehicles, etc. Smarter Eye’s binocular cameras are typically rendered for AEBS and detection of height limiters. The bus groups in more than 30 cities have employed such cameras.

Smarter Eye pioneers in applying binocular cameras to detect height limiters. Both conventional height limiters and non-standard height limiters such as small archways and culverts in the countryside can be accurately perceived by binocular cameras that promptly warn drivers by sound and light alarms. Recreational vehicles, special vehicles, etc. have rigid demand for this function.

双目2_副本.png

In 2019, Sphyrna Technology announced it successfully developed a flexible binocular camera system which can use two separate monocular cameras to accomplish a binocular camera system, overcoming inherent defects (large size, complicated process, difficult installation, and high cost) of binocular cameras.

双目3_副本.png

The two cameras are independently fixed on the right side of the car body, needing neither rigid connection in the middle nor strict requirements on angle or spacing. The "flexible binocular cameras" lie in self-calibration technology. Even if the cameras slightly deform and move during use, Sphyrna Technology's algorithms will automatically detect and recalibrate, dispensing with regular recalibration essential to conventional binocular cameras.

In April 2020, Foresight Autonomous Holdings Ltd. announced to collaborate with FLIR Systems Inc. on the development, marketing and distribution of Foresight’s QuadSight? vision system, combined with FLIR Systems’ infrared cameras, to a wide range of prospective customers. Foresight will exclusively purchase its thermal cameras from FLIR for all systems to be commercialized worldwide. Foresight’s unique QuadSight system, comprised of four thermal and visible-light cameras, showcases the capability of FLIR thermal cameras to greatly improve ADAS and autonomous vehicle safety through improved situational awareness at night, in high-contrast scenes and in bad weather. The data fusion between the two stereo channels can effectively avoid the non-reporting or false-reporting under the extreme conditions like the tunnel entrance where light changes quickly.

Millimeter-wave radar is beating other sensors. The same is true of cameras. Many companies like MAXIEYE are attempting to replace binocular cameras or liDAR by using monocular cameras for ranging and 3D imaging.

Unlike the first-generation product -- IFVS-200 series based on machine learning solutions, MAXIEYE’s 3rd-Gen product IFVS-500 family based on deep learning technology achieves monocular ranging and 3D scanning. IFVS-500 not only allows monocular vision products to perform 3D scanning like lidar, but also resembles lidar by scanning the 3D point cloud within 50 meters, enabling direct ranging of the object and detection of both motor vehicles within 200 meters and pedestrians & small obstacles within 100 meters.

Visual Capabilities under Extreme Scenarios Heighten

Whatever vision inside or outside the car in poor lighting and even the dark requires infrared technology. ON Semiconductor's RGB-IR image sensor features near infrared (NIR) enhanced images. Israeli start-up TriEye has developed a sensor technology for short-wave infrared (SWIR) which enhances safety in vehicles fitted with assistance systems or autonomous driving functions by improving the ability to see in weather conditions where visibility is poor, such as dust, fog, murky conditions or rain, and to stay alert to the danger (like icy road) in advance.

双目4_副本.png

In April 2020, Alibaba DAMO Academy revealed that it has developed an ISP processor for in-vehicle cameras. Through the use of it, the car camera has a significant improvement in image object detection and recognition capabilities by more than 10% compared to the mainstream processor in the night, the most challenging scene, and the original obscure labeling can be clearly identified, according to the drive test results of the DAMO Academy Automated Driving Laboratory.

On May 19, 2020, OmniVision announced the expansion of its Nyxel near-infrared (NIR) technology into the automotive market with the new 2.5-megapixel OX03A2S image sensor. This ASIL-B sensor is intended for exterior imaging applications that operate in low to no ambient light conditions within 2 meters of the vehicle. It can detect and recognize objects that other image sensors would reportedly miss under extremely low lighting conditions.

双目5_副本.png
 


Visual Perception Algorithms Become Crucial

The massive data incurred by the dramatic increment of vision sensors in smart cars as well as the addition of vision sensors has brought challenges and opportunities to algorithm processing.

For the visual perception system, Mobileye, a leader of visual ADAS algorithms, gets a multitude of independent perception algorithms used simultaneously to create internal redundancy layers for both detection and measurements with higher perception accuracy and stability. Detection is to determine what object is perceived, and measurements are to infer the 3D information of the perceived object via the 2D image of the camera.

For detection, Mobileye uses 6 independent engines:

  • 3DVD or 3D Object Detection: It is the common approach of predicting a 3D bounding box using a neural network from the 2D image.
  • Full Image Detection: It deals with the common scenario where an object (such as buses cars or trucks) is extremely close and can only be partially seen. Object classification using visual signatures is used to track close up vehicles in this scenario.
  • Top View FS: It focuses on identifying and marking the unoccupied roads in the screen.
  • Features Detection: This appearance-based engine detects vehicles from reliable features, such as wheels.
  • VIDAR: It is an approach that uses multiple views of the environment to triangulate and create a depth map. That depth map is converted into a point cloud and LiDAR based processing algorithms are used on that point cloud.
  • Scene Segmentation (NSS): It is a neural network-based approach to break the scene down into free space and semantic objects (vehicle, sign, pedestrian, etc.), the pixels containing an object are treated as a detection.

双目6_副本.png

Also as a leader in visual perception algorithms, Tesla names its deep learning network as HydraNet which involves 48 different neural networks that output 1,000 distinct tensors (predictions) at each timestep; in theory, HydraNet can detect 1,000 objects simultaneously. Tesla acquired DeepScale, a Silicon Valley startup that focuses on developing computer vision technologies, in a bid to improve its algorithmic capabilities.

To catch up with Tesla and Mobileye in visual perception algorithms, OEMs and Tier1 suppliers are expanding their teams of software engineers. The algorithmic capabilities will be one of the decisive factors to the performance of visual perception.

5 Chinese Automotive Vision Companies

5.1 Smarter Eye
5.1.1 Profile
5.1.2 Products
5.1.3 Development
5.1.4 Comparison between Likewise Products
5.1.5 Production
5.1.6 Application of Binocular Stereo Vision Products
5.2 Sphyrna Technology
5.2.1 Profile
5.2.2 Products
5.2.3 Flexible Binocular System
5.2.4 Large Truck ADAS
5.3 Slightech Intelligent Technology
5.3.1 Profile
5.3.1 Core Technologies
5.3.2 Binocular Camera Depth Sereis
5.3.3 Binocular ADAS Solutions
5.3.4 Autonomous Delivery Solutions
5.4 METOAK
5.4.1 Profile
5.4.2 Solutions
5.4.3 Product Application
5.5 SinoChipAi
5.5.1 Profile
5.5.2 Vision Products
5.5.3 Binocular ADAS
5.5.4 Partners
5.6 Hisense TransTech
5.6.1 Profile
5.6.2 Solutions
5.6.3 Binocular ADAS
5.7 Zhejiang Dahua Technology
5.7.1 Profile
5.7.2 Products
5.7.3 DAHUA Binocular Application
5.7.4 DAHUA Binocular News
5.8 Foresight 
5.8.1 Profile
5.8.2 Quad-ocular Vision System
5.8.3 Binocular Vision System Eyes-On
5.8.4 Foresight Eye-Net
5.8.5 Dynamics
5.9 RICOH
5.9.1 Profile
5.9.2 Development Strategy
5.9.3 Binocular Module
5.9.4 Other Applications of Binocular Products
5.10 Other Tier 1 Suppliers’ Binocular Products
5.10.1 Continental
5.10.2 Bosch Binocular Camera
5.10.3 Denso Stereo Vision Sensor
5.10.4 ZF Binocular Camera
5.11 Summary of Binocular Product and Technologies
5.11.1 Trends of Binocular Stereo Vision Technology
5.11.2 Binocular Chip

6 Other Automotive Vision Companies

6.1 Surround-view Market Overview
6.1.1 Number of Surround-view Cameras Installed in New Cars in China, 2018-2019
6.1.2 Number of Surround-view Cameras Installed in New Cars in China by Month, 2018-2019
6.1.3 Proportion of Surround-view Cameras Installed in New Cars and Top 20 Brands in China, 2019
6.1.4 Top 20 Brands by Installation Rate of Surround-view Cameras in New Cars in China, 2019
6.1.5 Top 10 Brands by Surround-view Camera Installed in New Cars and Installation Rate (by Price) in China, 2019
6.2 TungThih Electronic
6.2.1 Profile
6.2.2 Global Presence and Product Layout
6.2.3 Cameras
6.2.4 Major Products and Clients
6.3 HSAE
6.3.1 Profile
6.3.2 Product System
6.3.3 Collaborations
6.3.4 Suppliers
6.3.5 Clients
6.4 Hikvision
6.4.1 Profile
6.4.2 Revenue
6.4.3 Automotive Electronics
6.4.4 Vision Products
6.5 Softec
6.5.1 Profile
6.5.2 Automotive Surround-view System
6.5.3 Main Cameras
6.6 oToBrite
6.6.1 Profile
6.6.2 ADAS Products
6.6.3 Core Technologies
6.6.4 Cameras
6.6.5 Automated Parking System
6.6.6 Clients and Partners
6.7 MINTH Group
6.7.1 Profile
6.7.2 Revenue
6.7.3 R&D and Design Capabilities
6.7.4 History of Camera Business
6.7.5 Surround-view Products
6.7.6 Application of ADAS Products
6.8 LG 
6.8.1 Profile
6.8.2 Automotive Electronics
6.8.3 Cameras
6.8.4 ADAS Products
6.9 Panasonic
6.9.1 Profile
6.9.2 Automotive Business Revenue
6.9.3 Automotive Electronics Families
6.9.4 Automotive Vision Products
6.10 Valeo
6.10.1 Profile
6.10.2 Revenue in 2019
6.10.3 Automotive Vision and ADAS System
6.10.4 Vision Products
6.10.5 Partners in Vision Products
6.11 Others

7 Suppliers of Key Components for Automotive Camera

7.1 ON Semiconductor
7.1.1 Profile
7.1.2 Operation and Automotive Business Layout in 2019
7.1.3 Automotive Ecosystem
7.1.4 CMOS Market Position
7.1.5 ADAS Image Sensors
7.1.6 Automotive Camera System Architecture and CMOS Product System
7.1.7 Automotive CMOS Products
7.1.8 Mergers and Acquisitions in Recent Years
7.2 Sony
7.2.1 Profile
7.2.2 Operation in 2019
7.2.3 Technical Superiority in CMOS Field
7.2.4 Cameral Module Product System
7.2.6 Development Course of Automotive CMOS
7.2.7 Automotive CMOS Pedigrees
7.2.8 Automotive CMOS Products
7.2.9 Latest Vision CMOS Products
7.3 OmniVision
7.3.1 Profile
7.3.2 Image Sensors
7.3.3 Automotive Image Sensors
7.3.4 Dynamics
7.4 PixArt Imaging Inc.
7.4.1 Profile
7.4.2 CIS and Chip Products and Planned Products
7.4.3 PixArt Product
7.4.4 Automotive Vision Application System
7.4.5 Gesture Control IC for Automotive Use
7.5 Sunny Optical
7.5.1 Profile
7.5.2 Revenue in 2019
7.5.3 Business Layout
7.5.4 Development Course of Automotive Cameras 
7.5.5 Automotive Camera Sales and Shipments
7.5.6 Latest Developments and Layout
7.6 Lianchuang Electronic Technology
7.6.1 Profile
7.6.2 Development Course and Equity Structure
7.6.3 Revenue and R&D Expenditure
7.6.4 Automotive Lenses
7.6.5 Application in Automotive Camera Field
7.6.6 Major Clients

8 Development Tendencies of Automotive Vision Industry

8.1 ToF Use in Vehicle
8.1.1 What Is the 3D Perception Technology?
8.1.2 3D Perception: Stereo Vision and Structured Light
8.1.3 3D Perception: ToF
8.1.4 Huge Potentiality of ToF
8.1.5 Comparison between Main ToF Image Sensors
8.1.6 Infineon’s and Panasonic’s ToF
8.1.7 ADI ToF
8.1.8 Panasonic’s All-new ToF Image Sensor
8.2 AI Use in Automotive Vision
8.3 Other Automotive Vision Trends
 

Global and China Leading Tier1 Suppliers’ Intelligent Cockpit Business Research Report, 2022 (II)

Tier1 Intelligent Cockpit Research: The mass production of innovative cockpits gathers pace, and penetration of new technologies is on a rapid riseGlobal OEMs and Tier 1 suppliers are racing for the i...

Global and China Leading Tier1 Suppliers’ Intelligent Cockpit Business Research Report, 2022 (I)

Tier1 Intelligent Cockpit Research: The mass production of innovative cockpits gathers pace, and penetration of new technologies is on a rapid riseGlobal OEMs and Tier 1 suppliers are racing for the i...

China Commercial Vehicle Intelligent Cockpit Industry Report 2021

Research on Intelligent Cockpits of Commercial Vehicles: Heading for Large Screens, Voice Interaction, Entertainment and Life Following AD/ADAS functions, the intelligent configuration of the cockpit...

Automotive Ultra Wide Band (UWB) Industry Report, 2022

UWB got initially utilized in the military field, and began to be commercially applied after the release of criteria for UWB commercialization in 2002. In 2019, Car Connectivity Consortium (CCC) liste...

China Automotive Distribution and Aftermarket Industry Report, 2022-2027

Since the introduction of 4S store model into China at the end of 20th century, China's authorized dealer system has gradually developed from a single-store-based mode to a group-based mode, and from ...

Global and China Skateboard Chassis Industry Report, 2021-2022

Research into skateboard chassis: where to sell, how to sell and to whom it is sold Rivian, a new carmaker based on skateboard chassis, is quite popular in the market and becomes the focus of the aut...

Emerging Automakers Strategy Research Report, 2022--NIO

Research on emerging carmaking strategies: no new cars in 2021, 3 new cars in 2022, can NIO make its renaissance? The delivery of ET7 is imminent, and the sluggish sales situation is expected to fade...

Automotive and 5G Industry Integration Development Report, 2022

Research on integration of vehicle and 5G: OEMs rush into mass production of 5G models whose sales may reach 3.68 million units in 2025 By the end of 2021, China had built and opened in excess of 1.3...

China Automotive Finance Industry Report, 2022-2030

Auto finance is lucrative with the highest profit margin in the international automobile industry chain, contributing to roughly 23% of the global automobile industry profits. Yet, auto finance only h...

Global and China Power Battery Management System (BMS) Industry Report, 2022-2026

1. Robust demand from new energy vehicle spurs BMS market to boom New energy vehicle sales have been growing rapidly worldwide over the recent years, reaching 6.5 million units with a year-on-year up...

ADAS/AD Chip Industry Research Report, 2022

Autonomous driving chip research: In addition to computing power, core IP, software stacks, AI training platforms, etc. are becoming more and more importantL2.5 and L2.9 have achieved mass production ...

Automotive Sensor Chip Industry Research Report, 2022

Sensor Chip Research: Automotive Sensors Have Entered a Technology Iteration Cycle, and Opportunities for Localization of Chips Are Coming Automotive sensor chips can obtain external environment ...

Automotive Cloud Service Platform Industry Report, 2021-2022

Research on Automotive Cloud Services: Based on 5ABCD, cloud services run through the R&D, production, sale, management and services of automakersWith the development of intelligent connectivity, ...

Global and China Cobalt Industry Report, 2021-2026

As a very rare metal and an important strategic resource for a country, cobalt gets typically utilized in battery materials, super heat-resistant alloys, tool steels, cemented carbides, and magnetic m...

Automotive Event Data Recorder (EDR) Industry Report, 2022

An event data recorder (EDR), sometimes referred to informally as an automotive black box, is a device or a system installed in vehicle to monitor, collect and record technical vehicle data and occupa...

Commercial Vehicle ADAS Industry Report, 2021

ResearchInChina has published the "Commercial Vehicle ADAS Industry Report, 2021", focusing on policy climate, ADAS installations, suppliers, etc., and with a deep dive into the prospects of Chinese c...

Automotive High-precision Positioning Research Report, 2022

High-precision Positioning Research: from L2+ to L3, high-precision integrated navigation and positioning will become the standard With the development and progress of the autonomous driving industry...

China Around View System (AVS) Suppliers and Technology Trends Report, 2021 –Joint Venture Automakers

Research into JV automakers’ around view system: large-scale implementation of AVP is round the corner, and AVS vendors are energetically pushing ahead with parking fusion solution. During January to...

2005- www.researchinchina.com All Rights Reserved 京ICP备05069564号-1 京公网安备1101054484号