Automotive Vision Industry Chain Report (II) Binocular and Others
  • May 2020
  • Hard Copy
  • USD $3,600
  • Pages:210
  • Single User License
    (PDF Unprintable)       
  • USD $3,400
  • Code: TY003
  • Enterprise-wide License
    (PDF Printable & Editable)       
  • USD $5,000
  • Hard Copy + Single User License
  • USD $3,800
      

Visual Perception Algorithms Become Crucial

Automotive cameras are divided into perception cameras and video cameras, according to Sunny Optical.

Perception camera, used for active safety (generally for forward and inward view), captures images accurately. Video camera, suitable for passive safety (typically surround view and rear view), stores or sends the captured images to the user. They are totally different in imaging quality and temperature reliability.

For lane detection, signal light detection, road sign recognition, in-vehicle monitoring, etc., any errors in the images taken by perception cameras will issue in software calculation errors and inevitable consequences. In this sense, perception camera is less sensitive to price.

Video cameras, with not so high a demanding on performance, are very sensitive to price; there exists a price war in this market where numerous Chinese companies are fiercely scrambling for meager profits but the vast majority do not make money. As per the pattern of Chinese passenger-car-use surround-view camera OEM market in 2019, the market share of vendors is quite scattered, a sharp contrast to the top 6 players holding a combined over 90% of the front-view monocular camera market.

双目1_副本.png

Forward-view cameras require complex algorithms and chips. A forward-view monocular camera costs nearly RMB1,000, and a forward-view binocular camera over RMB1,000. Rear-view, side-view and in-built cameras has the unit price at RMB200 or so.

Breakthroughs in Binocular Camera

Chinese startups have made dramatic breakthroughs in binocular cameras, especially for commercial vehicle and special vehicle.

Smarter Eye has shipped more than 10,000 binocular cameras, mainly available in Apollo autonomous vehicles, JMC small buses, sanitation vehicles, autonomous boats, tractors, patrol vehicles, etc. Smarter Eye’s binocular cameras are typically rendered for AEBS and detection of height limiters. The bus groups in more than 30 cities have employed such cameras.

Smarter Eye pioneers in applying binocular cameras to detect height limiters. Both conventional height limiters and non-standard height limiters such as small archways and culverts in the countryside can be accurately perceived by binocular cameras that promptly warn drivers by sound and light alarms. Recreational vehicles, special vehicles, etc. have rigid demand for this function.

双目2_副本.png

In 2019, Sphyrna Technology announced it successfully developed a flexible binocular camera system which can use two separate monocular cameras to accomplish a binocular camera system, overcoming inherent defects (large size, complicated process, difficult installation, and high cost) of binocular cameras.

双目3_副本.png

The two cameras are independently fixed on the right side of the car body, needing neither rigid connection in the middle nor strict requirements on angle or spacing. The "flexible binocular cameras" lie in self-calibration technology. Even if the cameras slightly deform and move during use, Sphyrna Technology's algorithms will automatically detect and recalibrate, dispensing with regular recalibration essential to conventional binocular cameras.

In April 2020, Foresight Autonomous Holdings Ltd. announced to collaborate with FLIR Systems Inc. on the development, marketing and distribution of Foresight’s QuadSight? vision system, combined with FLIR Systems’ infrared cameras, to a wide range of prospective customers. Foresight will exclusively purchase its thermal cameras from FLIR for all systems to be commercialized worldwide. Foresight’s unique QuadSight system, comprised of four thermal and visible-light cameras, showcases the capability of FLIR thermal cameras to greatly improve ADAS and autonomous vehicle safety through improved situational awareness at night, in high-contrast scenes and in bad weather. The data fusion between the two stereo channels can effectively avoid the non-reporting or false-reporting under the extreme conditions like the tunnel entrance where light changes quickly.

Millimeter-wave radar is beating other sensors. The same is true of cameras. Many companies like MAXIEYE are attempting to replace binocular cameras or liDAR by using monocular cameras for ranging and 3D imaging.

Unlike the first-generation product -- IFVS-200 series based on machine learning solutions, MAXIEYE’s 3rd-Gen product IFVS-500 family based on deep learning technology achieves monocular ranging and 3D scanning. IFVS-500 not only allows monocular vision products to perform 3D scanning like lidar, but also resembles lidar by scanning the 3D point cloud within 50 meters, enabling direct ranging of the object and detection of both motor vehicles within 200 meters and pedestrians & small obstacles within 100 meters.

Visual Capabilities under Extreme Scenarios Heighten

Whatever vision inside or outside the car in poor lighting and even the dark requires infrared technology. ON Semiconductor's RGB-IR image sensor features near infrared (NIR) enhanced images. Israeli start-up TriEye has developed a sensor technology for short-wave infrared (SWIR) which enhances safety in vehicles fitted with assistance systems or autonomous driving functions by improving the ability to see in weather conditions where visibility is poor, such as dust, fog, murky conditions or rain, and to stay alert to the danger (like icy road) in advance.

双目4_副本.png

In April 2020, Alibaba DAMO Academy revealed that it has developed an ISP processor for in-vehicle cameras. Through the use of it, the car camera has a significant improvement in image object detection and recognition capabilities by more than 10% compared to the mainstream processor in the night, the most challenging scene, and the original obscure labeling can be clearly identified, according to the drive test results of the DAMO Academy Automated Driving Laboratory.

On May 19, 2020, OmniVision announced the expansion of its Nyxel near-infrared (NIR) technology into the automotive market with the new 2.5-megapixel OX03A2S image sensor. This ASIL-B sensor is intended for exterior imaging applications that operate in low to no ambient light conditions within 2 meters of the vehicle. It can detect and recognize objects that other image sensors would reportedly miss under extremely low lighting conditions.

双目5_副本.png
 


Visual Perception Algorithms Become Crucial

The massive data incurred by the dramatic increment of vision sensors in smart cars as well as the addition of vision sensors has brought challenges and opportunities to algorithm processing.

For the visual perception system, Mobileye, a leader of visual ADAS algorithms, gets a multitude of independent perception algorithms used simultaneously to create internal redundancy layers for both detection and measurements with higher perception accuracy and stability. Detection is to determine what object is perceived, and measurements are to infer the 3D information of the perceived object via the 2D image of the camera.

For detection, Mobileye uses 6 independent engines:

  • 3DVD or 3D Object Detection: It is the common approach of predicting a 3D bounding box using a neural network from the 2D image.
  • Full Image Detection: It deals with the common scenario where an object (such as buses cars or trucks) is extremely close and can only be partially seen. Object classification using visual signatures is used to track close up vehicles in this scenario.
  • Top View FS: It focuses on identifying and marking the unoccupied roads in the screen.
  • Features Detection: This appearance-based engine detects vehicles from reliable features, such as wheels.
  • VIDAR: It is an approach that uses multiple views of the environment to triangulate and create a depth map. That depth map is converted into a point cloud and LiDAR based processing algorithms are used on that point cloud.
  • Scene Segmentation (NSS): It is a neural network-based approach to break the scene down into free space and semantic objects (vehicle, sign, pedestrian, etc.), the pixels containing an object are treated as a detection.

双目6_副本.png

Also as a leader in visual perception algorithms, Tesla names its deep learning network as HydraNet which involves 48 different neural networks that output 1,000 distinct tensors (predictions) at each timestep; in theory, HydraNet can detect 1,000 objects simultaneously. Tesla acquired DeepScale, a Silicon Valley startup that focuses on developing computer vision technologies, in a bid to improve its algorithmic capabilities.

To catch up with Tesla and Mobileye in visual perception algorithms, OEMs and Tier1 suppliers are expanding their teams of software engineers. The algorithmic capabilities will be one of the decisive factors to the performance of visual perception.

5 Chinese Automotive Vision Companies

5.1 Smarter Eye
5.1.1 Profile
5.1.2 Products
5.1.3 Development
5.1.4 Comparison between Likewise Products
5.1.5 Production
5.1.6 Application of Binocular Stereo Vision Products
5.2 Sphyrna Technology
5.2.1 Profile
5.2.2 Products
5.2.3 Flexible Binocular System
5.2.4 Large Truck ADAS
5.3 Slightech Intelligent Technology
5.3.1 Profile
5.3.1 Core Technologies
5.3.2 Binocular Camera Depth Sereis
5.3.3 Binocular ADAS Solutions
5.3.4 Autonomous Delivery Solutions
5.4 METOAK
5.4.1 Profile
5.4.2 Solutions
5.4.3 Product Application
5.5 SinoChipAi
5.5.1 Profile
5.5.2 Vision Products
5.5.3 Binocular ADAS
5.5.4 Partners
5.6 Hisense TransTech
5.6.1 Profile
5.6.2 Solutions
5.6.3 Binocular ADAS
5.7 Zhejiang Dahua Technology
5.7.1 Profile
5.7.2 Products
5.7.3 DAHUA Binocular Application
5.7.4 DAHUA Binocular News
5.8 Foresight 
5.8.1 Profile
5.8.2 Quad-ocular Vision System
5.8.3 Binocular Vision System Eyes-On
5.8.4 Foresight Eye-Net
5.8.5 Dynamics
5.9 RICOH
5.9.1 Profile
5.9.2 Development Strategy
5.9.3 Binocular Module
5.9.4 Other Applications of Binocular Products
5.10 Other Tier 1 Suppliers’ Binocular Products
5.10.1 Continental
5.10.2 Bosch Binocular Camera
5.10.3 Denso Stereo Vision Sensor
5.10.4 ZF Binocular Camera
5.11 Summary of Binocular Product and Technologies
5.11.1 Trends of Binocular Stereo Vision Technology
5.11.2 Binocular Chip

6 Other Automotive Vision Companies

6.1 Surround-view Market Overview
6.1.1 Number of Surround-view Cameras Installed in New Cars in China, 2018-2019
6.1.2 Number of Surround-view Cameras Installed in New Cars in China by Month, 2018-2019
6.1.3 Proportion of Surround-view Cameras Installed in New Cars and Top 20 Brands in China, 2019
6.1.4 Top 20 Brands by Installation Rate of Surround-view Cameras in New Cars in China, 2019
6.1.5 Top 10 Brands by Surround-view Camera Installed in New Cars and Installation Rate (by Price) in China, 2019
6.2 TungThih Electronic
6.2.1 Profile
6.2.2 Global Presence and Product Layout
6.2.3 Cameras
6.2.4 Major Products and Clients
6.3 HSAE
6.3.1 Profile
6.3.2 Product System
6.3.3 Collaborations
6.3.4 Suppliers
6.3.5 Clients
6.4 Hikvision
6.4.1 Profile
6.4.2 Revenue
6.4.3 Automotive Electronics
6.4.4 Vision Products
6.5 Softec
6.5.1 Profile
6.5.2 Automotive Surround-view System
6.5.3 Main Cameras
6.6 oToBrite
6.6.1 Profile
6.6.2 ADAS Products
6.6.3 Core Technologies
6.6.4 Cameras
6.6.5 Automated Parking System
6.6.6 Clients and Partners
6.7 MINTH Group
6.7.1 Profile
6.7.2 Revenue
6.7.3 R&D and Design Capabilities
6.7.4 History of Camera Business
6.7.5 Surround-view Products
6.7.6 Application of ADAS Products
6.8 LG 
6.8.1 Profile
6.8.2 Automotive Electronics
6.8.3 Cameras
6.8.4 ADAS Products
6.9 Panasonic
6.9.1 Profile
6.9.2 Automotive Business Revenue
6.9.3 Automotive Electronics Families
6.9.4 Automotive Vision Products
6.10 Valeo
6.10.1 Profile
6.10.2 Revenue in 2019
6.10.3 Automotive Vision and ADAS System
6.10.4 Vision Products
6.10.5 Partners in Vision Products
6.11 Others

7 Suppliers of Key Components for Automotive Camera

7.1 ON Semiconductor
7.1.1 Profile
7.1.2 Operation and Automotive Business Layout in 2019
7.1.3 Automotive Ecosystem
7.1.4 CMOS Market Position
7.1.5 ADAS Image Sensors
7.1.6 Automotive Camera System Architecture and CMOS Product System
7.1.7 Automotive CMOS Products
7.1.8 Mergers and Acquisitions in Recent Years
7.2 Sony
7.2.1 Profile
7.2.2 Operation in 2019
7.2.3 Technical Superiority in CMOS Field
7.2.4 Cameral Module Product System
7.2.6 Development Course of Automotive CMOS
7.2.7 Automotive CMOS Pedigrees
7.2.8 Automotive CMOS Products
7.2.9 Latest Vision CMOS Products
7.3 OmniVision
7.3.1 Profile
7.3.2 Image Sensors
7.3.3 Automotive Image Sensors
7.3.4 Dynamics
7.4 PixArt Imaging Inc.
7.4.1 Profile
7.4.2 CIS and Chip Products and Planned Products
7.4.3 PixArt Product
7.4.4 Automotive Vision Application System
7.4.5 Gesture Control IC for Automotive Use
7.5 Sunny Optical
7.5.1 Profile
7.5.2 Revenue in 2019
7.5.3 Business Layout
7.5.4 Development Course of Automotive Cameras 
7.5.5 Automotive Camera Sales and Shipments
7.5.6 Latest Developments and Layout
7.6 Lianchuang Electronic Technology
7.6.1 Profile
7.6.2 Development Course and Equity Structure
7.6.3 Revenue and R&D Expenditure
7.6.4 Automotive Lenses
7.6.5 Application in Automotive Camera Field
7.6.6 Major Clients

8 Development Tendencies of Automotive Vision Industry

8.1 ToF Use in Vehicle
8.1.1 What Is the 3D Perception Technology?
8.1.2 3D Perception: Stereo Vision and Structured Light
8.1.3 3D Perception: ToF
8.1.4 Huge Potentiality of ToF
8.1.5 Comparison between Main ToF Image Sensors
8.1.6 Infineon’s and Panasonic’s ToF
8.1.7 ADI ToF
8.1.8 Panasonic’s All-new ToF Image Sensor
8.2 AI Use in Automotive Vision
8.3 Other Automotive Vision Trends
 

Automotive DMS (Driver Monitoring System) Research Report, 2019-2020

Automotive DMS Research: DMS installations shoot up, with a year-on-year upsurge of 360% in Q1 2020 DMS (Driver Monitoring System) is bifurcated into active DMS and passive DMS. Passive DMS judges th...

Automotive Infrared Night Vision System Research Report, 2019-2020

Automotive Infrared Night Vision Research: Infrared Thermal Imaging May Handle Extreme Cases Well Infrared radiation consists of electromagnetic waves in the wavelength region from 0.75 μm to 1,000 μ...

Global and China Automotive Gateway Industry Report, 2019-2020

Automotive Gateway Industry Research: Tenfold Improvement in Gateway Performance Breaks the Bottleneck of Software-defined Vehicles. Automotive gateway chip is actually a field with scarcely ever cha...

Automotive Vision Industry Chain Report (II) Binocular and Others

Visual Perception Algorithms Become Crucial Automotive cameras are divided into perception cameras and video cameras, according to Sunny Optical. Perception camera, used for active safety (generally...

Global and China Tire Pressure Monitoring System (TPMS) Industry Report, 2020-2026

TPMS OEM prevails across the world, with its market size reaching 59.2 million units and the installation rate at 64.5% (an increase of 4.9 points from a year ago) in 2019 as TMPS needs to be installe...

Automotive High-precision Positioning Research Report, 2019-2020

High-precision Positioning Research: Competition from Chips, Terminals to Ground-based Augmentation Stations Autonomous driving prompts the use of high-precision positioning technology in the realm o...

Shared Mobility Industry Research--Autonomous Driving Leads Shared Mobility 3.0

The global shared mobility industry is experiencing a hard time. It is since 2019 that shared mobility enterprises have been exposed to financial fragility and have closed down one after another amid ...

Automotive Vision Industry Chain Report 2019-2020 (I): Monocular Vision

Automotive Vision Industry Chain Report 2019-2020 (I): The front-view monocular camera market soared 95.6% year-on-year in 2019 About 23 million cameras were pre-installed in new passenger cars in Ch...

China Automotive Financial Leasing Industry Report, 2020-2026

After ceaseless decline in 2018 and 2019, the Chinese automobile industry ushers in a period of recovery when the consumers are more prudent to buy cars and automobile consumer finance draws more atte...

Autonomous Driving Simulation Industry Chain Report, 2019-2020 (II)

Autonomous Driving Simulation (II): It Turns Out to Be a Battlefield of GiantsAlibaba DAMO Academy unveiled in early 2019 the "Top Ten Technology Trends of 2019", most of which are still credible toda...

Automotive Radar Dismantling and Cost Analysis, 2019-2020

It is in this report that over a dozen of millimeter-wave radar types are studied on design, supply chain and cost, including Continental’s ARS4A, ARS4B, ARS408 and ARS410, Bosch’s LRR4, FR5CP, MRR1PL...

Global and China L4 Autonomous Driving Industry Report, 2019-2020

Giants gain high finance.Progress of L4 autonomous driving is greatly hampered over the recent two years, causing OEMs’ and Tier 1 suppliers’ delay in L4 launches. Yet, the top L4 companies still rais...

Automotive Domain Control Unit (DCU) Industry Report, 2019-2020

Domain control unit shipments will boom in 2021. When the one-to-one correspondence between the growing number of sensors and electronic control units (ECU) leads to underperforming vehicles and adds...

Global and China Automotive Millimeter-wave (MMW) Radar Industry Report, 2019-2020

Millimeter wave radar installations soared by 44.37% year-on-year in 2019 and were available in more scenarios, encroaching on Lidar and ultrasonic. Automotive radar wins popularity and gets increasi...

ADAS and Autonomous Driving Tier 1 Suppliers Report, 2019-2020

Tier 1 suppliers for autonomous driving: Chinese Tier 1 suppliers have not embarked on the actuation layer, and L3 will spread after 2022 Amid the controversy in L3, some media believe that Audi will...

Global and China Automotive Operating System (OS) Industry Report, 2019-2020

With advances in smart cockpit and intelligent driving, and enormous strides of Tesla, OEMs care more about automotive operating system (OS). Yet, it is by no means easy for both new carmakers and tra...

Global and China Low Speed Autonomous Driving Industry Report, 2019-2020

In 2019, low speed autonomous driving market tended to calm down, with more regular pilots but on small scale. In 2020, the COVID-19 pandemic brings new opportunities to low speed autonomous delivery ...

Special Vehicle Autonomous Driving Industry Report, 2019-2020

Autonomous mining vehicle and autonomous sanitation vehicle markets take off. This report highlights progress of autonomous working vehicles in four fields: sanitation, airport, agriculture and minin...

2005- www.researchinchina.com All Rights Reserved 京ICP备05069564号-1 京公网安备1101054484号