Integrated open image signal processor adds to R-Car SoC applications
An integrated open image signal processor (ISP) from Renesas Electronics can be integrated on the company’s R-Car V3M and R-Car V3H SoCs to speed the development of automotive smart camera applications.
According to Renesas, integrating the ISP on the R-Car V3x SoCs and leveraging MM Solutions’ Automotive Camera Development Kit (AutoCDK), enables automotive Tier 1s to simplify the sensor calibration and tuning process for camera applications, including front camera and surround view to reduce the time to market.
The open ISP solution supports a range of development needs, from low-level-programming ISP capabilities via the open interface to the AutoCDK for users to jumpstart development using the MM Solutions’ tools.
Autonomous vehicles will be required to sense their environments, with smart cameras in front and surround view systems used to detect traffic signs, lanes, pedestrians, vehicles, and other obstacles in real time.
High performance computer vision requires highly reliable, highly configurable ISPs that support high dynamic ranges in challenging driving situations as well as low-noise performance and imagery perception close to that of a human eye’s level – or beyond, explains Renesas. Drivers will want to see a realistic visual representation of the surrounding of the car, where the ISP plays an important role for image adjustment.
In collaboration with MM Solutions, Renesas has developed an open ISP solution that helps users tune and control their sensors to support both human vision and machine vision. Integrating the ISP vision processing software onto the R-Car V3x SoCs provides a camera-neutral approach, offering camera manufacturers and Tier 1s the flexibility to work with ECUs and sensors of choice.
Jean-Francois Chouteau, vice president of the Automotive Solution Business Unit, Renesas Electronics, said: “Developing the software solution as part of the Renesas autonomy platform allows customers to take advantage of robust off-the-shelf middleware as well as privileged access to the image quality expertise of our partner MM Solutions.”
“Turnkey ISP solutions that support multiple platforms are essential to achieving excellent camera quality while meeting increasingly shorter time-to-market challenges for front camera, surround view, and other automotive camera applications,” added Ivan Poibrenski, managing director of MM Solutions.
“Achieving high dynamic range and LED flicker mitigation simultaneously is the key challenge for ADAS camera systems,” said Tsutomu Haruta, deputy senior general manager, Sony Semiconductor Solutions. “The combination of Renesas’ ISP solution and Sony’s image sensors enables our automotive customers to . . . realise a superior image quality.”
Mass production of the Renesas R-Car V3M and R-Car V3H SoCs is scheduled to begin Q2 2019 and Q3 2019, respectively. The AutoCDK from MM Solutions will be available in November 2018.
Renesas will demonstrate the Open ISP using the Renesas R-Car V3M, MM Solutions’ AutoCDK, and Sony’s IMX390 image sensor in booth 6 at AutoSens 2018, September 17-20, 2018, Brussels, Belgium.