“Processing Raw Images Efficiently on the MAX78000 Neural Network Accelerator,” a Presentation from Analog Devices

Gorkem Ulkar, Principal ML Engineer at Analog Devices, presents the “Processing Raw Images Efficiently on the MAX78000 Neural Network Accelerator” tutorial at the May 2023 Embedded Vision Summit.

In this talk, Ulkar presents alternative and more efficient methods of processing raw camera images using neural network accelerators. He begins by introducing Analog Devices’ convolutional neural network accelerator, MAX78000, and showing how it achieves superior performance and energy efficiency on a range of neural network inference tasks.

In visual AI applications, cameras provide raw images not in the familiar RGB format, but in a Bayer format. In order to process these images using a neural network that was trained on RGB data, the camera images must be “de-Bayerized” to turn them into RGB images. The conventional way of performing this step is via interpolation. Unfortunately, this increases energy consumption and latency of the application since it cannot be performed by neural network accelerators. Ulkar presents alternative methods of performing this task using neural network accelerators and demonstrates the effectiveness of these techniques.

See here for a PDF of the slides.

Here you’ll find a wealth of practical technical insights and expert advice to help you bring AI and visual intelligence into your products without flying blind.

Contact

Address

Berkeley Design Technology, Inc.
PO Box #4446
Walnut Creek, CA 94596

Phone
Phone: +1 (925) 954-1411
Scroll to Top