fbpx
Computer vision and visual AI developers, help guide technology suppliers by taking this 10-minute survey and get $50 off a 2022 Embedded Vision Summit pass and entry in a drawing to win 1 of 50 $25 Amazon gift cards.Learn More & Take The Survey

Processors for Embedded Vision

THIS TECHNOLOGY CATEGORY INCLUDES ANY DEVICE THAT EXECUTES VISION ALGORITHMS OR VISION SYSTEM CONTROL SOFTWARE

This technology category includes any device that executes vision algorithms or vision system control software. The following diagram shows a typical computer vision pipeline; processors are often optimized for the compute-intensive portions of the software workload.

ev pipeline

The following examples represent distinctly different types of processor architectures for embedded vision, and each has advantages and trade-offs that depend on the workload. For this reason, many devices combine multiple processor types into a heterogeneous computing environment, often integrated into a single semiconductor component. In addition, a processor can be accelerated by dedicated hardware that improves performance on computer vision algorithms.

General-purpose CPUs

While computer vision algorithms can run on most general-purpose CPUs, desktop processors may not meet the design constraints of some systems. However, x86 processors and system boards can leverage the PC infrastructure for low-cost hardware and broadly-supported software development tools. Several Alliance Member companies also offer devices that integrate a RISC CPU core. A general-purpose CPU is best suited for heuristics, complex decision-making, network access, user interface, storage management, and overall control. A general purpose CPU may be paired with a vision-specialized device for better performance on pixel-level processing.

Graphics Processing Units

High-performance GPUs deliver massive amounts of parallel computing potential, and graphics processors can be used to accelerate the portions of the computer vision pipeline that perform parallel processing on pixel data. While General Purpose GPUs (GPGPUs) have primarily been used for high-performance computing (HPC), even mobile graphics processors and integrated graphics cores are gaining GPGPU capability—meeting the power constraints for a wider range of vision applications. In designs that require 3D processing in addition to embedded vision, a GPU will already be part of the system and can be used to assist a general-purpose CPU with many computer vision algorithms. Many examples exist of x86-based embedded systems with discrete GPGPUs.

Digital Signal Processors

DSPs are very efficient for processing streaming data, since the bus and memory architecture are optimized to process high-speed data as it traverses the system. This architecture makes DSPs an excellent solution for processing image pixel data as it streams from a sensor source. Many DSPs for vision have been enhanced with coprocessors that are optimized for processing video inputs and accelerating computer vision algorithms. The specialized nature of DSPs makes these devices inefficient for processing general-purpose software workloads, so DSPs are usually paired with a RISC processor to create a heterogeneous computing environment that offers the best of both worlds.

Field Programmable Gate Arrays (FPGAs)

Instead of incurring the high cost and long lead-times for a custom ASIC to accelerate computer vision systems, designers can implement an FPGA to offer a reprogrammable solution for hardware acceleration. With millions of programmable gates, hundreds of I/O pins, and compute performance in the trillions of multiply-accumulates/sec (tera-MACs), high-end FPGAs offer the potential for highest performance in a vision system. Unlike a CPU, which has to time-slice or multi-thread tasks as they compete for compute resources, an FPGA has the advantage of being able to simultaneously accelerate multiple portions of a computer vision pipeline. Since the parallel nature of FPGAs offers so much advantage for accelerating computer vision, many of the algorithms are available as optimized libraries from semiconductor vendors. These computer vision libraries also include preconfigured interface blocks for connecting to other vision devices, such as IP cameras.

Vision-Specific Processors and Cores

Application-specific standard products (ASSPs) are specialized, highly integrated chips tailored for specific applications or application sets. ASSPs may incorporate a CPU, or use a separate CPU chip. By virtue of their specialization, ASSPs for vision processing typically deliver superior cost- and energy-efficiency compared with other types of processing solutions. Among other techniques, ASSPs deliver this efficiency through the use of specialized coprocessors and accelerators. And, because ASSPs are by definition focused on a specific application, they are usually provided with extensive associated software. This same specialization, however, means that an ASSP designed for vision is typically not suitable for other applications. ASSPs’ unique architectures can also make programming them more difficult than with other kinds of processors; some ASSPs are not user-programmable.

Algolux Demonstration of Automatic Optimization of Camera Image Signal Processors for Computer Vision Using the Atlas Camera Optimization Suite

Marc Courtemanche, Product Architect at Algolux, demonstrates the company’s latest edge AI and vision technologies and products at the 2021 Embedded Vision Summit. Specifically, Courtemanche demonstrates how to automatically optimize camera image signal processors (ISPs) for computer vision (CV) using the Atlas camera optimization suite. The Atlas cloud-enabled workflow can automatically optimize ISPs to maximize

Read More »

Algolux Demonstration of Highly Robust Computer Vision for All Conditions with the Eos Embedded Perception Software

Dave Tokic, Vice President of Marketing and Strategic Partnerships at Algolux, demonstrates the company’s latest edge AI and vision technologies and products at the 2021 Embedded Vision Summit. Specifically, Tokic demonstrates highly robust computer vision for all conditions with the Eos embedded perception software. The Eos end-to-end vision architecture enables co-design of imaging and detection

Read More »

Xilinx Demonstration of Defect Detection Running As an Accelerated Application on the Kria KV260

Girish Malipeddi, Director of Video and Imaging Solutions at Xilinx, demonstrates the company’s latest edge AI and vision technologies and products at the 2021 Embedded Vision Summit. Specifically, Malipeddi demonstrates defect detection running as an accelerated application on the Kria KV260. This demo shows the Kria K26 SOM running both vision machine learning (ML) and

Read More »

Xilinx Demonstration of an X-ray Classification Solution for COVID-19 and Pneumonia Detection

Quenton Hall, AI Architect at Xilinx, demonstrates the company’s latest edge AI and vision technologies and products at the 2021 Embedded Vision Summit. Specifically, Hall demonstrates an x-ray classification solution for COVID-19 and pneumonia detection. Spline.AI is collaborating with Amazon Web Services and Xilinx to deliver an open-source, open-model, x-ray classification solution for COVID-19 and

Read More »

Synopsys Demonstration of SRGAN Super Resolution on DesignWare ARC EV7x Processors

Liliya Tazieva, Software Engineer at Synopsys, demonstrates the company’s latest edge AI and vision technologies and products at the 2021 Embedded Vision Summit. Specifically, Tazieva demonstrates SRGAN super resolution on Synopsys’ DesignWare ARC EV7x processors. Image super resolution techniques reconstruct a higher-resolution image from a lower-resolution one. Although this can be done with classical vision

Read More »

Synopsys Demonstration of SLAM Acceleration on DesignWare ARC EV7x Processors

Liliya Tazieva, Software Engineer at Synopsys, demonstrates the company’s latest edge AI and vision technologies and products at the 2021 Embedded Vision Summit. Specifically, Tazieva demonstrates simultaneous localization and mapping (SLAM) acceleration on Synopsys’ DesignWare ARC EV7x processors. SLAM creates and updates a map of an unknown environment while at the same time keeping track

Read More »

Synaptics Demonstration of the Progression from Neural Network to Edge with Synaptics’ Katana Processor and Eta Compute’s TENSAI Flow Tool

Vineet Ganju, Vice President and General Manager of the Low Power AI Business Unit at Synaptics, demonstrates the company’s latest edge AI and vision technologies and products at the 2021 Embedded Vision Summit. Specifically, Ganju demonstrates how to progress a design from neural network to edge with Synaptics’ Katana processor in partnership with Eta Compute.

Read More »

Ultra-premium Flagship Smartphone Cameras: Is Bigger Really Better?

This market research report was originally published at Yole Développement’s website. It is reprinted here with the permission of Yole Développement. Yole Développement (Yole), DXOMARK, and System Plus Consulting combine their expertise to analyze the performance of the latest ultra-premium flagship smartphones in a new dedicated report. OUTLINE: Hardware & chipset Great photos and videos:

Read More »

Microchip Adds Second Development Tool Offering for Designers Using Its Low-Power PolarFire RISC-V SoC FPGA for Embedded Vision Applications at the Edge

Platform extends customer options for designing secure and reliable systems in applications ranging from neural network inferencing to Industrial Internet of Things (IIoT) and factory automation CHANDLER, Ariz., Nov. 23, 2021 – Microchip Technology (Nasdaq: MCHP) today announced the second development tool offering in its Smart Embedded Vision initiative for designers using its PolarFire® RISC-V

Read More »

Photonics West: New Components for Embedded Vision

November 23, 2021 – At the Photonics West exhibition, Vision Components will present new products for even more intelligence on the edge, additional applications and longer transmission paths. The FPGA-based hardware accelerator VC Power SoM was developed for complex image preprocessing. Results are directly transferred to a processor board. Multiple MIPI-CSI-2 inputs and outputs mean

Read More »

CEVA SensPro™ Sensor Hub DSP Achieves Automotive Safety Compliant Certification for ASIL B (Random) and ASIL D (Systematic)

Functional safety-certified DSP and comprehensive software development kit is ideal for the development of low power automotive sensor fusion SoCs to process and fuse data from cameras, radar, lidar and more for autonomous driving and advanced driver assistance systems (ADAS) applications Rockville, MD, November 23, 2021 – CEVA, Inc. (NASDAQ: CEVA), the leading licensor of wireless

Read More »

Synaptics Demonstration of Real-time Video Post-processing Using Machine Learning

Zafer Diab, Director of Product Marketing at Synaptics, demonstrates the company’s latest edge AI and vision technologies and products at the 2021 Embedded Vision Summit. Specifically, Diab demonstrates real-time video post-processing using machine learning. Enhancements in AI processing capabilities on edge devices are enabling significant enhancements in video scaling and post-processing, compared to what had

Read More »

Bigger is not Always Better: Exploiting Parallelism in Neural Network Hardware

This blog post was originally published at AImotive’s website. It is reprinted here with the permission of AImotive. When considering hardware platforms for executing high performance NNs (Neural Networks), automotive system designers frequently determine the total compute power by simply adding up each NN’s requirements. However, the approach usually leads to demands for a single

Read More »

D3 Engineering Demonstration of a Synchronized 2D/3D Time-of-Flight Multi-camera Application on NVIDIA’s Jetson AGX Xavier

Jason Enslin, Product Manager for NVIDIA Jetson and Cameras at NVIDIA partner D3 Engineering, demonstrates the company’s latest edge AI and vision technologies and products at the 2021 Embedded Vision Summit. Specifically, Enslin demonstrates a synchronized 2D and 3D time-of-flight multi-camera application on NVIDIA’s Jetson AGX Xavier. With the growing need for video, distance measurement

Read More »

Connect Tech Demonstration of Integrating Vision Sensors with NVIDIA’s Jetson Edge Applications

Patrick Dietrich, Chief Technology Officer of NVIDIA partner Connect Tech, demonstrates the company’s latest edge AI and vision technologies and products at the 2021 Embedded Vision Summit. Specifically, Dietrich demonstrates how to integrating vision sensors with NVIDIA’s Jetson edge applications. Since the inception of NVIDIA’s Jetson platform, the capabilities of edge AI and vision-enabled systems

Read More »

AAEON Demonstration of Its Compact Fanless Embedded BOX PC Based on NVIDIA’s Jetson Xavier NX SoC

Iris Huang, Product Sales Manager, and Owen Wei, AI & IOT Product Solution Manager, both of NVIDIA partner AAEON, demonstrate the company’s latest edge AI and vision technologies and products at the 2021 Embedded Vision Summit. Specifically, Huang and Wei demonstrate AAEON’s BOXER-8251AI AI@Edge compact fan-less embedded BOX PC, based on NVIDIA’s Jetson Xavier NX

Read More »

Nextchip Demonstration of Enabling Smart Automotive Camera ADAS

James Kim, Director of Technical Marketing at Nextchip, demonstrates the company’s latest edge AI and vision technologies and products at the 2021 Embedded Vision Summit. Specifically, Kim demonstrates Nextchip’s SoCs for enabling smart automotive camera ADAS. In this demonstration, Nextchip presents its image processors for the edge, APACHE4 and 5, which are ADAS SoCs empowering

Read More »

Nextchip Demonstration of Its Imaging Signal Processor’s Supported Functions

Jessie Lee, General Manager of Technical Marketing at Nextchip, demonstrates the company’s latest edge AI and vision technologies and products at the 2021 Embedded Vision Summit. Specifically, Lee demonstrates the functions supported by its imaging signal processor (ISP). In this demonstration, Nextchip showcases its ISP expertise by demonstrating various ISP features for automotive applications. Nextchip’s

Read More »

Here you’ll find a wealth of practical technical insights and expert advice to help you bring AI and visual intelligence into your products without flying blind.

Contact

Address

1646 North California Blvd.,
Suite 360
Walnut Creek, CA 94596 USA

Phone
Phone: +1 (925) 954-1411
Scroll to Top