Processors for Embedded Vision


This technology category includes any device that executes vision algorithms or vision system control software. The following diagram shows a typical computer vision pipeline; processors are often optimized for the compute-intensive portions of the software workload.

ev pipeline

The following examples represent distinctly different types of processor architectures for embedded vision, and each has advantages and trade-offs that depend on the workload. For this reason, many devices combine multiple processor types into a heterogeneous computing environment, often integrated into a single semiconductor component. In addition, a processor can be accelerated by dedicated hardware that improves performance on computer vision algorithms.

General-purpose CPUs

While computer vision algorithms can run on most general-purpose CPUs, desktop processors may not meet the design constraints of some systems. However, x86 processors and system boards can leverage the PC infrastructure for low-cost hardware and broadly-supported software development tools. Several Alliance Member companies also offer devices that integrate a RISC CPU core. A general-purpose CPU is best suited for heuristics, complex decision-making, network access, user interface, storage management, and overall control. A general purpose CPU may be paired with a vision-specialized device for better performance on pixel-level processing.

Graphics Processing Units

High-performance GPUs deliver massive amounts of parallel computing potential, and graphics processors can be used to accelerate the portions of the computer vision pipeline that perform parallel processing on pixel data. While General Purpose GPUs (GPGPUs) have primarily been used for high-performance computing (HPC), even mobile graphics processors and integrated graphics cores are gaining GPGPU capability—meeting the power constraints for a wider range of vision applications. In designs that require 3D processing in addition to embedded vision, a GPU will already be part of the system and can be used to assist a general-purpose CPU with many computer vision algorithms. Many examples exist of x86-based embedded systems with discrete GPGPUs.

Digital Signal Processors

DSPs are very efficient for processing streaming data, since the bus and memory architecture are optimized to process high-speed data as it traverses the system. This architecture makes DSPs an excellent solution for processing image pixel data as it streams from a sensor source. Many DSPs for vision have been enhanced with coprocessors that are optimized for processing video inputs and accelerating computer vision algorithms. The specialized nature of DSPs makes these devices inefficient for processing general-purpose software workloads, so DSPs are usually paired with a RISC processor to create a heterogeneous computing environment that offers the best of both worlds.

Field Programmable Gate Arrays (FPGAs)

Instead of incurring the high cost and long lead-times for a custom ASIC to accelerate computer vision systems, designers can implement an FPGA to offer a reprogrammable solution for hardware acceleration. With millions of programmable gates, hundreds of I/O pins, and compute performance in the trillions of multiply-accumulates/sec (tera-MACs), high-end FPGAs offer the potential for highest performance in a vision system. Unlike a CPU, which has to time-slice or multi-thread tasks as they compete for compute resources, an FPGA has the advantage of being able to simultaneously accelerate multiple portions of a computer vision pipeline. Since the parallel nature of FPGAs offers so much advantage for accelerating computer vision, many of the algorithms are available as optimized libraries from semiconductor vendors. These computer vision libraries also include preconfigured interface blocks for connecting to other vision devices, such as IP cameras.

Vision-Specific Processors and Cores

Application-specific standard products (ASSPs) are specialized, highly integrated chips tailored for specific applications or application sets. ASSPs may incorporate a CPU, or use a separate CPU chip. By virtue of their specialization, ASSPs for vision processing typically deliver superior cost- and energy-efficiency compared with other types of processing solutions. Among other techniques, ASSPs deliver this efficiency through the use of specialized coprocessors and accelerators. And, because ASSPs are by definition focused on a specific application, they are usually provided with extensive associated software. This same specialization, however, means that an ASSP designed for vision is typically not suitable for other applications. ASSPs’ unique architectures can also make programming them more difficult than with other kinds of processors; some ASSPs are not user-programmable.

MegaChips Forms Strategic Partnership with BrainChip

Partnership Provides Ultra-Low Power and High-Performance Edge AI Solutions for ASIC Customers San Jose and Laguna Hills, Calif. – May 26, 2022 – MegaChips, the leading custom ASIC company in Japan, and BrainChip Holdings Ltd, the world’s first commercial producer of ultra-low power neuromorphic AI IP, formally announced a strategic partnership signed late last year.

Read More »

MediaTek Launches First mmWave Chipset for Seamless 5G Smartphone Connectivity

Dimensity 1050 mmWave SoC highlights trio of new chipsets expanding MediaTek’s 5G and gaming portfolio HSINCHU, Taiwan – May 23, 2022 – MediaTek today announced the Dimensity 1050 system-on-chip [SoC], its first mmWave 5G chipset that will power the next generation of 5G smartphones with seamless connectivity, displays, gaming and power efficiency. Through dual connectivity

Read More »

BrainChip Joins Arm AI Partner Program

Laguna Hills, Calif. – May 22, 2022 – – BrainChip Holdings Ltd (ASX: BRN, OTCQX: BRCHF, ADR: BCHPY), the world’s first commercial producer of ultra-low power neuromorphic AI IP, announced today it has been accepted into the Arm® AI Partner Program, an ecosystem of hardware and software specialists enabling developers to deliver the next generation

Read More »

May 2022 Embedded Vision Summit Slides

The Embedded Vision Summit was held on May 16-19, 2022 in Santa Clara, California, as an educational forum for product creators interested in incorporating visual intelligence into electronic systems and software. The presentations delivered at the Summit are listed below. All of the slides from these presentations are included in… May 2022 Embedded Vision Summit

Read More »

Imagination and Visidon Partner for Deep-learning-based Super Resolution Technology

IMG Series4 NNA enables advanced AI-based software to efficiently upscale images and videos London, England – 17th May, 2022 – Imagination Technologies and Visidon Oy partner to power the transition to deep-learning-based super resolution for embedded applications across mobile, DTV and automotive markets. This AI-based technology allows users to upscale low-resolution images and videos up

Read More »

Qualcomm Extends Leadership in Premium and High Tier Android Devices with Snapdragon’s Newest Powerhouse Mobile Platforms

Snapdragon 8+ Gen 1 and Snapdragon 7 Gen 1 Mobile Platforms Deliver Cutting-Edge Mobile Experiences in Premium and High-Tiers Smartphones Highlights: The Company’s newest premium-tier platform—Snapdragon 8+ Gen 1—is a true powerhouse delivering power and performance enhancements forthe ultimate boost across all on-device experiences. Offering a selection of high-end, in-demand features and technologies, Snapdragon 7

Read More »

Intel® oneAPI 2022.2 is Available

I am pleased to announce the latest Intel® oneAPI tools release (2022.2).  This updates oneAPI 2022, which I described previously. The oneAPI initiative, and its open specification, are focused on enabling an open, multiarchitecture world with strong support for software developers—a world of open choice without sacrificing performance or functionality. These oneAPI tools are based on

Read More »

AMD Robotics Starter Kit Kick-Starts the Intelligent Factory of the Future

Kria KR260 Starter Kit enables rapid development of hardware-accelerated applications for robotics and industrial automation Delivers nearly 5X productivity gain, up to 8X better performance/watt and 3.5X lower latency compared to competitive GPU-based solutions SANTA CLARA, Calif. – 05/17/2022 – Today AMD (NASDAQ: AMD) announced the Kria™ KR260 Robotics Starter Kit, the latest addition to the

Read More »

Quadric and MegaChips Form Partnership to Bring IP Products to ASIC and SoC Market

Collaboration Will Leverage High-Performance Quadric GPNPU Architecture to Deliver On-Device AI Solutions BURLINGAME, Calif., and OSAKA, Japan, May 17, 2022 – Quadric, an innovator in high-performance edge processing platforms for on-device AI, and MegaChips, a leading ASIC and SoC services company based in Japan, today announced a strategic partnership to deliver ASIC and SoC solutions

Read More »

Axelera AI Announces Successful Testing of Thetis Core Chip

Delivering 40 tera operations per second, the chip is fully optimised for AI edge applications Eindhoven, Netherlands – May 17, 2022 – Artificial intelligence (AI) startup Axelera AI announced it has successfully tested and validated its first chip, the Thetis Core. The Thetis Core, first taped out in December 2021 with the support of imec.IC-link,

Read More »

BrainChip and Edge Impulse Partner to Accelerate AI/ML Deployments

LAGUNA HILLS, CA / ACCESSWIRE / May 15, 2022 / BrainChip Holdings Ltd (ASX:BRN)(OTCQX:BRCHF)(ADR:BCHPY), the world’s first commercial producer of ultra-low power neuromorphic AI IP, and Edge Impulse, the leading development platform for machine learning (ML) on edge devices, are partnering to deliver next-generation platforms to customers looking to develop products utilizing the companies’ unique

Read More »

Computing and AI for Automotive: A Crowded Room of Players

This market research report was originally published at Yole Développement’s website. It is reprinted here with the permission of Yole Développement. Processing for ADAS and infotainment will expand threefold in the next five years… OUTLINE: Computing revenue for the ADAS and infotainment processor market segments is increasing quickly, with a 19% CAGR expected between 2021

Read More »

GrAI Matter Labs Unveils Life-Ready AI with GrAI VIP

May 16, 2022 03:00 AM Eastern Daylight Time–PARIS–(BUSINESS WIRE)–GrAI Matter Labs, a pioneer of brain-inspired ultra-low latency computing, announced today that it will be unveiling GrAI VIP, a full-stack AI system-on-chip platform, to partners and customers at GLOBAL INDUSTRIE, May 17th-20th, 2022. At GLOBAL INDUSTRIE, GML will demonstrate a live event-based, brain-inspired computing solution for

Read More »

Quadric Appoints Former ARM Vice President Steve Roddy as Chief Marketing Officer and Accelerates the Licensing of Its GPNPU Architecture

Accomplished semiconductor IP and machine learning executive joins Quadric as the company revolutionizes AI for everyone, everywhere BURLINGAME, Calif., May 16, 2022 – Quadric, a leading processor technology intellectual property (IP) licensor, today announced that Steve Roddy, a former vice president with Arm’s machine learning group, has joined the company’s executive team as chief marketing

Read More »

Arm Delivers Record Revenues and Record Profits in FY21

May 12, 2022 2021 total revenues were up 35% to $2.7Bn with strong growth in both royalty and non-royalty revenue. 2021 licensing (non-royalty) revenues were up 61% to $1.13Bn as our expanded product portfolio and new business models such as Arm Flexible Access gave more customers more reasons and more ways to license Arm technology.

Read More »

Here you’ll find a wealth of practical technical insights and expert advice to help you bring AI and visual intelligence into your products without flying blind.



1646 N. California Blvd.,
Suite 360
Walnut Creek, CA 94596 USA

Phone: +1 (925) 954-1411
Scroll to Top