Processors for Embedded Vision


This technology category includes any device that executes vision algorithms or vision system control software. The following diagram shows a typical computer vision pipeline; processors are often optimized for the compute-intensive portions of the software workload.

ev pipeline

The following examples represent distinctly different types of processor architectures for embedded vision, and each has advantages and trade-offs that depend on the workload. For this reason, many devices combine multiple processor types into a heterogeneous computing environment, often integrated into a single semiconductor component. In addition, a processor can be accelerated by dedicated hardware that improves performance on computer vision algorithms.

General-purpose CPUs

While computer vision algorithms can run on most general-purpose CPUs, desktop processors may not meet the design constraints of some systems. However, x86 processors and system boards can leverage the PC infrastructure for low-cost hardware and broadly-supported software development tools. Several Alliance Member companies also offer devices that integrate a RISC CPU core. A general-purpose CPU is best suited for heuristics, complex decision-making, network access, user interface, storage management, and overall control. A general purpose CPU may be paired with a vision-specialized device for better performance on pixel-level processing.

Graphics Processing Units

High-performance GPUs deliver massive amounts of parallel computing potential, and graphics processors can be used to accelerate the portions of the computer vision pipeline that perform parallel processing on pixel data. While General Purpose GPUs (GPGPUs) have primarily been used for high-performance computing (HPC), even mobile graphics processors and integrated graphics cores are gaining GPGPU capability—meeting the power constraints for a wider range of vision applications. In designs that require 3D processing in addition to embedded vision, a GPU will already be part of the system and can be used to assist a general-purpose CPU with many computer vision algorithms. Many examples exist of x86-based embedded systems with discrete GPGPUs.

Digital Signal Processors

DSPs are very efficient for processing streaming data, since the bus and memory architecture are optimized to process high-speed data as it traverses the system. This architecture makes DSPs an excellent solution for processing image pixel data as it streams from a sensor source. Many DSPs for vision have been enhanced with coprocessors that are optimized for processing video inputs and accelerating computer vision algorithms. The specialized nature of DSPs makes these devices inefficient for processing general-purpose software workloads, so DSPs are usually paired with a RISC processor to create a heterogeneous computing environment that offers the best of both worlds.

Field Programmable Gate Arrays (FPGAs)

Instead of incurring the high cost and long lead-times for a custom ASIC to accelerate computer vision systems, designers can implement an FPGA to offer a reprogrammable solution for hardware acceleration. With millions of programmable gates, hundreds of I/O pins, and compute performance in the trillions of multiply-accumulates/sec (tera-MACs), high-end FPGAs offer the potential for highest performance in a vision system. Unlike a CPU, which has to time-slice or multi-thread tasks as they compete for compute resources, an FPGA has the advantage of being able to simultaneously accelerate multiple portions of a computer vision pipeline. Since the parallel nature of FPGAs offers so much advantage for accelerating computer vision, many of the algorithms are available as optimized libraries from semiconductor vendors. These computer vision libraries also include preconfigured interface blocks for connecting to other vision devices, such as IP cameras.

Vision-Specific Processors and Cores

Application-specific standard products (ASSPs) are specialized, highly integrated chips tailored for specific applications or application sets. ASSPs may incorporate a CPU, or use a separate CPU chip. By virtue of their specialization, ASSPs for vision processing typically deliver superior cost- and energy-efficiency compared with other types of processing solutions. Among other techniques, ASSPs deliver this efficiency through the use of specialized coprocessors and accelerators. And, because ASSPs are by definition focused on a specific application, they are usually provided with extensive associated software. This same specialization, however, means that an ASSP designed for vision is typically not suitable for other applications. ASSPs’ unique architectures can also make programming them more difficult than with other kinds of processors; some ASSPs are not user-programmable.

Real-time Video Enhancement Reaches New Standard with Visionary.ai and Inuitive Partnership

25 January 2022 – Jerusalem – Two Israeli AI startups, Visionary.ai and Inuitive, today announced a new partnership. The companies have been collaborating in recent months to run Visionary.ai’s AI-based imaging technology on Inuitive’s AI processor, making cutting-edge computer vision available to edge devices, affordably and with minimal power consumption. Visionary.ai has developed a software-based

Read More »

BrainChip Achieves Full Commercialization of Its AKD1000 AIoT Chip with Availability of Mini PCIe Boards in High Volume

Company welcomes enterprises to the Edge with AIoT PCIe board and board design layout Laguna Hills , Calif. – DATE, 2022 – BrainChip Holdings Ltd (ASX: BRN, OTCQX: BRCHF, ADR: BCHPY), a leading provider of ultra-low power high performance artificial intelligence technology and the world’s first commercial producer of neuromorphic AI chips and IP, today

Read More »

Light Leverages Cadence Tensilica Vision Q7 DSP for Enhanced Depth Perception in Next-Generation ADAS Systems

Tensilica Vision Q7 DSP enables Light’s Clarity Depth Perception Platform to power next-generation ADAS systems with 10X greater performance than quad-core CPU REDWOOD CITY and SAN JOSE, Calif., January 13, 2022 – Light™ and Cadence Design Systems, Inc. (Nasdaq: CDNS) today announced that Light has deployed the Cadence® Tensilica® Vision Q7 DSP for use in

Read More »

Seeing Machines and Ambarella Collaborate on Integrated Forward-facing ADAS and In-cabin Occupant and Driver Monitoring System Solutions

CANBERRA, Australia and SANTA CLARA, Calif. – Jan. 6, 2022 – Seeing Machines Limited (LSE: SEE), the advanced computer vision technology company that designs AI-powered operator monitoring systems to improve transport safety, announced a collaboration with Ambarella, Inc. (NASDAQ: AMBA), an AI vision silicon company, to bring integrated Advanced Driver Assistance System (ADAS) and occupant

Read More »

Syntiant and CeramicSpeed to Develop Autonomous Wireless Sensors for Condition-based Monitoring

Collaboration Aimed at Reducing Costs through Predictive Maintenance in Industrial IoT Applications Irvine, Calif., January 6, 2022 – Syntiant Corp., a provider of deep learning solutions making edge AI a reality for always-on applications, today announced a collaboration with Denmark-based CeramicSpeed to develop ultra-low-power autonomous sensors for Industrial IoT applications using the Syntiant® NDP120 Neural

Read More »

Syntiant and Energous Collaborate for Wireless Charging of Always-on Edge AI Processors

Companies to Demonstrate Energous’ WattUp PowerBridge Technology Combined With Syntiant’s Ultra-Low-Power Deep Learning Architecture for IoT Network Edge Applications at CES 2022 Las Vegas, Nev. January 5, 2022 — Energous Corporation (Nasdaq: WATT), a leading developer of RF-based charging for wireless power networks, today announced a collaboration with Syntiant, a provider of deep learning solutions

Read More »

CEVA Redefines High Performance AI/ML Processing for Edge AI and Edge Compute Devices with its NeuPro-M Heterogeneous and Secure Processor Architecture

3rd generation NeuPro AI/ML architecture offers scalable performance of 20 to 1,200 TOPS at SoC and Chiplet levels, lowers memory bandwidth by 6X Targets broad use of AI/ML in automotive, industrial, 5G networks and handsets, surveillance cameras, and Edge Compute LAS VEGAS, Jan. 6, 2022 /PRNewswire/ — Consumer Electronics Show  – CEVA, Inc. (NASDAQ: CEVA),

Read More »

Lattice FPGAs Power Next Generation Lenovo Edge/AI Experiences

Low power Lattice FPGAs and computer vision software solutions to drive a new era of premium PC experiences across latest Lenovo™ ThinkPad™ X1 portfolio HILLSBORO, Ore – Jan. 5, 2022 – Lattice Semiconductor Corporation (NASDAQ: LSCC), the low power programmable leader, today announced its award-winning Lattice CrossLink™-NX FPGAs and AI-optimized software solutions power Lenovo’s latest

Read More »

Ambarella Announces Breakthrough AI-Based Image Signal Processing

New Neural Network Based ISP Enhances Low-Light and HDR Processing by Up to 100X Compared to State-of-the-Art Traditional ISPs SANTA CLARA, Calif., Jan. 5, 2022 — Ambarella, Inc. (NASDAQ: AMBA), an AI vision silicon company, today announced its new Artificial Intelligence Image Signal Processor (AISP). The company is showcasing this technology at its invitation-only event

Read More »

Qualcomm Announces Collaboration with Microsoft to Expand and Accelerate AR to Usher in New Gateways to the Metaverse

The Companies will Collaborate on Designing Custom AR Chips and Integrating Software Platforms January 4, 2022 – Las Vegas – At the 2022 Consumer Electronics Show (CES), Qualcomm Technologies, Inc. announced their collaboration with Microsoft to expand and accelerate the adoption of augmented reality (AR) in both the consumer and enterprise sector. Both companies are

Read More »

Ambarella Launches AI Domain Controller SoC Family for Single-Chip Multi-Sensor Perception, Fusion and Path Planning in ADAS to L4 Autonomous Vehicles

CV3 Automotive SoC Family Offers Unprecedented 500 eTOPS AI Performance Combined With High-Resolution Image, Radar and Ultrasonic Processing at Extremely Low Power SANTA CLARA, Calif., Jan. 4, 2022 — Ambarella, Inc. (NASDAQ: AMBA), an AI vision silicon company, today announced during CES the CV3 AI domain controller family. This fully scalable, power-efficient CVflow® family of

Read More »

ADLINK Launches COM-HPC Client Type and COM Express Type 6 Modules with 12th Gen Intel Core Processors

Breakthrough Intel® Core™ technology with ADLINK Computer-on-Modules allow for hybrid architecture performance and a wide variety of deployment scenarios with superior performance Summary: Advanced hybrid architecture features up to six Performance-cores (P-cores) that enhance single-threaded throughput for IoT workloads and up to eight Efficient-cores (E-cores) for background task management and multitasking Integrated Intel Iris Xe

Read More »

12th Gen Intel Core Processor for IoT Announced

New IoT-focused 12th Gen Intel Core processors offer increased core count and performance to retail, manufacturing, healthcare and digital safety customers. What’s New: Today at CES 2022, Intel launched 12th Gen Intel® Core™ processors (code-named Alder Lake S-series and H-series), the first family of processors enhanced for the edge to feature performance hybrid architecture that combines

Read More »

CES: Intel Engineers Fastest Mobile Processor Ever with 12th Gen Intel Core Mobile

Twenty-eight new 12th Gen Intel Core mobile and 22 desktop processors drive powerful gaming and creator-focused laptops and desktops, enterprise-ready systems and IoT applications. NEWS HIGHLIGHTS Intel announces the 12th Gen Intel® Core™ family of mobile processors led by the launch of new H-series mobile processors featuring the flagship Intel® Core™ i9-12900HK – the fastest

Read More »

CES 2022: Intel Achieves Major Milestones across Automotive, PCs and Graphics

Mobileye expands major automaker relationships; Intel delivers fastest mobile processor, ships Alchemist GPUs. News Highlights Mobileye announces the new EyeQ® Ultra system-on-chip for autonomous vehicles and expanded relationships with major automakers, including Ford, Volkswagen Group and Geely’s ZEEKR brand. Intel launches the 12th Gen Intel® Core™ i9-12900HK – the world’s best gaming laptop platform1 –

Read More »

New Mobileye EyeQ Ultra will Enable Consumer AVs

Single-package design will deliver industry’s leanest, most performance-power efficient SoC for fully autonomous vehicles. NEWS HIGHLIGHTS Mobileye introduces EyeQ® Ultra™ – a single package AV-on-chip super-computer that is purpose-built for end-to-end autonomous driving. Proven Mobileye EyeQ® architecture underpins EyeQ Ultra, maximizing performance and efficiency at 176 TOPS (tera operations per second). First silicon for the

Read More »

Here you’ll find a wealth of practical technical insights and expert advice to help you bring AI and visual intelligence into your products without flying blind.



1646 North California Blvd.,
Suite 360
Walnut Creek, CA 94596 USA

Phone: +1 (925) 954-1411
Scroll to Top