fbpx

Processors for Embedded Vision

THIS TECHNOLOGY CATEGORY INCLUDES ANY DEVICE THAT EXECUTES VISION ALGORITHMS OR VISION SYSTEM CONTROL SOFTWARE

This technology category includes any device that executes vision algorithms or vision system control software. The following diagram shows a typical computer vision pipeline; processors are often optimized for the compute-intensive portions of the software workload.

ev pipeline

The following examples represent distinctly different types of processor architectures for embedded vision, and each has advantages and trade-offs that depend on the workload. For this reason, many devices combine multiple processor types into a heterogeneous computing environment, often integrated into a single semiconductor component. In addition, a processor can be accelerated by dedicated hardware that improves performance on computer vision algorithms.

General-purpose CPUs

While computer vision algorithms can run on most general-purpose CPUs, desktop processors may not meet the design constraints of some systems. However, x86 processors and system boards can leverage the PC infrastructure for low-cost hardware and broadly-supported software development tools. Several Alliance Member companies also offer devices that integrate a RISC CPU core. A general-purpose CPU is best suited for heuristics, complex decision-making, network access, user interface, storage management, and overall control. A general purpose CPU may be paired with a vision-specialized device for better performance on pixel-level processing.

Graphics Processing Units

High-performance GPUs deliver massive amounts of parallel computing potential, and graphics processors can be used to accelerate the portions of the computer vision pipeline that perform parallel processing on pixel data. While General Purpose GPUs (GPGPUs) have primarily been used for high-performance computing (HPC), even mobile graphics processors and integrated graphics cores are gaining GPGPU capability—meeting the power constraints for a wider range of vision applications. In designs that require 3D processing in addition to embedded vision, a GPU will already be part of the system and can be used to assist a general-purpose CPU with many computer vision algorithms. Many examples exist of x86-based embedded systems with discrete GPGPUs.

Digital Signal Processors

DSPs are very efficient for processing streaming data, since the bus and memory architecture are optimized to process high-speed data as it traverses the system. This architecture makes DSPs an excellent solution for processing image pixel data as it streams from a sensor source. Many DSPs for vision have been enhanced with coprocessors that are optimized for processing video inputs and accelerating computer vision algorithms. The specialized nature of DSPs makes these devices inefficient for processing general-purpose software workloads, so DSPs are usually paired with a RISC processor to create a heterogeneous computing environment that offers the best of both worlds.

Field Programmable Gate Arrays (FPGAs)

Instead of incurring the high cost and long lead-times for a custom ASIC to accelerate computer vision systems, designers can implement an FPGA to offer a reprogrammable solution for hardware acceleration. With millions of programmable gates, hundreds of I/O pins, and compute performance in the trillions of multiply-accumulates/sec (tera-MACs), high-end FPGAs offer the potential for highest performance in a vision system. Unlike a CPU, which has to time-slice or multi-thread tasks as they compete for compute resources, an FPGA has the advantage of being able to simultaneously accelerate multiple portions of a computer vision pipeline. Since the parallel nature of FPGAs offers so much advantage for accelerating computer vision, many of the algorithms are available as optimized libraries from semiconductor vendors. These computer vision libraries also include preconfigured interface blocks for connecting to other vision devices, such as IP cameras.

Vision-Specific Processors and Cores

Application-specific standard products (ASSPs) are specialized, highly integrated chips tailored for specific applications or application sets. ASSPs may incorporate a CPU, or use a separate CPU chip. By virtue of their specialization, ASSPs for vision processing typically deliver superior cost- and energy-efficiency compared with other types of processing solutions. Among other techniques, ASSPs deliver this efficiency through the use of specialized coprocessors and accelerators. And, because ASSPs are by definition focused on a specific application, they are usually provided with extensive associated software. This same specialization, however, means that an ASSP designed for vision is typically not suitable for other applications. ASSPs’ unique architectures can also make programming them more difficult than with other kinds of processors; some ASSPs are not user-programmable.

Blaize Partners to Demonstrate Multiple AI Inference for the Edge Applications at Embedded World 2022

EL DORADO HILLS, CA — June 15, 2022 — Blaize® today announced plans to demonstrate its Blaize Graph Streaming Processor (GSP®) architecture with partner companies exhibiting next week at Embedded World 2022 (June 21-23). Blaize has developed a next-generation computing architecture designed for AI workloads, which tackles the economic and technical barriers to widespread AI

Read More »

AEWIN Partners with Blaize to Deliver High Performance GSP Computing for Edge AI Applications

El Dorado Hills, CA and New Taipei City, Taiwan — June 13, 2022 — Blaize, the AI computing innovator revolutionizing edge and automotive computing solutions, today announced that AEWIN Technologies, Taiwan, is offering its platform of Multi-Access Edge Computing network appliances, SCB-1932, with the Blaize® Xplorer X1600P-Q PCIe accelerator for Edge AI computing. “AEWIN’s collaboration

Read More »

“Autonomous Driving AI Workloads: Technology Trends and Optimization Strategies,” a Presentation from Qualcomm

Ahmed Sadek, Senior Director of Engineering at Qualcomm, presents the “Autonomous Driving AI Workloads: Technology Trends and Optimization Strategies” tutorial at the May 2022 Embedded Vision Summit. Enabling safe, comfortable and affordable autonomous driving requires solving some of the most demanding and challenging technological problems. From centimeter-level localization to multimodal… “Autonomous Driving AI Workloads: Technology

Read More »

“Tools for Creating Next-Gen Computer Vision Apps on Snapdragon,” a Presentation from Qualcomm

Judd Heape, Vice President of Product Management for Camera, Computer Vision and Video Technology at Qualcomm, presents the “Tools for Creating Next-Gen Computer Vision Apps on Snapdragon” tutorial at the May 2022 Embedded Vision Summit. The Snapdragon Mobile Platform powers the world’s best smartphones, XR headsets, PCs, wearables, cars and… “Tools for Creating Next-Gen Computer

Read More »

CEVA Expands Sensor Fusion Product Line with New Sensor Hub MCU for High Precision Motion Tracking and Orientation Detection

FSP201 delivers superior orientation and heading accuracy, providing high quality, low cost, sensor-agnostic solution for robotics, 3D audio, metaverse hardware & general 6-axis motion applications ROCKVILLE, MD, June 09, 2022 – CEVA, Inc. (NASDAQ: CEVA), the leading licensor of wireless connectivity, smart sensing technologies, and integrated IP solutions, today announced that it has expanded its

Read More »

TEMPO AI Chip Tapes Out with videantis Processor Platform

Hannover, Germany, June 09, 2022 – videantis GmbH, a leading supplier of deep learning, computer vision, image processing, and video coding solutions, today announced the tape-out of a low-power AI chip based on its v-MP6000UDX unified processing platform. The chip development is part of the European TEMPO project and targets several autonomous driving use cases.

Read More »

“Seamless Deployment of Multimedia and Machine Learning Applications at the Edge,” a Presentation from Qualcomm

Megha Daga, Senior Director of Product Management for AIoT at Qualcomm, presents the “Seamless Deployment of Multimedia and Machine Learning Applications at the Edge” tutorial at the May 2022 Embedded Vision Summit. There has been an explosion of opportunities for edge compute solutions across the internet of things. This growth… “Seamless Deployment of Multimedia and

Read More »

Arm Introduces New Image Signal Processor to Advance Vision Systems for IoT and Embedded Markets

News highlights: Arm Mali-C55 is the smallest and most configurable image signal processor from Arm, already seeing success with licensees such as Renesas Delivers improved image quality and higher performance for advanced embedded and IoT vision systems with half the silicon area of previous generations Multi-camera high resolution support and seamless integration for more machine

Read More »

“A Practical Guide to Getting the DNN Accuracy You Need and the Performance You Deserve,” a Presentation from Qualcomm

Felix Baum, Director of Product Management at Qualcomm, presents the “Practical Guide to Getting the DNN Accuracy You Need and the Performance You Deserve” tutorial at the May 2022 Embedded Vision Summit. Every day, developers struggle to take DNN workloads that were originally developed on workstations and migrate them to… “A Practical Guide to Getting

Read More »

Ambarella’s Automotive AI SoC Achieves ASIL C Certification, Exceeding Functional Safety Levels of Competing Front ADAS Solutions

CVflow® SoC Combines High Certification Level With Best-in-Class AI Performance Per Watt for Safety Critical Automotive Perception Systems From ADAS to L4 Autonomous Driving SANTA CLARA, Calif., June 7, 2022 — Ambarella, Inc. (NASDAQ: AMBA), an edge AI semiconductor company, today announced that its CV2FS automotive AI perception system-on-chip (SoC) achieved ASIL C certification from

Read More »

“Powering the Connected Intelligent Edge and the Future of On-Device AI,” a Presentation from Qualcomm

Ziad Asghar, Vice President of Product Management at Qualcomm, presents the “Powering the Connected Intelligent Edge and the Future of On-Device AI,” tutorial at the May 2022 Embedded Vision Summit. Qualcomm is leading the realization of the “connected intelligent edge,” where the convergence of wireless connectivity, efficient computing and distributed… “Powering the Connected Intelligent Edge

Read More »

“How Do We Enable Edge ML Everywhere? Data, Reliability and Silicon Flexibility,” a Presentation from Edge Impulse

Zach Shelby, Co-founder and CEO of Edge Impulse, presents the “How Do We Enable Edge ML Everywhere? Data, Reliability and Silicon Flexibility” tutorial at the May 2022 Embedded Vision Summit. In this talk, Shelby reveals insights from the company’s recent global edge ML developer survey, which identified key barriers to… “How Do We Enable Edge

Read More »

Advanced RISC-V AI SoCs for High-End Passenger Cars to Reach $819M Dollars by 2027

For more information, visit https://semico.com/content/analyzing-market-potential-risc-v-cpu-sip-automotive-addendum The automotive market is undergoing a tremendous amount of rapid change. Automotive manufacturers are exploring the potential of adding various new functions and reconfiguring existing functions to all include some level of intelligence. This covers the range from merely intelligent functions all the way to fully autonomous driving functions that

Read More »

Apple Invites Us to Dream…

This market research report was originally published at Yole Développement’s website. It is reprinted here with the permission of Yole Développement. The devices that handle most of the computing needs of today’s consumers are either smartphones, tablets, or personal computers (PC). In terms of shipped quantity, smartphones take the lion’s share, with more than three

Read More »

Intel to Acquire Codeplay Software

Intel has long believed that innovation thrives in an open ecosystem, enables choice, fosters trust, and is equally accessible to all. The oneAPI project reflects and embodies this commitment to an open, vibrant, and active ecosystem, featuring an open specification, open source reference implementations, Technical Advisory Boards, and worldwide oneAPI Centers of Excellence. Since its

Read More »

Snapdragon Spaces is Globally Available for All Developers to Download and Revolutionize Headworn AR

Highlights: Snapdragon Spaces™ XR Developer Platform is available for developers to download. The first Snapdragon Spaces ready hardware development kit, the Lenovo ThinkReality A3 smart glasses and a motorola edge+ smartphone, can be purchased. Qualcomm Ventures announces investments in echo3D and Tripp as part of the previously announced $100M Snapdragon™ Metaverse Fund. June 1, 2022

Read More »

Imagination Launches Open Access Program, Providing Scale-ups with a Low-cost Path to Differentiated Silicon

Removing licensing fees and accelerating SoC development for growing businesses London, England – 31st May 2022 – Imagination Technologies announces its Open Access program, offering access for early-stage companies to select class-leading GPU and AI accelerator IP without any licensing costs. This lowers the barriers of entry to SoC design, enabling scale-ups to create advanced

Read More »

Yet Another AI Chip Market Segment has Emerged

This market research report was originally published at JP Data’s website. It is reprinted here with the permission of JP Data. The AI chip market continues to grow. Driven by always-on applications such as keyword detection, a whole new market segment for AI chips that consume less than 100 milli watt power has emerged in

Read More »

Here you’ll find a wealth of practical technical insights and expert advice to help you bring AI and visual intelligence into your products without flying blind.

Contact

Address

1646 N. California Blvd.,
Suite 360
Walnut Creek, CA 94596 USA

Phone
Phone: +1 (925) 954-1411
Scroll to Top