Processors for Embedded Vision
THIS TECHNOLOGY CATEGORY INCLUDES ANY DEVICE THAT EXECUTES VISION ALGORITHMS OR VISION SYSTEM CONTROL SOFTWARE
This technology category includes any device that executes vision algorithms or vision system control software. The following diagram shows a typical computer vision pipeline; processors are often optimized for the compute-intensive portions of the software workload.
The following examples represent distinctly different types of processor architectures for embedded vision, and each has advantages and trade-offs that depend on the workload. For this reason, many devices combine multiple processor types into a heterogeneous computing environment, often integrated into a single semiconductor component. In addition, a processor can be accelerated by dedicated hardware that improves performance on computer vision algorithms.
While computer vision algorithms can run on most general-purpose CPUs, desktop processors may not meet the design constraints of some systems. However, x86 processors and system boards can leverage the PC infrastructure for low-cost hardware and broadly-supported software development tools. Several Alliance Member companies also offer devices that integrate a RISC CPU core. A general-purpose CPU is best suited for heuristics, complex decision-making, network access, user interface, storage management, and overall control. A general purpose CPU may be paired with a vision-specialized device for better performance on pixel-level processing.
Graphics Processing Units
High-performance GPUs deliver massive amounts of parallel computing potential, and graphics processors can be used to accelerate the portions of the computer vision pipeline that perform parallel processing on pixel data. While General Purpose GPUs (GPGPUs) have primarily been used for high-performance computing (HPC), even mobile graphics processors and integrated graphics cores are gaining GPGPU capability—meeting the power constraints for a wider range of vision applications. In designs that require 3D processing in addition to embedded vision, a GPU will already be part of the system and can be used to assist a general-purpose CPU with many computer vision algorithms. Many examples exist of x86-based embedded systems with discrete GPGPUs.
Digital Signal Processors
DSPs are very efficient for processing streaming data, since the bus and memory architecture are optimized to process high-speed data as it traverses the system. This architecture makes DSPs an excellent solution for processing image pixel data as it streams from a sensor source. Many DSPs for vision have been enhanced with coprocessors that are optimized for processing video inputs and accelerating computer vision algorithms. The specialized nature of DSPs makes these devices inefficient for processing general-purpose software workloads, so DSPs are usually paired with a RISC processor to create a heterogeneous computing environment that offers the best of both worlds.
Field Programmable Gate Arrays (FPGAs)
Instead of incurring the high cost and long lead-times for a custom ASIC to accelerate computer vision systems, designers can implement an FPGA to offer a reprogrammable solution for hardware acceleration. With millions of programmable gates, hundreds of I/O pins, and compute performance in the trillions of multiply-accumulates/sec (tera-MACs), high-end FPGAs offer the potential for highest performance in a vision system. Unlike a CPU, which has to time-slice or multi-thread tasks as they compete for compute resources, an FPGA has the advantage of being able to simultaneously accelerate multiple portions of a computer vision pipeline. Since the parallel nature of FPGAs offers so much advantage for accelerating computer vision, many of the algorithms are available as optimized libraries from semiconductor vendors. These computer vision libraries also include preconfigured interface blocks for connecting to other vision devices, such as IP cameras.
Vision-Specific Processors and Cores
Application-specific standard products (ASSPs) are specialized, highly integrated chips tailored for specific applications or application sets. ASSPs may incorporate a CPU, or use a separate CPU chip. By virtue of their specialization, ASSPs for vision processing typically deliver superior cost- and energy-efficiency compared with other types of processing solutions. Among other techniques, ASSPs deliver this efficiency through the use of specialized coprocessors and accelerators. And, because ASSPs are by definition focused on a specific application, they are usually provided with extensive associated software. This same specialization, however, means that an ASSP designed for vision is typically not suitable for other applications. ASSPs’ unique architectures can also make programming them more difficult than with other kinds of processors; some ASSPs are not user-programmable.
25 January 2022 – Jerusalem – Two Israeli AI startups, Visionary.ai and Inuitive, today announced a new partnership. The companies have been collaborating in recent months to run Visionary.ai’s AI-based imaging technology on Inuitive’s AI processor, making cutting-edge computer vision available to edge devices, affordably and with minimal power consumption. Visionary.ai has developed a software-based
In this video, you’ll see how AI technology can be used to identify faces using the MAX78000EVKIT from Maxim Integrated (now part of Analog Devices), along with a camera and display. This face identification demonstration, shown by Erman Okman and Gorken Ulkar, members of the technical staff at Maxim Integrated, implements an energy-efficient convolutional neural
BrainChip Achieves Full Commercialization of Its AKD1000 AIoT Chip with Availability of Mini PCIe Boards in High Volume
Company welcomes enterprises to the Edge with AIoT PCIe board and board design layout Laguna Hills , Calif. – DATE, 2022 – BrainChip Holdings Ltd (ASX: BRN, OTCQX: BRCHF, ADR: BCHPY), a leading provider of ultra-low power high performance artificial intelligence technology and the world’s first commercial producer of neuromorphic AI chips and IP, today
Light Leverages Cadence Tensilica Vision Q7 DSP for Enhanced Depth Perception in Next-Generation ADAS Systems
Tensilica Vision Q7 DSP enables Light’s Clarity Depth Perception Platform to power next-generation ADAS systems with 10X greater performance than quad-core CPU REDWOOD CITY and SAN JOSE, Calif., January 13, 2022 – Light™ and Cadence Design Systems, Inc. (Nasdaq: CDNS) today announced that Light has deployed the Cadence® Tensilica® Vision Q7 DSP for use in
On February 24, 2022 at 9 am PT (noon ET), Rob Telson, Vice President of Worldwide Sales, and Todd Vierra, Director of Customer Engagement, both of BrainChip, will present the free hour webinar “Developing Optimized Systems with BrainChip’s Akida Neuromorphic Processor,” organized by the Edge AI and Vision Alliance. Here’s the description, from the event
Seeing Machines and Ambarella Collaborate on Integrated Forward-facing ADAS and In-cabin Occupant and Driver Monitoring System Solutions
CANBERRA, Australia and SANTA CLARA, Calif. – Jan. 6, 2022 – Seeing Machines Limited (LSE: SEE), the advanced computer vision technology company that designs AI-powered operator monitoring systems to improve transport safety, announced a collaboration with Ambarella, Inc. (NASDAQ: AMBA), an AI vision silicon company, to bring integrated Advanced Driver Assistance System (ADAS) and occupant
Multi-Lingual Custom Wake Words and Speech Commands Supported by Data Training and Modeling, Providing a Complete, End-to-End Solution for Edge AI Processing Irvine, Calif., January 6, 2022 – Syntiant Corp., a provider of deep learning solutions making edge AI a reality for always-on applications, today announced a new reference design that will enable ODMs and
Collaboration Aimed at Reducing Costs through Predictive Maintenance in Industrial IoT Applications Irvine, Calif., January 6, 2022 – Syntiant Corp., a provider of deep learning solutions making edge AI a reality for always-on applications, today announced a collaboration with Denmark-based CeramicSpeed to develop ultra-low-power autonomous sensors for Industrial IoT applications using the Syntiant® NDP120 Neural
Companies to Demonstrate Energous’ WattUp PowerBridge Technology Combined With Syntiant’s Ultra-Low-Power Deep Learning Architecture for IoT Network Edge Applications at CES 2022 Las Vegas, Nev. January 5, 2022 — Energous Corporation (Nasdaq: WATT), a leading developer of RF-based charging for wireless power networks, today announced a collaboration with Syntiant, a provider of deep learning solutions
CEVA Redefines High Performance AI/ML Processing for Edge AI and Edge Compute Devices with its NeuPro-M Heterogeneous and Secure Processor Architecture
3rd generation NeuPro AI/ML architecture offers scalable performance of 20 to 1,200 TOPS at SoC and Chiplet levels, lowers memory bandwidth by 6X Targets broad use of AI/ML in automotive, industrial, 5G networks and handsets, surveillance cameras, and Edge Compute LAS VEGAS, Jan. 6, 2022 /PRNewswire/ — Consumer Electronics Show – CEVA, Inc. (NASDAQ: CEVA),
Low power Lattice FPGAs and computer vision software solutions to drive a new era of premium PC experiences across latest Lenovo™ ThinkPad™ X1 portfolio HILLSBORO, Ore – Jan. 5, 2022 – Lattice Semiconductor Corporation (NASDAQ: LSCC), the low power programmable leader, today announced its award-winning Lattice CrossLink™-NX FPGAs and AI-optimized software solutions power Lenovo’s latest
New Neural Network Based ISP Enhances Low-Light and HDR Processing by Up to 100X Compared to State-of-the-Art Traditional ISPs SANTA CLARA, Calif., Jan. 5, 2022 — Ambarella, Inc. (NASDAQ: AMBA), an AI vision silicon company, today announced its new Artificial Intelligence Image Signal Processor (AISP). The company is showcasing this technology at its invitation-only event
Qualcomm Announces Collaboration with Microsoft to Expand and Accelerate AR to Usher in New Gateways to the Metaverse
The Companies will Collaborate on Designing Custom AR Chips and Integrating Software Platforms January 4, 2022 – Las Vegas – At the 2022 Consumer Electronics Show (CES), Qualcomm Technologies, Inc. announced their collaboration with Microsoft to expand and accelerate the adoption of augmented reality (AR) in both the consumer and enterprise sector. Both companies are
Ambarella Launches AI Domain Controller SoC Family for Single-Chip Multi-Sensor Perception, Fusion and Path Planning in ADAS to L4 Autonomous Vehicles
CV3 Automotive SoC Family Offers Unprecedented 500 eTOPS AI Performance Combined With High-Resolution Image, Radar and Ultrasonic Processing at Extremely Low Power SANTA CLARA, Calif., Jan. 4, 2022 — Ambarella, Inc. (NASDAQ: AMBA), an AI vision silicon company, today announced during CES the CV3 AI domain controller family. This fully scalable, power-efficient CVflow® family of
ADLINK Launches COM-HPC Client Type and COM Express Type 6 Modules with 12th Gen Intel Core Processors
Breakthrough Intel® Core™ technology with ADLINK Computer-on-Modules allow for hybrid architecture performance and a wide variety of deployment scenarios with superior performance Summary: Advanced hybrid architecture features up to six Performance-cores (P-cores) that enhance single-threaded throughput for IoT workloads and up to eight Efficient-cores (E-cores) for background task management and multitasking Integrated Intel Iris Xe
New IoT-focused 12th Gen Intel Core processors offer increased core count and performance to retail, manufacturing, healthcare and digital safety customers. What’s New: Today at CES 2022, Intel launched 12th Gen Intel® Core™ processors (code-named Alder Lake S-series and H-series), the first family of processors enhanced for the edge to feature performance hybrid architecture that combines
Twenty-eight new 12th Gen Intel Core mobile and 22 desktop processors drive powerful gaming and creator-focused laptops and desktops, enterprise-ready systems and IoT applications. NEWS HIGHLIGHTS Intel announces the 12th Gen Intel® Core™ family of mobile processors led by the launch of new H-series mobile processors featuring the flagship Intel® Core™ i9-12900HK – the fastest
Mobileye expands major automaker relationships; Intel delivers fastest mobile processor, ships Alchemist GPUs. News Highlights Mobileye announces the new EyeQ® Ultra system-on-chip for autonomous vehicles and expanded relationships with major automakers, including Ford, Volkswagen Group and Geely’s ZEEKR brand. Intel launches the 12th Gen Intel® Core™ i9-12900HK – the world’s best gaming laptop platform1 –
Single-package design will deliver industry’s leanest, most performance-power efficient SoC for fully autonomous vehicles. NEWS HIGHLIGHTS Mobileye introduces EyeQ® Ultra™ – a single package AV-on-chip super-computer that is purpose-built for end-to-end autonomous driving. Proven Mobileye EyeQ® architecture underpins EyeQ Ultra, maximizing performance and efficiency at 176 TOPS (tera operations per second). First silicon for the
NVIDIA Expands Reach With New GeForce Laptops and Desktops, GeForce NOW Partners, and Omniverse for Creators
160+ Gaming and Studio Laptop Designs, GeForce RTX 3080 Ti for Laptops and RTX 3050 for Desktops; More Electronic Arts Games, Samsung TVs and AT Omniverse Extended to Millions of Creators Tuesday, January 4, 2022—CES—NVIDIA today set out the next direction of the ultimate platform for gamers and creators, unveiling more than 160 gaming and