Processors for Embedded Vision
THIS TECHNOLOGY CATEGORY INCLUDES ANY DEVICE THAT EXECUTES VISION ALGORITHMS OR VISION SYSTEM CONTROL SOFTWARE
This technology category includes any device that executes vision algorithms or vision system control software. The following diagram shows a typical computer vision pipeline; processors are often optimized for the compute-intensive portions of the software workload.
The following examples represent distinctly different types of processor architectures for embedded vision, and each has advantages and trade-offs that depend on the workload. For this reason, many devices combine multiple processor types into a heterogeneous computing environment, often integrated into a single semiconductor component. In addition, a processor can be accelerated by dedicated hardware that improves performance on computer vision algorithms.
While computer vision algorithms can run on most general-purpose CPUs, desktop processors may not meet the design constraints of some systems. However, x86 processors and system boards can leverage the PC infrastructure for low-cost hardware and broadly-supported software development tools. Several Alliance Member companies also offer devices that integrate a RISC CPU core. A general-purpose CPU is best suited for heuristics, complex decision-making, network access, user interface, storage management, and overall control. A general purpose CPU may be paired with a vision-specialized device for better performance on pixel-level processing.
Graphics Processing Units
High-performance GPUs deliver massive amounts of parallel computing potential, and graphics processors can be used to accelerate the portions of the computer vision pipeline that perform parallel processing on pixel data. While General Purpose GPUs (GPGPUs) have primarily been used for high-performance computing (HPC), even mobile graphics processors and integrated graphics cores are gaining GPGPU capability—meeting the power constraints for a wider range of vision applications. In designs that require 3D processing in addition to embedded vision, a GPU will already be part of the system and can be used to assist a general-purpose CPU with many computer vision algorithms. Many examples exist of x86-based embedded systems with discrete GPGPUs.
Digital Signal Processors
DSPs are very efficient for processing streaming data, since the bus and memory architecture are optimized to process high-speed data as it traverses the system. This architecture makes DSPs an excellent solution for processing image pixel data as it streams from a sensor source. Many DSPs for vision have been enhanced with coprocessors that are optimized for processing video inputs and accelerating computer vision algorithms. The specialized nature of DSPs makes these devices inefficient for processing general-purpose software workloads, so DSPs are usually paired with a RISC processor to create a heterogeneous computing environment that offers the best of both worlds.
Field Programmable Gate Arrays (FPGAs)
Instead of incurring the high cost and long lead-times for a custom ASIC to accelerate computer vision systems, designers can implement an FPGA to offer a reprogrammable solution for hardware acceleration. With millions of programmable gates, hundreds of I/O pins, and compute performance in the trillions of multiply-accumulates/sec (tera-MACs), high-end FPGAs offer the potential for highest performance in a vision system. Unlike a CPU, which has to time-slice or multi-thread tasks as they compete for compute resources, an FPGA has the advantage of being able to simultaneously accelerate multiple portions of a computer vision pipeline. Since the parallel nature of FPGAs offers so much advantage for accelerating computer vision, many of the algorithms are available as optimized libraries from semiconductor vendors. These computer vision libraries also include preconfigured interface blocks for connecting to other vision devices, such as IP cameras.
Vision-Specific Processors and Cores
Application-specific standard products (ASSPs) are specialized, highly integrated chips tailored for specific applications or application sets. ASSPs may incorporate a CPU, or use a separate CPU chip. By virtue of their specialization, ASSPs for vision processing typically deliver superior cost- and energy-efficiency compared with other types of processing solutions. Among other techniques, ASSPs deliver this efficiency through the use of specialized coprocessors and accelerators. And, because ASSPs are by definition focused on a specific application, they are usually provided with extensive associated software. This same specialization, however, means that an ASSP designed for vision is typically not suitable for other applications. ASSPs’ unique architectures can also make programming them more difficult than with other kinds of processors; some ASSPs are not user-programmable.
Axelera AI, November 22, 2023 – Axelera AI, provider of world’s most powerful and advanced solutions for AI at the Edge, today announced that it has been named a CES® 2024 Innovation Awards Honoree for its Metis™ AI Platform. This year’s CES Innovation Awards program received a record number of over 3000 submissions. The announcement
This blog post was originally published at NVIDIA’s website. It is reprinted here with the permission of NVIDIA. More than 10,000 companies building on the NVIDIA Jetson platform can now use new generative AI, APIs and microservices to accelerate industrial digitalization. Powerful generative AI models and cloud-native APIs and microservices are coming to the edge.
This blog post was originally published at Qualcomm’s website. It is reprinted here with the permission of Qualcomm. New Snapdragon XR processors power Meta Quest 3 and the Ray-Ban Meta smart glasses collection to revolutionize your reality Qualcomm Technologies and Meta have a long history of driving innovation in the extended reality (XR) industry. Our
On February 6, 2024 at 9 am PT (noon ET), Julie Buquet, AI Scientist for Imaging, and Ludimila Centeno, Associate VP of Technology Offer and Support, both of Immervision, will present the free hour webinar “Optimizing Camera Design for Machine Perception Via End-to-end Camera Simulation,” organized by the Edge AI and Vision Alliance. Here’s the description,
Laguna Hills, Calif. – 21st November 2023: BrainChip Holdings Ltd (ASX: BRN, OTCQX: BRCHF, ADR: BCHPY), the world’s first commercial producer of ultra-low power, fully digital, neuromorphic AI IP, today announced the hiring of M. Anthony (Tony) Lewis as the new Chief Technology Officer (CTO) and the planned retirement of co-founder and CTO Peter Van
Spatial computing promises to transform the way we interact with our devices as computing goes truly 3D, with early signs of change already underway. While Apple‘s upcoming Vision Pro is bringing new excitement to this space, gaming-focused VR (Virtual Reality) headsets from companies including Meta, Sony, and Pico have sold millions of units, and AR
News highlights: New Arm Cortex-M52 is the smallest, most area and cost-efficient processor enabled with Arm Helium technology, delivering enhanced AI capabilities for lower cost IoT devices Provides the flexibility to scale across a range of performance points and configurations, delivering DSP capabilities without a separate unit to save on area and cost Simplified development
Brand-new Snapdragon 7-series Mobile Platform Provides Remarkable Performance and Power Efficiency with First-in-tier Features
Highlights: Snapdragon 7 Gen 3 Mobile Platform amplifies experiences, bringing next-generation Snapdragon technology and features to more consumers, globally. Provides exhilarating on-device AI, fan-favorite mobile gaming, a creativity-charged camera, powerful 5G connectivity, and more to the Snapdragon 7-series. Snapdragon 7 Gen 3 will be initially adopted by key OEMs including HONOR and vivo, and the
Low-power consumption processors enable real-time, high-accuracy data analysis at the edge Increases the intelligence and efficiency of industrial automation solutions Rueil-Malmaison, France – November 16, 2023 – Schneider Electric, the leader in the digital transformation of energy management and automation, today announced a technology collaboration with Hailo Technologies, a leading Artificial Intelligence (AI) chipmaker, to
Korean fabless startup unleashes world’s most innovative AI chip technology — ultra-gap source technology DEEPX is honored with three CES Innovation Awards 2024 in its core focus areas: Computer Hardware, Embedded Technology, and Robotics. The brand is a fabless AI chipmaker with world-leading innovation in cutting-edge source technologies — specifically ultra-gap source technology. SEOUL, South Korea
This market research report was originally published at the Yole Group’s website. It is reprinted here with the permission of the Yole Group. Increasing capacity expansion by substrate manufacturers to accommodate the growth of application processors in the AI age. OUTLINE The advanced IC substrate market is expected to grow at an 11% CAGR from
This blog post was originally published at Silo AI’s website. It is reprinted here with the permission of Silo AI. Machine learning in embedded systems is becoming increasingly important. We are seeing it being utilized in a multitude of different application areas including automotive, manufacturing, robotics as well as as well as in advanced consumer
This blog post was originally published at Qualcomm’s website. It is reprinted here with the permission of Qualcomm. While robots have proliferated in recent years in smart cities, factories and homes, we are mostly interacting with robots controlled by classical handcrafted algorithms. These are robots that have a narrow goal and don’t learn from their
AMD Expands Ryzen Embedded Processor Family for High-performance Industrial Automation, Machine Vision and Edge Applications
Ryzen Embedded 7000 Series processors deliver leadership performance and advanced features with a growing partner ecosystem including Advantech, ASRock and DFI NUREMBERG, Germany, Nov. 14, 2023 (GLOBE NEWSWIRE) — AMD (NASDAQ: AMD) today announced at Smart Production Solutions 2023 the AMD Ryzen™ Embedded 7000 Series processor family, optimized for the high-performance requirements of industrial markets.
New AMD Radeon PRO Workstation Graphics Card to Power Next-generation Professional Content Creation, CAD and AI Applications
AMD Radeon™ PRO W7700 graphics card sets standard for professional graphics accelerators at $999, delivering a double-digit performance increase in key professional applications compared to the competition SANTA CLARA, Calif., Nov. 13, 2023 (GLOBE NEWSWIRE) — AMD (NASDAQ:AMD) today announced the AMD Radeon™ PRO W7700, the most powerful professional workstation graphics card under $1,0001, offering an
HGX H200 Systems and Cloud Instances Coming Soon From World’s Top Server Manufacturers and Cloud Service Providers November 13, 2023—SC23—NVIDIA today announced it has supercharged the world’s leading AI computing platform with the introduction of the NVIDIA HGX™ H200. Based on NVIDIA Hopper™ architecture, the platform features the NVIDIA H200 Tensor Core GPU with advanced
This blog post was originally published at Qualcomm’s website. It is reprinted here with the permission of Qualcomm. AI and privacy: How on-device AI enhances privacy and security The rapid adoption of generative artificial intelligence (AI) has opened a new world promising explosive creativity, convenience and productivity. With large language models (LLMs), as well as
This blog post was originally published at Silo AI’s website. It is reprinted here with the permission of Silo AI. Similarly to AI, edge AI should be approached as an umbrella term. Edge AI is not a model but an entire technology stack. Like AI, there’s an incredible amount of different technologies and methods underneath
On January 24, 2024 at 9 am PT (noon ET), Suresh Madhu, Head of Product Marketing, and Arun Asokan, Head of the ISP Division, both of e-Con Systems, will present the free hour webinar “Mastering Image Quality: The Power of Imaging Signal Processors in Embedded Vision,” organized by the Edge AI and Vision Alliance. Here’s
IDS NXT malibu: Camera combines advanced consumer image processing and AI technology from Ambarella and industrial quality from IDS November 8, 2023 – IDS NXT malibu marks a new class of intelligent industrial cameras that act as edge devices and generate AI overlays in live video streams. For the new camera series, IDS Imaging Development