Vision Algorithms for Embedded Vision

Most computer vision algorithms were developed on general-purpose computer systems with software written in a high-level language

Most computer vision algorithms were developed on general-purpose computer systems with software written in a high-level language. Some of the pixel-processing operations (ex: spatial filtering) have changed very little in the decades since they were first implemented on mainframes. With today’s broader embedded vision implementations, existing high-level algorithms may not fit within the system constraints, requiring new innovation to achieve the desired results.

Some of this innovation may involve replacing a general-purpose algorithm with a hardware-optimized equivalent. With such a broad range of processors for embedded vision, algorithm analysis will likely focus on ways to maximize pixel-level processing within system constraints.

This section refers to both general-purpose operations (ex: edge detection) and hardware-optimized versions (ex: parallel adaptive filtering in an FPGA). Many sources exist for general-purpose algorithms. The Embedded Vision Alliance is one of the best industry resources for learning about algorithms that map to specific hardware, since Alliance Members will share this information directly with the vision community.

General-purpose computer vision algorithms

Introduction To OpenCV Figure 1

One of the most-popular sources of computer vision algorithms is the OpenCV Library. OpenCV is open-source and currently written in C, with a C++ version under development. For more information, see the Alliance’s interview with OpenCV Foundation President and CEO Gary Bradski, along with other OpenCV-related materials on the Alliance website.

Hardware-optimized computer vision algorithms

Several programmable device vendors have created optimized versions of off-the-shelf computer vision libraries. NVIDIA works closely with the OpenCV community, for example, and has created algorithms that are accelerated by GPGPUs. MathWorks provides MATLAB functions/objects and Simulink blocks for many computer vision algorithms within its Vision System Toolbox, while also allowing vendors to create their own libraries of functions that are optimized for a specific programmable architecture. National Instruments offers its LabView Vision module library. And Xilinx is another example of a vendor with an optimized computer vision library that it provides to customers as Plug and Play IP cores for creating hardware-accelerated vision algorithms in an FPGA.

Other vision libraries

  • Halcon
  • Matrox Imaging Library (MIL)
  • Cognex VisionPro
  • VXL
  • CImg
  • Filters

The Future of AI is Hybrid: How On-device AI Leadership, Global Scale and Ecosystem Enablement are Making Hybrid AI a Reality

This blog post was originally published at Qualcomm’s website. It is reprinted here with the permission of Qualcomm. Qualcomm’s AI investments are key to the global adoption of generative AI: Here’s why As our previous post and whitepaper established, the future of artificial intelligence (AI) needs to be hybrid, with AI processing distributed between the

Read More »

Syntiant’s Deep Learning Computer Vision Models Deployed on Renesas RZ/V2L Microprocessor

Technology Collaboration Demonstrations on Display at the Renesas Booth During Embedded Vision Summit 2023 Irvine, Calif., May 19, 2023 – Syntiant Corp., a leader in edge AI deployment, today announced that the company’s commercially available deep learning computer vision (CV) models can now be deployed on the integrated DRP-AI (Dramatically Reconfigurable Processor) core on the

Read More »

Embedded Vision Summit Announces Full Conference Program for Edge AI and Computer Vision Innovators, May 22-24 in Santa Clara, California

The premier event for product creators incorporating computer vision and edge AI in products and applications SANTA CLARA, Calif., April 27, 2023 /PRNewswire/ — The Edge AI and Vision Alliance, a 100+ company worldwide industry partnership, today announced the full program for the 2023 Embedded Vision Summit, May 22-24 at the Santa Clara Convention Center, Santa

Read More »

The Future of AI is Hybrid: How On-device AI is Enabling Generative AI to Scale

This blog post was originally published at Qualcomm’s website. It is reprinted here with the permission of Qualcomm. Providing cost savings as well as performance, personalization, privacy and security benefits As generative artificial intelligence (AI) adoption grows at record-setting speeds1 and computing demands increase2, hybrid processing is more important than ever. But just like traditional

Read More »

CEVA Acquires Spatial Audio Business from VisiSonics

Acquisition of RealSpace® enables CEVA to offer a complete spatial audio solution to OEMs targeting high volume markets including TWS, OTC hearables, gaming headphones, AR/VR, audio conferencing, automotive and media entertainment ROCKVILLE, MD., May 10, 2023 – CEVA, Inc. (NASDAQ: CEVA), the leading licensor of wireless connectivity and smart sensing technologies and custom SoC solutions, today

Read More »

Increasing Throughput and Reducing Costs for AI-based Computer Vision with CV-CUDA

This blog post was originally published at NVIDIA’s website. It is reprinted here with the permission of NVIDIA. Real-time cloud-scale applications that involve AI-based computer vision are growing rapidly. The use cases include image understanding, content creation, content moderation, mapping, recommender systems, and video conferencing. However, the compute cost of these workloads is growing too,

Read More »

New Toolchain and Software Package from STMicroelectronics Ease Development of Edge Processing with Intelligent Inertial Sensors

On display at Sensor+Test 2023 in Nuremberg, Germany, May 9-11 May 3, 2023 – STMicroelectronics has released a toolchain and accompanying software package for programming the intelligent sensor processing unit (ISPU) embedded in the latest-generation intelligent MEMS IMUs, ISM330IS and LSM6DSO16IS. The toolchain and software help employ the ISPU to handle motion-related workloads such as

Read More »

Is Causality the Missing Piece of the AI Puzzle?

This blog post was originally published at Qualcomm’s website. It is reprinted here with the permission of Qualcomm. Qualcomm AI Research explores fundamental research to combine causality with AI At its core, science is all about finding causal relations. For example, it is not enough to know that smoking and cancer are correlated; what is

Read More »

STRADVISION Receives European Automotive Industry’s Top Information Security Management Standard, TISAX AL3

TISAX’s AL3 standard further positions STRADVISION as an excellent partner providing unparalleled reliability in the level of information security The achievement spurs STRADVISION’s focus on global business expansion, including the European market SEOUL, South Korea, May 1, 2023 /PRNewswire/ — STRADVISION, an automotive industry pioneer in deep learning-based vision perception technology, has received the highest assessment

Read More »

Bringing AI Research to Wireless Communication and Sensing

This blog post was originally published at Qualcomm’s website. It is reprinted here with the permission of Qualcomm. Our fundamental AI research is fueling wireless innovation by combining the strengths of machine learning with wireless domain expertise. Artificial Intelligence (AI) for wireless is already here, with applications in areas such as mobility management, sensing and

Read More »

Who’s in the Zoo: A Brief Taxonomy of AI Systems

The ubiquity of AI begs for a good definition. But there is no simple definition—a myriad of different technologies huddle under the AI umbrella. What’s at stake: With all the claims and commentary about AI systems, you can’t tell the insightful from the frightful without a program. That means digging into the different things hiding

Read More »

Here you’ll find a wealth of practical technical insights and expert advice to help you bring AI and visual intelligence into your products without flying blind.



1646 N. California Blvd.,
Suite 360
Walnut Creek, CA 94596 USA

Phone: +1 (925) 954-1411
Scroll to Top