Vision Algorithms for Embedded Vision
Most computer vision algorithms were developed on general-purpose computer systems with software written in a high-level language
Most computer vision algorithms were developed on general-purpose computer systems with software written in a high-level language. Some of the pixel-processing operations (ex: spatial filtering) have changed very little in the decades since they were first implemented on mainframes. With today’s broader embedded vision implementations, existing high-level algorithms may not fit within the system constraints, requiring new innovation to achieve the desired results.
Some of this innovation may involve replacing a general-purpose algorithm with a hardware-optimized equivalent. With such a broad range of processors for embedded vision, algorithm analysis will likely focus on ways to maximize pixel-level processing within system constraints.
This section refers to both general-purpose operations (ex: edge detection) and hardware-optimized versions (ex: parallel adaptive filtering in an FPGA). Many sources exist for general-purpose algorithms. The Embedded Vision Alliance is one of the best industry resources for learning about algorithms that map to specific hardware, since Alliance Members will share this information directly with the vision community.
General-purpose computer vision algorithms
One of the most-popular sources of computer vision algorithms is the OpenCV Library. OpenCV is open-source and currently written in C, with a C++ version under development. For more information, see the Alliance’s interview with OpenCV Foundation President and CEO Gary Bradski, along with other OpenCV-related materials on the Alliance website.
Hardware-optimized computer vision algorithms
Several programmable device vendors have created optimized versions of off-the-shelf computer vision libraries. NVIDIA works closely with the OpenCV community, for example, and has created algorithms that are accelerated by GPGPUs. MathWorks provides MATLAB functions/objects and Simulink blocks for many computer vision algorithms within its Vision System Toolbox, while also allowing vendors to create their own libraries of functions that are optimized for a specific programmable architecture. National Instruments offers its LabView Vision module library. And Xilinx is another example of a vendor with an optimized computer vision library that it provides to customers as Plug and Play IP cores for creating hardware-accelerated vision algorithms in an FPGA.
Other vision libraries
- Matrox Imaging Library (MIL)
- Cognex VisionPro
Free Webinar Explores How to Accelerate TensorFlow Models on Intel Compute Devices Using Only 2 Lines of Code
On August 25, 2022 at 9 am PT (noon ET), Kumar Vishwesh, Technical Product Manager, and Ragesh Hajela, Senior AI Engineer, both of Intel, will present the free hour webinar “Accelerating TensorFlow Models on Intel Compute Devices Using Only 2 Lines of Code,” organized by the Edge AI and Vision Alliance. Here’s the description, from
The Embedded Vision Summit was held on May 16-19, 2022 in Santa Clara, California, as an educational forum for product creators interested in incorporating visual intelligence into electronic systems and software. The presentations delivered at the Summit are listed below. All of the slides from these presentations are included in… May 2022 Embedded Vision Summit
IMG Series4 NNA enables advanced AI-based software to efficiently upscale images and videos London, England – 17th May, 2022 – Imagination Technologies and Visidon Oy partner to power the transition to deep-learning-based super resolution for embedded applications across mobile, DTV and automotive markets. This AI-based technology allows users to upscale low-resolution images and videos up
At Intel Vision 2022, the company showcases how education, finance, manufacturing, medicine, transportation and defense industries are transformed through Intel silicon, software and services. NEWS HIGHLIGHTS Argonne National Laboratories, Blue White Robotics, Bosch, Dell Technologies, Federated Wireless, Lenovo, and Nourish + Bloom Market are among the customers and partners highlighting how Intel technology helps fuel
This technical article was originally published at Axelera AI’s website. It is reprinted here with the permission of Axelera AI. Convolutional Neural Networks (CNN) have been dominant in Computer Vision applications for over a decade. Today, they are being outperformed and replaced by Vision Transformers (ViT) with a higher learning capacity. The fastest ViTs are
SLAMcore Raises $16 Million to Deliver Low-cost, Spatial Understanding to Real-life Robots and the Metaverse
SLAMcore already working with companies including Meta, Synaos and Cyberdyne London – May 3, 2022 – SLAMcore, a pioneer in vision-based location and mapping for robots, autonomous machines and consumer electronics products, has raised $16 million in Series A capital that will allow the business to rapidly capitalize on its proven technology which combines AI
SEATTLE, April 26, 2022 – Sequitur Labs announced today that it has been selected by Lenovo as the technology vendor of choice for protecting edge AI computing applications utilized as part of the Lenovo ThinkEdge™ SE70 platform. ThinkEdge SE70 is a powerful and flexible AI edge platform for the enterprise and designed to meet the
Q&A: AI Researcher Roland Memisevic Discusses the Secret to Dataset Generation, Data-driven AI, and What’s Next in Machine Learning
This blog post was originally published at Qualcomm’s website. It is reprinted here with the permission of Qualcomm. Why a change in mindset about capturing the right data is essential for advances in machine learning Machine learning is rapidly changing how software and algorithms are developed. And data is the lifeblood driving the machine learning
This blog post was originally published at Hailo’s website. It is reprinted here with the permission of Hailo. In this blog post, we present Hailo’s License Plate Recognition (LPR) implementation (also known as Automatic Number Plate Recognition or ANPR). The presented solution can be used in Intelligent Transportation Systems (ITS) and is a good example
This technical article was originally published at Axelera AI’s website. It is reprinted here with the permission of Axelera AI. Convolutional neural networks (CNNs) still dominate today’s computer vision. Recently, however, networks based on transformer blocks have also been applied to typical computer vision tasks such as object classification, detection, and segmentation, attaining state-of-the-art results
This technical article was originally published by SmartCow AI Technologies. It is reprinted here with the permission of SmartCow AI Technologies. On March 22th 2022, NVIDIA announced the availability of its new edge computing platform, the Jetson AGX Orin™ developer kit. The production version is being released on Q4 2022 at roughly the same price
In the fall of 2021, Alliance Member companies Au-Zone Technologies and NXP Semiconductors co-presented the webinar “ML at the Edge: Visual Intelligence with a Low Cost MCU” as an accompaniment to their technical blog post on the topic. If you missed the webinar, you can view the archive recording here. From the event page: Are
This blog post was originally published at NVIDIA’s website. It is reprinted here with the permission of NVIDIA. This post was written to enable the beginner developer community, especially those new to computer vision and computer science. NVIDIA recognizes that solving and benefiting the world’s visual computing challenges through computer vision and artificial intelligence requires
This blog post was originally published at Qualcomm’s website. It is reprinted here with the permission of Qualcomm. AI-based compression has compelling benefits for both video and speech. The world is going digital. With increased demand for multimedia along with the rising trends of AI, IOT, and 5G, a tremendous amount of data is being
This blog post was originally published at Lattice Semiconductor’s website. It is reprinted here with the permission of Lattice Semiconductor. The AI/ML revolution continues to gain traction across multiple applications, particularly Edge applications. Edge devices like security cameras, robots, industrial equipment, Client PCs, and even toys can now support AI/ML capabilities that provide users with
This blog post was originally published at AImotive’s website. It is reprinted here with the permission of AImotive. It has been recognized by many leaders in the automotive industry that vehicles of the future will rely on far more highly integrated, scalable software that can be rapidly and regularly updated throughout the life of the