Vision Algorithms for Embedded Vision
Most computer vision algorithms were developed on general-purpose computer systems with software written in a high-level language
Most computer vision algorithms were developed on general-purpose computer systems with software written in a high-level language. Some of the pixel-processing operations (ex: spatial filtering) have changed very little in the decades since they were first implemented on mainframes. With today’s broader embedded vision implementations, existing high-level algorithms may not fit within the system constraints, requiring new innovation to achieve the desired results.
Some of this innovation may involve replacing a general-purpose algorithm with a hardware-optimized equivalent. With such a broad range of processors for embedded vision, algorithm analysis will likely focus on ways to maximize pixel-level processing within system constraints.
This section refers to both general-purpose operations (ex: edge detection) and hardware-optimized versions (ex: parallel adaptive filtering in an FPGA). Many sources exist for general-purpose algorithms. The Embedded Vision Alliance is one of the best industry resources for learning about algorithms that map to specific hardware, since Alliance Members will share this information directly with the vision community.
General-purpose computer vision algorithms
One of the most-popular sources of computer vision algorithms is the OpenCV Library. OpenCV is open-source and currently written in C, with a C++ version under development. For more information, see the Alliance’s interview with OpenCV Foundation President and CEO Gary Bradski, along with other OpenCV-related materials on the Alliance website.
Hardware-optimized computer vision algorithms
Several programmable device vendors have created optimized versions of off-the-shelf computer vision libraries. NVIDIA works closely with the OpenCV community, for example, and has created algorithms that are accelerated by GPGPUs. MathWorks provides MATLAB functions/objects and Simulink blocks for many computer vision algorithms within its Vision System Toolbox, while also allowing vendors to create their own libraries of functions that are optimized for a specific programmable architecture. National Instruments offers its LabView Vision module library. And Xilinx is another example of a vendor with an optimized computer vision library that it provides to customers as Plug and Play IP cores for creating hardware-accelerated vision algorithms in an FPGA.
Other vision libraries
- Matrox Imaging Library (MIL)
- Cognex VisionPro
This blog post was originally published at Intel’s website. It is reprinted here with the permission of Intel. If it wasn’t clear before, I think it’s unquestionable now: global online video demand is insatiable. The latest Cisco Annual Internet Report calls out just how big of an impact high-definition video is having on the market.
This blog post was originally published at NVIDIA’s website. It is reprinted here with the permission of NVIDIA. NVIDIA CUDA-X AI are deep learning libraries for researchers and software developers to build high performance GPU-accelerated applications for conversational AI, recommendation systems and computer vision. Learn what’s new in the latest releases of CUDA-X AI libraries.
Jeff Bier, Founder of the Edge AI and Vision Alliance, interviews Zhenbin Xu, CEO of Family Smart and Corporate Vice President at Seedland Group, about a new outdoor security product, Sentinel, which analyzes sound data using AI algorithms and can be integrated with surveillance cameras.
What’s New: Intel today announced the winners of the Great Cross-Architecture Challenge, a collaboration with the European Organization for Nuclear Research (CERN) and Argonne National Laboratory, and run by CodeProject. The challenge attracted participants across five continents, demonstrating the growing momentum of oneAPI’s open, cross-architecture, multi-vendor programming approach. Entrants used oneAPI and Data Parallel C++ (DPC++) to
This blog post was originally published at ClearML’s website in partnership with Forsight.ai. It is reprinted here with the permission of ClearML and Forsight.ai. Tensorflow Object Detection API (TF OD API) just got even better. Recently, Google released the new version of TF OD API which now supports Tensorflow 2.x. This is a huge improvement
CEVA Unveils MotionEngine Scout, a Highly-Accurate Dead Reckoning Software Solution for Indoor Autonomous Robots
Robust and precise dead reckoning software offers cost-reduced alternative to expensive camera or LIDAR based systems for indoor robot navigation by fusing sensor data from optical sensors, IMU sensors and wheel encoders Rockville, MD, March 24, 2021 – CEVA, Inc. (NASDAQ: CEVA), the leading licensor of wireless connectivity and smart sensing technologies, today unveiled the
This blog post was originally published at Intel’s website. It is reprinted here with the permission of Intel. Throughout season two of the Intel on AI podcast, many of the world’s most prominent artificial intelligence (AI) experts have talked about why they believe machines can’t simply improve performance on large data sets in order for
What’s New: Sankara Eye Foundation and Singapore-based Leben Care are deploying a comprehensive retina risk assessment software-as-a-service platform in India. Netra.AI, the cloud-based artificial intelligence (AI) solution, is powered by Intel® technology and uses deep learning to identify retinal conditions in a short span of time with the accuracy level of human doctors. Netra.AI can accurately identify diabetic retinopathy
This blog post was originally published at NVIDIA’s website. It is reprinted here with the permission of NVIDIA. Why signal processing? Signal processing is all around us. Broadly defined as the manipulation of signals — or mechanisms of transmitting information from one place to another — the field of signal processing exploits embedded information to
This blog post was originally published at Qualcomm’s website. It is reprinted here with the permission of Qualcomm. As machine learning (ML) has grown, many open source frameworks have come along, effectively democratizing what was once reserved for artificial intelligence (AI) researchers. Of these frameworks, TensorFlow has become the most popular for building and running
On March 24, 2021 at 9 am PT (noon ET), the Edge AI and Vision Alliance’s Founder, Jeff Bier, will present the free hour webinar “Deep Learning for Embedded Computer Vision: An Introduction,” in partnership with Vision Systems Design. Here’s the description, from the event registration page: Deep learning for embedded computer vision has made
What’s New: EXOS, a leader in the field of advancing human performance, is piloting Intel’s 3D Athlete Tracking (3DAT) technology in training aspiring professional athletes to reach their peak performance. As pro days loom, these athletes seek to take their game to the next level with 3DAT by leveraging artificial intelligence (AI) to gain actionable insights
This blog post was originally published at Ambarella’s website. It is reprinted here with the permission of Ambarella. Autonomy starts with how the vehicle perceives a three-dimensional world. An essential task in autonomous driving is environmental perception—interpreting an ever-changing, three-dimensional world on the fly. Which methods will the vehicle use to understand and respond to
Smart City connected by IoT (Image by Tumisu from Pixabay) This blog post was originally published at Xailient’s website. It is reprinted here with the permission of Xailient. Whether you’re new to computer vision or an expert, you’ve probably heard about AlexNet winning the ImageNet challenge in 2012. That was the turning point in computer
“Practical Guide to Implementing Deep Neural Network Inferencing at the Edge,” a Presentation from Zebra Technologies
Toly Kotlarsky, Distinguished Member of the Technical Staff in R&D at Zebra Technologies, presents the “Practical Guide to Implementing Deep Neural Network Inferencing at the Edge” tutorial at the September 2020 Embedded Vision Summit. In this presentation, Kotlarsky explores practical aspects of implementing a pre-trained deep neural network (DNN) inference… “Practical Guide to Implementing Deep
How an Automotive Tier 1 Supplier Used Atlas to Improve Computer Vision Accuracy By Up to 48% mAP Within Days This blog post was originally published at Algolux’s website. It is reprinted here with the permission of Algolux. Computer vision is a fundamental technology in automotive Advanced Driver Assistance Systems (ADAS) for pedestrian, vehicle, or