Development Tools for Embedded Vision
ENCOMPASSING MOST OF THE STANDARD ARSENAL USED FOR DEVELOPING REAL-TIME EMBEDDED PROCESSOR SYSTEMS
The software tools (compilers, debuggers, operating systems, libraries, etc.) encompass most of the standard arsenal used for developing real-time embedded processor systems, while adding in specialized vision libraries and possibly vendor-specific development tools for software development. On the hardware side, the requirements will depend on the application space, since the designer may need equipment for monitoring and testing real-time video data. Most of these hardware development tools are already used for other types of video system design.
Both general-purpose and vender-specific tools
Many vendors of vision devices use integrated CPUs that are based on the same instruction set (ARM, x86, etc), allowing a common set of development tools for software development. However, even though the base instruction set is the same, each CPU vendor integrates a different set of peripherals that have unique software interface requirements. In addition, most vendors accelerate the CPU with specialized computing devices (GPUs, DSPs, FPGAs, etc.) This extended CPU programming model requires a customized version of standard development tools. Most CPU vendors develop their own optimized software tool chain, while also working with 3rd-party software tool suppliers to make sure that the CPU components are broadly supported.
Heterogeneous software development in an integrated development environment
Since vision applications often require a mix of processing architectures, the development tools become more complicated and must handle multiple instruction sets and additional system debugging challenges. Most vendors provide a suite of tools that integrate development tasks into a single interface for the developer, simplifying software development and testing.
“Introduction to Optimizing ML Models for the Edge,” a Presentation from Cisco Systems
Kumaran Ponnambalam, Principal Engineer of AI, Emerging Tech and Incubation at Cisco Systems, presents the “Introduction to Optimizing ML Models for the Edge” tutorial at the May 2023 Embedded Vision Summit. Edge computing opens up a new world of use cases for deep learning across numerous markets, including manufacturing, transportation,… “Introduction to Optimizing ML Models
“Efficient Neuromorphic Computing with Dynamic Vision Sensor, Spiking Neural Network Accelerator and Hardware-aware Algorithms,” a Presentation from Arizona State University
Jae-sun Seo, Associate Professor at Arizona State University, presents the “Efficient Neuromorphic Computing with Dynamic Vision Sensor, Spiking Neural Network Accelerator and Hardware-aware Algorithms” tutorial at the May 2023 Embedded Vision Summit. Spiking neural networks (SNNs) mimic biological nervous systems. Using event-driven computation and communication, SNNs achieve very low power… “Efficient Neuromorphic Computing with Dynamic
“Item Recognition in Retail,” a Presentation from 7-Eleven
Sumedh Datar, Senior Machine Learning Engineer at 7-Eleven, presents the “Item Recognition in Retail” tutorial at the May 2023 Embedded Vision Summit. Computer vision has vast potential in the retail space. 7-Eleven is working on fast frictionless checkout applications to better serve customers. These solutions range from faster checkout systems… “Item Recognition in Retail,” a
“Lessons Learned in Developing a High-volume, Vision-enabled Coffee Maker,” an Interview with Keurig Dr Pepper
Jason Lavene, Director of Advanced Development Engineering at Keurig Dr Pepper, talks with Jeff Bier, Founder of the Edge AI and Vision Alliance, for the “Lessons Learned in Developing a High-volume, Vision-enabled Coffee Maker” interview at the May 2023 Embedded Vision Summit. Why did Keurig Dr Pepper—a $12B beverage company—spend… “Lessons Learned in Developing a
“Embedded Vision in Robotics, Biotech and Education,” an Interview with Dean Kamen
Dean Kamen, Founder of DEKA Research and Development, talks with Jeff Bier, Founder of the Edge AI and Vision Alliance, for the “Embedded Vision in Robotics, Biotech and Education” interview at the May 2023 Embedded Vision Summit. In his 2018 keynote presentation at the Embedded Vision Summit, legendary inventor and… “Embedded Vision in Robotics, Biotech
May 2023 Embedded Vision Summit Opening Remarks (May 24)
Jeff Bier, Founder of the Edge AI and Vision Alliance, welcomes attendees to the May 2023 Embedded Vision Summit on May 24, 2023. Bier provides an overview of the edge AI and vision market opportunities, challenges, solutions and trends. He also introduces the Edge AI and Vision Alliance and the… May 2023 Embedded Vision Summit
May 2023 Embedded Vision Summit Opening Remarks (May 23)
Jeff Bier, Founder of the Edge AI and Vision Alliance, welcomes attendees to the May 2023 Embedded Vision Summit on May 23, 2023. Bier provides an overview of the edge AI and vision market opportunities, challenges, solutions and trends. He also introduces the Edge AI and Vision Alliance and the… May 2023 Embedded Vision Summit
Visual ChatGPT Explained
This blog post was originally published at SOYNET’s website. It is reprinted here with the permission of SOYNET. A Multi-Modal Conversational Model for Image Understanding and Generation Visual ChatGPT allows users to perform complex visual tasks using text and visual inputs. With the rapid advancements in AI, there is a growing need for models that
