Andrew Richards, Co-founder and CEO of Codeplay Software, presents the “Deploying AI Software to Embedded Devices Using Open Standards” tutorial at the September 2020 Embedded Vision Summit.
AI software developers need to deploy diverse classes of algorithms in embedded devices, including deep learning, machine vision and sensor fusion. Adapting these algorithms to run efficiently on embedded devices typically involves using accelerator processors, such as GPUs or neural network accelerators. Quickly deploying high-performance AI algorithms to different processors requires open standards.
There are a variety of open standards available to help: SYCL, OpenCL, SPIR-V, OpenMP, OpenVX and ONNX. This talk presents proven workflows that combine these standards to enable AI software developed on a PC to run efficiently on a variety of embedded devices using accelerated programming models.
See here for a PDF of the slides.