Carole-Jean Wu, Research Scientist at Facebook AI Research and an Associate Professor at Arizona State University, presents the “MLPerf: An Industry Standard Performance Benchmark Suite for Machine Learning” tutorial at the September 2020 Embedded Vision Summit.
The rapid growth in the use of DNNs has spurred the development of numerous specialized processor architectures and software frameworks. System and application developers need reliable performance metrics to help them select processors and frameworks. Processor and framework developers need reliable performance metrics so that they can improve their products.
This talk presents MLPerf, an industry-standard performance benchmark suite, and the design philosophies behind the benchmark suite and associated benchmarking methodologies.
See here for a PDF of the slides.