Val Marchevsky, Senior Director of Engineering at Motorola, presents the "Designing and Implementing Camera ISP Algorithms Using Deep Learning and Computer Vision" tutorial at the May 2017 Embedded Vision Summit.
Once we began to rely on our phone cameras as the primary means of sharing memories, emotions and important events in our lives, the quality of images became critical to a positive user experience. Tuning the mobile camera became a kind of black art, which grew in complexity with each advance in camera components such as sensors, lenses, voice coil motors and image signal processors. This many-dimensional optimization problem is further complicated by constraints imposed on mobile cameras due to the small size of the phone. Together, this complexity and these constraints create a rather complicated problem that needs to be solved faster and faster with each successive product cycle.
Motorola/Lenovo looks at this situation as an opportunity to apply its engineering skills to achieve great image quality faster. In this talk, Marchevsky explores intelligent tuning of some image signal processing components, such as auto white balance, using deep learning. He also discusses applying computer vision for image enhancement technologies such as high dynamic range imaging.