Nota AI Demonstration of LLM Acceleration on Mobilint NPU, Optimized with NetsPresso®

Thibault Castells, Research Engineer at Nota AI, demonstrates the company’s latest edge AI technologies at the 2026 Embedded Vision Summit. Specifically, he demonstrates Qwen3-4B running as a real-time LLM Coding Assistant entirely on Mobilint MLA100 NPU, optimized with NetsPresso®. Achieving 179–478ms Time to First Token and 8.5–10.8 tokens per second, the demo proves that high-performance LLM deployment is fully possible on-device. This showcases how NetsPresso® enables practical, scalable LLM acceleration at the edge without cloud dependency.

To learn more about NetsPresso®, visit: https://www.nota.ai/netspresso

 

Here you’ll find a wealth of practical technical insights and expert advice to help you bring AI and visual intelligence into your products without flying blind.

Contact

Address

Berkeley Design Technology, Inc.
PO Box #4446
Walnut Creek, CA 94596

Phone
Phone: +1 (925) 954-1411
Scroll to Top