Multimodal

Efficient LLaMA-3.2-Vision by Trimming Cross-attended Visual Features

Algorithms, Blog Posts, Multimodal, Nota AI, Software, Tools /

This blog post was originally published at Nota AI’s website. It is reprinted here with the permission of Nota AI. Our method, Trimmed-Llama, reduces the key-value cache (KV cache) and latency of cross-attention-based Large Vision Language Models (LVLMs) without sacrificing performance. We identify sparsity in LVLM cross-attention maps, showing a consistent layer-wise pattern where most […]

Efficient LLaMA-3.2-Vision by Trimming Cross-attended Visual Features Read More +

Deploying an Efficient Vision-Language Model on Mobile Devices

Algorithms, Blog Posts, Multimodal, Nota AI, Software, Tools /

This blog post was originally published at Nota AI’s website. It is reprinted here with the permission of Nota AI. Recent large language models (LLMs) have demonstrated unprecedented performance in a variety of natural language processing (NLP) tasks. Thanks to their versatile language processing capabilities, it has become possible to develop various NLP applications that

Deploying an Efficient Vision-Language Model on Mobile Devices Read More +

LM Studio Accelerates LLM Performance With NVIDIA GeForce RTX GPUs and CUDA 12.8

Algorithms, Blog Posts, Multimodal, NVIDIA, Processors, Software, Tools /

This blog post was originally published at NVIDIA’s website. It is reprinted here with the permission of NVIDIA. Latest release of the desktop application brings enhanced dev tools and model controls, as well as better performance for RTX GPUs. As AI use cases continue to expand — from document summarization to custom software agents —

LM Studio Accelerates LLM Performance With NVIDIA GeForce RTX GPUs and CUDA 12.8 Read More +

Advancing Generative AI at the Edge During CES 2025

Algorithms, Ambarella, Automotive, Blog Posts, Multimodal, Processors, Software, Tools /

This blog post was originally published at Ambarella’s website. It is reprinted here with the permission of Ambarella. For this year’s CES, our theme was Your GenAI Edge—highlighting how Ambarella’s AI SoCs continue to redefine what’s possible with generative AI at the edge. Building on last year’s edge GenAI demos, we debuted a new 25-stream,

Advancing Generative AI at the Edge During CES 2025 Read More +

Optimizing Transformer-based Diffusion Models for Video Generation with NVIDIA TensorRT

Algorithms, Articles, Multimodal, NVIDIA, Processors, Software, Tools /

This article was originally published at NVIDIA’s website. It is reprinted here with the permission of NVIDIA. State-of-the-art image diffusion models take tens of seconds to process a single image. This makes video diffusion even more challenging, requiring significant computational resources and high costs. By leveraging the latest FP8 quantization features on NVIDIA Hopper GPUs

Optimizing Transformer-based Diffusion Models for Video Generation with NVIDIA TensorRT Read More +

R²D²: Adapting Dexterous Robots with NVIDIA Research Workflows and Models

Algorithms, Blog Posts, Multimodal, NVIDIA, Processors, Robotics, Sensors and Cameras, Software, Tools /

This blog post was originally published at NVIDIA’s website. It is reprinted here with the permission of NVIDIA. Robotic arms are used today for assembly, packaging, inspection, and many more applications. However, they are still preprogrammed to perform specific and often repetitive tasks. To meet the increasing need for adaptability in most environments, perceptive arms

R²D²: Adapting Dexterous Robots with NVIDIA Research Workflows and Models Read More +

Using AI to Better Understand the Ocean

Algorithms, Blog Posts, Multimodal, NVIDIA, Object Identification, Object Tracking, Processors, Robotics, Sensors and Cameras, Software, Tools /

This blog post was originally published at NVIDIA’s website. It is reprinted here with the permission of NVIDIA. Humans know more about deep space than we know about Earth’s deepest oceans. But scientists have plans to change that—with the help of AI. “We have better maps of Mars than we do of our own exclusive

Using AI to Better Understand the Ocean Read More +

Rockets to Retail: Intel Core Ultra Delivers Edge AI for Video Management

Algorithms, Blog Posts, Intel, Multimodal, Network Optix, News, Processors, Software, Tools /

At Intel Vision, Network Optix debuts natural language prompt prototype to redefine video management, offering industries faster AI-driven insights and efficiency. On the surface, aerospace manufacturers, shopping malls, universities, police departments and automakers might not have a lot in common. But they each collectively use and manage hundreds to thousands of video cameras across their

Rockets to Retail: Intel Core Ultra Delivers Edge AI for Video Management Read More +

R²D²: Advancing Robot Mobility and Whole-body Control with Novel Workflows and AI Foundation Models from NVIDIA Research

Algorithms, Blog Posts, Multimodal, NVIDIA, Processors, Robotics, Sensors and Cameras, Software, Tools /

This blog post was originally published at NVIDIA’s website. It is reprinted here with the permission of NVIDIA. Welcome to the first edition of the NVIDIA Robotics Research and Development Digest (R2D2). This technical blog series will give developers and researchers deeper insight and access to the latest physical AI and robotics research breakthroughs across

R²D²: Advancing Robot Mobility and Whole-body Control with Novel Workflows and AI Foundation Models from NVIDIA Research Read More +

Ambarella Debuts Next-generation Edge GenAI Technology at ISC West, Including Reasoning Models Running on its CVflow Edge AI SoCs

Ambarella, Multimodal, News, Processors, Tools /

With Over 30 Million Edge AI Systems-on-Chip Shipped, Ambarella is Driving Innovation for a Broad Range of On-Device and On-Premise Generative AI Applications SANTA CLARA, Calif., March 31, 2025 — Ambarella, Inc. (NASDAQ: AMBA), an edge AI semiconductor company, today announced during the ISC West security expo that it is continuing to push the envelope

Ambarella Debuts Next-generation Edge GenAI Technology at ISC West, Including Reasoning Models Running on its CVflow Edge AI SoCs Read More +

Here you’ll find a wealth of practical technical insights and expert advice to help you bring AI and visual intelligence into your products without flying blind.

Pages

Topics

Contact

Address

Berkeley Design Technology, Inc.
PO Box #4446
Walnut Creek, CA 94596

Phone
Phone: +1 (925) 954-1411
Scroll to Top