STMicroelectronics continues to revolutionize the world of imaging and edge-AI technologies with its innovative ST BrightSense Imaging solutions, ST Flightsense Time-of-Flight technologies and its new Arm® Cortex®-M55-based MCU. Leveraging cutting-edge advancements in CMOS image sensors, in mini-LiDAR with flood illumination and in the ST Neural-ART Accelerator, STMicroelectronics offers demos that highlight the capabilities of their latest products in real-time object detection, multi-pose detection, and depth mapping.
Don’t miss the chance to see these demos live at the Embedded Vision Summit from May 21st to May 22nd!
Real-Time Object Detection & Tracking
The Real-Time Object Detection & Tracking demo highlights the power of STMicroelectronics’ VD66GY 1.5 MP image sensor, combined with the STM32N6 microcontroller. This solution, developed with SIANA and e2IP technologies, can identify and track objects accurately and efficiently. It is perfect for:
- Surveillance: Improving security systems by accurately identifying and tracking people or objects.
- Inventory Management: Making warehouse operations more efficient by tracking items.
- Automated Systems: Enhancing automation in manufacturing and logistics with precise object detection.
Real-Time Multi-Pose Detection
The Real-Time Multi-Pose Detection demo showcases the VD55G1 0.6 MP image sensor, paired with the STM32N6 microcontroller. This system, also developed with SIANA and e2IP, can detect and analyze multiple human poses in real-time. It is ideal for:
- Gesture Control: Allowing intuitive control of devices through hand and body gestures.
- Interactive Gaming: Creating immersive gaming experiences by recognizing player movements and poses.
- Fitness Tracking: Monitoring exercise routines and providing feedback to improve performance.
Real-Time Depth Mapping
The Real-Time Depth Mapping demo features the VL53L9CX all-in-one dToF 3D mini-LiDAR module, combined with the STM32N6 microcontroller. This demo, developed with SIANA and e2IP, offers precise depth mapping capabilities, making it suitable for:
- Robotics: Enhancing robot navigation and obstacle detection.
- AR/VR: Improving spatial awareness in augmented and virtual reality applications.
- Autonomous Vehicles: Providing reliable depth perception for safe navigation.
Imaging and Beyond
With ST BrightSense you develop superior camera-based systems at low power. Relying on proprietary innovations, the ST BrightSense portfolio leverages cutting-edge pixel technologies to offer a tiny form factor and ultra-low power consumption. Combining global shutter, 3D stacking, backside illumination (BSI), and capacitive deep trench isolation (CDTI) technologies, ST BrightSense camera sensors provide superior image quality for smart, accurate and reactive camera-based systems. Their rich set of on-chip features allows faster and more efficient processing to support the next generation of smart devices.
For more information on STMicroelectronics’ ST BrightSense Imaging solutions visit ST BrightSense – STMicroelectronics
GPM and Beyond
The STM32N6 is based on the Arm® Cortex®-M55 running at 800 MHz, the first CPU to introduce Arm Helium vector processing technology, bringing DSP processing capability to a standard CPU.
The STM32N6 is the first STM32 MCU to embed the ST Neural-ART accelerator™, an in-house developed neural processing unit (NPU) engineered for power-efficient edge AI applications. Clocked at 1 GHz and providing up to 600 GOPS, it enables real-time neural network inference for computer vision and audio applications.
A dedicated computer vision pipeline with a MIPI CSI-2 interface and image signal processing (ISP) ensures compatibility with a wide range of cameras. The STM32N6 also features an H264 hardware encoder and the NeoChrom™ Accelerator for graphics, making it suitable for feature-rich products.
The STM32N6, like all STM32, is fully supported by the ST Edge AI Suite. The ST Edge AI Suite is an integrated collection of software tools, designed to facilitate the development and deployment of embedded AI applications. This comprehensive suite supports both optimization and deployment of machine-learning algorithms, starting from data collection to final deployment on hardware, streamlining the workflow for different types of users.
By combining ST Brightsense image sensors and ST Flightsense mini-LiDAR with the powerful STM32 microcontrollers, STMicroelectronics provides strong and flexible solutions for the future of imaging and edge-AI technologies. Whether it’s improving security, enhancing automation, or creating immersive experiences, STMicroelectronics solutions lead the way in innovation.
