Out-of-the-box AMR solution
Orbbec, a 3D camera provider, announced the Orbbec Perceptor Developer Kit (OPDK), an out-of-the-box autonomous mobile robot (AMR) solution preloaded with NVIDIA Isaac Perceptor.
The OPDK is designed for AMR developers who seek a powerful, hardware-software integrated kit to develop AI applications for dynamic and unstructured environments in warehouses and factories.
The Orbbec Gemini 335L cameras, integrated with NVIDIA Jetson AGX Orin system-on-modules, combine active and passive stereo vision technologies for seamless operations in both indoor and outdoor conditions. The Gemini 335L cameras offer in-camera depth processing powered by Orbbec’s MX6800 ASIC, and a precise multi-camera sync system.
The NVIDIA Jetson AGX Orin offers up to 275 trillion operations per second (TOPS) of performance, pre-trained AI models, reference AI workflows, and vertical application frameworks in robotics, vision AI and sensor fusion.
The Gemini 335L’s in-camera depth processing frees up GPU, CPU and NPU resources on the Jetson AGX Orin to run visual simultaneous localization and mapping (SLAM) and odometry for improved mapping in rapidly changing environments. This efficient system now increases resources for AI applications for dynamic object detection and pose estimation.
The out-of-the-box OPDK system solution for AMR features:
- Preloaded with NVIDIA Isaac Perceptor for robot development and control. Optimized for AMR development, enabling rapid prototyping and deployment.
- 360-degree visual SLAM with four RGB-D cameras, with in-camera depth processing and capable of indoor and outdoor operations.
- Option to use visual odometry from cuVSLAM or wheel odometry from robots.
AMR developers can leverage CUDA-accelerated libraries and AI models, streamlining the development process and accelerating time to market.
The OPDK system components include:
- Four Orbbec Gemini 335L RGB-D Cameras: Depth resolution up to 1280x800 at 30 FPS, offering high-precision depth data with a wide field of view (4*90° horizontal, 65° vertical) and USB connectivity, and IP65 rating for dust and water protection.
- Multi-Camera Synchronization: Orbbec Sync Hub enables precise camera synchronization, enabling seamless multi-angle data collection with minimal interference.
- NVIDIA Jetson AGX Orin (64GB) Developer Kit: AI-powered compute engine with up to 275 TOPS of AI performance, support from the NVIDIA JetPack software development kit, NVIDIA Isaac ROS, AI models, and tools that make it ideal for complex robotics tasks such as vision processing from multi-camera data streams, AI model inference, visual SLAM and 3D scene reconstruction.
“The Orbbec Perceptor Dev Kit gives developers a truly out-of-the-box experience with a feature-rich, comprehensive system to begin AI application development immediately,” said Amit Banerjee, head of partnerships at Orbbec. “This collaboration with NVIDIA enables us to provide compelling advantages to AMR developers to navigate the complexities of 3D sensing and computer vision algorithms with OPDK.”
Orbbec also announcedthe Gemini 335Lg Stereo Vision 3D Camera, the latest addition to the Gemini 330 Series. With GMSL2 and secure FAKRA connection, the Gemini 335Lg achieves stable and smooth data transmission over longer distances and overcomes challenges from vibrations caused by movement over uneven terrain or electromagnetic interference. A version of the OPDK with GMSL cameras will be available soon.