Source-linked AI summary
OpenVSLAM: A Versatile Visual SLAM Framework
Shinya Sumikura, Mikiya Shibuya, Ken Sakurada
TL;DR
Open-source visual SLAM frameworks have not been appropriately designed as libraries for third-party programs, despite their importance in robotics and AR. OpenVSLAM addresses this gap with modular APIs, documentation, broad camera-model support, and practical map functions. The framework is evaluated quantitatively and experimentally across standard and non-perspective camera settings.
Problem
Conventional open-source visual SLAM frameworks are not appropriately designed as libraries called from third-party programs, limiting their usability and extensibility.
Source: §1 · p. 1Method
OpenVSLAM encapsulates well-known SLAM approaches in separated components with clear APIs, documentation, multiple camera models, and map-storage and prebuilt-map localization functions.
Source: §1 · pp. 1–2, §2.2 · p. 2, §3.1 · p. 3Results
OpenVSLAM supports perspective, fisheye, and equirectangular cameras, achieves tracking accuracy comparable to ORB–SLAM on EuRoC MAV, and consumes less tracking time in the reported comparison.
Source: §1 · p. 2, §4.1 · p. 3Takeaways & Limitations
OpenVSLAM provides a visual SLAM framework designed for easier use and extension across application scenarios and research and development.
Source: §6 · p. 5
Abstract
from arXiv · showhide
In this paper, we introduce OpenVSLAM, a visual SLAM framework with high usability and extensibility. Visual SLAM systems are essential for AR devices, autonomous control of robots and drones, etc. However, conventional open-source visual SLAM frameworks are not appropriately designed as libraries called from third-party programs. To overcome this situation, we have developed a novel visual SLAM framework. This software is designed to be easily used and extended. It incorporates several useful features and functions for research and development.
1 INTRODUCTION
OpenVSLAM addresses the usability and extensibility limitations of conventional open-source visual SLAM frameworks by packaging established approaches into documented, modular components. It supports multiple camera models and practical map-management functions for research and applications.
- Its framework is intended to let researchers and engineers use and extend visual SLAM more easily than conventional open-source systems designed primarily as standalone programs.Source: §1 · p. 1
- OpenVSLAM packages well-known SLAM approaches into separated components with clear APIs and extensive documentation, including sample code snippets.Source: §1 · p. 1
- OpenVSLAM stores and loads map databases and localizes new images using prebuilt maps.Source: §1 · pp. 1–2
- The framework supports perspective, fisheye, and equirectangular cameras, with nearly the same implementation for perspective and fisheye models.Equirectangular input enables tracking and mapping independent of camera direction.Source: §1 · p. 2
- The project is provided as a community framework so researchers can jointly contribute to its development.Source: §1 · p. 2
2 RELATED WORK
Related work spans batch SfM and real-time visual SLAM, including indirect feature-based and direct brightness-based methods. OpenVSLAM targets usability, extensibility, and broader camera-model compatibility, including map database I/O.
- SfM typically reconstructs 3D scenes from an image set prepared in advance using batch processing, whereas visual SLAM processes sequential images in real time.Source: §2.1 · p. 2
- Open-source visual SLAM frameworks mostly handle perspective imagery, motivating OpenVSLAM’s compatibility with various camera models.Source: §2.1 · p. 2
- OpenVSLAM is presented as a novel framework designed to improve usability and extensibility for 3D mapping and localization.Source: §2.1 · p. 2
- Indirect SLAM uses local feature matching, while direct SLAM exploits image brightness information without explicitly extracting keypoints.The passage states that direct methods can operate correctly in more texture-less environments but also notes additional drawbacks.Source: §2.2 · p. 2
- Most visual SLAM frameworks cannot store and load map databases, although prebuilt-map localization is important for practical applications.OpenVSLAM implements map-database input and output functions in response to this gap.Source: §2.2 · p. 2
3 IMPLEMENTATION
OpenVSLAM uses a modular, API-oriented design built around established graph-based indirect SLAM components, with support for multiple camera models and reusable maps.
Module Structure
- The framework uses graph-based indirect SLAM with ORB feature extraction, while its module structure is designed for customizability.Source: §3.1 · p. 3
- OpenVSLAM separates tracking, mapping, and global optimization into modules, with tracking estimating poses and selecting keyframes for downstream processing.The mapping module triangulates new 3D points from inserted keyframes.Source: §3.1 · p. 3
Camera Models
- OpenVSLAM accepts perspective, fisheye, and equirectangular cameras, including monocular, stereo, and RGBD setups for perspective and fisheye models.Source: §3.2 · p. 3
- Users can add camera models such as dual fisheye and catadioptric by implementing classes derived from camera::base.Source: §3.2 · p. 3
- Equirectangular support provides omnidirectional imagery compatibility, which the paper identifies as novel among open-source visual SLAM frameworks.Source: §3.2 · p. 3
Map I/O and Localization
- OpenVSLAM stores and loads maps, supports localization against prebuilt maps, and saves map databases in MessagePack for third-party reuse.Source: §3.3 · p. 3
4 QUANTITATIVE EVALUATION
OpenVSLAM is evaluated against ORB–SLAM2 on trajectory accuracy and tracking time using EuRoC MAV and KITTI Odometry benchmarks, with comparable accuracy and lower tracking time reported.
Evaluation Setup
EuRoC MAV
- OpenVSLAM has comparable tracking accuracy to ORB–SLAM on 11 EuRoC MAV monocular sequences and is more accurate on dark MH_04 and MH_05 scenes.The paper attributes the dark-scene result mainly to robust matching in frame tracking.Source: §4.1 · p. 3
- OpenVSLAM consumes less tracking time than ORB–SLAM on EuRoC MAV MH_02, including later sequence parts.The paper attributes this to optimized ORB extraction and preventing unnecessary local-map enlargement during global-map expansion.Source: §4.1 · pp. 3–4
KITTI Odometry
- OpenVSLAM has comparable tracking accuracy to ORB–SLAM on 11 KITTI Odometry stereo sequences.Source: §4.2 · p. 4, Figure 3 · p. 4
- OpenVSLAM consumes less tracking time than ORB–SLAM on KITTI sequence 05, with a larger difference attributed to larger images and more optimized stereo matching.Source: §4.2 · p. 4, Figure 4 · p. 4
5 QUALITATIVE RESULTS
Qualitative experiments demonstrate successful fisheye and equirectangular visual SLAM indoors and outdoors, including mapping and tracking in challenging visual conditions.
Fisheye Camera
- Outdoor fisheye mapping uses about 6400 frames and preserves elevation differences in the 3D map’s side view.Camera pose tracking also succeeded in high dynamic range scenes.Source: §5.1 · p. 4, Figure 7 · p. 5
- Indoor fisheye mapping uses about 6700 frames, reconstructs the room clearly, and tracks successfully in areas with less common views.Source: §5.1 · p. 4
- The fisheye experiments conclude that visual SLAM is correctly performed both outdoors and indoors.Source: §5.1 · p. 4
Equirectangular Camera
- Outdoor equirectangular mapping uses 15,000 frames at 10.0 FPS, with camera tracking, loop-closing, and global optimization working on a large-scale sequence.Source: §5.2 · p. 4
- Indoor equirectangular mapping uses 1,430 frames at 10.0 FPS and tracks camera poses in texture-less areas through omnidirectional observation.Source: §5.2 · p. 4
- The equirectangular experiments conclude that visual SLAM is correctly performed both outdoors and indoors.Source: §5.2 · p. 4
6 CONCLUSION
OpenVSLAM is presented as a usable and extensible visual SLAM framework for varied application scenarios, with quantitative benchmark evaluation and qualitative camera-model experiments.
Conclusion
- OpenVSLAM is designed for usability and extensibility across visual SLAM application scenarios and includes functions useful for research and development.The paper reports benchmark-based quantitative evaluation and experiments with fisheye and equirectangular camera models.Source: §6 · p. 5