Dense Continuous-Time Tracking and Mapping with Rolling Shutter RGB-D Cameras
Title | Dense Continuous-Time Tracking and Mapping with Rolling Shutter RGB-D Cameras |
Publication Type | Conference Paper |
Year of Publication | 2015 |
Authors | Kerl, C., Stückler, J., Cremers, D. |
Conference Name | 2015 IEEE International Conference on Computer Vision (ICCV) |
Date Published | dec |
Keywords | B-spline, camera trajectory representation, Cameras, continuous trajectory representation, dense continuous-time tracking, estimation theory, image alignment, Image reconstruction, image representation, optimisation, pose estimation, pubcrawl170110, rolling shutter RGB-D camera, simultaneous localization and mapping, SLAM, SLAM (robots), splines (mathematics), Three-dimensional displays, Trajectory, trajectory estimation, trajectory optimization |
Abstract | We propose a dense continuous-time tracking and mapping method for RGB-D cameras. We parametrize the camera trajectory using continuous B-splines and optimize the trajectory through dense, direct image alignment. Our method also directly models rolling shutter in both RGB and depth images within the optimization, which improves tracking and reconstruction quality for low-cost CMOS sensors. Using a continuous trajectory representation has a number of advantages over a discrete-time representation (e.g. camera poses at the frame interval). With splines, less variables need to be optimized than with a discrete representation, since the trajectory can be represented with fewer control points than frames. Splines also naturally include smoothness constraints on derivatives of the trajectory estimate. Finally, the continuous trajectory representation allows to compensate for rolling shutter effects, since a pose estimate is available at any exposure time of an image. Our approach demonstrates superior quality in tracking and reconstruction compared to approaches with discrete-time or global shutter assumptions. |
DOI | 10.1109/ICCV.2015.261 |
Citation Key | kerl_dense_2015 |
- pose estimation
- trajectory optimization
- trajectory estimation
- Trajectory
- Three-dimensional displays
- splines (mathematics)
- SLAM (robots)
- SLAM
- simultaneous localization and mapping
- rolling shutter RGB-D camera
- pubcrawl170110
- B-spline
- optimisation
- image representation
- Image reconstruction
- image alignment
- estimation theory
- dense continuous-time tracking
- continuous trajectory representation
- Cameras
- camera trajectory representation