VILAM: Infrastructure-assisted 3D Visual Localization and Mapping for Autonomous Driving

Authors: 

Jiahe Cui, Beihang University, The Chinese University of Hong Kong, and Tianmushan Laboratory; Shuyao Shi and Yuze He, The Chinese University of Hong Kong; Jianwei Niu, Beihang University; Guoliang Xing, The Chinese University of Hong Kong; Zhenchao Ouyang, Tianmushan Laboratory and International Innovation Institute of Beihang University

Abstract: 

Visual Simultaneous Localization and Mapping (SLAM) presents a promising avenue for fulfilling the essential perception and localization tasks in autonomous driving systems using cost-effective visual sensors. Nevertheless, existing visual SLAM frameworks often suffer from substantial cumulative errors and performance degradation in complicated driving scenarios. In this paper, we propose VILAM, a novel framework that leverages intelligent roadside infrastructures to realize high-precision and globally consistent localization and mapping on autonomous vehicles. The key idea of VILAM is to utilize the precise scene measurement from the infrastructure as global references to correct errors in the local map constructed by the vehicle. To overcome the unique deformation in the 3D local map to align it with the infrastructure measurement, VILAM proposes a novel elastic point cloud registration method that enables independent optimization of different parts of the local map. Moreover, VILAM adopts a lightweight factor graph construction and optimization to first correct the vehicle trajectory, and thus reconstruct the consistent global map efficiently. We implement the VILAM end-to-end on a real-world smart lamppost testbed in multiple road scenarios. Extensive experiment results show that VILAM can achieve decimeter-level localization and mapping accuracy with consumer-level onboard cameras and is robust under diverse road scenarios. A video demo of VILAM on our real-world testbed is available at https://youtu.be/lTlqDNipDVE.

NSDI '24 Open Access Sponsored by
King Abdullah University of Science and Technology (KAUST)

Open Access Media

USENIX is committed to Open Access to the research presented at our events. Papers and proceedings are freely available to everyone once the event begins. Any video, audio, and/or slides that are posted after the event are also free and open to everyone. Support USENIX and our commitment to Open Access.

BibTeX
@inproceedings {295693,
author = {Jiahe Cui and Shuyao Shi and Yuze He and Jianwei Niu and Guoliang Xing and Zhenchao Ouyang},
title = {{VILAM}: Infrastructure-assisted 3D Visual Localization and Mapping for Autonomous Driving},
booktitle = {21st USENIX Symposium on Networked Systems Design and Implementation (NSDI 24)},
year = {2024},
isbn = {978-1-939133-39-7},
address = {Santa Clara, CA},
pages = {1831--1845},
url = {https://www.usenix.org/conference/nsdi24/presentation/cui},
publisher = {USENIX Association},
month = apr
}

Presentation Video