3D Scene Reconstruction Based on Multi-source Sensor Data Fusion

NAVIGATE

Table of Contents

STATISTICS

Viewed3166

Downloads2261

3D Scene Reconstruction Based on Multi-source Sensor Data Fusion

[HTML] PDF下载 (2261)

[1]Chen Yifei,Guo Sheng,Pan Wenan,et al.3D Scene Reconstruction Based on Multi-source Sensor Data Fusion[J].Journal of Zhengzhou University (Engineering Science),2021,42(02):81-87.[doi:10.13705/j.issn.1671-6833.2021.02.008]

Copy

Journal of Zhengzhou University (Engineering Science)[ISSN 1671-6833/CN 41-1339/T] Volume: 42 Number of periods: 2021 02 Page number: 81-87 Column: Public date: 2021-04-12

Title:: 3D Scene Reconstruction Based on Multi-source Sensor Data Fusion

Author(s):: Chen Yifei; Guo Sheng; Pan Wen’an; Lu Yanhui;; School of Information Engineering, Zhengzhou University; Chinese University of Hong Kong (Shenzhen) Institute of Technology; Shenzhen Institute of Data;

Keywords:: data fusion; 3D modeling; deep learning; object detection; feature matching; scene recurrence

CLC:: -

DOI:: 10.13705/j.issn.1671-6833.2021.02.008

Abstract:: Aiming at the target redundancy in reconstruction of certain scenes, in this paper a data fusion method of the camera RGB bitmap and lidar data was employed to solve the problem. In the field of 3D reconstruction, this method of data fusion could eliminate the irrelevant targets in the specific scene and reproduce the three-dimensional scene. The lightweight LeGO-LOAM algorithm was used to extract and match different types of feature points at first, and point clouds were merged at different times to complete the reproduction of the point cloud map. For the irrelevant targets in the constructed point cloud map, with the help of multi-source sensor data and deep learning application technology in the field of computer vision, object detection and elimination are accomplished in three-dimensional space. For the two different processes of point cloud modeling and target detection, the method of point cloud registration was adopted to fuse the algorithm and finally complete the scene reproduction in the campus environment. Experimental results showed that the method based muti-source data fusion could effectively combine the two processes of 3D modeling and object detection. The method proposed in this paper could be applied to smart cities, unmanned driving and other fields, and should have practical application value.

References:: [1] 张勤, 贾庆轩. 基于激光与单目视觉的室内场景三维重建[J]. 系统仿真学报, 2014, 26(2):357-362.
[2] 辛俊伟, 罗艳, 程朋根. 基于LiDAR技术的古建筑复杂曲面三维重建[J]. 测绘与空间地理信息, 2017, 40(7):65-67.
[3] 刘晋,禹鹏,白隽瑄,等.基于三维激光扫描技术的犯罪现场重建[J].刑事技术,2017,42(6):476-481.
[4] 李云翔.相机标定与三维重建技术研究[D].青岛:青岛大学,2009.
[5] 曹明玮,钱烨强,王冰,等.基于监督式学习的全景相机与激光雷达的联合标定[J].机电一体化,2018,24(1):3-9,34.
[6] ZHANG J,SINGH S.Low-drift and real-time lidar odometry and mapping[J].Autonomous robots,2017,41(2):401-416.
[7] DISSANAYAKE M W M G,NEWMAN P,CLARK S,et al.A solution to the simultaneous localization and map building (SLAM) problem[J].IEEE transactions on robotics and automation,2001,17(3):229-241.
[8] SHAN T X,ENGLOT B.LeGO-LOAM:lightweight and ground-optimized lidar odometry and mapping on variable terrain[C]//2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).New York:IEEE,2018:4758-4765.
[9] CHARLES R Q,HAO S,MO K C,et al.PointNet:deep learning on point sets for 3D classification and segmentation[C]//2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).New York:IEEE,2017:77-85.
[10] QI C R,YI L,SU H,et al.PointNet++:deep hierarchical feature learning on point sets in a metric space[EB/OL].(2017-06-07)[2019-12-01].https://arxiv.org/abs/1706.02413.
[11] 张艺琨,唐雁,陈强.基于多特征融合的三维模型检索[J].郑州大学学报(工学版),2019,40(1):1-6.
[12] LI Y Y, BU R, SUN M C, et al. PointCNN: convolution on x-transformed points[C]//32nd Conference on Neural Information Processing Systems. New York:ACM，2018:820-830.
[13] QI C R,LIU W,WU C X,et al.Frustum PointNets for 3D object detection from RGB-D data[C]//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.New York:IEEE,2018:918-927.
[14] 庄加福.基于机载激光雷达的复杂场景车辆类目标检测[D].武汉:华中科技大学,2013.
[15] 叶语同,李必军,付黎明.智能驾驶中点云目标快速检测与跟踪[J].武汉大学学报(信息科学版),2019,44(1):139-144,152.
[16] GEIGER A,LENZ P,STILLER C,et al.Vision meets robotics:the KITTI dataset[J].The international journal of robotics research,2013,32(11):1231-1237.[17] LIU Y S,HU Z C,GAO S,et al.In situ analysis of major and trace elements of anhydrous minerals by LA-ICP-MS without applying an internal standard[J].Chemical geology,2008,257(1/2):34-43.
[18] RUSINKIEWICZ S,LEVOY M.Efficient variants of the ICP algorithm[C]//Proceedings 3rd International Conference on 3-D Digital Imaging and Modeling.New York:IEEE,2001:145-152.
[19] 戴静兰,陈志杨,叶修梓.ICP算法在点云配准中的应用[J].中国图象图形学报,2007,12(3):517-521.

Similar References:

Memo

Last Update: 2021-05-30