Ask Your Question

Integrate 3D sensing in robot_localization package

asked 2019-08-15 16:35:04 -0600


I came across of this image of the robot_localization package, and I wonder if it is possible to integrate in the sensor fusion the 3D sensing data like in the picture. I didn't find anything about incorporating 3D sensing data in the documentation of this package.


image description

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2019-08-15 22:53:49 -0600

PapaG gravatar image

The package robot_localization is just a kalman filter that fuses odometry data to provide a filtered estimate of the fusion of sensors. The package can currently accept messages of type:

from a plethora of sources. Where those sources come from is up to you. The package does have support for 3D localization and 2D localisation with two_d_mode set to true. Please see the documentation as to how to use this. Specifically referring to your picture,

  • Odometry would be supplied from a tachometer relating the sensor to kinematic constraints
  • IMU would come from an Inertial Measurement Unit of which the manufacturer most likely provides a driver
  • GPS provides a pose in a global reference frame which is determined by the navsat_transform_node also a part of the package.
  • Camera using some visual odometry package such as rtabmap or viso
  • 3D sensing appears to represent an Xbox Kinect in this image of which you could perform the above visual odometry or even Iterative Closest Point (ICP) odometry by interpreting the depth sensing as a point cloud

Based on the sources you supply to the state estimation nodes, it will provide a 3D (or 2D) estimate of your position. This package is often used in collaboration with gmapping for Simaltaneous Localisation And Mapping (SLAM).

Thanks, Grant.

edit flag offensive delete link more

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Question Tools



Asked: 2019-08-15 16:35:04 -0600

Seen: 398 times

Last updated: Aug 15 '19