Ask Your Question
0

Sensor data fusion Autoware

asked 2019-06-17 04:25:13 -0500

AM97 gravatar image

updated 2019-06-17 04:26:32 -0500

I have learned that in Autoware.AI they are fusing all data from Sensors like Cameras, LIDARS, IMUS, and GPS and using it as ROS Navigation Stack but I couldn't clearly understand how you are fusing all data from Sensors using ROS as middleware. Can anyone describe or explain how are we going to fuse data from different sensors and use it for the perception of Cars?

edit retag flag offensive close merge delete

Comments

I know that there is a robot localization package which is used to fuse data from sensors but I am not understanding it clearly how are we fusing all data from sensors

AM97 gravatar imageAM97 ( 2019-06-17 11:42:03 -0500 )edit

1 Answer

Sort by ยป oldest newest most voted
0

answered 2019-06-17 19:50:24 -0500

cassini.huygens gravatar image

You can definitely find more about how that's done using Autoware's repository and documentations (including publications). One easy example is Lidar and Camera data fusion: Essentially Lidar detects the objects and knows where it is placed at, on the other hand Camera detects what is the object, then the combo of two gives you "what's where". Lidars IMUs and GPS can be fused to get a better localization and/or resets ndt_matching if localizer is lost.

https://github.com/CPFL/Autoware-Manu...

edit flag offensive delete link more

Comments

I understand that but I am not getting how are we doing it physically, for example, How are fusing the data from LIDAR and camera.

AM97 gravatar imageAM97 ( 2019-06-18 01:12:28 -0500 )edit

@AM97 What do you mean physically? Do you mean how the data from the two sensors are related to each other? If yes, there is a LiDAR-camera calibration publisher node in Autoware which publishes the relative position information between the sensors.

i_robot_flight gravatar imagei_robot_flight ( 2019-07-01 16:45:56 -0500 )edit

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Question Tools

1 follower

Stats

Asked: 2019-06-17 04:25:13 -0500

Seen: 156 times

Last updated: Jun 17