Attention: Answers.ros.org is deprecated as of August the 11th, 2023. Please visit robotics.stackexchange.com to ask a new question. This site will remain online in read-only mode during the transition and into the foreseeable future. Selected questions and answers have been migrated, and redirects have been put in place to direct users to the corresponding questions on Robotics Stack Exchange. Additional details are available here.

rtabmap outdoor

asked 2018-10-18 03:11:08 -0500

rembert
3 ●2 ●3 ●3

When running rtabmap in localization mode (using a map that was made e.g. a few hours before) we're having problems finding loop closures.

I can see that many of the extracted keypoints are features of shadows, and because the sun moves, or it gets clouded temporarily, the loop closures don't happen anymore.

The problem is a lot less when it's clouded.

Is there any way to tune the key point extractor to ignore shadows? Or any other parameters that are useful in these situations?

edit retag flag offensive close merge delete

add a comment

1 Answer

Sort by » oldest newest most voted

answered 2018-10-19 10:24:27 -0500

matlabbe

6409 ●11 ●96 ●80

Shadows can be indeed very challenging for visual loop closure detection. There is no way in rtabmap to know if some parts of the image are shadows or not.

With its default parameters, rtabmap extracts features only if corresponding depth pixel is valid. The general approach is to filter the depth image where we don't want features extracted. If you could know from another approach (e.g., deep learning) which parts of the image are shadows, the corresponding mask could be applied to depth image so that rtabmap doesn't extract features from shadows.

cheers,
Mathieu

edit flag offensive delete link

add a comment

Question Tools

2 followers

Stats

Asked: 2018-10-18 03:11:08 -0500

Seen: 347 times

Last updated: Oct 19 '18

rtabmap outdoor edit

1 Answer

Question Tools

Stats

Related questions

rtabmap outdoor