TF Frame Convention for Stereo Cameras

asked 2011-04-26 20:19:15 -0600

mkoval

524 ●17 ●27 ●33 http://mkoval.org/

updated 2011-06-17 11:17:57 -0600

mmwise

8372 ●45 ●74 ●99 http://www.meloneewise.com/

I am using a stereo camera for both stereo reconstruction and monocular image processing. Since I am not calibrating the pair of cameras twice, I am doing all of the monocular processing using the stereo calibration parameters. For the camera intrinsics, this works fine. I am not sure how to handle the extrinsics.

I would like to have the left and right cameras in different TF frames that correspond to their positions on my robot (e.g. /stereo_left_link and /stereo_right_link). Since the stereo baseline is encoded in the stereo calibration parameters, I am not sure stereo_image_proc will deal with the two images being in different TF frames.

What is the correct way to set the CameraInfo and Image message frame_ids to safely proceed to avoid being affected by the potential inconsistencies?

edit retag flag offensive close merge delete

add a comment

0

answered 2011-06-30 05:53:02 -0600

tfoote

58457 ●128 ●550 ●526 http://www.ros.org/

You could check out uvc_camera's stereo_node as somewhere to start.

edit flag offensive delete link

add a comment

1

answered 2011-06-17 11:01:43 -0600

mmwise

8372 ●45 ●74 ●99 http://www.meloneewise.com/

typically each camera in a stereo pair is assigned a different tf frame and the camera info for each camera contains the frame information

# Time of image acquisition, camera coordinate frame ID
Header header    # Header timestamp should be acquisition time of image
                 # Header frame_id should be optical frame of camera
                 # origin of frame should be optical center of camera
                 # +x should point to the right in the image
                 # +y should point down in the image
                 # +z should point into the plane of the image

stereo_image_proc listens on the right/camera_info and left/camera_info topics

edit flag offensive delete link

Comments

I believe I have already tried this, but stereo_image_proc complains that the left and right TF frames do not match.

mkoval ( 2011-06-17 18:31:40 -0600 )edit

if you look at this question http://answers.ros.org/question/106/how-to-add-kinect-sensor-input-to-a-urdf-model#175 this is how we model the kinect for the turtlebot

mmwise ( 2011-06-18 09:07:37 -0600 )edit

Thanks for the link, but it is solving a different problem. I would like left/{image,camera_info} to have TF frame /stereo_left_link and right/{image,camera_info} to have TF frame /stereo_right_link. However, this triggers an assertion that left.frame != right.frame.

mkoval ( 2011-06-27 03:50:16 -0600 )edit

add a comment

0

answered 2011-06-26 23:04:57 -0600

rajat
175 ●8 ●10 ●18 http://gonnarisup.blog...

Are you able to slove the problem, i am having the same problem , whenever i use stereo_image_proc , stereo vslam crashes saying that , assertion of right_.tf=left_tf failed .

Do you have any idea how to solve this problem?

edit flag offensive delete link

Comments

1

I still haven't figured out how to get stereo_image_proc working without putting both cameras in the same TF frame.

mkoval ( 2011-06-27 03:46:47 -0600 )edit

add a comment

0

answered 2011-06-27 23:57:41 -0600

rajat
175 ●8 ●10 ●18 http://gonnarisup.blog...

can you tell me how to put both the cameras in same TF frame .???

edit flag offensive delete link

add a comment

TF Frame Convention for Stereo Cameras

4 Answers

Comments

Comments

Question Tools

Stats

Related questions

TF Frame Convention for Stereo Cameras edit

4 Answers

Comments

Comments

Question Tools

Stats

Related questions

TF Frame Convention for Stereo Cameras