Attention: Answers.ros.org is deprecated as of August the 11th, 2023. Please visit robotics.stackexchange.com to ask a new question. This site will remain online in read-only mode during the transition and into the foreseeable future. Selected questions and answers have been migrated, and redirects have been put in place to direct users to the corresponding questions on Robotics Stack Exchange. Additional details are available here.

problems with the ray in projectPixelTo3dRay

asked 2011-05-03 11:06:03 -0600

Javier Romero
66 ●2 ●5 ●8

updated 2014-01-28 17:09:37 -0600

ngrennan
1 ●1 ●1

According to the API, the return value is "the unit vector in the camera coordinate frame in the direction of rectified pixel" (from 1.4 is not unit, but with unit z component). I expected that multiplying such a vector by a scalar z would give me the 3D point with depth z that projects into the input pixel. However, when i back-project such a vector the result is not the input pixel:

cv::Point2d pixel(r,c);
cv::Point3d ray =  model.projectPixelTo3dRay(pixel);
cv::Point3d point = ray * z;
cv::Point2d back_pixel = model.project3dToPixel(point);

I would expect back_pixel be equal to pixel for any z, but it only happens for z=1. Have I misunderstood something?

edit retag flag offensive close merge delete

add a comment

1 Answer

Sort by » oldest newest most voted

answered 2011-05-03 12:34:50 -0600

Javier Romero
66 ●2 ●5 ●8

OK, it's pretty straightforward if you look at the code of the functions. The problem is that I was looking to the second camera of a stereo pair, and therefore the components Tx is non-zero. Therefore you have to make a couple of translations:

cv::Point2d pixel(r,c);
cv::Point3d ray =  model.projectPixelTo3dRay(pixel);
float tx_fx = model.Tx()/model.fx();
cv::Point3d point(z*(ray.x+tx_fx)-tx_fx,z*ray.y,z*ray.z);
cv::Point2d back_pixel = model.project3dToPixel(point);

edit flag offensive delete link

add a comment

Question Tools

Stats

Asked: 2011-05-03 11:06:03 -0600

Seen: 1,514 times

Last updated: May 03 '11

problems with the ray in projectPixelTo3dRay edit

1 Answer

Question Tools

Stats

Related questions

problems with the ray in projectPixelTo3dRay