ccny_rgbd_tools launch files for PR2 in Gazebo

asked 2013-02-25 12:38:12 -0500

astaranowicz

238 ●10 ●11 ●19

updated 2014-11-22 17:05:44 -0500

ngrennan
1 ●1 ●1

Hi,

I would like to use the ccny_rgbd_tools package on the PR2 in Gazebo using the head_mount_kinect.

What would the launch files I would need in order for this to work?
What would I need to modify in the current launch files?

Sorry, I'm still inexperience using the PR2 and its topics so I don't quite understand which topics will be required. However, I am still checking.

Thanks.

EDIT:

I updated the vo+mapping.launch file to remap the expected topics:

<remap from="/rgbd/rgb" to="/head_mount_kinect/rgb/image_raw"/>
<remap from="/rgbd/depth" to="/head_mount_kinect/depth/image_raw"/>
<remap from="/rgbd/info" to="/head_mount_kinect/rgb/camera_info"/>

... rest of the node ... </node>

However, I get this error: (partial)

Frame /r_gripper_motor_slider_link exists with parent /r_gripper_palm_link. Frame /r_gripper_r_finger_link exists with parent /r_gripper_palm_link. Frame /r_shoulder_lift_link exists with parent /r_shoulder_pan_link. Frame /r_shoulder_pan_link exists with parent /torso_lift_link. Frame /r_wrist_flex_link exists with parent /r_forearm_link. Frame /torso_lift_motor_screw_link exists with parent /base_link. Frame /odom_combined exists with parent NO_PARENT.

Most of the links now say that there is NO_PARENT.

Now I know the ccny_rgbd_tools expects:

RGB Image (8UC3) topic Depth Image (16UC1, in millimeters) topic Camera Info topic

However, I don't know if I am using the right topics. Any suggestions?

EDIT_2:

Topics and Frames I am using: remap from="/rgbd/rgb" to="/head_mount_kinect/rgb/image_raw/compressed"

remap from="/rgbd/depth" to="/head_mount_kinect/depth/image_raw"

remap from="/rgbd/info" to="/head_mount_kinect/rgb/camera_info"

param name="publish_tf" value="false"

param name="fixed_frame" value="/odom"

param name="base_frame" value="/base_link"

edit retag flag offensive close merge delete

Comments

Are you sure /head_mount_kinect/rgb/image_raw is a debayered RGB image in 8UC3?

Ivan Dryanovski ( 2013-02-26 07:10:43 -0500 )edit

I'm not sure, however, to move from a simulated Gazebo image to a real Image, the use of cv_bridge is needed to turn a ROS msg in to an OpenCV Mat. I think this will take more time.

astaranowicz ( 2013-02-26 07:28:25 -0500 )edit

the ccny_rgbd already uses cv::bridge to convert ROS messages, so no need to account for that. Is there any documentation on the Gazebo image generation you can point me to? Or launch files, or anything?

Ivan Dryanovski ( 2013-02-26 07:32:37 -0500 )edit

Basically, I'm just calling $roslaunch pr2_gazebo pr2_empty_world.launch found here :http://ros.org/wiki/pr2_gazebo. The Gazebo Image Generation is done by ray-tracing from the camera reference frame as far as I know.

astaranowicz ( 2013-02-26 07:55:24 -0500 )edit

I see. Well the pr2_bringup.launch is calling robot_pose_ekf, but disabling the vo, so that needs to be changed. Before you worry about robot_pose_ekf, I would make sure that the topics and frames are correct

Ivan Dryanovski ( 2013-02-26 08:07:58 -0500 )edit

add a comment

answered 2013-02-26 07:09:57 -0500

Ivan Dryanovski

4954 ●52 ●70 ●86 http://robotics.ccny.cuny.edu/

updated 2013-02-27 02:40:43 -0500

You should be able to use the ccny_rgb tools with simulated Kinect data, as long as that data comes in the same format as the OpenNI image topics. The visual_odometry and keyframe_mapper tools require 3 incoming topics:

/rgbd/rgb: a rectified, debayered RGB image, 8UC3 encoding
/rgbd/depth: a rectified depth image, registered with the RGB image, 16UC1 encoding (in millimeters)
/rgbd/info: CameraInfo topic (applies to both image, since they are registered).

If the topics are coming from the OpenNI driver, you would need to add the following remappings to the visual_odometry_node and the keyframe_mapper_node launch files

<remap from="/rgbd/rgb"   to="/camera/rgb/image_rect_color"/>
<remap from="/rgbd/depth" to="/camera/depth_registered/image_rect_raw"/>
<remap from="/rgbd/info"  to="/camera/rgb/camera_info"/>

Finally, you should choose the fixed_frame and base_frame parameters. The defaults are odom and camera_link. In your case, since this is a real robot, the base frame might be different - base_link for example. You need to ensure that there exists a tf between the base_frame and the optical frame of the camera. This transform is assumed to be static by ccny_rgbd, and will be cached.

EDIT: The visual odometry will publish a tf, but this might not be what you need for your application, especially if you are using robot_pose_ekf to fuse odometry sources.

If this is the case, disable the tf publishing (using the publish_tf flag), and make robot_pose_ekf subscribe to the "odom" topic published by "visual_odometry_node", of type nav_msgs/Odometry

EDIT 2: Still can't find what the simulated Kinect data is exactly, but it appears the only available depth topic is 32FC1. A ticket has been opened to enable support in ccny_rgbd.

EDIT 3: Added support for 32FC1 images (see ticket for details). Also added clearer instructions in launch files which summarize this answer here.

Comments

Just to clarify. In robot_pose_ekf, what do you mean ekf?

astaranowicz ( 2013-02-26 08:01:21 -0500 )edit

ekf means extended kalman filter. robot_pose_ekf is a ros package that gives an optimal odometry estimate by combining two sources of odometry with different accuracy

sai ( 2013-04-07 19:26:35 -0500 )edit

Hello,

I'd like to clarify whether the ccny_rgbd package uses odometry data obtained from the robot (encoders / etc). From what I understand, to configure SLAM for just a camera, I should set publish_tf to false? Also, could you elaborate on what frame ID's I should be setting for that case?

Tanmay ( 2015-06-02 18:21:44 -0500 )edit

add a comment

ccny_rgbd_tools launch files for PR2 in Gazebo

Comments

1 Answer

Comments

Question Tools

Stats

Related questions

ccny_rgbd_tools launch files for PR2 in Gazebo edit

Comments

1 Answer

Comments

Question Tools

Stats

Related questions

ccny_rgbd_tools launch files for PR2 in Gazebo