Ask Your Question
0

Accessing rviz view (Camera + Marker) in rospy

asked 2017-03-30 06:42:18 -0500

Ravi Joshi gravatar image

I want to get the rviz view, which is showing me visualization marker on the top of camera view in a single image. Please see below the rviz view:

rviz

I tried to view the image topic but it doesn't contain any marker image (as expected). Please see below the image:

rostopic

Later, I echo the rostopic but couldn't get any clue to get the image. Below is the output of rostopic:

$ rostopic echo /visualization_marker
header: 
  seq: 401
  stamp: 
    secs: 149
    nsecs: 462000000
  frame_id: kinect2_rgb_optical_frame
ns: basic_shapes
id: 8
type: 1
action: 0
pose: 
  position: 
    x: -0.151297542
    y: 0.000741795717294
    z: 0.44793458834
  orientation: 
    x: 0.95382124573
    y: -0.00821160004013
    z: 0.241985041143
    w: 0.177766252933
scale: 
  x: 0.045
  y: 0.045
  z: 0.009
color: 
  r: 0.5
  g: 0.0
  b: 0.5
  a: 1.0
lifetime: 
  secs: 1
  nsecs:         0
frame_locked: False
points: []
colors: []
text: ''
mesh_resource: ''
mesh_use_embedded_materials: False

I want to get the image (in the form of sensor_msgs/Image) as it is seen in rviz using python in ros.

edit retag flag offensive close merge delete

Comments

Does the Marker appear in rviz in the regular 3D view? If so make an rviz Axes and set it to the camera frame_id, and make sure the z-axis is pointed in the general direction of the marker you want to see overlaid on the Image.

lucasw gravatar imagelucasw ( 2017-03-30 07:55:05 -0500 )edit

If I disable (unselect checkbox) camera, I can see the visualization marker. However it appears bigger and misplaced in the screen. But once I enable camera view, I can see marker in proper place (on the top of camera image)

Ravi Joshi gravatar imageRavi Joshi ( 2017-03-30 08:52:44 -0500 )edit

I am not sure if I understand you completely, but are you looking for a topic with 'rendered' camera+marker images? If so I don't believe it is readily available in rviz..

huanxiner gravatar imagehuanxiner ( 2017-03-30 10:23:51 -0500 )edit

@huanxiner: Please see the first image in the question. This image is being displayed by rviz. Notice that the identified marker has been colored in this picture by rviz. I want to get this image (including the colored/detected marker) in ros python code.

Ravi Joshi gravatar imageRavi Joshi ( 2017-03-30 11:07:50 -0500 )edit

1 Answer

Sort by ยป oldest newest most voted
4

answered 2017-03-30 10:23:24 -0500

lucasw gravatar image

updated 2017-03-30 10:24:05 -0500

If I understand your problem correctly then rviz_camera_stream https://github.com/lucasw/rviz_camera... may do part of what you want- it can publish an rviz view of the marker from the same perspective as your camera. What it doesn't do currently is underlay the video. That wouldn't be too hard to add (by borrowing code from the rviz Camera plugin).

Instead of adding that feature you could have a python node subscribe to both the source video (undistorted/rectified) and an rviz_camera_stream where you have set the background color to black and are only visualizing the Marker, and combine the two in the node (create a mask with the non-background pixels in the rviz image and then copy the marker pixels to the source camera image).

edit flag offensive delete link more

Comments

I can easily subscribe and get the camera image (video) which I am able to see using rosrun image_view image_view image:=/kinect2/hd/image_color. However, I am not able to get any marker image. rostopic echo /visualization_marker shows me pose in 3D space. How to convert it to camera space?

Ravi Joshi gravatar imageRavi Joshi ( 2017-03-31 09:26:13 -0500 )edit

Are you running rviz_camera_stream?

lucasw gravatar imagelucasw ( 2017-03-31 11:02:58 -0500 )edit

What do you mean by saying running rviz_camera_stream? I posted two pictures in the question above. First one is rviz view and another one is the output of following command rosrun image_view image_view image:=/kinect2/hd/image_color. Can you please explain in detail?

Ravi Joshi gravatar imageRavi Joshi ( 2017-04-01 09:10:09 -0500 )edit
1

something like this:

cd ~/catkin_ws/src
git clone https://github.com/lucasw/rviz_camera_stream.git

Then build it and try out:

roslaunch rviz_camera_stream demo.launch

There will be images published out of rviz with this.

lucasw gravatar imagelucasw ( 2017-04-03 11:56:14 -0500 )edit

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Question Tools

1 follower

Stats

Asked: 2017-03-30 06:42:18 -0500

Seen: 647 times

Last updated: Mar 30 '17