ROS Resources: Documentation | Support | Discussion Forum | Index | Service Status | ros @ Robotics Stack Exchange
Ask Your Question
0

How do I get a robot to execute a plan based on 2D images?

asked 2020-04-23 05:15:17 -0500

I'm working on a project that requires me to use a navigation tracking camera to visualise the movement of instrumentation and an IRB 120 robotic arm to perform spinal surgery.

The task requires me to

  1. use the navigation camera to track reference markers specifically placed on the phantom spine model and the IRB120 robot end effector
  2. develop planning for the IRB 120 robot to position itself in specific drilling trajectories on the spine
  3. execute these planning paths on the IRB 120 so that it moves towards the planned paths and positions itself in these planned paths over the spine

How do I plan precisely for my robot to position itself over the spine in specific trajectories for drilling?

edit retag flag offensive close merge delete

1 Answer

Sort by » oldest newest most voted
0

answered 2020-04-25 14:43:56 -0500

pring gravatar image

Sound like a neat project - I hope they're paying you well.

If your reference markers (April Tags, ARuCO?) look like QR codes than you should be able to get a 3D pose of the center of the marker. Of course, your camera will have to be properly calibrated to the markers in question to get a true metric 3D pose.

With a 3D pose, you can use move_it to easily plan a trajectory for the arm to reach.

Good luck

edit flag offensive delete link more

Question Tools

1 follower

Stats

Asked: 2020-04-23 05:15:17 -0500

Seen: 64 times

Last updated: Apr 25 '20