| ROS Resources: Documentation | Support | Discussion Forum | Index | Service Status | ros @ Robotics Stack Exchange |
Can anybody please guide me that how can I perform an image classification task by deep learning in ROS through an ABB robot?
Here is one project that does what you're looking for. I originally found it on youtube. You can use it as a jumping off point.
https://douglasrizzo.com.br/projects
https://www.youtube.com/watch?v=fXJYm...
https://github.com/douglasrizzo/dodo_...
It runs a tensorflow-based classification using ROS message passing. I have it running on a custom robot with RPi camera.
@billy, thanks for providing links. They are really useful
Asked: 2020-04-11 02:00:47 -0500
Seen: 504 times
Last updated: Apr 12 '20
ROS Answers is licensed under Creative Commons Attribution 3.0 Content on this site is licensed under a Creative Commons Attribution Share Alike 3.0 license.
@ahmed ali 95, I have so many questions here. If you could provide any sort of details on where you at, that would be great. This is a cool project though. Are you attaching camera on the end of the robot arm or is the camera fixed in space somewhere on the fixture or on the wall and what not? Generally speaking and in very vague terms, you'd need to learn to build CNN (Convolution Neural Network) first, then get your hands on the object-detection packages, in whatever environment you are comfortable with (PyTorch, tensorflow, Keras, or even simple numpy), and then... (I'm just guessing here at this point) build a ROS system where your CNN gets input from the camera through ROS and does the classification, and then sends the commands to the robot back through ROS. One thing for sure, keep your machine learning of any ...(more)
@Yev_D, thank you for your response. I have done enough research on CNN for image classification task by using tensorflow through anaconda. I want guidance to understand the procedure that how can I build a ROS system through which I can get classification results in ROS and most importantly transfer those results/commands to the robot through ROS? Also, I am planning to attach camera on robotic arm. Will be waiting for your kind response. Thanks.
@ahmed ali 95, cool, that's a great start ! Have you ever worked with ROS? If not, then I'd suggest to spend few weeks on getting the basics right. If yes, then the links that @billy has posted look pretty promising.
@Yev_D, that is a good suggestion. Thank you very much dear for your response.