Reinforcement learning with ros robot

I'm very sorry to ask this question again

My case is using ubuntu18 and ROS melody At the same time, because my own hardware configuration is rtx3070. Therefore, the corresponding CUDA version is 11.1. As a result, Pytorch and tensorflow suitable for CUDA are no longer suitable for python2 seven

So my idea is to create a python3 environment by Anaconda (so that you can install the appropriate Python and tensorflow). But how to carry out reinforcement learning for the gazebo robot created in the main environment(with python2.7) in the python3 environment?

Asked by kankanzheli on 2022-02-11 04:45:50 UTC

Comments

Answers

I think OpenAI could be a good start for you.

This post on ROS Discourse about robo-gym could help you too.

Good luck!

Asked by ljaniec on 2022-02-11 05:19:33 UTC

Comments

Thanks for your advices. But I have a lot of trouble when I try to using this tow methods. When I try to download robo-gym-robot-servers, the following error is occured: ros-melodic-franka-example-controllers: dependency: ros-melodic-panda-moveit-config, but it will not be installed

E: The error cannot be fixed because you require some packages to remain as they are, because they break the dependencies between packages.

For openai_ros, I have no idea. Should I catkin build it in anaconda python3 enviroment? If yes, how to do that? And it there any example for openai_ros in ros melodic enviroment?

Asked by kankanzheli on 2022-02-11 10:47:21 UTC

Robo-gym: Which step from there https://github.com/jr-robotics/robo-gym-robot-servers wasn't working for you? OpenAI: https://bitbucket.org/theconstructcore/openai_examples_projects/src/master/ have a lot of examples, not sure about ROS Melodic part though

Asked by ljaniec on 2022-02-11 11:32:26 UTC

For Robo-gym, Environment Side can be simple installed. The problen was happened when I download Robot Server Side. When I try to work with this step "rosdep install --from-paths src -i -y --rosdistro $ROS_DISTRO", that error is happened.

Asked by kankanzheli on 2022-02-11 11:42:36 UTC

And for openai_ros, should I catkin build it in anaconda python3 enviroment?

Asked by kankanzheli on 2022-02-11 11:43:18 UTC

Sadly, I didn't have time to delve into this more by myself, I hope somebody there or on GitHub can help you directly with resolving these bugs and with answering your questions

Asked by ljaniec on 2022-02-13 06:02:59 UTC