Ask Your Question
5

Has anyone integrated ROS with Unity 3d?

asked 2014-01-28 10:25:19 -0600

daveayyyy gravatar image

You know: www.unity3d.com, runs Mono. Prefer Windows, but understand that Mac might be closer to supportable.

edit retag flag offensive close merge delete

Comments

What kind of integration are you talking about?

bchr gravatar imagebchr ( 2014-01-28 10:53:23 -0600 )edit

Using C# to talk to native, DLL, or websocket, for example. Want to be able to interact with the 3D model of my building to tell robot where to go, have robot tell me where it is and reflect that in the model.

daveayyyy gravatar imagedaveayyyy ( 2014-01-28 11:07:49 -0600 )edit
1

I integrated untiy via DLL + socket conection to player/stage 3 years ago . Was quite a bit of work. Haven't heard any thing about ROS+Unity, would be awesome, though.

Wolf gravatar imageWolf ( 2014-01-28 20:07:21 -0600 )edit

Is there anyone who has got his/her hands dirty on that (viz. ROS+Unity3D) ?

Kadir Firat Uyanik gravatar imageKadir Firat Uyanik ( 2015-04-06 04:59:52 -0600 )edit

http://ieeexplore.ieee.org/xpl/articl...

These guys have done quite a bit in making unity and ROS speak. But sadly, they say nothing about their code.

pavan gravatar imagepavan ( 2016-06-17 14:37:48 -0600 )edit

2 Answers

Sort by ยป oldest newest most voted
1

answered 2016-11-09 14:30:59 -0600

jacksonkr_ gravatar image

rosbridge is a great way to make a websocket which can stream data via restful api. You can use rosbridge to get topics from ROS to unity. I've done this myself but one caveat is that PointCloud2 topics are bugged in indigo to the point that the streaming doesn't work for those types.

Here's a great example to get you started with streaming topics form a kinect: http://wiki.ros.org/ros3djs/Tutorials...

Also, do ingest the data via Unity3d you merely point it at the web service.

edit flag offensive delete link more
4

answered 2017-10-13 09:08:07 -0600

Martin Bischoff gravatar image

We have recently published our ROS-Unity3D Toolbox ROS# on GitHub: https://github.com/siemens/ros-sharp

We use rosbridge_suite on the ROS side and implemented RosBridgeClient in C# (using websocket-sharp and newtonsoft json.net ).

Our toolbox also has a URDF importer for Unity3d which downloads URDF, meshes and textures from ROS and models the robot with all its kinematics in Unity3D.

edit flag offensive delete link more

Comments

Not sure if I can ask you elsewhere, so I ask here: I implemented the ros-sharp toolkit in an existing unity project and even set up a new one but got a error compiling the projects. Something with the newsonsoft.json has problems. It could be because we use the hololens toolkit too. Any suggestions

Demian23 gravatar imageDemian23 ( 2017-11-23 02:55:36 -0600 )edit

@Demian23 please provide a clear error description so that we can help you.

Problems with ROS#: Please write detailed issues here: https://github.com/siemens/ros-sharp/...

Unity3D, Hololens, Json.NET Problems: https://answers.unity.com/questions/a...

Martin Bischoff gravatar imageMartin Bischoff ( 2017-11-23 04:26:11 -0600 )edit

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Question Tools

7 followers

Stats

Asked: 2014-01-28 10:25:19 -0600

Seen: 8,247 times

Last updated: Oct 13 '17