Ask Your Question
3

OpenNI_Camera on Pandaboard (Fuerte + Ubuntu 12.04)

asked 2013-02-19 18:01:57 -0500

aman501 gravatar image

updated 2016-10-24 08:34:34 -0500

ngrennan gravatar image

Hi,

As is mentioned in the title, I have a Pandaboard (pandaboard.org) which features a dual core ARMv7 processor. I currently have Ubuntu 12.04 running, as well as have compiled the "full - desktop" version of ROS Fuerte for it (wiki here: www.ros.org/wiki/fuerte/Installation/Ubuntu/Source). This Pandaboard is intended to be the brain of a robot which features a Kinect sensor for SLAM.

I am currently grappling with compiling OpenNI_Camera for my platform. I have installed the latest (unstable) OpenNI drivers as per this guide (www.pansenti.com/wordpress/?page_id=1772). I have not been able to sudo apt-get install any ROS packages on the Pandaboard. Is there a repository I'm missing or something?

Not sure if that was the right move, but thats what I've attempted so far. I realize this is not ros-fuerte-openni-camera as one would sudo apt-get on a normal x86 processor, but I believe it to be a dependency for the openni_camera (ros.org/wiki/openni_camera - fuerte version) package.

I guess my question/problem is that according to sources like this (kinect-with-ros.976505.n3.nabble.com/Ros-kinect-kinect-on-ARM-td2654041.html), people have openni_camera and openni_launch compiled and running for ARM architectures but I simply cannot find out how to do it, I thought I'd start by compiling its dependencies by hand, but the libopenni-sensor-primesense-dev for example, has no ARM compilation options according to the README (github.com/jspricke/openni-sensor-primesense) as well as a quick peak into the git.

Any direction or advice for how to do this would be greatly appreciated! This is for an undergraduate senior design course, for those interested. Apologies for the lack of karma and henceforth, real links - I've been lurking around for an answer on the internet for a couple weeks now.

EDIT 1:

Having followed the directions provided here:(http://www.pansenti.com/wordpress/?page_id=1772) (openNI and kinect drivers) and here:(http://www.novemberkiloecho.com/2012/05/08/how-to-install-opencv-2-4-on-your-pandaboard-an-addendum/) (OpenCV - Hansg91 mentioned it as a dependency, not sure if its necessary) The first link basically outlines what Hansg91 has said below. I have successfully read data from the kinect on the pandaboard, as per the testing listed at the bottom of the first link. This data is not in ROS yet, but will begin to look at Hansg91's source code to see if it can read the data as I have it.

It is worth noting that to get the test to execute successfully I had to change the default USB interface. Hansg91 recommended BULK, however I needed ISO, as is mentioned under the driver installation (UsbInterface=1) in the first link. I plan on continuing to update this post as I make progress. It is still very possible that his/her code needs BULK usb interface instead (UsbInterface=2)

EDIT 2:

Moving on from The OpenNI drivers, we found we would like to use these packages in ccny_rgbd. Its faster than rgbd_slam and doesn't require openni_camera (but still ... (more)

edit retag flag offensive close merge delete

Comments

I'll follow your question: I'm using fuerte on a Panda too but didn't even try to compile the whole desktop variant.

Unfortunately there is (at this time) no repository for ROS on ARM. So no debs.

Claudio gravatar image Claudio  ( 2013-02-19 21:14:30 -0500 )edit

Yeah, that's what I assumed, hence the installation from source. Thanks.

aman501 gravatar image aman501  ( 2013-02-20 06:06:35 -0500 )edit

Ah I see you have it working, very good :) You actually don't even need OpenCV, but it makes things a bit easier (and you probably need it sometime anyway). I thought I had changed it to BULK interface, but I could very well have been mistaking, ISO sounds familiar too ;)

Hansg91 gravatar image Hansg91  ( 2013-03-06 07:27:13 -0500 )edit

Hello, have you made any progress with ccny_rgbd? I'd be curious to see if it worked on your setup. If you need help recompiling it against a custom pcl, let me know

Ivan Dryanovski gravatar image Ivan Dryanovski  ( 2013-03-07 04:34:35 -0500 )edit

1 Answer

Sort by ยป oldest newest most voted
3

answered 2013-02-24 03:56:50 -0500

Hansg91 gravatar image

Getting a Kinect to work on a Pandaboard is possible, but I will tell you now that it is computationally very expensive for the Pandaboard to read out the Kinect data. As I said in another question, if you have the Kinect working and sending its data to the Pandaboard, there is little computational power left for SLAM, sending it over WiFi is a bad idea as well. I have not tried to use the Kinect on the Pandaboard with just SLAM, but my experience is that the Pandaboard would get hot rather quickly, scale down its CPU and then you have one very slow brain.

So to sum up: be careful if you want to do this, with what you let the Pandaboard do as calculations.

I have a Pandaboard with Ubuntu 11.10 and ROS Fuerte installed, indeed from source as none of the packages are available for ARM.

What I did was compile the OpenNI drivers from source, using (if I remember correctly) these steps:

  • Download the OpenNI source from https://github.com/OpenNI/OpenNI and compile it using the ARM compiler and install it
  • Download the NITE middleware source (for which I cannot find the link at the moment?) and compile it using ARM and install it
  • Download the avin2 SensorKinect driver (https://github.com/avin2/SensorKinect), compile it for ARM and install it

I am not sure if the NITE middleware SDK was mandatory or optional, you can try without. Also, I believe the OpenNI had to be set to use the BULK USB interface for ARM devices, otherwise it wouldn't communicate properly.

If you got this far, try one of the OpenNI samples and see if they work. If they do, it is just a matter of letting ROS know OpenNI is installed and where it is installed.

Good luck!

edit flag offensive delete link more

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Question Tools

4 followers

Stats

Asked: 2013-02-19 18:01:57 -0500

Seen: 1,066 times

Last updated: Mar 23 '13