Point Cloud Stitching and processing [closed]
I have pointclouds from two realsense D415 cameras, which is mounted in a way to have overlap. I am able to stitch the output pointclouds in realtime to get a single larger FOV pointcloud by using PCL ICP to find the transforms and transforming one pointcloud to match with the other. Now I would like to detect planes on this output pointcloud and further detect people with the help of the detected planes and ground plane. I have implemented the same with PCL libraries once again.
Now issues arise in two cases: (1) The final stitched output is unordered leading to a lot of PCL functions not being able to use the pointcloud. To overcome this , say I resize my pointcloud to match the final dimensions with height not being 1, I run into (2).
(2) Upon passing the resized pointcloud I get an error from the normal algorithm I am using as Input not from a projective device, using only XXXX points (XXXX is a very small fraction of the total number of points in the pointcloud). Any other available normal algorithm performs really slow and is not capable of being used in real time applications.
Any ideas how to proceed with this? Happy to provide more information.
I've closed this as it's not really a ROS question. We use PCL with/in ROS, but PCL is not part of ROS.
Questions like these should be posted to a more appropriate venue. The main PCL site these day is pointclouds.org.
Hi, sorry for that. I would also like to know if there are other methods apart from pcl for robust stitching of pointclouds and keep them ordered, would love some help on that as well.
@Pran-Seven if you know the mounted position of the cameras, why can't you transform all the points to the same transfrom frame? Why do you need to use a more complicated stitching algorithm?
Just transforming all the points would not account for the overlap right? Because currently before applying the stitching, I am indeed transforming them to the base link, which gives me a bigger pointcloud yes, but does not merge the repeated objects.
The meaning of "repeated objects" is not clear to me. A pointcloud consists of a set of infinitely-small points. Why should your processing care if two points happen to be rather close to each other in 3d-space?
Hey, thank you for your reply. By repeated points, I mean the objects/scenes seen by both the camera because of the overlap. This seems to cause an issue, because what seems to be happening is, there are two layers of points in the same place. I am attaching an image for reference. What seems to be happening in this case is the nearest neighbour algorithm is failing with an error Input on.not from a projective device as there are two layers in the same region. This multiple layer is definitely caused by an error in my align+merge, but this is the best transformation matrix I have been able to achieve and since the scene will not remain the same, I can not hard code it to overcome the error. Now I am wondering if I can somehow delete these common points from the second pointcloud before merging them.
@Pran-Seven: There are various filters in PCL. You can apply VoxelGrid filter to eliminate such points. Thanks to all great developers in ROS, you don't need to code anything to do it. You can just write a lunch file. Please see the following tutorial: http://wiki.ros.org/pcl_ros/Tutorials...
@ravijoshi thanks for your response! I did try voxel grid down sampling, but owing to the large dataset size, I could only get it working with leaf size as 0.1f and at that leaf size, the output pointcloud is kinda useless for my further processing