Detecting AR Markers pose with a fisheye lense
Is there any general library or ROS package that is compatible with fisheye like distorted images? Until now I was undistorting my images and using the ar_track_alvar package but this sacrifices the wide field of view. And what intrinsic calibration information do such programs get? (I think OpenCV 2.x.x only supports pinhole models). An alternative to estimate a monocular fisheye camera pose would also be useful.
Did you find any information about this topic? I'm also thinking about detecting markers in fisheye images. But I'm not sure if alvar can handle the distortion. Should I risk buying a fisheye camera and not being able to process the images?
The topic is old, but you undistort the image with image_proc after calibrating the camera.
@machinekoder the whole point was about using the full field of view of the camera to cover more space. Undistorting the image will crop a lot of that field out view out. See my old answer.
But keep in mind undistorting should not sacrifice FOV. It just undistorts the image of the fisheye lens, which itself already loses information compared to a less distorted lens (more details on the same image sensor area). So yes, the fisheye lens can indeed improve FOV compared to a standard lens, with the cost of image quality.