Is there a way to publish a video file so it can be displayed with a camera display in RViz? (solved)

edit

The difference between the Image and Camera displays is that the former just takes an image and displays is, while the latter additionally uses information about camera intrinsics for additional functionality such as being able to project rviz 3D rendered information into the image. To be able to do so, it requires a CameraInfo message to be published along with each Image message, see for instance REP-0104.

So for the Camera display to work, you need to publish a correctly timestamped CameraInfo message for each Image you publish. According to the video_stream_opencv documentation such functionality is already available, so you might want to check if CameraInfo messages are already published.