Rosbag play stuck, tf issues?

edit

I have a very peculiar issue here. When playing the well known bagfile rgbd_dataset_freiburg1_xyz.bag and have rviz open, the clock gets stuck around 3.780429. If i play back with 10% speed, everything just plays fine. Also without rviz open, everything just works fine.

As soon as I run a node that listens to tf that error seems to happen. So i guess it is something deeper than rviz...

Any ideas what might cause this issue or how to fix it?

<launch>
    <param name="/use_sim_time" value="true"/>
    <node pkg="rosbag" type="play" name="player" output="screen" args="--clock -r 1 --pause -l $(find phx_vo)/data/rgbd_dataset_freiburg1_xyz.bag"/>
    <node pkg="rviz" type="rviz" name="rviz" args="-d $(find phx_vo)/launch/vo.rviz" required="true"/>
</launch>