Apparently I didn't have ros-melodic-gazebo-ros-pkgs installed. (And didn't have any error indicating that it was missing either)