rostests fail intermittently when run with catkin_make run_tests

asked 2023-01-11 10:10:13 -0500

Hello ROS Answers Community,

I have a set of rostests for a ROS package. Whenever they are run individually with rostest package_name launch_file.launch they pass. Normally, when run with catkin_make run_tests they pass too, however this sometimes causes intermittent failures.

Increasing the number of allowed jobs (catkin_make run_tests -j 20) appears to increase the rate of failures, however only allowing one job at a time (catkin_make run_tests -j 1) has also caused failures.

If I remove all but one of the add_rostest lines in the CMakeLists.txt, the remaining rostest seems to always pass.

Running the tests with github actions seems to increase the failure rate.

I'm running ROS Noetic on Ubuntu 20.04 with GNU Make 4.2.1 and Python 3.8.10 Linux version 5.14.0-1055-oem (buildd@lcy02-amd64-045) (gcc (Ubuntu 9.4.0-1ubuntu1~20.04.1) 9.4.0, GNU ld (GNU Binutils for Ubuntu) 2.34)

On github actions I'm using ubuntu-20.04 and the ros:noetic docker image

If anyone could point me in the direction of what might be going on, I would greatly appreciate it, thanks in advance for the help

edit retag flag offensive close merge delete