Examine ROS buildfarm pull request testing result output

asked 2016-07-27 21:12:25 -0500

10937 ●203 ●339 ●330 http://www.linkedin.co...

updated 2016-07-27 21:30:51 -0500

I particularly have no clue in how to analyze the result of pull request testing on ROS buildfarm.

A test on buildfarm for one of my PRs fails, while the tests in the repo run on Travis CI succeeds. Same result (good on Travis, failure on buildfarm) keeps happening with updated commits so the behavior seems stable. And on buildfarm, tests defined in the package seems to be passing too. Not sure what makes the buildfarm script to fail the test.

Can anyone tell us what to look for when the job fails for PR testing on buildfarm?

I typically try to find keywords "fail", "error", "not found", "summary", "undefined" (to hit rostest result section) by in-page search. For the buildfarm output I also browsed through. For the particular aforementioned PR, however, none of these didn't convince me for the cause of the error.

Thanks.

edit retag flag offensive close merge delete

add a comment

answered 2016-07-27 21:41:34 -0500

tfoote

58457 ●128 ●550 ●526 http://www.ros.org/

updated 2016-07-27 21:42:49 -0500

Looking at the build log it appears to pass the tests, but the conversion to JUnit xml format fails when Jenkins is parsing the results. And the error appears to be due to a missing xml file. Looking at the last file processed it appears that the output has no test results,

The file in question: rosunit-nxo_moveit.xml appears to have no results inside it.

<?xml version="1.0" encoding="utf-8"?>

Looking at the full log it appears that there should be one successful test in the xml.

Erroring section of the log:

# BEGIN SECTION:
Clean up to save disk space on slaves
18:31:13 + rm -fr catkin_workspace/build_isolated
18:31:13 + rm -fr catkin_workspace/devel_isolated
18:31:13 + rm -fr catkin_workspace/install_isolated
18:31:13 + echo # END SECTION
18:31:13 # END SECTION
18:31:13 [WARNINGS]Parsing warnings in console log with parser GNU C Compiler 4 (gcc)
18:31:13 [WARNINGS]Computing warning deltas based on reference build #2
18:31:13 [xUnit] [INFO] - Starting to record.
18:31:13 [xUnit] [INFO] - Processing GoogleTest-1.6
18:31:13 [xUnit] [INFO] - [GoogleTest-1.6] - 11 test report file(s) were found with the pattern 'catkin_workspace/test_results/**/*.xml' relative to '/home/jenkins-slave/workspace/Ipr__rtmros_nextage__ubuntu_trusty_amd64' for the testing framework 'GoogleTest-1.6'.
18:31:13 [xUnit] [INFO] - Converting '/home/jenkins-slave/workspace/Ipr__rtmros_nextage__ubuntu_trusty_amd64/catkin_workspace/test_results/nextage_gazebo/rostest-test_gz.xml' .
18:31:13 [xUnit] [INFO] - Converting '/home/jenkins-slave/workspace/Ipr__rtmros_nextage__ubuntu_trusty_amd64/catkin_workspace/test_results/nextage_gazebo/rosunit-test_gz.xml' .
18:31:13 [xUnit] [INFO] - Converting '/home/jenkins-slave/workspace/Ipr__rtmros_nextage__ubuntu_trusty_amd64/catkin_workspace/test_results/nextage_moveit_config/rostest-test_joy.xml' .
18:31:13 [xUnit] [INFO] - Converting '/home/jenkins-slave/workspace/Ipr__rtmros_nextage__ubuntu_trusty_amd64/catkin_workspace/test_results/nextage_moveit_config/rostest-test_nxo_moveit.xml' .
18:31:13 [xUnit] [INFO] - Converting '/home/jenkins-slave/workspace/Ipr__rtmros_nextage__ubuntu_trusty_amd64/catkin_workspace/test_results/nextage_moveit_config/rosunit-hz_moveplan_joy.xml' .
18:31:13 [xUnit] [INFO] - Converting '/home/jenkins-slave/workspace/Ipr__rtmros_nextage__ubuntu_trusty_amd64/catkin_workspace/test_results/nextage_moveit_config/rosunit-nxo_moveit.xml' .
18:31:13 [xUnit] [ERROR] - Conversion error Error to convert - A file not found
18:31:13 ERROR: Step ‘Publish xUnit test result report’ aborted due to exception: 
18:31:13 java.io.IOException: remote file operation failed: /home/jenkins-slave/workspace/Ipr__rtmros_nextage__ubuntu_trusty_amd64 at hudson.remoting.Channel@73d6a4f4:ip-172-31-15-104.us-west-1.compute.internal: hudson.util.IOException2: There are some problems during the conversion into JUnit reports: 
18:31:13    at hudson.FilePath.act(FilePath.java:986)
18:31:13    at hudson.FilePath.act(FilePath.java:968)
18:31:13    at org.jenkinsci.plugins.xunit.XUnitProcessor.performTests(XUnitProcessor.java:145)
18:31:13    at org.jenkinsci.plugins.xunit.XUnitProcessor.performXUnit(XUnitProcessor.java:88)
18:31:13    at org.jenkinsci.plugins.xunit.XUnitPublisher.perform(XUnitPublisher.java:142)
18:31:13    at org.jenkinsci.plugins.xunit.XUnitPublisher.perform(XUnitPublisher.java:134)
18:31:13    at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
18:31:13    at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:782)
18:31:13    at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:723)
18:31:13    at hudson.model.Build$BuildExecution.post2(Build.java:185)
18:31:13    at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:668)
18:31:13 ...

(more)