ROS Resources: Documentation | Support | Discussion Forum | Index | Service Status | Q&A
Ask Your Question

Buildfarm remote execution scaling

asked 2022-06-22 12:03:19 -0500

durosu1 gravatar image

I'm using the latest Buildfarm version. I managed to setup remote execution with Bazel. I can see the build time improvement (~25%) when I add the second remote server/worker. Beyond that, adding worker/server 3 and 4 does not improve the build time almost at all.

So there is a bottleneck somewhere but I could not figure out where. My buildfarm server config and the worker config are slightly modified example configs. (Higher cache limits, timeouts, cores)

Note: For this comparison I was building with the caching disabled --noremote_accept_cached.

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2022-06-22 22:56:19 -0500

tfoote gravatar image

There's likely a bottleneck. The first place to look is likely in the ability of Bazel to parallelize the specific package that you're attempting to build. Not all build steps can be parallelized so adding more workers beyond the maximum level of parallelization won't continue to result in faster builds.

edit flag offensive delete link more

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Question Tools

1 follower


Asked: 2022-06-22 12:03:19 -0500

Seen: 39 times

Last updated: Jun 22 '22