Ask Your Question
0

Different versions of python3-catkin-pkg-modules are distributed on packages.ros.org

asked 2020-05-18 06:50:24 -0500

Kenji Miyake gravatar image

It seems different versions of python3-catkin-pkg-modulesare distributed on packages.ros.org. Therefore, when I tried to install python3-catkin-pkg-modules, sometimes it fails, and sometimes succeeds.

Environment

  • Ubuntu 18.04
  • ROS Melodic

How to reproduce the problem

$ docker run --rm -it ubuntu:18.04 /bin/sh

# apt update && apt install -y lsb-release gnupg
# sh -c 'echo "deb http://packages.ros.org/ros/ubuntu $(lsb_release -sc) main" > /etc/apt/sources.list.d/ros-latest.list'
# apt-key adv --keyserver 'hkp://keyserver.ubuntu.com:80' --recv-key C1CF6E31E6BADE8868B172B4F42ED6FBAB17C654
# apt update
# apt install -y python3-catkin-pkg-modules
Reading package lists... Done
Building dependency tree       
Reading state information... Done
The following additional packages will be installed:
  docutils-common libfreetype6 libjbig0 libjpeg-turbo8 libjpeg8 liblcms2-2 libpaper-utils libpaper1
  libpng16-16 libtiff5 libwebp6 libwebpdemux2 libwebpmux3 multiarch-support python3-dateutil
  python3-docutils python3-olefile python3-pil python3-pkg-resources python3-pygments python3-pyparsing
  python3-roman python3-six sgml-base tzdata ucf xml-core
Suggested packages:
  liblcms2-utils docutils-doc fonts-linuxlibertine | ttf-linux-libertine texlive-lang-french
  texlive-latex-base texlive-latex-recommended python-pil-doc python3-pil-dbg python3-setuptools
  ttf-bitstream-vera python-pyparsing-doc sgml-base-doc debhelper
The following NEW packages will be installed:
  docutils-common libfreetype6 libjbig0 libjpeg-turbo8 libjpeg8 liblcms2-2 libpaper-utils libpaper1
  libpng16-16 libtiff5 libwebp6 libwebpdemux2 libwebpmux3 multiarch-support python3-catkin-pkg-modules
  python3-dateutil python3-docutils python3-olefile python3-pil python3-pkg-resources python3-pygments
  python3-pyparsing python3-roman python3-six sgml-base tzdata ucf xml-core
0 upgraded, 28 newly installed, 0 to remove and 16 not upgraded.
Need to get 42.0 kB/3179 kB of archives.
After this operation, 15.7 MB of additional disk space will be used.
Err:1 http://packages.ros.org/ros/ubuntu bionic/main amd64 python3-catkin-pkg-modules all 0.4.20-1
  404  Not Found [IP: 64.50.236.52 80]
E: Failed to fetch http://packages.ros.org/ros/ubuntu/pool/main/p/python3-catkin-pkg-modules/python3-catkin-pkg-modules_0.4.20-1_all.deb  404  Not Found [IP: 64.50.236.52 80]
E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?

# apt install -y python3-catkin-pkg-modules # try again
Reading package lists... Done
Building dependency tree       
Reading state information... Done
The following additional packages will be installed:
  docutils-common libfreetype6 libjbig0 libjpeg-turbo8 libjpeg8 liblcms2-2 libpaper-utils libpaper1
  libpng16-16 libtiff5 libwebp6 libwebpdemux2 libwebpmux3 multiarch-support python3-dateutil
  python3-docutils python3-olefile python3-pil python3-pkg-resources python3-pygments
  python3-pyparsing python3-roman python3-six sgml-base tzdata ucf xml-core
Suggested packages:
  liblcms2-utils docutils-doc fonts-linuxlibertine | ttf-linux-libertine texlive-lang-french
  texlive-latex-base texlive-latex-recommended python-pil-doc python3-pil-dbg python3-setuptools
  ttf-bitstream-vera python-pyparsing-doc sgml-base-doc debhelper
The following NEW packages will be installed:
  docutils-common libfreetype6 libjbig0 libjpeg-turbo8 libjpeg8 liblcms2-2 libpaper-utils libpaper1
  libpng16-16 libtiff5 libwebp6 libwebpdemux2 libwebpmux3 multiarch-support python3-catkin-pkg-modules
  python3-dateutil python3-docutils python3-olefile python3-pil python3-pkg-resources python3-pygments
  python3-pyparsing python3-roman python3-six sgml-base tzdata ucf xml-core
0 upgraded, 28 newly installed, 0 to remove and 16 not upgraded.
Need to get 41.8 kB/3179 kB of archives.
After this operation, 15.7 MB of additional disk space will be used.
Get:1 http://packages.ros.org/ros/ubuntu bionic/main amd64 python3-catkin-pkg-modules all 0.4.18-1 [41.8 kB]
Fetched 41.8 kB in 6s (7383 B/s)

Investigation

I can see that there are three addresses for packages.ros.org.

$ host packages.ros.org
packages.ros.org is an alias for ftp.osuosl.org.
ftp.osuosl.org has address 64.50.233.100
ftp.osuosl.org has address 140.211.166.134
ftp.osuosl.org ...
(more)
edit retag flag offensive close merge delete

Comments

I've seen this as well, but for python3-vcstool (ros-industrial/industrial_ci#509 and ros-industrial-consortium/tesseract#292).

I can see that there are three addresses for packages.ros.org.

this could be an issue with round-robin DNS and not all hosts being in-sync.

Is this the correct state, or did I made any mistakes?

No, I believe your analysis is correct.

We'll have to wait for either:

  1. the hosts to get back in sync by themselves, or
  2. the admin(s) of the hosts to force them to sync

@tfoote@nuclearsandwich?


Edit: now also on ROS Discourse: comment on Preparing for Kinetic Sync 2020-05-13.

gvdhoorn gravatar image gvdhoorn  ( 2020-05-18 06:59:56 -0500 )edit

Thank you for your quick reply. I'll watch the discourse thread.

Could you tell me whether this is an accidental problem or could happen regularly?

this could be an issue with round-robin DNS and not all hosts being in-sync.

Do you mean that this kind of problem can frequently happen right after releasing a new version?
If so, do you know about how long we should wait for syncing?
Also, what is the best way to let admins know the problem when I find it? (As you did, replying to the Preparing thread?)

Kenji Miyake gravatar image Kenji Miyake  ( 2020-05-18 09:29:17 -0500 )edit

Could you tell me whether this is an accidental problem or could happen regularly?

This is the first time this has happened, IIRC.

Do you mean that this kind of problem can frequently happen right after releasing a new version?

No, that's not what I meant. What I wrote is that it seems there is a round-robin DNS configuration and in this particular case one of the hosts involved in that seems to have gone out-of-sync with the others.

If so, do you know about how long we should wait for syncing?

I would not know.

Also, what is the best way to let admins know the problem when I find it?

Posting either here or on ROS Discourse, maybe in the Packaging and Release Management category. Or perhaps the Buildfarm category.

gvdhoorn gravatar image gvdhoorn  ( 2020-05-18 11:36:21 -0500 )edit
gvdhoorn gravatar image gvdhoorn  ( 2020-05-18 13:42:19 -0500 )edit

I understand, thank you! I'll wait for a while and check again after it's fixed.

Kenji Miyake gravatar image Kenji Miyake  ( 2020-05-18 18:28:22 -0500 )edit

Oh, now 64.50.236.52 seems to be synced. Will check other packages as well for just in case.

Kenji Miyake gravatar image Kenji Miyake  ( 2020-05-18 18:32:07 -0500 )edit

I've tried the installation of ROS melodic + colcon several times using docker, and it seems working correctly.

Kenji Miyake gravatar image Kenji Miyake  ( 2020-05-18 22:24:13 -0500 )edit

1 Answer

Sort by ยป oldest newest most voted
0

answered 2020-05-19 01:53:58 -0500

gvdhoorn gravatar image

According to Incident Report for ROS: packages.ros.org mirrors out of sync, this should now be fixed:

Resolved

The mirrors are re-synchronized.

Original incident report:

We have identified that one of our 3 mirrors of packages.ros.org is out of sync. We're working with our hosting provider to bring the new one up to date.

edit flag offensive delete link more

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Question Tools

1 follower

Stats

Asked: 2020-05-18 06:50:24 -0500

Seen: 53 times

Last updated: May 19