Different versions of python3-catkin-pkg-modules are distributed on packages.ros.org

asked 2020-05-18 06:50:24 -0600

Kenji Miyake
307 ●3 ●21 ●17

It seems different versions of python3-catkin-pkg-modulesare distributed on packages.ros.org. Therefore, when I tried to install python3-catkin-pkg-modules, sometimes it fails, and sometimes succeeds.

Environment

Ubuntu 18.04
ROS Melodic

How to reproduce the problem

$ docker run --rm -it ubuntu:18.04 /bin/sh

# apt update && apt install -y lsb-release gnupg
# sh -c 'echo "deb http://packages.ros.org/ros/ubuntu $(lsb_release -sc) main" > /etc/apt/sources.list.d/ros-latest.list'
# apt-key adv --keyserver 'hkp://keyserver.ubuntu.com:80' --recv-key C1CF6E31E6BADE8868B172B4F42ED6FBAB17C654
# apt update
# apt install -y python3-catkin-pkg-modules
Reading package lists... Done
Building dependency tree       
Reading state information... Done
The following additional packages will be installed:
  docutils-common libfreetype6 libjbig0 libjpeg-turbo8 libjpeg8 liblcms2-2 libpaper-utils libpaper1
  libpng16-16 libtiff5 libwebp6 libwebpdemux2 libwebpmux3 multiarch-support python3-dateutil
  python3-docutils python3-olefile python3-pil python3-pkg-resources python3-pygments python3-pyparsing
  python3-roman python3-six sgml-base tzdata ucf xml-core
Suggested packages:
  liblcms2-utils docutils-doc fonts-linuxlibertine | ttf-linux-libertine texlive-lang-french
  texlive-latex-base texlive-latex-recommended python-pil-doc python3-pil-dbg python3-setuptools
  ttf-bitstream-vera python-pyparsing-doc sgml-base-doc debhelper
The following NEW packages will be installed:
  docutils-common libfreetype6 libjbig0 libjpeg-turbo8 libjpeg8 liblcms2-2 libpaper-utils libpaper1
  libpng16-16 libtiff5 libwebp6 libwebpdemux2 libwebpmux3 multiarch-support python3-catkin-pkg-modules
  python3-dateutil python3-docutils python3-olefile python3-pil python3-pkg-resources python3-pygments
  python3-pyparsing python3-roman python3-six sgml-base tzdata ucf xml-core
0 upgraded, 28 newly installed, 0 to remove and 16 not upgraded.
Need to get 42.0 kB/3179 kB of archives.
After this operation, 15.7 MB of additional disk space will be used.
Err:1 http://packages.ros.org/ros/ubuntu bionic/main amd64 python3-catkin-pkg-modules all 0.4.20-1
  404  Not Found [IP: 64.50.236.52 80]
E: Failed to fetch http://packages.ros.org/ros/ubuntu/pool/main/p/python3-catkin-pkg-modules/python3-catkin-pkg-modules_0.4.20-1_all.deb  404  Not Found [IP: 64.50.236.52 80]
E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?

# apt install -y python3-catkin-pkg-modules # try again
Reading package lists... Done
Building dependency tree       
Reading state information... Done
The following additional packages will be installed:
  docutils-common libfreetype6 libjbig0 libjpeg-turbo8 libjpeg8 liblcms2-2 libpaper-utils libpaper1
  libpng16-16 libtiff5 libwebp6 libwebpdemux2 libwebpmux3 multiarch-support python3-dateutil
  python3-docutils python3-olefile python3-pil python3-pkg-resources python3-pygments
  python3-pyparsing python3-roman python3-six sgml-base tzdata ucf xml-core
Suggested packages:
  liblcms2-utils docutils-doc fonts-linuxlibertine | ttf-linux-libertine texlive-lang-french
  texlive-latex-base texlive-latex-recommended python-pil-doc python3-pil-dbg python3-setuptools
  ttf-bitstream-vera python-pyparsing-doc sgml-base-doc debhelper
The following NEW packages will be installed:
  docutils-common libfreetype6 libjbig0 libjpeg-turbo8 libjpeg8 liblcms2-2 libpaper-utils libpaper1
  libpng16-16 libtiff5 libwebp6 libwebpdemux2 libwebpmux3 multiarch-support python3-catkin-pkg-modules
  python3-dateutil python3-docutils python3-olefile python3-pil python3-pkg-resources python3-pygments
  python3-pyparsing python3-roman python3-six sgml-base tzdata ucf xml-core
0 upgraded, 28 newly installed, 0 to remove and 16 not upgraded.
Need to get 41.8 kB/3179 kB of archives.
After this operation, 15.7 MB of additional disk space will be used.
Get:1 http://packages.ros.org/ros/ubuntu bionic/main amd64 python3-catkin-pkg-modules all 0.4.18-1 [41.8 kB]
Fetched 41.8 kB in 6s (7383 B/s)

Investigation

I can see that there are three addresses for packages.ros.org.

$ host packages.ros.org
packages.ros.org is an alias for ftp.osuosl.org.
ftp.osuosl.org has address 64.50.233.100
ftp.osuosl.org has address 140.211.166.134
ftp.osuosl.org ...

(more)

edit retag flag offensive close merge delete

Comments

I've seen this as well, but for python3-vcstool (ros-industrial/industrial_ci#509 and ros-industrial-consortium/tesseract#292).

I can see that there are three addresses for packages.ros.org.

this could be an issue with round-robin DNS and not all hosts being in-sync.

Is this the correct state, or did I made any mistakes?

No, I believe your analysis is correct.

We'll have to wait for either:

the hosts to get back in sync by themselves, or
the admin(s) of the hosts to force them to sync

@tfoote @nuclearsandwich?

Edit: now also on ROS Discourse: comment on Preparing for Kinetic Sync 2020-05-13.

gvdhoorn ( 2020-05-18 06:59:56 -0600 )edit

Thank you for your quick reply. I'll watch the discourse thread.

Could you tell me whether this is an accidental problem or could happen regularly?

this could be an issue with round-robin DNS and not all hosts being in-sync.

Do you mean that this kind of problem can frequently happen right after releasing a new version?
If so, do you know about how long we should wait for syncing?
Also, what is the best way to let admins know the problem when I find it? (As you did, replying to the Preparing thread?)

Kenji Miyake ( 2020-05-18 09:29:17 -0600 )edit

Could you tell me whether this is an accidental problem or could happen regularly?

This is the first time this has happened, IIRC.

Do you mean that this kind of problem can frequently happen right after releasing a new version?

No, that's not what I meant. What I wrote is that it seems there is a round-robin DNS configuration and in this particular case one of the hosts involved in that seems to have gone out-of-sync with the others.