[DBWG] AFRINIC RPKI RRDP connectivity issues?

Wed May 17 17:20:03 UTC 2023

On Wed, May 17, 2023 at 10:05:11AM -0700, S. Moonesamy wrote:
> I ran a quick test (please see rpki-client output below).  I was unable to
> reproduce the issue which you encountered.  I'll contact you off-list.

The problem seems to for validators outside the African continent: the download
speed for various places around the world is between 20 and 50 kilobytes/sec -
which is too slow to load the 35 megabyte snapshot file in a timely fashion.

If you are getting good results, and I am not (from multiple vantage points), I
suspect there is a heavily congested network interface somewhere in Afrinic's
network affecting far-away international clients.

Times in UTC

Singapore:

	May 17 16:50:07 rpki-client: https://rrdp.afrinic.net/notification.xml: downloading snapshot (11218e02-4ae9-4c95-a8fa-49df27f15272#72928)
	May 17 17:05:03 rpki-client: rsync://rpki.afrinic.net/repository: synchronisation timeout
	May 17 17:05:06 rpki-client: https://rrdp.afrinic.net/11218e02-4ae9-4c95-a8fa-49df27f15272/72928/snapshot...  (196.216.2.29): data write: Broken pipe
	May 17 17:05:06 rpki-client: https://rrdp.afrinic.net/notification.xml: load from network failed, fallback to rsync

sng-vrp-gen1# traceroute rrdp.afrinic.net
traceroute to rrdp.afrinic.net (196.216.2.29), 64 hops max, 40 byte packets
 1  * * *
 2  10.76.194.78 (10.76.194.78)  0.782 ms 10.76.194.68 (10.76.194.68)  0.648 ms 10.76.194.78 (10.76.194.78)  0.497 ms
 3  143.198.252.2 (143.198.252.2)  0.418 ms 143.198.252.4 (143.198.252.4)  0.37 ms 143.198.252.0 (143.198.252.0)  0.366 ms
 4  143.244.192.90 (143.244.192.90)  0.378 ms 143.244.192.86 (143.244.192.86)  0.46 ms 143.244.192.88 (143.244.192.88)  0.346 ms
 5  143.244.224.230 (143.244.224.230)  0.854 ms  0.829 ms 143.244.224.232 (143.244.224.232)  0.937 ms
 6  143.244.224.213 (143.244.224.213)  0.672 ms 143.244.224.211 (143.244.224.211)  0.548 ms 143.244.224.207 (143.244.224.207)  0.526 ms
 7  * * ae-2.a01.sngpsi07.sg.bb.gin.ntt.net (116.51.17.193)  1.273 ms
 8  ae-11.r23.sngpsi07.sg.bb.gin.ntt.net (129.250.2.93)  1.266 ms  0.626 ms  1.335 ms
 9  ae-8.r21.vienat02.at.bb.gin.ntt.net (129.250.4.181)  154.425 ms  156.515 ms  158.127 ms
10  ae-0.r20.vienat02.at.bb.gin.ntt.net (129.250.7.12)  152.518 ms  153.388 ms ae-0.r21.mlanit02.it.bb.gin.ntt.net (129.250.3.157)  140.367 ms
11  ae-6.r21.frnkge13.de.bb.gin.ntt.net (129.250.3.183)  202.164 ms  219.692 ms ae-1.r20.frnkge13.de.bb.gin.ntt.net (129.250.7.35)  275.344 ms
12  ae-17.r00.frnkge13.de.bb.gin.ntt.net (129.250.6.42)  166.019 ms  164.068 ms  179.018 ms
13  ae-0.workonline.frnkge13.de.bb.gin.ntt.net (213.198.72.63)  156.251 ms  159.982 ms  158.261 ms
14  * * *
15  * * *
16  esr1-isd-cr1-te0-0-26.wolcomm.net (197.157.77.97)  229.994 ms  345.157 ms  318.425 ms
17  197.157.64.195 (197.157.64.195)  251.536 ms  281.221 ms *
18  196.216.2.29 (196.216.2.29)  266.103 ms !C  263.233 ms !C  269.606 ms !C

------------

Calgary, Canada:

	May 17 16:44:26 rpki-client: https://rrdp.afrinic.net/notification.xml: downloading snapshot (11218e02-4ae9-4c95-a8fa-49df27f15272#72928)
	May 17 16:59:14 rpki-client: rsync://rpki.afrinic.net/repository: synchronisation timeout
	May 17 16:59:14 rpki-client: https://rrdp.afrinic.net/11218e02-4ae9-4c95-a8fa-49df27f15272/72928/snapshot... (196.216.2.29): data write: Broken pipe

yyz-vrp-gen1# traceroute rrdp.afrinic.net
traceroute to rrdp.afrinic.net (196.216.2.29), 64 hops max, 40 byte packets
 1  162.243.190.9 (162.243.190.9)  0.546 ms  0.193 ms 162.243.190.8 (162.243.190.8)  0.254 ms
 2  143.198.252.192 (143.198.252.192)  1.581 ms  0.954 ms 143.198.252.196 (143.198.252.196)  0.39 ms
 3  168.143.228.10 (168.143.228.10)  18.583 ms  25.98 ms ae-5.a00.toroon02.ca.bb.gin.ntt.net (168.143.228.40)  0.792 ms
 4  ae-8.r21.nwrknj03.us.bb.gin.ntt.net (129.250.2.141)  12.546 ms  11.918 ms  12.142 ms
 5  * * *
 6  ae-9.r20.londen12.uk.bb.gin.ntt.net (129.250.6.146)  87.54 ms  82.012 ms  81.262 ms
 7  ae-1.r21.londen12.uk.bb.gin.ntt.net (129.250.2.183)  86.915 ms * *
 8  ae-1.r03.londen05.uk.bb.gin.ntt.net (129.250.6.113)  81.627 ms  86.876 ms  86.962 ms
 9  212.119.4.177 (212.119.4.177)  81.597 ms  86.713 ms  81.613 ms
10  * * *
11  cr1-lhx-et32.wolcomm.net (41.78.188.132)  264.913 ms 41.78.188.144 (41.78.188.144)  265.217 ms cr1-lhx-et32.wolcomm.net (41.78.188.132)  265.417 ms
12  esr1-isd-cr2-te0-0-27.wolcomm.net (197.157.77.101)  409.147 ms  372.739 ms esr1-isd-cr1-te0-0-26.wolcomm.net (197.157.77.97)  342.673 ms
13  197.157.64.195 (197.157.64.195)  305.842 ms  307.144 ms  305.254 ms
14  196.216.2.29 (196.216.2.29)  304.355 ms !C  311.057 ms !C  304.272 ms !C

------------

Amsterdam, Netherlands

	May 17 16:51:09 rpki-client: https://rrdp.afrinic.net/notification.xml: pulling from network
	May 17 16:51:11 rpki-client: https://rrdp.afrinic.net/notification.xml: downloading snapshot (11218e02-4ae9-4c95-a8fa-49df27f15272#72928)
	May 17 17:06:08 rpki-client: rsync://rpki.afrinic.net/repository: synchronisation timeout
	May 17 17:06:09 rpki-client: https://rrdp.afrinic.net/11218e02-4ae9-4c95-a8fa-49df27f15272/72928/snapshot... (196.216.2.29): data write: Broken pipe

ams-vrp-gen1# traceroute rrdp.afrinic.net
traceroute to rrdp.afrinic.net (196.216.2.29), 64 hops max, 40 byte packets
 1  * * *
 2  10.82.4.44 (10.82.4.44)  0.691 ms 10.82.4.34 (10.82.4.34)  0.412 ms 10.82.4.42 (10.82.4.42)  0.425 ms
 3  138.197.250.98 (138.197.250.98)  0.484 ms 138.197.250.112 (138.197.250.112)  0.391 ms  0.288 ms
 4  138.197.250.94 (138.197.250.94)  0.611 ms 138.197.250.80 (138.197.250.80)  6.431 ms 138.197.250.84 (138.197.250.84)  3.137 ms
 5  80.249.213.52 (80.249.213.52)  1.168 ms  0.897 ms  1.061 ms
 6  cr2-fxn-et49-1.wolcomm.net (41.78.188.129)  186.436 ms  186.359 ms  186.437 ms
 7  * * *
 8  cr1-lhx-et32.wolcomm.net (41.78.188.132)  181.037 ms  180.832 ms  180.78 ms
 9  esr1-isd-cr1-te0-0-26.wolcomm.net (197.157.77.97)  237.952 ms  198.831 ms  273.428 ms
10  197.157.64.195 (197.157.64.195)  222.852 ms * *
11  196.216.2.29 (196.216.2.29)  223.609 ms !C  223.981 ms !C  221.937 ms !C