Date: Sat, 12 Jan 2013 16:21:18 +1100 From: John Marshall <john.marshall@riverwillow.com.au> To: freebsd-hubs@freebsd.org Subject: SLOW rsync from bit0.us-west Message-ID: <50F0F2CE.9050605@riverwillow.com.au>
next in thread | raw e-mail | index | archive | help
This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig1934F8F4CDBEB9CDE5AE8380 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable I have been updating the gnats collection on our mirror via rsync since the CVSup updates stopped but noticed this morning that the updates appeared to be stalled. I killed off jobs that appeared to be stuck downloading incremental file list (after about 20 minutes) but then thought to run rsync manually with -vvv. What I saw then was short bursts of messages like 'recv_file_name(bin/nnnn)' interspersed with 15-20 seconds of nothing. tcpdump showed just a handful of packets every 15 seconds or so. The update eventually finished after more than 2 hours.= I ran the rsync again after about 10 minutes with only a single -v and included --stats in the command line. This time it took only 1 hour to update 9 files and produced the following output. ozsrv03# rsync -avz --stats bit0.us-west.freebsd.org::FreeBSD-bit/gnats/ /freebsd/current/gnats/gnats This is bit0.us-west.FreeBSD.org. receiving incremental file list bin/ bin/175214 docs/ docs/175224 gnats-adm/ gnats-adm/current gnats-adm/index gnats-adm/locks/ kern/ kern/151564 kern/152250 kern/153361 ports/175221 ports/175222 Number of files: 174424 Number of files transferred: 9 Total file size: 1738253321 bytes Total transferred file size: 33819340 bytes Literal data: 70300 bytes Matched data: 33749040 bytes File list size: 1967813 File list generation time: 0.075 seconds File list transfer time: 0.000 seconds Total bytes sent: 41303 Total bytes received: 1989084 sent 41303 bytes received 1989084 bytes 612.76 bytes/sec total size is 1738253321 speedup is 856.12 The network isn't any worse than usual. We have a 100Mbps connection and latency across the Pacific Ocean from Australia is normal (~170ms RTT). ozsrv03# ping -qc 3 bit0.us-west.FreeBSD.org. PING bit0.ysv.FreeBSD.org (8.8.178.111): 56 data bytes --- bit0.ysv.FreeBSD.org ping statistics --- 3 packets transmitted, 3 packets received, 0.0% packet loss round-trip min/avg/max/stddev =3D 168.805/168.922/169.023/0.090 ms Is it just me? --=20 John Marshall --------------enig1934F8F4CDBEB9CDE5AE8380 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.19 (FreeBSD) iEYEARECAAYFAlDw8toACgkQw/tAaKKahKI2vQCfflahqcu2k/Zw9/vRO/K699oT 4FYAn1ufXTkoIo1LQs/Gu9DVVatKNnpH =eMgk -----END PGP SIGNATURE----- --------------enig1934F8F4CDBEB9CDE5AE8380--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?50F0F2CE.9050605>