Date: Mon, 29 Sep 2014 00:09:54 -0700 From: Peter Wemm <peter@wemm.org> To: hubs@freebsd.org Subject: It's time to turn off your cvsup mirrors. Message-ID: <2287901.ilnitse8V3@overcee.wemm.org>
next in thread | raw e-mail | index | archive | help
[-- Attachment #1 --] It is time to turn off the remaining cvsup mirrors. For the record, here's the timeline overview of how we got here: Beginning of FreeBSD: cvs based. Used "sup(1)" to replicate, or CTM for batch processing though email. The CVS repository was CLOSED and *private* to committers-only. Non-committers could essentially only get src with releases. 1995-ish: John Polstra wrote cvsup to efficiently distribute the CVS tree. This provided incentive for the FreeBSD project to clean up our tainted CVS repository and open it to the world. CVSup essentially replaced CTM. (*1) 1995-1996: Extensive fan-out based cvsup distribution mechanism created by volunteers. 1996: rsync invented, cvsup grew rsync capabilities for repairs. (Had rsync existed a few years earlier, cvsup might never have existed) [Good times and many bikesheds later..] 2008: src tree switched from cvs to svn. Since then, doc, www ports have also switched. A temporary transition aide was written to export the svn tree into cvs, both as a fallback and to leverage the cvsup mirror network. 2008-2012: svn to cvs exporters ran, but were fragile. They required frequent repairs. They were written in python to a deprecated svn api. Considerable fear in updating the back-end svn servers resulted. 2012: (August) svn to cvs exporters began deprecation cycle including an EOL (end of 9.0, 8.3 and 7.4 support). https://wiki.freebsd.org/CvsIsDeprecated 2012: (September) security incident tainted exported cvs tree with no effective means to audit. Since they had been announced as deprecated, we decided that a top-of-branch review would have to do. The machine that ran the exporters was compromised. 2012: (October) a quick and dirty replacement svn to cvs exporter was hacked together. It no longer maintained 1:1 equivalence with svn. 2013: (Feb 28th) ports ceases being exported from svn to cvs entirely at EOL of 7.4. (ports had an explicit separate EOL schedule for this) 2014: (Feb 4th) An undiscovered maintenance error caused cvsup to completely stop being updated (some key files were owned by root, preventing updates by the normal non-privileged mirror user) 2014: (April 30) 8.3 EOL reached (the final milestone for cvsup EOL) 2014: (May 24) mirror switch from cvsup to native rsync announced. https://lists.freebsd.org/pipermail/freebsd-hubs/2014-May/002737.html 2014: (May 26) Problem from feb 4th discovered. On realizing that nobody had even noticed that cvsup was broken, the decision was made to shut down the exporter and cease entirely on May 31st. https://lists.freebsd.org/pipermail/freebsd-hubs/2014-May/002739.html 2014: (May 31) shutdown deadline reached. Contents were purged and archived on ftp.freebsd.org in /pub/FreeBSD/development/CVS-archive 2014: since then: server has been handing out an empty repository. A quick glance at the last 23 hours of logs shows the same mirrors are still reliably connecting to cvsup-master as before, mirroring nothing but that README file. 70 root@p32195-ipadfx41marunouchi.tokyo.ocn.ne.jp <kuriyama@freebsd.org> 24 root@radiogaga2.corbina.net <cvsup@corbina.net> 24 root@backups.absolight.net <mat@FreeBSD.org> 23 root@raines.cse.buffalo.edu <root@cvsup5.FreeBSD.org> 23 root@office.oberon.net <cvsup@cvsup8.de.FreeBSD.org> 23 root@ncvsup.twc.weather.com <mperrin@weather.com> 23 root@moss.cse.buffalo.edu <cvsup@cvsup-spare.FreeBSD.org> 23 root@mirror.dk.freebsd.org <fj@batmule.dk> 23 root@logan.cse.buffalo.edu <cvsupin@cvsup18.FreeBSD.org> 23 root@jbell.maths.tcd.ie <dwmalone@freebsd.org> 23 root@freebsd.twaren.net <tjs@cvsup3.tw.freebsd.org> 23 root@cvsup.ludd.ltu.se <adm@ludd.luth.se> 23 root@coupland.heanet.ie <cvsup@cvsup2.ie.FreeBSD.org> 23 root@akane.desync.com <cvsup@desync.com> 12 root@regency.nsu.ru <fjoe@iclub.nsu.ru> 3 root@daniel.thekeelecentre.com <cvsup@thekeelecentre.com> 1 root@gate.rabson.org <dfr@freebsd.org> 1 root@florida.sarang.net <holywar@mail.holywar.net> I will be attempting to contact people. If you have better contacts for these people than I have above, please forward this notice accordingly. If you are a hostmaster for a CC.freebsd.org zone, please use your contact information for your surviving cvsupN.CC.freebsd.org and reach out to them and forward this notice. You should be aiming to have the dns names removed. I am removing the cvsup-master dns name today and begin the process of archiving and recycling the servers. It had an outstanding run. Goodbye old friend, Long live CVSup! Footnotes: *1: CTM is still running. How ironic! -- Peter Wemm - peter@wemm.org; peter@FreeBSD.org; peter@yahoo-inc.com; KI6FJV UTF-8: for when a ' or ... just won\342\200\231t do\342\200\246 [-- Attachment #2 --] -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQEcBAABAgAGBQJUKQXHAAoJEDXWlwnsgJ4EmpcIANhqwGPiR9X9L/Wd3exf2N0J 502xBf67can72m8XMTIUQVt+ByJBz2AnPqt+DbynMkVO/qK82ylVu2Vp4tOBGN5c fgHMAexwiWUdHzBthDH0rFTa/UD89Rua9xU3JSUyegNbVijpmMTSKpSKZC0N99Lh 6tn91cwWF9ycxxaqXP8e+s+7Q+JU4htCT7Qs36fV1OjR/TDZRha4XLJQt47h5s/w xkZQgQaqK7g+knpB1Zsl8hBey/2xMB/le14066hAAFpSzCnT7KGlSK1b0yDtmOOz npG2WKPHjxqCmH4Bdy3RhNf+vvUy85kdmG0A30ei4kbs0CoSOPmhDcZ6/A9nxsw= =FHvV -----END PGP SIGNATURE-----
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?2287901.ilnitse8V3>