From owner-freebsd-hubs@FreeBSD.ORG Sat May 24 23:54:29 2014 Return-Path: Delivered-To: hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 14E24BED for ; Sat, 24 May 2014 23:54:29 +0000 (UTC) Received: from smtp2.wemm.org (smtp2.wemm.org [IPv6:2001:470:67:39d::78]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smtp2.wemm.org", Issuer "StartCom Class 1 Primary Intermediate Server CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id E6DD428EE for ; Sat, 24 May 2014 23:54:28 +0000 (UTC) Received: from [172.16.26.29] (50-204-120-225-static.hfc.comcastbusiness.net [50.204.120.225]) (using TLSv1 with cipher ECDHE-RSA-AES128-SHA (128/128 bits)) (Client did not present a certificate) (Authenticated sender: peter) by smtp2.wemm.org (Postfix) with ESMTPSA id 7D817649 for ; Sat, 24 May 2014 16:54:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=wemm.org; s=m20140428; t=1400975667; bh=m76E73XQT7nH+7wiyyqD636MVjbpyEUxObEmBlMUmQw=; h=Date:From:To:Subject; b=fF3R2lzJY+Dmc8+xVg/Uy5IoZ6VCg0uTphFXewmPYQbvlh8RxCL6HH7ibvjo3Z/sc JWt53/lGfHiFfn+e+0C9w+1yt11BHRfZAxO3pUXqMO+cSz6lzqOMQ5AzufoFHbt7hr IrNN47rC+bjDhANc57SSHd6my/gNFTH8oUNtZ1Mw= Message-ID: <53813134.7090901@wemm.org> Date: Sat, 24 May 2014 16:54:28 -0700 From: Peter Wemm User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:24.0) Gecko/20100101 Thunderbird/24.5.0 MIME-Version: 1.0 To: hubs@freebsd.org Subject: HEADS UP: people running www.freebsd.org mirrors! Switch from cvsup to rsync please. Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 May 2014 23:54:29 -0000 If you are running a www mirror that is being updated via cvsup, *please stop* and switch to rsync. Right now, the data flow is like this: build-web --rsync--> bit0.us-west.freebsd.org -+-rsync--> cvsup-master --cvsup--> mirrors +-rsync--> www.freebsd.org You can skip a whole lot of detouring of data by elinimating cvsup from your mirror feeds and fetching it directly from bit0.us-west.freebsd.org # rsync rsync://bit0.us-west.freebsd.org/FreeBSD-www-data/ This is bit0.us-west.FreeBSD.org. drwxrwxr-x 1,536 2014/05/24 23:21:03 . -rw-rw-r-- 10,290 2014/05/24 23:20:31 4xx.html -rw-rw-r-- 10,317 2014/05/24 23:20:31 5xx.html -rw-rw-r-- 14,015 2014/05/24 23:20:31 about.html .... To switch, please use something like this: $ rsync -aHz --delete rsync://bit0.us-west.freebsd.org/FreeBSD-www-data/ /home/mirror/www-data/ of note, -H for tracking hard links, and --delete to clean up old files. Don't run rsync as root, etc etc. However I would like to make a plea here. Please take a peek at your server's traffic logs to check that it makes sense to keep the mirror going and that it's not just bots. I'm aware that people run them for a variety of reasons (anything from language variants to local content to improving latency to participating in the community etc), but please don't feel obligated to keep running one if there is no longer a reason. A neglected mirror is far worse than no mirror. Even worse, we risk being penalized in search engines for duplicated content because it looks like spam to certain algorithms. If it's time to stop, contact the hostmaster for your zone and have the dns and mirror lists updated. Please don't let them go to dead air. -Peter