From owner-freebsd-hubs@FreeBSD.ORG Thu Apr 19 18:51:36 2007 Return-Path: X-Original-To: hubs@freebsd.org Delivered-To: freebsd-hubs@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 5E3FB16A406 for ; Thu, 19 Apr 2007 18:51:36 +0000 (UTC) (envelope-from peter@wemm.org) Received: from canning.wemm.org (canning.wemm.org [192.203.228.65]) by mx1.freebsd.org (Postfix) with ESMTP id 4F30D13C465 for ; Thu, 19 Apr 2007 18:51:36 +0000 (UTC) (envelope-from peter@wemm.org) Received: from [10.0.0.84] (canning.wemm.org [192.203.228.65]) by canning.wemm.org (Postfix) with ESMTP id EBF9546B86 for ; Thu, 19 Apr 2007 11:32:32 -0700 (PDT) (envelope-from peter@wemm.org) Message-ID: <4627B539.2030908@wemm.org> Date: Thu, 19 Apr 2007 11:30:17 -0700 From: Peter Wemm User-Agent: Thunderbird 1.5.0.10 (Macintosh/20070221) MIME-Version: 1.0 To: hubs@freebsd.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: Subject: ftp-master down for a few hours X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 Apr 2007 18:51:36 -0000 The new ftp-master hardware is online and data is being copied. Things should be much much much faster once this is finished. The old old ftp-master was a 3ware-based 8x80G raid5 box with roughly 480G space (1 spare, which got used). It had a multi-drive failure and died. The temporary ftp-master was serving the ftp archive from a netapp via nfs. This was far from satisfactory because the machine had nowhere near enough ram to cache stuff. Any rsync operations caused a huge amount of nfs traffic. The netapp for the cluster was running at 100% load nearly 24x7. I wrote a cvsup scan generator a while back and that helped the cvsup clients considerably, but it still sucked in general. It had 1 pentium4 cpu with 1G ram. The new machine is a dell 2850 with 4 cores, 6x300G scsi drives set up as a 1.2TB raid5 and 4G ram. It should be several orders of magnitude of an improvement over the temporary arrangement. So, there are a couple of things to watch out for. 1) I expect all the timestamps and attributes to be preserved, but it is possible that some might get touched. There may be an initial round of rsync/touch activity. I hope not though. 2) the old array was 480G, and is now 1.2TB. I suspect that the archive will bloat a bit more as we have future releases, ports packages, etc. 7.x is coming up soon etc. There won't be a hard limit to force the poor release engineers to juggle things around to cram it on anymore so I'd expect it to tend to expand over time. 3) there might be a separate ftp-archive for old releases being able to be served from here, but that depends on what Ken wants to do. So anyway, apologies for the lack of notice for the outage, but it should be worth it. -Peter