From owner-freebsd-hackers@FreeBSD.ORG Sun Oct 24 15:19:05 2010 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8EA82106564A for ; Sun, 24 Oct 2010 15:19:05 +0000 (UTC) (envelope-from m.seaman@infracaninophile.co.uk) Received: from smtp.infracaninophile.co.uk (smtp6.infracaninophile.co.uk [IPv6:2001:8b0:151:1:3fd3:cd67:fafa:3d78]) by mx1.freebsd.org (Postfix) with ESMTP id 76E438FC19 for ; Sun, 24 Oct 2010 15:19:04 +0000 (UTC) Received: from seedling.black-earth.co.uk (seedling.black-earth.co.uk [81.187.76.163]) (authenticated bits=0) by smtp.infracaninophile.co.uk (8.14.4/8.14.4) with ESMTP id o9OFIxmY033434 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Sun, 24 Oct 2010 16:18:59 +0100 (BST) (envelope-from m.seaman@infracaninophile.co.uk) X-DKIM: Sendmail DKIM Filter v2.8.3 smtp.infracaninophile.co.uk o9OFIxmY033434 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=infracaninophile.co.uk; s=201001-infracaninophile; t=1287933539; bh=fA95/ksXbMhpZvoPTv797ZupRiMBo1BZNGTNZm08cjQ=; h=Message-ID:Date:From:MIME-Version:To:CC:Subject:References: In-Reply-To:Content-Type:Cc:Content-Type:Date:From:In-Reply-To: Message-ID:Mime-Version:References:To; z=Message-ID:=20<4CC44E5B.9040902@infracaninophile.co.uk>|Date:=20S un,=2024=20Oct=202010=2016:18:51=20+0100|From:=20Matthew=20Seaman= 20|Organization:=20Infracaninophi le|User-Agent:=20Mozilla/5.0=20(Macintosh=3B=20U=3B=20Intel=20Mac= 20OS=20X=2010.6=3B=20en-GB=3B=20rv:1.9.2.11)=20Gecko/20101013=20Th underbird/3.1.5|MIME-Version:=201.0|To:=20cronfy=20|CC:=20freebsd-hackers@freebsd.org|Subject:=20Re:=20Slow=20disk =20access=20while=20rsync=20-=20what=20should=20I=20tune?|Referenc es:=20|In-Reply-To:=20|X-Enigmail-Version:=201.1.1|OpenPGP:=20id=3D60A E908C|Content-Type:=20multipart/signed=3B=20micalg=3Dpgp-sha1=3B=0 D=0A=20protocol=3D"application/pgp-signature"=3B=0D=0A=20boundary= 3D"------------enigA9CEBDD7A4FDFC2DAD3E6A7B"; b=l9/oCnepfVpMdSUeMqgSbU135xXCyxuLDTLfSeCaB3rTdj6yo2tm6FCCNGK/uikHC XP/HXvQzftCNWpIeMxqwEoUXfHMnvsXSzMupyug2Y0eQRpUEpis2bLAQOK9n6ETIpH kaZXXCvzH1CqIjCj8FlZy3xqXa+3gerOkRn0VFn4= Message-ID: <4CC44E5B.9040902@infracaninophile.co.uk> Date: Sun, 24 Oct 2010 16:18:51 +0100 From: Matthew Seaman Organization: Infracaninophile User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-GB; rv:1.9.2.11) Gecko/20101013 Thunderbird/3.1.5 MIME-Version: 1.0 To: cronfy References: In-Reply-To: X-Enigmail-Version: 1.1.1 OpenPGP: id=60AE908C Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enigA9CEBDD7A4FDFC2DAD3E6A7B" X-Virus-Scanned: clamav-milter 0.96.3 at lucid-nonsense.infracaninophile.co.uk X-Virus-Status: Clean X-Spam-Status: No, score=-0.1 required=5.0 tests=BAYES_40,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,SPF_FAIL autolearn=no version=3.3.1 X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on lucid-nonsense.infracaninophile.co.uk Cc: freebsd-hackers@freebsd.org Subject: Re: Slow disk access while rsync - what should I tune? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 24 Oct 2010 15:19:05 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enigA9CEBDD7A4FDFC2DAD3E6A7B Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable On 24/10/2010 14:15, cronfy wrote: > I tried to enable async (in hope it will make rsync faster) or even > disable softupdates on /backup partition (in hope it will make rsync > slower and OS filesytem cache will not be flushed by backups), it did > not help. I also want to try to upgrate to Adaptec 5405 (it has 256M > of write cache) or move mysql databases on a separate SAS disk, but I > just not quite sure what will help better. rsync has standard options to limit the bandwidth it will consume. Making it write through a narrow pipe will also slow down the rate of disk accesses, so should help control the impact on other services on the machine. However, taking backups slowly makes it harder to ensure you have a consistent backup, so I recommend you investigate snapshotting the filesystem (well supported for UFS, trivially easy for ZFS) and then backup the snapshot as slowly as you like. Cheers, Matthew --=20 Dr Matthew J Seaman MA, D.Phil. 7 Priory Courtyard Flat 3 PGP: http://www.infracaninophile.co.uk/pgpkey Ramsgate JID: matthew@infracaninophile.co.uk Kent, CT11 9PW --------------enigA9CEBDD7A4FDFC2DAD3E6A7B Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.0.14 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAkzETmIACgkQ8Mjk52CukIxXLwCdFNhbjn8AE59ablYpmbF/pwET nqIAn1q3+QHg0psXmBDlllt3K/uusjj+ =f+KB -----END PGP SIGNATURE----- --------------enigA9CEBDD7A4FDFC2DAD3E6A7B--