From owner-freebsd-fs@FreeBSD.ORG Fri Apr 5 21:13:05 2013 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 5DB04290 for ; Fri, 5 Apr 2013 21:13:05 +0000 (UTC) (envelope-from peter@rulingia.com) Received: from vps.rulingia.com (host-122-100-2-194.octopus.com.au [122.100.2.194]) by mx1.freebsd.org (Postfix) with ESMTP id D3B42DD2 for ; Fri, 5 Apr 2013 21:13:04 +0000 (UTC) Received: from server.rulingia.com (c220-239-237-213.belrs5.nsw.optusnet.com.au [220.239.237.213]) by vps.rulingia.com (8.14.5/8.14.5) with ESMTP id r35LCtmQ046740 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK); Sat, 6 Apr 2013 08:12:56 +1100 (EST) (envelope-from peter@rulingia.com) X-Bogosity: Ham, spamicity=0.000000 Received: from server.rulingia.com (localhost.rulingia.com [127.0.0.1]) by server.rulingia.com (8.14.5/8.14.5) with ESMTP id r35LCnVi049996 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Sat, 6 Apr 2013 08:12:49 +1100 (EST) (envelope-from peter@server.rulingia.com) Received: (from peter@localhost) by server.rulingia.com (8.14.5/8.14.5/Submit) id r35LCnWB049995; Sat, 6 Apr 2013 08:12:49 +1100 (EST) (envelope-from peter) Date: Sat, 6 Apr 2013 08:12:49 +1100 From: Peter Jeremy To: Joar Jegleim Subject: Re: Regarding regular zfs Message-ID: <20130405211249.GB31958@server.rulingia.com> References: MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="82I3+IH0IqGh5yIs" Content-Disposition: inline In-Reply-To: X-PGP-Key: http://www.rulingia.com/keys/peter.pgp User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-fs@freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 05 Apr 2013 21:13:05 -0000 --82I3+IH0IqGh5yIs Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 2013-Apr-05 12:17:27 +0200, Joar Jegleim wrote: >I've got this script that initially zfs send's a whole zfs volume, and >for every send after that only sends the diff . So after the initial zfs >send, the diff's usually take less than a minute to send over. Are you deleting old snapshots after the newer snapshots have been sent? >I've had increasing problems on the 'slave', it seem to grind to a >halt for anything between 5-20 seconds after every zfs receive . Everything >on the server halts / hangs completely. Can you clarify which machine you mean by server in the last line above. I presume you mean the slave machine running "zfs recv". If you monitor the "server" with "vmstat -v 1", "gstat -a" and "zfs-mon -a" (the latter is part of ports/sysutils/zfs-stats) during the "freeze", what do you see? Are the disks saturated or idle? Are the "cache" or "free" values close to zero? ># 16GB arc_max ( server got 30GB of ram, but had a couple 'freeze' >situations, suspect zfs.arc ate too much memory) There was a bug in interface between ZFS ARC and FreeBSD VM that resulted in ARC starvation. This was fixed between 8.2 and 8.3/9.0. >I suspect it may have something to do with the zfs volume being sent >is mount'ed on the slave, and I'm also doing the backups from the >slave, which means a lot of the time the backup server is rsyncing the >zfs volume being updated. Do you have atime enabled or disabled? What happens when you don't run rsync at the same time? Are you able to break into DDB? >In my setup have I taken the use case for zfs send / receive too far >(?) as in, it's not meant for this kind of syncing and this often, so >there's actually nothing 'wrong'. Apart from the rsync whilst receiving, everything sounds OK. It's possible that the rsync whilst receiving is triggering a bug. --=20 Peter Jeremy --82I3+IH0IqGh5yIs Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.19 (FreeBSD) iEYEARECAAYFAlFfPlEACgkQ/opHv/APuIdhDACdH8TJwA++wALt80XjP5nH0bSl wngAnRFGty1FAplmb4kFndp89nFjTXQK =CMl0 -----END PGP SIGNATURE----- --82I3+IH0IqGh5yIs--