From owner-freebsd-fs@FreeBSD.ORG Fri Sep 17 17:10:00 2010 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 954261065670 for ; Fri, 17 Sep 2010 17:10:00 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from mail-ey0-f182.google.com (mail-ey0-f182.google.com [209.85.215.182]) by mx1.freebsd.org (Postfix) with ESMTP id 214A58FC13 for ; Fri, 17 Sep 2010 17:09:59 +0000 (UTC) Received: by eyx24 with SMTP id 24so1356418eyx.13 for ; Fri, 17 Sep 2010 10:09:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=3FQ6UxuSDDcQJHqHoRVGq5GOYsljiStzbETa5t3vb5g=; b=CAgHPIcvYkx2/iidAAQnHvnO/4U3UpjHfunQN43unDEu2T39n1rAlrNiv3uWDcYG1w LRmpRCmvO8EitwYuruHTO1mliRHM252BhcZFeJwT0HV1Ez5WLHkfVqw4gLHRcCckvW+x qcket5UjwK0r/E4aqmU/40htPIaREvM25XmYc= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=hmx8/vSbG2eucLCWf4tGBEmNJQF8xQdf9xe2HPv1OhlibWFkr4ALQgRfLqQhukt9f5 VKYHX2oywXBp08p3JviZUqsJs3L7pqvZjpkgnJZxbQY42Wq1aedNifQ5dmH8Sk2Y8DDx utuYvTSyX/h7na6bWB9j/kg8jhdWGIM1WPlyM= MIME-Version: 1.0 Received: by 10.223.124.141 with SMTP id u13mr989192far.32.1284743398958; Fri, 17 Sep 2010 10:09:58 -0700 (PDT) Received: by 10.223.110.197 with HTTP; Fri, 17 Sep 2010 10:09:58 -0700 (PDT) In-Reply-To: References: <4C9385B0.2080909@shatow.net> <20100917161847.GA58503@icarus.home.lan> Date: Fri, 17 Sep 2010 10:09:58 -0700 Message-ID: From: Freddie Cash To: freebsd-fs@freebsd.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Subject: Re: what happens to pool if ZIL dies on ZFS v14 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 17 Sep 2010 17:10:00 -0000 On Fri, Sep 17, 2010 at 9:47 AM, Gil Vidals wrote: > First, let me say that I'm receiving excellent input from the FreeBSD > community. I'm new to FreeBSD and ZFS and this mailing list has been very > helpful. > > I'm running ZFSv14 on FreeBSD 8.1 AMD64 with 8GB of DDR3 RAM with two SSD= s - > one for the ZIL and the other for the L2ARC cache. > > zambia# zpool iostat -v 1 1 > =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 cap= acity =C2=A0 =C2=A0 operations =C2=A0 =C2=A0bandwidth > pool =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 used =C2=A0avail = =C2=A0 read =C2=A0write =C2=A0 read =C2=A0write > ---------------- =C2=A0----- =C2=A0----- =C2=A0----- =C2=A0----- =C2=A0--= --- =C2=A0----- > tank =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A06.57G =C2=A0 921G = =C2=A0 =C2=A0 =C2=A00 =C2=A0 =C2=A0 11 =C2=A0 116K =C2=A0 438K > =C2=A0mirror =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A06.57G =C2=A0 921G =C2=A0 = =C2=A0 =C2=A00 =C2=A0 =C2=A0 =C2=A05 =C2=A0 116K =C2=A0 229K > =C2=A0 =C2=A0label/disk1 =C2=A0 =C2=A0 =C2=A0 - =C2=A0 =C2=A0 =C2=A0- =C2= =A0 =C2=A0 =C2=A00 =C2=A0 =C2=A0 =C2=A03 =C2=A057.9K =C2=A0 229K > =C2=A0 =C2=A0label/disk2 =C2=A0 =C2=A0 =C2=A0 - =C2=A0 =C2=A0 =C2=A0- =C2= =A0 =C2=A0 =C2=A00 =C2=A0 =C2=A0 =C2=A03 =C2=A057.8K =C2=A0 229K > =C2=A0label/zilcache =C2=A0 136K =C2=A059.5G =C2=A0 =C2=A0 =C2=A00 =C2=A0= =C2=A0 =C2=A06 =C2=A0 =C2=A0 17 =C2=A0 209K > cache =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 - =C2=A0 = =C2=A0 =C2=A0- =C2=A0 =C2=A0 =C2=A0- =C2=A0 =C2=A0 =C2=A0- =C2=A0 =C2=A0 = =C2=A0- =C2=A0 =C2=A0 =C2=A0- > =C2=A0label/l2cache =C2=A0 59.6G =C2=A08.50K =C2=A0 =C2=A0 =C2=A00 =C2=A0= =C2=A0 =C2=A00 =C2=A031.5K =C2=A048.9K > ---------------- =C2=A0----- =C2=A0----- =C2=A0----- =C2=A0----- =C2=A0--= --- =C2=A0----- > > Observing the ZIL Cache, I see it being used very sparingly. And now that= I > know the SSD slog must be mirrored in ZFS < v19, I think the best course = of > action (assuming I'm not buying more equipment) is to mirror the ZIL SSD = and > abandon the L2ARC altogether. Won't RAM be used for L2ARC instead? The ZIL is only used for synchronous writes, and does not need to be very large. I forget the formula for determining the exact size of a ZIL (something along the lines of the max amount of data you can write in 30 seconds), but it's rarely more than 4 GB and usually in the 1-2 GB range. If possible, you'd be better off rebuilding your pool like so: mirror disk1 and disk2 slice both SSDs into two: 4-8 GB for ZIL, rest for L2ARC mirror zilcache1 zilcache2 add l2cache1 l2cache2 (don't mirror them) That way, you have a mirrored ZIL, and double the L2ARC. However, since it takes around 270 bytes of RAM for every object in the L2ARC, you'll want to make sure you have lots of RAM to manage it (or, possibly, make 3 slices on the SSDs and use the third for swap?). --=20 Freddie Cash fjwcash@gmail.com