From owner-freebsd-virtualization@freebsd.org Thu Aug 27 06:18:18 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 953C59C2BB6 for ; Thu, 27 Aug 2015 06:18:18 +0000 (UTC) (envelope-from marcus@odin.blazingdot.com) Received: from odin.blazingdot.com (odin.blazingdot.com [204.109.60.170]) by mx1.freebsd.org (Postfix) with ESMTP id ED2D2A9 for ; Thu, 27 Aug 2015 06:18:17 +0000 (UTC) (envelope-from marcus@odin.blazingdot.com) Received: by odin.blazingdot.com (Postfix, from userid 1001) id 215011324B2; Wed, 26 Aug 2015 23:10:44 -0700 (PDT) Date: Wed, 26 Aug 2015 23:10:44 -0700 From: Marcus Reid To: Vick Khera Cc: freebsd-virtualization@freebsd.org Subject: Re: Options for zfs inside a VM backed by zfs on the host Message-ID: <20150827061044.GA10221@blazingdot.com> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Coffee-Level: nearly-fatal User-Agent: Mutt/1.5.23 (2014-03-12) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 27 Aug 2015 06:18:18 -0000 On Wed, Aug 26, 2015 at 05:25:52PM -0400, Vick Khera wrote: > I'm running FreeBSD inside a VM that is providing the virtual disks backed > by several ZFS zvols on the host. I want to run ZFS on the VM itself too > for simplified management and backup purposes. > > The question I have is on the VM guest, do I really need to run a raid-z or > mirror or can I just use a single virtual disk (or even a stripe)? Given > that the underlying storage for the virtual disk is a zvol on a raid-z > there should not really be too much worry for data corruption, I would > think. It would be equivalent to using a hardware raid for each component > of my zfs pool. > > Opinions? Preferably well-reasoned ones. :) This is a frustrating situation, because none of the options that I can think of look particularly appealing. Single-vdev pools would be the best option, your redundancy is already taken care of by the host's pool. The overhead of checksumming, etc. twice is probably not super bad. However, having the ARC eating up lots of memory twice seems pretty bletcherous. You can probably do some tuning to reduce that, but I never liked tuning the ARC much. All the nice features ZFS brings to the table is hard to give up once you get used to having them around, so I understand your quandry. Marcus