From owner-freebsd-fs@FreeBSD.ORG Tue Aug 28 15:27:29 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 9426E106564A for ; Tue, 28 Aug 2012 15:27:29 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from mail-lb0-f182.google.com (mail-lb0-f182.google.com [209.85.217.182]) by mx1.freebsd.org (Postfix) with ESMTP id 162028FC12 for ; Tue, 28 Aug 2012 15:27:28 +0000 (UTC) Received: by lbbgg13 with SMTP id gg13so3938643lbb.13 for ; Tue, 28 Aug 2012 08:27:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=IWSoFCwwtN32uZSFME0Bw3FuA9Jh9wny4gunBrFQ2HA=; b=ioNMGda5LwsKfKdXZoYQL5gJMcmemor5HD0+aKK2ERHaGuKsLiymnVcwdbjuSvfQFK cc4s0a5LjSP/4ubDwd1J77q42jkx6q36CC8ZVrbI7+9lY/DzO8sep/P+Xw8xmqBZuqM/ ep1AKlifzuq77KaseWwSvavzVXBbhKBKXsysIp405rMw9Vqqh34wFipuozuhUMamI6kO ZK3PlKX2o03cs2+a3fIhXd3RtAh9wMlLB1ADS27TqthgR+mDW93qhAnDzHewgOqaV3/K lIYysqC1khKmI14XjDcAt0tGWTmhIMxgh4OqdvU8HxuEyZQ0oLDKQjLtOED+8EncbiFc Kmcw== MIME-Version: 1.0 Received: by 10.152.114.3 with SMTP id jc3mr18970245lab.11.1346167647938; Tue, 28 Aug 2012 08:27:27 -0700 (PDT) Received: by 10.114.23.230 with HTTP; Tue, 28 Aug 2012 08:27:27 -0700 (PDT) In-Reply-To: <503C8AEE.1090703@nobaq.net> References: <503A6F9F.7070801@nobaq.net> <503C8AEE.1090703@nobaq.net> Date: Tue, 28 Aug 2012 08:27:27 -0700 Message-ID: From: Freddie Cash To: Niki Hammler Content-Type: text/plain; charset=UTF-8 Cc: freebsd-fs@freebsd.org Subject: Re: zvol + raidz issue? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Aug 2012 15:27:29 -0000 On Tue, Aug 28, 2012 at 2:10 AM, Niki Hammler wrote: > Am 26.08.2012 22:13, schrieb Freddie Cash: >> (Sorry for top-post, sending from phone.) >> >> Please show the command-line used to create the zvol. Especially the >> recordsize option. When using zvols, you have to make sure to match the >> recordsize of the zvol to that of the filesystem used above it. >> Otherwise, performance will be atrocious. > > Sorry for my third posting on this. > Now I strictly followed your suggestion and used > > zfs create -b 128k -V 500g plvl5i0/zvtest > > (with 128k being the recordsize of the dataset in the zpool). > > Suddenly the write performance increased from the 2.5 MB/s to 250 MB/s > (or 78MB/s when using bs=4096 with dd) > > 1.) How can this explained? > 2.) Is there any problem when choosing -b 128k (can I always blindly > choose -b 128k)? > > Remember again that the problem ONLY occurs with raidz1+zvol+force 4096 > block alignment and in no other case! Most likely it has to do with the raidz stripe size and the constant block size of the zvol causing alignment or similar issues. I've also seen indications in the zfs-discuss mailing list about optimal and sub-optimal disk configurations for the various raidz types (wrong number of disks in the vdev leads to horrible performance). -- Freddie Cash fjwcash@gmail.com