From owner-freebsd-performance@FreeBSD.ORG  Tue Sep 28 10:44:48 2010
Return-Path: <owner-freebsd-performance@FreeBSD.ORG>
Delivered-To: freebsd-performance@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 13A79106566B
	for <freebsd-performance@freebsd.org>;
	Tue, 28 Sep 2010 10:44:48 +0000 (UTC)
	(envelope-from gofp-freebsd-performance@m.gmane.org)
Received: from lo.gmane.org (lo.gmane.org [80.91.229.12])
	by mx1.freebsd.org (Postfix) with ESMTP id BF2C88FC1A
	for <freebsd-performance@freebsd.org>;
	Tue, 28 Sep 2010 10:44:47 +0000 (UTC)
Received: from list by lo.gmane.org with local (Exim 4.69)
	(envelope-from <gofp-freebsd-performance@m.gmane.org>)
	id 1P0Xfw-0003wJ-64
	for freebsd-performance@freebsd.org; Tue, 28 Sep 2010 12:44:44 +0200
Received: from lara.cc.fer.hr ([161.53.72.113])
	by main.gmane.org with esmtp (Gmexim 0.1 (Debian))
	id 1AlnuQ-0007hv-00
	for <freebsd-performance@freebsd.org>; Tue, 28 Sep 2010 12:44:44 +0200
Received: from ivoras by lara.cc.fer.hr with local (Gmexim 0.1 (Debian))
	id 1AlnuQ-0007hv-00
	for <freebsd-performance@freebsd.org>; Tue, 28 Sep 2010 12:44:44 +0200
X-Injected-Via-Gmane: http://gmane.org/
To: freebsd-performance@freebsd.org
From: Ivan Voras <ivoras@freebsd.org>
Date: Tue, 28 Sep 2010 12:44:44 +0200
Lines: 26
Message-ID: <i7sguk$gi2$1@dough.gmane.org>
References: <4CA14009.4050906@softhammer.net>
Mime-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
X-Complaints-To: usenet@dough.gmane.org
X-Gmane-NNTP-Posting-Host: lara.cc.fer.hr
User-Agent: Mozilla/5.0 (X11; U; FreeBSD amd64; en-US;
	rv:1.9.1.9) Gecko/20100518 Thunderbird/3.0.4
In-Reply-To: <4CA14009.4050906@softhammer.net>
X-Enigmail-Version: 1.0.1
Subject: Re: gstripe small transaction size
X-BeenThere: freebsd-performance@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Performance/tuning <freebsd-performance.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-performance>,
	<mailto:freebsd-performance-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-performance>
List-Post: <mailto:freebsd-performance@freebsd.org>
List-Help: <mailto:freebsd-performance-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-performance>,
	<mailto:freebsd-performance-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 28 Sep 2010 10:44:48 -0000

On 09/28/10 03:08, Stephen Sanders wrote:
> I'm trying a disk throughput experiment where in two 3ware raid 6's are
> being put into a g_strip raid 0.
>
> The raid 6's are using 8 7200RPM disks. The disk transfer rate is
> ~80MB/s. Using a load generation tool that is using O_DIRECT for I/O,
> I've generated the following short output from iostat. Needless to say,
> the write performance is a lot less than I'm expecting.
>
> We've modified the kernel such that our KB/t figure is closer to 512KB/t
> per disk when measured without the g_strip. With g_strip turned on, the
> KB/t number is more like 60KB/t.
>
> The question is how do I get g_stripe to write larger transactions to
> the disk ?
>
> gstripe label -v -s 131072 roadkill /dev/da0 /dev/da2

No pratical way. You have a gstripe array of two drives and with MAXPHYS 
of 128 KiB each would in fact see at most 64 KiB transactions. It gets 
worse when you add drives.

> newfs /dev/stripe/roadkill

Depending on what you are doing, adding "-U" would help you here.