From owner-freebsd-questions@FreeBSD.ORG Fri Sep 16 11:15:49 2011 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 934CD106566C for ; Fri, 16 Sep 2011 11:15:49 +0000 (UTC) (envelope-from joh.hendriks@gmail.com) Received: from mail-ew0-f50.google.com (mail-ew0-f50.google.com [209.85.215.50]) by mx1.freebsd.org (Postfix) with ESMTP id 2B1A78FC0C for ; Fri, 16 Sep 2011 11:15:48 +0000 (UTC) Received: by ewy10 with SMTP id 10so1517840ewy.37 for ; Fri, 16 Sep 2011 04:15:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=ZkwKuUW5hOOZwV4NStcMauushgEZeOfiZ5MpBKUZePk=; b=Ap2iVPIG8HEPES0nHBIZ+s2lydr35cYo9izjQPChkh8Ncpn5juQsTpnKwlfafsJGt2 +aTnvUYn8ZDd6n0HY1nevnCLILqfyJ+3N0Z/S2FGVmVA77/t6dkrZ4NmZ158TeWuIurN sRyyJjH48uw8ilh2rSA9r0andR2Zru7/7lBX0= Received: by 10.213.114.136 with SMTP id e8mr170236ebq.43.1316171746269; Fri, 16 Sep 2011 04:15:46 -0700 (PDT) Received: from [192.168.50.106] (double-l.xs4all.nl. [80.126.205.144]) by mx.google.com with ESMTPS id u14sm17585986eeh.1.2011.09.16.04.15.44 (version=SSLv3 cipher=OTHER); Fri, 16 Sep 2011 04:15:45 -0700 (PDT) Message-ID: <4E732FDF.9080307@gmail.com> Date: Fri, 16 Sep 2011 13:15:43 +0200 From: Johan Hendriks User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:6.0.2) Gecko/20110902 Thunderbird/6.0.2 MIME-Version: 1.0 To: freebsd@top-consulting.net References: <20110916063153.200375qdq59crf8c@mail.top-consulting.net> In-Reply-To: <20110916063153.200375qdq59crf8c@mail.top-consulting.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-questions@freebsd.org Subject: Re: FS of choice for max random iops ( Maildir ) X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 Sep 2011 11:15:49 -0000 freebsd@top-consulting.net schreef: > I have a new server that I would like to use as a back-end Maildir > storage shared through NFS. The specs are: > > FreeBSD 9.0 Beta 2 > Xeon x3470 @ 2.93 quad-core CPU > 4 GB Ram @ 1333mhz ( upgrading to 12GB tomorrow ) > 3WARE 9650SE-16LP card with write cache enabled ( battery is installed ) > 16 x WD RE3 1TB drives > RAID 10 setup > > Right now I defined an entire array of 8TB ( all 16 disks ) separated > in two pieces. 50 GB for FreeBSD to boot and the rest available to > configure as storage. > > I've tried three options for the storage file system but I'm not sure > which one is the best option since I can't really reproduce production > conditions. I only ran tests with dd and bonnie and here's what I found: > > A. TEST1: dd bs=1024 if=/dev/zero of=/data/t1 count=1M > > 1. ZFS performed the worst, averaging 67MB/sec > 2. UFS + gjournal did around 130MB/sec > 3. UFS did around 190MB/sec > > B. TEST2 ( random file creation ): bonnie++ -d /data -c 10 -s 0 -n 50 > -u 0 > > 1. UFS + gjournal performed the worst > 2. ZFS performed somewhat better > 3. UFS performed the best again ( about 50% better ) > > C. TEST3 ( sequential writing ): bonnie++ -d /data -c 10 -s 8088 -n 0 > -u 0 > > 1. UFS + gjournal crashed the box > 2. ZFS performed average > 3. UFS performed better than ZFS ( about 50% better ) > > > I really like the concepts behind ZFS and UFS + Journaling but the > performance hit is quite drastic when compared to UFS. > > What I'm looking for here is max IOPS when doing random read/writes. > Is UFS the best choice for this ? Do my results make sense ? > > > > _______________________________________________ > freebsd-questions@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-questions > To unsubscribe, send any mail to > "freebsd-questions-unsubscribe@freebsd.org" Did you use raidz1 2 or 3 or mirror for the ZFS ppol. I believe that ZFS mirror gives you the best performance, but the least actual space. If you did make a raidz[1,2,3] try it with a mirror pool. Also do not use the raid function of your raid controller if you use ZFS, this way you loose the goodies of zfs. If you setup ZFS use JBOD on the raid controller. Gr Johan