From owner-freebsd-fs@FreeBSD.ORG  Thu Apr  4 12:46:34 2013
Return-Path: <owner-freebsd-fs@FreeBSD.ORG>
Delivered-To: freebsd-fs@freebsd.org
Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115])
 by hub.freebsd.org (Postfix) with ESMTP id ACF9FCB7
 for <freebsd-fs@freebsd.org>; Thu,  4 Apr 2013 12:46:34 +0000 (UTC)
 (envelope-from feld@feld.me)
Received: from new1-smtp.messagingengine.com (new1-smtp.messagingengine.com
 [66.111.4.221]) by mx1.freebsd.org (Postfix) with ESMTP id 8197FE3E
 for <freebsd-fs@freebsd.org>; Thu,  4 Apr 2013 12:46:33 +0000 (UTC)
Received: from compute4.internal (compute4.nyi.mail.srv.osa [10.202.2.44])
 by gateway1.nyi.mail.srv.osa (Postfix) with ESMTP id 52977BC2
 for <freebsd-fs@freebsd.org>; Thu,  4 Apr 2013 08:46:33 -0400 (EDT)
Received: from frontend2.nyi.mail.srv.osa ([10.202.2.161])
 by compute4.internal (MEProxy); Thu, 04 Apr 2013 08:46:33 -0400
DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d=feld.me; h=
 content-type:to:subject:references:date:mime-version
 :content-transfer-encoding:from:message-id:in-reply-to; s=
 mesmtp; bh=RHfv1nBOrnKtwqMmyO9JhzSp1JE=; b=URGGNNm4uutnV3em2uUsX
 0lH9XE/PTda4EtS7n7Z3TtEY0XGg6QWFAxx0qwj7ztSl7s5u0F900xdX2VIYrYsn
 l2ACkepaRABxZkvkTw2G0LmJ77eSCN463V7w3k+7Fd37VoNwKpVSDlh9YnGXpGJt
 QP500WskbLZ/vF6mhXbkVo=
DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d=
 messagingengine.com; h=content-type:to:subject:references:date
 :mime-version:content-transfer-encoding:from:message-id
 :in-reply-to; s=smtpout; bh=RHfv1nBOrnKtwqMmyO9JhzSp1JE=; b=VW0z
 /IKoH9c1UmRSvT94bKRUPFukdLF84HJnKQFHt/Ut9unTTHeYlJYW0bs1Z/x1B+b2
 QAUCVTc9UVwRUZML9l9aUUe6mcpvjoNfaPBXV9ybCnNoK82jrgyRtrk/PW4UXkUG
 gc/nr7oYEmU+hEyMmKcVPpaEIv3diiDpw8zuDqo=
X-Sasl-enc: mhgPdMUupZB/8y2e/+dL2U7D+p14ezOISO8kPv8fDsJa 1365079593
Received: from tech304.office.supranet.net (unknown [66.170.8.18])
 by mail.messagingengine.com (Postfix) with ESMTPA id EF9A62000E4
 for <freebsd-fs@freebsd.org>; Thu,  4 Apr 2013 08:46:32 -0400 (EDT)
Content-Type: text/plain; charset=us-ascii; format=flowed; delsp=yes
To: freebsd-fs@freebsd.org
Subject: Re: ZFS in production enviroments
References: <CAEW+ogaUkiiTw+VgZ0J6ey9MMD6EOv7sZD6FcqBq4=wU6z6w7w@mail.gmail.com>
Date: Thu, 04 Apr 2013 07:46:32 -0500
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
From: "Mark Felder" <feld@feld.me>
Message-ID: <op.wu0ofum934t2sn@tech304.office.supranet.net>
In-Reply-To: <CAEW+ogaUkiiTw+VgZ0J6ey9MMD6EOv7sZD6FcqBq4=wU6z6w7w@mail.gmail.com>
User-Agent: Opera Mail/12.14 (FreeBSD)
X-BeenThere: freebsd-fs@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Filesystems <freebsd-fs.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-fs>,
 <mailto:freebsd-fs-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-fs>
List-Post: <mailto:freebsd-fs@freebsd.org>
List-Help: <mailto:freebsd-fs-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
 <mailto:freebsd-fs-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Thu, 04 Apr 2013 12:46:34 -0000

Our setup:

* FreeBSD 9-STABLE (from before 9.0-RELEASE)
* HP DL360 servers acting as "head units"
* LSI SAS 9201-16e controllers
* Intel NICs
* DataOn Storage DNS-1630 JBODs with dual controllers (LSI based)
* 2TB 7200RPM Hitachi SATA HDs with SAS interposers (LSISS9252)
* Intel SSDs for cache/log devices
* gmultipath is handling the active/active data paths to the drives. ex:  
ZFS uses multipath/disk01 in the pool
* istgt serving iSCSI to Xen and ESXi from zvols

Built these just before the hard drive prices spiked from the floods. I  
need to jam more RAM in there and it would be nice to be running FreeBSD  
10 with some of the newer ZFS code and having access to TRIM. Uptime on  
these servers is over a year.