From owner-freebsd-hardware@FreeBSD.ORG Mon Aug 27 11:07:09 2012 Return-Path: Delivered-To: freebsd-hardware@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1329B106566B for ; Mon, 27 Aug 2012 11:07:09 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id D82C78FC08 for ; Mon, 27 Aug 2012 11:07:08 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.5/8.14.5) with ESMTP id q7RB78Wt085854 for ; Mon, 27 Aug 2012 11:07:08 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.5/8.14.5/Submit) id q7RB78I4085852 for freebsd-hardware@FreeBSD.org; Mon, 27 Aug 2012 11:07:08 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 27 Aug 2012 11:07:08 GMT Message-Id: <201208271107.q7RB78I4085852@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-hardware@FreeBSD.org Cc: Subject: Current problem reports assigned to freebsd-hardware@FreeBSD.org X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Aug 2012 11:07:09 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/156241 hardware [mfi] 'zfs send' does not prevents disks to suspend if 1 problem total. From owner-freebsd-hardware@FreeBSD.ORG Tue Aug 28 20:46:01 2012 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D0D58106564A for ; Tue, 28 Aug 2012 20:46:01 +0000 (UTC) (envelope-from ayoung@mosaicarchive.com) Received: from mail-ob0-f182.google.com (mail-ob0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id 8E7C18FC0A for ; Tue, 28 Aug 2012 20:46:01 +0000 (UTC) Received: by obbun3 with SMTP id un3so14985802obb.13 for ; Tue, 28 Aug 2012 13:46:00 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:x-originating-ip:date:message-id:subject:from:to :content-type:x-gm-message-state; bh=Bm95tdOIZFcQzRphuAg7eTk8nQo2DKJpjlEYFuUu4j8=; b=H9494IybL093tMl3I5zAhG+5m6P0uWDCPB7nj972+DDdAlhw+7WhRDXHANuzjJvvt+ /IlONB7FcdRZmyIwhv80jCppxlqR2wDZN4PsbZFaWsSnSTgTljptAkC4XAMyM2eV949/ OZP9KwK1Q2N/dHQa+2gg2OEPOK5WRscwhlMYk5bF1jlj6L8JesesDCb8lH0W2v72SGge LQKfgNjPHaByw5L4l4BfdHAldumh20j8raMXGn7Jd9qK46Gju3mvRFxkzo4ddcxJiojp D/ITaA46Icj6YZUQ+JZtITGeLL4DlfmHoj+6oDguoI4XLmoYO7j2+US5Ir6AzEs9ZfDv e5rA== MIME-Version: 1.0 Received: by 10.182.73.65 with SMTP id j1mr13670056obv.42.1346186760598; Tue, 28 Aug 2012 13:46:00 -0700 (PDT) Received: by 10.76.174.38 with HTTP; Tue, 28 Aug 2012 13:46:00 -0700 (PDT) X-Originating-IP: [96.237.242.243] Date: Tue, 28 Aug 2012 16:46:00 -0400 Message-ID: From: Andy Young To: freebsd-hardware@freebsd.org X-Gm-Message-State: ALoCoQm6/lwvgZ5ku9XfhFThlBRZF3l0m3b0fPxm6BAPWPrKVEOBBQlpuPZPtuiRuIh0Bc6sW5Wg Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: Support for Fusion IO drives? X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Aug 2012 20:46:01 -0000 We are investigating adding SSDs as ZIL devices to boost our ZFS write performance. I read an article a while ago about iX Systems teaming up with Fusion IO to integrate their hardware with FreeBSD. Does anyone know anything about supported drivers for Fusion IO's iodrives? Thanks! Andy From owner-freebsd-hardware@FreeBSD.ORG Tue Aug 28 23:08:01 2012 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AD618106564A for ; Tue, 28 Aug 2012 23:08:01 +0000 (UTC) (envelope-from josh@tcbug.org) Received: from out1-smtp.messagingengine.com (out1-smtp.messagingengine.com [66.111.4.25]) by mx1.freebsd.org (Postfix) with ESMTP id 783818FC15 for ; Tue, 28 Aug 2012 23:08:01 +0000 (UTC) Received: from compute5.internal (compute5.nyi.mail.srv.osa [10.202.2.45]) by gateway1.nyi.mail.srv.osa (Postfix) with ESMTP id 6FCAA208FA; Tue, 28 Aug 2012 19:07:54 -0400 (EDT) Received: from frontend1.nyi.mail.srv.osa ([10.202.2.160]) by compute5.internal (MEProxy); Tue, 28 Aug 2012 19:07:54 -0400 DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d= messagingengine.com; h=message-id:date:from:mime-version:to:cc :subject:references:in-reply-to:content-type :content-transfer-encoding; s=smtpout; bh=f9DdGfcTyRSULsehHNmQUy svJPY=; b=ZdbkBueLnvUUWtiNIgvqaFFUcpV6sr0icw2bIU5qwjpLJiibo4cbJx JKRrMX8YP6oRujMSjVASl+3IWZt5EIav0m64rBjkrSpppOroHD+gU1PXln39EcVO l3XVVf3JDpJgOQQ++LJYsi22QDRG4kkg8zvhZOP2mcULZQI1pNw2U= X-Sasl-enc: DVzBaFQihnH8BbwgN1MQW5v4/TwsO7V5HeqOIzch9CEu 1346195274 Received: from commander.ixsystems.com (unknown [206.40.55.65]) by mail.messagingengine.com (Postfix) with ESMTPA id EC1118E0205; Tue, 28 Aug 2012 19:07:53 -0400 (EDT) Message-ID: <503D4F48.9020108@tcbug.org> Date: Tue, 28 Aug 2012 16:07:52 -0700 From: Josh Paetzel User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:13.0) Gecko/20120621 Thunderbird/13.0.1 MIME-Version: 1.0 To: Andy Young References: <503D3026.6010901@ixsystems.com> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: freebsd-hardware@freebsd.org Subject: Re: Support for Fusion IO drives? X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Aug 2012 23:08:01 -0000 >> -------- Original Message -------- >> Subject: Support for Fusion IO drives? >> Date: Tue, 28 Aug 2012 16:46:00 -0400 >> From: Andy Young >> To: freebsd-hardware@freebsd.org >> >> >> We are investigating adding SSDs as ZIL devices to boost our ZFS write >> performance. I read an article a while ago about iX Systems teaming up >> with >> Fusion IO to integrate their hardware with FreeBSD. Does anyone know >> anything about supported drivers for Fusion IO's iodrives? >> >> Thanks! >> >> Andy >> _______________________________________________ >> freebsd-hardware@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-hardware >> To unsubscribe, send any mail to >> "freebsd-hardware-unsubscribe@freebsd.org" >> >> >> >> I'll put on my iXsystems hat here, as well as my fast storage, ZFS and Fusion-I/O hat. The ZFS filesystem supports dedicated ZIL devices, which can accelerate certain types of write requests, notably related to fsync. The VMWare NFS client issues a sync with every write, and most databases do as well. In those types of environments having a fast dedicated ZIL device is almost essential. In other environments the benefits of a dedicated ZIL range from non-existent to substantial. A good dedicated ZIL device is all about latency. It doesn't need to be large, in fact it will only ever handle 10 seconds of writes, so 10x network bandwidth is worst case. (In most environments this means 20GB is larger than needed). Fusion-I/O cards are far too large to be cost effective ZIL devices. Even though they do rock at I/O latency, the really fast ones are also fairly large, so the $/GB on them isn't so attractive. There are better options for ZIL devices. Another consideration is the Fusion-I/O driver is fairly memory hungry, which competes with memory ZFS wants to use for read caching. Now as an L2ARC device, that's a whole different can of worms. Command line used: iozone -r 4k -s 96g -i 0 -i 1 -i 2 -t 8 Parent sees throughput for 8 readers = 1712399.95 KB/sec L2 ARC Breakdown: 197.45m Hit Ratio: 98.61% 194.71m L2 ARC Size: (Adaptive) 771.13 GiB ARC Efficiency: 683.40m Actual Hit Ratio: 71.09% 485.82m ~ 800GB test data, all served from cache. If you are considering Fusion-I/O, the FreeBSD driver is generally not released to the general public by Fusion-I/O, but can be obtained from various partners. (I believe iXsystems is the only FreeBSD friendly fusion-i/o partner but could be wrong about that) -- Thanks, Josh Paetzel From owner-freebsd-hardware@FreeBSD.ORG Tue Aug 28 23:47:10 2012 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0546A1065670 for ; Tue, 28 Aug 2012 23:47:10 +0000 (UTC) (envelope-from ayoung@mosaicarchive.com) Received: from mail-vc0-f182.google.com (mail-vc0-f182.google.com [209.85.220.182]) by mx1.freebsd.org (Postfix) with ESMTP id A37C08FC15 for ; Tue, 28 Aug 2012 23:47:09 +0000 (UTC) Received: by vcbgb22 with SMTP id gb22so8408310vcb.13 for ; Tue, 28 Aug 2012 16:47:08 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=references:in-reply-to:mime-version:content-transfer-encoding :content-type:message-id:cc:x-mailer:from:subject:date:to :x-gm-message-state; bh=NDgxLgR8uChIulEWymWj0SOtqaSjQRvn3jyRdzom49A=; b=PHI/00CDvKUPqK2w1Tzgz19ncagNZoutfUIv1MWMkHmjeUf8S6/F+VJhSnfN8G07AP dQz1JjP/itsT11Lvdhlt0vyXh+PeKgf8HsVF6WePRnPscOUsePPBU6hko5vRqYwT57x6 SNnGhZUJ33y2QBPMv2Xol1jDvALdcfBCtVCq9WlGcy99m8TKnIdeP1ZwTjh8I/KF+/f/ sGWMQaFcurg65qAWIiULYHvsQmF6DTN+YghiTtDW9Ti5lJcER0MIEWlVheNb98OrM8CW NEa7cDrMdDoJHKrm6FEoDumv/oW89vf1OgRNYVgV+zj5jXhW0Ajvrxp3Y/TZJ6HRwtHZ 0z/w== Received: by 10.52.98.67 with SMTP id eg3mr13621020vdb.5.1346197628845; Tue, 28 Aug 2012 16:47:08 -0700 (PDT) Received: from [192.168.1.3] (pool-96-237-242-243.bstnma.fios.verizon.net. [96.237.242.243]) by mx.google.com with ESMTPS id by3sm12084047vdc.17.2012.08.28.16.47.07 (version=TLSv1/SSLv3 cipher=OTHER); Tue, 28 Aug 2012 16:47:08 -0700 (PDT) References: <503D3026.6010901@ixsystems.com> <503D4F48.9020108@tcbug.org> In-Reply-To: <503D4F48.9020108@tcbug.org> Mime-Version: 1.0 (1.0) Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Message-Id: <3F6C1EB2-1EC4-4863-A5BF-093649D9D61C@mosaicarchive.com> X-Mailer: iPhone Mail (9B206) From: Andrew Young Date: Tue, 28 Aug 2012 19:47:05 -0400 To: Josh Paetzel X-Gm-Message-State: ALoCoQkvXU/VR7rVJkYfGFQi2d7Z3G0VDWGiM5S1kXLnEtvaAjSOg1pP5POYhX2ofOOO5vKtIG/C Cc: "freebsd-hardware@freebsd.org" Subject: Re: Support for Fusion IO drives? X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Aug 2012 23:47:10 -0000 Thanks for the great feedback Josh! The optimum size for an ssd zil device w= as still an open question for us. I'm really glad to hear that they don't ne= ed to be that big. What does zfs do with the zil if there is no dedicated zil device? Our serve= rs consist of a small sata drive that holds the OS and a boatload of larger d= rives on a sas bus. What I'm wondering is if I simply replace the OS disk wi= th an ssd will I get the same performance boost as if I added a dedicated ss= d zil?=20 Thanks! Andy On Aug 28, 2012, at 7:07 PM, Josh Paetzel wrote: >>> -------- Original Message -------- >>> Subject: Support for Fusion IO drives? >>> Date: Tue, 28 Aug 2012 16:46:00 -0400 >>> From: Andy Young >>> To: freebsd-hardware@freebsd.org >>>=20 >>>=20 >>> We are investigating adding SSDs as ZIL devices to boost our ZFS write >>> performance. I read an article a while ago about iX Systems teaming up >>> with >>> Fusion IO to integrate their hardware with FreeBSD. Does anyone know >>> anything about supported drivers for Fusion IO's iodrives? >>>=20 >>> Thanks! >>>=20 >>> Andy >>> _______________________________________________ >>> freebsd-hardware@freebsd.org mailing list >>> http://lists.freebsd.org/mailman/listinfo/freebsd-hardware >>> To unsubscribe, send any mail to >>> "freebsd-hardware-unsubscribe@freebsd.org" >>>=20 >>>=20 >>>=20 >>>=20 >=20 > I'll put on my iXsystems hat here, as well as my fast storage, ZFS and > Fusion-I/O hat. >=20 > The ZFS filesystem supports dedicated ZIL devices, which can accelerate > certain types of write requests, notably related to fsync. The VMWare > NFS client issues a sync with every write, and most databases do as > well. In those types of environments having a fast dedicated ZIL device > is almost essential. In other environments the benefits of a dedicated > ZIL range from non-existent to substantial. >=20 > A good dedicated ZIL device is all about latency. It doesn't need to be > large, in fact it will only ever handle 10 seconds of writes, so 10x > network bandwidth is worst case. (In most environments this means 20GB > is larger than needed). >=20 > Fusion-I/O cards are far too large to be cost effective ZIL devices. > Even though they do rock at I/O latency, the really fast ones are also > fairly large, so the $/GB on them isn't so attractive. There are better > options for ZIL devices. >=20 > Another consideration is the Fusion-I/O driver is fairly memory hungry, > which competes with memory ZFS wants to use for read caching. >=20 > Now as an L2ARC device, that's a whole different can of worms. >=20 > Command line used: iozone -r 4k -s 96g -i 0 -i 1 -i 2 -t 8 > Parent sees throughput for 8 readers =3D 1712399.95 KB/sec > L2 ARC Breakdown: 197.45m > Hit Ratio: 98.61% 194.71m > L2 ARC Size: (Adaptive) 771.13 GiB > ARC Efficiency: 683.40m > Actual Hit Ratio: 71.09% 485.82m >=20 > ~ 800GB test data, all served from cache. >=20 > If you are considering Fusion-I/O, the FreeBSD driver is generally not > released to the general public by Fusion-I/O, but can be obtained from > various partners. (I believe iXsystems is the only FreeBSD friendly > fusion-i/o partner but could be wrong about that) >=20 >=20 > --=20 > Thanks, >=20 > Josh Paetzel >=20 From owner-freebsd-hardware@FreeBSD.ORG Wed Aug 29 05:49:41 2012 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 75AED106566B for ; Wed, 29 Aug 2012 05:49:41 +0000 (UTC) (envelope-from ndenev@gmail.com) Received: from mail-wg0-f50.google.com (mail-wg0-f50.google.com [74.125.82.50]) by mx1.freebsd.org (Postfix) with ESMTP id EFE628FC18 for ; Wed, 29 Aug 2012 05:49:40 +0000 (UTC) Received: by wgbds11 with SMTP id ds11so127282wgb.31 for ; Tue, 28 Aug 2012 22:49:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:mime-version:content-type:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to:x-mailer; bh=IOvCrMlancS57bdRO8Xjk/Z9ApxP7tHqZpspcpzT9fw=; b=tky5upbib3HAYT93ZI6mEPWTOXZJErcT6v+LLOoCE9kdc286ESkK0G4BvzGYbBNXyV HXyleFhRlXbrhLxQNOi4yx1nhxkZJ6116vGuPgzuriXz28kSOMW5v6q3o2qmMpTg409t Ca96NE6nMnJdzj7RSeIMioROKDyhTHw5KXPZzIP0I3rbiBROooMH95zfsnNjkbPGZdaa CzltoQIiDBKzcZupWcSi8R/TTsWijxMbxA4HQdHmBUfNV5+xWwYj4oW9TaOVPwiUqDXc xu9WuLHlOMSbVtyLwpvSEORdRxHuzN0mcB4ucVsIk3aFaqxRjdd1TLLqUUdq7m6IM5ey 1Ysw== Received: by 10.180.97.135 with SMTP id ea7mr37750825wib.11.1346219379663; Tue, 28 Aug 2012 22:49:39 -0700 (PDT) Received: from [10.0.0.86] ([93.152.184.10]) by mx.google.com with ESMTPS id l6sm8541707wiz.4.2012.08.28.22.49.38 (version=TLSv1/SSLv3 cipher=OTHER); Tue, 28 Aug 2012 22:49:38 -0700 (PDT) Mime-Version: 1.0 (Mac OS X Mail 6.0 \(1486\)) Content-Type: text/plain; charset=us-ascii From: Nikolay Denev In-Reply-To: <3F6C1EB2-1EC4-4863-A5BF-093649D9D61C@mosaicarchive.com> Date: Wed, 29 Aug 2012 08:49:37 +0300 Content-Transfer-Encoding: quoted-printable Message-Id: <4D5E46B8-B1C5-4131-BEB3-673769B844E7@gmail.com> References: <503D3026.6010901@ixsystems.com> <503D4F48.9020108@tcbug.org> <3F6C1EB2-1EC4-4863-A5BF-093649D9D61C@mosaicarchive.com> To: Andrew Young X-Mailer: Apple Mail (2.1486) Cc: Josh Paetzel , "freebsd-hardware@freebsd.org" Subject: Re: Support for Fusion IO drives? X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Aug 2012 05:49:41 -0000 Fron the zpool man page: By default, the intent log is allocated from blocks within the main = pool. However, it might be possible to get better performance using = separate intent log devices such as NVRAM or a dedicated disk. I was also contemplating the idea of a fast SSD on PCIe as a ZIL and = L2ARC. And given the fact that the SSD will not suffer from the different types = and locations of IO requests, maybe it makes sense to go with a big SSD, and partition it for a small = ZIL partition, and the rest for L2ARC. Anyone tried that? Regards, Nikolay On Aug 29, 2012, at 2:47 AM, Andrew Young = wrote: > Thanks for the great feedback Josh! The optimum size for an ssd zil = device was still an open question for us. I'm really glad to hear that = they don't need to be that big. >=20 > What does zfs do with the zil if there is no dedicated zil device? Our = servers consist of a small sata drive that holds the OS and a boatload = of larger drives on a sas bus. What I'm wondering is if I simply replace = the OS disk with an ssd will I get the same performance boost as if I = added a dedicated ssd zil?=20 >=20 > Thanks! > Andy >=20 > On Aug 28, 2012, at 7:07 PM, Josh Paetzel wrote: >=20 >>>> -------- Original Message -------- >>>> Subject: Support for Fusion IO drives? >>>> Date: Tue, 28 Aug 2012 16:46:00 -0400 >>>> From: Andy Young >>>> To: freebsd-hardware@freebsd.org >>>>=20 >>>>=20 >>>> We are investigating adding SSDs as ZIL devices to boost our ZFS = write >>>> performance. I read an article a while ago about iX Systems teaming = up >>>> with >>>> Fusion IO to integrate their hardware with FreeBSD. Does anyone = know >>>> anything about supported drivers for Fusion IO's iodrives? >>>>=20 >>>> Thanks! >>>>=20 >>>> Andy >>>> _______________________________________________ >>>> freebsd-hardware@freebsd.org mailing list >>>> http://lists.freebsd.org/mailman/listinfo/freebsd-hardware >>>> To unsubscribe, send any mail to >>>> "freebsd-hardware-unsubscribe@freebsd.org" >>>>=20 >>>>=20 >>>>=20 >>>>=20 >>=20 >> I'll put on my iXsystems hat here, as well as my fast storage, ZFS = and >> Fusion-I/O hat. >>=20 >> The ZFS filesystem supports dedicated ZIL devices, which can = accelerate >> certain types of write requests, notably related to fsync. The = VMWare >> NFS client issues a sync with every write, and most databases do as >> well. In those types of environments having a fast dedicated ZIL = device >> is almost essential. In other environments the benefits of a = dedicated >> ZIL range from non-existent to substantial. >>=20 >> A good dedicated ZIL device is all about latency. It doesn't need to = be >> large, in fact it will only ever handle 10 seconds of writes, so 10x >> network bandwidth is worst case. (In most environments this means = 20GB >> is larger than needed). >>=20 >> Fusion-I/O cards are far too large to be cost effective ZIL devices. >> Even though they do rock at I/O latency, the really fast ones are = also >> fairly large, so the $/GB on them isn't so attractive. There are = better >> options for ZIL devices. >>=20 >> Another consideration is the Fusion-I/O driver is fairly memory = hungry, >> which competes with memory ZFS wants to use for read caching. >>=20 >> Now as an L2ARC device, that's a whole different can of worms. >>=20 >> Command line used: iozone -r 4k -s 96g -i 0 -i 1 -i 2 -t 8 >> Parent sees throughput for 8 readers =3D 1712399.95 KB/sec >> L2 ARC Breakdown: 197.45m >> Hit Ratio: 98.61% 194.71m >> L2 ARC Size: (Adaptive) 771.13 GiB >> ARC Efficiency: 683.40m >> Actual Hit Ratio: 71.09% 485.82m >>=20 >> ~ 800GB test data, all served from cache. >>=20 >> If you are considering Fusion-I/O, the FreeBSD driver is generally = not >> released to the general public by Fusion-I/O, but can be obtained = from >> various partners. (I believe iXsystems is the only FreeBSD friendly >> fusion-i/o partner but could be wrong about that) >>=20 >>=20 >> --=20 >> Thanks, >>=20 >> Josh Paetzel >>=20 > _______________________________________________ > freebsd-hardware@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hardware > To unsubscribe, send any mail to = "freebsd-hardware-unsubscribe@freebsd.org" From owner-freebsd-hardware@FreeBSD.ORG Sat Sep 1 20:14:29 2012 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id C5A8E106566C for ; Sat, 1 Sep 2012 20:14:29 +0000 (UTC) (envelope-from ayoung@mosaicarchive.com) Received: from mail-ob0-f182.google.com (mail-ob0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id 825F58FC1C for ; Sat, 1 Sep 2012 20:14:29 +0000 (UTC) Received: by obbun3 with SMTP id un3so9678500obb.13 for ; Sat, 01 Sep 2012 13:14:28 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:x-originating-ip:date:message-id:subject:from:to :content-type:x-gm-message-state; bh=+KKyU3KnfAu2MyZfKKKQ1R/PjEFbQSMFCNI3nmRrZus=; b=CF1Qx4HIx1Pdt4jsuYXsqulVeAVVm3JWkzQna8BjOXauYM0Gg5M4Q4Cl32HTHz4QaJ 52QTRPnV58MGQAuhTkCvake2vozmBpEWUAeB7qEDb+ekZ3OCfBwXFWFEhPu6gVEYhjsA 0+yqoJpK15PP7E5as1jDETkowSdNI/Z2I1Eo1SHZ1SBuwG7/tWVGAC7djLtxcScgtfjT qQf4eH7t2uRPT/WZVmal1JUnWRGgWR1+DAoWAHkuIcNXGGLQYddoRPgj2SV0SoxeYhik /MYCoUzlh4kLnpUWdZKqbAzM1byV1JGwLg537qQ/RxQTub7rj4PorNEzLqJsJ1wjcpEl N3+w== MIME-Version: 1.0 Received: by 10.182.188.41 with SMTP id fx9mr10610472obc.92.1346530468743; Sat, 01 Sep 2012 13:14:28 -0700 (PDT) Received: by 10.76.174.38 with HTTP; Sat, 1 Sep 2012 13:14:28 -0700 (PDT) X-Originating-IP: [96.237.242.243] Date: Sat, 1 Sep 2012 16:14:28 -0400 Message-ID: From: Andy Young To: freebsd-hardware@freebsd.org X-Gm-Message-State: ALoCoQlwECjDO9tHP2DN9u1e5xY/aiwUXHOXWATJIOXhZHbvc8AkeShELihERGAABeZ+jOL0WfG/ Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: Load testing knocks out network X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 01 Sep 2012 20:14:29 -0000 Last night one our servers went offline while I was load testing it. When I got to the datacenter to check on it, the server seemed perfectly fine. Everything was running on it, there were no panics or any other sign of a hard crash. The only problem is the network was unreachable. I couldn't connect to the box even from a laptop directly attached to the ethernet port. I couldn't connect to anything from the box either. It was if the network controller had seized up. I restarted netif and it didn't make a difference. Rebooting the machine however, solved the issue and everything went back to working great. I restarted the load testing and reproduced the problem twice more this morning so at least its repeatable. It feels like a network controller / driver issue to me for a couple reasons. First, the problem affects the entire system. We're running FreeBSD 9 with about a half dozen jails. Most of the jails are running Apache but the one I was load testing was running Jetty. However, if it was my application code crashing I would expect the problem to at least be isolated to the jail that hosts it. Instead, the entire machine and all jails in it lose access to the network. Apart from not being able to access the network, I don't see any other signs of problems. This is the first major problem I've had to debug in FreeBSD so I'm not a debugging expert by any means. There are no error messages in /var/log/messages or dmesg apart from syslogd not being able to reach the network. If anyone has ideas on where I can look for more evidence of what is going wrong, I would really appreciate it. We're running FreeBSD 9.0-RELEASE-p3. The network controller is a Intel(R) PRO/1000 Network Connection version - 2.2.5 configured with 6 ips using aliases, five of which are used for jails. Thank you for the help!! Andy