From owner-freebsd-geom@FreeBSD.ORG Thu Dec 22 02:06:05 2011 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 718A9106566B for ; Thu, 22 Dec 2011 02:06:05 +0000 (UTC) (envelope-from feld@feld.me) Received: from mwi1.coffeenet.org (unknown [IPv6:2607:f4e0:100:300::2]) by mx1.freebsd.org (Postfix) with ESMTP id F2BD68FC17 for ; Thu, 22 Dec 2011 02:06:04 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=feld.me; s=blargle; h=Message-Id:Subject:To:From:Date:Content-Type:Mime-Version; bh=J4ncI/tQsIF26U4ePrpYXEiFJwXjcc7e7x7s38Y+iSM=; b=M7BEOhBKI4jqKCaCA/EaFfCem45pEcyAkFZ6xNu3r/ycDGFJN8MiTae2+GaE2eNF8xnL1nXzwEQoKFs9fG9QByHZw++TEcKl1j6KmrHxGuBg9iYNtxjtEUl4RXMElHTy; Received: from localhost ([127.0.0.1] helo=mwi1.coffeenet.org) by mwi1.coffeenet.org with esmtp (Exim 4.77 (FreeBSD)) (envelope-from ) id 1RdY2l-0007vj-Dl for freebsd-geom@freebsd.org; Wed, 21 Dec 2011 20:06:04 -0600 Received: from feld@feld.me by mwi1.coffeenet.org (Archiveopteryx 3.1.4) with esmtpsa id 1324519557-2714-2713/5/3; Thu, 22 Dec 2011 02:05:57 +0000 Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Date: Wed, 21 Dec 2011 20:05:57 -0600 From: Mark Felder To: freebsd-geom@freebsd.org Message-Id: <7bf62b8af857803e03363b81ead54484@feld.me> X-Sender: feld@feld.me User-Agent: Roundcube Webmail/0.6 X-SA-Score: -1.0 Subject: RFC: GEOM MULTIPATH Rewrite X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2011 02:06:05 -0000 Hi all, Building dual ZFS SANs at work with this hardware: HP DL360 head units // 18GB RAM // Intel SSDs for zil/cache LSI SAS 9201-16e DataOn Storage DL-1630 with dual controllers filled with 2TB SATA Hitachis + LSI SAS transposers I originally installed FreeBSD but my fight with gmultipath was not going well. I wasn't happy that it didn't have ACTIVE/ACTIVE and I also was discouraged by the ability to make it panic. I flirted briefly with OpenIndiana, but that whole platform needs to die as it's so painful to use. The weirdly horrible interactivity wasn't confidence-inspiring either -- why did it take 10 seconds to display "top"? Why were ZFS pool operations so slow? Very strange! This morning I found you actually released gmultipath patches and I must say -- this works FANTASTIC now! I can be writing 500MB/s+ and pull the cables at random and it's nearly transparent in passive and active modes. I urge you to commit this so it gets more testing, but I will be putting FreeBSD9 + gmultipath in production soon. I just need to do some more benchmarks and I might switch the scheduler to 4BSD because this box will be doing nothing but I/O and network traffic and my research indicates ULE is not optimal in that type of a workload. Cheers, Mark