From owner-freebsd-stable@FreeBSD.ORG Mon Jun 9 12:41:25 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 699C91065672 for ; Mon, 9 Jun 2008 12:41:25 +0000 (UTC) (envelope-from andy.kosela@gmail.com) Received: from wa-out-1112.google.com (wa-out-1112.google.com [209.85.146.183]) by mx1.freebsd.org (Postfix) with ESMTP id 3845B8FC28 for ; Mon, 9 Jun 2008 12:41:25 +0000 (UTC) (envelope-from andy.kosela@gmail.com) Received: by wa-out-1112.google.com with SMTP id j4so1629782wah.3 for ; Mon, 09 Jun 2008 05:41:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=ESTyVRL4bnX8SQXMI3Pt2O1s/aBecrTc5/XqWdmILlc=; b=k1p2/l13Hie6MMn/HL3a4az3Hbgr55zg55NEQ8oioFNsIDssQwA0X6N2CLxia20SBq oaggeBBrNj8qOmzKulS8w67Hh6byhvoqUPDYHwWm2OIRZxxOmtmgTRGfecPXH7NpGn72 q9CZzuXrniq8XMO+YfEbJtPEYi86mLwo+4Ckc= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=qdD3sfyuxub/CY11hjAUhMBa4zl/b+77roYibgiLtsW6HJZqm6iU9843AyXpOTfMIt 53pcyjGPdyKSzbN1Fl9S9Oa0ODWPiWaZNB/k/GcKY0MVJMpNsHLf0oObDfWDITVRqocE pEaUvlO005ggVlbyg/P11/Gjh1av4JA05ShNw= Received: by 10.114.197.10 with SMTP id u10mr3189156waf.47.1213015284561; Mon, 09 Jun 2008 05:41:24 -0700 (PDT) Received: by 10.114.112.6 with HTTP; Mon, 9 Jun 2008 05:41:24 -0700 (PDT) Message-ID: <3cc535c80806090541g15c03c24mf1c47a9b92ff166a@mail.gmail.com> Date: Mon, 9 Jun 2008 14:41:24 +0200 From: "Andy Kosela" To: freebsd-stable@freebsd.org In-Reply-To: <20080609103610.GA36227@riffraff.plig.net> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <3cc535c80806071158h44ec9be1pbe72ca6711016bde@mail.gmail.com> <484C4E6D.7060306@datapipe.com> <20080609103610.GA36227@riffraff.plig.net> Cc: msaad@datapipe.com, rv@openusenet.org Subject: Re: Current status of support for high end SAN hardware X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 09 Jun 2008 12:41:25 -0000 On Mon, Jun 9, 2008 at 12:36 PM, Russell Vincent wrote: > > The FreeBSD support for multipath/SAN is fairly poor. It's fiddly > to get to work and boot times are a little variable (into the > minutes) as it tries to discover the devices. Once it is configured > and booted, it just works as long as things don't go wrong. SAN > outages cause the machine to hang up until the issue is resolved > (in which case it just seems to continue) or it doesn't recover at > all and requires a reboot. Note that I don't spend a significant > amount of time on this, so it may be that I could do things a little > better. I have also not tested the failover stuff very well (I > only upgraded this machine to 7-STABLE fairly recently). Disk > access seems to be restricted to a single path at a time. Problem > solving is very tricky as there is very little information to trace > which path/disk refers to which fabric/storage device/LUN. > Russell, Thank you for your insights. It's good to see you have no problems with isp(4) and Qlogic HBAs. Though I'm concerned about multipathing. We run 6.x-RELEASE releases so it seems we have to upgrade to 7.0-RELEASE to achieve that goal. gmultipath(8) code is fairly new so I suppose it's not that mature yet as in Linux. Unfortunately it is only an active/passive approach with no load balancing (the active path is active until a BIO request is failed with EIO or ENXIO) Good support for high end SAN environment is essential in todays data centers, as most servers are connected to storage using FC based storage area network. I hope things will improve as 7.x-STABLE will be polished over time. Mark, I completely agree with you that ZFS is much better than Ext3+LVM2. Ext3 is still lacking internal snapshoting capability, so it's even inferior to UFS2. As a matter of fact I'm watching Oracle's btrfs development as it seems it will change many things on Linux filesystems scene. Though I still fear ZFS on FreeBSD is not as yet mature to the point of using it in a mission critical 24x7 production environments. But it's definetly something to watch out for. -- Andy Kosela ora et labora