From owner-freebsd-scsi@FreeBSD.ORG Mon Jan 7 01:30:17 2008 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 35D8116A419 for ; Mon, 7 Jan 2008 01:30:17 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from pooker.samsco.org (pooker.samsco.org [168.103.85.57]) by mx1.freebsd.org (Postfix) with ESMTP id E6FBF13C461 for ; Mon, 7 Jan 2008 01:30:16 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from phobos.samsco.home (phobos.samsco.home [192.168.254.11]) (authenticated bits=0) by pooker.samsco.org (8.13.8/8.13.8) with ESMTP id m071UDJ7001765; Sun, 6 Jan 2008 18:30:14 -0700 (MST) (envelope-from scottl@samsco.org) Message-ID: <478180A5.3080406@samsco.org> Date: Sun, 06 Jan 2008 18:30:13 -0700 From: Scott Long User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.11) Gecko/20071128 SeaMonkey/1.1.7 MIME-Version: 1.0 To: "Jeffery G. Archambeau" References: <477F98B2.8030901@tehlunix.org> In-Reply-To: <477F98B2.8030901@tehlunix.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Greylist: Sender succeeded SMTP AUTH authentication, not delayed by milter-greylist-2.0.2 (pooker.samsco.org [168.103.85.57]); Sun, 06 Jan 2008 18:30:14 -0700 (MST) X-Spam-Status: No, score=-1.4 required=5.4 tests=ALL_TRUSTED autolearn=failed version=3.1.8 X-Spam-Checker-Version: SpamAssassin 3.1.8 (2007-02-13) on pooker.samsco.org Cc: freebsd-scsi@freebsd.org Subject: Re: dump card state begins... X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Jan 2008 01:30:17 -0000 Jeffery G. Archambeau wrote: > This particular box has been up and running without incident for a > couple of years, now. It's running 6.2-RELEASE-p7 with the on-board > Adaptec scsi controller. > > This morning, the box was painfully slow. top shows that nothing's > hogging CPU or RAM. bandwidth monitors show that the box isn't being > attacked. Then dmesg showed this.... Help? > > > ahd0: PCI error Interrupt > >>>>>>>>>>>>>>>>>> Dump Card State Begins <<<<<<<<<<<<<<<<< This might be something like dust build-up in the case or thermal creep in the card and/or memory contacts, especially since it's been running without incident for so long. I'd open up the machine, vacuum it out, reseat all of the cards and memory modules, and see if it happens again. Scott From owner-freebsd-scsi@FreeBSD.ORG Mon Jan 7 11:07:08 2008 Return-Path: Delivered-To: freebsd-scsi@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1435416A55D for ; Mon, 7 Jan 2008 11:07:08 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 0767813C459 for ; Mon, 7 Jan 2008 11:07:08 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.2/8.14.2) with ESMTP id m07B77kC061904 for ; Mon, 7 Jan 2008 11:07:07 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.2/8.14.1/Submit) id m07B77h1061900 for freebsd-scsi@FreeBSD.org; Mon, 7 Jan 2008 11:07:07 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 7 Jan 2008 11:07:07 GMT Message-Id: <200801071107.m07B77h1061900@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-scsi@FreeBSD.org Cc: Subject: Current problem reports assigned to freebsd-scsi@FreeBSD.org X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Jan 2008 11:07:08 -0000 Current FreeBSD problem reports Critical problems Serious problems S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/39388 scsi ncr/sym drivers fail with 53c810 and more than 256MB m o kern/40895 scsi wierd kernel / device driver bug o kern/52638 scsi [panic] SCSI U320 on SMP server won't run faster than s kern/57398 scsi [mly] Current fails to install on mly(4) based RAID di o kern/60598 scsi wire down of scsi devices conflicts with config o kern/60641 scsi [sym] Sporadic SCSI bus resets with 53C810 under load s kern/61165 scsi [panic] kernel page fault after calling cam_send_ccb o kern/74627 scsi [ahc] [hang] Adaptec 2940U2W Can't boot 5.3 o kern/81887 scsi [aac] Adaptec SCSI 2130S aac0: GetDeviceProbeInfo comm o kern/90282 scsi [sym] SCSI bus resets cause loss of ch device o kern/92798 scsi [ahc] SCSI problem with timeouts o kern/93128 scsi [sym] FreeBSD 6.1 BETA 1 has problems with Symbios/LSI o kern/94838 scsi Kernel panic while mounting SD card with lock switch o o kern/99954 scsi [ahc] reading from DVD failes on 6.x (regression) o kern/110847 scsi [ahd] Tyan U320 onboard problem with more than 3 disks 15 problems total. Non-critical problems S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/35234 scsi World access to /dev/pass? (for scanner) requires acce o kern/38828 scsi [feature request] DPT PM2012B/90 doesn't work o kern/44587 scsi dev/dpt/dpt.h is missing defines required for DPT_HAND o kern/76178 scsi [ahd] Problem with ahd and large SCSI Raid system o kern/114597 scsi [sym] System hangs at SCSI bus reset with dual HBAs 5 problems total. From owner-freebsd-scsi@FreeBSD.ORG Mon Jan 7 17:51:24 2008 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6DC6E16A420 for ; Mon, 7 Jan 2008 17:51:24 +0000 (UTC) (envelope-from lan@hangwithme.com) Received: from mta1.recol.net (mta1.recol.net [64.207.103.6]) by mx1.freebsd.org (Postfix) with ESMTP id 462D113C465 for ; Mon, 7 Jan 2008 17:51:23 +0000 (UTC) (envelope-from lan@hangwithme.com) Message-ID: <47826194.1080703@hangwithme.com> Date: Mon, 07 Jan 2008 12:29:56 -0500 From: Lan Tran User-Agent: Thunderbird 2.0.0.9 (Windows/20071031) MIME-Version: 1.0 To: freebsd-scsi@freebsd.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: QLogic HBAs+EMC AX100 SAN X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Jan 2008 17:51:24 -0000 I'd like to direct connect a FreeBSD-6.2 system to an EMC AX100 SAN using 2 QLogic 23xx series HBAs. Here is the dmesg output: isp0: port 0xec00-0xecff mem 0xdfdff000-0xdfdfffff irq 39 at device 12.0 on pci2 isp0: [GIANT-LOCKED] isp0: Polled Mailbox Command (0x2) Timeout isp0: Polled Mailbox Command (0x8) Timeout device_attach: isp0 attach returned 6 isp1: port 0xdc00-0xdcff mem 0xdfbff000-0xdfbfffff irq 37 at device 11.0 on pci3 isp1: [GIANT-LOCKED] isp1: Polled Mailbox Command (0x2) Timeout isp1: Polled Mailbox Command (0x8) Timeout device_attach: isp1 attach returned 6 During boot the system would hang after for awhile then continue. I have created a LUN and assigned it to this system, but the OS does not see it. What am I missing? What commands should I try from the OS? Does anyone have a similar setup working with the QLogic HBAs? AX100 used to be connected to RHEL but I want to use FreeBSD instead :). Lan From owner-freebsd-scsi@FreeBSD.ORG Mon Jan 7 18:04:08 2008 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D1F6416A419 for ; Mon, 7 Jan 2008 18:04:08 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from pooker.samsco.org (pooker.samsco.org [168.103.85.57]) by mx1.freebsd.org (Postfix) with ESMTP id 808D813C458 for ; Mon, 7 Jan 2008 18:04:08 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from phobos.samsco.home (phobos.samsco.home [192.168.254.11]) (authenticated bits=0) by pooker.samsco.org (8.13.8/8.13.8) with ESMTP id m07I42nv006099; Mon, 7 Jan 2008 11:04:02 -0700 (MST) (envelope-from scottl@samsco.org) Message-ID: <47826992.10200@samsco.org> Date: Mon, 07 Jan 2008 11:04:02 -0700 From: Scott Long User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.11) Gecko/20071128 SeaMonkey/1.1.7 MIME-Version: 1.0 To: Lan Tran References: <47826194.1080703@hangwithme.com> In-Reply-To: <47826194.1080703@hangwithme.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Greylist: Sender succeeded SMTP AUTH authentication, not delayed by milter-greylist-2.0.2 (pooker.samsco.org [168.103.85.57]); Mon, 07 Jan 2008 11:04:02 -0700 (MST) X-Spam-Status: No, score=-1.4 required=5.4 tests=ALL_TRUSTED autolearn=failed version=3.1.8 X-Spam-Checker-Version: SpamAssassin 3.1.8 (2007-02-13) on pooker.samsco.org Cc: freebsd-scsi@freebsd.org Subject: Re: QLogic HBAs+EMC AX100 SAN X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Jan 2008 18:04:08 -0000 Lan Tran wrote: > I'd like to direct connect a FreeBSD-6.2 system to an EMC AX100 SAN > using 2 QLogic 23xx series HBAs. Here is the dmesg output: > isp0: port 0xec00-0xecff mem > 0xdfdff000-0xdfdfffff irq 39 at device 12.0 on pci2 > isp0: [GIANT-LOCKED] > isp0: Polled Mailbox Command (0x2) Timeout > isp0: Polled Mailbox Command (0x8) Timeout > device_attach: isp0 attach returned 6 > > isp1: port 0xdc00-0xdcff mem > 0xdfbff000-0xdfbfffff irq 37 at device 11.0 on pci3 > isp1: [GIANT-LOCKED] > isp1: Polled Mailbox Command (0x2) Timeout > isp1: Polled Mailbox Command (0x8) Timeout > device_attach: isp1 attach returned 6 > > During boot the system would hang after for awhile then continue. I > have created a LUN and assigned it to this system, but the OS does not > see it. What am I missing? What commands should I try from the OS? > Does anyone have a similar setup working with the QLogic HBAs? AX100 > used to be connected to RHEL but I want to use FreeBSD instead :). > > Lan Did you compile in or load the ispfw module? Without it, FC operations are severely limited. Scott From owner-freebsd-scsi@FreeBSD.ORG Mon Jan 7 20:23:35 2008 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D104B16A421 for ; Mon, 7 Jan 2008 20:23:35 +0000 (UTC) (envelope-from lan@hangwithme.com) Received: from mta1.recol.net (mta1.recol.net [64.207.103.6]) by mx1.freebsd.org (Postfix) with ESMTP id A14AC13C474 for ; Mon, 7 Jan 2008 20:23:35 +0000 (UTC) (envelope-from lan@hangwithme.com) Message-ID: <47828A47.4050100@hangwithme.com> Date: Mon, 07 Jan 2008 15:23:35 -0500 From: Lan Tran User-Agent: Thunderbird 2.0.0.9 (Windows/20071031) MIME-Version: 1.0 To: Scott Long References: <47826194.1080703@hangwithme.com> <47826992.10200@samsco.org> In-Reply-To: <47826992.10200@samsco.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-scsi@freebsd.org Subject: Re: QLogic HBAs+EMC AX100 SAN X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Jan 2008 20:23:35 -0000 Scott Long wrote: > Lan Tran wrote: >> I'd like to direct connect a FreeBSD-6.2 system to an EMC AX100 SAN >> using 2 QLogic 23xx series HBAs. Here is the dmesg output: >> isp0: port 0xec00-0xecff mem >> 0xdfdff000-0xdfdfffff irq 39 at device 12.0 on pci2 >> isp0: [GIANT-LOCKED] >> isp0: Polled Mailbox Command (0x2) Timeout >> isp0: Polled Mailbox Command (0x8) Timeout >> device_attach: isp0 attach returned 6 >> >> isp1: port 0xdc00-0xdcff mem >> 0xdfbff000-0xdfbfffff irq 37 at device 11.0 on pci3 >> isp1: [GIANT-LOCKED] >> isp1: Polled Mailbox Command (0x2) Timeout >> isp1: Polled Mailbox Command (0x8) Timeout >> device_attach: isp1 attach returned 6 >> >> During boot the system would hang after for awhile then continue. I >> have created a LUN and assigned it to this system, but the OS does >> not see it. What am I missing? What commands should I try from the >> OS? Does anyone have a similar setup working with the QLogic HBAs? >> AX100 used to be connected to RHEL but I want to use FreeBSD instead :). >> >> Lan > > Did you compile in or load the ispfw module? Without it, FC > operations are severely limited. > > Scott Thanks for a quick reply, Scott. I added ispfw_load="YES" to /boot/loader.conf and now system can boot up fast. # camcontrol devlist -v scbus0 on isp0 bus 0: at scbus0 target 125 lun 0 (pass0,da0) < > at scbus0 target -1 lun -1 () scbus1 on isp1 bus 0: at scbus1 target 125 lun 0 (pass1,da1) < > at scbus1 target -1 lun -1 () scbus-1 on xpt0 bus 0: < > at scbus-1 target -1 lun -1 (xpt0) Next question is can I do multipath with ISP driver? The EMC AX100 has two "processors" for redundancy. Lan From owner-freebsd-scsi@FreeBSD.ORG Mon Jan 7 20:53:34 2008 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B0FA116A419 for ; Mon, 7 Jan 2008 20:53:34 +0000 (UTC) (envelope-from gpalmer@freebsd.org) Received: from noop.in-addr.com (unknown [IPv6:2001:5c0:8fff:fffe::214d]) by mx1.freebsd.org (Postfix) with ESMTP id 656AA13C43E for ; Mon, 7 Jan 2008 20:53:34 +0000 (UTC) (envelope-from gpalmer@freebsd.org) Received: from gjp by noop.in-addr.com with local (Exim 4.54 (FreeBSD)) id 1JByyT-000EER-6f; Mon, 07 Jan 2008 15:53:33 -0500 Date: Mon, 7 Jan 2008 15:53:33 -0500 From: Gary Palmer To: Lan Tran Message-ID: <20080107205333.GA86111@in-addr.com> References: <47826194.1080703@hangwithme.com> <47826992.10200@samsco.org> <47828A47.4050100@hangwithme.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <47828A47.4050100@hangwithme.com> Cc: freebsd-scsi@freebsd.org Subject: Re: QLogic HBAs+EMC AX100 SAN X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Jan 2008 20:53:34 -0000 On Mon, Jan 07, 2008 at 03:23:35PM -0500, Lan Tran wrote: > Scott Long wrote: > >Lan Tran wrote: > >>I'd like to direct connect a FreeBSD-6.2 system to an EMC AX100 SAN > >>using 2 QLogic 23xx series HBAs. Here is the dmesg output: > >>isp0: port 0xec00-0xecff mem > >>0xdfdff000-0xdfdfffff irq 39 at device 12.0 on pci2 > >>isp0: [GIANT-LOCKED] > >>isp0: Polled Mailbox Command (0x2) Timeout > >>isp0: Polled Mailbox Command (0x8) Timeout > >>device_attach: isp0 attach returned 6 > >> > >>isp1: port 0xdc00-0xdcff mem > >>0xdfbff000-0xdfbfffff irq 37 at device 11.0 on pci3 > >>isp1: [GIANT-LOCKED] > >>isp1: Polled Mailbox Command (0x2) Timeout > >>isp1: Polled Mailbox Command (0x8) Timeout > >>device_attach: isp1 attach returned 6 > >> > >>During boot the system would hang after for awhile then continue. I > >>have created a LUN and assigned it to this system, but the OS does > >>not see it. What am I missing? What commands should I try from the > >>OS? Does anyone have a similar setup working with the QLogic HBAs? > >>AX100 used to be connected to RHEL but I want to use FreeBSD instead :). > >> > >>Lan > > > >Did you compile in or load the ispfw module? Without it, FC > >operations are severely limited. > > > >Scott > Thanks for a quick reply, Scott. > > I added ispfw_load="YES" to /boot/loader.conf and now system can boot up > fast. > # camcontrol devlist -v > scbus0 on isp0 bus 0: > at scbus0 target 125 lun 0 (pass0,da0) > < > at scbus0 target -1 lun -1 () > scbus1 on isp1 bus 0: > at scbus1 target 125 lun 0 (pass1,da1) > < > at scbus1 target -1 lun -1 () > scbus-1 on xpt0 bus 0: > < > at scbus-1 target -1 lun -1 (xpt0) > > Next question is can I do multipath with ISP driver? The EMC AX100 has > two "processors" for redundancy. man geom_fox From owner-freebsd-scsi@FreeBSD.ORG Mon Jan 7 20:54:55 2008 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CCD3816A421 for ; Mon, 7 Jan 2008 20:54:55 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from pooker.samsco.org (pooker.samsco.org [168.103.85.57]) by mx1.freebsd.org (Postfix) with ESMTP id 5AEAE13C458 for ; Mon, 7 Jan 2008 20:54:55 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from phobos.samsco.home (phobos.samsco.home [192.168.254.11]) (authenticated bits=0) by pooker.samsco.org (8.13.8/8.13.8) with ESMTP id m07KsqOk006689; Mon, 7 Jan 2008 13:54:52 -0700 (MST) (envelope-from scottl@samsco.org) Message-ID: <4782919C.9050805@samsco.org> Date: Mon, 07 Jan 2008 13:54:52 -0700 From: Scott Long User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.11) Gecko/20071128 SeaMonkey/1.1.7 MIME-Version: 1.0 To: Lan Tran References: <47826194.1080703@hangwithme.com> <47826992.10200@samsco.org> <47828A47.4050100@hangwithme.com> In-Reply-To: <47828A47.4050100@hangwithme.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Greylist: Sender succeeded SMTP AUTH authentication, not delayed by milter-greylist-2.0.2 (pooker.samsco.org [168.103.85.57]); Mon, 07 Jan 2008 13:54:52 -0700 (MST) X-Spam-Status: No, score=-1.4 required=5.4 tests=ALL_TRUSTED autolearn=failed version=3.1.8 X-Spam-Checker-Version: SpamAssassin 3.1.8 (2007-02-13) on pooker.samsco.org Cc: freebsd-scsi@freebsd.org Subject: Re: QLogic HBAs+EMC AX100 SAN X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Jan 2008 20:54:55 -0000 Lan Tran wrote: > Scott Long wrote: >> Lan Tran wrote: >>> I'd like to direct connect a FreeBSD-6.2 system to an EMC AX100 SAN >>> using 2 QLogic 23xx series HBAs. Here is the dmesg output: >>> isp0: port 0xec00-0xecff mem >>> 0xdfdff000-0xdfdfffff irq 39 at device 12.0 on pci2 >>> isp0: [GIANT-LOCKED] >>> isp0: Polled Mailbox Command (0x2) Timeout >>> isp0: Polled Mailbox Command (0x8) Timeout >>> device_attach: isp0 attach returned 6 >>> >>> isp1: port 0xdc00-0xdcff mem >>> 0xdfbff000-0xdfbfffff irq 37 at device 11.0 on pci3 >>> isp1: [GIANT-LOCKED] >>> isp1: Polled Mailbox Command (0x2) Timeout >>> isp1: Polled Mailbox Command (0x8) Timeout >>> device_attach: isp1 attach returned 6 >>> >>> During boot the system would hang after for awhile then continue. I >>> have created a LUN and assigned it to this system, but the OS does >>> not see it. What am I missing? What commands should I try from the >>> OS? Does anyone have a similar setup working with the QLogic HBAs? >>> AX100 used to be connected to RHEL but I want to use FreeBSD instead :). >>> >>> Lan >> >> Did you compile in or load the ispfw module? Without it, FC >> operations are severely limited. >> >> Scott > Thanks for a quick reply, Scott. > > I added ispfw_load="YES" to /boot/loader.conf and now system can boot up > fast. # camcontrol devlist -v > scbus0 on isp0 bus 0: > at scbus0 target 125 lun 0 (pass0,da0) > < > at scbus0 target -1 lun -1 () > scbus1 on isp1 bus 0: > at scbus1 target 125 lun 0 (pass1,da1) > < > at scbus1 target -1 lun -1 () > scbus-1 on xpt0 bus 0: > < > at scbus-1 target -1 lun -1 (xpt0) > > Next question is can I do multipath with ISP driver? The EMC AX100 has > two "processors" for redundancy. > Lan There isn't much multipath support in FreeBSD. It's up to the host adapter card to manage that right now, and I don't know if the Qlogic cards do that or not. You might talk to Matt Jacob . Scott From owner-freebsd-scsi@FreeBSD.ORG Mon Jan 7 21:11:37 2008 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 14F0B16A417 for ; Mon, 7 Jan 2008 21:11:37 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from pooker.samsco.org (pooker.samsco.org [168.103.85.57]) by mx1.freebsd.org (Postfix) with ESMTP id 93B4A13C4DD for ; Mon, 7 Jan 2008 21:11:36 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from phobos.samsco.home (phobos.samsco.home [192.168.254.11]) (authenticated bits=0) by pooker.samsco.org (8.13.8/8.13.8) with ESMTP id m07LBXT1006820; Mon, 7 Jan 2008 14:11:33 -0700 (MST) (envelope-from scottl@samsco.org) Message-ID: <47829585.5060900@samsco.org> Date: Mon, 07 Jan 2008 14:11:33 -0700 From: Scott Long User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.11) Gecko/20071128 SeaMonkey/1.1.7 MIME-Version: 1.0 To: Gary Palmer References: <47826194.1080703@hangwithme.com> <47826992.10200@samsco.org> <47828A47.4050100@hangwithme.com> <20080107205333.GA86111@in-addr.com> In-Reply-To: <20080107205333.GA86111@in-addr.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Greylist: Sender succeeded SMTP AUTH authentication, not delayed by milter-greylist-2.0.2 (pooker.samsco.org [168.103.85.57]); Mon, 07 Jan 2008 14:11:33 -0700 (MST) X-Spam-Status: No, score=-1.4 required=5.4 tests=ALL_TRUSTED autolearn=failed version=3.1.8 X-Spam-Checker-Version: SpamAssassin 3.1.8 (2007-02-13) on pooker.samsco.org Cc: freebsd-scsi@freebsd.org Subject: Re: QLogic HBAs+EMC AX100 SAN X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Jan 2008 21:11:37 -0000 Gary Palmer wrote: > On Mon, Jan 07, 2008 at 03:23:35PM -0500, Lan Tran wrote: >> Scott Long wrote: >>> Lan Tran wrote: >>>> I'd like to direct connect a FreeBSD-6.2 system to an EMC AX100 SAN >>>> using 2 QLogic 23xx series HBAs. Here is the dmesg output: >>>> isp0: port 0xec00-0xecff mem >>>> 0xdfdff000-0xdfdfffff irq 39 at device 12.0 on pci2 >>>> isp0: [GIANT-LOCKED] >>>> isp0: Polled Mailbox Command (0x2) Timeout >>>> isp0: Polled Mailbox Command (0x8) Timeout >>>> device_attach: isp0 attach returned 6 >>>> >>>> isp1: port 0xdc00-0xdcff mem >>>> 0xdfbff000-0xdfbfffff irq 37 at device 11.0 on pci3 >>>> isp1: [GIANT-LOCKED] >>>> isp1: Polled Mailbox Command (0x2) Timeout >>>> isp1: Polled Mailbox Command (0x8) Timeout >>>> device_attach: isp1 attach returned 6 >>>> >>>> During boot the system would hang after for awhile then continue. I >>>> have created a LUN and assigned it to this system, but the OS does >>>> not see it. What am I missing? What commands should I try from the >>>> OS? Does anyone have a similar setup working with the QLogic HBAs? >>>> AX100 used to be connected to RHEL but I want to use FreeBSD instead :). >>>> >>>> Lan >>> Did you compile in or load the ispfw module? Without it, FC >>> operations are severely limited. >>> >>> Scott >> Thanks for a quick reply, Scott. >> >> I added ispfw_load="YES" to /boot/loader.conf and now system can boot up >> fast. >> # camcontrol devlist -v >> scbus0 on isp0 bus 0: >> at scbus0 target 125 lun 0 (pass0,da0) >> < > at scbus0 target -1 lun -1 () >> scbus1 on isp1 bus 0: >> at scbus1 target 125 lun 0 (pass1,da1) >> < > at scbus1 target -1 lun -1 () >> scbus-1 on xpt0 bus 0: >> < > at scbus-1 target -1 lun -1 (xpt0) >> >> Next question is can I do multipath with ISP driver? The EMC AX100 has >> two "processors" for redundancy. > > man geom_fox > geom_fox doesn't provide the active-passive level of control that most people expect with FC, nor does it interoperate with other non-FreeBSD systems. So it is useful in some situations, but it's not exactly what most people expect from traditional FC multipath. Scott From owner-freebsd-scsi@FreeBSD.ORG Mon Jan 7 21:24:14 2008 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C52F716A468; Mon, 7 Jan 2008 21:24:14 +0000 (UTC) (envelope-from john@jnielsen.net) Received: from ns1.jnielsen.net (ns1.jnielsen.net [69.55.238.237]) by mx1.freebsd.org (Postfix) with ESMTP id 4DD4813C474; Mon, 7 Jan 2008 21:24:14 +0000 (UTC) (envelope-from john@jnielsen.net) Received: from ns1.jnielsen.net (jn@ns1 [69.55.238.237]) by ns1.jnielsen.net (8.12.9p2/8.12.9) with ESMTP id m07L36QV081928; Mon, 7 Jan 2008 16:03:07 -0500 (EST) (envelope-from john@jnielsen.net) Received: (from www@localhost) by ns1.jnielsen.net (8.12.9p2/8.12.9/Submit) id m07L36XF081925; Mon, 7 Jan 2008 16:03:06 -0500 (EST) (envelope-from john@jnielsen.net) X-Authentication-Warning: ns1.jnielsen.net: www set sender to john@jnielsen.net using -f Received: from nc-2wac-zop02.wachovia.com (nc-2wac-zop02.wachovia.com [162.111.235.36]) by newwebmail.jnielsen.net (Horde MIME library) with HTTP; Mon, 07 Jan 2008 16:03:06 -0500 Message-ID: <20080107160306.xv38wi6v40cw4s4g@newwebmail.jnielsen.net> Date: Mon, 07 Jan 2008 16:03:06 -0500 From: John Nielsen To: Gary Palmer References: <47826194.1080703@hangwithme.com> <47826992.10200@samsco.org> <47828A47.4050100@hangwithme.com> <20080107205333.GA86111@in-addr.com> In-Reply-To: <20080107205333.GA86111@in-addr.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format="flowed" Content-Disposition: inline Content-Transfer-Encoding: 7bit User-Agent: Internet Messaging Program (IMP) H3 (4.0.4) / FreeBSD-4.9 X-Virus-Scanned: ClamAV version 0.88.4, clamav-milter version 0.88.4 on ns1.jnielsen.net X-Virus-Status: Clean Cc: freebsd-scsi@freebsd.org Subject: Re: QLogic HBAs+EMC AX100 SAN X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Jan 2008 21:24:14 -0000 Quoting Gary Palmer : > On Mon, Jan 07, 2008 at 03:23:35PM -0500, Lan Tran wrote: >> Scott Long wrote: >> >Lan Tran wrote: >> >>I'd like to direct connect a FreeBSD-6.2 system to an EMC AX100 SAN >> >>using 2 QLogic 23xx series HBAs. Here is the dmesg output: >> >>isp0: port 0xec00-0xecff mem >> >>0xdfdff000-0xdfdfffff irq 39 at device 12.0 on pci2 >> >>isp0: [GIANT-LOCKED] >> >>isp0: Polled Mailbox Command (0x2) Timeout >> >>isp0: Polled Mailbox Command (0x8) Timeout >> >>device_attach: isp0 attach returned 6 >> >> >> >>isp1: port 0xdc00-0xdcff mem >> >>0xdfbff000-0xdfbfffff irq 37 at device 11.0 on pci3 >> >>isp1: [GIANT-LOCKED] >> >>isp1: Polled Mailbox Command (0x2) Timeout >> >>isp1: Polled Mailbox Command (0x8) Timeout >> >>device_attach: isp1 attach returned 6 >> >> >> >>During boot the system would hang after for awhile then continue. I >> >>have created a LUN and assigned it to this system, but the OS does >> >>not see it. What am I missing? What commands should I try from the >> >>OS? Does anyone have a similar setup working with the QLogic HBAs? >> >>AX100 used to be connected to RHEL but I want to use FreeBSD instead :). >> >> >> >>Lan >> > >> >Did you compile in or load the ispfw module? Without it, FC >> >operations are severely limited. >> > >> >Scott >> Thanks for a quick reply, Scott. >> >> I added ispfw_load="YES" to /boot/loader.conf and now system can boot up >> fast. >> # camcontrol devlist -v >> scbus0 on isp0 bus 0: >> at scbus0 target 125 lun 0 (pass0,da0) >> < > at scbus0 target -1 lun -1 () >> scbus1 on isp1 bus 0: >> at scbus1 target 125 lun 0 (pass1,da1) >> < > at scbus1 target -1 lun -1 () >> scbus-1 on xpt0 bus 0: >> < > at scbus-1 target -1 lun -1 (xpt0) >> >> Next question is can I do multipath with ISP driver? The EMC AX100 has >> two "processors" for redundancy. > > man geom_fox geom_multipath (by mjacob as it happens) is more complete and user-friendly and is/will be included with FreeBSD 7. See this (short) thread: http://groups.google.com/group/bsdmailinglist/browse_thread/thread/c1a32120f238ca8c/0f58dd01c5ef0b16 JN From owner-freebsd-scsi@FreeBSD.ORG Mon Jan 7 21:50:35 2008 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EA8C216A417 for ; Mon, 7 Jan 2008 21:50:35 +0000 (UTC) (envelope-from lan@hangwithme.com) Received: from mta1.recol.net (mta1.recol.net [64.207.103.6]) by mx1.freebsd.org (Postfix) with ESMTP id B888C13C47E for ; Mon, 7 Jan 2008 21:50:35 +0000 (UTC) (envelope-from lan@hangwithme.com) Message-ID: <47829EAB.6060306@hangwithme.com> Date: Mon, 07 Jan 2008 16:50:35 -0500 From: Lan Tran User-Agent: Thunderbird 2.0.0.9 (Windows/20071031) MIME-Version: 1.0 To: John Nielsen References: <47826194.1080703@hangwithme.com> <47826992.10200@samsco.org> <47828A47.4050100@hangwithme.com> <20080107205333.GA86111@in-addr.com> <20080107160306.xv38wi6v40cw4s4g@newwebmail.jnielsen.net> In-Reply-To: <20080107160306.xv38wi6v40cw4s4g@newwebmail.jnielsen.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-scsi@freebsd.org Subject: Re: QLogic HBAs+EMC AX100 SAN X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Jan 2008 21:50:36 -0000 John Nielsen wrote: > Quoting Gary Palmer : > >> On Mon, Jan 07, 2008 at 03:23:35PM -0500, Lan Tran wrote: >>> Scott Long wrote: >>> >Lan Tran wrote: >>> >>I'd like to direct connect a FreeBSD-6.2 system to an EMC AX100 SAN >>> >>using 2 QLogic 23xx series HBAs. Here is the dmesg output: >>> >>isp0: port 0xec00-0xecff mem >>> >>0xdfdff000-0xdfdfffff irq 39 at device 12.0 on pci2 >>> >>isp0: [GIANT-LOCKED] >>> >>isp0: Polled Mailbox Command (0x2) Timeout >>> >>isp0: Polled Mailbox Command (0x8) Timeout >>> >>device_attach: isp0 attach returned 6 >>> >> >>> >>isp1: port 0xdc00-0xdcff mem >>> >>0xdfbff000-0xdfbfffff irq 37 at device 11.0 on pci3 >>> >>isp1: [GIANT-LOCKED] >>> >>isp1: Polled Mailbox Command (0x2) Timeout >>> >>isp1: Polled Mailbox Command (0x8) Timeout >>> >>device_attach: isp1 attach returned 6 >>> >> >>> >>During boot the system would hang after for awhile then continue. I >>> >>have created a LUN and assigned it to this system, but the OS does >>> >>not see it. What am I missing? What commands should I try from the >>> >>OS? Does anyone have a similar setup working with the QLogic HBAs? >>> >>AX100 used to be connected to RHEL but I want to use FreeBSD >>> instead :). >>> >> >>> >>Lan >>> > >>> >Did you compile in or load the ispfw module? Without it, FC >>> >operations are severely limited. >>> > >>> >Scott >>> Thanks for a quick reply, Scott. >>> >>> I added ispfw_load="YES" to /boot/loader.conf and now system can >>> boot up >>> fast. >>> # camcontrol devlist -v >>> scbus0 on isp0 bus 0: >>> at scbus0 target 125 lun 0 >>> (pass0,da0) >>> < > at scbus0 target -1 lun -1 () >>> scbus1 on isp1 bus 0: >>> at scbus1 target 125 lun 0 >>> (pass1,da1) >>> < > at scbus1 target -1 lun -1 () >>> scbus-1 on xpt0 bus 0: >>> < > at scbus-1 target -1 lun -1 (xpt0) >>> >>> Next question is can I do multipath with ISP driver? The EMC AX100 >>> has >>> two "processors" for redundancy. >> >> man geom_fox > > geom_multipath (by mjacob as it happens) is more complete and > user-friendly and is/will be included with FreeBSD 7. See this (short) > thread: > http://groups.google.com/group/bsdmailinglist/browse_thread/thread/c1a32120f238ca8c/0f58dd01c5ef0b16 > > > JN > Thanks for the thread. That is a good news. I'll wait for 7.0-R to try geom_multipath or is it included in 7.0-PRE already? Lan From owner-freebsd-scsi@FreeBSD.ORG Mon Jan 7 23:24:14 2008 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id ED32F16A419 for ; Mon, 7 Jan 2008 23:24:14 +0000 (UTC) (envelope-from lists@jnielsen.net) Received: from ns1.jnielsen.net (ns1.jnielsen.net [69.55.238.237]) by mx1.freebsd.org (Postfix) with ESMTP id 973EA13C448 for ; Mon, 7 Jan 2008 23:24:14 +0000 (UTC) (envelope-from lists@jnielsen.net) Received: from stealth.jnielsen.net (jn@stealth.jnielsen.net [74.218.226.254]) (authenticated bits=0) by ns1.jnielsen.net (8.12.9p2/8.12.9) with ESMTP id m07MqnQV052777; Mon, 7 Jan 2008 17:52:49 -0500 (EST) (envelope-from lists@jnielsen.net) From: John Nielsen To: freebsd-scsi@freebsd.org Date: Mon, 7 Jan 2008 17:52:48 -0500 User-Agent: KMail/1.9.7 References: <47826194.1080703@hangwithme.com> <20080107160306.xv38wi6v40cw4s4g@newwebmail.jnielsen.net> <47829EAB.6060306@hangwithme.com> In-Reply-To: <47829EAB.6060306@hangwithme.com> X-Face: #X5#Y*q>F:]zT!DegL3z5Xo'^MN[$8k\[4^3rN~wm=s=Uw(sW}R?3b^*f1Wu*.<=?utf-8?q?of=5F4NrS=0A=09P*M/9CpxDo!D6?=)IY1w<9B1jB; tBQf[RU-R<,I)e"$q7N7 MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200801071752.48485.lists@jnielsen.net> X-Virus-Scanned: ClamAV version 0.88.4, clamav-milter version 0.88.4 on ns1.jnielsen.net X-Virus-Status: Clean Cc: Subject: Re: QLogic HBAs+EMC AX100 SAN X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Jan 2008 23:24:15 -0000 On Monday 07 January 2008 04:50:35 pm Lan Tran wrote: > John Nielsen wrote: > > Quoting Gary Palmer : > >> On Mon, Jan 07, 2008 at 03:23:35PM -0500, Lan Tran wrote: > >>> Next question is can I do multipath with ISP driver? The EMC AX100 > >>> has > >>> two "processors" for redundancy. > >> > >> man geom_fox > > > > geom_multipath (by mjacob as it happens) is more complete and > > user-friendly and is/will be included with FreeBSD 7. See this (short) > > thread: > > http://groups.google.com/group/bsdmailinglist/browse_thread/thread/c1a3 > >2120f238ca8c/0f58dd01c5ef0b16 > > Thanks for the thread. That is a good news. I'll wait for 7.0-R to try > geom_multipath or is it included in 7.0-PRE already? It's been in 7-CURRENT/BETA/PRE for quite a while; I just didn't want to imply that 7.0-RELEASE had already happened. If you're already running 7.0-PRE then have a look at "man gmultipath". Keep in mind that this is a "regular" GEOM class and uses the last sector of the provider to store its own metadata, so Scott's comments about geom_fox as far as interoperability goes still apply (other OSes know nothing about GEOM). The man page does a good job of explaining how the active/passive status works, so you can be your own judge of whether that meets your expectations. JN