From owner-freebsd-scsi@FreeBSD.ORG Sat Feb 19 06:15:55 2005 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 093D516A4CE for ; Sat, 19 Feb 2005 06:15:55 +0000 (GMT) Received: from svm.csie.ntu.edu.tw (svm.csie.ntu.edu.tw [140.112.90.75]) by mx1.FreeBSD.org (Postfix) with ESMTP id 67E5D43D46 for ; Sat, 19 Feb 2005 06:15:54 +0000 (GMT) (envelope-from rafan@svm.csie.ntu.edu.tw) Received: from svm.csie.ntu.edu.tw (localhost [127.0.0.1]) by svm.csie.ntu.edu.tw (8.13.1/8.13.1) with ESMTP id j1J6FPLj092196; Sat, 19 Feb 2005 14:15:25 +0800 (CST) (envelope-from rafan@svm.csie.ntu.edu.tw) Received: (from rafan@localhost) by svm.csie.ntu.edu.tw (8.13.1/8.13.1/Submit) id j1J6FHCl092195; Sat, 19 Feb 2005 14:15:17 +0800 (CST) (envelope-from rafan) Date: Sat, 19 Feb 2005 14:15:17 +0800 From: Rong-En Fan To: Rong-En Fan Message-ID: <20050219061517.GA92149@svm.csie.ntu.edu.tw> References: <20050204102558.GA2001@svm.csie.ntu.edu.tw> <1108667040.656.20.camel@spirit> <20050218071746.GA41419@svm.csie.ntu.edu.tw> <20050218202901.GA71842@svm.csie.ntu.edu.tw> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20050218202901.GA71842@svm.csie.ntu.edu.tw> User-Agent: Mutt/1.5.7i cc: delphij@delphij.net cc: ob@e-Gitt.NET cc: scsi@freebsd.org Subject: Re: Problem with mpt(4) and Infortrend RAID X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 Feb 2005 06:15:55 -0000 On Sat, Feb 19, 2005 at 04:29:01AM +0800, Rong-En Fan wrote: > On Fri, Feb 18, 2005 at 03:17:46PM +0800, Rong-En Fan wrote: > > On Fri, Feb 18, 2005 at 03:04:00AM +0800, Xin LI wrote: > > > Have you got a chance to test this, I have gotten some similar problem > > > and got rid of them with the following patch applied (credit goes to > > > gibbs@ who fixed this last November): > > > > > > http://www.freebsd.org/cgi/cvsweb.cgi/src/sys/cam/cam_xpt.c.diff?r1=1.142&r2=1.142.2.2 > > > > > > This might be important since I think this has affected many users who > > > wants to use multiple LUN's, and thus warrants a new errata candidate > > > for 5.3-RELEASE. > > > > > > Thanks in advance! > > > > I have tested this with 5.3-p5: > > > > 1. 2 LD -> 1 channel, 320MB/s ok (with patch) > > 2. 2 LD -> 1 channel, 320MB/s failed (without patch) > > > > I simulate io by benchmark/blogbench > > This box now serves as NFS server with 20 clients. > and has some heavy io (about 30MB/s, lasting for 5 hours > or so) with this patch works fine. (2 channels, > each channel is 1 LD running at 320MB/s). Though you said > this patch solves multiple LUN problem, I think this > also solve my problem here. I was wrong, with patch, and 1 LD -> 1 channel, 320MB/s after 12hours, I got this: mpt0: time out on request index = 0xf6 sequence = 0x00246948 mpt0: Status 00000001; Mask 00000001; Doorbell 24000000 request state On Chip SCSI IO Request @ 0xe6489c20 Chain Offset 0x10 MsgFlags 0x00 MsgContext 0x000000f6 Bus: 0 TargetID 0 SenseBufferLength 32 LUN: 0x0 Control 0x01000000 WRITE SIMPLEQ DataLength 0x00010000 SenseBufAddr 0x7d610de0 CDB[0:10] 2a 00 6c 59 d7 50 00 00 80 00 SE32 0xe653dc30: Addr=0x3721e000 FlagsLength=0x14001000 HOST_TO_IOC SE32 0xe653dc38: Addr=0x7a65f000 FlagsLength=0x94001000 HOST_TO_IOC LAST_ELEMENT CE32 0xe653dc40: Addr=0x7d610c48 NxtChnO=0x16 Flgs=0x30 Len=0x60 SE32 0xe653dc48: Addr=0x76380000 FlagsLength=0x14001000 HOST_TO_IOC SE32 0xe653dc50: Addr=0xbae1000 FlagsLength=0x14001000 HOST_TO_IOC SE32 0xe653dc58: Addr=0x559a2000 FlagsLength=0x14001000 HOST_TO_IOC SE32 0xe653dc60: Addr=0x5343000 FlagsLength=0x14001000 HOST_TO_IOC SE32 0xe653dc68: Addr=0x282c4000 FlagsLength=0x14001000 HOST_TO_IOC SE32 0xe653dc70: Addr=0x41c5000 FlagsLength=0x14001000 HOST_TO_IOC SE32 0xe653dc78: Addr=0x231c6000 FlagsLength=0x14001000 HOST_TO_IOC SE32 0xe653dc80: Addr=0x5e9e7000 FlagsLength=0x14001000 HOST_TO_IOC SE32 0xe653dc88: Addr=0x2ffa8000 FlagsLength=0x14001000 HOST_TO_IOC SE32 0xe653dc90: Addr=0x6f09000 FlagsLength=0x14001000 HOST_TO_IOC SE32 0xe653dc98: Addr=0x4c2aa000 FlagsLength=0x94001000 HOST_TO_IOC LAST_ELEMENT CE32 0xe653dca0: Addr=0x7d610ca8 NxtChnO=0x0 Flgs=0x30 Len=0x18 SE32 0xe653dca8: Addr=0x3294b000 FlagsLength=0x14001000 HOST_TO_IOC SE32 0xe653dcb0: Addr=0x6e2ec000 FlagsLength=0x14001000 HOST_TO_IOC SE32 0xe653dcb8: Addr=0x2d78d000 FlagsLength=0xd5001000 HOST_TO_IOC LAST_ELEMENT END_OF_BUFFER END_OF_LIST mpt0: time out on request index = 0x36 sequence = 0x00246949 mpt0: Status 00000001; Mask 00000001; Doorbell 24000000 request state On Chip SCSI IO Request @ 0xe6489c20 Chain Offset 0x10 MsgFlags 0x00 MsgContext 0x00000036 Bus: 0 TargetID 0 SenseBufferLength 32 LUN: 0x0 Control 0x01000000 WRITE SIMPLEQ DataLength 0x00010000 SenseBufAddr 0x7d5f8de0 CDB[0:10] 2a 00 6c 59 d7 d0 00 00 80 00 SE32 0xe6525c30: Addr=0x878e000 FlagsLength=0x14001000 HOST_TO_IOC SE32 0xe6525c38: Addr=0x7906f000 FlagsLength=0x94001000 HOST_TO_IOC LAST_ELEMENT CE32 0xe6525c40: Addr=0x7d5f8c48 NxtChnO=0x16 Flgs=0x30 Len=0x60 SE32 0xe6525c48: Addr=0x21170000 FlagsLength=0x14001000 HOST_TO_IOC SE32 0xe6525c50: Addr=0x503f1000 FlagsLength=0x14001000 HOST_TO_IOC SE32 0xe6525c58: Addr=0x58c92000 FlagsLength=0x14001000 HOST_TO_IOC SE32 0xe6525c60: Addr=0x29a33000 FlagsLength=0x14001000 HOST_TO_IOC SE32 0xe6525c68: Addr=0x181d4000 FlagsLength=0x14001000 HOST_TO_IOC SE32 0xe6525c70: Addr=0x2875000 FlagsLength=0x14001000 HOST_TO_IOC SE32 0xe6525c78: Addr=0x58c76000 FlagsLength=0x14001000 HOST_TO_IOC SE32 0xe6525c80: Addr=0x4937000 FlagsLength=0x14001000 HOST_TO_IOC SE32 0xe6525c88: Addr=0x5fc78000 FlagsLength=0x14001000 HOST_TO_IOC SE32 0xe6525c90: Addr=0x7d019000 FlagsLength=0x14001000 HOST_TO_IOC SE32 0xe6525c98: Addr=0x7915a000 FlagsLength=0x94001000 HOST_TO_IOC LAST_ELEMENT CE32 0xe6525ca0: Addr=0x7d5f8ca8 NxtChnO=0x0 Flgs=0x30 Len=0x18 SE32 0xe6525ca8: Addr=0x909b000 FlagsLength=0x14001000 HOST_TO_IOC SE32 0xe6525cb0: Addr=0x27f9c000 FlagsLength=0x14001000 HOST_TO_IOC SE32 0xe6525cb8: Addr=0x65a1d000 FlagsLength=0xd5001000 HOST_TO_IOC LAST_ELEMENT END_OF_BUFFER END_OF_LIST These are the only messages after that console hang. Regards, Rong-En Fan