From owner-freebsd-stable@FreeBSD.ORG Tue Sep 20 12:23:02 2011 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 24261106564A for ; Tue, 20 Sep 2011 12:23:02 +0000 (UTC) (envelope-from freebsdlists@bsdunix.ch) Received: from conversation.bsdunix.ch (ns1.bsdunix.ch [82.220.1.90]) by mx1.freebsd.org (Postfix) with ESMTP id C38CD8FC0A for ; Tue, 20 Sep 2011 12:23:01 +0000 (UTC) Received: from conversation.bsdunix.ch (localhost [127.0.0.1]) by conversation.bsdunix.ch (Postfix) with ESMTP id 5A1244CCA; Tue, 20 Sep 2011 12:23:00 +0000 (UTC) X-Virus-Scanned: by amavisd-new at mail.bsdunix.ch Received: from conversation.bsdunix.ch ([127.0.0.1]) by conversation.bsdunix.ch (conversation.bsdunix.ch [127.0.0.1]) (amavisd-new, port 10024) with LMTP id EL6yO7rboaV3; Tue, 20 Sep 2011 12:22:59 +0000 (UTC) Received: from ernie.mlan.solnet.ch (ernie.mlan.solnet.ch [212.101.1.20]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by conversation.bsdunix.ch (Postfix) with ESMTPSA id 8C90C4CC4; Tue, 20 Sep 2011 12:22:59 +0000 (UTC) Mime-Version: 1.0 (Apple Message framework v1244.3) Content-Type: text/plain; charset=us-ascii From: Thomas Vogt In-Reply-To: <20110919195340.GQ40781@alchemy.franken.de> Date: Tue, 20 Sep 2011 14:22:59 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: <2843DCCD-4813-4B3A-B46E-0F73D87A1E3E@bsdunix.ch> References: <94E5E0D6-3062-44A2-8ED3-3C3D44FA7A09@bsdunix.ch> <20110919190659.GA76654@alchemy.franken.de> <20110919195340.GQ40781@alchemy.franken.de> To: Marius Strobl X-Mailer: Apple Mail (2.1244.3) Cc: stable@freebsd.org Subject: Re: mpt0 timeouts with an intel SASUC8I controller X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Sep 2011 12:23:02 -0000 On Sep 19, 2011, at 9:53 PM, Marius Strobl wrote: > On Mon, Sep 19, 2011 at 09:13:53PM +0200, Thomas Vogt wrote: >> Hi Marius >>=20 >> On 19.09.2011, at 21:06, Marius Strobl wrote: >>=20 >>> On Mon, Sep 19, 2011 at 02:45:04PM +0200, Thomas Vogt wrote: >>>> Hello >>>>=20 >>>> I've stability issue with my new intel SASUC8I [1] PCIe controller. = It's a LSI 1068e based controller. After a few minutes with disk io = (csup or scrub by example) my FreeBSD 8-stable (64bit) is "freezing" for = a couple of minutes and I see a lot of error messages like: >>>>=20 >>>> Sep 17 03:10:03 gw kernel: mpt0: request 0xffffff80002bc3b0:48367 = timed out for ccb 0xffffff00050a8000 (req->ccb 0xffffff00050a8000) >>>> Sep 17 03:10:03 gw kernel: mpt0: request 0xffffff80002bbb40:48368 = timed out for ccb 0xffffff0004f81800 (req->ccb 0xffffff0004f81800) >>>> Sep 17 03:10:03 gw kernel: mpt0: completing timedout/aborted req = 0xffffff80002bc3b0:48367 >>>> Sep 17 03:10:03 gw kernel: mpt0: completing timedout/aborted req = 0xffffff80002bbb40:48368 >>>> Sep 17 03:10:03 gw kernel: mpt0: Timedout requests already = complete. Interrupts may not be functioning >>>>=20 >>>=20 >>> If this really is an issue with interrupts not getting delivered you >>> could try whether disabling MSI/MSI-X by setting hw.pci.enable_msi=3D0= >>> and hw.pci.enable_msix=3D0 either on the loader prompt or via = loader.conf >>> works around it. >>=20 >> I already tried this. It didn't change anything. Same timeouts. >>=20 >> I also tried vfs.zfs.vdev.min_pending=3D"1" and = vfs.zfs.vdev.max_pending=3D"1" in loader.conf without any positive = change. >>=20 >=20 > Okay, I was just worried as I recently changed mpt(4) to use MSI/MSI-X > by default for the SAS variants but couldn't test with all of them. = I'm > not aware of any issues with the driver causing command timeouts = though. > I'd make sure that both the controller and the disks have the latest > firmware; IIRC some time ago someone reported on current@ that = updating > the firmware of the disks solved the timeouts he was seeing for him. I already use the latest IR firmware on my controller. This Intel = SASUC8I supports both initiator target (IT) and integrated RAID (IR) = firmware as most LSI SAS host adapter [1]. I flashed the controller from = IR to IT. It works now.=20 With IR firmware: mptutil show adapter mpt0 Adapter: Board Name: SASUC8I Board Assembly: L3-25071-00C Chip Name: C1068E Chip Revision: UNUSED RAID Levels: RAID0, RAID1, RAID1E RAID0 Stripes: 64k RAID1E Stripes: 64k RAID0 Drives/Vol: 2-10 RAID1 Drives/Vol: 2 With IT firmware: mptutil show adapter mpt0 Adapter: Board Name: SASUC8I Board Assembly: L3-25071-00C Chip Name: C1068E Chip Revision: UNUSED RAID Levels: none [1] http://kb.lsi.com/KnowledgebaseArticle16266.aspx Regards, Thomas=