From owner-freebsd-hardware@FreeBSD.ORG Tue Jul 8 00:41:06 2008 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2400F1065673 for ; Tue, 8 Jul 2008 00:41:06 +0000 (UTC) (envelope-from aradford@gmail.com) Received: from py-out-1112.google.com (py-out-1112.google.com [64.233.166.176]) by mx1.freebsd.org (Postfix) with ESMTP id D04B68FC19 for ; Tue, 8 Jul 2008 00:41:05 +0000 (UTC) (envelope-from aradford@gmail.com) Received: by py-out-1112.google.com with SMTP id p76so1057655pyb.10 for ; Mon, 07 Jul 2008 17:41:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=ejBQnfLIL9nz5GIRs/PFze+zgibf0zHaM+pqwnFIhcA=; b=GfiCGipdmaw6goe7hN8hXPuZQrV+DLQXqRLG1XuNaPjJsUuA9mi971B+mOJoDsLris chlB87zkZCqJnMyjcTdzz49uoTdO0QZv8BY3Iy+i0sIqtGsGc6QzQrbIpmuYd75xbCjh +J4GrDUg8AazFDH4lhgu0D0h03mglaP9fGNTg= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=IJ0EAj1EGwGXx5D+Wj2OYcJndC0EtPQJ2VHgFycGmNmSknYvBCRBDSK+J4rJ5kQkia XEOHUU9+Z+/35WXqunW6lzE3KpA6Dm/7vhUMRJ+qqYq9XvdrUxMEoKedcPS/ryPzUVdh f31qRQqrEgCi0gUvBtJPPv1zQZ3/jYxlibP0c= Received: by 10.115.32.8 with SMTP id k8mr7217520waj.89.1215477664840; Mon, 07 Jul 2008 17:41:04 -0700 (PDT) Received: by 10.115.79.9 with HTTP; Mon, 7 Jul 2008 17:41:04 -0700 (PDT) Message-ID: Date: Mon, 7 Jul 2008 17:41:04 -0700 From: "adam radford" To: "Mike Andrews" In-Reply-To: <20080707190237.K70038@beast.int.bit0.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <20080707190237.K70038@beast.int.bit0.com> Cc: Manjunath Ranganathaiah , freebsd-hardware@freebsd.org Subject: Re: Debugging 3Ware 9000 series hangs under load X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Jul 2008 00:41:06 -0000 On Mon, Jul 7, 2008 at 4:26 PM, Mike Andrews wrote: > I've occasionally had problems with 3Ware 9550SX, 9650SE, and now 9690SA > cards hanging under load. By "hanging" I mean "swap_pager: indefinite wait > buffer" messages on the console, machine still pingable, etc -- basically a > livelock situation. "Heavy load" usually involves a busy MySQL instance > combined with, say, copying some multi-gigabyte files, maybe also combined > with rsync, all running concurrently. The problem is the hangs are > extremely sporadic and not easily reproducible on demand. It seems to happen > with both ZFS and UFS2; I've been sticking to UFS2 for this for now due to > some weird ZFS+MySQL issues (which are annoying but not relevant to this > particular problem)... > > On a FreeBSD/amd64 7-STABLE system built from less-than-one-week-old source, > with serial console and the kernel debugger compiled in, but being a > complete idiot on how to use KDB, can someone tell me what would be the most > useful info I could gather from KDB the next time this happens? Mike, Can you first run the 3ware command line utility (tw_cli) and post the results of: tw_cli info c0 diag -Adam