From owner-freebsd-stable@FreeBSD.ORG Wed Jul 11 11:19:45 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 4B12D106566B for ; Wed, 11 Jul 2012 11:19:45 +0000 (UTC) (envelope-from freebsd-stable@m.gmane.org) Received: from plane.gmane.org (plane.gmane.org [80.91.229.3]) by mx1.freebsd.org (Postfix) with ESMTP id 002F58FC16 for ; Wed, 11 Jul 2012 11:19:44 +0000 (UTC) Received: from list by plane.gmane.org with local (Exim 4.69) (envelope-from ) id 1SouxG-00018W-Dv for freebsd-stable@freebsd.org; Wed, 11 Jul 2012 13:19:38 +0200 Received: from lara.cc.fer.hr ([161.53.72.113]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 11 Jul 2012 13:19:38 +0200 Received: from ivoras by lara.cc.fer.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 11 Jul 2012 13:19:38 +0200 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-stable@freebsd.org From: Ivan Voras Date: Wed, 11 Jul 2012 13:19:27 +0200 Lines: 69 Message-ID: References: <4FF734CD.9070401@rpi.edu> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig8F0474A2E8E32C433B598958" X-Complaints-To: usenet@dough.gmane.org X-Gmane-NNTP-Posting-Host: lara.cc.fer.hr User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:10.0) Gecko/20120213 Thunderbird/10.0 In-Reply-To: <4FF734CD.9070401@rpi.edu> X-Enigmail-Version: 1.3.5 Subject: Re: Problems with crashing IBM X3630 M3/ZFS X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 11:19:45 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig8F0474A2E8E32C433B598958 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable On 06/07/2012 20:56, Bob Healey wrote: > Hello. I've got a quartet of IBM x3630 M3 with one that is frequently > hard locking under heavy NFS load. I am running 9.0-RELEASE with all > the patches from freebsd-update. >=20 > My problem machine has 8 16 core clients, each doing IO intensive tasks= > connected to it via a Procurve and the onboard igb0 interface. Mostly > network reads, typically 10MB read per MB written. > When the machine locks under load, none of the consoles respond, nor ca= n > I reach the machine via ethernet. I can break into DDB via the serial > over lan interface, and am running a debug/witness kernel at the moment= > (I was running GENERIC previously). During the boot sequence, witness > tosses me into DDB ~10 times before I get a login prompt. Prior to this= > machine acting up, it had multiple 802.1q vlans, and ran 9K packets on > its private network to the compute clients. >=20 > A dmesg can be found at http://boyle.che.rpi.edu/~healer/boomer/dmesg > /etc/rc.conf can be found at > http://boyle.che.rpi.edu/~healer/boomer/rc.conf > A listing of installed ports can be found at > http://boyle.che.rpi.edu/~healer/boomer/pkg_info > The output of psauxwwo wchan against my two crash dumps can be found at= > http://boyle.che.rpi.edu/~healer/boomer/crash1-psaux-wchan and > http://boyle.che.rpi.edu/~healer/boomer/crash2-psaux-wchan >=20 > I'm not entire convinced this is software, but I've run out of local > experts to ask, and can't prove its hardware. Hi, I tested a recent IBM machine similar to yours recently (I don't know if it was exactly the same model, but it was probably an M3), and observed a number of lockups which seemed to be related to the RAID card (IBM's ServeRAID, re-branded LSI). I don't know if this has anything to do with your problems, but IIRC in my case there were some kernel messages on the console relating to the driver and/or PCI bus errors on the slot with the RAID controller prior to the lockups - maybe you can check for these. I have other bad experiences with IBM's hardware and have given up on them for running FreeBSD. --------------enig8F0474A2E8E32C433B598958 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.19 (FreeBSD) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk/9YT8ACgkQ/QjVBj3/HSwl+wCgiXX702ufpDZq8OszYNMC0pAe TIMAoJ1spaHw4VRUpotf/j9AIuC8n+NZ =qJYJ -----END PGP SIGNATURE----- --------------enig8F0474A2E8E32C433B598958--