From owner-freebsd-bugs@FreeBSD.ORG Mon Oct 22 10:20:01 2012 Return-Path: Delivered-To: freebsd-bugs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 7A8A8EA1 for ; Mon, 22 Oct 2012 10:20:01 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.FreeBSD.org [8.8.178.135]) by mx1.freebsd.org (Postfix) with ESMTP id 50B248FC12 for ; Mon, 22 Oct 2012 10:20:01 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.5/8.14.5) with ESMTP id q9MAK1fX040481 for ; Mon, 22 Oct 2012 10:20:01 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.5/8.14.5/Submit) id q9MAK175040480; Mon, 22 Oct 2012 10:20:01 GMT (envelope-from gnats) Resent-Date: Mon, 22 Oct 2012 10:20:01 GMT Resent-Message-Id: <201210221020.q9MAK175040480@freefall.freebsd.org> Resent-From: FreeBSD-gnats-submit@FreeBSD.org (GNATS Filer) Resent-To: freebsd-bugs@FreeBSD.org Resent-Reply-To: FreeBSD-gnats-submit@FreeBSD.org, Travis Mikalson Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 76B10D15 for ; Mon, 22 Oct 2012 10:18:15 +0000 (UTC) (envelope-from nobody@FreeBSD.org) Received: from red.freebsd.org (red.freebsd.org [IPv6:2001:4f8:fff6::22]) by mx1.freebsd.org (Postfix) with ESMTP id 44BD58FC17 for ; Mon, 22 Oct 2012 10:18:15 +0000 (UTC) Received: from red.freebsd.org (localhost [127.0.0.1]) by red.freebsd.org (8.14.5/8.14.5) with ESMTP id q9MAIET1035744 for ; Mon, 22 Oct 2012 10:18:14 GMT (envelope-from nobody@red.freebsd.org) Received: (from nobody@localhost) by red.freebsd.org (8.14.5/8.14.5/Submit) id q9MAIEuf035743; Mon, 22 Oct 2012 10:18:14 GMT (envelope-from nobody) Message-Id: <201210221018.q9MAIEuf035743@red.freebsd.org> Date: Mon, 22 Oct 2012 10:18:14 GMT From: Travis Mikalson To: freebsd-gnats-submit@FreeBSD.org X-Send-Pr-Version: www-3.1 Subject: kern/172952: 9.1 hangs on reboot after all buffers synced X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 22 Oct 2012 10:20:01 -0000 >Number: 172952 >Category: kern >Synopsis: 9.1 hangs on reboot after all buffers synced >Confidential: no >Severity: non-critical >Priority: low >Responsible: freebsd-bugs >State: open >Quarter: >Keywords: >Date-Required: >Class: sw-bug >Submitter-Id: current-users >Arrival-Date: Mon Oct 22 10:20:00 UTC 2012 >Closed-Date: >Last-Modified: >Originator: Travis Mikalson >Release: 9.1-RC2 or 9-STABLE >Organization: TerraNovaNet Inc >Environment: FreeBSD mail.keysaccounting.com 9.1-RC2 FreeBSD 9.1-RC2 #8: Sat Oct 20 23:15:35 EDT 2012 root@mail.keysaccounting.com:/usr/obj/usr/src/sys/mail amd64 >Description: This is similar to PR 172086, but circumstances are different enough to warrant a new PR. Somewhere between 9.0-RELEASE and 9.1-RC, the ability to reliably soft reboot has been seriously compromised. When trying to "reboot" or "shutdown -r now", FreeBSD hangs indefinitely after "All buffers synced." The system is still pingable but otherwise non-responsive and requires a power-cycle. This problem is confirmed to not occur at all using 9.0-RELEASE-p4 world+kernel built from base/releng/9.0 48 hours ago. On two different servers with Supermicro H8SGL-F motherboards (AMD SR5650 + SP5100 Chipset, Opteron 6212 processor) and one or more mps(4) LSI SAS2008 controllers with ZFS loaded, this problem is 100% reproducible every time I attempt to reboot when using both 9.1-RC2 and base/stable/9 from 48 hours ago. These two servers cannot soft reboot, ever. I have also tried updating the BIOS on one of them and changing various BIOS settings to no avail including switching SATA controllers between AHCI and IDE emulation mode. On a simpler Intel Core i5 760 system with two SATA drives (using AHCI) this problem occurs about 25% of the time that I attempt to reboot. I have reproduced this hang randomly once so far on the simpler Intel Core i5 760 system without ZFS loaded with only a single SATA SSD using plain UFS plus journaled softupdates. I also built 9.1-RC2 with all changes from SVN revision 237873 patched out of it and I've confirmed that commit was not the cause of this problem. I realize this isn't yet adequate information to find and fix, but seeing as this is happening to varying degrees on all three systems I've put 9.1-RC2 on, I feel this issue is a severe showstopper for 9.1-RELEASE and I wanted to get this PR in before the 9.1 release cycle was completed. I will submit follow-up if I narrow this down in any useful way. Screen shot of issue: http://tog.net/reboothang-freebsd91.jpg >How-To-Repeat: I have not yet narrowed down what specifically causes this issue to be 100% reproducible or not so without someone else having my hardware config that 100% reproduces the problem here, is difficult to tell someone else how to repeat the problem. I will follow up as soon as I determine something more useful. >Fix: >Release-Note: >Audit-Trail: >Unformatted: