From owner-freebsd-stable@FreeBSD.ORG Mon Jun 6 17:01:22 2005 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E6D5816A41C for ; Mon, 6 Jun 2005 17:01:22 +0000 (GMT) (envelope-from mgrooms@seton.org) Received: from zixvpm01.seton.org (zixvpm01.seton.org [207.193.126.161]) by mx1.FreeBSD.org (Postfix) with ESMTP id 84A9243D1F for ; Mon, 6 Jun 2005 17:01:22 +0000 (GMT) (envelope-from mgrooms@seton.org) Received: from zixvpm01.seton.org (ZixVPM [127.0.0.1]) by Outbound.seton.org (Proprietary) with ESMTP id 79C9A360060 for ; Mon, 6 Jun 2005 12:01:21 -0500 (CDT) Received: from mx1-out.seton.org (unknown [10.21.254.249]) by zixvpm01.seton.org (Proprietary) with ESMTP id 4CFA6330047 for ; Mon, 6 Jun 2005 12:01:21 -0500 (CDT) Received: from localhost (unknown [127.0.0.1]) by mx1-out.seton.org (Postfix) with ESMTP id 422298014E25 for ; Mon, 6 Jun 2005 12:01:21 -0500 (CDT) Received: from mx1-out.seton.org ([10.21.254.249]) by localhost (mx1 [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id 01705-35 for ; Mon, 6 Jun 2005 12:01:21 -0500 (CDT) Received: from ausexfe01.seton.org (ausexfe01.seton.org [10.20.10.211]) by mx1-out.seton.org (Postfix) with ESMTP id 339F38014E24 for ; Mon, 6 Jun 2005 12:01:21 -0500 (CDT) Received: from [10.20.160.190] ([10.20.160.190]) by ausexfe01.seton.org with Microsoft SMTPSVC(6.0.3790.211); Mon, 6 Jun 2005 12:01:17 -0500 Message-ID: <42A48284.6070008@seton.org> Date: Mon, 06 Jun 2005 12:06:12 -0500 From: Matthew Grooms Organization: Seton Healthcare Network User-Agent: Mozilla Thunderbird 1.0.2 (Windows/20050317) X-Accept-Language: en-us, en MIME-Version: 1.0 To: freebsd-stable@freebsd.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-OriginalArrivalTime: 06 Jun 2005 17:01:17.0891 (UTC) FILETIME=[5B0BA130:01C56AB9] X-Virus-Scanned: by amavisd-new at seton.org Subject: Debug help - 5.3 lockups on amd64 SMP X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 06 Jun 2005 17:01:23 -0000 All, I am experiencing lockups on a production 5.4 amd64 SMP system. Its lightly loaded and seems to last about 3-5 days before it stops responding to network or even console interaction. The system is acting as a firewall and runs a mostly stock kernel with IPV6 removed and SMP, PF, PFLOG, CARP and ALTQ added. The only other thing I can think to note is that tcpdump is running constantly on the pflog interface to coax human readable firewall logs out of pf. I have an identical hot spare server with SMP disabled that has taken over flawlessly every time the live lock occurs so I am willing to leave the primary in the production environment to do testing and gather debug info. I have added the following options to primary fw kernel config ... # Debug Options makeoptions DEBUG=-g options DDB options KDB options BREAK_TO_DEBUGGER options INVARIANT_SUPPORT options INVARIANTS options WITNESS options WITNESS_KDB options WITNESS_SKIPSPIN ... and the following to the rc.conf ... dumpdev="/dev/amrd0s1h" dumpdir="/var/crash" Will this do it or should I add anything else? Thanks in advance, -Matthew