From owner-freebsd-stable@FreeBSD.ORG Tue Sep 30 20:19:55 2003 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D783D16A4B3 for ; Tue, 30 Sep 2003 20:19:55 -0700 (PDT) Received: from phoenix.gargantuan.com (rrcs-se-24-73-171-238.biz.rr.com [24.73.171.238]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9112A44005 for ; Tue, 30 Sep 2003 20:19:54 -0700 (PDT) (envelope-from michael@gargantuan.com) Received: from localhost (localhost.gargantuan.com [127.0.0.1]) by spamassassin-injector (Postfix) with SMTP id 6C73F383; Tue, 30 Sep 2003 23:19:53 -0400 (EDT) Received: from cyclops.gargantuan.com (cyclops.gargantuan.com [IPv6:3ffe:c00:8034:a00::18]) by phoenix.gargantuan.com (Postfix) with ESMTP id 61704231; Tue, 30 Sep 2003 23:19:41 -0400 (EDT) From: "Michael W. Oliver" To: Robert Watson Date: Tue, 30 Sep 2003 23:19:34 -0400 User-Agent: KMail/1.5.3 References: In-Reply-To: X-Personal-Email: michael@gargantuan.com X-WWW-Site: http://michael.gargantuan.com X-GPG-Public-Key: $WWW-Site/gnupg/pubkey.asc X-Home-Phone: +1-863-816-8091 X-Mobile-Phone: +1-863-738-2334 X-Home-Address: 8008 Apache Lane, Lakeland, FL, US 33810-2172 MIME-Version: 1.0 Content-Type: multipart/signed; protocol="application/pgp-signature"; micalg=pgp-sha1; boundary="Boundary-02=_Mfke/AKl2YS8nXl"; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Message-Id: <200309302319.40059.michael@gargantuan.com> X-Spam-Status: No, hits=-104.6 required=5.0 tests=AWL,BAYES_01,IN_REP_TO,PGP_SIGNATURE_2,REFERENCES, USER_AGENT_KMAIL,USER_IN_WHITELIST autolearn=ham version=2.55 X-Spam-Level: X-Spam-Checker-Version: SpamAssassin 2.55 (1.174.2.19-2003-05-19-exp) cc: freebsd-stable@freebsd.org Subject: Re: panics on 24 hour boundaries X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: michael@gargantuan.com List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Oct 2003 03:19:56 -0000 --Boundary-02=_Mfke/AKl2YS8nXl Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Content-Description: signed data Content-Disposition: inline +--- On Tuesday, September 30, 2003 22:35 --- | Robert Watson proclaimed: | | Initial reactions: panics on 24 hour boundaries are, in my experience, | often associated with the daily event. Once a day, the daily scripts run | find several times on your file systems, causing every file and directory | to be inspected for changes in setuid scripts, etc. This can trigger | certain classes of race conditions and resource limits that you might | otherwise not hit in normal operation -- and conviently, they run 24 | hours apart :-). To try and confirm this suspicion, it would be | interesting to know what time of day exactly the panics take place, and | whether you can reproduce the panic by manually running the daily or | security script. All of the panics happened in the evening hours, between 1800 and 2200 EDT.= =20 I am also able to successfully run the daily periodic scripts at any time=20 of the day without issue. | Also, out of curiosity: since you're experiencing crashes, I assume fsck | has run on all your file systems. If not, you might want to boot to | single user and run fsck on each file system manually to make sure | there's no on-disk corruption of UFS meta-data. Yep, fsck has been run after each hostile reboot, and I did a full fsck fro= m=20 single user mode before installing the world on the evening of 2003-09-28. As of this writing, the server has been up for 1 day, 2:22. Should another= =20 panic occur, I will perform a trace as before and post it out to stable@. Thanks for your reply Robert, I do appreciate it. =2D-=20 Mike perl -e 'print unpack("u","88V]N=3D&%C=3D\"!I;F9O(&EN(&AE861E