From owner-freebsd-questions@FreeBSD.ORG Wed Sep 24 15:57:40 2008 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2A08910656A0 for ; Wed, 24 Sep 2008 15:57:40 +0000 (UTC) (envelope-from ml@t-b-o-h.net) Received: from vjofn.tucs-beachin-obx-house.com (unknown [IPv6:2001:470:1f00:ffff::5e5]) by mx1.freebsd.org (Postfix) with ESMTP id EC4178FC0A for ; Wed, 24 Sep 2008 15:57:39 +0000 (UTC) (envelope-from ml@t-b-o-h.net) Received: from himinbjorg.tucs-beachin-obx-house.com (cpe-24-161-50-5.hvc.res.rr.com [24.161.50.5]) (authenticated bits=0) by vjofn.tucs-beachin-obx-house.com (8.14.2/8.14.2) with ESMTP id m8OFvS1S008781; Wed, 24 Sep 2008 11:57:38 -0400 (EDT) Received: from himinbjorg.tucs-beachin-obx-house.com (localhost.tucs-beachin-obx-house.com [127.0.0.1]) by himinbjorg.tucs-beachin-obx-house.com (8.14.3/8.14.3) with ESMTP id m8OFvMHD011594; Wed, 24 Sep 2008 11:57:23 -0400 (EDT) (envelope-from tbohml@himinbjorg.tucs-beachin-obx-house.com) Received: (from tbohml@localhost) by himinbjorg.tucs-beachin-obx-house.com (8.14.3/8.14.3/Submit) id m8OFvMx2011592; Wed, 24 Sep 2008 11:57:22 -0400 (EDT) (envelope-from tbohml) From: "Tuc at T-B-O-H.NET" Message-Id: <200809241557.m8OFvMx2011592@himinbjorg.tucs-beachin-obx-house.com> To: i.tanusheff@procreditbank.bg (Ivailo Tanusheff) Date: Wed, 24 Sep 2008 11:57:22 -0400 (EDT) In-Reply-To: X-Mailer: ELM [version 2.5 PL8] MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.64 on 192.168.3.21 Cc: freebsd-questions@freebsd.org Subject: Re: [freebsd-questions] Re: Machine locking up X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Sep 2008 15:57:40 -0000 Hi, Might be on track there. The default "background_fsck" is on and the first time I didn't see any of the fsck syslog messages. On the second reboot, I see them all. Oddly, on the reboot I see the first one done in 12 minutes from the boot, yet the prior boot went over an hour before it locked up. I did run into some oddness though. I found it was doing the final fsck on a 1.1TB filesystem, so I wandered into '/mountpoint/.snap' and did an "ls -lt". It hung. When I did a CTRL-T, it told me it was in a spinlock. I ran top and found I had 1/2 a dozen processes also in spinlock. I was patient this time (And had other multiple VTYs logged in) so I waited it out. All of a sudden all the spinlocks stopped, the processes and ls completed, but it still was in pass 5 at 95%. It sat there for a while before finally sending the output to syslog and things are doing fair. I'm letting the system have it easy for a few days before I put a load back onto it (4 SETI). The 2nd part to recompile kernel/world... I don't worry too much doing that. Its the "install" part that gives me the willies. I've done that before on a system that was "acting up" and on reboot it just "acted dead". I remember I had to hand copy some libraries over after remaking AGAIN and things started to pick up. But scary as heck. The system finally died totally about a month later. Thanks, Tuc > > I suggest you reboot in single user mode and fsck -fy the mount points you > use. > If the problem persists - you might recompile the kernel and world. > > Regards, > Ivailo Tanusheff > > > > > > "Tuc at T-B-O-H.NET" > Sent by: owner-freebsd-questions@freebsd.org > 24.09.2008 10:56 > > To > freebsd-questions@freebsd.org > cc > > Subject > Machine locking up > > > > > > > Hi, > > We had a power failure at the datacenter we colocate at, > and all our > servers went down. > > One is acting up ever since. It rebooted but wasn't > accessible. I > tried to log in via our KVM and got the login/pass, but when it did the > /etc/motd and rest it locked up. CTRL-C and CTRL-\ didn't do anything. > The remote KVM could C-A-D and the machine rebooted. > > Once it rebooted it seemed ok, but then locked up again > while in use. > The odd thing was I remembered to try CTRL-T, and got : > > load: 0.00 cmd: login 1188 [sysctl lock] 0.00u 0.00s 0% 176k > > on the session I was trying to log in on, and on the > session I was > doing a tail, I saw : > > load: 0.00 cmd: tail 2013 [proctree] 0.00u 0.00s 0% 0k > > I could tab between VTYs, but logins wouldn't accept > input, and > I couldn't C-A-D this time around. I could telnet to a special port on it > for monitoring and get a reply, but SSH/sendmail didn't reply. > > Its a FreeBSD 5.5 (I can't upgrade it, sorry).... > > Any clues what to look for? > > Thanks, Tuc