From owner-freebsd-geom@FreeBSD.ORG Fri Jan 12 22:48:50 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 30B0916A4AB for ; Fri, 12 Jan 2007 22:48:50 +0000 (UTC) (envelope-from cyberleo@cyberleo.net) Received: from pizzabox.cyberleo.net (alpha.cyberleo.net [198.145.45.10]) by mx1.freebsd.org (Postfix) with ESMTP id CA12E13C4B8 for ; Fri, 12 Jan 2007 22:48:49 +0000 (UTC) (envelope-from cyberleo@cyberleo.net) Received: (qmail 39689 invoked from network); 12 Jan 2007 22:48:48 -0000 Received: from adsl-69-212-1-127.dsl.chcgil.ameritech.net (HELO ?172.16.44.14?) (cyberleo@cyberleo.net@69.212.1.127) by alpha.cyberleo.net with ESMTPA; 12 Jan 2007 22:48:48 -0000 Message-ID: <45A81027.6000503@cyberleo.net> Date: Fri, 12 Jan 2007 16:48:07 -0600 From: CyberLeo Kitsana User-Agent: Thunderbird 1.5 (X11/20051201) MIME-Version: 1.0 To: "R. B. Riddick" References: <416255.11150.qm@web30304.mail.mud.yahoo.com> In-Reply-To: <416255.11150.qm@web30304.mail.mud.yahoo.com> Content-Type: text/plain; charset=iso-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: FreeBSD Geom Subject: Re: geom_raid5 livelock? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 12 Jan 2007 22:48:50 -0000 R. B. Riddick wrote: > --- CyberLeo Kitsana wrote: >> http://home.cyberleo.net/cyberleo/workspace/Zip/graid5-testing.png >> > Aha... > Looks like gmirror is quite busy, too, while idle at the same time... > This might mean, that we have a new GEOM problem... > >> As shown in top, one rsync and one find process are stuck in biord >> waiting for data from the filesystem, while the CPU is otherwise mostly >> quiescent. I can't find evidence anywhere of what could be using the >> raid5 and mirror providers so much, though. >> > Me, too... > >> The frozen processes are one locate database update (find) and one rsync >> process copying data from an old backup machine to the new one. The >> frozen processes do not respond to attempts to kill them until the >> filesystem begins responding. >> > Hmm... Can u try without gmirror? :-) > I mean: Just if it is not too complicated for u (I have no hard evidence, that > gmirror is the cause of something)... > >> Also, tuning the sysctl had no effect prior to, nor during, the >> livelock. Nothing new appeared in /var/log/messages while set to 1 or 2. >> > Hmm... > That might show, that ur /etc/syslog.conf does not log every message... :-) Can > u try the line "*.* /var/log/all" to /etc/syslog.conf (after editing that file, > touch the log file ("touch /var/log/all") and then reload the syslogd conf > ("/etc/rc.d/syslogd reload" or so))? http://home.cyberleo.net/cyberleo/workspace/Zip/graid5-testing2.png Disabled gmirror and booted from a single member of the array. The lower-right xterm is tailing all.log, enabled as you suggested in syslog, with kern.geom.raid5.debug = 2. It was logging to /var/log/messages, four lines every 10 seconds or so. I was just impatient. ^.^ -- Fuzzy love, -CyberLeo Technical Administrator CyberLeo.Net Webhosting http://www.CyberLeo.Net Furry Peace! - http://www.fur.com/peace/