From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 10 18:36:53 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4D1311065676 for ; Thu, 10 Sep 2009 18:36:53 +0000 (UTC) (envelope-from linda.messerschmidt@gmail.com) Received: from mail-qy0-f195.google.com (mail-qy0-f195.google.com [209.85.221.195]) by mx1.freebsd.org (Postfix) with ESMTP id 02A4B8FC13 for ; Thu, 10 Sep 2009 18:36:52 +0000 (UTC) Received: by qyk33 with SMTP id 33so4139qyk.14 for ; Thu, 10 Sep 2009 11:36:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=0y6GXBQfPRSM1p1wkRQwAVsAH8YmHNuWOwsX3BEG/WI=; b=ePreWNDHWFINBiLRHPtluE9R/oqDMRYHYqkUOLhUvbbaLNsyrfqVZh+1p5icGNiHsr 5xk0XrusKD1r3Ap5zDvna4ex/mYa/7CyvKJRNQ1bDtEPlSbfGhYXqQ44nTYP2B5ie7Ot ftQzIb3r5GskmK12tjibjCGJ09+ULEJ3cHV1A= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=iI0nOwUwBydW70PEh046n3uUiE/5zp9JJSEfBAjVcZig2CGGkf4gftp7ylEiGMO0W5 1YfWwRfQYGDyYLzPc0kFj/mKdBJiwkRVSkFBIpKTct9U8VzSAy/giYespRTEBI/wC6Q9 QQyVzd3qs8DdUtDZ+T42WH7HywMW/xE/4F0qw= MIME-Version: 1.0 Received: by 10.229.39.69 with SMTP id f5mr1039615qce.107.1252607363953; Thu, 10 Sep 2009 11:29:23 -0700 (PDT) In-Reply-To: References: <237c27100908261203g7e771400o2d9603220d1f1e0b@mail.gmail.com> <200908261642.59419.jhb@freebsd.org> <237c27100908271237y66219ef4o4b1b8a6e13ab2f6c@mail.gmail.com> <200908271729.55213.jhb@freebsd.org> <237c27100909100946q3d186af3h66757e0efff307a5@mail.gmail.com> Date: Thu, 10 Sep 2009 14:29:23 -0400 Message-ID: <237c27100909101129y28771061o86db3c6a50a640eb@mail.gmail.com> From: Linda Messerschmidt To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Subject: Re: Intermittent system hangs on 7.2-RELEASE-p1 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Sep 2009 18:36:53 -0000 On Thu, Sep 10, 2009 at 12:57 PM, Ryan Stone wrote: > You should be able to run schedgraph.py on a windows machine with python > installed.=A0 It works just fine for me on XP. Don't have any of those either, but I *did* get it working on a Mac right out of the box. Should have thought of that sooner. :) The output looks pretty straightforward, but there are a couple of things I find odd. First, there's a point right around what I estimate to be the problem time where schedgraph.py indicates gmond (the Ganglia monitor) was running uninterrupted for a period of exactly 1 second. However, it also indicates that both CPU's idle tasks were *also* running almost continuously during that time (subject to clock/net interrupts), and that the run queue on both CPU's was zero for most of that second while gmond was allegedly running. Second, the interval I graphed was about nine seconds. During that time, the PHP command line script made a whole lot of requests: it usleeps 50ms between requests, and non-broken requests average about 1.4ms. So even with the stalled request chopping 2 seconds off the end, there should be somewhere in the neighborhood of 130 requests during the graphed period. But that php process doesn't appear in the schedgraph output at all. So that doesn't make a whole lot of sense to me. I'll try to get another trace and see if that happens the same way again.