From owner-freebsd-hackers@FreeBSD.ORG Wed Dec 10 15:05:10 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A161F106564A; Wed, 10 Dec 2008 15:05:10 +0000 (UTC) (envelope-from prvs=12308e1c5a=killing@multiplay.co.uk) Received: from mail1.multiplay.co.uk (core6.multiplay.co.uk [85.236.96.23]) by mx1.freebsd.org (Postfix) with ESMTP id EDEB18FC13; Wed, 10 Dec 2008 15:05:09 +0000 (UTC) (envelope-from prvs=12308e1c5a=killing@multiplay.co.uk) DKIM-Signature: v=1; a=rsa-sha256; c=simple; d=multiplay.co.uk; s=Multiplay; t=1228920552; x=1229525352; q=dns/txt; h=Received: Message-ID:From:To:Subject:Date:MIME-Version:Content-Type: Content-Transfer-Encoding; bh=rGttyBfSniE0d99ULXmMihcsuSpGy/XY6A O+1IR2LXw=; b=n/xebX+AKYvikTYaBWzq00hRpdZkSLHr/FfVtZTpTk6M347DR3 CUKC29SpHCLMCylL/m6l8pK6NzYjuSMQqoNRJCYv1XyBje9pD5gPypyzcnaTM3HA FloNj5F9W3HBeY5bmY6YNjDS8k4jNMfC/1XDI+i9KB1x07Wy7rpyp4Hps= X-Spam-Checker-Version: SpamAssassin 3.1.8 (2007-02-13) on mail1.multiplay.co.uk X-Spam-Level: X-Spam-Status: No, score=-14.7 required=6.0 tests=BAYES_00, FORGED_MUA_OUTLOOK, USER_IN_WHITELIST,USER_IN_WHITELIST_TO autolearn=ham version=3.1.8 Received: from r2d2 by mail1.multiplay.co.uk (MDaemon PRO v9.6.6) with ESMTP id md50006696587.msg; Wed, 10 Dec 2008 14:49:11 +0000 X-Authenticated-Sender: Killing@multiplay.co.uk X-MDRemoteIP: 213.123.247.160 X-Return-Path: prvs=12308e1c5a=killing@multiplay.co.uk X-Envelope-From: killing@multiplay.co.uk Message-ID: <38D2AA3D46354E8EA3EE2A1056A1BE4A@multiplay.co.uk> From: "Steven Hartland" To: , Date: Wed, 10 Dec 2008 14:49:11 -0000 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="iso-8859-1"; reply-type=original Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.5512 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.5579 X-Spam-Processed: mail1.multiplay.co.uk, Wed, 10 Dec 2008 14:49:11 +0000 X-MDAV-Processed: mail1.multiplay.co.uk, Wed, 10 Dec 2008 14:49:12 +0000 Cc: Subject: 7.0 unusual performance issue - vmdaemon hang? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Dec 2008 15:05:10 -0000 Just had one of hour webservers flag as down here and on investigation the machine seems to be struggling due to a hung vmdaemon process. top is reporting vmdaemon as using a constant 55.57% CPU yet CPU time is not increasing:- last pid: 36492; load averages: 0.04, 0.05, .11 up 89+19:53:21 14:36:08 223 processes: 9 running, 201 sleeping, 13 waiting CPU states: 0.0% user, 0.0% nice, 0.0% system, 0.0% interrupt, 100% idle Mem: 644M Active, 2780M Inact, 480M Wired, 249M Cache, 214M Buf, 3759M Free Swap: 4096M Total, 537M Used, 3559M Free, 13% Inuse PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 11 root 1 171 ki31 0K 16K CPU7 7 2116.4 100.00% idle: cpu7 12 root 1 171 ki31 0K 16K CPU6 6 2059.5 100.00% idle: cpu6 13 root 1 171 ki31 0K 16K CPU5 5 2029.3 100.00% idle: cpu5 14 root 1 171 ki31 0K 16K CPU4 4 1977.8 100.00% idle: cpu4 15 root 1 171 ki31 0K 16K CPU3 3 1912.0 100.00% idle: cpu3 16 root 1 171 ki31 0K 16K CPU2 2 1835.2 100.00% idle: cpu2 17 root 1 171 ki31 0K 16K CPU1 1 1763.1 100.00% idle: cpu1 18 root 1 171 ki31 0K 16K RUN 0 1727.6 100.00% idle: cpu0 37 root 1 20 - 0K 16K psleep 5 0:56 55.57% vmdaemon 60198 www 1 4 0 98M 13516K sbwait 2 35:21 1.46% httpd 60264 www 1 4 0 133M 9248K sbwait 0 21:21 0.39% httpd 30 root 1 -68 - 0K 16K - 7 18.3H 0.00% em1 taskq 29 root 1 -68 - 0K 16K - 6 330:21 0.00% em0 taskq 41 root 1 20 - 0K 16K syncer 1 212:42 0.00% syncer 21 root 1 -44 - 0K 16K WAIT 0 201:02 0.00% swi1: net 19 root 1 -32 - 0K 16K WAIT 0 120:15 0.00% swi4: clock 22 root 1 44 - 0K 16K - 5 73:00 0.00% yarrow I've tried to ktrace the process and it produced nothing, also tried gdb and it failed to attach. Is there anything else I can try before we reboot the machine to help determine what the problem is? Regards Steve ================================================ This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337 or return the E.mail to postmaster@multiplay.co.uk.