From owner-freebsd-virtualization@freebsd.org Fri May 19 14:53:46 2017 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C71E6D7318C for ; Fri, 19 May 2017 14:53:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B658F377 for ; Fri, 19 May 2017 14:53:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v4JErkKC013368 for ; Fri, 19 May 2017 14:53:46 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 219355] Heavy disk activity in bhyve deadlocks host Date: Fri, 19 May 2017 14:53:46 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: freebsd-bugs@joe.mulloy.me X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 19 May 2017 14:53:46 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D219355 --- Comment #4 from Joseph Mulloy --- I just tried again with the ARC limited to 12 GB (out of 32 GB) and it still crashes. This time I got a ton of "swap_pager: indefinite wait buffer" mess= ages on the console. From the output of top, which I have pasted below I can see that the ARC was on 5 GB but the wired memory is up to 30GB. The guest has = the -S flag (wire guest memory) on the bhyve command since that is the default = in chyves. I have tried without it before since I suspected a memory problem. I will try again without it. 471 processes: 1 running, 447 sleeping, 23 waiting CPU: 43.8% user, 0.0% nice, 29.5% system, 1.4% interrupt, 25.4% idle Mem: 1106M Active, 317M Inact, 30G Wired, 55M Cache, 18M Free ARC: 5135M Total, 2282K MFU, 40M MRU, 2680M Anon, 1510M Header, 903M Other Swap: 16G Total, 1221M Used, 15G Free, 7% Inuse, 12K In, 141M Out PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMA= ND 3091 88 25 20 0 460M 21832K select 0 0:19 85.90% mysqld 3593 88 143 20 0 604M 195M select 3 2:39 83.29% mysqld 39084 root 21 20 0 2127M 1969M kqread 2 3:12 4.43% bhyve 4256 zabbix 1 20 0 105M 4584K pfault 3 0:16 0.45% zabbix_server 4264 zabbix 1 20 0 105M 3272K sbwait 2 0:16 0.44% zabbix_server 4278 zabbix 1 20 0 105M 8292K nanslp 0 0:16 0.38% zabbix_server 4294 zabbix 1 20 0 105M 4732K nanslp 0 0:16 0.38% zabbix_server 4295 zabbix 1 20 0 105M 8396K sbwait 2 0:15 0.35% zabbix_server 4233 zabbix 1 20 0 102M 6948K nanslp 0 0:03 0.34% zabbix_server 1191 root 1 20 0 26264K 3716K CPU3 3 0:43 0.11% top 1158 jdmulloy2 1 20 0 51156K 5224K select 3 0:09 0.09% mosh-server 1170 root 1 20 0 22420K 3340K select 0 0:22 0.08% tmux 4266 zabbix 1 20 0 105M 4608K sbwait 2 0:15 0.03% zabbix_server 4240 zabbix 1 20 0 105M 2256K pfault 2 0:16 0.02% zabbix_server 2090 root 14 52 0 45048K 9464K uwait 1 0:06 0.02% fileb= eat 4544 root 11 52 0 43672K 9840K uwait 1 0:06 0.02% fileb= eat 3786 root 13 52 0 44984K 10312K uwait 3 0:07 0.02% fileb= eat 4257 zabbix 1 20 0 105M 8360K sbwait 1 0:16 0.01% zabbix_server 1889 root 14 52 0 44056K 10308K uwait 1 0:06 0.01% fileb= eat 1487 root 10 52 0 44600K 9372K uwait 3 0:06 0.01% fileb= eat 4247 zabbix 1 20 0 105M 4868K sbwait 3 0:16 0.01% zabbix_server 2367 root 12 20 0 42676K 8788K tx->tx 2 0:06 0.01% fileb= eat 4329 zabbix 1 20 0 105M 1952K nanslp 2 0:16 0.01% zabbix_server 772 zabbix 1 20 0 31004K 2300K nanslp 0 0:02 0.01% zabbix_agentd 1662 zabbix 1 20 0 31004K 1972K nanslp 2 0:02 0.01% zabbix_agentd 3373 zabbix 1 20 0 31004K 2412K nanslp 0 0:02 0.01% zabbix_agentd 2609 zabbix 1 20 0 31004K 2612K tx->tx 1 0:01 0.01% zabbix_agentd 3405 root 15 52 0 46232K 10464K uwait 1 0:06 0.01% fileb= eat 808 root 1 20 0 10436K 1260K select 0 0:03 0.01% powerd 2605 zabbix 1 20 0 31004K 2520K nanslp 3 0:02 0.01% zabbix_agentd 1461 zabbix 1 20 0 31004K 1984K nanslp 0 0:02 0.01% zabbix_agentd 2635 root 15 52 0 45240K 10552K uwait 1 0:07 0.01% fileb= eat 3984 root 12 20 0 42808K 10000K uwait 0 0:06 0.01% fileb= eat --=20 You are receiving this mail because: You are on the CC list for the bug.=