From owner-freebsd-bugs@freebsd.org Thu Feb 14 17:42:41 2019 Return-Path: Delivered-To: freebsd-bugs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8DCAF14DBA0E for ; Thu, 14 Feb 2019 17:42:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 22E2983ACC for ; Thu, 14 Feb 2019 17:42:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id D612914DBA0D; Thu, 14 Feb 2019 17:42:40 +0000 (UTC) Delivered-To: bugs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B0CA914DBA0B for ; Thu, 14 Feb 2019 17:42:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4ADD283AC8 for ; Thu, 14 Feb 2019 17:42:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 713BEF60 for ; Thu, 14 Feb 2019 17:42:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x1EHgdMG045198 for ; Thu, 14 Feb 2019 17:42:39 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x1EHgda9045195 for bugs@FreeBSD.org; Thu, 14 Feb 2019 17:42:39 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: bugs@FreeBSD.org Subject: [Bug 235748] Using swap with free memory available Date: Thu, 14 Feb 2019 17:42:39 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: info@murrawhip.net X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 14 Feb 2019 17:42:41 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D235748 Bug ID: 235748 Summary: Using swap with free memory available Product: Base System Version: 11.2-RELEASE Hardware: amd64 OS: Any Status: New Severity: Affects Only Me Priority: --- Component: kern Assignee: bugs@FreeBSD.org Reporter: info@murrawhip.net Since updating to FreeBSD 11.2 from 11.1 I've been experiencing swap usage growing consistently over several weeks until there's none left, despite ha= ving free ram available. I detailed the issue on one of the smaller servers here: https://serverfault.com/questions/953819/freebsd-swap-usage-with-mysql I have a larger server exhibiting the same issue but it's at the point where it's logging the following 20-40 times in a second, every couple minutes: Feb 14 09:31:48 rad-myecr kernel: swap_pager_getswapspace(6): failed MySQL is the process using the memory, and its data directory is on a zvol = with vfs.zfs.arc_max=3D"256M" root@rad-myecr:/var/log # vmstat procs memory page disks faults cpu r b w avm fre flt re pi po fr sr da0 da1 in sy cs us s= y id 2 0 1 2.1T 434M 850 886 10 5 569 1103 0 0 827 759 320 2 = 1 97 root@rad-myecr:/var/log # zpool list NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH=20 ALTROOT data 1.12T 345G 799G - - 70% 30% 1.00x ONLINE - last pid: 75850; load averages: 1.80, 1.71, 1.54=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20 up 42+15:02:10 09:38:24 29 processes: 1 running, 28 sleeping CPU: 2.6% user, 0.0% nice, 1.5% system, 0.0% interrupt, 96.0% idle Mem: 17G Active, 9096M Inact, 2219M Laundry, 3295M Wired, 1551M Buf, 347M F= ree ARC: 252M Total, 110M MFU, 31M MRU, 1380K Anon, 4992K Header, 104M Other 30M Compressed, 198M Uncompressed, 6.54:1 Ratio Swap: 20G Total, 16G Used, 3638M Free, 82% Inuse, 20K In last pid: 75910; load averages: 1.85, 1.76, 1.58=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20 up 42+15:03:57 09:40:11 29 processes: 1 running, 28 sleeping CPU: 6.0% user, 0.0% nice, 1.1% system, 0.1% interrupt, 92.8% idle Mem: 17G Active, 8662M Inact, 2218M Laundry, 3294M Wired, 1551M Buf, 772M F= ree ARC: 253M Total, 110M MFU, 37M MRU, 1008K Anon, 4984K Header, 100M Other 34M Compressed, 202M Uncompressed, 5.87:1 Ratio Swap: 20G Total, 16G Used, 3642M Free, 82% Inuse, 152K In PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMA= ND 10914 mysql 43 22 0 63717M 27468M select 4 487.4H 148.46% mysqld 75880 root 1 20 0 7920K 3628K CPU16 16 0:00 0.08% top 125 root 2 20 0 32472K 4520K select 4 46:58 0.07% vmtoo= lsd 452 root 1 20 0 9184K 696K select 12 4:41 0.02% devd 36456 root 1 28 0 534M 408M nanslp 3 5:29 0.02% php 75614 dfairley 1 20 0 13164K 8084K select 2 0:00 0.02% sshd 33400 root 1 23 0 255M 37376K select 9 13:15 0.02% snmpd 619 root 1 20 0 6416K 2008K select 7 3:04 0.00% syslo= gd 709 root 1 20 0 12456K 12552K select 15 3:51 0.00% ntpd 1273 root 1 20 0 10456K 5092K select 19 1:02 0.00% sendm= ail 1280 root 1 20 0 6468K 768K nanslp 0 0:14 0.00% cron 401 root 1 42 0 6548K 1912K select 7 0:02 0.00% dhcli= ent 1276 smmsp 1 20 0 10456K 876K pause 17 0:01 0.00% sendm= ail 447 _dhcp 1 20 0 6548K 2004K select 21 0:01 0.00% dhcli= ent 1270 root 1 20 0 12852K 5264K select 13 0:00 0.00% sshd 75619 root 1 20 0 7416K 4336K pause 20 0:00 0.00% csh 10428 mysql 1 52 0 7064K 0K wait 18 0:00 0.00% 75615 dfairley 1 20 0 7416K 4360K pause 6 0:00 0.00% csh 75612 root 1 23 0 13164K 7964K select 22 0:00 0.00% sshd 75617 root 1 22 0 7612K 3832K select 9 0:00 0.00% sudo 75618 root 1 24 0 6936K 3104K wait 1 0:00 0.00% su 1335 root 1 52 0 6408K 1796K ttyin 2 0:00 0.00% getty 1333 root 1 52 0 6408K 1796K ttyin 5 0:00 0.00% getty 1334 root 1 52 0 6408K 1796K ttyin 0 0:00 0.00% getty 1336 root 1 52 0 6408K 1796K ttyin 12 0:00 0.00% getty 1332 root 1 52 0 6408K 1796K ttyin 11 0:00 0.00% getty 1331 root 1 52 0 6408K 1796K ttyin 3 0:00 0.00% getty 1329 root 1 52 0 6408K 1796K ttyin 7 0:00 0.00% getty 1330 root 1 52 0 6408K 1796K ttyin 21 0:00 0.00% getty --=20 You are receiving this mail because: You are the assignee for the bug.=