From owner-freebsd-current@freebsd.org Wed Apr 4 02:46:24 2018 Return-Path: Delivered-To: freebsd-current@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5626AF883D9 for ; Wed, 4 Apr 2018 02:46:24 +0000 (UTC) (envelope-from ler@lerctr.org) Received: from thebighonker.lerctr.org (thebighonker.lerctr.org [IPv6:2001:470:1f0f:3ad:bb:dcff:fe50:d900]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "lerctr.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id EC09D83BE8; Wed, 4 Apr 2018 02:46:23 +0000 (UTC) (envelope-from ler@lerctr.org) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lerctr.org; s=lerami; h=Content-transfer-encoding:Content-type:Mime-version:In-Reply-To: References:Message-ID:CC:To:From:Subject:Date:Sender:Reply-To:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=p79vU2gtp9OBBzPMvm2hxe0dY6JgmPGkLzy4+twZ6a4=; b=pygZBG0+IqR2hvIWXjw8p1BNuu Rdzj0EYHFFvLZAG2m10amfkW7d7173wg6ODPC/Yz0CeI9aO9U1M/DV1fekoOSks58Yp80tAOUAyiE MwKHVR+VyqhOguTmuZqUqSx5Omnfb9IjB/awI6ZWf+WbjC68HS6cbRRS4m+AJEliJXQw=; Received: from [2600:1700:210:b18f:3427:71c7:7f27:d86c] (port=49209 helo=[192.168.200.50]) by thebighonker.lerctr.org with esmtpsa (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256) (Exim 4.90_1 (FreeBSD)) (envelope-from ) id 1f3YRK-00025p-Ez; Tue, 03 Apr 2018 21:46:22 -0500 User-Agent: Microsoft-MacOutlook/10.d.0.180401 Date: Tue, 03 Apr 2018 21:46:21 -0500 Subject: Re: Strange ARC/Swap/CPU on yesterday's -CURRENT From: Larry Rosenman To: Cy Schubert , Bryan Drewery , Peter Jeremy , Jeff Roberson CC: FreeBSD current , Andriy Gapon Message-ID: Thread-Topic: Strange ARC/Swap/CPU on yesterday's -CURRENT References: <20180404015345.AFFFC1121@spqr.komquats.com> In-Reply-To: <20180404015345.AFFFC1121@spqr.komquats.com> Mime-version: 1.0 Content-type: text/plain; charset="UTF-8" Content-transfer-encoding: quoted-printable X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Apr 2018 02:46:24 -0000 Thanks for that hint. I thought that arc_max was a tunable, but now knowin= g it's sysctl, that helps a lot. --=20 Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 E-Mail: ler@lerctr.org US Mail: 5708 Sabbia Drive, Round Rock, TX 78665-2106 =EF=BB=BFOn 4/3/18, 8:54 PM, "Cy Schubert" wrote: Try arbitrarily reducing arc_max through sysctl. ARC is immediately red= uced and free memory increased however wired pages remains the same. =20 --- Sent using a tiny phone keyboard. Apologies for any typos and autocorrect. Also, this old phone only supports top post. Apologies. =20 Cy Schubert or The need of the many outweighs the greed of the few. --- =20 -----Original Message----- From: Larry Rosenman Sent: 03/04/2018 19:27 To: Cy Schubert; Bryan Drewery; Peter Jeremy; Jeff Roberson Cc: FreeBSD current; Andriy Gapon Subject: Re: Strange ARC/Swap/CPU on yesterday's -CURRENT =20 When my full backups run (1st Sunday -> Monday of the month) the box be= comes unusable after 5-10 hours of that backup with LOTS of SWAP usage And ARC using 100+G.=20 =20 Is anyone looking into this? =20 =20 =20 --=20 Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 E-Mail: ler@lerctr.org US Mail: 5708 Sabbia Drive, Round Rock, TX 78665-2106 =EF=BB=BFOn 4/3/18, 8:24 PM, "Cy Schubert" wrote: =20 +1 =20 However under certain circumstances it will release some memory. To= reproduce, when bsdtar unpacks some tarballs (when building certain ports) = tar will use 12 GB or more forcing ARC to release memory. =20 BTW, I haven't stopped to grok whether the bsdtar issue is local to= me or another problem yet. =20 --- Sent using a tiny phone keyboard. Apologies for any typos and autocorrect. Also, this old phone only supports top post. Apologies. =20 Cy Schubert or The need of the many outweighs the greed of the few. --- =20 -----Original Message----- From: Bryan Drewery Sent: 23/03/2018 17:23 To: Peter Jeremy; Jeff Roberson Cc: FreeBSD current; Andriy Gapon Subject: Re: Strange ARC/Swap/CPU on yesterday's -CURRENT =20 On 3/20/2018 12:07 AM, Peter Jeremy wrote: >=20 > On 2018-Mar-11 10:43:58 -1000, Jeff Roberson wrote: >> Also, if you could try going back to r328953 or r326346 and let = me know if=20 >> the problem exists in either. That would be very helpful. If a= nyone is=20 >> willing to debug this with me contact me directly and I will sen= d some=20 >> test patches or debugging info after you have done the above ste= ps. >=20 > I ran into this on 11-stable and tracked it to r326619 (MFC of r3= 25851). > I initially got around the problem by reverting that commit but e= ither > it or something very similar is still present in 11-stable r33105= 3. >=20 > I've seen it in my main server (32GB RAM) but haven't managed to = reproduce > it in smaller VBox guests - one difficulty I faced was artificial= ly filling > ARC. >=20 =20 Looking at the ARC change you referred to from r325851 https://reviews.freebsd.org/D12163, I am convinced that ARC backpre= ssure is completely broken. On my 78GB RAM system with ARC limited to 40G= B and doing a poudriere build of all LLVM and GCC packages at once in tmp= fs I can get swap up near 50GB and yet the ARC remains at 40GB through i= t all. It's always been slow to give up memory for package builds bu= t it really seems broken right now. =20 --=20 Regards, Bryan Drewery =20 _______________________________________________ freebsd-current@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to "freebsd-current-unsubscribe@freeb= sd.org" =20 =20 =20 _______________________________________________ freebsd-current@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.o= rg" =20