From owner-freebsd-current@freebsd.org Wed Apr 4 01:53:51 2018 Return-Path: Delivered-To: freebsd-current@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5B8D7F852BF for ; Wed, 4 Apr 2018 01:53:51 +0000 (UTC) (envelope-from cy.schubert@cschubert.com) Received: from smtp-out-so.shaw.ca (smtp-out-so.shaw.ca [64.59.136.137]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "Client", Issuer "CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id AC719811EE; Wed, 4 Apr 2018 01:53:50 +0000 (UTC) (envelope-from cy.schubert@cschubert.com) Received: from spqr.komquats.com ([70.67.125.17]) by shaw.ca with ESMTPA id 3XcQfPRW4Lkoz3XcSfBCqi; Tue, 03 Apr 2018 19:53:49 -0600 X-Authority-Analysis: v=2.3 cv=OeS28CbY c=1 sm=1 tr=0 a=VFtTW3WuZNDh6VkGe7fA3g==:117 a=VFtTW3WuZNDh6VkGe7fA3g==:17 a=Kd1tUaAdevIA:10 a=YxBL1-UpAAAA:8 a=6I5d2MoRAAAA:8 a=6VqBrpBaAAAA:8 a=8fqvCxzDAAAA:8 a=lzb0MAms_pIzW377eeoA:9 a=RXG5mFhLMQbsAcR_:21 a=z37ykU1UKxJ3DLQO:21 a=QEXdDO2ut3YA:10 a=kcW0WbjXQlUA:10 a=45Xs7ifGvxIA:10 a=9KCo1u1gBHjnrNLiqAMA:9 a=dEruVAzBn2s-0MCJ:21 a=2uO3SawNETqDo4BZ:21 a=rB7BF9cxiKwZdF4_:21 a=_W_S_7VecoQA:10 a=Ia-lj3WSrqcvXOmTRaiG:22 a=IjZwj45LgO3ly-622nXo:22 a=l6wOqGboJC1rSQv2Z1Bd:22 a=xrUD0wEA3vlMLTxm4nS9:22 Received: from [25.85.100.44] (unknown [24.244.29.245]) by spqr.komquats.com (Postfix) with ESMTPSA id AFFFC1121; Tue, 3 Apr 2018 18:53:45 -0700 (PDT) MIME-Version: 1.0 From: Cy Schubert Subject: RE: Strange ARC/Swap/CPU on yesterday's -CURRENT Date: Tue, 3 Apr 2018 19:53:46 -0600 To: Larry Rosenman , Bryan Drewery , Peter Jeremy , Jeff Roberson CC: FreeBSD current , Andriy Gapon Message-Id: <20180404015345.AFFFC1121@spqr.komquats.com> X-CMAE-Envelope: MS4wfMp1rYncW65iSAeFbdpWRrkTH1OffBP7uvCB98ExIoyui3TwA7tuew4rBiVkz+OnMCmnYSbA1oy9S8gRvq5KdVuRr0xjFxrhZ74EEBlZs64TXujGRS8f MzEs+8lZnq3M+C0sEmpcQ+1qHXUjISCNsftio3LGmeh+l6L8ROSBryeDG8Ykc3+HmMu0rttmVuOd7aXlY5EPH4Q5VbBySpZ599sqsDGlnMyNERaYtX0SUJG8 SQkvW/d2cgkojSn0C8C5BYIN/5LkAPiFQTPxf3O8xVyyv/z+TFaxpqkPzrtikx1poa+mbDWGTPljXtY8cb+G4q95Lz1HvS3YGwdvUr8CdEM= Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Apr 2018 01:53:51 -0000 Try arbitrarily reducing arc_max through sysctl. ARC is immediately reduced= and free memory increased however wired pages remains the same. --- Sent using a tiny phone keyboard. Apologies for any typos and autocorrect. Also, this old phone only supports top post. Apologies. Cy Schubert or The need of the many outweighs the greed of the few. --- -----Original Message----- From: Larry Rosenman Sent: 03/04/2018 19:27 To: Cy Schubert; Bryan Drewery; Peter Jeremy; Jeff Roberson Cc: FreeBSD current; Andriy Gapon Subject: Re: Strange ARC/Swap/CPU on yesterday's -CURRENT When my full backups run (1st Sunday -> Monday of the month) the box become= s unusable after 5-10 hours of that backup with LOTS of SWAP usage And ARC using 100+G.=20 Is anyone looking into this? --=20 Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 E-Mail: ler@lerctr.org US Mail: 5708 Sabbia Drive, Round Rock, TX 78665-2106 =EF=BB=BFOn 4/3/18, 8:24 PM, "Cy Schubert" wrote: +1 =20 However under certain circumstances it will release some memory. To rep= roduce, when bsdtar unpacks some tarballs (when building certain ports) tar= will use 12 GB or more forcing ARC to release memory. =20 BTW, I haven't stopped to grok whether the bsdtar issue is local to me = or another problem yet. =20 --- Sent using a tiny phone keyboard. Apologies for any typos and autocorrect. Also, this old phone only supports top post. Apologies. =20 Cy Schubert or The need of the many outweighs the greed of the few. --- =20 -----Original Message----- From: Bryan Drewery Sent: 23/03/2018 17:23 To: Peter Jeremy; Jeff Roberson Cc: FreeBSD current; Andriy Gapon Subject: Re: Strange ARC/Swap/CPU on yesterday's -CURRENT =20 On 3/20/2018 12:07 AM, Peter Jeremy wrote: >=20 > On 2018-Mar-11 10:43:58 -1000, Jeff Roberson wrote: >> Also, if you could try going back to r328953 or r326346 and let me k= now if=20 >> the problem exists in either. That would be very helpful. If anyon= e is=20 >> willing to debug this with me contact me directly and I will send so= me=20 >> test patches or debugging info after you have done the above steps. >=20 > I ran into this on 11-stable and tracked it to r326619 (MFC of r32585= 1). > I initially got around the problem by reverting that commit but eithe= r > it or something very similar is still present in 11-stable r331053. >=20 > I've seen it in my main server (32GB RAM) but haven't managed to repr= oduce > it in smaller VBox guests - one difficulty I faced was artificially f= illing > ARC. >=20 =20 Looking at the ARC change you referred to from r325851 https://reviews.freebsd.org/D12163, I am convinced that ARC backpressur= e is completely broken. On my 78GB RAM system with ARC limited to 40GB an= d doing a poudriere build of all LLVM and GCC packages at once in tmpfs I can get swap up near 50GB and yet the ARC remains at 40GB through it all. It's always been slow to give up memory for package builds but it really seems broken right now. =20 --=20 Regards, Bryan Drewery =20 _______________________________________________ freebsd-current@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.o= rg" =20