Date: Sun, 05 Apr 2015 09:31:55 -0500 From: Karl Denninger <karl@denninger.net> To: freebsd-fs@freebsd.org Subject: Re: Swap usage with ZFS Message-ID: <5521475B.4010703@denninger.net> In-Reply-To: <880944c05bb859ca0fc97b2d8606fe29@thebighonker.lerctr.org> References: <880944c05bb859ca0fc97b2d8606fe29@thebighonker.lerctr.org>
next in thread | previous in thread | raw e-mail | index | archive | help
[-- Attachment #1 --] On 4/5/2015 09:23, Larry Rosenman wrote: > I have a -HEAD (11-CURRENT) box that has 64G of memory, but very > little load. > > The ZFS ARC grows to eat most of it, but I see around 200M in use in > SWAP. This was under control > in 10.x. > > I'm wondering what information y'all need to help diagnose why. > > borg.lerctr.org /home/ler $ uname -aKU > FreeBSD borg.lerctr.org 11.0-CURRENT FreeBSD 11.0-CURRENT #32 r281050: > Fri Apr 3 16:41:13 CDT 2015 > root@borg.lerctr.org:/usr/obj/usr/src/sys/VT-LER amd64 1100067 1100067 > borg.lerctr.org /home/ler $ > > > borg.lerctr.org /home/ler $ top > last pid: 26313; load averages: 6.92, 6.79, 6.83 up 1+16:26:05 > 09:23:13 > 80 processes: 4 running, 76 sleeping > CPU: 0.0% user, 46.9% nice, 0.3% system, 0.0% interrupt, 52.8% idle > Mem: 281M Active, 539M Inact, 59G Wired, 18M Cache, 8128K Buf, 1241M Free > ARC: 55G Total, 42G MFU, 9766M MRU, 1044K Anon, 568M Header, 3437M Other > Swap: 128G Total, 205M Used, 128G Free > > This is consistent with how the VM system is expected to behave absent the patches I developed for 10-STABLE (and continue to maintain for same.) In short what is going on is that ZFS (absent those patches) will allow ARC to grow until the pager not only wakes up and starts scavenging cache pages but actively starts evicting working set to the page file. It will then pare down the ARC but at that point you have paged out working set process memory. I argue this is flat-out wrong as discarding ARC instead *possibly* implicates one disk I/O (to retrieve said data) if the cached data is later needed but a page-out of RSS *always* implicates one disk I/O (to page out said data) and *possibly* implicates two disk operations (if the RSS pages are later executed.) Therefore it is /*never*/ the correct decision to favor paging out resident processes rather than discarding disk cache. https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=187594 I do not know if this will apply against -HEAD. -- Karl Denninger karl@denninger.net <mailto:karl@denninger.net> /The Market Ticker/ [-- Attachment #2 --] 0 *H 01 0 + 0 *H Y0U0=0 *H 01 0 UUS10UFlorida10U Niceville10U Cuda Systems LLC1 0UCuda Systems LLC CA1"0 *H Cuda Systems LLC CA0 150325131020Z 200323131020Z0S1 0 UUS10UFlorida10U Cuda Systems LLC10UKarl Denninger0"0 *H 0 q7 ۇT:teߋ{h ~]!+Z&r˳ނo8Ie?VHMu<{y;l0_^VЌ>[5 $ibIRv \M@Y ɐ6 ܷO&p$-C.o C^$ӂFϤid $Rgϵ|Y&{ȌKz Ę$ 1b z踲?Dr_F' PS~h{!eFO'ґ,G m ] nM|4y e 1*6v@(x1T)ދ$\Q C,P=f fėT |JF#:emMܕ( C=~A{M\a]5<3O*h ML =xI}YXYbDsߌ=l**ج; "g\# 00 U 0 0 `HB0 U 0, `HB OpenSSL Generated Certificate0 U #/6%Ѹ'*ZqE#p0 U #0$q}ݽʒm50 U 0karl@denninger.net08 `HB+)https://cudasystems.net:11443/revoked.crl0 *H p 7-2^,"nl5N>H*p&v' suS[d\}E!2"4YLvGM( hlNon.U#Q#enEȶ?GQhM=Tl_RiF f@~=ﾨoB0!Om`x҂:G26XF}?>խ !15` 0Zŝ-ȩo{J,lLY~nc.oA]y+f,K諩 [mg]7tB% ^f,-ɽ.,?BCP#Ta;)mҸ=dY/_#%7559C6М0.+xP&+qLݚF+} 7P\ S|ƪpF%OU[-^Mю* \3^P"swIlYmP9{,rG'abݹMA˛ Ϸ8_XI®!jF&j')E1c%10001 0 UUS10UFlorida10U Niceville10U Cuda Systems LLC1 0UCuda Systems LLC CA1"0 *H Cuda Systems LLC CA0 + !0 *H 1 *H 0 *H 1 150405143155Z0# *H 1ӯRJ9+0l *H 1_0]0 `He*0 `He0 *H 0*H 0 *H @0+0 *H (0 +71001 0 UUS10UFlorida10U Niceville10U Cuda Systems LLC1 0UCuda Systems LLC CA1"0 *H Cuda Systems LLC CA0 *H 101 0 UUS10UFlorida10U Niceville10U Cuda Systems LLC1 0UCuda Systems LLC CA1"0 *H Cuda Systems LLC CA0 *H r ,/I:Bbj& Iѓ.:reCWg(^GV%$wtQp|(3cԽ ':/B115BtGfgEc&vt9u|ug@tPgFq+"/\f㦼 # sJ Nu6r)IoXM^m9W<-r zhV{Rgn_ IiPt8LyVk\0 _Fϣ #`g a2AW E m !9=? RFc'7ӛ >rV,h?"t/d7\%Dj1Un癔z .ÜKhRVBe6C~)Ym> E`!%gG }L L'5tkQbȕK?\ $ hn>sEwH,
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?5521475B.4010703>