From owner-freebsd-arm@freebsd.org Sun Aug 12 18:10:08 2018 Return-Path: Delivered-To: freebsd-arm@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 93A431078A09 for ; Sun, 12 Aug 2018 18:10:08 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic314-14.consmr.mail.bf2.yahoo.com (sonic314-14.consmr.mail.bf2.yahoo.com [74.6.132.124]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 2B68074106 for ; Sun, 12 Aug 2018 18:10:08 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: mA6aPOUVM1lZjEv1xx.s69v03ynkzBD29QRnlTz_XGlmpvv6ZoLB1uR3AOpx8ft ScINetOCThH8l91Or2YNWWiEckczKcoJuRpUBf7ehHdOoFPjkhDs0kx0EJXv7DHHpKEn7PVNelhK _KSZFYV5e2lBW3Eu2IftH0Io8Dl080kyvZbWdB6nre480cU8D1PXCdeQylzkj7eW9KvwlxjO4xaS sho0VYpFoH6Wpf1wCUpVGVOFb1lFpbDnIo4mrHF6UDcWLSmEPYEDqphOlvFhkmwy8WSespAcvgVb .GesGLXke2JAmbTGr2.6pn5ZENQeawmaSKM5lI0o3onJJkpwsXrcMUEy9WjWWE2Nyrrn5uJCBjHJ hNDvw8xWGG0IUKQdSbI5BBMpbeeqZzY_rmZhpHFEXkyckpPazJSjgfDqaw3GrRkFd_du8I6rLeIa itRMa8WDJM3SwGX.BxoHh7IFlfkeYERlTxhJh9G47Qs821La0lWNe85k7J2Hypj5VWWcAIw0E6vW cjzjc97xQEqXamAz02nOEqg4_DFGNbX_xYuYkmRJBHNzoYDEOs35azIBfHU7OXpfysss88j9XLxH .iDvUqXjYhy6eEFC2WDNSta8LFf1fko1Qw7IN_zBXE8AN5RlqlanK9mA2KtIdnENvBF8YpcdcQXo RwBVGmBcFgiW5cda5MnWdIQ5.y7ZMR_V7yf8I4aDzhJkpHOT_TLtZjoCJvzDE.vTyiQ7.v0zARBD 04A3BnVqxkn0gckJvYdvUF_tb6iLMtjVgB.0J2GpkbbOM_iSflg0YrIVA6VxFF1B0aQ7UoqD4l_N twUUYLkwihRIUF6i9UqRS8sEIMPuiF.d1I9ExMZU40dtZ5uNiAPnStEdkeaCS33RRqJMXTcRJOWZ BeyumwqLRkDlx7Q_t6kUmWW3uRVKtEwapEj6gwjrLOGNo702xSEoeHpYiSaWr81cooiMyNABztqP AE8nuQV0bXGI._JLqOq2pU_qWHzC.vojZ9P8F1vnySzMnPN3JiYW7wXLSHH6018c7mKZ3UWqKhM9 s.IvFdtMhDXRLfW0ddggPp2uUeQ-- Received: from sonic.gate.mail.ne1.yahoo.com by sonic314.consmr.mail.bf2.yahoo.com with HTTP; Sun, 12 Aug 2018 18:10:01 +0000 Received: from ip70-189-131-151.lv.lv.cox.net (EHLO [192.168.0.105]) ([70.189.131.151]) by smtp428.mail.bf1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID 793bb8f2e0a27775956cfc8c533bbc7d; Sun, 12 Aug 2018 17:59:50 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 11.5 \(3445.9.1\)) Subject: Re: RPI3 swap experiments [a failure for a Pine64+ 2GB at head -r337400 without vm.pageout_oom_seq or #define adjustment, no I/O latency problem reported] From: Mark Millard In-Reply-To: Date: Sun, 12 Aug 2018 10:59:48 -0700 Cc: Trev , bob prohaska , John Kennedy , Jamie Landeg-Jones , "freebsd-arm@freebsd.org" Content-Transfer-Encoding: quoted-printable Message-Id: <507FC6E0-6EDB-4A0D-A9A6-DD03B50A1DA3@yahoo.com> References: <20180806155837.GA6277@raichu> <20180808153800.GF26133@www.zefox.net> <20180808204841.GA19379@raichu> <20180809065648.GB30347@www.zefox.net> <20180809152152.GC68459@raichu> <20180809153710.GC30347@www.zefox.net> <20180810044426.GB32974@www.zefox.net> <20180811163209.GA38922@www.zefox.net> <64798536-4ba5-24e9-304b-30cfb5b702d0@sentry.org> To: Mark Johnston , Warner Losh X-Mailer: Apple Mail (2.3445.9.1) X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 12 Aug 2018 18:10:08 -0000 [Quick top post: Possibly related bugzilla's for this area are: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D227609 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D230402 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D230454 .] On 2018-Aug-12, at 10:15 AM, Mark Millard wrote: > Based on having all Mark Johnston's reporting-patches but > not adjusting vm.pageout_oom_seq or the #define I got > an OOM kill during buildworld on a Pine64+ 2GB (so 2 GiByte > of RAM). >=20 > I'll give other environment characteristic later. > But that no I/O latency problems were reported by the > patches is not a surprise: the device with the root file > system and swap partition has not historically shown > latency problems and is not of a type usually used with > such a system (better than normal). >=20 > I expect that this case shows that the problem does not > require I/O latency problems to be involved. >=20 > The only console message was: >=20 > Aug 12 09:30:13 pine64 kernel: v_free_count: 7773, v_inactive_count: 1 > Aug 12 09:30:13 pine64 kernel: pid 80573 (c++), uid 0, was killed: out = of swap space >=20 > The build had been started at: 01:44:59 so the failure > was around 7 hours 45 minutes into the build. >=20 > The build log shows: >=20 > Building = /usr/obj/cortexA53_clang/arm64.aarch64/usr/src/arm64.aarch64/lib/clang/lib= clang/Sema/SemaDeclAttr.o > Building = /usr/obj/cortexA53_clang/arm64.aarch64/usr/src/arm64.aarch64/lib/clang/lib= clang/Sema/SemaDeclCXX.o > Building = /usr/obj/cortexA53_clang/arm64.aarch64/usr/src/arm64.aarch64/lib/clang/lib= clang/Sema/SemaDeclObjC.o > --- Sema/SemaDecl.o --- > c++: error: unable to execute command: Killed > c++: error: clang frontend command failed due to signal (use -v to see = invocation) > FreeBSD clang version 6.0.1 (tags/RELEASE_601/final 335540) (based on = LLVM 6.0.1) > Target: aarch64-unknown-freebsd12.0 > Thread model: posix > InstalledDir: /usr/bin > c++: note: diagnostic msg: PLEASE submit a bug report to = https://bugs.freebsd.org/submit/ and include the crash backtrace, = preprocessed source, and associated run script. > c++: note: diagnostic msg:=20 > ******************** >=20 > PLEASE ATTACH THE FOLLOWING FILES TO THE BUG REPORT: > Preprocessed source(s) and associated run script(s) are located at: > c++: note: diagnostic msg: /tmp/SemaDecl-44b104.cpp > c++: note: diagnostic msg: /tmp/SemaDecl-44b104.sh > c++: note: diagnostic msg:=20 >=20 > ******************** > *** [Sema/SemaDecl.o] Error code 254 >=20 >=20 > Description of the context . . . >=20 > I have access to a Pine64+ 2GB (that was updated to -r337400 > via a cross build) and had it doing a self-hosted rebuild of > -r337400 via -j4. (This was a jump from its last update over > 10 months ago. I've not historically had OOM kill problems.) >=20 > The root file system is on a USB3.0-capable 240 GB SSD > plugged in the lower slot, where it gets the 480Mbps > USB 2.0 classification. The kernel was loaded from a > microSDHC card that also supplied a /etc/fstab that > redirects to the USB root file system. >=20 > (With an edit of that /etc/fstab the microSDHC can boot > standalone: I keep it tracking.) >=20 > # usbconfig > ugen0.1: at usbus0, cfg=3D0 md=3DHOST = spd=3DHIGH (480Mbps) pwr=3DSAVE (0mA) > ugen1.1: at usbus1, cfg=3D0 md=3DHOST spd=3DFULL= (12Mbps) pwr=3DSAVE (0mA) > ugen0.2: at usbus0, cfg=3D0 md=3DHOST spd=3DHIGH = (480Mbps) pwr=3DON (0mA) >=20 > Historically I've not observed latency problems for > the USB SSD. None were reported by Mark Johnston's > reporting patches, unlike for Bob P.'s context. >=20 > In top I'd seem over 1400 Mem Active, well over the amount > of RAM in a rpi3 or rpi2. (Of course with more memory the > relative timings of what is running will be different > from what rpi3's/rpi2's get. That is not the only source of > variation.) >=20 > Swap had been used, I've seen 19M Used shown (of 3 GiByte > in the swap partition in use). (I do not have in place my > prior changes to record and report the maximum observed > swap used: I reverted to the normal version of top during > top's development activity.) >=20 > I'm unlikely to have observed approximate the maximums for > Mem Active or Swap Used. These are things I wish there were > normally available for inspection from FreeBSD. >=20 > I did not have a parallel loop showing gstat output > or other such, relying on Mark Johnston's patches > for reporting any that are a problem for the subsystem(s) > involved. (It is also less I/O to not be running the > extra logs.) >=20 =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)