From owner-freebsd-arm@freebsd.org Sat Mar 28 16:17:42 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C81012A69E3 for ; Sat, 28 Mar 2020 16:17:42 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Received: from www.zefox.net (www.zefox.net [50.1.20.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "www.zefox.org", Issuer "www.zefox.org" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 48qP566QJ1z43MW for ; Sat, 28 Mar 2020 16:17:30 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Received: from www.zefox.net (localhost [127.0.0.1]) by www.zefox.net (8.15.2/8.15.2) with ESMTPS id 02SGHgTN007665 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Sat, 28 Mar 2020 09:17:43 -0700 (PDT) (envelope-from fbsd@www.zefox.net) Received: (from fbsd@localhost) by www.zefox.net (8.15.2/8.15.2/Submit) id 02SGHgmc007664; Sat, 28 Mar 2020 09:17:42 -0700 (PDT) (envelope-from fbsd) Date: Sat, 28 Mar 2020 09:17:42 -0700 From: bob prohaska To: Mark Millard Cc: freebsd-arm@freebsd.org, bob prohaska Subject: Re: Belated out of swap kill on rpi3 at r359216 Message-ID: <20200328161742.GA7571@www.zefox.net> References: <83E41A13-6C24-4B56-A837-779044038FBC@yahoo.com> <20200324185518.GA92311@www.zefox.net> <75CE3C07-8A0A-4D32-84C6-24BEA967447E@yahoo.com> <20200324224658.GA92726@www.zefox.net> <764D5A86-6A42-44E0-A706-F1C49BB198DA@yahoo.com> <20200325015633.GA93057@www.zefox.net> <0FF6BC4C-296F-49F3-8FB8-AA87A49349E2@yahoo.com> <20200326220649.GA99824@www.zefox.net> <0A8CF8D1-8D0F-40E2-A10D-EB44BEEAB557@yahoo.com> <5549E63B-0784-4B58-AD36-2A2EDC518308@yahoo.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <5549E63B-0784-4B58-AD36-2A2EDC518308@yahoo.com> User-Agent: Mutt/1.5.24 (2015-08-30) X-Rspamd-Queue-Id: 48qP566QJ1z43MW X-Spamd-Bar: ++ Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of fbsd@www.zefox.net has no SPF policy when checking 50.1.20.27) smtp.mailfrom=fbsd@www.zefox.net X-Spamd-Result: default: False [2.23 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.11)[-0.108,0]; WWW_DOT_DOMAIN(0.50)[]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; IP_SCORE(0.05)[ip: (0.24), ipnet: 50.1.16.0/20(0.12), asn: 7065(-0.03), country: US(-0.05)]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[zefox.net]; AUTH_NA(1.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_SPAM_LONG(0.38)[0.383,0]; R_SPF_NA(0.00)[]; FREEMAIL_TO(0.00)[yahoo.com]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:7065, ipnet:50.1.16.0/20, country:US]; MID_RHS_MATCH_FROM(0.00)[]; MID_RHS_WWW(0.50)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 28 Mar 2020 16:17:42 -0000 On Fri, Mar 27, 2020 at 07:25:45PM -0700, Mark Millard wrote: > > > On 2020-Mar-26, at 16:24, Mark Millard wrote: > > > > > Anyway, I may, for a time, have one context that is > > more like yours than is normal for me. As stands, the > > RPi3 is doing a from-scratch buildworld buildkernel . > > (Reconstructing the head -r358966 that it is already > > running.) It is not splitting the I/O load but is > > using a USB SSD (via a powered hub), not the microsd > > card. No extra logging. vm.pfault_oom_attempts=-1 > > and vm.pageout_oom_seq=120 for this attempt. 3072 > > MiBytes of page/swap space. It is a -j4 build attempt. > > > > ("No extra logging" meant: beyond my normal typescript > recording of the build output. That file ended up at > 7741518 Bytes for size.) Does the process capture all the output from make buildworld? On my machines (pi2 and pi3) that's usually ~30 MB. > > > The build completed without any /var/log/message or > console output during the build. My modified version > of top reported (details copied from a ssh window) . . . > That seems to settle matters. My problems are with the old microSD card. New, it was marginally ok. Old, it's not. That crudely quantifies lifespan at around a year of active use, with trouble appearing roughly when the card was 75% full, at least a hint of required overprovisioning. Out of curiosity, have you tried leaving vm.pfault_oom_attempts at its default value? An OOM kill would be unexpected, but interesting if observed. > For Mem: 738512Ki MaxObsActive, 190608Ki MaxObsWired, 906372Ki MaxObs(Act+Wir) > For Swap: 1927Mi MaxObsUsed > Thanks for posting! bob prohaska > (top was started before the build. "MaxObs" is short > for "Maximum Observed".) > > The build took a few minutes under 31 hrs. > (Ending: 2010-03-27:18:54:03 > Starting: 2020-03-26:12:02:47). > > Because it was rebuilding -r358966 that it was already > running, no bootstrap compiler or linker was built, > despite it being a from-scratch build: The system > compiler and linker were sufficient. > > > > For reference: the details of what was specified for > building (contributes to "how long it took"). . . > > # more ~/src.configs/src.conf.cortexA53-clang-bootstrap.aarch64-host > TO_TYPE=aarch64 > # > KERNCONF=GENERIC-NODBG > TARGET=arm64 > .if ${.MAKE.LEVEL} == 0 > TARGET_ARCH=${TO_TYPE} > .export TARGET_ARCH > .endif > # > WITH_SYSTEM_COMPILER= > WITH_SYSTEM_LINKER= > # > WITH_LIBCPLUSPLUS= > WITHOUT_BINUTILS_BOOTSTRAP= > WITH_ELFTOOLCHAIN_BOOTSTRAP= > #Disables avoiding bootstrap: WITHOUT_LLVM_TARGET_ALL= > WITH_LLVM_TARGET_AARCH64= > WITH_LLVM_TARGET_ARM= > WITHOUT_LLVM_TARGET_MIPS= > WITHOUT_LLVM_TARGET_POWERPC= > WITHOUT_LLVM_TARGET_RISCV= > WITHOUT_LLVM_TARGET_X86= > WITH_CLANG= > WITH_CLANG_IS_CC= > WITH_CLANG_FULL= > WITH_CLANG_EXTRAS= > WITH_LLD= > WITH_LLD_IS_LD= > WITHOUT_BINUTILS= > WITH_LLDB= > # > WITH_BOOT= > WITHOUT_LIB32= > # > # > NO_WERROR= > #WERROR= > MALLOC_PRODUCTION= > # > # Avoid stripping but do not control host -g status as well: > DEBUG_FLAGS+= > # > WITH_DEBUG_FILES= > # > # Use of the .clang 's here avoids > # interfering with other CFLAGS > # usage, such as ?= usage. > CFLAGS.clang+= -mcpu=cortex-a53 > CXXFLAGS.clang+= -mcpu=cortex-a53 > CPPFLAGS.clang+= -mcpu=cortex-a53 > ACFLAGS.arm64cpuid.S+= -mcpu=cortex-a53+crypto > ACFLAGS.aesv8-armx.S+= -mcpu=cortex-a53+crypto > ACFLAGS.ghashv8-armx.S+= -mcpu=cortex-a53+crypto > > # more /usr/src/sys/arm64/conf/GENERIC-NODBG > # > # GENERIC -- Custom configuration for the arm64/aarch64 > # > > include "GENERIC" > > ident GENERIC-NODBG > > makeoptions DEBUG=-g # Build kernel with gdb(1) debug symbols > > options ALT_BREAK_TO_DEBUGGER > > options KDB # Enable kernel debugger support > > # For minimum debugger support (stable branch) use: > #options KDB_TRACE # Print a stack trace for a panic > options DDB # Enable the kernel debugger > > # Extra stuff: > #options VERBOSE_SYSINIT=0 # Enable verbose sysinit messages > #options BOOTVERBOSE=1 > #options BOOTHOWTO=RB_VERBOSE > #options KTR > #options KTR_MASK=KTR_TRAP > ##options KTR_CPUMASK=0xF > #options KTR_VERBOSE > > # Disable any extra checking for. . . > nooptions DEADLKRES # Enable the deadlock resolver > nooptions INVARIANTS # Enable calls of extra sanity checking > nooptions INVARIANT_SUPPORT # Extra sanity checks of internal structures, required by INVARIANTS > nooptions WITNESS # Enable checks to detect deadlocks and cycles > nooptions WITNESS_SKIPSPIN # Don't run witness on spinlocks for speed > nooptions DIAGNOSTIC > nooptions MALLOC_DEBUG_MAXZONES # Separate malloc(9) zones > nooptions BUF_TRACKING > nooptions FULL_BUF_TRACKING > > > === > Mark Millard > marklmi at yahoo.com > ( dsl-only.net went > away in early 2018-Mar) > >