From owner-freebsd-arm@freebsd.org Fri Aug 10 04:44:18 2018 Return-Path: Delivered-To: freebsd-arm@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7C09A105B4F4 for ; Fri, 10 Aug 2018 04:44:18 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Received: from www.zefox.net (www.zefox.net [50.1.20.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "www.zefox.org", Issuer "www.zefox.org" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id EB1B47874A; Fri, 10 Aug 2018 04:44:17 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Received: from www.zefox.net (localhost [127.0.0.1]) by www.zefox.net (8.15.2/8.15.2) with ESMTPS id w7A4iRsG035088 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Thu, 9 Aug 2018 21:44:28 -0700 (PDT) (envelope-from fbsd@www.zefox.net) Received: (from fbsd@localhost) by www.zefox.net (8.15.2/8.15.2/Submit) id w7A4iQib035087; Thu, 9 Aug 2018 21:44:26 -0700 (PDT) (envelope-from fbsd) Date: Thu, 9 Aug 2018 21:44:26 -0700 From: bob prohaska To: Warner Losh Cc: Mark Johnston , "freebsd-arm@freebsd.org" , bob prohaska Subject: Re: RPI3 swap experiments ["was killed: out of swap space" with: "v_free_count: 5439, v_inactive_count: 1"] Message-ID: <20180810044426.GB32974@www.zefox.net> References: <20180802015135.GC99523@www.zefox.net> <20180806155837.GA6277@raichu> <20180808153800.GF26133@www.zefox.net> <20180808204841.GA19379@raichu> <20180809065648.GB30347@www.zefox.net> <20180809152152.GC68459@raichu> <20180809153710.GC30347@www.zefox.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.24 (2015-08-30) X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Aug 2018 04:44:18 -0000 On Thu, Aug 09, 2018 at 09:42:59AM -0600, Warner Losh wrote: > On Thu, Aug 9, 2018 at 9:37 AM, bob prohaska wrote: > > > > > There's a kernel building now with > > options CAM_IOSCHED_DYNAMIC > > in the config file. Is it still worth trying? Anything else to try? > > > > It won't be a cure-all, out of the box, I don't think. However, the read > biasing code may help sneak a few 'reads' in between writes which may help > keep away from the pathological behavior.... Or not, it's hard to say... > I've not looked at swapping to super-crappy nand (I mean thumb drives) in > as much detail as the drives we use for work. > Alas, 'tis true. Combined with the patches so far it didn't seem to help at all, with or without using vm.pageout_oom_seq to 120. The -j4 buildworld ended with an OOMA kill using 12 and a panic and reboot at 120. A -j4 buildworld actually got farther using vm.pageout_oom_seq=120 with no other changes. Results are at http://www.zefox.net/~fbsd/rpi3/swaptests/r337226M/1gbsdflash_1gbusbflash/batchqueue/pageout120/slow_swap/cam_iosched_dynamic/ Any suggestions on what to try next would be welcome. Thanks for reading, bob prohaska