From owner-freebsd-arm@freebsd.org Wed Aug 8 21:02:46 2018 Return-Path: Delivered-To: freebsd-arm@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B4AEB106AFDD for ; Wed, 8 Aug 2018 21:02:46 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic305-21.consmr.mail.gq1.yahoo.com (sonic305-21.consmr.mail.gq1.yahoo.com [98.137.64.84]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3AEF393F40 for ; Wed, 8 Aug 2018 21:02:45 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: HMj5RcAVM1luvjOQLPn_G5N0BtL3tomjYPkJGP.6Ewk_Wq_dpwdbspNme1uISIs nL7GdqNXaSQMIOGw0Y7CfKNvQtKgMxpomV.pOpgEP2khVCCZEWsZo9X1mB4Pu3lGOGN1fufEoZ.Y VWD0t88yGO6lhB8_7VD1cpRkQWaCrtjdsVNnTauBgxfNIy7Vcu1VrL0EsQ3n.tNLA71EzkFt4qhw ANOIke_2fggpOC4w_MJvVK_Hmm7QG7tsh5HRE6Nd6T_ctqxDkJwaZnN88XOLp0oh7VZZh658qBHx CZU_JIJm4UagxoVDchahifvNd_N83VfxDLfxPErL2J.nZ5hJTdKg_FupQccxCa8Wvxdg2ProMD8n jDACC2fiecCKNlmnMbK6IGYFXzP148VcgaVmPBgpkn1liOALLPPbt5RklZ0GMT9kEPvFt.lxNuLH YXJzJd7xJ6d3tf90l2AO_49I4ZN2SQUw90B9Iix7rzXJuqusbrrcRYXrn6klfb7eYDdvTUVCa6mB hFes.VjEt.3GGvP2eZjIVXojdMNPx24rJVS.S3GzYm1xA6JuTzNAEGTIWy906QBrUlDRAMH6Mlut fNth2XIna3ZAGOd_rJd5SNx5uFfb7FT99Ucww8UJLn8z7Sec4xKw_2Vcnrd0DmgtnSDj_bZhnZSs sakOMRqd2RULajXM7LrA.CkkoaSF725W0TkdrMtkzsDzIMSTw..Bcuw75CA40wGEa3vS9GAgHxS8 eza9GCF1eTtTepLMB.15rLiJo8Na8KLyamd_42.0sviXDwioxEXuFD7nK1VpFDQSho05g8dkra3i 42DDOfTrSC2ZTD8xeZXCBJJUdPU_YnwMtGULli1DysZzXUdvh5cB7t6qHSS6Ca5q732q1.Vj.LJF rnFoGIpgSlxI56K_zdeftHv7tj3TTzkMBt1AlOtAzd_eEa7UrOWS.UKb7ikCItDOy45moNia.zfo WQtbiy1kSD2yuCrr8vWsyFHB_yaKqZeMn.617TDGatQhV.Qy5kQDUZB6NMNn0_y10w9hFtPZM3je 4mncCSOdvUw-- Received: from sonic.gate.mail.ne1.yahoo.com by sonic305.consmr.mail.gq1.yahoo.com with HTTP; Wed, 8 Aug 2018 21:02:39 +0000 Received: from ip70-189-131-151.lv.lv.cox.net (EHLO [192.168.0.105]) ([70.189.131.151]) by smtp430.mail.gq1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID d6d90b079c097a43e7e27ad7b7fe5143; Wed, 08 Aug 2018 21:02:38 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 11.5 \(3445.9.1\)) Subject: Re: RPI3 swap experiments ["was killed: out of swap space" with: "v_free_count: 5439, v_inactive_count: 1"] From: Mark Millard In-Reply-To: <20180808204841.GA19379@raichu> Date: Wed, 8 Aug 2018 14:02:36 -0700 Cc: bob prohaska , Mark Millard via freebsd-arm , Trev , John Kennedy , Jamie Landeg-Jones Content-Transfer-Encoding: quoted-printable Message-Id: <2DC1A479-92A0-48E6-9245-3FF5CFD89DEF@yahoo.com> References: <20180731231912.GF94742@www.zefox.net> <2222ABBD-E689-4C3B-A7D3-50AECCC5E7B2@yahoo.com> <20180801034511.GA96616@www.zefox.net> <201808010405.w7145RS6086730@donotpassgo.dyslexicfish.net> <6BFE7B77-A0E2-4FAF-9C68-81951D2F6627@yahoo.com> <20180802002841.GB99523@www.zefox.net> <20180802015135.GC99523@www.zefox.net> <20180806155837.GA6277@raichu> <20180808153800.GF26133@www.zefox.net> <20180808204841.GA19379@raichu> To: Mark Johnston X-Mailer: Apple Mail (2.3445.9.1) X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Aug 2018 21:02:47 -0000 On 2018-Aug-8, at 1:48 PM, Mark Johnston wrote: > On Wed, Aug 08, 2018 at 08:38:00AM -0700, bob prohaska wrote: >> The patched kernel ran longer than default but OOMA still halted = buildworld around >> 13 MB. That's considerably farther than a default build world have = run but less than >> observed when setting vm.pageout_oom_seq=3D120 alone. Log files are = at >> = http://www.zefox.net/~fbsd/rpi3/swaptests/r337226M/1gbsdflash_1gbusbflash/= batchqueue/ >>=20 >> Both changes are now in place and -j4 buildworld has been restarted.=20= >=20 > Looking through the gstat output, I'm seeing some pretty abysmal = average > write latencies for da0, the flash drive. I also realized that my > reference to r329882 lowering the pagedaemon sleep period was wrong - > things have been this way for much longer than that. Moreover, as you > pointed out, bumping oom_seq to a much larger value wasn't quite > sufficient. My understanding is that some other folks involved in the message exchange replicated the OOM kills without having evidence of issues like Bob P. has with large latencies for his hardware. The latencies may be sufficient but not necessary. Getting some of the other folks to run your tests would likely be good. > I'm curious as to what the worst case swap I/O latencies are in your > test, since the average latencies reported in your logs are high = enough > to trigger OOM kills even with the increased oom_seq value. When the > current test finishes, could you try repeating it with this patch > applied on top? = https://people.freebsd.org/~markj/patches/slow_swap.diff > That is, keep the non-default oom_seq setting and modification to > VM_BATCHQUEUE_SIZE, and apply this patch on top. It'll cause the = kernel > to print messages to the console under certain conditions, so a log of > console output will be interesting. Sounds like anyone else running tests should also have all 3 changes in place. I've CC'd some folks from the exchange that I think were running some tests. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)