From owner-freebsd-arm@freebsd.org Thu Sep 6 17:33:03 2018 Return-Path: Delivered-To: freebsd-arm@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 91B51FCDF12 for ; Thu, 6 Sep 2018 17:33:03 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic301-4.consmr.mail.bf2.yahoo.com (sonic301-4.consmr.mail.bf2.yahoo.com [74.6.129.43]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 38ECB81702 for ; Thu, 6 Sep 2018 17:33:03 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: _x.UZ_sVM1lY2q_qZmtzeCBpf91IvCqLpCPosjA6P_pkMBY7Bf_bURWGh15ktoW 2XRMXEW8bf7wz5wxNC1_JzXR3EKs0F2A2d0lg27nLvlyoXRK1OSn5ym.O0ic4vX574vVcXesfP27 YV3G9VC5Sx344ffcpNzWOIay6zO9ENR1PHRJS8eX.bNP.zbXK8LS2k31AdOUlLYdqVNgZbkmKCYV jEFnrspw1AmvxtQKUTnpdtAgaYeP7hKUckX77GC4qy2.yWeuIy0522Bo.nWVz6YRmf0BvZLQOnSm umLD_pSX4YhtiKb7pIdVtl2SquAtRdi7v96uF3oVBWzaSIPRulND71ROYyDFeVGFuS5nrF27oA95 GEXkSps11SEc_3CGQy9g9oG4bVQTlc1cUTAC3muYd5VpCt0vtbNVeqjRgiMDC27bXUgjV7f3qmmq 07BkVCiimN28Zm1YNvN5xd5hfHxZxLIk4vB3pFDDM8VtgMvw4oEoIQTIJP63hSLIRXF_TNv1fqBS rhDWv4IbDvpaZLdX9UmfByNIS.5ZbaZmpzUpgDu5lqbVuqGhAUoUM8QC7xjbenkBOs2fXwFtMm.g FjQOi4r.1635wiCM20LmlLCu6fNYqP8xKr0jSel.M64gGlfAacSr8AWzvo_i7zad5PjSVczVvxul 5JqYm7RiV.abNUSyfsgB9cW_5FFoTzMGtReJFRZ_2bZ_qDDTbfmLTF9mPkaKFz8LZaAO_wZnj_Vj nZwB46k8DR9tJxLJq5I1tpLVotO.3BYYDZupqla4Q8rV2pqB2uaLx_PNuftZ8Xn..pnowE5TlAFE ss0C9kB_ViC4YFz2b.L3oym1dDtn8WF7dTRuyx1lkm_W26jkEJbmFDLm9xSH4EjyvEjGNsGcjc2E UCtd7MNSgyCsI06NFxHs9S62n.h5YJf87CEuTw3cZcURUO69DckwTxzHeN1bQR2XI6DfnZpsnkmt ah0ujblnVbnmqFIjSc6EsapmSZONPCVM8KUm8EIpkwAfrUgJP_gsO8WVlxLo5xeam2ZV8FeKVJw9 hsnNnj4NrtA-- Received: from sonic.gate.mail.ne1.yahoo.com by sonic301.consmr.mail.bf2.yahoo.com with HTTP; Thu, 6 Sep 2018 17:32:57 +0000 Received: from ip70-189-131-151.lv.lv.cox.net (EHLO [192.168.0.105]) ([70.189.131.151]) by smtp418.mail.bf1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID f3e61f723f48550491ae7acc9d4c41b7; Thu, 06 Sep 2018 17:32:52 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 11.5 \(3445.9.1\)) Subject: Re: RPI3 swap experiments (r338342 with vm.pageout_oom_seq="1024" and 6 GB swap) From: Mark Millard In-Reply-To: <20180906155858.GA5980@www.zefox.net> Date: Thu, 6 Sep 2018 10:32:50 -0700 Cc: freebsd-arm@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <075BD4BB-CAFB-4C9B-809A-10901522D1ED@yahoo.com> References: <20180814014226.GA50013@www.zefox.net> <20180815013612.GB51051@www.zefox.net> <20180815225504.GB59074@www.zefox.net> <20180901230233.GA42895@www.zefox.net> <20180906003829.GC818@www.zefox.net> <20180906051520.GB3482@www.zefox.net> <059D2FED-6E7C-4FEF-8807-8D4A0D0B3E26@yahoo.com> <20180906155858.GA5980@www.zefox.net> To: bob prohaska X-Mailer: Apple Mail (2.3445.9.1) X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 Sep 2018 17:33:03 -0000 On 2018-Sep-6, at 8:58 AM, bob prohaska wrote: > On Thu, Sep 06, 2018 at 12:08:09AM -0700, Mark Millard wrote: >> On 2018-Sep-5, at 10:15 PM, bob prohaska = wrote: >>=20 >>>> . . . >>> There were two buildworld tests run with 6 GB of swap, the first = without >>> TRIM being turned on and the second with TRIM turned on. The second = run >>> too an hour longer, with TRIM being on the only difference.=20 >>=20 >> buildworld did not take an hour longer for one vs. the other >> based on the timestamps in the log files: >>=20 >> trim off: >>=20 >>>>> World build started on Sun Sep 2 20:28:12 PDT 2018 >> . . . >>>>> World build completed on Mon Sep 3 21:35:47 PDT 2018 >>=20 >> So somewhat over 25 hours 7 minutes. >>=20 >> trim on: >>=20 >>>>> World build started on Tue Sep 4 00:02:36 PDT 2018 >> . . . >>>>> World build completed on Wed Sep 5 01:12:47 PDT 2018 >>=20 >> So somewhat over 25 hours 10 minutes. >>=20 >> I get an under 5 minute difference from those timestamps. >>=20 >>=20 >=20 > You are correct, the mistake is mine. Thanks for catching it! >=20 >>>> . . . >>> Near as I can tell there are no non-zero values for d/s, which if = it's tied >>> to TRIM is reasonable for all but microSD, which did have TRIM = enabled. Since >>> microSD wasn't particularly busy, apart from swap, that too is = unsurprising. >>=20 >> = http://www.zefox.net/~fbsd/rpi3/swaptests/r338342/3gbsd_3gbusb/trim_on/wri= tedelay.sort >> shows ms/d and its matching kBps with the below non-zero figures: >>=20 >> . . . >> 0 0 0 0 0.0 0 6 16.2 0 10 = 0.1 0.3 mmcsd0 >> 0 0 0 0 0.0 0 6 16.3 0 10 = 0.2 0.3 mmcsd0s2 >> . . . >> 0 0 0 0 0.0 0 3 99.2 0 4 = 40.7 1.3 mmcsd0s2a >> 0 0 0 0 0.0 0 3 99.3 0 4 = 40.8 1.3 ufs/rootfs >> . . . >> 0 0 0 0 0.0 0 10 147.6 0 6 = 12.0 4.5 mmcsd0s2a >> . . . >> 0 2 1 8 1.8 0 7 211.0 0 10 = 114.5 5.8 mmcsd0 >> 0 2 1 8 1.8 0 7 211.1 0 10 = 114.5 5.8 mmcsd0s2 >> 0 1 0 0 0.0 0 7 211.2 0 10 = 114.6 5.6 ufs/rootfs >> . . . >>=20 >> Those are all I found. I may have missed some. >>=20 >=20 > Again, I was mistaken, misreading your original question.=20 I looked at examples of using 1 device for swap and only 2 GiByte of swap ( still -r338342 ): For 2gbsd (2 GiBytes on the sdcard, two 1 GiByte partitions used): World build started on Thu Aug 30 09:44:09 PDT 2018 . . . World build completed on Fri Aug 31 07:56:20 PDT 2018 So: somewhat over 22 hour and 12 minutes. vs. For 2gbusb (2 GiBytes on the usb device, two 1 GiByte partitions used): World build started on Fri Aug 31 10:27:17 PDT 2018 . . . World build completed on Sat Sep 1 12:49:19 PDT 2018 So: somewhat over 26 hours 22 minutes. So a difference of over 4 hours. It appears to me that for the devices that you are currently using, you are better off for elapsed time having the swap only on the sdcard. It may be evidence that the split of heavivly in use UFS and the swap partition across the channels/devices is useful. Or it could just be that the sdcard is faster. I can not tell from the cases available. If you had a sufficiently large sdcard of similar performance, and ran a test that avoided the usb device completely, that would give a clue (still -r338342 or otherwise matching contexts for the comparison with a split context). =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)