From owner-freebsd-arm@freebsd.org Mon Jun 25 04:22:52 2018 Return-Path: Delivered-To: freebsd-arm@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B964C1023786 for ; Mon, 25 Jun 2018 04:22:51 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic307-10.consmr.mail.gq1.yahoo.com (sonic307-10.consmr.mail.gq1.yahoo.com [98.137.64.34]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1F03F8A093 for ; Mon, 25 Jun 2018 04:22:51 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: xnFH40UVM1kV9iMDHF9CEfaTD7Bfy0OaA0MJjpEAMvQEAIM4kLe0MtJAgh2Xd7n y2e60a.XHF2FCUS9ZpQ0bUfL5Vo8VmuVa1ePlkpeHKedpeUyOIYhwIz4YM8fN5uFqrzpxh4FFj0T 8_k6pRFX2WEPl8tPZbiLS376Y6k3xZhgWEcjqNAiAqZlwNnnbCGjMzmx2WRfWBXAr2Ch_bPSJek8 rkA0Tcq0HndsYLyz0ZK3ySwmUAEbTp0C0ZDBzj7wI1hsZ3C8Q0FE.grqJmWk1MvAUGH4rZ96gzGB zBE3OVFAGjgYnQOzrDIaCANXleFeJ8aisNWZiCA81cjwpeZDASQZXE8SSYVmXaPE32j8FPOWFpFS g3tW4aPYADWzPOMjw4eBrLf5cIVOg.Yt.YotCS975DnrSXPM46m0plOiqPaoQijQFWjwQyg9aqyV OjIzquHx_3iVHW0tf0cXF8uvOlvicZWZRKt3Rpsrhf10T.3ZBUVR6.Yig4WpId9joRkWPZ4WNF_V 6UgIhhigO4ezJVFPUz8J8xJ8XCf3oLtRBGC4XgnbO2.1.jI85RcjATYxi12ULd3mvev37o5XFBPn PTu7Bksu3h5LASTlZ7_yqrEdrdLwsNZP_qrR7RAde40I5hs_niX5_JwpKjgj9x6niSR5txuGhIfB h3pO0NDFfqnlIlPeSSBvpw_bH1nSfQvR19wBLROyo.enXrm0ED4.1uJ2ENi.HSpLPcjlTFSa2.JS lcSCN5uFXuGJV0Yd2ciHBMn_uy8zuawsxvHfSG_3ulUa7iQLiwSosZ_Vp76yKdx5aW5vh_t_xPGw Q5ISSGALa5nMWg6KjAKTALIJx3XwKGKBsL6K6ijuabHIXLqWuy9hfzR2OBCLFwaasFTHWnTa7gmn oxOy4PZ5Xem73EwdYksDsZw7ZTfSUxXxuyZfSGU.Mt6k.DkzKFZh0mQ_68bRCnoEMN2PXRUGCoHF usjmbsE_8C8HsUFf1qrlyYRSnSg3Xsw-- Received: from sonic.gate.mail.ne1.yahoo.com by sonic307.consmr.mail.gq1.yahoo.com with HTTP; Mon, 25 Jun 2018 04:22:43 +0000 Received: from ip70-189-131-151.lv.lv.cox.net (EHLO [192.168.0.105]) ([70.189.131.151]) by smtp423.mail.gq1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID ecf7377f9be98f5e028a56c58a6f3a62; Mon, 25 Jun 2018 04:22:39 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 11.4 \(3445.8.2\)) Subject: Re: RPI3 swap experiments, was Re: GPT vs MBR for swap devices From: Mark Millard In-Reply-To: <20180624231020.GA11132@www.zefox.net> Date: Sun, 24 Jun 2018 21:22:38 -0700 Cc: freebsd-arm@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <25F1A4BA-FBFC-4C32-85DD-5F5BA71A2B1A@yahoo.com> <20180620023253.GA89924@www.zefox.net> <1D86911D-20D1-494A-822B-1C07C5598CB1@yahoo.com> <10CAC122-399D-459E-9153-ABD7E753777E@yahoo.com> <20180623143218.GA6905@www.zefox.net> <03C2D3C4-6E90-4054-AF79-BD7FE2B7958D@yahoo.com> <20180624231020.GA11132@www.zefox.net> To: bob prohaska X-Mailer: Apple Mail (2.3445.8.2) X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 Jun 2018 04:22:52 -0000 On 2018-Jun-24, at 4:10 PM, bob prohaska wrote: > I've tried to replicate the RPi3 "run out of swap" experiment after > updating source, kernel and world to r335576. Roughly the same things = happen: > Errors flood the console, when swap usage goes a bit over 80% the = machine becomes > unresponsive. No sign of the OOM assassin.=20 >=20 > However, -j4 buildworld got all the way to building libraries. With = r334939 it > always stopped in cross tools. That seems like a significant = improvement > in swap usage efficiency. Is this to be expected?=20 >=20 =46rom the log file: = http://www.zefox.net/~fbsd/rpi3/swaptests/r335576/1gbsdflash/buildworld.lo= g is the text: --- buildworld --- make[1]: "/usr/src/Makefile.inc1" line 299: SYSTEM_COMPILER: Determined = that CC=3Dcc matches the source tree. Not bootstrapping a = cross-compiler. make[1]: "/usr/src/Makefile.inc1" line 304: SYSTEM_LINKER: Determined = that LD=3Dld matches the source tree. Not bootstrapping a cross-linker. So the cross compiler and cross linker were not built: the existing llvm files were used. It was during building of these that the earlier failures happened in the cross-tools stage as I understand: the other stuff does not require as big of processes, or as big of a maximum-total for -j4 . > What details were captured can be seen at > http://www.zefox.net/~fbsd/rpi3/swaptests/r335576/1gbsdflash/ > in case they're of interest. You are still using the drive that gets the errors ( /dev/da0 ), even if it is not being used for swapping. http://www.zefox.net/~fbsd/rpi3/swaptests/r335576/1gbsdflash/console shows: _vfs_done():da0d[WRITE(offset=3D51819347968, length=3D131072)]error =3D = 5 g_vfs_done():da0d[WRITE(offset=3D51819479040, length=3D28672)]error =3D = 5 g_vfs_done():da0d[READ(offset=3D59586936832, length=3D32768)]error =3D 5 g_vfs_done():vm_fault: pager read error, pid 823 (tcsh) da0d[READ(offset=3D59650965504, length=3D32768)]error =3D 5 g_vfs_done():vm_fault: pager read error, pid 3950 (sshd) da0a[WRITE(offset=3D65536, length=3D4096)]error =3D 5 g_vfs_done():da0a[WRITE(offset=3D8585216, length=3D4096)]error =3D 5 :24 www kernel: Failed to fully fault in a core file segment at VA = 0x405e6000 with size 0x10000 to be written at offset 0x346000 for = process tcsh Jun 24 13:25:25 www kernel: Failed to fully fault in a core file segment = at VA 0x40c41000 with size 0x10000 to be written at offset 0x981000 for = process tcsh (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 00 0b 3f c0 00 00 80 00=20 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error (da0:umass-sim0:0:0:0): Retrying command, 3 more tries remain (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 00 0b 3f c0 00 00 80 00=20 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error (da0:umass-sim0:0:0:0): Retrying command, 2 more tries remain (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 00 0b 3f c0 00 00 80 00=20 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error (da0:umass-sim0:0:0:0): Retrying command, 1 more tries remain (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 00 0b 3f c0 00 00 80 00=20 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error (da0:umass-sim0:0:0:0): Retrying command, 0 more tries remain (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 00 0b 3f c0 00 00 80 00=20 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error (da0:umass-sim0:0:0:0): Error 5, Retries exhausted g_vfs_done():da0a[WRITE(offset=3D805568512, length=3D32768)]error =3D 5 g_vfs_done():da0d[READ(offset=3D59580710912, length=3D32768)]error =3D 5 g_vfs_done():vm_fault: pager read error, pid 3960 (csh) da0d[READ(offset=3D59604205568, length=3D32768)]error =3D 5 g_vfs_done():vm_fault: pager read error, pid 823 (tcsh) da0a[WRITE(offset=3D65536, length=3D4096)]error =3D 5 g_vfs_done():da0a[WRITE(offset=3D8585216, length=3D4096)]error =3D 5 g_vfs_done():da0a[WRITE(offset=3D268599296, length=3D16384)]error =3D 5 g_vfs_done():da0a[WRITE(offset=3D268632064, length=3D32768)]error =3D 5 g_vfs_done():da0a[WRITE(offset=3D268664832, length=3D32768)]error =3D 5 g_vfs_done():da0a[WRITE(offset=3D289939456, length=3D4096)]error =3D 5 g_vfs_done():da0a[WRITE(offset=3D377454592, length=3D131072)]error =3D 5 (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 00 00 41 80 00 00 08 00=20 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error (da0:umass-sim0:0:0:0): Retrying command, 3 more tries remain (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 00 00 41 80 00 00 08 00=20 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error (da0:umass-sim0:0:0:0): Retrying command, 2 more tries remain (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 00 00 41 80 00 00 08 00=20 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error (da0:umass-sim0:0:0:0): Retrying command, 1 more tries remain (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 00 00 41 80 00 00 08 00=20 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error (da0:umass-sim0:0:0:0): Retrying command, 0 more tries remain (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 00 00 41 80 00 00 08 00=20 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error (da0:umass-sim0:0:0:0): Error 5, Retries exhausted g_vfs_done():da0a[WRITE(offset=3D268664832, length=3D32768)]error =3D 5 g_vfs_done():da0a[WRITE(offset=3D377454592, length=3D32768)]error =3D 5 g_vfs_done():da0d[WRITE(offset=3D65536, length=3D4096)]error =3D 5 g_vfs_done():da0d[WRITE(offset=3D20709376, length=3D4096)]error =3D 5 g_vfs_done():da0d[R:20 www kernel: Failed to fully fault in a core file = segment at VA 0x40c72000 with size 0x10000 to be written at offset = 0x992000 for process tcsh EAD(offset=3D17179279360, length=3D32768)]error =3D 5 g_vfs_done():vm_fault: pager read error, pid 817 (sshd) da0d[READ(offset=3D36814438400, length=3D4096)]error =3D 5 g_vfs_done():da0d[WRITE(offset=3D51207864320, length=3D32768)]error =3D = 5 g_vfs_done():da0d[WRITE(offset=3D51208126464, length=3D32768)]error =3D = 5 g_vfs_done():da0a[WRITE(offset=3D65536, length=3D4096)]error =3D 5 g_vfs_done():da0a[WRITE(offset=3D8585216, length=3D4096)]error =3D 5 (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 00 0b 3f c0 00 00 80 00=20 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error (da0:umass-sim0:0:0:0): Retrying command, 3 more tries remain (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 00 0b 3f c0 00 00 80 00=20 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error (da0:umass-sim0:0:0:0): Retrying command, 2 more tries remain (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 00 0b 3f c0 00 00 80 00=20 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error (da0:umass-sim0:0:0:0): Retrying command, 1 more tries remain (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 00 0b 3f c0 00 00 80 00=20 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error (da0:umass-sim0:0:0:0): Retrying command, 0 more tries remain (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 00 0b 3f c0 00 00 80 00=20 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error (da0:umass-sim0:0:0:0): Error 5, Retries exhausted g_vfs_done():da0a[WRITE(offset=3D377585664, length=3D8192)]error =3D 5 g_vfs_done():da0a[WRITE(offset=3D805568512, length=3D32768)]error =3D 5 g_vfs_done():da0a[WRITE(offset=3D825851904, length=3D16384)]error =3D 5 g_vfs_done():da0d[READ(offset=3D39456112640, length=3D32768)]error =3D 5 g_vfs_done():vm_fault: pager read error, pid 646 (getty) da0d[WRITE(offset=3D51818659840, length=3D32768)]error =3D 5 g_vfs_done():da0d[WRITE(offset=3D51819053056, length=3D32768)]error =3D = 5 g_vfs_done():da0d[WRITE(offset=3D51819347968, length=3D131072)]error =3D = 5 g_vfs_done():da0d[WRITE(offset=3D51819479040, length=3D28672)]error =3D = 5 g_vfs_done():da0d[READ(offset=3D59651031040, length=3D32768)]error =3D 5 g_vfs_done():vm_fault: pager read error, pid 817 (sshd) da0a[WRITE(offset=3D65536, length=3D4096)]error =3D 5 g_vfs_done():da0a[WRITE(offset=3D8585216, length=3D4096)]error =3D 5 g_vfs_done():da0a[WRITE(offset=3D268599296, length=3D16384)]error =3D 5 g_vfs_done():da0a[WRITE(offset=3D268632064, length=3D32768)]error =3D 5 g_vfs_done():da0a[WRITE(offset=3D268664832, length=3D32768)]error =3D 5 g_vfs_done():da0a[WRITE(offset=3D277078016, length=3D4096)]error =3D 5 g_vfs_done():da0a[WRITE(offset=3D377454592, length=3D131072)]error =3D 5 (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 00 00 41 80 00 00 08 00=20 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error (da0:umass-sim0:0:0:0): Retrying command, 3 more tries remain (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 00 00 41 80 00 00 08 00=20 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error (da0:umass-sim0:0:0:0): Retrying command, 2 more tries remain (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 00 00 41 80 00 00 08 00=20 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error (da0:umass-sim0:0:0:0): Retrying command, 1 more tries remain (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 00 00 41 80 00 00 08 00=20 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error (da0:umass-sim0:0:0:0): Retrying command, 0 more tries remain (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 00 00 41 80 00 00 08 00=20 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error (da0:umass-sim0:0:0:0): Error 5, Retries exhausted g_vfs_done():da0a[WRITE(offset=3D377454592, length=3D32768)]error =3D 5 g_vfs_done():da0d[WRITE(offset=3D65536, length=3D4096)]error =3D 5 g_vfs_done():da0d[WRITE(offset=3D20709376, length=3D4096)]error =3D 5 g_vfs_done():da0d[READ(offset=3D17179312128, length=3D32768)]error =3D 5 g_vfs_done():vm_fault: pager read error, pid 695 (sshd) da0d[READ(offset=3D39456473088, length=3D32768)]error =3D 5 g_vfs_done():vm_fault: pager read error, pid 646 (getty) da0d[WRITE(offset=3D51207864320, length=3D32768)]error =3D 5 g_vfs_done():da0d[WRITE(offset=3D51208126464, length=3D32768)]error =3D = 5 g_vfs_done():da0a[WRITE(offset=3D65536, length=3D4096)]error =3D 5 g_vfs_done():da0a[WRITE(offset=3D8585216, length=3D4096)]error =3D 5 (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 00 0b 3f c0 00 00 80 00=20 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error (da0:umass-sim0:0:0:0): Retrying command, 3 more tries remain (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 00 0b 3f c0 00 00 80 00=20 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error (da0:umass-sim0:0:0:0): Retrying command, 2 more tries remain (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 00 0b 3f c0 00 00 80 00=20 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error (da0:umass-sim0:0:0:0): Retrying command, 1 more tries remain (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 00 0b 3f c0 00 00 80 00=20 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error (da0:umass-sim0:0:0:0): Retrying command, 0 more tries remain (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 00 0b 3f c0 00 00 80 00=20 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error (da0:umass-sim0:0:0:0): Error 5, Retries exhausted g_vfs_done():da0a[WRITE(offset=3D377585664, length=3D16384)]error =3D 5 g_vfs_done():da0a[WRITE(offset=3D805568512, length=3D32768)]error =3D 5 g_vfs_done():da0d[READ(offset=3D39456047104, length=3D32768)]error =3D 5 g_vfs_done():da0a[WRITE(offset=3D65536, length=3D4096)]error =3D 5 g_vfs_done():da0a[WRITE(offset=3D8585216, length=3D4096)]error =3D 5 g_vfs_done():da0a[WRITE(offset=3D268599296, length=3D16384)]error =3D 5 g_vfs_done():da0a[WRITE(offset=3D268632064, length=3D32768)]error =3D 5 g_vfs_done():da0a[WRITE(offset=3D268664832, length=3D32768)]error =3D 5 g_vfs_done():da0a[WRITE(offset=3D277078016, length=3D4096)]error =3D 5 g_vfs_done():da0a[WRITE(offset=3D377454592, length=3D131072)]error =3D 5 (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 00 00 41 80 00 00 08 00=20 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error (da0:umass-sim0:0:0:0): Retrying command, 3 more tries remain (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 00 00 41 80 00 00 08 00=20 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error (da0:umass-sim0:0:0:0): Retrying command, 2 more tries remain There are examples of > 50 seconds for ms/w: 2 0 0 0 0.0 0 10 53783 0 0 = 0.0 537.8 da0d 5 1 0 0 0.0 1 14 54159 0 0 = 0.0 551.9 da0 3 0 0 0 0.0 0 3 55101 0 0 = 0.0 551.9 da0a There are a lot with > 20 seconds for ms/w, I'll not list them here. Similarly for > 20 seconds for ms/r. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)