From nobody Thu Aug 24 22:20:50 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RWyGV3m8Kz4rfSR for ; Thu, 24 Aug 2023 22:21:06 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic304-25.consmr.mail.gq1.yahoo.com (sonic304-25.consmr.mail.gq1.yahoo.com [98.137.68.206]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RWyGT0Jj0z3bCC for ; Thu, 24 Aug 2023 22:21:04 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=CmVcVUUb; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.68.206 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1692915662; bh=G7vFLD3bCO1RCS6K+iggZt3uLMk/ErRMMGmaQiGAHxk=; h=From:Subject:Date:To:References:From:Subject:Reply-To; b=CmVcVUUbtpFeF8QNwdQOpMlX1XFJ7u/A0oEmA05Ekn/34qf1bN0wCwxKm5+IIWvX3mqaSuMi3zZ1Dc40GfepRh366Mu+BtgiF4Msh2GprMxzyAF+IhEWYN+LYWXZOHx8+B4s/0m6rvkVfNCFZpeKBLxeabq6IyjEI0w0ehh1gIwG54ZXE8uqeBDuTZk5XdHyoDdyj8zPqSdkIMctb3I+q8zzL7T68x8FY6nXsVR/wdyJUjmNbOHsry07VRsz1U3gm4FnkHbMIocsLs8Nu7c2sq4eYxF0JlB31sXfJffd9YBtDu052Fi+mFvJkIy1+/8+9Wt7xJ8p7l3iordroPrmxg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1692915662; bh=ahlb4l5vIiGgtVPA77CyMmdhtMUB/VA3nRundIEI7K0=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=OeZdoCTrDCq63OSxJWb/r3nz2f5xZdDwS+AMwZCfUyb8p6VmNbLD723JRmTrAbjl9AaKNs0hIFP3ZllKPsy8P+Mm6oFEnJcMOW6tSa6itHYEbQP+BSB2MNUctjVMX2ay3FNOJ1ok1qJWZfTtMNPO4CRrX7yOjZwMfNZLfwtJlJI4fCrVAxHGLyGML04OxG802nuWkjYybkerUi+vOXbnA3sA1ASzB31kGbTCXWI4jAwt8AVeTjQsEVgH1XC72rRkwJiLzSVH79EkQvxCu4HLrv9mzxB8dwwvS9hdy6/M69uKlba3FniXtRa6TYKbhM5CIl+jzV1NJP7w80P42eKI7A== X-YMail-OSG: ZDvzPeQVM1kiBYZrDGIOYrZfM0YLVFG4tFEGPzFhJXrekNKLADrzCiFus7yu.E3 q34X.txgtb4AU98EpSD44p1ifCSEHgJkjlX2xzInUMCiEqK_l.SLpbVOQf41Vq8CE9bFE77OKXtx EmiYPFA7kbZpcYRNrDyldiBYfR_Wz6Dhjh09XWn9Xa_HXT40owbZp4_Qn7TsMmYuAjzFnaV1poDU 4ADE_Itz4Ni8XGNaQGm4iC_kDiwW6J7u920JOU5V0c150pD65VnIix60pESLiXSOy7qnurmobeX0 9bh.9IYvi304VpObZrWUeJ3J5iHXE7NZZ1AcS91qbV8g2FgWOf85Gx5gNTAIG2W6NDVmBx._rme0 FnlNaSWXSTXelnRVIYgDjm4psOCGGXCr9kwE4snW5jYfwZRKT5itv47xCppvhsLbDyd6xtIaAVos nNbyVvd0dz4.zdmy7BT4DjXojaMU5PD9GmkmYio2qdkQgKPvbpReDfHbLamF7XNieN_j.vb6ecH9 NybSPqDrON.ROMqeaMVgoKmwB_V2qWHqtbB3zW2j.HXckP.ytv8.oRm7VSMX_T0WkUU.Pwc40KWv SoCYBd.CeDD5s66aDsT2cmTgFbNJD7yiuxTapZX1jAGu3qWH0A47QqsPaXFf_EfahBHy4UnVmx1d 10W62.sR4huynDdisZGJ53ctv9upxz6Rg3Ih1brMEJpNzPGjh7aAyPyK3OzaZEaEe0JL_fbDyUKH i1smG7udjmzUJLYwHYE8Owi4UnwXCa0Uuq9NCA0iwAX2y_WDK2dPN5QhKaP_6jmTr6FpC5EgkRTY THyanPycLBLvs3a8f8FdnGPBkxocm3_bbMRTNSBzKDhLgL8AZMlyX9Ok6ddrLlfR3ZwIYtBqt1CV RJXVfFUgUk0R1Tquac1SgDUB_phqoStJ1sa854.DxRM3NRWyoiY1_awMhzZusiXrQBcOHGL2AaM7 GLxosuelyk6huF7KB_qhMAIfaOXHWRS2ncBQ6grTpoWBsqFoGdpgxliCKZDKvG7bpm1PwHfxsX4u rg.86YeMqo8vqpar_K0MJ3rJsSVNoFvMDFbnCn4PlLRXkcEO2lT3tr.682cfH9tlSXfbKnXLf1WM Vvo5niuTqHnGmHb.YylmpAFFnDQqeFQrvN_eWFFHUvZYgK_2mrWNAAEQqRyV6lLZ_rgelQ6U9rn. GkPGNam2bp8UnMdGewTOydTgDrtoufCPfzOdiradGQP.9UsN5lmo.cpMaXxchFNnNbtzYffQUBNK 4u8EMFWFsAuSe7wKY3wMencLIQdMgqabCfLcuF_KDvrfSrFDeGX8wyyJWIIFOUvHTNBiGMBBlc7C KXV4qCRV3yZYJkyhwxMnKbsV.k5Mb_Vu42iMKh86Xe.zF7n.H6a26s1HlRX4dXd74kTZBnK.W8AQ b7U.nNOQv1IC6Yhp1GCFDwUAyEkSHZeOXyCHdUhn4qoQw7bvO3R3e2ftjBrwgiE7C9T3I2mlw4o_ OEO2YrDIampA7tqiaSEwzAR.sbLlF8xvLJIMFgwCnFRb.izKh1N0PxLLWo212w8EKxRgeKia2scJ dgEMncZw2W8QuB6.k4z4iljDOLSQ12LH6YfcwWYu7UVWhB7CyOvlGLqAUbz71vyFJMaTsFo7GCFW khMLq6dVPyadEOCPUQt6Ict4EuhiZsdEmKwko0Tu8zr9.ln.1qgCUnrzKZpqvo0sGltUBSS1C5GW Ev9Vp_Qr3h._dqXTTbBvY8hyC.DVygyS3wHrPbVGRtilW4x7Zs3mAzle8JMNWzr2as1QA_meBaHJ Y5BVY6bAdIs2Ml6dOyIgWazs5GXH43A35EiOzRh.8Sj4AyYvJgEftldZMgR9JUS_S42eXKbSJg.V FSCTZbMvUOAtj0lgnDA0jJ.eVfHuONNO0qOzdN64Zr_5PnNeufxtRcOQrzCbej2WC94PrzpIvXod ZH.adkLRQfa8HGu.tPjRuXJHOZsWV_Swc2x4DuS.EcP2JLoZRuqLrUUTZ.9yQFdYmX7UZegam6ri mlO6p1.23uAny3J3vdJm7Tr868ZL.EPSsstXqcjQLZlXVCRcVBhUaRVG1sYRJ3FUsp34yJPn.wbr vuGb0.I2s1g3TBRR_2it1UE2.THeL.ZWHHbAecFLSsjhtgQVspfD7qxCrNzQKbMffdRuv1dnwEcp shwBBVwIMchzdS7z.JTWUK_pG6mAF5JK10PsJ8LrMwWAxzaC3DWR3tdQvyMf_ODmaMWla6AWTKRl ensC.r90w_FnFIg_r6EAyyDiiFQXqKBGqoAz0E2vsBNbQSz7Ts0UoGQxTp1jxMIjpHZcAU6aog0E r X-Sonic-MF: X-Sonic-ID: f3b482b4-16d9-4b54-add9-f951ae6369e3 Received: from sonic.gate.mail.ne1.yahoo.com by sonic304.consmr.mail.gq1.yahoo.com with HTTP; Thu, 24 Aug 2023 22:21:02 +0000 Received: by hermes--production-ne1-7b767b77cc-q899j (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID a2020579cda67b73abb996e7f78ec2e5; Thu, 24 Aug 2023 22:21:01 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: www/chromium will not build on a host w/ 8 CPU and 16G mem [RPi4B 8 GiByte example] Message-Id: <804E6287-71B7-4D2C-A72C-6FA681311139@yahoo.com> Date: Thu, 24 Aug 2023 15:20:50 -0700 To: bob prohaska , Current FreeBSD X-Mailer: Apple Mail (2.3731.700.6) References: <804E6287-71B7-4D2C-A72C-6FA681311139.ref@yahoo.com> X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ARC_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.68.206:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.68.206:from]; DKIM_TRACE(0.00)[yahoo.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Spamd-Bar: --- X-Rspamd-Queue-Id: 4RWyGT0Jj0z3bCC bob prohaska wrote on Date: Thu, 24 Aug 2023 19:44:17 UTC : > On Fri, Aug 18, 2023 at 08:05:41AM +0200, Matthias Apitz wrote: > >=20 > > sysctl vfs.read_max=3D128 > > sysctl vfs.aio.max_buf_aio=3D8192 > > sysctl vfs.aio.max_aio_queue_per_proc=3D65536 > > sysctl vfs.aio.max_aio_per_proc=3D8192 > > sysctl vfs.aio.max_aio_queue=3D65536 > > sysctl vm.pageout_oom_seq=3D120 > > sysctl vm.pfault_oom_attempts=3D-1=20 > >=20 >=20 > Just tried these settings on a Pi4, 8GB. Seemingly no help, > build of www/chromium failed again, saying only: >=20 > =3D=3D=3D> Compilation failed unexpectedly. > Try to set MAKE_JOBS_UNSAFE=3Dyes and rebuild before reporting the = failure to > the maintainer. > *** Error code 1 >=20 > No messages on the console at all, no indication of any swap use at = all. > If somebody can tell me how to invoke MAKE_JOBS_UNSAFE=3Dyes, either > locally or globally, I'll give it a try. But, if it's a system problem > I'd expect at least a peep on the console.... Are you going to post the log file someplace? You may have missed an earlier message. How long had it run before stopping? How does that match up with the MAX_EXECUTION_TIME and NOHANG_TIME and the like that you have poudriere set up to use ( /usr/local/etc/poudriere.conf ). Something relevant for the question is what you have for: # Grep build logs to determine a possible build failure reason. This is # only shown on the web interface. # Default: yes DETERMINE_BUILD_FAILURE_REASON=3Dno Using DETERMINE_BUILD_FAILURE_REASON leads to large builds running for a long time after it starts the process of stopping from a timeout> the grep activity takes a long time and the build activity is not stopped during the grep. vm.pageout_oom_seq=3D120 and vm.pfault_oom_attempts=3D-1 make sense to me for certain kinds of issues involved in large builds, presuming sufficient RAM+SWAP for how it is set up to operate. vm.pageout_oom_seq is associated with console/log messages. if one runs out of RAM+SWAP, vm.pfault_oom_attempts=3D-1 tends to lead to deadlock. But it allows slow I/O to have the time to complete and so can be useful. I'm not sure that any vfs.aio.* is actually involved: special system calls are involved, splitting requests vs. retrieving the status of completed requests later. Use of aio has to be explicit in the running software from what I can tell. I've no information about which software builds might be using aio during the build activity. # sysctl -d vfs.aio vfs.aio: Async IO management vfs.aio.max_buf_aio: Maximum buf aio requests per process vfs.aio.max_aio_queue_per_proc: Maximum queued aio requests per process vfs.aio.max_aio_per_proc: Maximum active aio requests per process vfs.aio.aiod_lifetime: Maximum lifetime for idle aiod vfs.aio.num_unmapped_aio: Number of aio requests presently handled by = unmapped I/O buffers vfs.aio.num_buf_aio: Number of aio requests presently handled by the buf = subsystem vfs.aio.num_queue_count: Number of queued aio requests vfs.aio.max_aio_queue: Maximum number of aio requests to queue, globally vfs.aio.target_aio_procs: Preferred number of ready kernel processes for = async IO vfs.aio.num_aio_procs: Number of presently active kernel processes for = async IO vfs.aio.max_aio_procs: Maximum number of kernel processes to use for = handling async IO=20 vfs.aio.unsafe_warningcnt: Warnings that will be triggered upon failed = IO requests on unsafe files vfs.aio.enable_unsafe: Permit asynchronous IO on all file types, not = just known-safe types vfs.read_max may well change the disk access sequences: # sysctl -d vfs.read_max vfs.read_max: Cluster read-ahead max block count That might well help some spinning rust or other types of I/O. MAKE_JOBS_UNSAFE=3Dyes is, for example, put in makefiles of ports that have problems with parallel build activity. It basically disables having parallel activity in the build context involved. I've no clue if you use the likes of, say, /usr/local/etc/poudriere.d/make.conf with conditional logic inside such as use of notation like: .if ${.CURDIR:M*/www/chromium} STUFF HERE .endif but you could. =3D=3D=3D Mark Millard marklmi at yahoo.com