From owner-freebsd-stable@freebsd.org Sun Mar 17 12:56:11 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A888B15395BB for ; Sun, 17 Mar 2019 12:56:11 +0000 (UTC) (envelope-from doralitze@chaotikum.org) Received: from mail.chaotikum.net (mail.chaotikum.net [IPv6:2a01:4f8:160:3067::9]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E9B5A76D6B for ; Sun, 17 Mar 2019 12:56:09 +0000 (UTC) (envelope-from doralitze@chaotikum.org) Received: from cryingsilvertomb.technikradio.org (dialin-212-144-081-053.pools.arcor-ip.net [212.144.81.53]) by mail.chaotikum.net (Postfix) with ESMTPSA id 63E91A23E51 for ; Sun, 17 Mar 2019 13:55:59 +0100 (CET) Subject: Re: hw.vga.acpi_ignore_no_vga=1 for installation media To: freebsd-stable@freebsd.org References: From: Leon Christopher Dietrich Openpgp: preference=signencrypt Autocrypt: addr=doralitze@chaotikum.org; keydata= mDMEWtHUghYJKwYBBAHaRw8BAQdADiq7m5rFo5SGrzdtwaAD2CKcTYyCG64PX70zTq+WTgm0 M0xlb24gQ2hyaXN0b3BoZXIgRGlldHJpY2ggPGRvcmFsaXR6ZUBjaGFvdGlrdW0ub3JnPoiW BBMWCAA+FiEEQeNAFBlbshh/yWC93qL1fUgfdPUFAlrR1IICGwMFCQlmAYAFCwkIBwIGFQoJ CAsCBBYCAwECHgECF4AACgkQ3qL1fUgfdPVPbAEA8ams4Q5IOf0R4shKMzd7YLvjsjaafoFh Ja3/VM2fqaQA/iSsTi6IulicfUZrOmrsBARB29a7I2C7dvVXsJYUIXINtDNMZW9uIENocmlz dG9waGVyIERpZXRyaWNoIDx0ZWNobmlrcmFkaW9AaWNsb3VkLmNvbT6IlgQTFggAPhYhBEHj QBQZW7IYf8lgvd6i9X1IH3T1BQJa0dVCAhsDBQkJZgGABQsJCAcCBhUKCQgLAgQWAgMBAh4B AheAAAoJEN6i9X1IH3T1njsBALkJwsUpZ9rAwoS4EdByW7dPk+UoOQnSa3YRNQMzQQdqAP4z MPYG+Q2S9KYlJ/F785Ua2pQwbdt1eaOtwfj0xnKPBrg4BFrR1IISCisGAQQBl1UBBQEBB0D/ 8vFbITqE8nmVs/ukO84/qT1Il704fgCKrnWszPCeDQMBCAeIfgQYFggAJhYhBEHjQBQZW7IY f8lgvd6i9X1IH3T1BQJa0dSCAhsMBQkJZgGAAAoJEN6i9X1IH3T1BAgBAL1ysO9CDYw6lbVU gmHILJB7KRuozhFGg7NcJcBPXdbzAQC6oylZ9aOafxOgEWVwKgxw+VRHAMUwVxBUdpqTqY7F BQ== Message-ID: Date: Sun, 17 Mar 2019 13:55:54 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.5.3 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="dYFVrKIm1ML27l0odzmz5toF01vcN9PtV" X-Rspamd-Queue-Id: E9B5A76D6B X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-3.49 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; HAS_ATTACHMENT(0.00)[]; TO_DN_NONE(0.00)[]; MX_GOOD(-0.01)[mail.chaotikum.net]; SIGNED_PGP(-2.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[53.81.144.212.zen.spamhaus.org : 127.0.0.11]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE]; MIME_TRACE(0.00)[0:+,1:+,2:+]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.20)[multipart/signed,multipart/mixed,text/plain]; IP_SCORE(-0.83)[ipnet: 2a01:4f8::/29(-2.17), asn: 24940(-1.95), country: DE(-0.01)]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; DMARC_NA(0.00)[chaotikum.org]; NEURAL_SPAM_SHORT(0.55)[0.550,0]; RCVD_IN_DNSWL_NONE(0.00)[9.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.7.6.0.3.0.6.1.0.8.f.4.0.1.0.a.2.list.dnswl.org : 127.0.10.0]; R_SPF_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 17 Mar 2019 12:56:12 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --dYFVrKIm1ML27l0odzmz5toF01vcN9PtV Content-Type: multipart/mixed; boundary="hxwAqwS7SRTx0VeRq06LOigSYcyON2e1W"; protected-headers="v1" From: Leon Christopher Dietrich To: freebsd-stable@freebsd.org Message-ID: Subject: Re: hw.vga.acpi_ignore_no_vga=1 for installation media References: In-Reply-To: --hxwAqwS7SRTx0VeRq06LOigSYcyON2e1W Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Content-Language: en-US Sound's like solid idea. A lot of systems out there lack propper ACPI description for VGA and it would definitly make the installation on such a system much more easy. As far as I can tell it doesn't seam to break other things and even low power system without VGA (like a pcengines apu2) don't seam to suffer. On 17.03.19 13:00, FreeBSD-stable-request@freebsd.org wrote: > Date: Sun, 17 Mar 2019 02:59:12 +0700 > From: Eugene Grosbein > To: FreeBSD stable > Subject: hw.vga.acpi_ignore_no_vga=3D1 for installation media > Message-ID: <912fc95d-5a5e-012b-7385-0f43f50dca65@grosbein.net> > Content-Type: text/plain; charset=3Dkoi8-r > > Hi! > > Since 11.2-RELESE, default console driver vt(4) checks ACPI table for p= resence of VGA in the system. > It does not initialize console (no input, no output) if ACPI states the= re is no VGA adapter. > > There are PRs describing many cases when VGA is present but ACPI lies > and we have a regression compared with 11.1 and earlier: > FreeBSD cannot be installed interactively onto such a system, leaving a= side serial console. > > vt(4) has loader knob to restore pre-11.2 behaviour and ignore ACPI: > > hw.vga.acpi_ignore_no_vga=3D1 > > Should we add this unconditionally to the installation media designed f= or interactive VGA-based installation? > > > ------------------------------ > --hxwAqwS7SRTx0VeRq06LOigSYcyON2e1W-- --dYFVrKIm1ML27l0odzmz5toF01vcN9PtV Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iHUEARYIAB0WIQRB40AUGVuyGH/JYL3eovV9SB909QUCXI5D3gAKCRDeovV9SB90 9bICAQCPpL1lqiLvy1PWE9zD6J5/mI7EULEMxbQF9f1ID2K1PgEAzVs5wKXrC377 iCiwpv/6NQO1JAflS/m99bqOa5PD9g4= =RQrp -----END PGP SIGNATURE----- --dYFVrKIm1ML27l0odzmz5toF01vcN9PtV-- From owner-freebsd-stable@freebsd.org Sun Mar 17 15:00:01 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 89889153DFE8 for ; Sun, 17 Mar 2019 15:00:01 +0000 (UTC) (envelope-from karl@denninger.net) Received: from colo1.denninger.net (colo1.denninger.net [104.236.120.189]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 82AE4834FF for ; Sun, 17 Mar 2019 15:00:00 +0000 (UTC) (envelope-from karl@denninger.net) Received: from denninger.net (ip68-1-57-197.pn.at.cox.net [68.1.57.197]) by colo1.denninger.net (Postfix) with ESMTP id 75C232110A3 for ; Sun, 17 Mar 2019 10:58:53 -0400 (EDT) Received: from [192.168.10.20] (D10.Denninger.Net [192.168.10.20]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by denninger.net (Postfix) with ESMTPSA id 038F6C26B4 for ; Sun, 17 Mar 2019 09:58:53 -0500 (CDT) To: freebsd-stable@freebsd.org From: Karl Denninger Subject: Observations from a ZFS reorganization on 12-STABLE Openpgp: preference=signencrypt Autocrypt: addr=karl@denninger.net; prefer-encrypt=mutual; keydata= mQINBFIX1zsBEADRcJfsQUl9oFeoMfLPJ1kql+3sIaYx0MfJAUhV9LnbWxr0fsWCskM1O4cV tHm5dqPkuPM4Ztc0jLotD1i9ubWvCHOlkLGxFOL+pFbjA+XZ7VKsC/xWmhMwJ3cM8HavK2OV SzEWQ/AEYtMi04IzGSwsxh/5/5R0mPHrsIomV5SbuiI0vjLuDj7fo6146AABI1ULzge4hBYW i/SHrqUrLORmUNBs6bxek79/B0Dzk5cIktD3LOfbT9EAa5J/osVkstMBhToJgQttaMIGv8SG CzpR/HwEokE+7DP+k2mLHnLj6H3kfugOF9pJH8Za4yFmw//s9cPXV8WwtZ2SKfVzn1unpKqf wmJ1PwJoom/d4fGvQDkgkGKRa6RGC6tPmXnqnx+YX4iCOdFfbP8L9rmk2sewDDVzHDU3I3ZZ 8hFIjMYM/QXXYszRatK0LCV0QPZuF7LCf4uQVKw1/oyJInsnH7+6a3c0h21x+CmSja9QJ+y0 yzgEN/nM89d6YTakfR+1xkYgodVmMy/bS8kmXbUUZG/CyeqCqc95RUySjKT2ECrf9GhhoQkl +D8n2MsrAUSMGB4GQSN+TIq9OBTpNuvATGSRuF9wnQcs1iSry+JNCpfRTyWp83uCNApe6oHU EET4Et6KDO3AvjvBMAX0TInTRGW2SQlJMuFKpc7Dg7tHK8zzqQARAQABtCNLYXJsIERlbm5p bmdlciA8a2FybEBkZW5uaW5nZXIubmV0PokCPAQTAQIAJgUCUhfXOwIbIwUJCWYBgAYLCQgH AwIEFQIIAwQWAgMBAh4BAheAAAoJEG6/sivc5s0PLxQP/i6x/QFx9G4Cw7C+LthhLXIm7NSH AtNbz2UjySEx2qkoQQjtsK6mcpEEaky4ky6t8gz0/SifIfJmSmyAx0UhUQ0WBv1vAXwtNrQQ jJd9Bj6l4c2083WaXyHPjt2u2Na6YFowyb4SaQb83hu/Zs25vkPQYJVVE0JX409MFVPUa6E3 zFbd1OTr3T4yNUy4gNeQZfzDqDS8slbIks2sXeoJrZ6qqXVI0ionoivOlaN4T6Q0UYyXtigj dQvvhMt0aNowKFjRqrmSDRpdz+o6yg7Mp7qEZ1V6EZk8KqQTH6htpCTQ8i79ttK4LG6bstSF Re6Fwq52nbrcANrcdmtZXqjo+SGbUqJ8b1ggrxAsJ5MEhRh2peKrCgI/TjQo+ZxfnqEoR4AI 46Cyiz+/lcVvlvmf2iPifS3EEdaH3Itfwt7MxFm6mQORYs6skHDw3tOYB2/AdCW6eRVYs2hB RMAG4uwApZfZDKgRoE95PJmQjeTBiGmRPcsQZtNESe7I7EjHtCDLwtJqvD4HkDDQwpzreT6W XkyIJ7ns7zDfA1E+AQhFR6rsTFGgQZRZKsVeov3SbhYKkCnVDCvb/PKQCAGkSZM9SvYG5Yax 8CMry3AefKktf9fqBFg8pWqtVxDwJr56dhi0GHXRu3jVI995rMGo1fLUG5fSxiZ8L5sAtokh 9WFmQpyl Message-ID: <58eb1994-41bd-cd22-be66-0024bcbc36e6@denninger.net> Date: Sun, 17 Mar 2019 09:58:52 -0500 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.5.3 MIME-Version: 1.0 Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-512; boundary="------------ms020602020202040801080604" X-Rspamd-Queue-Id: 82AE4834FF X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.17 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; HAS_ATTACHMENT(0.00)[]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; MX_GOOD(-0.01)[px.denninger.net]; NEURAL_HAM_SHORT(-0.64)[-0.644,0]; RECEIVED_SPAMHAUS_PBL(0.00)[197.57.1.68.zen.spamhaus.org : 127.0.0.11]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:14061, ipnet:104.236.64.0/18, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:+]; MID_RHS_MATCH_FROM(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; SIGNED_SMIME(-2.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.20)[multipart/signed,multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; IP_SCORE(-2.32)[ip: (-9.88), ipnet: 104.236.64.0/18(-3.85), asn: 14061(2.21), country: US(-0.07)]; DMARC_NA(0.00)[denninger.net]; R_SPF_NA(0.00)[] X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 17 Mar 2019 15:00:01 -0000 This is a cryptographically signed message in MIME format. --------------ms020602020202040801080604 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable I've long argued that the VM system's interaction with ZFS' arc cache and UMA has serious, even severe issues.=C2=A0 12.x appeared to have addressed some of them, and as such I've yet to roll forward any part of the patch series that is found here [ https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D187594 ] or the Phabricator version referenced in the bug thread (which is more-complex and attempts to dig at the root of the issue more effectively, particularly when UMA is involved as it usually is.) Yesterday I decided to perform a fairly significant reorganization of the ZFS pools on one of my personal machines, including the root pool which was on mirrored SSDs, changing to a Raidz2 (also on SSDs.)=C2=A0 Th= is of course required booting single-user from a 12-Stable memstick. A simple "zfs send -R zs/root-save/R | zfs recv -Fuev zsr/R" should have done it, no sweat.=C2=A0 The root that was copied over before I started i= s uncomplicated; it's compressed, but not de-duped.=C2=A0 While it has snapshots on it too it's by no means complex. *The system failed to execute that command with an "out of swap space" error, killing the job; there was indeed no swap configured since I booted from a memstick.* Huh?=C2=A0 A simple *filesystem copy* managed to force a 16Gb system into= requiring page file backing store? I was able to complete the copy by temporarily adding the swap space back on (where it would be when the move was complete) but that requirement is pure insanity and it appears, from what I was able to determine, that it came about from the same root cause that's been plaguing VM/ZFS interaction since 2014 when I started work this issue -- specifically, when RAM gets low rather than evict ARC (or clean up UMA that is allocated but unused) the system will attempt to page out working set.=C2=A0 In this case since it couldn't page out working set si= nce there was nowhere to page it to the process involved got an OOM error and was terminated. *I continue to argue that this decision is ALWAYS wrong.* It's wrong because if you invalidate cache and reclaim it you *might* take a read from physical I/O to replace that data back into the cache in the future (since it's not in RAM) but in exchange for a *potential* I/O you perform a GUARANTEED physical I/O (to page out some amount of working set) and possibly TWO physical I/Os (to page said working set out and, later, page it back in.) It has always appeared to me to be flat-out nonsensical to trade a possible physical I/O (if there is a future cache miss) for a guaranteed physical I/O and a possible second one.=C2=A0 It's even worse if the reas= on you make that decision is that UMA is allocated but unused; in that case you are paging when no physical I/O is required at all as the "memory pressure" is a phantom!=C2=A0 While UMA is a very material performance wi= n in the general case to allow allocated-but-unused UMA to force paging, from a performance perspective, appears to be flat-out insanity.=C2=A0 I find = it very difficult to come up with any reasonable scenario where releasing allocated-but-unused UMA rather than paging out working set is a net performance loser. In this case since the system was running in single user mode the process that got selected to be destroyed when that circumstance arose and there was no available swap was the copy process itself.=C2=A0 The co= py itself did not require anywhere near all of the available non-kernel RAM.= I'm going to dig into this further but IMHO the base issue still exists, even though the impact of it for my workloads with everything "running normally" has materially decreased with 12.x. --=20 Karl Denninger karl@denninger.net /The Market Ticker/ /[S/MIME encrypted email preferred]/ --------------ms020602020202040801080604 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC DdgwggagMIIEiKADAgECAhMA5EiKghDOXrvfxYxjITXYDdhIMA0GCSqGSIb3DQEBCwUAMIGL MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJTmljZXZpbGxlMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExITAf BgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQTAeFw0xNzA4MTcxNjQyMTdaFw0yNzA4 MTUxNjQyMTdaMHsxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkwFwYDVQQKDBBD dWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExJTAjBgNVBAMMHEN1 ZGEgU3lzdGVtcyBMTEMgMjAxNyBJbnQgQ0EwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIK AoICAQC1aJotNUI+W4jP7xQDO8L/b4XiF4Rss9O0B+3vMH7Njk85fZ052QhZpMVlpaaO+sCI KqG3oNEbuOHzJB/NDJFnqh7ijBwhdWutdsq23Ux6TvxgakyMPpT6TRNEJzcBVQA0kpby1DVD 0EKSK/FrWWBiFmSxg7qUfmIq/mMzgE6epHktyRM3OGq3dbRdOUgfumWrqHXOrdJz06xE9NzY vc9toqZnd79FUtE/nSZVm1VS3Grq7RKV65onvX3QOW4W1ldEHwggaZxgWGNiR/D4eosAGFxn uYeWlKEC70c99Mp1giWux+7ur6hc2E+AaTGh+fGeijO5q40OGd+dNMgK8Es0nDRw81lRcl24 SWUEky9y8DArgIFlRd6d3ZYwgc1DMTWkTavx3ZpASp5TWih6yI8ACwboTvlUYeooMsPtNa9E 6UQ1nt7VEi5syjxnDltbEFoLYcXBcqhRhFETJe9CdenItAHAtOya3w5+fmC2j/xJz29og1KH YqWHlo3Kswi9G77an+zh6nWkMuHs+03DU8DaOEWzZEav3lVD4u76bKRDTbhh0bMAk4eXriGL h4MUoX3Imfcr6JoyheVrAdHDL/BixbMH1UUspeRuqQMQ5b2T6pabXP0oOB4FqldWiDgJBGRd zWLgCYG8wPGJGYgHibl5rFiI5Ix3FQncipc6SdUzOQIDAQABo4IBCjCCAQYwHQYDVR0OBBYE FF3AXsKnjdPND5+bxVECGKtc047PMIHABgNVHSMEgbgwgbWAFBu1oRhUMNEzjODolDka5k4Q EDBioYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJ TmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5 c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYIJAKxAy1WBo2kY MBIGA1UdEwEB/wQIMAYBAf8CAQAwDgYDVR0PAQH/BAQDAgGGMA0GCSqGSIb3DQEBCwUAA4IC AQCB5686UCBVIT52jO3sz9pKuhxuC2npi8ZvoBwt/IH9piPA15/CGF1XeXUdu2qmhOjHkVLN gO7XB1G8CuluxofOIUce0aZGyB+vZ1ylHXlMeB0R82f5dz3/T7RQso55Y2Vog2Zb7PYTC5B9 oNy3ylsnNLzanYlcW3AAfzZcbxYuAdnuq0Im3EpGm8DoItUcf1pDezugKm/yKtNtY6sDyENj tExZ377cYA3IdIwqn1Mh4OAT/Rmh8au2rZAo0+bMYBy9C11Ex0hQ8zWcvPZBDn4v4RtO8g+K uQZQcJnO09LJNtw94W3d2mj4a7XrsKMnZKvm6W9BJIQ4Nmht4wXAtPQ1xA+QpxPTmsGAU0Cv HmqVC7XC3qxFhaOrD2dsvOAK6Sn3MEpH/YrfYCX7a7cz5zW3DsJQ6o3pYfnnQz+hnwLlz4MK 17NIA0WOdAF9IbtQqarf44+PEyUbKtz1r0KGeGLs+VGdd2FLA0e7yuzxJDYcaBTVwqaHhU2/ Fna/jGU7BhrKHtJbb/XlLeFJ24yvuiYKpYWQSSyZu1R/gvZjHeGb344jGBsZdCDrdxtQQcVA 6OxsMAPSUPMrlg9LWELEEYnVulQJerWxpUecGH92O06wwmPgykkz//UmmgjVSh7ErNvL0lUY UMfunYVO/O5hwhW+P4gviCXzBFeTtDZH259O7TCCBzAwggUYoAMCAQICEwCg0WvVwekjGFiO 62SckFwepz0wDQYJKoZIhvcNAQELBQAwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3Jp ZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBD QTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExMQyAyMDE3IEludCBDQTAeFw0xNzA4MTcyMTIx MjBaFw0yMjA4MTYyMTIxMjBaMFcxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRswGQYDVQQDDBJrYXJsQGRlbm5pbmdlci5uZXQw ggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIKAoICAQC+HVSyxVtJhy3Ohs+PAGRuO//Dha9A 16l5FPATr6wude9zjX5f2lrkRyU8vhCXTZW7WbvWZKpcZ8r0dtZmiK9uF58Ec6hhvfkxJzbg 96WHBw5Fumd5ahZzuCJDtCAWW8R7/KN+zwzQf1+B3MVLmbaXAFBuKzySKhKMcHbK3/wjUYTg y+3UK6v2SBrowvkUBC+jxNg3Wy12GsTXcUS/8FYIXgVVPgfZZrbJJb5HWOQpvvhILpPCD3xs YJFNKEPltXKWHT7Qtc2HNqikgNwj8oqOb+PeZGMiWapsatKm8mxuOOGOEBhAoTVTwUHlMNTg 6QUCJtuWFCK38qOCyk9Haj+86lUU8RG6FkRXWgMbNQm1mWREQhw3axgGLSntjjnznJr5vsvX SYR6c+XKLd5KQZcS6LL8FHYNjqVKHBYM+hDnrTZMqa20JLAF1YagutDiMRURU23iWS7bA9tM cXcqkclTSDtFtxahRifXRI7Epq2GSKuEXe/1Tfb5CE8QsbCpGsfSwv2tZ/SpqVG08MdRiXxN 5tmZiQWo15IyWoeKOXl/hKxA9KPuDHngXX022b1ly+5ZOZbxBAZZMod4y4b4FiRUhRI97r9l CxsP/EPHuuTIZ82BYhrhbtab8HuRo2ofne2TfAWY2BlA7ExM8XShMd9bRPZrNTokPQPUCWCg CdIATQIDAQABo4IBzzCCAcswPAYIKwYBBQUHAQEEMDAuMCwGCCsGAQUFBzABhiBodHRwOi8v b2NzcC5jdWRhc3lzdGVtcy5uZXQ6ODg4ODAJBgNVHRMEAjAAMBEGCWCGSAGG+EIBAQQEAwIF oDAOBgNVHQ8BAf8EBAMCBeAwHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMEMDMGCWCG SAGG+EIBDQQmFiRPcGVuU1NMIEdlbmVyYXRlZCBDbGllbnQgQ2VydGlmaWNhdGUwHQYDVR0O BBYEFLElmNWeVgsBPe7O8NiBzjvjYnpRMIHKBgNVHSMEgcIwgb+AFF3AXsKnjdPND5+bxVEC GKtc047PoYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UE BwwJTmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRh IFN5c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYITAORIioIQ zl6738WMYyE12A3YSDAdBgNVHREEFjAUgRJrYXJsQGRlbm5pbmdlci5uZXQwDQYJKoZIhvcN AQELBQADggIBAJXboPFBMLMtaiUt4KEtJCXlHO/3ZzIUIw/eobWFMdhe7M4+0u3te0sr77QR dcPKR0UeHffvpth2Mb3h28WfN0FmJmLwJk+pOx4u6uO3O0E1jNXoKh8fVcL4KU79oEQyYkbu 2HwbXBU9HbldPOOZDnPLi0whi/sbFHdyd4/w/NmnPgzAsQNZ2BYT9uBNr+jZw4SsluQzXG1X lFL/qCBoi1N2mqKPIepfGYF6drbr1RnXEJJsuD+NILLooTNf7PMgHPZ4VSWQXLNeFfygoOOK FiO0qfxPKpDMA+FHa8yNjAJZAgdJX5Mm1kbqipvb+r/H1UAmrzGMbhmf1gConsT5f8KU4n3Q IM2sOpTQe7BoVKlQM/fpQi6aBzu67M1iF1WtODpa5QUPvj1etaK+R3eYBzi4DIbCIWst8MdA 1+fEeKJFvMEZQONpkCwrJ+tJEuGQmjoQZgK1HeloepF0WDcviiho5FlgtAij+iBPtwMuuLiL shAXA5afMX1hYM4l11JXntle12EQFP1r6wOUkpOdxceCcMVDEJBBCHW2ZmdEaXgAm1VU+fnQ qS/wNw/S0X3RJT1qjr5uVlp2Y0auG/eG0jy6TT0KzTJeR9tLSDXprYkN2l/Qf7/nT6Q03qyE QnnKiBXWAZXveafyU/zYa7t3PTWFQGgWoC4w6XqgPo4KV44OMYIFBzCCBQMCAQEwgZIwezEL MAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBM TEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExM QyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTANBglghkgBZQMEAgMFAKCCAkUw GAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMTkwMzE3MTQ1ODUy WjBPBgkqhkiG9w0BCQQxQgRA1Hbp7Lq00nbsTPSM58W2vssmS/Lu4m5rbhg/Q/XVJqgYEiQ4 XEjgZKH1aw9WyoOOSbH4FZKzie7XBPMM6jQDBTBsBgkqhkiG9w0BCQ8xXzBdMAsGCWCGSAFl AwQBKjALBglghkgBZQMEAQIwCgYIKoZIhvcNAwcwDgYIKoZIhvcNAwICAgCAMA0GCCqGSIb3 DQMCAgFAMAcGBSsOAwIHMA0GCCqGSIb3DQMCAgEoMIGjBgkrBgEEAYI3EAQxgZUwgZIwezEL MAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBM TEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExM QyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTCBpQYLKoZIhvcNAQkQAgsxgZWg gZIwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lz dGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0 ZW1zIExMQyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTANBgkqhkiG9w0BAQEF AASCAgA5zkDs51DPi/+B/Y0u2J7KnEA1ERUF9oexczq/lEYbTJlOxTdoUv0aAkuavEf2xfLi 9AadsywtM0BkWnOmIaR1NJdOiWye/n6oIvk/XhYk60yK+rkLZR5CojX20sOkOdEOobVnMsUm EA2nBTWPjT9XdeVgrwQrWvs7fza4tXsSm1238dtYX03ZWjRlyAtwVosSG4z42so7trCiVsLC j2QHl9RbC0RMwWTFZLlpT+c1n5Jx+ims4aMxAM5E6n3EfaqzlSIMXp9D+65XW/eFRcrg1aRy ujfYlOoU6PRQWNddAsut81I7gn2jNOVh7F9fEwb2hPhNS6ygoNW0JI6dOsLpZtuYELkRzDhc FvOPza78SIcAU/jLMWA8g+YB18t1MufqJgT3xEyFErcGHgoh5HQdWhHRnQu2ftC3nyF7WU0r r/75XM95p6qTh2u/bc1yfJ+i6WjAD1VFVvj8v/fvMhA60RgcPIjEzUlGnt8BEbrX5TElk3im grumWb2EUg3APkNcWu7qez2gvX41HfSFKZ1ol/Fjn9w8G79hdb8jV5c30cei6csGUZAVcFJG VhQwIhQ9LLoLJtIQ1vKrOPvSMogkGs/m2RhSKRDJMEcRcUNqfgvjBH6bDfSL+9HLmi2LVOS3 KqWpf4rgPr7ENGEr6EPJ4h84uOH3+FRkTInWz6j+NAAAAAAAAA== --------------ms020602020202040801080604-- From owner-freebsd-stable@freebsd.org Sun Mar 17 15:49:04 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 36052153FDF0 for ; Sun, 17 Mar 2019 15:49:04 +0000 (UTC) (envelope-from rainer@ultra-secure.de) Received: from connect.ultra-secure.de (connect.ultra-secure.de [88.198.71.201]) by mx1.freebsd.org (Postfix) with ESMTP id 6597985243 for ; Sun, 17 Mar 2019 15:49:02 +0000 (UTC) (envelope-from rainer@ultra-secure.de) Received: (Haraka outbound); Sun, 17 Mar 2019 16:46:55 +0100 Received-SPF: None (connect.ultra-secure.de: domain of ultra-secure.de does not designate 217.71.83.52 as permitted sender) receiver=connect.ultra-secure.de; identity=mailfrom; client-ip=217.71.83.52; helo=[192.168.1.201]; envelope-from= Received: from [192.168.1.201] (217-071-083-052.ip-tech.ch [217.71.83.52]) by connect.ultra-secure.de (Haraka/2.6.2-toaster) with ESMTPSA id 216E1225-DAA4-40A5-8826-70EF8E6A40AD.1 envelope-from (authenticated bits=0) (version=TLSv1/SSLv3 cipher=AES256-GCM-SHA384 verify=NO); Sun, 17 Mar 2019 16:46:48 +0100 From: Rainer Duffner Message-Id: <86C7CA40-EBB4-498E-BFD9-34187DBE1323@ultra-secure.de> Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: Observations from a ZFS reorganization on 12-STABLE Date: Sun, 17 Mar 2019 16:48:45 +0100 In-Reply-To: <58eb1994-41bd-cd22-be66-0024bcbc36e6@denninger.net> Cc: freebsd-stable@freebsd.org To: Karl Denninger References: <58eb1994-41bd-cd22-be66-0024bcbc36e6@denninger.net> X-Mailer: Apple Mail (2.3445.102.3) X-Haraka-GeoIP: EU, CH, 451km X-Haraka-ASN: 24951 X-Haraka-GeoIP-Received: X-Haraka-ASN: 24951 217.71.80.0/20 X-Haraka-ASN-CYMRU: asn=24951 net=217.71.80.0/20 country=CH assignor=ripencc date=2003-08-07 X-Haraka-FCrDNS: 217-071-083-052.ip-tech.ch X-Haraka-p0f: os="Mac OS X " link_type="DSL" distance=14 total_conn=8 shared_ip=N X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on spamassassin X-Spam-Level: X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00, HTML_MESSAGE,URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.1 X-Haraka-Karma: score: 6, good: 8739, bad: 6, connections: 9487, history: 8733, asn_score: 253, asn_connections: 270, asn_good: 253, asn_bad: 0, pass:asn, asn_all_good, relaying X-Rspamd-Queue-Id: 6597985243 X-Spamd-Bar: + Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [1.61 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_HAM_MEDIUM(-0.81)[-0.814,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; NEURAL_HAM_LONG(-0.47)[-0.467,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; DMARC_NA(0.00)[ultra-secure.de]; AUTH_NA(1.00)[]; URI_COUNT_ODD(1.00)[3]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_SPAM_SHORT(0.67)[0.672,0]; MX_GOOD(-0.01)[connect.ultra-secure.de]; RCPT_COUNT_TWO(0.00)[2]; R_SPF_NA(0.00)[]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; ASN(0.00)[asn:24940, ipnet:88.198.0.0/16, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; IP_SCORE(-0.27)[ipnet: 88.198.0.0/16(0.63), asn: 24940(-1.95), country: DE(-0.01)] Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 17 Mar 2019 15:49:04 -0000 > Am 17.03.2019 um 15:58 schrieb Karl Denninger : >=20 > I've long argued that the VM system's interaction with ZFS' arc cache > and UMA has serious, even severe issues. 12.x appeared to have > addressed some of them, and as such I've yet to roll forward any part = of > the patch series that is found here [ > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D187594 = ] or the > Phabricator version referenced in the bug thread (which is = more-complex > and attempts to dig at the root of the issue more effectively, > particularly when UMA is involved as it usually is.) >=20 > Yesterday I decided to perform a fairly significant reorganization of > the ZFS pools on one of my personal machines, including the root pool > which was on mirrored SSDs, changing to a Raidz2 (also on SSDs.) This > of course required booting single-user from a 12-Stable memstick. Interesting. The patches published before Christmas 2018 solved all of the problems I = had (shared by many others, probably also visible on the FreeBSD = project=E2=80=99s own infrastructure) with 11.2 and 12.0 I run a decently sized syslog-server and the 25MB/s stream of = syslog-data was killing 11.2 almost instantly. I have a few 11.2 systems that I haven=E2=80=99t patched yet - but they = have north of 128GB of RAM and ARC had been configured down to 70% long = before that - so I never saw the issue there. From owner-freebsd-stable@freebsd.org Sun Mar 17 16:10:59 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CA86B1540B50 for ; Sun, 17 Mar 2019 16:10:59 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-qt1-x829.google.com (mail-qt1-x829.google.com [IPv6:2607:f8b0:4864:20::829]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DB2B85DEA for ; Sun, 17 Mar 2019 16:10:58 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-qt1-x829.google.com with SMTP id v32so15329464qtc.10 for ; Sun, 17 Mar 2019 09:10:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=cXcsoydXs6YQzsiGnlfqdFvF7rRnpbkI7OgvYjaEyMg=; b=AwVKMZDI/8cDTDV3LavXCV1aFp7p5zcnst92jkVxcwfHfKTQuEL7hHKKegnR2RFYt9 Ll/bbUpQxjWpADgHxmIcDSht0iVe+feQKg7NEc/J+RIqZuDB5pIGMx8i/berPES24tDa RzB4QMv7YzxGEqIET8dcxTjxosqV62BVFwdRpwZd5Wa2OSdMHr5EOPrSqa1KGcwZpWx4 gAkMl5aqC4MljC88RsKXFqSvJMiKMZlHDkYkGJa09jvytPGH6qtupLOL5w+NseZZvpEx Q9ygYUAq1NXvQraCTaydg1NGqmO2j53RcTxjymMN3uS+cSo7IQYsOGLWHeuzu418db0i 3l2A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=cXcsoydXs6YQzsiGnlfqdFvF7rRnpbkI7OgvYjaEyMg=; b=SLSMIKjuSRSKKtwWqnJpzt5R6sA61MKxWZ05Y4G55W6FrZqdBZuGrgq5GqShxnU+Oo A3Cy46p2Z9IQF+DEstwbg5ATfw7bip/pHfsI6uNSziJE3vHcqE9VyZCzY5GdQ5QdvCwe VXdbvFk4YSsy+A2gzoZ1u+F9y09Yy8CXqKAJWKB6UefbbZkbbc0wh8wKhDzVlAu6ouH6 AFcK0mQYbB1au6r/i7hZl+baspeOQCqqDgYWI09ZI1EvzMB0RR8SUd3MUDq/lNod50Nm /OvDGq8k5hKUIdF7uJubeCiQpia7V9E4TQLPYfsdxUrdxT9wtAsIKuy9GvfVqEVp5/K9 FPxg== X-Gm-Message-State: APjAAAWMRL+ywE/+FbzfsMUYOAkjgCmB/dG697H1BTjwoEwGzOQbWqJn gksWEDinFlAhGo+VcRaNXnXY851/PbMMbFdAp3FwgQ== X-Google-Smtp-Source: APXvYqwgQPF8e4LPRFgAYKqa7cTgcnV7doOUdnGB63tliYAEEs+EyG5wDueXYIZq7PRfrm2VTDp4N2phCJmZDD60cBo= X-Received: by 2002:ac8:304a:: with SMTP id g10mr4449016qte.118.1552839057375; Sun, 17 Mar 2019 09:10:57 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Warner Losh Date: Sun, 17 Mar 2019 10:10:45 -0600 Message-ID: Subject: Re: hw.vga.acpi_ignore_no_vga=1 for installation media To: Leon Christopher Dietrich Cc: FreeBSD-STABLE Mailing List X-Rspamd-Queue-Id: 4DB2B85DEA X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20150623.gappssmtp.com header.s=20150623 header.b=AwVKMZDI X-Spamd-Result: default: False [-5.68 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.997,0]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20150623.gappssmtp.com:s=20150623]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_SHORT(-0.94)[-0.940,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: ALT1.aspmx.l.google.com]; DKIM_TRACE(0.00)[bsdimp-com.20150623.gappssmtp.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[9.2.8.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; R_SPF_NA(0.00)[]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; MIME_TRACE(0.00)[0:+,1:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; IP_SCORE(-2.74)[ip: (-8.79), ipnet: 2607:f8b0::/32(-2.74), asn: 15169(-2.09), country: US(-0.07)]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 17 Mar 2019 16:11:00 -0000 I generally like this idea... But two caveats... First, we'd need to update the docs so that folks doing serial installs can unset it.... Though serial installs are a weird beast.... Second, if it's really needed, we should have the installer generate it. alas, only vt can tell us that, but it should be easy to add a sysctl to it that says that it has done video by ignoring the absence of the vga node... Warner On Sun, Mar 17, 2019 at 6:58 AM Leon Christopher Dietrich < doralitze@chaotikum.org> wrote: > Sound's like solid idea. > > A lot of systems out there lack propper ACPI description for VGA and it > would definitly make the installation on such a system much more easy. > > As far as I can tell it doesn't seam to break other things and even low > power system without VGA (like a pcengines apu2) don't seam to suffer. > > On 17.03.19 13:00, FreeBSD-stable-request@freebsd.org wrote: > > Date: Sun, 17 Mar 2019 02:59:12 +0700 > > From: Eugene Grosbein > > To: FreeBSD stable > > Subject: hw.vga.acpi_ignore_no_vga=1 for installation media > > Message-ID: <912fc95d-5a5e-012b-7385-0f43f50dca65@grosbein.net> > > Content-Type: text/plain; charset=koi8-r > > > > Hi! > > > > Since 11.2-RELESE, default console driver vt(4) checks ACPI table for > presence of VGA in the system. > > It does not initialize console (no input, no output) if ACPI states > there is no VGA adapter. > > > > There are PRs describing many cases when VGA is present but ACPI lies > > and we have a regression compared with 11.1 and earlier: > > FreeBSD cannot be installed interactively onto such a system, leaving > aside serial console. > > > > vt(4) has loader knob to restore pre-11.2 behaviour and ignore ACPI: > > > > hw.vga.acpi_ignore_no_vga=1 > > > > Should we add this unconditionally to the installation media designed > for interactive VGA-based installation? > > > > > > ------------------------------ > > > > From owner-freebsd-stable@freebsd.org Sun Mar 17 17:34:31 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 85AA91544786 for ; Sun, 17 Mar 2019 17:34:31 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B2C0388F96 for ; Sun, 17 Mar 2019 17:34:30 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.15.2/8.15.2) with ESMTPS id x2HHYL6T048868 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Sun, 17 Mar 2019 19:34:24 +0200 (EET) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua x2HHYL6T048868 Received: (from kostik@localhost) by tom.home (8.15.2/8.15.2/Submit) id x2HHYLmI048867; Sun, 17 Mar 2019 19:34:21 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Sun, 17 Mar 2019 19:34:21 +0200 From: Konstantin Belousov To: Warner Losh Cc: Leon Christopher Dietrich , FreeBSD-STABLE Mailing List Subject: Re: hw.vga.acpi_ignore_no_vga=1 for installation media Message-ID: <20190317173421.GN96870@kib.kiev.ua> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.11.3 (2019-02-01) X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FORGED_GMAIL_RCVD,FREEMAIL_FROM, NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on tom.home X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 17 Mar 2019 17:34:31 -0000 On Sun, Mar 17, 2019 at 10:10:45AM -0600, Warner Losh wrote: > I generally like this idea... But two caveats... > > First, we'd need to update the docs so that folks doing serial installs can > unset it.... Though serial installs are a weird beast.... > Second, if it's really needed, we should have the installer generate it. > alas, only vt can tell us that, but it should be easy to add a sysctl to it > that says that it has done video by ignoring the absence of the vga node... It is not about VGA node (what is that ?). It is about ignoring FACP flag IAPC_BOOT_ARCH={NO_VGA}, and there are machines which actually break when trying to access VGA hardware despite the flag is set. Can anybody provide an example of machine where the flag is set but VGA works ? For me, it is set on headless NUC when there is no monitor attached, and then BIOS does not configure framebuffer at all. So the proposal is about reversing the set of broken machines, but only in installer ? In other words, if it worked for installer, the installed system would be broken (again) ? > > Warner > > On Sun, Mar 17, 2019 at 6:58 AM Leon Christopher Dietrich < > doralitze@chaotikum.org> wrote: > > > Sound's like solid idea. > > > > A lot of systems out there lack propper ACPI description for VGA and it > > would definitly make the installation on such a system much more easy. > > > > As far as I can tell it doesn't seam to break other things and even low > > power system without VGA (like a pcengines apu2) don't seam to suffer. What apu2 reports in FACP flags ? Do acpidump -dt | grep IAPC_BOOT_ARCH > > > > On 17.03.19 13:00, FreeBSD-stable-request@freebsd.org wrote: > > > Date: Sun, 17 Mar 2019 02:59:12 +0700 > > > From: Eugene Grosbein > > > To: FreeBSD stable > > > Subject: hw.vga.acpi_ignore_no_vga=1 for installation media > > > Message-ID: <912fc95d-5a5e-012b-7385-0f43f50dca65@grosbein.net> > > > Content-Type: text/plain; charset=koi8-r > > > > > > Hi! > > > > > > Since 11.2-RELESE, default console driver vt(4) checks ACPI table for > > presence of VGA in the system. > > > It does not initialize console (no input, no output) if ACPI states > > there is no VGA adapter. > > > > > > There are PRs describing many cases when VGA is present but ACPI lies > > > and we have a regression compared with 11.1 and earlier: > > > FreeBSD cannot be installed interactively onto such a system, leaving > > aside serial console. > > > > > > vt(4) has loader knob to restore pre-11.2 behaviour and ignore ACPI: > > > > > > hw.vga.acpi_ignore_no_vga=1 > > > > > > Should we add this unconditionally to the installation media designed > > for interactive VGA-based installation? > > > > > > > > > ------------------------------ > > > > > > > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@freebsd.org Sun Mar 17 21:58:14 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3AF33154C56B for ; Sun, 17 Mar 2019 21:58:14 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [IPv6:2a01:4f8:d12:604::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CFCC92F12 for ; Sun, 17 Mar 2019 21:58:03 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (eg.sd.rdtc.ru [IPv6:2a03:3100:c:13:0:0:0:5]) by hz.grosbein.net (8.15.2/8.15.2) with ESMTPS id x2HLvocd045457 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Sun, 17 Mar 2019 22:57:53 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: karl@denninger.net Received: from [10.58.0.4] ([10.58.0.4]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTPS id x2HLvnB3067333 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT); Mon, 18 Mar 2019 04:57:49 +0700 (+07) (envelope-from eugen@grosbein.net) Subject: Re: Observations from a ZFS reorganization on 12-STABLE To: Karl Denninger , freebsd-stable@freebsd.org References: <58eb1994-41bd-cd22-be66-0024bcbc36e6@denninger.net> From: Eugene Grosbein Message-ID: Date: Mon, 18 Mar 2019 04:57:43 +0700 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: <58eb1994-41bd-cd22-be66-0024bcbc36e6@denninger.net> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM,SPF_PASS autolearn=no autolearn_force=no version=3.4.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.0 SPF_PASS SPF: sender matches SPF record * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on hz.grosbein.net X-Rspamd-Queue-Id: 4CFCC92F12 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; spf=permerror (mx1.freebsd.org: domain of eugen@grosbein.net uses mechanism not recognized by this client) smtp.mailfrom=eugen@grosbein.net X-Spamd-Result: default: False [-3.47 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; MX_INVALID(0.50)[greylisted]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[grosbein.net]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_SPF_PERMFAIL(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.71)[-0.712,0]; IP_SCORE(-1.16)[ip: (-1.65), ipnet: 2a01:4f8::/29(-2.17), asn: 24940(-1.96), country: DE(-0.01)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 17 Mar 2019 21:58:14 -0000 17.03.2019 21:58, Karl Denninger wrote: > Huh? A simple *filesystem copy* managed to force a 16Gb system into > requiring page file backing store? > > I was able to complete the copy by temporarily adding the swap space > back on (where it would be when the move was complete) but that > requirement is pure insanity and it appears, from what I was able to > determine, that it came about from the same root cause that's been > plaguing VM/ZFS interaction since 2014 when I started work this issue -- > specifically, when RAM gets low rather than evict ARC (or clean up UMA > that is allocated but unused) the system will attempt to page out > working set. In this case since it couldn't page out working set since > there was nowhere to page it to the process involved got an OOM error > and was terminated. > > *I continue to argue that this decision is ALWAYS wrong.* I agree. Recently I've found kind-of-workaround for this problem: increase vm.v_free_min so when "FREE" memory goes low, page daemon wakes earlier and shrinks UMA (and ZFS ARC too) moving some memory from WIRED to FREE quick enough so it can be re-used before bad things happen. But avoid increasing vm.v_free_min too much (e.g. over 1/4 of total RAM) because kernel may start behaving strange. For 16Gb system it should be enough to raise vm.v_free_min upto 262144 (1GB) or 131072 (512M). This is not permanent solution in any way but it really helps. From owner-freebsd-stable@freebsd.org Sun Mar 17 22:09:50 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AD852154C9F5 for ; Sun, 17 Mar 2019 22:09:50 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [IPv6:2a01:4f8:d12:604::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 2A3A5934D6 for ; Sun, 17 Mar 2019 22:09:50 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (eg.sd.rdtc.ru [IPv6:2a03:3100:c:13:0:0:0:5]) by hz.grosbein.net (8.15.2/8.15.2) with ESMTPS id x2HM9b4Y045540 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Sun, 17 Mar 2019 23:09:38 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: kostikbel@gmail.com Received: from [10.58.0.4] ([10.58.0.4]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTPS id x2HM9aXv067396 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT); Mon, 18 Mar 2019 05:09:36 +0700 (+07) (envelope-from eugen@grosbein.net) Subject: Re: hw.vga.acpi_ignore_no_vga=1 for installation media To: Konstantin Belousov , Warner Losh References: <20190317173421.GN96870@kib.kiev.ua> Cc: FreeBSD-STABLE Mailing List , Leon Christopher Dietrich From: Eugene Grosbein Message-ID: <11d5849a-848d-5034-8062-7e07cd6c8d3f@grosbein.net> Date: Mon, 18 Mar 2019 05:09:31 +0700 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: <20190317173421.GN96870@kib.kiev.ua> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=1.4 required=5.0 tests=BAYES_00, LOCAL_FROM, SPF_PASS, URI_HEX autolearn=no autolearn_force=no version=3.4.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.0 SPF_PASS SPF: sender matches SPF record * 1.1 URI_HEX URI: URI hostname has long hexadecimal sequence * 2.6 LOCAL_FROM From my domains X-Spam-Level: * X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on hz.grosbein.net X-Rspamd-Queue-Id: 2A3A5934D6 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.98 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.98)[-0.979,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; REPLY(-4.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 17 Mar 2019 22:09:50 -0000 18.03.2019 0:34, Konstantin Belousov wrote: > Can anybody provide an example of machine where the flag is set but VGA > works ? For me, it is set on headless NUC when there is no monitor > attached, and then BIOS does not configure framebuffer at all. http://freebsd.1045724.x6.nabble.com/vt-4-related-hang-of-11-2-td6299125.html https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=230172 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=229235 > > So the proposal is about reversing the set of broken machines, but only > in installer ? In other words, if it worked for installer, the installed > system would be broken (again) ? VGA-based installation session won't event start unless this is fixed. It should be easy to make installer generate the knob for target machine if installer sees wrong ACPI flag with working VGA hardware. From owner-freebsd-stable@freebsd.org Mon Mar 18 06:59:29 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 42A531533533 for ; Mon, 18 Mar 2019 06:59:29 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from kabab.cs.huji.ac.il (kabab.cs.huji.ac.il [132.65.116.210]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B086A736CB for ; Mon, 18 Mar 2019 06:59:28 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=cs.huji.ac.il; s=57791128; h=References:To:Cc:In-Reply-To:Date:Subject:Mime-Version:Content-Type:Message-Id:From; bh=s/Bm/bpKTYp1UtycwlIs4qaGpPgW47oEm+046padr48=; b=sKHQlQsYcz4W72hGKkErX1Umhayt6yKD3fRlPBNU9jBb+5Cf8BGQ6ITA7gh7p+pzuSKRM3VH8YkNejgyMXZVW8fPpeiJ+TAh6vpjBqwIKMXzK6bZ85iYDO11ugofkIA+JhG9DI7KvxmqFvuWM0yd2Psm94HH1gc67EbQ5RRKi4IrKSIep3CHmhCRIN/I10qhzSHnpYFhdW+tND5eLa2pNCV1tIh8Mmme455n13Y6fO6J7lUAgei+4z3QymkKBSiv3s/2YylGMYnceZBpe3Uq4N1uMwK5NBMHFVYO70nUxX82QzCsGUE8CH/xyGtvKasNviH81Wdxx/YWU19gjqH2yg==; Received: from bach.cs.huji.ac.il ([132.65.80.20]) by kabab.cs.huji.ac.il with esmtp id 1h5mEo-000HJp-Sm; Mon, 18 Mar 2019 08:59:10 +0200 From: Daniel Braniss Message-Id: <3B7CFB1B-EFC8-4251-ABFE-DA01D7619C2D@cs.huji.ac.il> Mime-Version: 1.0 (Mac OS X Mail 11.5 \(3445.9.1\)) Subject: Re: hw.vga.acpi_ignore_no_vga=1 for installation media Date: Mon, 18 Mar 2019 08:59:10 +0200 In-Reply-To: <20190317173421.GN96870@kib.kiev.ua> Cc: Warner Losh , FreeBSD-STABLE Mailing List , Leon Christopher Dietrich To: Konstantin Belousov References: <20190317173421.GN96870@kib.kiev.ua> X-Mailer: Apple Mail (2.3445.9.1) X-Rspamd-Queue-Id: B086A736CB X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.97 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; REPLY(-4.00)[]; NEURAL_HAM_SHORT(-0.97)[-0.974,0] Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Mar 2019 06:59:29 -0000 > On 17 Mar 2019, at 19:34, Konstantin Belousov = wrote: >=20 > On Sun, Mar 17, 2019 at 10:10:45AM -0600, Warner Losh wrote: >> I generally like this idea... But two caveats... >>=20 >> First, we'd need to update the docs so that folks doing serial = installs can >> unset it.... Though serial installs are a weird beast.... >> Second, if it's really needed, we should have the installer generate = it. >> alas, only vt can tell us that, but it should be easy to add a sysctl = to it >> that says that it has done video by ignoring the absence of the vga = node... > It is not about VGA node (what is that ?). > It is about ignoring FACP flag IAPC_BOOT_ARCH=3D{NO_VGA}, and there = are > machines which actually break when trying to access VGA hardware = despite > the flag is set. > Can anybody provide an example of machine where the flag is set but = VGA > works ? For me, it is set on headless NUC when there is no monitor > attached, and then BIOS does not configure framebuffer at all. >=20 > So the proposal is about reversing the set of broken machines, but = only > in installer ? In other words, if it worked for installer, the = installed > system would be broken (again) ? >=20 >>=20 >> Warner >>=20 >> On Sun, Mar 17, 2019 at 6:58 AM Leon Christopher Dietrich < >> doralitze@chaotikum.org> wrote: >>=20 >>> Sound's like solid idea. >>>=20 >>> A lot of systems out there lack propper ACPI description for VGA and = it >>> would definitly make the installation on such a system much more = easy. >>>=20 >>> As far as I can tell it doesn't seam to break other things and even = low >>> power system without VGA (like a pcengines apu2) don't seam to = suffer. > What apu2 reports in FACP flags ? Do > acpidump -dt | grep IAPC_BOOT_ARCH mine reports: IAPC_BOOT_ARCH=3D >=20 >>>=20 >>> On 17.03.19 13:00, FreeBSD-stable-request@freebsd.org wrote: >>>> Date: Sun, 17 Mar 2019 02:59:12 +0700 >>>> From: Eugene Grosbein >>>> To: FreeBSD stable >>>> Subject: hw.vga.acpi_ignore_no_vga=3D1 for installation media >>>> Message-ID: <912fc95d-5a5e-012b-7385-0f43f50dca65@grosbein.net> >>>> Content-Type: text/plain; charset=3Dkoi8-r >>>>=20 >>>> Hi! >>>>=20 >>>> Since 11.2-RELESE, default console driver vt(4) checks ACPI table = for >>> presence of VGA in the system. >>>> It does not initialize console (no input, no output) if ACPI states >>> there is no VGA adapter. >>>>=20 >>>> There are PRs describing many cases when VGA is present but ACPI = lies >>>> and we have a regression compared with 11.1 and earlier: >>>> FreeBSD cannot be installed interactively onto such a system, = leaving >>> aside serial console. >>>>=20 >>>> vt(4) has loader knob to restore pre-11.2 behaviour and ignore = ACPI: >>>>=20 >>>> hw.vga.acpi_ignore_no_vga=3D1 >>>>=20 >>>> Should we add this unconditionally to the installation media = designed >>> for interactive VGA-based installation? >>>>=20 >>>>=20 >>>> ------------------------------ >>>>=20 >>>=20 >>>=20 >> _______________________________________________ >> freebsd-stable@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-stable >> To unsubscribe, send any mail to = "freebsd-stable-unsubscribe@freebsd.org" > _______________________________________________ > freebsd-stable@freebsd.org mailing = list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable = > To unsubscribe, send any mail to = "freebsd-stable-unsubscribe@freebsd.org = " From owner-freebsd-stable@freebsd.org Mon Mar 18 10:22:23 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7AC961538A65 for ; Mon, 18 Mar 2019 10:22:23 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8580E82171 for ; Mon, 18 Mar 2019 10:22:22 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.15.2/8.15.2) with ESMTPS id x2IAMBee007096 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Mon, 18 Mar 2019 12:22:15 +0200 (EET) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua x2IAMBee007096 Received: (from kostik@localhost) by tom.home (8.15.2/8.15.2/Submit) id x2IAMBpp007094; Mon, 18 Mar 2019 12:22:11 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Mon, 18 Mar 2019 12:22:11 +0200 From: Konstantin Belousov To: Eugene Grosbein Cc: Warner Losh , FreeBSD-STABLE Mailing List , Leon Christopher Dietrich Subject: Re: hw.vga.acpi_ignore_no_vga=1 for installation media Message-ID: <20190318102211.GR96870@kib.kiev.ua> References: <20190317173421.GN96870@kib.kiev.ua> <11d5849a-848d-5034-8062-7e07cd6c8d3f@grosbein.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <11d5849a-848d-5034-8062-7e07cd6c8d3f@grosbein.net> User-Agent: Mutt/1.11.3 (2019-02-01) X-Spam-Status: No, score=0.1 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FORGED_GMAIL_RCVD,FREEMAIL_FROM, NML_ADSP_CUSTOM_MED,URI_HEX autolearn=no autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on tom.home X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Mar 2019 10:22:23 -0000 On Mon, Mar 18, 2019 at 05:09:31AM +0700, Eugene Grosbein wrote: > 18.03.2019 0:34, Konstantin Belousov wrote: > > > Can anybody provide an example of machine where the flag is set but VGA > > works ? For me, it is set on headless NUC when there is no monitor > > attached, and then BIOS does not configure framebuffer at all. > > http://freebsd.1045724.x6.nabble.com/vt-4-related-hang-of-11-2-td6299125.html > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=230172 > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=229235 All of them are about Silvermont/Airmont atoms which probably share reference Intel BIOS code. As I noted above, BIOS on mine machine is somewhat smarter, it reports NO_VGA only if the display was not connected on boot. > > > > So the proposal is about reversing the set of broken machines, but only > > in installer ? In other words, if it worked for installer, the installed > > system would be broken (again) ? > > VGA-based installation session won't event start unless this is fixed. > > It should be easy to make installer generate the knob for target machine > if installer sees wrong ACPI flag with working VGA hardware. Until installer generates such knob, it is out of question to make the config of the kernel booted from the installation media different from the config of the installed system. That said, did anybody considered ignoring NO_VGA FACP flag on Silvermonts only ? Or even better, gather SMBIOS identifications for affected BIOSes and ignore the flag for them ? From owner-freebsd-stable@freebsd.org Mon Mar 18 10:31:00 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 83E54153905C for ; Mon, 18 Mar 2019 10:31:00 +0000 (UTC) (envelope-from doralitze@chaotikum.org) Received: from mail.chaotikum.net (mail.chaotikum.net [5.9.47.118]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 07CAF827CE for ; Mon, 18 Mar 2019 10:30:59 +0000 (UTC) (envelope-from doralitze@chaotikum.org) Received: from cryingsilvertomb.technikradio.org (dialin-212-144-081-053.pools.arcor-ip.net [212.144.81.53]) by mail.chaotikum.net (Postfix) with ESMTPSA id 42629A23E51; Mon, 18 Mar 2019 11:30:57 +0100 (CET) Subject: Re: hw.vga.acpi_ignore_no_vga=1 for installation media To: Konstantin Belousov , Eugene Grosbein Cc: "imp@bsdimp.com;freebsd-stable"@freebsd.org, FreeBSD-STABLE Mailing List References: <20190317173421.GN96870@kib.kiev.ua> <11d5849a-848d-5034-8062-7e07cd6c8d3f@grosbein.net> <20190318102211.GR96870@kib.kiev.ua> From: Leon Christopher Dietrich Openpgp: preference=signencrypt Autocrypt: addr=doralitze@chaotikum.org; keydata= mDMEWtHUghYJKwYBBAHaRw8BAQdADiq7m5rFo5SGrzdtwaAD2CKcTYyCG64PX70zTq+WTgm0 M0xlb24gQ2hyaXN0b3BoZXIgRGlldHJpY2ggPGRvcmFsaXR6ZUBjaGFvdGlrdW0ub3JnPoiW BBMWCAA+FiEEQeNAFBlbshh/yWC93qL1fUgfdPUFAlrR1IICGwMFCQlmAYAFCwkIBwIGFQoJ CAsCBBYCAwECHgECF4AACgkQ3qL1fUgfdPVPbAEA8ams4Q5IOf0R4shKMzd7YLvjsjaafoFh Ja3/VM2fqaQA/iSsTi6IulicfUZrOmrsBARB29a7I2C7dvVXsJYUIXINtDNMZW9uIENocmlz dG9waGVyIERpZXRyaWNoIDx0ZWNobmlrcmFkaW9AaWNsb3VkLmNvbT6IlgQTFggAPhYhBEHj QBQZW7IYf8lgvd6i9X1IH3T1BQJa0dVCAhsDBQkJZgGABQsJCAcCBhUKCQgLAgQWAgMBAh4B AheAAAoJEN6i9X1IH3T1njsBALkJwsUpZ9rAwoS4EdByW7dPk+UoOQnSa3YRNQMzQQdqAP4z MPYG+Q2S9KYlJ/F785Ua2pQwbdt1eaOtwfj0xnKPBrg4BFrR1IISCisGAQQBl1UBBQEBB0D/ 8vFbITqE8nmVs/ukO84/qT1Il704fgCKrnWszPCeDQMBCAeIfgQYFggAJhYhBEHjQBQZW7IY f8lgvd6i9X1IH3T1BQJa0dSCAhsMBQkJZgGAAAoJEN6i9X1IH3T1BAgBAL1ysO9CDYw6lbVU gmHILJB7KRuozhFGg7NcJcBPXdbzAQC6oylZ9aOafxOgEWVwKgxw+VRHAMUwVxBUdpqTqY7F BQ== Message-ID: <9fce2660-3d4b-9f57-3a39-7669fc71c677@chaotikum.org> Date: Mon, 18 Mar 2019 11:30:51 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.5.3 MIME-Version: 1.0 In-Reply-To: <20190318102211.GR96870@kib.kiev.ua> Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="hynydSy6YzV4k4JbvYj1zyGYpqUjdrXjp" X-Rspamd-Queue-Id: 07CAF827CE X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.95 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.95)[-0.951,0]; REPLY(-4.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Mar 2019 10:31:00 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --hynydSy6YzV4k4JbvYj1zyGYpqUjdrXjp Content-Type: multipart/mixed; boundary="9idSQt04P2rGQKUUTyFu2uQg6Bq2dEDv0"; protected-headers="v1" From: Leon Christopher Dietrich To: Konstantin Belousov , Eugene Grosbein Cc: "imp@bsdimp.com;freebsd-stable"@freebsd.org, FreeBSD-STABLE Mailing List Message-ID: <9fce2660-3d4b-9f57-3a39-7669fc71c677@chaotikum.org> Subject: Re: hw.vga.acpi_ignore_no_vga=1 for installation media References: <20190317173421.GN96870@kib.kiev.ua> <11d5849a-848d-5034-8062-7e07cd6c8d3f@grosbein.net> <20190318102211.GR96870@kib.kiev.ua> In-Reply-To: <20190318102211.GR96870@kib.kiev.ua> --9idSQt04P2rGQKUUTyFu2uQg6Bq2dEDv0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Content-Language: en-US It also happens on some supermicro atom boards that definitely don't run Intel reference BIOS software. I can't provide any serial numbers dough since it's Sunday at my location. On 18.03.19 11:22, Konstantin Belousov wrote: > On Mon, Mar 18, 2019 at 05:09:31AM +0700, Eugene Grosbein wrote: >> 18.03.2019 0:34, Konstantin Belousov wrote: >> >>> Can anybody provide an example of machine where the flag is set but V= GA >>> works ? For me, it is set on headless NUC when there is no monitor >>> attached, and then BIOS does not configure framebuffer at all. >> http://freebsd.1045724.x6.nabble.com/vt-4-related-hang-of-11-2-td62991= 25.html >> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D230172 >> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D229235 > All of them are about Silvermont/Airmont atoms which probably share ref= erence > Intel BIOS code. > > As I noted above, BIOS on mine machine is somewhat smarter, it reports > NO_VGA only if the display was not connected on boot. > >>>> So the proposal is about reversing the set of broken machines, but o= nly >>> in installer ? In other words, if it worked for installer, the insta= lled >>> system would be broken (again) ? >> VGA-based installation session won't event start unless this is fixed.= >> >> It should be easy to make installer generate the knob for target machi= ne >> if installer sees wrong ACPI flag with working VGA hardware. > Until installer generates such knob, it is out of question to make > the config of the kernel booted from the installation media different > from the config of the installed system. > > That said, did anybody considered ignoring NO_VGA FACP flag on Silvermo= nts > only ? Or even better, gather SMBIOS identifications for affected BIOS= es > and ignore the flag for them ? --9idSQt04P2rGQKUUTyFu2uQg6Bq2dEDv0-- --hynydSy6YzV4k4JbvYj1zyGYpqUjdrXjp Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iHUEARYIAB0WIQRB40AUGVuyGH/JYL3eovV9SB909QUCXI9zWwAKCRDeovV9SB90 9bs6AP42Wtmh96ww70h8pj4Mm44NAtN9p4EMvsSQPLeFcQXCDQD+Pwiq6KMVRSV0 fT4LtMa9VzhoDGHlKL4agW8+Cn8oZgA= =veH6 -----END PGP SIGNATURE----- --hynydSy6YzV4k4JbvYj1zyGYpqUjdrXjp-- From owner-freebsd-stable@freebsd.org Mon Mar 18 10:52:10 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DE5DC1539E88 for ; Mon, 18 Mar 2019 10:52:10 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [IPv6:2a01:4f8:d12:604::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 5D44F8377C for ; Mon, 18 Mar 2019 10:52:10 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (eg.sd.rdtc.ru [IPv6:2a03:3100:c:13:0:0:0:5]) by hz.grosbein.net (8.15.2/8.15.2) with ESMTPS id x2IAq0Ta050736 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 18 Mar 2019 11:52:01 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: kostikbel@gmail.com Received: from [10.58.0.4] ([10.58.0.4]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTPS id x2IApxQ2071893 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT); Mon, 18 Mar 2019 17:51:59 +0700 (+07) (envelope-from eugen@grosbein.net) Subject: Re: hw.vga.acpi_ignore_no_vga=1 for installation media To: Konstantin Belousov References: <20190317173421.GN96870@kib.kiev.ua> <11d5849a-848d-5034-8062-7e07cd6c8d3f@grosbein.net> <20190318102211.GR96870@kib.kiev.ua> Cc: Warner Losh , FreeBSD-STABLE Mailing List , Leon Christopher Dietrich From: Eugene Grosbein Message-ID: <20731c15-415d-2260-5442-44c501387e4c@grosbein.net> Date: Mon, 18 Mar 2019 17:51:53 +0700 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: <20190318102211.GR96870@kib.kiev.ua> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM,SPF_PASS autolearn=no autolearn_force=no version=3.4.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.0 SPF_PASS SPF: sender matches SPF record * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on hz.grosbein.net X-Rspamd-Queue-Id: 5D44F8377C X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.98 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.98)[-0.977,0]; REPLY(-4.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Mar 2019 10:52:11 -0000 18.03.2019 17:22, Konstantin Belousov wrote: > That said, did anybody considered ignoring NO_VGA FACP flag on Silvermonts > only ? Or even better, gather SMBIOS identifications for affected BIOSes > and ignore the flag for them ? Is SMBIOS-bases blacklisting reliable considering future BIOS updates (including pre-installed)? When it comes to human-managed interactive installation, it seems for me more reliable to check real functions of VGA and ACPI flag than collecting black list. From owner-freebsd-stable@freebsd.org Mon Mar 18 13:07:58 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C6CBC153EC32 for ; Mon, 18 Mar 2019 13:07:58 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from constantine.ingresso.co.uk (constantine.ingresso.co.uk [31.24.6.74]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8910B88ADB for ; Mon, 18 Mar 2019 13:07:57 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from dilbert.london-internal.ingresso.co.uk ([10.64.50.6]) by constantine.ingresso.co.uk with esmtpsa (TLSv1.2:ECDHE-RSA-AES128-GCM-SHA256:128) (Exim 4.91 (FreeBSD)) (envelope-from ) id 1h5rzZ-000DvC-MO for freebsd-stable@freebsd.org; Mon, 18 Mar 2019 13:07:49 +0000 Subject: Re: Observations from a ZFS reorganization on 12-STABLE To: freebsd-stable@freebsd.org References: <58eb1994-41bd-cd22-be66-0024bcbc36e6@denninger.net> From: Pete French Message-ID: <2baf16fd-3767-1dda-d519-995f7ebaf0cb@ingresso.co.uk> Date: Mon, 18 Mar 2019 13:07:49 +0000 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.5.3 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 8910B88ADB X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dmarc=pass (policy=none) header.from=ingresso.co.uk; spf=pass (mx1.freebsd.org: domain of petefrench@ingresso.co.uk designates 31.24.6.74 as permitted sender) smtp.mailfrom=petefrench@ingresso.co.uk X-Spamd-Result: default: False [-2.50 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_HAM_MEDIUM(-0.95)[-0.951,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:31.24.6.74]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCPT_COUNT_ONE(0.00)[1]; IP_SCORE(-0.09)[asn: 16082(-0.38), country: GB(-0.09)]; NEURAL_SPAM_SHORT(0.35)[0.350,0]; MX_GOOD(-0.01)[us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mimecast.com, us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mimecast.com, us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mimecast.com, us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mimecast.com, us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mimecast.com, us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mimecast.com, us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mimecast.com, us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mimecast.com, us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mimecast.com, us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mimecast.com, us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mimecast.com, us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mimecast.com, us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mimecast.com, us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mimecast.com, us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mimecast.com, us-smtp-inbound-1.mimecast.com, us-smtp-inbound-2.mi mecast.com,us-smtp-inbound-1.mimecast.com,us-smtp-inbound-2.mimecast.com,us-smtp-inbound-1.mimecast.com,us-smtp-inbound-2.mimecast.com,us-smtp-inbound-1.mimecast.com,us-smtp-inbound-2.mimecast.com,us-smtp-inbound-1.mimecast.com,us-smtp-inbound-2.mimecast.com,us-smtp-inbound-1.mimecast.com,us-smtp-inbound-2.mimecast.com,us-smtp-inbound-1.mimecast.com,us-smtp-inbound-2.mimecast.com,us-smtp-inbound-1.mimecast.com,us-smtp-inbound-2.mimecast.com,us-smtp-inbound-1.mimecast.com,us-smtp-inbound-2.mimecast.com,us-smtp-inbound-1.mimecast.com,us-smtp-inbound-2.mimecast.com,us-smtp-inbound-1.mimecast.com,us-smtp-inbound-2.mimecast.com,us-smtp-inbound-1.mimecast.com,us-smtp-inbound-2.mimecast.com,us-smtp-inbound-1.mimecast.com,us-smtp-inbound-2.mimecast.com]; DMARC_POLICY_ALLOW(-0.50)[ingresso.co.uk,none]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16082, ipnet:31.24.0.0/21, country:GB]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Mar 2019 13:07:59 -0000 On 17/03/2019 21:57, Eugene Grosbein wrote: > I agree. Recently I've found kind-of-workaround for this problem: > increase vm.v_free_min so when "FREE" memory goes low, > page daemon wakes earlier and shrinks UMA (and ZFS ARC too) moving some > memory > from WIRED to FREE quick enough so it can be re-used before bad things > happen. > > But avoid increasing vm.v_free_min too much (e.g. over 1/4 of total RAM) > because kernel may start behaving strange. For 16Gb system it should be > enough > to raise vm.v_free_min upto 262144 (1GB) or 131072 (512M). > > This is not permanent solution in any way but it really helps. Ah, thats very interesting, thankyou for that! I;ve been bitten by this issue too in the past, and it is (as mentioned) much improved on 12, but the act it could still cause issues worries me. -pete. From owner-freebsd-stable@freebsd.org Mon Mar 18 13:40:57 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 59B8F153FB9D for ; Mon, 18 Mar 2019 13:40:57 +0000 (UTC) (envelope-from karl@denninger.net) Received: from colo1.denninger.net (colo1.denninger.net [104.236.120.189]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4B26B89C58 for ; Mon, 18 Mar 2019 13:40:56 +0000 (UTC) (envelope-from karl@denninger.net) Received: from denninger.net (ip68-1-57-197.pn.at.cox.net [68.1.57.197]) by colo1.denninger.net (Postfix) with ESMTP id 5794221109C for ; Mon, 18 Mar 2019 09:40:54 -0400 (EDT) Received: from [192.168.10.25] (D15.Denninger.Net [192.168.10.25]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by denninger.net (Postfix) with ESMTPSA id 9BB1D9D82 for ; Mon, 18 Mar 2019 08:40:53 -0500 (CDT) Subject: Re: Observations from a ZFS reorganization on 12-STABLE To: freebsd-stable@freebsd.org References: <58eb1994-41bd-cd22-be66-0024bcbc36e6@denninger.net> <2baf16fd-3767-1dda-d519-995f7ebaf0cb@ingresso.co.uk> From: Karl Denninger Openpgp: preference=signencrypt Autocrypt: addr=karl@denninger.net; prefer-encrypt=mutual; keydata= mQINBFIX1zsBEADRcJfsQUl9oFeoMfLPJ1kql+3sIaYx0MfJAUhV9LnbWxr0fsWCskM1O4cV tHm5dqPkuPM4Ztc0jLotD1i9ubWvCHOlkLGxFOL+pFbjA+XZ7VKsC/xWmhMwJ3cM8HavK2OV SzEWQ/AEYtMi04IzGSwsxh/5/5R0mPHrsIomV5SbuiI0vjLuDj7fo6146AABI1ULzge4hBYW i/SHrqUrLORmUNBs6bxek79/B0Dzk5cIktD3LOfbT9EAa5J/osVkstMBhToJgQttaMIGv8SG CzpR/HwEokE+7DP+k2mLHnLj6H3kfugOF9pJH8Za4yFmw//s9cPXV8WwtZ2SKfVzn1unpKqf wmJ1PwJoom/d4fGvQDkgkGKRa6RGC6tPmXnqnx+YX4iCOdFfbP8L9rmk2sewDDVzHDU3I3ZZ 8hFIjMYM/QXXYszRatK0LCV0QPZuF7LCf4uQVKw1/oyJInsnH7+6a3c0h21x+CmSja9QJ+y0 yzgEN/nM89d6YTakfR+1xkYgodVmMy/bS8kmXbUUZG/CyeqCqc95RUySjKT2ECrf9GhhoQkl +D8n2MsrAUSMGB4GQSN+TIq9OBTpNuvATGSRuF9wnQcs1iSry+JNCpfRTyWp83uCNApe6oHU EET4Et6KDO3AvjvBMAX0TInTRGW2SQlJMuFKpc7Dg7tHK8zzqQARAQABtCNLYXJsIERlbm5p bmdlciA8a2FybEBkZW5uaW5nZXIubmV0PokCPAQTAQIAJgUCUhfXOwIbIwUJCWYBgAYLCQgH AwIEFQIIAwQWAgMBAh4BAheAAAoJEG6/sivc5s0PLxQP/i6x/QFx9G4Cw7C+LthhLXIm7NSH AtNbz2UjySEx2qkoQQjtsK6mcpEEaky4ky6t8gz0/SifIfJmSmyAx0UhUQ0WBv1vAXwtNrQQ jJd9Bj6l4c2083WaXyHPjt2u2Na6YFowyb4SaQb83hu/Zs25vkPQYJVVE0JX409MFVPUa6E3 zFbd1OTr3T4yNUy4gNeQZfzDqDS8slbIks2sXeoJrZ6qqXVI0ionoivOlaN4T6Q0UYyXtigj dQvvhMt0aNowKFjRqrmSDRpdz+o6yg7Mp7qEZ1V6EZk8KqQTH6htpCTQ8i79ttK4LG6bstSF Re6Fwq52nbrcANrcdmtZXqjo+SGbUqJ8b1ggrxAsJ5MEhRh2peKrCgI/TjQo+ZxfnqEoR4AI 46Cyiz+/lcVvlvmf2iPifS3EEdaH3Itfwt7MxFm6mQORYs6skHDw3tOYB2/AdCW6eRVYs2hB RMAG4uwApZfZDKgRoE95PJmQjeTBiGmRPcsQZtNESe7I7EjHtCDLwtJqvD4HkDDQwpzreT6W XkyIJ7ns7zDfA1E+AQhFR6rsTFGgQZRZKsVeov3SbhYKkCnVDCvb/PKQCAGkSZM9SvYG5Yax 8CMry3AefKktf9fqBFg8pWqtVxDwJr56dhi0GHXRu3jVI995rMGo1fLUG5fSxiZ8L5sAtokh 9WFmQpyl Message-ID: <6e9a7a55-3eec-f1b4-61cc-45da4a22eb85@denninger.net> Date: Mon, 18 Mar 2019 08:40:52 -0500 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.5.3 MIME-Version: 1.0 In-Reply-To: <2baf16fd-3767-1dda-d519-995f7ebaf0cb@ingresso.co.uk> Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-512; boundary="------------ms000505030608030001090908" X-Rspamd-Queue-Id: 4B26B89C58 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.50 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; HAS_ATTACHMENT(0.00)[]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; MX_GOOD(-0.01)[cached: px.denninger.net]; NEURAL_HAM_SHORT(-0.98)[-0.982,0]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(-2.31)[ip: (-9.88), ipnet: 104.236.64.0/18(-3.81), asn: 14061(2.20), country: US(-0.07)]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:14061, ipnet:104.236.64.0/18, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:+]; MID_RHS_MATCH_FROM(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[197.57.1.68.zen.spamhaus.org : 127.0.0.11]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; FROM_HAS_DN(0.00)[]; SIGNED_SMIME(-2.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.20)[multipart/signed,multipart/alternative,text/plain]; RCVD_TLS_LAST(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; DMARC_NA(0.00)[denninger.net]; R_SPF_NA(0.00)[] X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Mar 2019 13:40:57 -0000 This is a cryptographically signed message in MIME format. --------------ms000505030608030001090908 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable On 3/18/2019 08:07, Pete French wrote: > > > On 17/03/2019 21:57, Eugene Grosbein wrote: >> I agree. Recently I've found kind-of-workaround for this problem: >> increase vm.v_free_min so when "FREE" memory goes low, >> page daemon wakes earlier and shrinks UMA (and ZFS ARC too) moving >> some memory >> from WIRED to FREE quick enough so it can be re-used before bad >> things happen. >> >> But avoid increasing vm.v_free_min too much (e.g. over 1/4 of total RA= M) >> because kernel may start behaving strange. For 16Gb system it should >> be enough >> to raise vm.v_free_min upto 262144 (1GB) or 131072 (512M). >> >> This is not permanent solution in any way but it really helps. > > Ah, thats very interesting, thankyou for that! I;ve been bitten by > this issue too in the past, and it is (as mentioned) much improved on > 12, but the act it could still cause issues worries me. > > The code patch I developed originally essentially sought to have the ARC code pare back before the pager started evicting working set.=C2=A0 A sec= ond crack went after clearing allocated-but-not-in-use UMA. v_free_min may not be the right place to do this -- see if bumping up vm.v_free_target also works. I'll stick this on my "to do" list, but it's much less critical in my applications than it was with 10.x and 11.x, both of which suffered from it much more-severely to the point that I was getting "stalls" that in some cases went on for 10 or more seconds due to things like your shell being evicted to swap to make room for arc, which is flat-out nuts.=C2=A0= That, at least, doesn't appear to be a problem with 12. --=20 Karl Denninger karl@denninger.net /The Market Ticker/ /[S/MIME encrypted email preferred]/ --------------ms000505030608030001090908 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC DdgwggagMIIEiKADAgECAhMA5EiKghDOXrvfxYxjITXYDdhIMA0GCSqGSIb3DQEBCwUAMIGL MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJTmljZXZpbGxlMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExITAf BgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQTAeFw0xNzA4MTcxNjQyMTdaFw0yNzA4 MTUxNjQyMTdaMHsxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkwFwYDVQQKDBBD dWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExJTAjBgNVBAMMHEN1 ZGEgU3lzdGVtcyBMTEMgMjAxNyBJbnQgQ0EwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIK AoICAQC1aJotNUI+W4jP7xQDO8L/b4XiF4Rss9O0B+3vMH7Njk85fZ052QhZpMVlpaaO+sCI KqG3oNEbuOHzJB/NDJFnqh7ijBwhdWutdsq23Ux6TvxgakyMPpT6TRNEJzcBVQA0kpby1DVD 0EKSK/FrWWBiFmSxg7qUfmIq/mMzgE6epHktyRM3OGq3dbRdOUgfumWrqHXOrdJz06xE9NzY vc9toqZnd79FUtE/nSZVm1VS3Grq7RKV65onvX3QOW4W1ldEHwggaZxgWGNiR/D4eosAGFxn uYeWlKEC70c99Mp1giWux+7ur6hc2E+AaTGh+fGeijO5q40OGd+dNMgK8Es0nDRw81lRcl24 SWUEky9y8DArgIFlRd6d3ZYwgc1DMTWkTavx3ZpASp5TWih6yI8ACwboTvlUYeooMsPtNa9E 6UQ1nt7VEi5syjxnDltbEFoLYcXBcqhRhFETJe9CdenItAHAtOya3w5+fmC2j/xJz29og1KH YqWHlo3Kswi9G77an+zh6nWkMuHs+03DU8DaOEWzZEav3lVD4u76bKRDTbhh0bMAk4eXriGL h4MUoX3Imfcr6JoyheVrAdHDL/BixbMH1UUspeRuqQMQ5b2T6pabXP0oOB4FqldWiDgJBGRd zWLgCYG8wPGJGYgHibl5rFiI5Ix3FQncipc6SdUzOQIDAQABo4IBCjCCAQYwHQYDVR0OBBYE FF3AXsKnjdPND5+bxVECGKtc047PMIHABgNVHSMEgbgwgbWAFBu1oRhUMNEzjODolDka5k4Q EDBioYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJ TmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5 c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYIJAKxAy1WBo2kY MBIGA1UdEwEB/wQIMAYBAf8CAQAwDgYDVR0PAQH/BAQDAgGGMA0GCSqGSIb3DQEBCwUAA4IC AQCB5686UCBVIT52jO3sz9pKuhxuC2npi8ZvoBwt/IH9piPA15/CGF1XeXUdu2qmhOjHkVLN gO7XB1G8CuluxofOIUce0aZGyB+vZ1ylHXlMeB0R82f5dz3/T7RQso55Y2Vog2Zb7PYTC5B9 oNy3ylsnNLzanYlcW3AAfzZcbxYuAdnuq0Im3EpGm8DoItUcf1pDezugKm/yKtNtY6sDyENj tExZ377cYA3IdIwqn1Mh4OAT/Rmh8au2rZAo0+bMYBy9C11Ex0hQ8zWcvPZBDn4v4RtO8g+K uQZQcJnO09LJNtw94W3d2mj4a7XrsKMnZKvm6W9BJIQ4Nmht4wXAtPQ1xA+QpxPTmsGAU0Cv HmqVC7XC3qxFhaOrD2dsvOAK6Sn3MEpH/YrfYCX7a7cz5zW3DsJQ6o3pYfnnQz+hnwLlz4MK 17NIA0WOdAF9IbtQqarf44+PEyUbKtz1r0KGeGLs+VGdd2FLA0e7yuzxJDYcaBTVwqaHhU2/ Fna/jGU7BhrKHtJbb/XlLeFJ24yvuiYKpYWQSSyZu1R/gvZjHeGb344jGBsZdCDrdxtQQcVA 6OxsMAPSUPMrlg9LWELEEYnVulQJerWxpUecGH92O06wwmPgykkz//UmmgjVSh7ErNvL0lUY UMfunYVO/O5hwhW+P4gviCXzBFeTtDZH259O7TCCBzAwggUYoAMCAQICEwCg0WvVwekjGFiO 62SckFwepz0wDQYJKoZIhvcNAQELBQAwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3Jp ZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBD QTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExMQyAyMDE3IEludCBDQTAeFw0xNzA4MTcyMTIx MjBaFw0yMjA4MTYyMTIxMjBaMFcxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRswGQYDVQQDDBJrYXJsQGRlbm5pbmdlci5uZXQw ggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIKAoICAQC+HVSyxVtJhy3Ohs+PAGRuO//Dha9A 16l5FPATr6wude9zjX5f2lrkRyU8vhCXTZW7WbvWZKpcZ8r0dtZmiK9uF58Ec6hhvfkxJzbg 96WHBw5Fumd5ahZzuCJDtCAWW8R7/KN+zwzQf1+B3MVLmbaXAFBuKzySKhKMcHbK3/wjUYTg y+3UK6v2SBrowvkUBC+jxNg3Wy12GsTXcUS/8FYIXgVVPgfZZrbJJb5HWOQpvvhILpPCD3xs YJFNKEPltXKWHT7Qtc2HNqikgNwj8oqOb+PeZGMiWapsatKm8mxuOOGOEBhAoTVTwUHlMNTg 6QUCJtuWFCK38qOCyk9Haj+86lUU8RG6FkRXWgMbNQm1mWREQhw3axgGLSntjjnznJr5vsvX SYR6c+XKLd5KQZcS6LL8FHYNjqVKHBYM+hDnrTZMqa20JLAF1YagutDiMRURU23iWS7bA9tM cXcqkclTSDtFtxahRifXRI7Epq2GSKuEXe/1Tfb5CE8QsbCpGsfSwv2tZ/SpqVG08MdRiXxN 5tmZiQWo15IyWoeKOXl/hKxA9KPuDHngXX022b1ly+5ZOZbxBAZZMod4y4b4FiRUhRI97r9l CxsP/EPHuuTIZ82BYhrhbtab8HuRo2ofne2TfAWY2BlA7ExM8XShMd9bRPZrNTokPQPUCWCg CdIATQIDAQABo4IBzzCCAcswPAYIKwYBBQUHAQEEMDAuMCwGCCsGAQUFBzABhiBodHRwOi8v b2NzcC5jdWRhc3lzdGVtcy5uZXQ6ODg4ODAJBgNVHRMEAjAAMBEGCWCGSAGG+EIBAQQEAwIF oDAOBgNVHQ8BAf8EBAMCBeAwHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMEMDMGCWCG SAGG+EIBDQQmFiRPcGVuU1NMIEdlbmVyYXRlZCBDbGllbnQgQ2VydGlmaWNhdGUwHQYDVR0O BBYEFLElmNWeVgsBPe7O8NiBzjvjYnpRMIHKBgNVHSMEgcIwgb+AFF3AXsKnjdPND5+bxVEC GKtc047PoYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UE BwwJTmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRh IFN5c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYITAORIioIQ zl6738WMYyE12A3YSDAdBgNVHREEFjAUgRJrYXJsQGRlbm5pbmdlci5uZXQwDQYJKoZIhvcN AQELBQADggIBAJXboPFBMLMtaiUt4KEtJCXlHO/3ZzIUIw/eobWFMdhe7M4+0u3te0sr77QR dcPKR0UeHffvpth2Mb3h28WfN0FmJmLwJk+pOx4u6uO3O0E1jNXoKh8fVcL4KU79oEQyYkbu 2HwbXBU9HbldPOOZDnPLi0whi/sbFHdyd4/w/NmnPgzAsQNZ2BYT9uBNr+jZw4SsluQzXG1X lFL/qCBoi1N2mqKPIepfGYF6drbr1RnXEJJsuD+NILLooTNf7PMgHPZ4VSWQXLNeFfygoOOK FiO0qfxPKpDMA+FHa8yNjAJZAgdJX5Mm1kbqipvb+r/H1UAmrzGMbhmf1gConsT5f8KU4n3Q IM2sOpTQe7BoVKlQM/fpQi6aBzu67M1iF1WtODpa5QUPvj1etaK+R3eYBzi4DIbCIWst8MdA 1+fEeKJFvMEZQONpkCwrJ+tJEuGQmjoQZgK1HeloepF0WDcviiho5FlgtAij+iBPtwMuuLiL shAXA5afMX1hYM4l11JXntle12EQFP1r6wOUkpOdxceCcMVDEJBBCHW2ZmdEaXgAm1VU+fnQ qS/wNw/S0X3RJT1qjr5uVlp2Y0auG/eG0jy6TT0KzTJeR9tLSDXprYkN2l/Qf7/nT6Q03qyE QnnKiBXWAZXveafyU/zYa7t3PTWFQGgWoC4w6XqgPo4KV44OMYIFBzCCBQMCAQEwgZIwezEL MAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBM TEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExM QyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTANBglghkgBZQMEAgMFAKCCAkUw GAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMTkwMzE4MTM0MDUy WjBPBgkqhkiG9w0BCQQxQgRAvkRuB5xdt4HwiLkAru0ZzPjyJjOUxjgVWYzpgj/VmlteEbON KP8BvA48FTZOOVD9BM6l0DvvWyE4p3hR1u/JCTBsBgkqhkiG9w0BCQ8xXzBdMAsGCWCGSAFl AwQBKjALBglghkgBZQMEAQIwCgYIKoZIhvcNAwcwDgYIKoZIhvcNAwICAgCAMA0GCCqGSIb3 DQMCAgFAMAcGBSsOAwIHMA0GCCqGSIb3DQMCAgEoMIGjBgkrBgEEAYI3EAQxgZUwgZIwezEL MAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBM TEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExM QyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTCBpQYLKoZIhvcNAQkQAgsxgZWg gZIwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lz dGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0 ZW1zIExMQyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTANBgkqhkiG9w0BAQEF AASCAgC4v9HeNBW29gj3vqihPfHS/kdV3DxcbzT5dMz8yTuSJZ0dePMjEBiio3yziQhRRkT6 US+6omBnCvArsvILU/NptAP0Q+eISJS4CUZjME8Qy86/s4LjwWJ/9XKNalsU5PBjaxOdqhlv OfSogU7IGkNN5AZwkxf1lE7Kve7RgyTC7eTE1RMJbJrSr8BucQEFS++DGWYZ4aOJFh8A9UCd cIDMFHQ8laSRgcbpJVRZaQBO9exfHy85pEh5IjU09GhJkEmLRq00ieKeI7P0R8YGCAkqOjt9 7DW+wjV+XiXi3YPQDWbXDktS6vyodoQNHEH1jJIOOI4klDbCuPOAkFpBj8fb9/xGZBySc1Gt Mc7aA5Op77FgkA/ifk44M++RYAWlHbaWK8UC69sUkuMMwXW0XjLN24dEitbeCp/HtSLXWo5K YBQAs+xAp/3xpdytPEBiqnttibRF90eyOkrjbWtEl0SyZ3IA/mbgp2wxMe4N9QcOArcKNjmB yocQvJYELRbJHoRWwUK3UJJjh1PDn+dpAVjD/jjdFDa2ZfTsOEDxeMUimOP7h4sSDYq3e3jM rs4flM3cByknLiGWdJBKZci6GhJLEB48hGxUmB8tw2G+n/1M5IKhNXnvMeNqH0vLwGLnBefE OfXZWea7ODFE8j7o1dmKgv4i8BxwiX0k80Yg78oUxwAAAAAAAA== --------------ms000505030608030001090908-- From owner-freebsd-stable@freebsd.org Mon Mar 18 13:42:23 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AD0A8153FC6B for ; Mon, 18 Mar 2019 13:42:23 +0000 (UTC) (envelope-from wfc@mintsol.com) Received: from scully.mintsol.com (scully.mintsol.com [199.182.77.206]) by mx1.freebsd.org (Postfix) with ESMTP id 5853E89F09 for ; Mon, 18 Mar 2019 13:42:22 +0000 (UTC) (envelope-from wfc@mintsol.com) Received: from mintsol.com (officecc.mintsol.com [96.85.114.33]) by scully.mintsol.com with esmtp; Mon, 18 Mar 2019 09:37:14 -0400 id 00AC825D.000000005C8F9F0A.00017423 Received: from localhost (localhost [127.0.0.1]) (IDENT: uid 1002) by mintsol.com with esmtp; Mon, 18 Mar 2019 09:37:14 -0400 id 000007DB.5C8F9F0A.0000E7ED Date: Mon, 18 Mar 2019 09:37:14 -0400 (EDT) From: Walter Cramer To: Pete French cc: freebsd-stable@freebsd.org Subject: Re: Observations from a ZFS reorganization on 12-STABLE In-Reply-To: <2baf16fd-3767-1dda-d519-995f7ebaf0cb@ingresso.co.uk> Message-ID: <20190318091431.W52549@mulder.mintsol.com> References: <58eb1994-41bd-cd22-be66-0024bcbc36e6@denninger.net> <2baf16fd-3767-1dda-d519-995f7ebaf0cb@ingresso.co.uk> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 5853E89F09 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of wfc@mintsol.com designates 199.182.77.206 as permitted sender) smtp.mailfrom=wfc@mintsol.com X-Spamd-Result: default: False [-1.72 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.74)[-0.739,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+a:scully.mintsol.com]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[mintsol.com]; NEURAL_HAM_LONG(-0.98)[-0.984,0]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[bmx01.pofox.com]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.27)[-0.272,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:22768, ipnet:199.182.77.0/24, country:US]; IP_SCORE(-0.01)[country: US(-0.07)] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Mar 2019 13:42:23 -0000 I suggest caution in raising vm.v_free_min, at least on 11.2-RELEASE systems with less RAM. I tried "65536" (256MB) on a 4GB mini-server, with vfs.zfs.arc_max of 2.5GB. Bad things happened when the cron daemon merely tried to run `periodic daily`. A few more details - ARC was mostly full, and "bad things" was 1: `pagedaemon` seemed to be thrashing memory - using 100% of CPU, with little disk activity, and 2: many normal processes seemed unable to run. The latter is probably explained by `man 3 sysctl` (see entry for "VM_V_FREE_MIN"). On Mon, 18 Mar 2019, Pete French wrote: > On 17/03/2019 21:57, Eugene Grosbein wrote: >> I agree. Recently I've found kind-of-workaround for this problem: >> increase vm.v_free_min so when "FREE" memory goes low, >> page daemon wakes earlier and shrinks UMA (and ZFS ARC too) moving some >> memory >> from WIRED to FREE quick enough so it can be re-used before bad things >> happen. >> >> But avoid increasing vm.v_free_min too much (e.g. over 1/4 of total RAM) >> because kernel may start behaving strange. For 16Gb system it should be >> enough >> to raise vm.v_free_min upto 262144 (1GB) or 131072 (512M). >> >> This is not permanent solution in any way but it really helps. > > Ah, thats very interesting, thankyou for that! I;ve been bitten by this issue > too in the past, and it is (as mentioned) much improved on 12, but the act it > could still cause issues worries me. > > -pete. > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@freebsd.org Mon Mar 18 14:15:15 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3C8341540909 for ; Mon, 18 Mar 2019 14:15:15 +0000 (UTC) (envelope-from karl@denninger.net) Received: from colo1.denninger.net (colo1.denninger.net [104.236.120.189]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 859CF8AF6A for ; Mon, 18 Mar 2019 14:15:14 +0000 (UTC) (envelope-from karl@denninger.net) Received: from denninger.net (ip68-1-57-197.pn.at.cox.net [68.1.57.197]) by colo1.denninger.net (Postfix) with ESMTP id 293F821108C for ; Mon, 18 Mar 2019 10:14:42 -0400 (EDT) Received: from [192.168.10.25] (D15.Denninger.Net [192.168.10.25]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by denninger.net (Postfix) with ESMTPSA id 968B79EF3 for ; Mon, 18 Mar 2019 09:14:41 -0500 (CDT) Subject: Re: Observations from a ZFS reorganization on 12-STABLE To: freebsd-stable@freebsd.org References: <58eb1994-41bd-cd22-be66-0024bcbc36e6@denninger.net> <2baf16fd-3767-1dda-d519-995f7ebaf0cb@ingresso.co.uk> <20190318091431.W52549@mulder.mintsol.com> From: Karl Denninger Openpgp: preference=signencrypt Autocrypt: addr=karl@denninger.net; prefer-encrypt=mutual; keydata= mQINBFIX1zsBEADRcJfsQUl9oFeoMfLPJ1kql+3sIaYx0MfJAUhV9LnbWxr0fsWCskM1O4cV tHm5dqPkuPM4Ztc0jLotD1i9ubWvCHOlkLGxFOL+pFbjA+XZ7VKsC/xWmhMwJ3cM8HavK2OV SzEWQ/AEYtMi04IzGSwsxh/5/5R0mPHrsIomV5SbuiI0vjLuDj7fo6146AABI1ULzge4hBYW i/SHrqUrLORmUNBs6bxek79/B0Dzk5cIktD3LOfbT9EAa5J/osVkstMBhToJgQttaMIGv8SG CzpR/HwEokE+7DP+k2mLHnLj6H3kfugOF9pJH8Za4yFmw//s9cPXV8WwtZ2SKfVzn1unpKqf wmJ1PwJoom/d4fGvQDkgkGKRa6RGC6tPmXnqnx+YX4iCOdFfbP8L9rmk2sewDDVzHDU3I3ZZ 8hFIjMYM/QXXYszRatK0LCV0QPZuF7LCf4uQVKw1/oyJInsnH7+6a3c0h21x+CmSja9QJ+y0 yzgEN/nM89d6YTakfR+1xkYgodVmMy/bS8kmXbUUZG/CyeqCqc95RUySjKT2ECrf9GhhoQkl +D8n2MsrAUSMGB4GQSN+TIq9OBTpNuvATGSRuF9wnQcs1iSry+JNCpfRTyWp83uCNApe6oHU EET4Et6KDO3AvjvBMAX0TInTRGW2SQlJMuFKpc7Dg7tHK8zzqQARAQABtCNLYXJsIERlbm5p bmdlciA8a2FybEBkZW5uaW5nZXIubmV0PokCPAQTAQIAJgUCUhfXOwIbIwUJCWYBgAYLCQgH AwIEFQIIAwQWAgMBAh4BAheAAAoJEG6/sivc5s0PLxQP/i6x/QFx9G4Cw7C+LthhLXIm7NSH AtNbz2UjySEx2qkoQQjtsK6mcpEEaky4ky6t8gz0/SifIfJmSmyAx0UhUQ0WBv1vAXwtNrQQ jJd9Bj6l4c2083WaXyHPjt2u2Na6YFowyb4SaQb83hu/Zs25vkPQYJVVE0JX409MFVPUa6E3 zFbd1OTr3T4yNUy4gNeQZfzDqDS8slbIks2sXeoJrZ6qqXVI0ionoivOlaN4T6Q0UYyXtigj dQvvhMt0aNowKFjRqrmSDRpdz+o6yg7Mp7qEZ1V6EZk8KqQTH6htpCTQ8i79ttK4LG6bstSF Re6Fwq52nbrcANrcdmtZXqjo+SGbUqJ8b1ggrxAsJ5MEhRh2peKrCgI/TjQo+ZxfnqEoR4AI 46Cyiz+/lcVvlvmf2iPifS3EEdaH3Itfwt7MxFm6mQORYs6skHDw3tOYB2/AdCW6eRVYs2hB RMAG4uwApZfZDKgRoE95PJmQjeTBiGmRPcsQZtNESe7I7EjHtCDLwtJqvD4HkDDQwpzreT6W XkyIJ7ns7zDfA1E+AQhFR6rsTFGgQZRZKsVeov3SbhYKkCnVDCvb/PKQCAGkSZM9SvYG5Yax 8CMry3AefKktf9fqBFg8pWqtVxDwJr56dhi0GHXRu3jVI995rMGo1fLUG5fSxiZ8L5sAtokh 9WFmQpyl Message-ID: <76f222db-8b75-80ef-ce48-a43217f10e60@denninger.net> Date: Mon, 18 Mar 2019 09:14:40 -0500 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.5.3 MIME-Version: 1.0 In-Reply-To: <20190318091431.W52549@mulder.mintsol.com> Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-512; boundary="------------ms060507040309090209010401" X-Rspamd-Queue-Id: 859CF8AF6A X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.46 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; HAS_ATTACHMENT(0.00)[]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; MX_GOOD(-0.01)[cached: px.denninger.net]; NEURAL_HAM_SHORT(-0.94)[-0.936,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:14061, ipnet:104.236.64.0/18, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:+]; MID_RHS_MATCH_FROM(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[197.57.1.68.zen.spamhaus.org : 127.0.0.11]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; FROM_HAS_DN(0.00)[]; SIGNED_SMIME(-2.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.20)[multipart/signed,multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; IP_SCORE(-2.32)[ip: (-9.88), ipnet: 104.236.64.0/18(-3.84), asn: 14061(2.20), country: US(-0.07)]; DMARC_NA(0.00)[denninger.net]; R_SPF_NA(0.00)[] X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Mar 2019 14:15:15 -0000 This is a cryptographically signed message in MIME format. --------------ms060507040309090209010401 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable On 3/18/2019 08:37, Walter Cramer wrote: > I suggest caution in raising vm.v_free_min, at least on 11.2-RELEASE > systems with less RAM.=C2=A0 I tried "65536" (256MB) on a 4GB mini-serv= er, > with vfs.zfs.arc_max of 2.5GB.=C2=A0 Bad things happened when the cron > daemon merely tried to run `periodic daily`. > > A few more details - ARC was mostly full, and "bad things" was 1: > `pagedaemon` seemed to be thrashing memory - using 100% of CPU, with > little disk activity, and 2: many normal processes seemed unable to > run. The latter is probably explained by `man 3 sysctl` (see entry for > "VM_V_FREE_MIN"). > > > On Mon, 18 Mar 2019, Pete French wrote: > >> On 17/03/2019 21:57, Eugene Grosbein wrote: >>> I agree. Recently I've found kind-of-workaround for this problem: >>> increase vm.v_free_min so when "FREE" memory goes low, >>> page daemon wakes earlier and shrinks UMA (and ZFS ARC too) moving >>> some memory >>> from WIRED to FREE quick enough so it can be re-used before bad >>> things happen. >>> >>> But avoid increasing vm.v_free_min too much (e.g. over 1/4 of total >>> RAM) >>> because kernel may start behaving strange. For 16Gb system it should >>> be enough >>> to raise vm.v_free_min upto 262144 (1GB) or 131072 (512M). >>> >>> This is not permanent solution in any way but it really helps. >> >> Ah, thats very interesting, thankyou for that! I;ve been bitten by >> this issue too in the past, and it is (as mentioned) much improved on >> 12, but the act it could still cause issues worries me. >> Raising free_target should *not* result in that sort of thrashing.=C2=A0 However, that's not really a fix standing alone either since the underlying problem is not being addressed by either change.=C2=A0 It is especially dangerous to raise the pager wakeup thresholds if you still run into UMA allocated-but-not-in-use not being cleared out issues as there's a risk of severe pathological behavior arising that's worse than the original problem. 11.1 and before (I didn't have enough operational experience with 11.2 to know, as I went to 12.x from mostly-11.1 installs around here) were essentially unusable in my workload without either my patch set or the Phabricator one. This is *very* workload-specific however, or nobody would use ZFS on earlier releases, and many do without significant problems. --=20 Karl Denninger karl@denninger.net /The Market Ticker/ /[S/MIME encrypted email preferred]/ --------------ms060507040309090209010401 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC DdgwggagMIIEiKADAgECAhMA5EiKghDOXrvfxYxjITXYDdhIMA0GCSqGSIb3DQEBCwUAMIGL MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJTmljZXZpbGxlMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExITAf BgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQTAeFw0xNzA4MTcxNjQyMTdaFw0yNzA4 MTUxNjQyMTdaMHsxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkwFwYDVQQKDBBD dWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExJTAjBgNVBAMMHEN1 ZGEgU3lzdGVtcyBMTEMgMjAxNyBJbnQgQ0EwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIK AoICAQC1aJotNUI+W4jP7xQDO8L/b4XiF4Rss9O0B+3vMH7Njk85fZ052QhZpMVlpaaO+sCI KqG3oNEbuOHzJB/NDJFnqh7ijBwhdWutdsq23Ux6TvxgakyMPpT6TRNEJzcBVQA0kpby1DVD 0EKSK/FrWWBiFmSxg7qUfmIq/mMzgE6epHktyRM3OGq3dbRdOUgfumWrqHXOrdJz06xE9NzY vc9toqZnd79FUtE/nSZVm1VS3Grq7RKV65onvX3QOW4W1ldEHwggaZxgWGNiR/D4eosAGFxn uYeWlKEC70c99Mp1giWux+7ur6hc2E+AaTGh+fGeijO5q40OGd+dNMgK8Es0nDRw81lRcl24 SWUEky9y8DArgIFlRd6d3ZYwgc1DMTWkTavx3ZpASp5TWih6yI8ACwboTvlUYeooMsPtNa9E 6UQ1nt7VEi5syjxnDltbEFoLYcXBcqhRhFETJe9CdenItAHAtOya3w5+fmC2j/xJz29og1KH YqWHlo3Kswi9G77an+zh6nWkMuHs+03DU8DaOEWzZEav3lVD4u76bKRDTbhh0bMAk4eXriGL h4MUoX3Imfcr6JoyheVrAdHDL/BixbMH1UUspeRuqQMQ5b2T6pabXP0oOB4FqldWiDgJBGRd zWLgCYG8wPGJGYgHibl5rFiI5Ix3FQncipc6SdUzOQIDAQABo4IBCjCCAQYwHQYDVR0OBBYE FF3AXsKnjdPND5+bxVECGKtc047PMIHABgNVHSMEgbgwgbWAFBu1oRhUMNEzjODolDka5k4Q EDBioYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJ TmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5 c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYIJAKxAy1WBo2kY MBIGA1UdEwEB/wQIMAYBAf8CAQAwDgYDVR0PAQH/BAQDAgGGMA0GCSqGSIb3DQEBCwUAA4IC AQCB5686UCBVIT52jO3sz9pKuhxuC2npi8ZvoBwt/IH9piPA15/CGF1XeXUdu2qmhOjHkVLN gO7XB1G8CuluxofOIUce0aZGyB+vZ1ylHXlMeB0R82f5dz3/T7RQso55Y2Vog2Zb7PYTC5B9 oNy3ylsnNLzanYlcW3AAfzZcbxYuAdnuq0Im3EpGm8DoItUcf1pDezugKm/yKtNtY6sDyENj tExZ377cYA3IdIwqn1Mh4OAT/Rmh8au2rZAo0+bMYBy9C11Ex0hQ8zWcvPZBDn4v4RtO8g+K uQZQcJnO09LJNtw94W3d2mj4a7XrsKMnZKvm6W9BJIQ4Nmht4wXAtPQ1xA+QpxPTmsGAU0Cv HmqVC7XC3qxFhaOrD2dsvOAK6Sn3MEpH/YrfYCX7a7cz5zW3DsJQ6o3pYfnnQz+hnwLlz4MK 17NIA0WOdAF9IbtQqarf44+PEyUbKtz1r0KGeGLs+VGdd2FLA0e7yuzxJDYcaBTVwqaHhU2/ Fna/jGU7BhrKHtJbb/XlLeFJ24yvuiYKpYWQSSyZu1R/gvZjHeGb344jGBsZdCDrdxtQQcVA 6OxsMAPSUPMrlg9LWELEEYnVulQJerWxpUecGH92O06wwmPgykkz//UmmgjVSh7ErNvL0lUY UMfunYVO/O5hwhW+P4gviCXzBFeTtDZH259O7TCCBzAwggUYoAMCAQICEwCg0WvVwekjGFiO 62SckFwepz0wDQYJKoZIhvcNAQELBQAwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3Jp ZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBD QTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExMQyAyMDE3IEludCBDQTAeFw0xNzA4MTcyMTIx MjBaFw0yMjA4MTYyMTIxMjBaMFcxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRswGQYDVQQDDBJrYXJsQGRlbm5pbmdlci5uZXQw ggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIKAoICAQC+HVSyxVtJhy3Ohs+PAGRuO//Dha9A 16l5FPATr6wude9zjX5f2lrkRyU8vhCXTZW7WbvWZKpcZ8r0dtZmiK9uF58Ec6hhvfkxJzbg 96WHBw5Fumd5ahZzuCJDtCAWW8R7/KN+zwzQf1+B3MVLmbaXAFBuKzySKhKMcHbK3/wjUYTg y+3UK6v2SBrowvkUBC+jxNg3Wy12GsTXcUS/8FYIXgVVPgfZZrbJJb5HWOQpvvhILpPCD3xs YJFNKEPltXKWHT7Qtc2HNqikgNwj8oqOb+PeZGMiWapsatKm8mxuOOGOEBhAoTVTwUHlMNTg 6QUCJtuWFCK38qOCyk9Haj+86lUU8RG6FkRXWgMbNQm1mWREQhw3axgGLSntjjnznJr5vsvX SYR6c+XKLd5KQZcS6LL8FHYNjqVKHBYM+hDnrTZMqa20JLAF1YagutDiMRURU23iWS7bA9tM cXcqkclTSDtFtxahRifXRI7Epq2GSKuEXe/1Tfb5CE8QsbCpGsfSwv2tZ/SpqVG08MdRiXxN 5tmZiQWo15IyWoeKOXl/hKxA9KPuDHngXX022b1ly+5ZOZbxBAZZMod4y4b4FiRUhRI97r9l CxsP/EPHuuTIZ82BYhrhbtab8HuRo2ofne2TfAWY2BlA7ExM8XShMd9bRPZrNTokPQPUCWCg CdIATQIDAQABo4IBzzCCAcswPAYIKwYBBQUHAQEEMDAuMCwGCCsGAQUFBzABhiBodHRwOi8v b2NzcC5jdWRhc3lzdGVtcy5uZXQ6ODg4ODAJBgNVHRMEAjAAMBEGCWCGSAGG+EIBAQQEAwIF oDAOBgNVHQ8BAf8EBAMCBeAwHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMEMDMGCWCG SAGG+EIBDQQmFiRPcGVuU1NMIEdlbmVyYXRlZCBDbGllbnQgQ2VydGlmaWNhdGUwHQYDVR0O BBYEFLElmNWeVgsBPe7O8NiBzjvjYnpRMIHKBgNVHSMEgcIwgb+AFF3AXsKnjdPND5+bxVEC GKtc047PoYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UE BwwJTmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRh IFN5c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYITAORIioIQ zl6738WMYyE12A3YSDAdBgNVHREEFjAUgRJrYXJsQGRlbm5pbmdlci5uZXQwDQYJKoZIhvcN AQELBQADggIBAJXboPFBMLMtaiUt4KEtJCXlHO/3ZzIUIw/eobWFMdhe7M4+0u3te0sr77QR dcPKR0UeHffvpth2Mb3h28WfN0FmJmLwJk+pOx4u6uO3O0E1jNXoKh8fVcL4KU79oEQyYkbu 2HwbXBU9HbldPOOZDnPLi0whi/sbFHdyd4/w/NmnPgzAsQNZ2BYT9uBNr+jZw4SsluQzXG1X lFL/qCBoi1N2mqKPIepfGYF6drbr1RnXEJJsuD+NILLooTNf7PMgHPZ4VSWQXLNeFfygoOOK FiO0qfxPKpDMA+FHa8yNjAJZAgdJX5Mm1kbqipvb+r/H1UAmrzGMbhmf1gConsT5f8KU4n3Q IM2sOpTQe7BoVKlQM/fpQi6aBzu67M1iF1WtODpa5QUPvj1etaK+R3eYBzi4DIbCIWst8MdA 1+fEeKJFvMEZQONpkCwrJ+tJEuGQmjoQZgK1HeloepF0WDcviiho5FlgtAij+iBPtwMuuLiL shAXA5afMX1hYM4l11JXntle12EQFP1r6wOUkpOdxceCcMVDEJBBCHW2ZmdEaXgAm1VU+fnQ qS/wNw/S0X3RJT1qjr5uVlp2Y0auG/eG0jy6TT0KzTJeR9tLSDXprYkN2l/Qf7/nT6Q03qyE QnnKiBXWAZXveafyU/zYa7t3PTWFQGgWoC4w6XqgPo4KV44OMYIFBzCCBQMCAQEwgZIwezEL MAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBM TEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExM QyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTANBglghkgBZQMEAgMFAKCCAkUw GAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMTkwMzE4MTQxNDQw WjBPBgkqhkiG9w0BCQQxQgRAPVm77U3pTLm+Jryl8vM7I3o+pMvP66rx0dL6TtBIEF2TdiRP C8WTYI8lQcxAyNCYjBGOzVWkLcS7hxF6pquv3DBsBgkqhkiG9w0BCQ8xXzBdMAsGCWCGSAFl AwQBKjALBglghkgBZQMEAQIwCgYIKoZIhvcNAwcwDgYIKoZIhvcNAwICAgCAMA0GCCqGSIb3 DQMCAgFAMAcGBSsOAwIHMA0GCCqGSIb3DQMCAgEoMIGjBgkrBgEEAYI3EAQxgZUwgZIwezEL MAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBM TEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExM QyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTCBpQYLKoZIhvcNAQkQAgsxgZWg gZIwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lz dGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0 ZW1zIExMQyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTANBgkqhkiG9w0BAQEF AASCAgA+nDArhIpzsakJiGiWRaB2Yos/fxge+UfIGTRxyhvcV6ij7ePoec+SZVdqaY3kSvVx kH7zuB0njeNZIbr6WxMi+LRV0xRfBaRrGMLEjy0ph2xTOBE5uA35yazNtC63n6r7sQWxGagW LkC3JoVpWAqN+MqFv3FzAHPxE9yO+kMTbZtXliiWPdp82Q4vQfQ7GgyUy9f/ZrS5z11KC7zD EVeUEumhc6ISmSYcZ8ki0NdgRDdkL1jncXdwXNMfqcWKdGfuEcaaW3GyzsL6KbAWfGIRIlVM EBLsXZQI+i78Ta5Lt3D5I8sNK6VIA3w5JZdpDeuGgMNSduqT0H5scN9PCgagmesWYK/FWuUl q5KkL82Yc4bHIbxx89WHcIDFCczoG+dHNUA2oHhSe3m7BTgcjryBqdIqX3DhmaVpoCy1nLQj Nz7TkVuXsJgrSVzv/XzHC9k4D9KXPSD8899s91cC1pfOc9M3YaDJPAu2mcXJ1UEi3AnAHxiw FKgnbJ7K7VA8HiSmQcn+m4OzcQfP91jGVtkZvMoFJerrRyEshMirpKAQhisXf33AWoMI/0+g wFppo+agbBajNoREQCoQFGVSNPh+JUfC++/PCzgT516Ih08Wcx2niPRkPgy7p675Gx9OxGf8 HZaNKjnpgOGCGLHpmQJDRa1/sbyTHRJolhF11ePgCAAAAAAAAA== --------------ms060507040309090209010401-- From owner-freebsd-stable@freebsd.org Mon Mar 18 14:31:55 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BC3BE15410EE for ; Mon, 18 Mar 2019 14:31:54 +0000 (UTC) (envelope-from peter.blok@bsd4all.org) Received: from smtpq1.tb.mail.iss.as9143.net (smtpq1.tb.mail.iss.as9143.net [212.54.42.164]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 00FC48B7C1 for ; Mon, 18 Mar 2019 14:31:52 +0000 (UTC) (envelope-from peter.blok@bsd4all.org) Received: from [212.54.42.135] (helo=smtp11.tb.mail.iss.as9143.net) by smtpq1.tb.mail.iss.as9143.net with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1h5tIl-0002yI-0H for freebsd-stable@freebsd.org; Mon, 18 Mar 2019 15:31:43 +0100 Received: from 5ed17ad9.cm-7-2b.dynamic.ziggo.nl ([94.209.122.217] helo=wan0.bsd4all.org) by smtp11.tb.mail.iss.as9143.net with esmtp (Exim 4.86_2) (envelope-from ) id 1h5tIk-0008JQ-Sv for freebsd-stable@freebsd.org; Mon, 18 Mar 2019 15:31:42 +0100 Received: from newnas (localhost [127.0.0.1]) by wan0.bsd4all.org (Postfix) with ESMTP id 89D8C319 for ; Mon, 18 Mar 2019 15:31:42 +0100 (CET) X-Virus-Scanned: amavisd-new at bsd4all.org Received: from wan0.bsd4all.org ([127.0.0.1]) by newnas (newnas.bsd4all.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 8u9plNvnXwS3 for ; Mon, 18 Mar 2019 15:31:41 +0100 (CET) Received: from [192.168.1.65] (unknown [192.168.1.65]) by wan0.bsd4all.org (Postfix) with ESMTPSA id 603BD314 for ; Mon, 18 Mar 2019 15:31:41 +0100 (CET) From: peter.blok@bsd4all.org Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: Observations from a ZFS reorganization on 12-STABLE Date: Mon, 18 Mar 2019 15:31:40 +0100 References: <58eb1994-41bd-cd22-be66-0024bcbc36e6@denninger.net> <2baf16fd-3767-1dda-d519-995f7ebaf0cb@ingresso.co.uk> <20190318091431.W52549@mulder.mintsol.com> <76f222db-8b75-80ef-ce48-a43217f10e60@denninger.net> To: FreeBSD Stable In-Reply-To: <76f222db-8b75-80ef-ce48-a43217f10e60@denninger.net> Message-Id: X-Mailer: Apple Mail (2.3445.102.3) X-SourceIP: 94.209.122.217 X-Ziggo-spambar: / X-Ziggo-spamscore: 0.0 X-Ziggo-spamreport: CMAE Analysis: v=2.3 cv=T6TysMCQ c=1 sm=1 tr=0 a=0XONDDbZk2SpjknwKA3Xxg==:17 a=jpOVt7BSZ2e4Z31A5e1TngXxSK0=:19 a=NTGMnVQrEZIA:10 a=C6q32NwkAAAA:8 a=HDP82zNOIxMqSwr-1SMA:9 a=CjuIK1q_8ugA:10 a=Omqe0uy41MGbrpyyOKEA:9 a=8o6lKlSoSwwGiz_K:21 a=_W_S_7VecoQA:10 a=d0GpIgV8JInD5zQLk0HG:22 X-Ziggo-Spam-Status: No X-Spam-Status: No X-Spam-Flag: No X-Rspamd-Queue-Id: 00FC48B7C1 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of peter.blok@bsd4all.org designates 212.54.42.164 as permitted sender) smtp.mailfrom=peter.blok@bsd4all.org X-Spamd-Result: default: False [-2.15 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_COUNT_FIVE(0.00)[6]; NEURAL_HAM_MEDIUM(-0.82)[-0.818,0]; MIME_TRACE(0.00)[0:+,1:+]; R_SPF_ALLOW(-0.20)[+a:smtp.ziggo.nl/16]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; DMARC_NA(0.00)[bsd4all.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.99)[-0.986,0]; RCVD_TLS_LAST(0.00)[]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[smtp.bsd4all.org]; NEURAL_HAM_SHORT(-0.35)[-0.346,0]; FROM_NO_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; IP_SCORE(-0.09)[asn: 33915(-0.49), country: NL(0.01)]; FROM_EQ_ENVFROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[164.42.54.212.list.dnswl.org : 127.0.5.1]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:33915, ipnet:212.54.32.0/20, country:NL]; MID_RHS_MATCH_FROM(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[217.122.209.94.zen.spamhaus.org : 127.0.0.11] Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Mar 2019 14:31:55 -0000 Same here using mfsbsd from 11-RELEASE. First attempt I forgot to add = swap - it killed the ssh I was using to issue a zfs send on the remote = system. Next attempt I added swap, but ssh got killed too. Third attempt I used mfsbsd from 12-RELEASE. It succeeded. Now I am using mfsbsd 11-RELEASE with added swap and vis.zfs.arc_min and = arc_max to 128Mb (it is a 4GB system) and it succeeds > On 18 Mar 2019, at 15:14, Karl Denninger wrote: >=20 > On 3/18/2019 08:37, Walter Cramer wrote: >> I suggest caution in raising vm.v_free_min, at least on 11.2-RELEASE >> systems with less RAM. I tried "65536" (256MB) on a 4GB mini-server, >> with vfs.zfs.arc_max of 2.5GB. Bad things happened when the cron >> daemon merely tried to run `periodic daily`. >>=20 >> A few more details - ARC was mostly full, and "bad things" was 1: >> `pagedaemon` seemed to be thrashing memory - using 100% of CPU, with >> little disk activity, and 2: many normal processes seemed unable to >> run. The latter is probably explained by `man 3 sysctl` (see entry = for >> "VM_V_FREE_MIN"). >>=20 >>=20 >> On Mon, 18 Mar 2019, Pete French wrote: >>=20 >>> On 17/03/2019 21:57, Eugene Grosbein wrote: >>>> I agree. Recently I've found kind-of-workaround for this problem: >>>> increase vm.v_free_min so when "FREE" memory goes low, >>>> page daemon wakes earlier and shrinks UMA (and ZFS ARC too) moving >>>> some memory >>>> from WIRED to FREE quick enough so it can be re-used before bad >>>> things happen. >>>>=20 >>>> But avoid increasing vm.v_free_min too much (e.g. over 1/4 of total >>>> RAM) >>>> because kernel may start behaving strange. For 16Gb system it = should >>>> be enough >>>> to raise vm.v_free_min upto 262144 (1GB) or 131072 (512M). >>>>=20 >>>> This is not permanent solution in any way but it really helps. >>>=20 >>> Ah, thats very interesting, thankyou for that! I;ve been bitten by >>> this issue too in the past, and it is (as mentioned) much improved = on >>> 12, but the act it could still cause issues worries me. >>>=20 > Raising free_target should *not* result in that sort of thrashing.=20 > However, that's not really a fix standing alone either since the > underlying problem is not being addressed by either change. It is > especially dangerous to raise the pager wakeup thresholds if you still > run into UMA allocated-but-not-in-use not being cleared out issues as > there's a risk of severe pathological behavior arising that's worse = than > the original problem. >=20 > 11.1 and before (I didn't have enough operational experience with 11.2 > to know, as I went to 12.x from mostly-11.1 installs around here) were > essentially unusable in my workload without either my patch set or the > Phabricator one. >=20 > This is *very* workload-specific however, or nobody would use ZFS on > earlier releases, and many do without significant problems. >=20 > --=20 > Karl Denninger > karl@denninger.net = > > /The Market Ticker/ > /[S/MIME encrypted email preferred]/ From owner-freebsd-stable@freebsd.org Mon Mar 18 15:04:22 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D56E915430AC; Mon, 18 Mar 2019 15:04:21 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from wout1-smtp.messagingengine.com (wout1-smtp.messagingengine.com [64.147.123.24]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 5FAFE8CAEF; Mon, 18 Mar 2019 15:04:17 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.west.internal (Postfix) with ESMTP id 9A95843E4; Mon, 18 Mar 2019 11:04:08 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute4.internal (MEProxy); Mon, 18 Mar 2019 11:04:08 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zyxst.net; h= date:from:to:cc:subject:message-id:mime-version:content-type; s= fm2; bh=ekkaHxWtDaPGNrZzNoISIO8U7su9amFHDMIIDvwGuM8=; b=sQTo9Ofu rksUUIyY6Re5DcHZp6J6QsB/MMw2mG9vDNNCchUVZnhaO1+XhNE07u2m5HktBQr+ FDDhkctWTm8jouWUkma94f8E1m3gDSndg8aEyGK7mwXPZ8/wFGk/lp3lE0mRaUdK cw0W7erfRzDnEptcOVGi95E0wHCYPeDZbxrFUOmNjCvXe8EB9/erW+0mKOPGGry7 H2SmYWufN9kxXQQDyLHzQF9mq5C6gzd/BkP8SRgdjl34ju0h5T7sU1Sizv/DQY/u ld0wZkORZgnAyhmaH+3sLEiX0kAp1BINtcSeORYXRmIvRDrwAMAd7vnw2OU7uiME 8TmTy98nLiaLTw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:from:message-id :mime-version:subject:to:x-me-proxy:x-me-proxy:x-me-sender :x-me-sender:x-sasl-enc; s=fm2; bh=ekkaHxWtDaPGNrZzNoISIO8U7su9a mFHDMIIDvwGuM8=; b=GSHJjNH48X02sluAk5dp3skglknZjhBGN2aFGvPxW0STH IGlHsI4CrLX8JVGjPa61QJs8iotXL005b/Ied15ysF1SpeJh1lWxsdxV5WoQ/PzW yvLj747Jwgfs1y54uuWuHt0SZPBZJ0+sQDQM8kbo1gA5+V0aiKL9QJI6rObLdcOD mLB0iDncT8L4KyXAaowPa8GRPE+WNB6LgsEheYyS3jI+aEFHf23vWZqKaP4Qx/E4 HwTXHbapHQqV8z5LHsoOvQM9JlsrkausJ1A+ruIpZ20bCSe+yt4hxdzYTbUbksjy Df/AvhE1GoeUog5V9Tl6uk+2gdWbfwaqPIRm92MwA== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedutddriedugdejvdcutefuodetggdotefrodftvf curfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfghnecu uegrihhlohhuthemuceftddtnecunecujfgurhepfffhvffukfggtggufgesghdtreertd ervdenucfhrhhomhepthgvtghhqdhlihhsthhsuceothgvtghhqdhlihhsthhsseiihiig shhtrdhnvghtqeenucfkphepkedvrdejtddrledurddutddunecurfgrrhgrmhepmhgrih hlfhhrohhmpehtvggthhdqlhhishhtshesiiihgihsthdrnhgvthenucevlhhushhtvghr ufhiiigvpedt X-ME-Proxy: Received: from rpi3.zyxst.net (rpi3.zyxst.net [82.70.91.101]) by mail.messagingengine.com (Postfix) with ESMTPA id 52B9E1030F; Mon, 18 Mar 2019 11:04:07 -0400 (EDT) Date: Mon, 18 Mar 2019 15:04:05 +0000 From: tech-lists To: freebsd-virtualization@freebsd.org Cc: freebsd-stable@freebsd.org Subject: bhyve zfs resizing Message-ID: <20190318150404.GB91631@rpi3.zyxst.net> Mail-Followup-To: freebsd-virtualization@freebsd.org, freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="XF85m9dhOBO43t/C" Content-Disposition: inline User-Agent: Mutt/1.11.2 (2019-01-07) X-Rspamd-Queue-Id: 5FAFE8CAEF X-Spamd-Bar: ------- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=zyxst.net header.s=fm2 header.b=sQTo9Ofu; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=GSHJjNH4; spf=pass (mx1.freebsd.org: domain of tech-lists@zyxst.net designates 64.147.123.24 as permitted sender) smtp.mailfrom=tech-lists@zyxst.net X-Spamd-Result: default: False [-7.27 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[zyxst.net:s=fm2,messagingengine.com:s=fm2]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:64.147.123.24]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[zyxst.net]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_COUNT_THREE(0.00)[4]; MX_GOOD(-0.01)[in2-smtp.messagingengine.com,in1-smtp.messagingengine.com,in2-smtp.messagingengine.com,in1-smtp.messagingengine.com,in2-smtp.messagingengine.com,in1-smtp.messagingengine.com,in2-smtp.messagingengine.com,in1-smtp.messagingengine.com,in2-smtp.messagingengine.com,in1-smtp.messagingengine.com,in2-smtp.messagingengine.com,in1-smtp.messagingengine.com,in2-smtp.messagingengine.com,in1-smtp.messagingengine.com]; DKIM_TRACE(0.00)[zyxst.net:+,messagingengine.com:+]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.97)[-0.971,0]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:11403, ipnet:64.147.123.0/24, country:US]; IP_SCORE(-1.59)[ipnet: 64.147.123.0/24(-4.45), asn: 11403(-3.44), country: US(-0.07)]; RCVD_IN_DNSWL_LOW(-0.10)[24.123.147.64.list.dnswl.org : 127.0.5.1] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Mar 2019 15:04:22 -0000 --XF85m9dhOBO43t/C Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hi, Apart from the performance benefit as per the section for bhyve in the handbook, can the size of the zfs-backed guest: 1. be resized from the host? 2. does the guest need to be inactive? 3. can linux guests (or even windows ones) be resized as well? thanks, --=20 J. --XF85m9dhOBO43t/C Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEE8n3tWhxW11Ccvv9/s8o7QhFzNAUFAlyPs1YACgkQs8o7QhFz NAUlFQ//WBtTcdDJmrOiIvkOmwgwS3ShzwAIVajVHwLzFClPPFIY421lWCD1odVK MHVsBcf4gkdCzbQRQB9WLlSbHnY/1jJ7RJLptqpujxMd45Dr3DVKY9CpuQu8Gd4b r/ORT65sMRFFtQGaBACZp2ttcEgQpV05uJgwuhSyyvftFeIfNmB8REZkxvTAlnjO zjlQ03EHdQeNL2TRU+K/D046VJjVaAIvdpReGG85u7UsBpkTuwN55FpXf9qQv5+l 9zPkefzO5taMbhpe3Oz9souFuAvOoOouYFyJJpFi8xF1c04+cL22S+7Ff14WMjDI gCGw4LHD/h/HYh11o8W77T6Xo1asABkZJKS8Q+pPtT6pYdRAfweAScOHkFSgiH8P KVNzDZCK1LyNeG/x3PQIEGHutrxrO7fAVeE9Av9Q78xWC2MckMnM4PQsr67khCRD 2dlzpzOJCWmp84BuHTIhgZfgDc60V1Slk6Ek+pSkdIO061mo9EfM2SfijrT3yCPm UZ0jSW6fVoRksH/y3A1DOiV7+oUHqI3ccdcSUaQZJFRT3mD4UT2QEoh5gn+XhUHg hJ3W8yVQ38rQUO+8GnXonnlvLbxojwJSoFnT2R5BRSiDNwB+Li7RC3EVfHyqGbvT 1oGqKpJ7BzOQ7sK6uzggePmWlHiVw+z9BHPbVX5KL38fuj5yAtg= =LNSz -----END PGP SIGNATURE----- --XF85m9dhOBO43t/C-- From owner-freebsd-stable@freebsd.org Mon Mar 18 15:08:45 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7F66B154343E; Mon, 18 Mar 2019 15:08:45 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-lj1-f173.google.com (mail-lj1-f173.google.com [209.85.208.173]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 84FFD8CDDB; Mon, 18 Mar 2019 15:08:44 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-lj1-f173.google.com with SMTP id n18so12419001ljg.11; Mon, 18 Mar 2019 08:08:44 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=7M6FM8s1F/5jupaGN3K/AHKe4vjcbT2kz9laQUtEgbc=; b=WjJowxElhZjN/QbCtNAdqdHEsNm6z+9r/Robvt6NVNFWh4P2zxokDzQTMYOHU2cSQg HeyjSG8AgDHpNkCJ2ta0sbvoOpSwh+E0CA6g5Si/fP4ibtIlmglQQbUscG6qUgV2CL+W W+XXG5FjJoJrbqc5M3ODwpEG1/9PIxacPu9euQUX+Bplr0r3ok026OfVhQLRaKYG/nYa aSADLi0ohSmBSBPT0dfR6OUsLYrQ3LoMZaCVJPXpb02WoM5uFmsYuNxN96Z3abQJH3al 84pR36FPnecAt6gHfArTxYsfLVLkNJfDEUGxhVZA/nT4MKK6z0gy1yCzPl7bV6IMWbt2 mxMA== X-Gm-Message-State: APjAAAUHiuYb8/wyZfvbf2N2v7w2UPS0CMb7yV3Iz15Dat4NyGq/sa55 uSY+r/dLB5+BhWXcfaKXDMFC6xLBtB52mgKqxAy5+vCg X-Google-Smtp-Source: APXvYqw7yw6A62K2ODW0etZ5sF4yJwXtruA9nFGh+4l532y8OAAL1UBKnuWfsomSE/RSihW54N34j1Nka6Ng9Jgpfiw= X-Received: by 2002:a2e:8582:: with SMTP id b2mr6017265lji.24.1552921722331; Mon, 18 Mar 2019 08:08:42 -0700 (PDT) MIME-Version: 1.0 References: <20190318150404.GB91631@rpi3.zyxst.net> In-Reply-To: <20190318150404.GB91631@rpi3.zyxst.net> From: Alan Somers Date: Mon, 18 Mar 2019 09:08:31 -0600 Message-ID: Subject: Re: bhyve zfs resizing To: "freebsd-virtualization@freebsd.org" , FreeBSD Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 84FFD8CDDB X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.208.173 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-3.98 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.996,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; IP_SCORE(-1.31)[ip: (-0.53), ipnet: 209.85.128.0/17(-3.88), asn: 15169(-2.09), country: US(-0.07)]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[173.208.85.209.list.dnswl.org : 127.0.5.0]; NEURAL_HAM_SHORT(-0.66)[-0.657,0]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; MIME_TRACE(0.00)[0:+]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Mar 2019 15:08:45 -0000 On Mon, Mar 18, 2019 at 9:05 AM tech-lists wrote: > > Hi, > > Apart from the performance benefit as per the section for bhyve in the > handbook, can the size of the zfs-backed guest: > > 1. be resized from the host? > 2. does the guest need to be inactive? > 3. can linux guests (or even windows ones) be resized as well? > > thanks, > -- > J. Do you mean using a zvol as the backing store for a VM? If so, then: 1) Yes. You can just do "zfs set volsize" on the host. 2) In theory no, but the guest may need to be rebooted to notice the change. And I'm not sure if the current bhyve code will expose the new size without a reboot or not. 3) Sure. But after you expand the zvol (or before you shrink it), you'll have to change the size of the guest's filesystem using the guest's native tools. -Alan From owner-freebsd-stable@freebsd.org Mon Mar 18 15:25:34 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1B3BD1543C8F; Mon, 18 Mar 2019 15:25:34 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from wout1-smtp.messagingengine.com (wout1-smtp.messagingengine.com [64.147.123.24]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 7711D8D891; Mon, 18 Mar 2019 15:25:33 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.west.internal (Postfix) with ESMTP id A978045B0; Mon, 18 Mar 2019 11:25:31 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute4.internal (MEProxy); Mon, 18 Mar 2019 11:25:31 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zyxst.net; h= date:from:to:subject:message-id:references:mime-version :content-type:in-reply-to; s=fm2; bh=/yn8mfkLnZs8QtHF0yFXVC7vqx0 y05CUtyChPjrpgDo=; b=YG1uDenvgktq+mM0uB0PW31bsX8JTy0rVRR3qH8iWme 9ceTnF32rzvW2lI3oZmAqDSOmKLiKu9a0Gr2yMnv2MZ1+fHRU0mUtXVb4YjQl++C z/aB6hzF4BDsmV+uu4ZF0yCJNMzdIkdAlv5Z5AQNspwcIHru/K0R8xCqVz2mOmjn iO1qW7Ig22mghunpmPevX5tBomIscQ61c2VRNLRw5Wa+doLidTf0DX02lEEJSDvq 7pOiNXrutq9CBzQex3/tq2yutKDQnqkS9Ngam+M3YvT7PvnZcc0J1Q5jV8hvKsXb 3UTUFxmt7eMGEqltPRi9FmEAExJznyBfmbmwS41p87g== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm2; bh=/yn8mf kLnZs8QtHF0yFXVC7vqx0y05CUtyChPjrpgDo=; b=vUC+qNn8qYa0kxRnzoI70J vlxGgGirjAPf0+C1Po7V+nES7rxwex8Z28RsRR/pwuZTn4ctKFDiJooWXyg/HImP d5Tda8PrSpDs3sayRvQXuQnqAF40/2z2ytYSne6eXw+IVHU6CYgA251IoydmkB1M bbjD/3ULKIbRAdrSKqICvMPNiI93pacuJj9Qs4UTZeVwFs3A+1GnpUDyZmwXu+ek nKMz+aFM+bzGIuI6z5bx13Lq6EfHMJO87CE9q/1hRDFBiDwoAtZt2mZeYhjx21Q5 Ek/r1QthPZhzA4W0q6/EtiN2xcBZPMHHZklgI4vnpVTihPfQXYINll7DMI6Tmn4Q == X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedutddriedugdejiecutefuodetggdotefrodftvf curfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfghnecu uegrihhlohhuthemuceftddtnecunecujfgurhepfffhvffukfhfgggtuggjfgesghdtre ertdervdenucfhrhhomhepthgvtghhqdhlihhsthhsuceothgvtghhqdhlihhsthhsseii hiigshhtrdhnvghtqeenucfkphepkedvrdejtddrledurddutddunecurfgrrhgrmhepmh grihhlfhhrohhmpehtvggthhdqlhhishhtshesiiihgihsthdrnhgvthenucevlhhushht vghrufhiiigvpedt X-ME-Proxy: Received: from rpi3.zyxst.net (rpi3.zyxst.net [82.70.91.101]) by mail.messagingengine.com (Postfix) with ESMTPA id 78ECFE4684; Mon, 18 Mar 2019 11:25:30 -0400 (EDT) Date: Mon, 18 Mar 2019 15:25:26 +0000 From: tech-lists To: freebsd-virtualization@freebsd.org, FreeBSD Subject: Re: bhyve zfs resizing Message-ID: <20190318152525.GC91631@rpi3.zyxst.net> Mail-Followup-To: freebsd-virtualization@freebsd.org, FreeBSD References: <20190318150404.GB91631@rpi3.zyxst.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="Pk6IbRAofICFmK5e" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.11.2 (2019-01-07) X-Rspamd-Queue-Id: 7711D8D891 X-Spamd-Bar: ------- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=zyxst.net header.s=fm2 header.b=YG1uDenv; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=vUC+qNn8; spf=pass (mx1.freebsd.org: domain of tech-lists@zyxst.net designates 64.147.123.24 as permitted sender) smtp.mailfrom=tech-lists@zyxst.net X-Spamd-Result: default: False [-7.30 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[zyxst.net:s=fm2,messagingengine.com:s=fm2]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:64.147.123.24]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; DMARC_NA(0.00)[zyxst.net]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[zyxst.net:+,messagingengine.com:+]; RCPT_COUNT_TWO(0.00)[2]; MX_GOOD(-0.01)[cached: in2-smtp.messagingengine.com]; SIGNED_PGP(-2.00)[]; NEURAL_HAM_SHORT(-0.99)[-0.991,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:11403, ipnet:64.147.123.0/24, country:US]; IP_SCORE(-1.60)[ipnet: 64.147.123.0/24(-4.47), asn: 11403(-3.44), country: US(-0.07)]; RCVD_IN_DNSWL_LOW(-0.10)[24.123.147.64.list.dnswl.org : 127.0.5.1] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Mar 2019 15:25:34 -0000 --Pk6IbRAofICFmK5e Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Mar 18, 2019 at 09:08:31AM -0600, Alan Somers wrote: > >Do you mean using a zvol as the backing store for a VM? If so, then: >1) Yes. You can just do "zfs set volsize" on the host. >2) In theory no, but the guest may need to be rebooted to notice the >change. And I'm not sure if the current bhyve code will expose the >new size without a reboot or not. >3) Sure. But after you expand the zvol (or before you shrink it), >you'll have to change the size of the guest's filesystem using the >guest's native tools. Great, that's awesome. Thanks for clarifying=20 --=20 J. --Pk6IbRAofICFmK5e Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEE8n3tWhxW11Ccvv9/s8o7QhFzNAUFAlyPuFsACgkQs8o7QhFz NAUgvg//Z2bpBqYHbpl1U6fzFBF+NOw+j1iqMP46tia9TziO6FUH+B/KUe9HAx0v N+QFyPJO6Y5EFZUdKfnAXPpSe1nCA7q5ueFLNoCgJilg13kxLccsvWh2Wo0QO3R7 kdIcGBDAgBF7DM2mWTZdyLe6fdbzKMhfU5vhsZJPw+HQjdo3dCbrd3s2VynyCVT8 XyXDgpbdbm3N3D56JQdxrc2x2CTy7EjaVbYTxD6rfsyyl4Id6s45A4zcBgibtDiE 9ZKcajQmTuxHRmnRsA/4Oax2LMuoLCTFT4nzkry2k7frjJbnQqUTGY7mmVMeeQNO ZCvGPz/A8RhiW8lg6A6quui9wjWz8ItUhmayRZQ3XzRGi7Z685vJF5DMuyLDWY7r A6FI4Ta+3cvCxPdsfnQXlY9Ufj3cgtkNWbHgHEoGu0p/YU/H6AEFTE9U1WooY2GX rJxc+pzt6AJaDXVuj6uy3BImY8Eq3neupbmcZbdGACW3IXfksiGb6gim2N6vyhY9 GGL/S9kzzQEGP4/rcHkI7XHcaWVm7GZ/jaY2jhROhZ+MxLaYZIRntx1ShBEAtX5b cirLCy9X7nezkk+EQl2KBLux8H52LYD8QHaJVgVFGsDrJw2Ydb+ASRlPhBxjt2H+ 1aQMSu/C9i7FC7H9fptEbQ7aAkbavgHuFUBa6A/Ijo/2YCiCCM8= =3l1R -----END PGP SIGNATURE----- --Pk6IbRAofICFmK5e-- From owner-freebsd-stable@freebsd.org Mon Mar 18 17:02:32 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 953DA1546E35 for ; Mon, 18 Mar 2019 17:02:32 +0000 (UTC) (envelope-from danallen46@gmail.com) Received: from mail-pg1-x530.google.com (mail-pg1-x530.google.com [IPv6:2607:f8b0:4864:20::530]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6BB106AE24 for ; Mon, 18 Mar 2019 17:02:31 +0000 (UTC) (envelope-from danallen46@gmail.com) Received: by mail-pg1-x530.google.com with SMTP id y3so2583323pgk.12 for ; Mon, 18 Mar 2019 10:02:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:content-transfer-encoding:mime-version:subject:message-id:date :to; bh=OsGtG73qinSx6sICh5iG7C33o198ii6dfKFhjn5JtVo=; b=K2iI5rY8nrLHW9/FSyo7FYokDWjseaRz0p8O23/mBzkUA+N1agh0VLVbBUFIUOHsue u6tpdayzg7+xWj3zD4CjDJZnmjYd96cguAzNWz3RDo0cfpwBFCaEhhTQW7/5oIJoLJsk sDR/Cvq+X9mIHM10D8p8c49o2hrwqQGGEl1/LcRjda28KDnzyyQ6ezkrF7p/P696YJhC /Usaijn2liCxUgStXHUlarSDosXPsuOPj4wufFO2E21gPDG1iYx2bUnBDimVKmGwquzC FXFo20bpJS2B69InMDjumL96+synnD9aL02eNx58qQt54zwr8KVYU45Cn4pC39LbkYQs Iemw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:content-transfer-encoding:mime-version :subject:message-id:date:to; bh=OsGtG73qinSx6sICh5iG7C33o198ii6dfKFhjn5JtVo=; b=kJUXQKx3WS0RCWJ+QsjHEPlnTWsAYXRByA8+oRjq4lfG3kzQvjtX2HVr4zdaGLLhnS vNNNM3v6njeO3skvSipT6OMmToYVtg4i541yDZsGRna4I3KVMC8gx/tTuhPhezrDqiUW rkiO9CyiEpZIq1nrHpnbPJio8y+KTZrW3LMpkTH8JOuyZtbfdRIYA1ZQFTaMYMBrzPzW pZ0BXd7881arKIu6e9BMbIzNTOP1aSHnKCKwvOM80UlFd+TrreTRnyG40sxH8e4rjckB yFM5imVXMwz8/y7tDKO7GAjS/r1S858yCVJt1aZhZ6l3YMg4qDy4TXEcF0lZVOm7ptr8 P0uA== X-Gm-Message-State: APjAAAURbUTV0Ug8Yvaola3yE1HTXyxMaiImSBmMAgwq9liVDT0YkINB XYx9fh+7ieSCR6y2CCBonhQCz88pHGc= X-Google-Smtp-Source: APXvYqzQTeGrcuJmzVrxSFEN1QOE96nkL8Yjovv98tW6hMlGYKBXGz1E+R7mGPHwK0/1hJkK5xcpSQ== X-Received: by 2002:a63:704c:: with SMTP id a12mr18244013pgn.394.1552928549697; Mon, 18 Mar 2019 10:02:29 -0700 (PDT) Received: from [192.168.0.4] (75-174-44-110.boid.qwest.net. [75.174.44.110]) by smtp.gmail.com with ESMTPSA id 6sm6980540pfi.53.2019.03.18.10.02.28 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 18 Mar 2019 10:02:28 -0700 (PDT) From: Dan Allen Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: ifuncs check flawed? Message-Id: <35A0AE5B-B25D-4067-86E3-325E65F3C1F4@gmail.com> Date: Mon, 18 Mar 2019 11:02:28 -0600 To: "freebsd-stable@freebsd.org Mailing FreeBSD-STABLE" X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: 6BB106AE24 X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=K2iI5rY8; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of danallen46@gmail.com designates 2607:f8b0:4864:20::530 as permitted sender) smtp.mailfrom=danallen46@gmail.com X-Spamd-Result: default: False [-5.35 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MV_CASE(0.50)[]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.98)[-0.981,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SUBJECT_ENDS_QUESTION(1.00)[]; RCVD_IN_DNSWL_NONE(0.00)[0.3.5.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; IP_SCORE(-2.86)[ip: (-9.39), ipnet: 2607:f8b0::/32(-2.75), asn: 15169(-2.09), country: US(-0.07)] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Mar 2019 17:02:32 -0000 I have been building FreeBSD for many years, as in since 2.2.8. Currently my amd64 build of 12-STABLE is built with the following = src.conf: WITHOUT_BHYVE=3D1 WITHOUT_CAPSICUM=3D1 WITHOUT_CDDL=3D1 WITHOUT_CLANG_EXTRAS=3D1 WITHOUT_CLANG_FULL=3D1 WITHOUT_CROSS_COMPILER=3D1 WITHOUT_DEBUG_FILES=3D1 WITHOUT_EXAMPLES=3D1 WITHOUT_HYPERV=3D1 WITHOUT_JAIL=3D1 WITHOUT_LOCALES=3D1 WITHOUT_PROFILE=3D1 WITHOUT_QUOTAS=3D1 WITHOUT_TESTS=3D1 And a make.conf of: BATCH=3Dyes MK_CDDL=3Dno MK_CLANG_EXTRAS=3Dno MK_DEBUG_FILES=3Dno MK_NO_PROFILE=3Dyes MK_TESTS=3Dno OPTIONS_UNSET=3DJAVA WITH_JADETEX=3Dno WITHOUT_CDDL=3Dyes WITHOUT_CLANG_FULL=3Dyes WITHOUT_CTF=3Dyes WITHOUT_CTM=3Dyes DISABLE_VULNERABILITIES=3Dyes So far, so good. (I do this to fit the whole thing onto a CD-image.) Fooling around, and using xhyve on my Mac, I want to build a i386 = version in a VM. So I grabbed the 20190314 snapshot of 12-STABLE, i386 flavor, and = installed it. Works great. Now to rebuild the world. The buildworld and buildkernel steps both immediately fail due to the = linker not supporting ifuncs. The code that stops the buildworld is this from = /usr/src/lib/libc/Makefile: --- .if (${LIBC_ARCH} =3D=3D amd64 || ${LIBC_ARCH} =3D=3D i386) && \ ${.TARGETS:Mall} =3D=3D all && \ defined(LINKER_FEATURES) && ${LINKER_FEATURES:Mifunc} =3D=3D "" .error ${LIBC_ARCH} libc requires linker ifunc support .endif --- However the linker on my system is the lld linker that supports ifuncs! = Why does this check fail? I am building on i386 but I am only building i386, as in I am not = building all targets or amd64. I edited the two Makefiles that have this check to remove the check and = the builds proceed just fine. So it appears that these checks are flawed, or I am soon to learn = something new about FreeBSD! Thanks, Dan Allen From owner-freebsd-stable@freebsd.org Mon Mar 18 17:13:30 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3D03C1547874 for ; Mon, 18 Mar 2019 17:13:30 +0000 (UTC) (envelope-from danallen46@gmail.com) Received: from mail-pg1-x529.google.com (mail-pg1-x529.google.com [IPv6:2607:f8b0:4864:20::529]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 264EC6B600 for ; Mon, 18 Mar 2019 17:13:29 +0000 (UTC) (envelope-from danallen46@gmail.com) Received: by mail-pg1-x529.google.com with SMTP id v1so7122153pgi.5 for ; Mon, 18 Mar 2019 10:13:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:content-transfer-encoding:mime-version:subject:message-id:date :to; bh=IyHPFiyZWuyXDGA8BsM/XGP4nCyLB/P0wjIKe7bB7uw=; b=nifLw2zJtUsvs81iDcG4rgeXlo8VFj5uteGjNXLfRg0AUfQmLVTi4AAP3R2wyH0kN1 mr+CSgUcv/g/GsDlzv1sVEv5nSFoMNtTvNFYZ9m7cA5cEFKfDnFhV5xqpWUiH+PGUp2q 77V6RdNnsUTf6fpoK44xZanICq9Jxfeu9F3BaUK0eokK5yJx+EO0LAw/iIslpTPjaKSz eowSqgJLorhiQEMyt3okL1F1BHq8lWTqDL3Croz+xfUBMB2Ii+vepfyHLoZTBxNsnYLp yWCUhmhP9R8PaJ0vb+tgm109lUPvmkuaUiT+b5WtGSY2EQmccI0AMigzHhktZYB7c9aE Qaqg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:content-transfer-encoding:mime-version :subject:message-id:date:to; bh=IyHPFiyZWuyXDGA8BsM/XGP4nCyLB/P0wjIKe7bB7uw=; b=s1cawyZg5Z2YFhtYOxvGtoaGbMrTGRkKes1scl8w8KWTzbjMWcgwn/NbTkSMnydGUE 2KHb/zzhOTyAPJqyw6JJ44MMTrMfsXEvQ6Zm15j8a+LmvRmY5pyEC8iTNIlEqzUy3F1Y H6efoLWzTell682JrauZefNN+26hP8kZ8LCLF2i5xDf2ew0/sbzA7itWRWRYMI5F/FBH +81wxaUnwM+alRxIf+NbbWVlYUXqJFTaBSAHyaO7lZlS709YfLYJ5+bbAXQ8vg7yEZ1v 3U/vDjUgoGoiKkf5cxY3Ln7wG6FcOYMFHjr96GH8XcZIGwj4iOTGEc9VTr4g8QD+MvRE YuEQ== X-Gm-Message-State: APjAAAV46QlF6pwna2pEgkK00TuBc1iX3/A+dwhytOA9vhx8aAg1OGj9 PeNikIRGWiVDPTaaT1IsBVWw0uahZVs= X-Google-Smtp-Source: APXvYqzCvOLDJizjyjAJwRUzLt087Qi/lLWvMyFcQqKaONvWGIpNK28m53DQ1r6GAXTRIUX4DS26Yg== X-Received: by 2002:a17:902:a81:: with SMTP id 1mr20999198plp.308.1552929207833; Mon, 18 Mar 2019 10:13:27 -0700 (PDT) Received: from [192.168.0.4] (75-174-44-110.boid.qwest.net. [75.174.44.110]) by smtp.gmail.com with ESMTPSA id b15sm19827564pfj.167.2019.03.18.10.13.27 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 18 Mar 2019 10:13:27 -0700 (PDT) From: Dan Allen Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: re: ifuncs check flawed? Message-Id: <94F34BE7-1041-4518-AA3E-0B1F0B6CB01C@gmail.com> Date: Mon, 18 Mar 2019 11:13:26 -0600 To: "freebsd-stable@freebsd.org Mailing FreeBSD-STABLE" X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: 264EC6B600 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=nifLw2zJ; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of danallen46@gmail.com designates 2607:f8b0:4864:20::529 as permitted sender) smtp.mailfrom=danallen46@gmail.com X-Spamd-Result: default: False [-4.38 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[gmail.com]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.98)[-0.984,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; SUBJECT_ENDS_QUESTION(1.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; FAKE_REPLY(1.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; RCVD_TLS_LAST(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[9.2.5.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; IP_SCORE(-2.88)[ip: (-9.50), ipnet: 2607:f8b0::/32(-2.75), asn: 15169(-2.09), country: US(-0.07)] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Mar 2019 17:13:30 -0000 The ifuncs check for buildkernel is identical to the one in /usr/src/lib/libc/Makefile and is here: /usr/src/sys/conf/kern.pre.mk Dan From owner-freebsd-stable@freebsd.org Mon Mar 18 17:29:45 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F0CB01547E2D for ; Mon, 18 Mar 2019 17:29:44 +0000 (UTC) (envelope-from danallen46@gmail.com) Received: from mail-pg1-x52b.google.com (mail-pg1-x52b.google.com [IPv6:2607:f8b0:4864:20::52b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E66516BF79 for ; Mon, 18 Mar 2019 17:29:43 +0000 (UTC) (envelope-from danallen46@gmail.com) Received: by mail-pg1-x52b.google.com with SMTP id i7so8648591pgq.0 for ; Mon, 18 Mar 2019 10:29:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:content-transfer-encoding:mime-version:subject:message-id:date :to; bh=GKPOLFGY/YWSBdzM3D3dpwtDHmB5nvkBWWDryDTQo/o=; b=C3Bsxu1myMiktzZ54ajbHNy4H3Kl8JRxRaxltNBYwbOq7t4LloGph0LDqoFK25Gc6n 6FaDKIR0JSEAyZWFfRp97qtkkuQqd84NLvEZvczTTEOQGZbNwFeYL1gweJcEgzG+JS2J TZy4J0T7qfVdSVvSFYI6ibhPZOUoU8nFcPczuXf/9TjxrTx/eZMkG6mEuwOKglr0xx3U r93P+rxHg5LXe0lV4YZO/b+zyXI4e8CDbZOvFlm3bHINpXkZoCaC1zPTnOkTE+pe8q2w NmyzM74ZWpd4IHbs8TxzBfGeCAxZ4FTe7bzdzn+vKu6vpJj94JdqBNZ7bkT4KhtCPbQG 1K+A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:content-transfer-encoding:mime-version :subject:message-id:date:to; bh=GKPOLFGY/YWSBdzM3D3dpwtDHmB5nvkBWWDryDTQo/o=; b=KYZcp8QX/ODFcavxfHu+WvLlYsFymfnLrJEizJogNZMzs9oOl2zD4HPwzjFaY6ynoa XnRafy4Scdtn21MMYUD6F+nT3RpJV1/Smoc8OIjJt/YNXqP++HfhqqD7uxyQg1Vy/YWN eGSY8WqixOWMPs7cvrqnXMjTFFQPqPricsJ59gdOIA0xiNV6yN2f2sUwY1S/oHXXoMSz 3lean2bhlgpOwzKGB8YVKqog9bUfCY3UbSQoRK03pEQacONIdB/oUDOChUWhe1nHwb57 rOTnr0hqTNEdVvY/0dsIHzI6BDEH8iDv86++gOMKmPMTHDwl36H3mLu21i2ok+jIUOci MdTg== X-Gm-Message-State: APjAAAV2xPwIdb6edRyXKGuKBMW3lUahTivyW3TGoX/iuJjkpjIrd9RN U9iH+yDpmFAR6D+0H4UaImCEHdqfyCE= X-Google-Smtp-Source: APXvYqwpRw60019GJm+aKJSxrS7fdlsUgDoyEoOvnpQKK/XMzgCgdlwuFzjiI424XagzqVhpn5jA9Q== X-Received: by 2002:a17:902:8d89:: with SMTP id v9mr21240933plo.254.1552930182552; Mon, 18 Mar 2019 10:29:42 -0700 (PDT) Received: from [192.168.0.4] (75-174-44-110.boid.qwest.net. [75.174.44.110]) by smtp.gmail.com with ESMTPSA id g6sm14511438pgq.54.2019.03.18.10.29.41 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 18 Mar 2019 10:29:41 -0700 (PDT) From: Dan Allen Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: re: ifuncs check flawed? Message-Id: <8B5BADA2-C3A3-414F-890E-6C14388B59A0@gmail.com> Date: Mon, 18 Mar 2019 11:29:40 -0600 To: "freebsd-stable@freebsd.org Mailing FreeBSD-STABLE" X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: E66516BF79 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=C3Bsxu1m; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of danallen46@gmail.com designates 2607:f8b0:4864:20::52b as permitted sender) smtp.mailfrom=danallen46@gmail.com X-Spamd-Result: default: False [-3.77 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[gmail.com]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.99)[-0.992,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; FAKE_REPLY(1.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SUBJECT_ENDS_QUESTION(1.00)[]; RCVD_IN_DNSWL_NONE(0.00)[b.2.5.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; IP_SCORE(-2.27)[ip: (-6.41), ipnet: 2607:f8b0::/32(-2.76), asn: 15169(-2.09), country: US(-0.07)] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Mar 2019 17:29:45 -0000 Well, everything built fine, but the kernel faults on boot, so the = checks are probably needed. ;-) I still do not understand why the linker that is part of 12-STABLE does = not provide the support needed. The directives in my src.conf and make.conf do not delete the lld = linker. They just cut down on extra llvm parts that I do not need, or = so I am led to believe. Still puzzled. Dan From owner-freebsd-stable@freebsd.org Mon Mar 18 17:56:11 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2CBCD154899C; Mon, 18 Mar 2019 17:56:11 +0000 (UTC) (envelope-from SRS0=eii1=RV=quip.cz=000.fbsd@elsa.codelab.cz) Received: from elsa.codelab.cz (elsa.codelab.cz [94.124.105.4]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id C4C7C6D0CE; Mon, 18 Mar 2019 17:56:09 +0000 (UTC) (envelope-from SRS0=eii1=RV=quip.cz=000.fbsd@elsa.codelab.cz) Received: from elsa.codelab.cz (localhost [127.0.0.1]) by elsa.codelab.cz (Postfix) with ESMTP id E31D628416; Mon, 18 Mar 2019 18:56:06 +0100 (CET) Received: from illbsd.quip.test (ip-86-49-16-209.net.upcbroadband.cz [86.49.16.209]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by elsa.codelab.cz (Postfix) with ESMTPSA id BC69728417; Mon, 18 Mar 2019 18:56:05 +0100 (CET) Subject: Re: bhyve zfs resizing To: freebsd-virtualization@freebsd.org, FreeBSD References: <20190318150404.GB91631@rpi3.zyxst.net> <20190318152525.GC91631@rpi3.zyxst.net> From: Miroslav Lachman <000.fbsd@quip.cz> Message-ID: Date: Mon, 18 Mar 2019 18:56:03 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Firefox/52.0 SeaMonkey/2.49.3 MIME-Version: 1.0 In-Reply-To: <20190318152525.GC91631@rpi3.zyxst.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: C4C7C6D0CE X-Spamd-Bar: ++++ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [4.24 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.91)[0.914,0]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[quip.cz]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.96)[0.957,0]; RCVD_COUNT_THREE(0.00)[3]; IP_SCORE(0.21)[ip: (0.50), ipnet: 94.124.104.0/21(0.25), asn: 42000(0.20), country: CZ(0.07)]; MX_GOOD(-0.01)[cached: elsa.codelab.cz]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[4.105.124.94.list.dnswl.org : 127.0.10.0]; NEURAL_SPAM_LONG(0.97)[0.971,0]; R_SPF_NA(0.00)[]; FORGED_SENDER(0.30)[000.fbsd@quip.cz,SRS0=eii1=RV=quip.cz=000.fbsd@elsa.codelab.cz]; RECEIVED_SPAMHAUS_PBL(0.00)[209.16.49.86.zen.spamhaus.org : 127.0.0.11]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:42000, ipnet:94.124.104.0/21, country:CZ]; FROM_NEQ_ENVFROM(0.00)[000.fbsd@quip.cz,SRS0=eii1=RV=quip.cz=000.fbsd@elsa.codelab.cz]; MID_RHS_MATCH_FROM(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Mar 2019 17:56:11 -0000 tech-lists wrote on 2019/03/18 16:25: > On Mon, Mar 18, 2019 at 09:08:31AM -0600, Alan Somers wrote: >> >> Do you mean using a zvol as the backing store for a VM?  If so, then: >> 1) Yes.  You can just do "zfs set volsize" on the host. >> 2) In theory no, but the guest may need to be rebooted to notice the >> change.  And I'm not sure if the current bhyve code will expose the >> new size without a reboot or not. >> 3) Sure.  But after you expand the zvol (or before you shrink it), >> you'll have to change the size of the guest's filesystem using the >> guest's native tools. I did it 2 month ago on FreeBSD 11.2. On the host with running guest: # zfs set volsize=200G tank1/vol1/bhyve/kotel/disk1 Even if I unmounted disk in the guest it still does not see the new size until I rebooted the guest. After reboot of the guest, you will see corrupted GPT: # gpart show -p vtbd1 => 40 209715120 vtbd1 GPT (200G) [CORRUPT] 40 8 - free - (4.0K) 48 1024 vtbd1p1 freebsd-boot (512K) 1072 976 - free - (488K) 2048 203423744 vtbd1p2 freebsd-ufs (97G) 203425792 6289368 - free - (3.0G) And after running recover, the guest will see the added space # gpart recover vtbd1 vtbd1 recovered # gpart show -p vtbd1 => 40 419430320 vtbd1 GPT (200G) 40 8 - free - (4.0K) 48 1024 vtbd1p1 freebsd-boot (512K) 1072 976 - free - (488K) 2048 203423744 vtbd1p2 freebsd-ufs (97G) 203425792 216004568 - free - (103G) After this, the partition can finally be enlarged # gpart resize -a 1M -s 197G -i 2 vtbd1 # growfs /vol0 Kind regards Miroslav Lachman From owner-freebsd-stable@freebsd.org Mon Mar 18 19:20:20 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6ACC8154AFBA for ; Mon, 18 Mar 2019 19:20:20 +0000 (UTC) (envelope-from danallen46@gmail.com) Received: from mail-pf1-x435.google.com (mail-pf1-x435.google.com [IPv6:2607:f8b0:4864:20::435]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7114C71D21 for ; Mon, 18 Mar 2019 19:20:19 +0000 (UTC) (envelope-from danallen46@gmail.com) Received: by mail-pf1-x435.google.com with SMTP id r15so9169016pfn.9 for ; Mon, 18 Mar 2019 12:20:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:content-transfer-encoding:mime-version:subject:message-id:date :to; bh=47EuwQSXWRYAZaIt94kGVt7/3edyYtrnmIqmCsleOVg=; b=dGOd3KNVmmIydOOcwaVDWEx5hSjgCs1yAV+Q2BzvnfLiAbksDKW8cWSYNYy2HlKI9I C/2PM49f2UlsZBiBO1CpH963lUlkJv2ycmjzWWYW1JwFS6jtvCDn0AoaJAtsch1OyApF P4cNAFrYpget0jXyZX1G9Wyv+hU0scx2rbKS00Llzl566yv2uLTam/WJ/36NnlpiTuh4 +Kn90Tz9BQ6JS+yK3BID1q1echxP4ShjJmul8yU4SBw0wKbqnPOaRcmVugfcNA8FqLDv XzXhyZD+of0DhX0Vs0Y1zzFN9yQL5AanZTzlIMPmXbv2bgMskNOcZK+KjA5aeihOI2QR POdA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:content-transfer-encoding:mime-version :subject:message-id:date:to; bh=47EuwQSXWRYAZaIt94kGVt7/3edyYtrnmIqmCsleOVg=; b=JRNT4s4cQKG1ItMNJrQq+lYar5k6YJFoU4Urd9juu+HkfUQyNNFS7J3RfEfSmM5jnI Ij7ZeUlAcV/ibfx2y86ZjP9sYAVZlAPc2swnU/wM4/yunDSd71MYTBlqTQ61mOS4CciD n/kobxHyFFZu13a93u86fVYkFLm82C3tUzdHqp/oUmenyZAweq9xlzr9swW0VORZlfX0 iNoYjAyUp7mEQIhlBzgFV3gpRBQxDhLZcRxsL1jBJJbVmQDterMUgE1H8j79Kxc25zc8 3sc5f7UWZu90J6ZaGxt9B9tJniRNDBXwGMdJ/AMTKInVmCEScczsJdrp06jOqoVI+m57 jiIA== X-Gm-Message-State: APjAAAVg/l5epb1MzlD5EDdOrUqIHiU7+aypED3HxH1FCzLJC/0z68vM qrrHuv1MeCxUHMnn4HFNC22ZgMcmYks= X-Google-Smtp-Source: APXvYqy1xGurTGxSVe+CGv1hgLsKX1S4T5BS8CHoQmEMLQKTERW0/83RJsQnN9E7LoW6PgVWKUifCw== X-Received: by 2002:a17:902:9b86:: with SMTP id y6mr20964474plp.71.1552936818075; Mon, 18 Mar 2019 12:20:18 -0700 (PDT) Received: from [192.168.0.4] (75-174-44-110.boid.qwest.net. [75.174.44.110]) by smtp.gmail.com with ESMTPSA id q7sm17939596pfa.119.2019.03.18.12.20.16 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 18 Mar 2019 12:20:17 -0700 (PDT) From: Dan Allen Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: re: ifuncs check flawed? Message-Id: Date: Mon, 18 Mar 2019 13:20:15 -0600 To: "freebsd-stable@freebsd.org Mailing FreeBSD-STABLE" X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: 7114C71D21 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=dGOd3KNV; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of danallen46@gmail.com designates 2607:f8b0:4864:20::435 as permitted sender) smtp.mailfrom=danallen46@gmail.com X-Spamd-Result: default: False [-4.36 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[gmail.com]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.98)[-0.981,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; SUBJECT_ENDS_QUESTION(1.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; FAKE_REPLY(1.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; RCVD_TLS_LAST(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[5.3.4.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; IP_SCORE(-2.86)[ip: (-9.41), ipnet: 2607:f8b0::/32(-2.76), asn: 15169(-2.09), country: US(-0.07)] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Mar 2019 19:20:20 -0000 Another data point: I did the whole experiment with the latest 12-STABLE but for amd64 and = everything builds fine without changes, and runs fine too. I used the same src.conf and make.conf. So the problem is definitely = with i386. Dan From owner-freebsd-stable@freebsd.org Tue Mar 19 00:23:34 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D08A81551FEC; Tue, 19 Mar 2019 00:23:33 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from wout1-smtp.messagingengine.com (wout1-smtp.messagingengine.com [64.147.123.24]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 849F685B52; Tue, 19 Mar 2019 00:23:32 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.west.internal (Postfix) with ESMTP id 3E49438AA; Mon, 18 Mar 2019 20:23:30 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute4.internal (MEProxy); Mon, 18 Mar 2019 20:23:30 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zyxst.net; h= date:from:to:subject:message-id:references:mime-version :content-type:in-reply-to; s=fm2; bh=n4DsVE1Vk7yxDlJ8c6KpqfJbQAS XDBUQz0B5HlP/dYI=; b=VO67TFcZPZfPKy58xPuix9pYQyjAL1Mg/WzNcIZh+Kd X+cxcza2r2XINJb2JnR4wKI7FK63byR9qXpKq6LaJ9kNTpl5jEjulRX0EBz5rPkp HHG5zHZng5YNPENmjGjmgaJp4OEzt/EceYNZ4wGY96Eudquqescz38vuMn6lFha+ kRV5eEvf1L1Rpc+/EFG1lypIvDkC8ItK2cD6NnlqiL5QdNqUi+slwv0ZaVAaP9b+ XKKA83mRoztSX88kSHy/xNKQHON0O7FIrVd2/nsSzLf2Nwcsz2fERTn95RbsL8iD MZuPX87bOyI1XMnoigxj6mms69QGz1f0uP8rQSjWdkg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm2; bh=n4DsVE 1Vk7yxDlJ8c6KpqfJbQASXDBUQz0B5HlP/dYI=; b=LhXMQWmeey+S3sZxiFENKi EDxd4yaeZn6hF3HdoxZiP2OdnV5K8JuwD5NdfJIblBZNxF+KglaO6Dm633hXVUOA xA9Hh99UIxAUL9kt4gay1wBMaYnXkXo/Pe6mtL8N5nX6W3SbfEQ1H/nts9X34vvE +rT6wvCojG6SBI+6y7RbSDCjsEBDe7VoYRCkciKbBXZn3lVaZxgJwKwQEWrbmkOX KweEhv7DpBa5eWnB3VODlxhrx9Kq6KFlKkCGr6aoVoPES76h1GcNjXoMnjMjQoTW ZDeeNNcRkYkDXYj6nziNpYD1rt0f+0bCSlZDsF1icgB33HY2jpKBaHznrOQ4qpkw == X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedutddrieefgddufecutefuodetggdotefrodftvf curfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfghnecu uegrihhlohhuthemuceftddtnecunecujfgurhepfffhvffukfhfgggtuggjfgesghdtre ertdervdenucfhrhhomhepthgvtghhqdhlihhsthhsuceothgvtghhqdhlihhsthhsseii hiigshhtrdhnvghtqeenucfkphepkedvrdejtddrledurddutddunecurfgrrhgrmhepmh grihhlfhhrohhmpehtvggthhdqlhhishhtshesiiihgihsthdrnhgvthenucevlhhushht vghrufhiiigvpedt X-ME-Proxy: Received: from rpi3.zyxst.net (rpi3.zyxst.net [82.70.91.101]) by mail.messagingengine.com (Postfix) with ESMTPA id 0F420E465F; Mon, 18 Mar 2019 20:23:28 -0400 (EDT) Date: Tue, 19 Mar 2019 00:23:26 +0000 From: tech-lists To: freebsd-virtualization@freebsd.org, FreeBSD Subject: Re: bhyve zfs resizing Message-ID: <20190319002325.GD91631@rpi3.zyxst.net> Mail-Followup-To: freebsd-virtualization@freebsd.org, FreeBSD References: <20190318150404.GB91631@rpi3.zyxst.net> <20190318152525.GC91631@rpi3.zyxst.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="vni90+aGYgRvsTuO" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.11.2 (2019-01-07) X-Rspamd-Queue-Id: 849F685B52 X-Spamd-Bar: ------- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=zyxst.net header.s=fm2 header.b=VO67TFcZ; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=LhXMQWme; spf=pass (mx1.freebsd.org: domain of tech-lists@zyxst.net designates 64.147.123.24 as permitted sender) smtp.mailfrom=tech-lists@zyxst.net X-Spamd-Result: default: False [-7.15 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[zyxst.net:s=fm2,messagingengine.com:s=fm2]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:64.147.123.24]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; DMARC_NA(0.00)[zyxst.net]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_COUNT_THREE(0.00)[4]; MX_GOOD(-0.01)[cached: in2-smtp.messagingengine.com]; DKIM_TRACE(0.00)[zyxst.net:+,messagingengine.com:+]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.84)[-0.839,0]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:11403, ipnet:64.147.123.0/24, country:US]; IP_SCORE(-1.60)[ipnet: 64.147.123.0/24(-4.49), asn: 11403(-3.44), country: US(-0.07)]; RCVD_IN_DNSWL_LOW(-0.10)[24.123.147.64.list.dnswl.org : 127.0.5.1] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 Mar 2019 00:23:34 -0000 --vni90+aGYgRvsTuO Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Mar 18, 2019 at 06:56:03PM +0100, Miroslav Lachman wrote: [...] Thanks for the example, I've saved it. Ok just one other question, which I might have found the answer to, or might not. I'm new to this virtualising on zfs even though ive used zfs for years. It's basically: I made a zvol, installed 12-R into it,. Where the disks option came up I chose the auto defaults for *ZFS* in the guest. I also selected encryption for both the virtual disk and swap. I think perhaps I shouldn't have done all this together in the same vm because with apache running in it, httpd got wedged (and then everything got wedged. sync wouldn't return). I think the top zfs layer and the encryption layer and the zfs underneath got too busy. Happily the server still responded to a shutdown -r and came back up. It's scrubbing the zpool to be on the safe side. Am I correct? In that I should have used UFS in the guest rather than zfs? Or was it the encryption? thanks, --=20 J. --vni90+aGYgRvsTuO Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEE8n3tWhxW11Ccvv9/s8o7QhFzNAUFAlyQNnIACgkQs8o7QhFz NAVQPw/+M6VlF4Ypb6WbYP9RWYaNjmtM78W2YFnLEzVHTGud2NRALXf5L/da2QJ5 SsRJbV6VshSGs3sWIeYOaCq6JviHBEf8V8UvOHDWSRfztoA35oZGaXntsGhu9gse qea34NzRQSnbgSP84/SGncMTF6SMNQGOzepcO1zpDOVbeidZwvBfq/yvRD98jjoR kBmcCR/z1Tg3Ib1tkXCdR1PHIM5XQE/DzSWxmRQIFk29Pwdif/ptsWKODVJUBAHj NSlLQeT3j8Rq+V3qffAM7xtKsXsb7ga4B+8boGdwM13SPyteCm0FAiVvN0oklkL0 YcaxlWEdpPGLSCK21iRwJJ65azfD4rTa+M7sv4/kcNI10lEBh2EaNw4j9gws87Fx wtQMZTcdljkv2ARYySXD/e6XEsHJ/bs6kwYb7vlgRY4bY7oScgs6CxiM5FijA63k WshkwmRRGZ5XuM8vJGIT6j89bS3cxnWLpv8A6AuLAXfkmqci9J2oPaO0G7i9v6BW +bphPbPCsVPCUAr2SLDMD3j3woGdXnYwb5VaRXqjgPFXj/iLqp100O4HTp3NNsDw LaFiYHZ6tnWCYCHwc0j7cxgndKfEkvsNs69lOZBdOuxX2/47deVu53t+BF0J+bH8 7J2oDjZts9SWbrAEnXQFzeM3HuFpEubxQI5z/lz6glApDlsA8uk= =PkcC -----END PGP SIGNATURE----- --vni90+aGYgRvsTuO-- From owner-freebsd-stable@freebsd.org Tue Mar 19 00:28:33 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 22365152A57A; Tue, 19 Mar 2019 00:28:33 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-lf1-f45.google.com (mail-lf1-f45.google.com [209.85.167.45]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 42E15860E4; Tue, 19 Mar 2019 00:28:32 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-lf1-f45.google.com with SMTP id p1so12995544lfk.9; Mon, 18 Mar 2019 17:28:32 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=iOhevDRY+hweLBoticrI6QocbmRP1h4+75kC+bSCKto=; b=KVrUWlsg96Wv302lQvQeFz8dE0GzKt2gg0xD0KiuNaYDcoSYJyH7qiIVGQ3uLSNx4b NycD9mK0zHokXGKSxzH3M9mIKqIN+nuanQVBX+t51KNKy/6FTLOG1SQ/KpWb5eqazdD/ RR7IVIxtFz8AGvuw8Y4kmswanSniHS20tuJh9nGnzJf444o+tyah787t9FVtrIWvvu+h FtWHl/kg2/yfZnCnKvU5L9yyCfCJq+/cjUha1LFJtxW9G0MJkW/ZHq1MRCKcuJvRgmBN +lHauUuwZD7PYypfO9KsmdVpDMbSHiAjdOIQKb8xEEA+tL9Xv6qTuW4QAJhHJ5DQI3hF tEYQ== X-Gm-Message-State: APjAAAXGsu7GHbxCI0sLljtjSMWD5e7nnGRmSH0k+8BtOmtywUwEnt3j rNjbqTPAL/wsRjS4ceNBEPshB1cLLPITGr5JBSTQKc/Z X-Google-Smtp-Source: APXvYqzgLR+MrOSBSqJ7l7eUg9B6nSuKVaXCGACinYKM2lJRq5bajWiaPGTDXQAmRpx3PwEq677WIDH8yC/yu5JoBUs= X-Received: by 2002:ac2:43ba:: with SMTP id t26mr11184041lfl.10.1552955304427; Mon, 18 Mar 2019 17:28:24 -0700 (PDT) MIME-Version: 1.0 References: <20190318150404.GB91631@rpi3.zyxst.net> <20190318152525.GC91631@rpi3.zyxst.net> <20190319002325.GD91631@rpi3.zyxst.net> In-Reply-To: <20190319002325.GD91631@rpi3.zyxst.net> From: Alan Somers Date: Mon, 18 Mar 2019 18:28:13 -0600 Message-ID: Subject: Re: bhyve zfs resizing To: "freebsd-virtualization@freebsd.org" , FreeBSD Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 42E15860E4 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.167.45 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-3.85 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.998,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; IP_SCORE(-1.32)[ip: (-0.59), ipnet: 209.85.128.0/17(-3.87), asn: 15169(-2.10), country: US(-0.07)]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[45.167.85.209.list.dnswl.org : 127.0.5.0]; NEURAL_HAM_SHORT(-0.51)[-0.512,0]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; MIME_TRACE(0.00)[0:+]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 Mar 2019 00:28:33 -0000 On Mon, Mar 18, 2019 at 6:24 PM tech-lists wrote: > > On Mon, Mar 18, 2019 at 06:56:03PM +0100, Miroslav Lachman wrote: > > [...] > > Thanks for the example, I've saved it. > > Ok just one other question, which I might have found the answer to, or > might not. I'm new to this virtualising on zfs even though ive used zfs > for years. It's basically: > > I made a zvol, installed 12-R into it,. Where the disks option came up I > chose the auto defaults for *ZFS* in the guest. I also selected > encryption for both the virtual disk and swap. I think perhaps I > shouldn't have done all this together in the same vm because with apache > running in it, httpd got wedged (and then everything got wedged. sync > wouldn't return). I think the top zfs layer and the encryption layer and > the zfs underneath got too busy. Happily the server still responded to a > shutdown -r and came back up. It's scrubbing the zpool to be on the safe > side. > > Am I correct? In that I should have used UFS in the guest rather than > zfs? Or was it the encryption? > > thanks, > -- > J. Running ZFS inside of a ZFS-backed guest will be slower than using UFS, but it should work just fine. I doubt that it was the cause of your problem. -Alan From owner-freebsd-stable@freebsd.org Tue Mar 19 00:49:34 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CD535152C3F9; Tue, 19 Mar 2019 00:49:34 +0000 (UTC) (envelope-from SRS0=58Nm=RW=quip.cz=000.fbsd@elsa.codelab.cz) Received: from elsa.codelab.cz (elsa.codelab.cz [94.124.105.4]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 339C186F97; Tue, 19 Mar 2019 00:49:34 +0000 (UTC) (envelope-from SRS0=58Nm=RW=quip.cz=000.fbsd@elsa.codelab.cz) Received: from elsa.codelab.cz (localhost [127.0.0.1]) by elsa.codelab.cz (Postfix) with ESMTP id F2F1C28417; Tue, 19 Mar 2019 01:49:22 +0100 (CET) Received: from illbsd.quip.test (ip-86-49-16-209.net.upcbroadband.cz [86.49.16.209]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by elsa.codelab.cz (Postfix) with ESMTPSA id D6E1D28416; Tue, 19 Mar 2019 01:49:15 +0100 (CET) Subject: Re: bhyve zfs resizing To: freebsd-virtualization@freebsd.org, FreeBSD References: <20190318150404.GB91631@rpi3.zyxst.net> <20190318152525.GC91631@rpi3.zyxst.net> <20190319002325.GD91631@rpi3.zyxst.net> From: Miroslav Lachman <000.fbsd@quip.cz> Message-ID: <49d8d837-b734-0770-20fd-a439c6436a4d@quip.cz> Date: Tue, 19 Mar 2019 01:49:10 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Firefox/52.0 SeaMonkey/2.49.3 MIME-Version: 1.0 In-Reply-To: <20190319002325.GD91631@rpi3.zyxst.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 339C186F97 X-Spamd-Bar: ++++ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [4.29 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.98)[0.980,0]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[quip.cz]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.96)[0.962,0]; RCVD_COUNT_THREE(0.00)[3]; IP_SCORE(0.19)[ip: (0.48), ipnet: 94.124.104.0/21(0.24), asn: 42000(0.19), country: CZ(0.07)]; MX_GOOD(-0.01)[cached: elsa.codelab.cz]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[4.105.124.94.list.dnswl.org : 127.0.10.0]; NEURAL_SPAM_LONG(0.97)[0.967,0]; R_SPF_NA(0.00)[]; FORGED_SENDER(0.30)[000.fbsd@quip.cz,SRS0=58Nm=RW=quip.cz=000.fbsd@elsa.codelab.cz]; RECEIVED_SPAMHAUS_PBL(0.00)[209.16.49.86.zen.spamhaus.org : 127.0.0.11]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:42000, ipnet:94.124.104.0/21, country:CZ]; FROM_NEQ_ENVFROM(0.00)[000.fbsd@quip.cz,SRS0=58Nm=RW=quip.cz=000.fbsd@elsa.codelab.cz]; MID_RHS_MATCH_FROM(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 Mar 2019 00:49:35 -0000 tech-lists wrote on 2019/03/19 01:23: > Am I correct? In that I should have used UFS in the guest rather than > zfs? Or was it the encryption? As Alan already wrote - you can use ZFS inside of the guest but I would never choose ZFS in zvol backed guest. I prefere UFS. It is faster and does not need so much memory as ZFS does. My VirtualBox and Bhyve guests are small. Sometimes <1GB of RAM. Sometimes 2GB of RAM and that is very small for ZFS. May be you can try to limit ZFS ARC size in /etc/sysctl.conf or in /boot/loader.conf vfs.zfs.arc_max Choose about 1/4 of your guest's RAM size and test it again. Kind regards Miroslav Lachman From owner-freebsd-stable@freebsd.org Tue Mar 19 12:43:01 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B45C0154F831 for ; Tue, 19 Mar 2019 12:43:01 +0000 (UTC) (envelope-from lwhsu.freebsd@gmail.com) Received: from mail-yw1-f65.google.com (mail-yw1-f65.google.com [209.85.161.65]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9CBE6837EF for ; Tue, 19 Mar 2019 12:43:00 +0000 (UTC) (envelope-from lwhsu.freebsd@gmail.com) Received: by mail-yw1-f65.google.com with SMTP id j128so8839458ywg.12 for ; Tue, 19 Mar 2019 05:43:00 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=l6iLrLP+0E2tdVAIO02jZWhF9A2sn8TXaj9VHl7v3V4=; b=Vk4oHl93aFk0nbsUSU6VFmtO0B6hDTkU0/TMjy3rmpKFrc9SHhWetXUw/RHPsYbVbL XJYKHL9+JR93J19XvfYeXP/rcX7Puay5Y4lNdhugliqmpeF3pmRKnmPv1tCjU1Od1zOI oUsQHYhJp5r26fF3sKkDgEVm7O0vLOk4uKFcUAZvfd5o29ZFfLIvnpshX325vZZRbX3k Us7ekxA4fAow3MVzk6wB3COv5AmDS8V3nKGiRRSCgGPyr+aRGeOsGi7S8VmHP1AZlFhY 2LLqqHmHyBMVRj4op9FBF0nz0y0tgmVS/jceux4PFTEq3Ox1TTOniHZ69aHYfXpa0p8H rt0Q== X-Gm-Message-State: APjAAAXSg0NETDGGtosL0tyey80mpOnaxApgqoTQR19+KflEyEdpAVp6 qdi2qgVnFYbGJjFB53dOviX4TZ6itsvgMG8GkvUjR7oIAEA= X-Google-Smtp-Source: APXvYqzuOMCoBk44zGrHY5IZNg3Yq1Sx5h+jK+OifYoieGyhX+inTFdkBL8UVLPATnFnD1HYSwF+HHChJV/z1jkZlhM= X-Received: by 2002:a25:4a07:: with SMTP id x7mr1668535yba.351.1552999373490; Tue, 19 Mar 2019 05:42:53 -0700 (PDT) MIME-Version: 1.0 From: Li-Wen Hsu Date: Tue, 19 Mar 2019 21:42:42 +0900 Message-ID: Subject: FreeBSD CI Weekly Report 2019-03-17 To: freebsd-testing@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 9CBE6837EF X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of lwhsufreebsd@gmail.com designates 209.85.161.65 as permitted sender) smtp.mailfrom=lwhsufreebsd@gmail.com X-Spamd-Result: default: False [-3.61 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; RCVD_COUNT_TWO(0.00)[2]; TAGGED_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; MIME_TRACE(0.00)[0:+]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; RCVD_TLS_LAST(0.00)[]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.39)[-0.390,0]; DMARC_NA(0.00)[freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[65.161.85.209.list.dnswl.org : 127.0.5.0]; IP_SCORE(-1.21)[ipnet: 209.85.128.0/17(-3.87), asn: 15169(-2.10), country: US(-0.07)]; FORGED_SENDER(0.30)[lwhsu@freebsd.org,lwhsufreebsd@gmail.com]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FORGED_RECIPIENTS(0.00)[freebsd-testing@freebsd.org,freebsd-stable@freebsd.org]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[lwhsu@freebsd.org,lwhsufreebsd@gmail.com]; TO_DOM_EQ_FROM_DOM(0.00)[] X-Mailman-Approved-At: Tue, 19 Mar 2019 12:55:30 +0000 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 Mar 2019 12:43:02 -0000 (bcc -current and -stable for more audience) FreeBSD CI Weekly Report 2019-03-17 =================================== Here is a summary of the FreeBSD Continuous Integration results for the period from 2019-03-11 to 2019-03-17. During this period, we have: * 1918 builds (93.2% passed, 2.3% failed, 86% exception) were executed on aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64, sparc64 architectures for head, stable/12, stable/11 branches. * 339 test runs (54.9% passed, 44.8% unstable, 0.3% exception) were executed on amd64, i386, riscv64 architectures for head, stable/12, stable/11 branches. * 15 doc buils (100% passed) (For more meaningful statistics, we omitted the numbers from experimental jobs) If any of the issues found by CI are in your area of interest or expertise please investigate the PRs listed below. The latest web version of this report is available at https://hackmd.io/s/SJc5jaHw4 and archive is available at http://hackfoldr.org/freebsd-ci-report/, any help is welcome. ## Failing Tests * https://ci.freebsd.org/job/FreeBSD-head-amd64-test/ * lib.libarchive.functional_test.test_fuzz_zip (flakey) See https://bugs.freebsd.org/236300 for more details * https://ci.freebsd.org/job/FreeBSD-head-i386-test/ * sys.netmap.ctrl-api-test.main * sys.opencrypto.runtests.main * lib.libc.regex.exhaust_test.regcomp_too_big * lib.libregex.exhaust_test.regcomp_too_big * sys.kern.coredump_phnum_test.coredump_phnum WIP: https://reviews.freebsd.org/D18495 * (New) lib.libc.sys.sendfile_test.fd_positive_shm_v4 * (New) lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4 * https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/ * sbin.bectl.bectl_test.bectl_mount * sys.netmap.ctrl-api-test.main * sys.opencrypto.runtests.main * lib.libc.regex.exhaust_test.regcomp_too_big * lib.libregex.exhaust_test.regcomp_too_big * sys.kern.coredump_phnum_test.coredump_phnum WIP: https://reviews.freebsd.org/D18495 * https://ci.freebsd.org/job/FreeBSD-stable-11-amd64-test/ * usr.bin.procstat.procstat_test.kernel_stacks * https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/ * sys.netmap.ctrl-api-test.main * sys.opencrypto.runtests.main * usr.bin.procstat.procstat_test.kernel_stacks * local.kyua.* (31 cases) * local.lutok.* (3 cases) * lib.libc.sys.sendfile_test.fd_positive_shm_v4 * lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4 ## Failing Tests (from experimental jobs) * https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/ * common.rates.t_dtrace_contrib.tst_switchrate_d * common.syscall.t_dtrace_contrib.tst_args_d * common.misc.t_dtrace_contrib.tst_dynopt_d * common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh * common.ip.t_dtrace_contrib.tst_localsctpstate_ksh * https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/ * There are ~60 failing cases, including flakey ones, see https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/ for more details ## Disabled Tests * lib.libc.sys.mmap_test.mmap_truncate_signal https://bugs.freebsd.org/211924 * sys.fs.tmpfs.mount_test.large https://bugs.freebsd.org/212862 * sys.fs.tmpfs.link_test.kqueue https://bugs.freebsd.org/213662 * sys.kqueue.libkqueue.kqueue_test.main https://bugs.freebsd.org/233586 * usr.bin.procstat.procstat_test.command_line_arguments https://bugs.freebsd.org/233587 * usr.bin.procstat.procstat_test.environment https://bugs.freebsd.org/233588 ## Open Issues * Flakey test case: lib.libarchive.functional_test.test_fuzz_zip https://bugs.freebsd.org/236300 ### Cause build fails * [233339: genassym.o build race](https://bugs.freebsd.org/233339) * Patch available: https://people.freebsd.org/~bdrewery/patches/PR233339.diff * [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: machine/endian.h: No such file or directory](https://bugs.freebsd.org/233735) * [233769: Possible build race: ld: error: unable to find library -lgcc_s](https://bugs.freebsd.org/233769) ### Others [Tickets related to testing@](https://preview.tinyurl.com/y9maauwg) From owner-freebsd-stable@freebsd.org Tue Mar 19 13:49:13 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C4CB615512B8 for ; Tue, 19 Mar 2019 13:49:12 +0000 (UTC) (envelope-from erica.turner@gobalbizsol.com) Received: from n1nlsmtp02.shr.prod.ams1.secureserver.net (n1nlsmtp02.prod.ams1.secureserver.net [188.121.43.194]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "relay-hosting.secureserver.net", Issuer "Starfield Secure Certificate Authority - G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 192DB85A6F for ; Tue, 19 Mar 2019 13:49:01 +0000 (UTC) (envelope-from erica.turner@gobalbizsol.com) Received: from n3plcpnl0281.prod.ams3.secureserver.net ([160.153.156.29]) by : HOSTING RELAY : with ESMTP id 6F5uh0nurFRdl6F5uhMyz0; Tue, 19 Mar 2019 06:47:54 -0700 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gobalbizsol.com; s=default; h=Content-Type:MIME-Version:Message-ID:Date: Subject:To:From:Sender:Reply-To:Cc:Content-Transfer-Encoding:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:In-Reply-To:References:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=sp4BhqWXTMScuCwpO8MqO72cGkBrW0jTS/YRPdr8LgQ=; b=Vfl391kGXMqiwfvOxjNiWi1ST8 cM628085hdIJ01MOGHSihdjEAp6bb7U6D456BxCLmV1oS9kLOSvp2kK5F6XrCYbCv+1rZxYyjB13R YI/T3BoiQEUXwOB94J9B7HnznfKnkWsQCA8IvysD9f/n+na6jVTfgxepS19qSgD3r/KMzO7WLNwkV ZVJrw2IiApJWXXz6yN8S7schnVVm7+ZU8shd2Fvl41YCgSgJLiRY1hV8j9ICNKmE13EZLy0Wa5fVt d6hUsPep0/w1ryWneamdAlyQ15qt2Qu7Kdmh84xE+U2CHgV6JUqAxO8iL/iP3/cTKoNUARYDg3kzP pByNeIIw==; Received: from [122.166.166.3] (port=50172 helo=dellPC) by n3plcpnl0281.prod.ams3.secureserver.net with esmtpsa (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256) (Exim 4.91) (envelope-from ) id 1h6F5t-00GBVn-Sn for freebsd-stable@freebsd.org; Tue, 19 Mar 2019 06:47:54 -0700 From: "Erica Turner" To: Subject: Fedora Contact List Date: Tue, 19 Mar 2019 09:47:54 -0400 Message-ID: <220101d4de5a$5a8a1a10$0f9e4e30$@gobalbizsol.com> MIME-Version: 1.0 X-Mailer: Microsoft Outlook 15.0 Thread-Index: AdTeWljNk+m7Bhs/S1mr91HsN+XQZQ== Content-Language: en-us X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - n3plcpnl0281.prod.ams3.secureserver.net X-AntiAbuse: Original Domain - freebsd.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - gobalbizsol.com X-Get-Message-Sender-Via: n3plcpnl0281.prod.ams3.secureserver.net: authenticated_id: erica.turner@gobalbizsol.com X-Authenticated-Sender: n3plcpnl0281.prod.ams3.secureserver.net: erica.turner@gobalbizsol.com X-Source: X-Source-Args: X-Source-Dir: X-CMAE-Envelope: MS4wfJpcLoej/cqq5xrTUVwbwmhuy+io2h0ADfQEl/yc/6MMfm4hBXdu4iKejdWCvDbP8rgGhsBuumT+33GS7a3K0UQjc4rEE/VHpQFsWQBFe64BM+knBEXe Kl/KAHTnsZ58CwJUL/lo77+5tLDhpA/izA+hFZXi52XLviVk0X6eNjaOzdBnNpM8Rb2HgUC7QoRbcZbx25ASvuxkdn4uE6qiAp9vMREuCeIUlfRK5Btmha2P X-Rspamd-Queue-Id: 192DB85A6F X-Spamd-Bar: ++ Authentication-Results: mx1.freebsd.org; dkim=none (invalid DKIM record) header.d=gobalbizsol.com header.s=default header.b=Vfl391kG; spf=pass (mx1.freebsd.org: domain of erica.turner@gobalbizsol.com designates 188.121.43.194 as permitted sender) smtp.mailfrom=erica.turner@gobalbizsol.com X-Spamd-Result: default: False [2.13 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; MX_INVALID(0.50)[greylisted]; RWL_MAILSPIKE_GOOD(0.00)[194.43.121.188.rep.mailspike.net : 127.0.0.18]; R_SPF_ALLOW(-0.20)[+ip4:188.121.43.0/24]; HAS_X_SOURCE(0.00)[]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gobalbizsol.com:~]; HAS_X_ANTIABUSE(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[3.166.166.122.zen.spamhaus.org : 127.0.0.10]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; ASN(0.00)[asn:26496, ipnet:188.121.40.0/22, country:US]; MID_RHS_MATCH_FROM(0.00)[]; HAS_X_AS(0.00)[erica.turner@gobalbizsol.com]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.64)[0.642,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; DMARC_NA(0.00)[gobalbizsol.com]; NEURAL_SPAM_MEDIUM(0.60)[0.601,0]; RCPT_COUNT_ONE(0.00)[1]; IP_SCORE(0.29)[ip: (0.74), ipnet: 188.121.40.0/22(0.55), asn: 26496(0.21), country: US(-0.07)]; NEURAL_SPAM_LONG(0.40)[0.398,0]; RCVD_IN_DNSWL_NONE(0.00)[194.43.121.188.list.dnswl.org : 127.0.5.0]; R_DKIM_PERMFAIL(0.00)[gobalbizsol.com:s=default]; HAS_X_GMSV(0.00)[erica.turner@gobalbizsol.com]; RCVD_TLS_ALL(0.00)[] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 Mar 2019 13:49:13 -0000 Hi, Thank you for taking the time to read this email. I would like to know if you are interested in acquiring Fedora Contact List. We offer email lists based on your requirements. If you could send me your target audience (Industry / Geography / Job Titles), I'll come up with the data counts, costs & more information. Please let me know if interested, So that I can send you something much better for less than you are currently paying. If you do not wish to receive our email kindly reply back with exclude in the subject line. Erica turner Marketing Executive From owner-freebsd-stable@freebsd.org Tue Mar 19 15:34:46 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8C69F1553D16 for ; Tue, 19 Mar 2019 15:34:46 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: from mail-it1-f178.google.com (mail-it1-f178.google.com [209.85.166.178]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7EA3189F12 for ; Tue, 19 Mar 2019 15:34:45 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: by mail-it1-f178.google.com with SMTP id l4so12798288ite.1 for ; Tue, 19 Mar 2019 08:34:45 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=ga0KfW+nPIf3XMCIx+NWUwHkQiDJe/6zjcVXKwLnikM=; b=Rjcqvg3G+I+Zh5JrosSBtnj9enRm84IztAzsneB196HP0cncEIEfJvHDT8GXhdQjRW dHDfd4CKuIoAtwMUW+Kcr08I1RnI6qkRKSnk6E08h0QX9SHjL/uIet+1mJkAs3tVFioS 8uWXJaDQCAuw6FFMysTfpRvTBZjBnra72pKH/q7asZPK7jRfOOnVTPhBMOF14s6sLjQ/ 14u2eL1ZUeWdjd4PV4Lm4Kfrvj+gOnpoEnZ7r5HuCQFEkYAKFXaNlAPSGnj7u3izzHgv PmE3zeV44Cy6p8W2AnNorIgTflYpZ5nDDV2icWsrXZ4Im/ab/Uf4WoFZPrK+21Ww2m2Z A+2w== X-Gm-Message-State: APjAAAU3BXjtUDTv200MyukUanM7bF+EnpHk/UhQMNr23a3RKs2IW66x 18chlWzIwAdO+HB40I8JJj5vWkZxpaXTDEUsDyk= X-Google-Smtp-Source: APXvYqz7mIOCYGrFUFaGF3socFja1oX/0XN19ljOQmYzW+KHCPyOw3OYUVJiQ+tGjAsP8DiEmaVnixIR6pgBBweLvyI= X-Received: by 2002:a02:c9:: with SMTP id 192mr1828713jaa.129.1553009679296; Tue, 19 Mar 2019 08:34:39 -0700 (PDT) MIME-Version: 1.0 References: <35A0AE5B-B25D-4067-86E3-325E65F3C1F4@gmail.com> In-Reply-To: <35A0AE5B-B25D-4067-86E3-325E65F3C1F4@gmail.com> From: Ed Maste Date: Tue, 19 Mar 2019 11:34:26 -0400 Message-ID: Subject: Re: ifuncs check flawed? To: Dan Allen Cc: "freebsd-stable@freebsd.org Mailing FreeBSD-STABLE" Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 7EA3189F12 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of carpeddiem@gmail.com designates 209.85.166.178 as permitted sender) smtp.mailfrom=carpeddiem@gmail.com X-Spamd-Result: default: False [-4.78 / 15.00]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; IP_SCORE(-2.81)[ip: (-8.02), ipnet: 209.85.128.0/17(-3.87), asn: 15169(-2.10), country: US(-0.07)]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.96)[-0.961,0]; FORGED_SENDER(0.30)[emaste@freebsd.org,carpeddiem@gmail.com]; FREEMAIL_TO(0.00)[gmail.com]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[emaste@freebsd.org,carpeddiem@gmail.com]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; MIME_TRACE(0.00)[0:+]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[178.166.85.209.list.dnswl.org : 127.0.5.0]; RCVD_TLS_LAST(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; SUBJECT_ENDS_QUESTION(1.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 Mar 2019 15:34:46 -0000 On Mon, 18 Mar 2019 at 13:03, Dan Allen wrote: > > The buildworld and buildkernel steps both immediately fail due to the linker not supporting ifuncs. By default FreeBSD/i386 uses lld as the bootstrap linker (i.e., the linker used for building the kernel, libraries, and userland binaries) but still installs GNU ld as /usr/bin/ld on stable/12 due to issues in the ports tree. There are a few different ways you could address this: 1. Build either the buildworld or kernel-toolchain targets before make buildkernel, which will then use the built toolchain including lld. 2. Set LD=ld.lld to explicitly use lld for the kernel link. 3. Build and install world WITH_LLD_IS_LD in src.conf, so that /usr/bin/ld is lld. From owner-freebsd-stable@freebsd.org Tue Mar 19 20:54:27 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B8DC51538997 for ; Tue, 19 Mar 2019 20:54:27 +0000 (UTC) (envelope-from danallen46@gmail.com) Received: from mail-pg1-x533.google.com (mail-pg1-x533.google.com [IPv6:2607:f8b0:4864:20::533]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7B6F56F17E; Tue, 19 Mar 2019 20:54:26 +0000 (UTC) (envelope-from danallen46@gmail.com) Received: by mail-pg1-x533.google.com with SMTP id q206so48737pgq.4; Tue, 19 Mar 2019 13:54:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:message-id:mime-version:subject:date:in-reply-to:cc:to :references; bh=0Q4c3SeAjqmRuh0HxQNgDE50fUEg2Myoo4z50A6rPDo=; b=ME2KkCb/bBYG+s4ZkHSmRMnKVcOvYoDX9OWOjcuzafOMov008buPwtcv9YQABLHKB8 UPAx+MbRa9SanHm4t9NsDm6LEkAJotdW9+ep0TiV3byImS2VdtOZqbLHlDs3UTL29seJ cg8GkwMMt+00Kc3/mNDLgs/+3QJhN9p4zvDpGGHkGz1rR/NgvFqwJMQt9ypE+fuH9NrG cqOnFZpGleJxzGiRf0inkk7YIFKu7AiUPUEzUe6HfKKmXwdeS1AcLN8Kcb6UvUzPWcrz UgPuaKW8oafhCtUJJXmFX87o9QiK69KGbk2uNjSLYA33Cqq3ulQZIH1saQ5NJQVLplyT 6USQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:message-id:mime-version:subject:date :in-reply-to:cc:to:references; bh=0Q4c3SeAjqmRuh0HxQNgDE50fUEg2Myoo4z50A6rPDo=; b=Yhknn2VsykOvntW3kH/PQSHr2O9DDfNbnAvKK7OOPkPtaLrThNBDVhRGtdLHd+eXbc XzCTT/y4PLwDbcmhJdeztj24navYDUWIYZLMZhfkVWiM744xmqatTjJrcEhbGGcG+yub lx80GqofOtYGhuKFaz3BVO1g4QOOC4RJaFL2s357xKwIqd046NywC3ptXQqv62wG5nvm 7Mig3Zx9Nm6Zl2IN7sty5eHcLeZKF+hNBu/ZNYhOi83tNI3q8wrfhkDvi/LfwHQHIvZq JGHFV8mOfri0IN0O+a4EuSQR+Do6SmoZIy2gOrrFWFJXlanksPJynINCr4NN/1Xb6iR/ eTwQ== X-Gm-Message-State: APjAAAWBDbXScVWDIJmePfdbxpKeOGe5MA5JzQPXdI0isHWGY6UQj+sD p5eZk2vXE1qZ2rNvMh8WK9Ijv+8XQC0= X-Google-Smtp-Source: APXvYqxFDutVQTYItVRblDcildO8XJLUrvNJMONKBkxU0WmTf7GRLgtTsfVcxsLyrT71eZUpXVqUIA== X-Received: by 2002:aa7:8051:: with SMTP id y17mr3957541pfm.29.1553028865129; Tue, 19 Mar 2019 13:54:25 -0700 (PDT) Received: from [192.168.0.4] (75-174-44-110.boid.qwest.net. [75.174.44.110]) by smtp.gmail.com with ESMTPSA id n5sm16965750pgp.63.2019.03.19.13.54.24 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 19 Mar 2019 13:54:24 -0700 (PDT) From: Dan Allen Message-Id: <046A9FEB-32C5-40E2-8E9D-1D3503101056@gmail.com> Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: ifuncs check flawed? Date: Tue, 19 Mar 2019 14:54:24 -0600 In-Reply-To: Cc: "freebsd-stable@freebsd.org Mailing FreeBSD-STABLE" To: Ed Maste References: <35A0AE5B-B25D-4067-86E3-325E65F3C1F4@gmail.com> X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: 7B6F56F17E X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=ME2KkCb/; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of danallen46@gmail.com designates 2607:f8b0:4864:20::533 as permitted sender) smtp.mailfrom=danallen46@gmail.com X-Spamd-Result: default: False [-5.32 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[gmail.com]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.97)[-0.968,0]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FROM_EQ_ENVFROM(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; MIME_TRACE(0.00)[0:+,1:+]; RCVD_TLS_LAST(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[3.3.5.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; IP_SCORE(-2.84)[ip: (-9.23), ipnet: 2607:f8b0::/32(-2.78), asn: 15169(-2.11), country: US(-0.07)] Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 Mar 2019 20:54:28 -0000 > On 19 Mar 2019, at 9:34 AM, Ed Maste wrote: >=20 > There are a few different ways you could address this: > 1. Build either the buildworld or kernel-toolchain targets before make > buildkernel, which will then use the built toolchain including lld. I did this, and it did not work. I always build the system in the = canonical order: buildworld buildkernel installkernel installworld That is why I think the check is flawed! I am using the lld linker. It = is present in the snapshot. The system should be using it, but it = immediately fails due to the aforementioned checks. That is the bug = that I am raising. Dan From owner-freebsd-stable@freebsd.org Tue Mar 19 22:51:50 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4F4E5153E7E1 for ; Tue, 19 Mar 2019 22:51:50 +0000 (UTC) (envelope-from snow@teardrop.org) Received: from hoopy.teardrop.org (hoopy.teardrop.org [52.27.92.245]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 584F972997 for ; Tue, 19 Mar 2019 22:51:49 +0000 (UTC) (envelope-from snow@teardrop.org) Received: by hoopy.teardrop.org (Postfix, from userid 1002) id BE20ADDD3C; Tue, 19 Mar 2019 22:53:19 +0000 (UTC) Date: Tue, 19 Mar 2019 22:53:19 +0000 From: James Snow To: freebsd-stable@freebsd.org Subject: boot/pxeboot broken in freebsd-12? Message-ID: <20190319225319.GD91288@teardrop.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.11.2 (2019-01-07) X-Rspamd-Queue-Id: 584F972997 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of snow@teardrop.org designates 52.27.92.245 as permitted sender) smtp.mailfrom=snow@teardrop.org X-Spamd-Result: default: False [-2.49 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.997,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:52.27.92.245]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[teardrop.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_TRACE(0.00)[0:+]; MX_GOOD(-0.01)[hoopy.teardrop.org]; NEURAL_HAM_SHORT(-0.23)[-0.229,0]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:16509, ipnet:52.24.0.0/14, country:US]; MID_RHS_MATCH_FROM(0.00)[]; IP_SCORE(-0.95)[ipnet: 52.24.0.0/14(-3.39), asn: 16509(-1.32), country: US(-0.07)]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 Mar 2019 22:51:50 -0000 Hello -stable, We have a PXE environemt that builds FreeBSD-11 boxes. We've started to dip our toes into the 12.x waters, but have had trouble getting FreeBSD-12 to pxeboot. It would crash and burn like so: Startup error in /boot/lua/loader.lua: LUA ERROR: cannot open /boot/lua/loader.lua: device not configured On a whim, I pulled the boot/pxeboot binary from our FreeBSD-11 environment into the new FreeBSD-12 environment, and PXE clients started coming right up. Is FreeBSD-12's pxeboot broken or have I missed something? -Snow From owner-freebsd-stable@freebsd.org Tue Mar 19 23:14:28 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5E9A4153F265 for ; Tue, 19 Mar 2019 23:14:28 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-qk1-x733.google.com (mail-qk1-x733.google.com [IPv6:2607:f8b0:4864:20::733]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4EC90735CA for ; Tue, 19 Mar 2019 23:14:27 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-qk1-x733.google.com with SMTP id m65so5395035qkl.11 for ; Tue, 19 Mar 2019 16:14:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=zWrJpsV90+95yVJPiXbPQHQgVar/nvVmzX3c9yF/nrQ=; b=U+AmTEBVrU/kfCz3CPffPmiaSg6lAhKI8ssU5xn/3nbquz3Dxwq2b7kfZbCU0TMzHu 9NLthswIV2weaNh/u2uB5RUbp+H589JPwABI0vzR6DbhIMCx3uiI0pFHh1ghVpyz06OE r2DbeAiKcGFjYfaYTCdNMMcQ200xzfwgZwWL7sgALsQ8aphRLp6xZMLqQGHjANdU+H9Z CsJeSgpQBvBcGnwMQjsvyMxP4jOcE5gI8bAxEkXMNSEsGJzhOpRnzphKV9uaP+0dY3es cg3RXFs5yTtVksx6ZoAqRYmCIwvgwAUaiYc2gwbRqqx9HTL9gYrwEjT5SrwLGEz7U1vc DFDg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=zWrJpsV90+95yVJPiXbPQHQgVar/nvVmzX3c9yF/nrQ=; b=picZjndvsXFIIl9DKcs8zlrCwRlyBLDmkMrjtyyr7k6GLx7U2fSXW/GAl8fdZnE170 o0GlS/APaLUbwtHBtfBwBUQAinSF8o/hC9+JAl3J/1OrYe6fRjQzNON1rHpypXXUplhs MsWDHbfPpvuGXAVmUMjENgqIiFAPeJoT0JLeKwGMj/DAgmAfi1gBj4kSLGMxSFePxq/2 vhE8v6rL5ewSH/wV5mPmrc9gpPj7Ct28JWDkQl/lbZ3EnWruMQnueshbehHD4WShM5LO i0hVuhr0sHgD/W5IngLkFmtW+osjlSgmrR6PD8bK3PKFob3AqNlTKUCxWPZZ+H4Jansg +5Vw== X-Gm-Message-State: APjAAAUqITwB0wu1bt+5MaOG3l4AwrmZf0YOm9mZa0TkGkzhrGsT0Gkq FeKkgJPPtsTnKO+r8L/cOpGto7kwvSaZ6QcJkerUlw== X-Google-Smtp-Source: APXvYqyd/C+zOU8cGNlmCsDBE90ko5Ng+aoCfpap4jLlhSkIJCfJKfCKxPPX/YZJRo2Tf4jTRV1FTDqYmE30+j1TXcg= X-Received: by 2002:a05:620a:1194:: with SMTP id b20mr4077755qkk.258.1553037266623; Tue, 19 Mar 2019 16:14:26 -0700 (PDT) MIME-Version: 1.0 References: <20190319225319.GD91288@teardrop.org> In-Reply-To: <20190319225319.GD91288@teardrop.org> From: Warner Losh Date: Tue, 19 Mar 2019 17:14:15 -0600 Message-ID: Subject: Re: boot/pxeboot broken in freebsd-12? To: James Snow Cc: FreeBSD-STABLE Mailing List X-Rspamd-Queue-Id: 4EC90735CA X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20150623.gappssmtp.com header.s=20150623 header.b=U+AmTEBV X-Spamd-Result: default: False [-4.77 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20150623.gappssmtp.com:s=20150623]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_SHORT(-0.91)[-0.907,0]; IP_SCORE(-2.85)[ip: (-9.31), ipnet: 2607:f8b0::/32(-2.79), asn: 15169(-2.11), country: US(-0.07)]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: ALT1.aspmx.l.google.com]; DKIM_TRACE(0.00)[bsdimp-com.20150623.gappssmtp.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[3.3.7.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; R_SPF_NA(0.00)[]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; SUBJECT_ENDS_QUESTION(1.00)[]; MIME_TRACE(0.00)[0:+,1:+]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; RCVD_TLS_LAST(0.00)[]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 Mar 2019 23:14:28 -0000 On Tue, Mar 19, 2019 at 4:53 PM James Snow wrote: > Hello -stable, > > We have a PXE environemt that builds FreeBSD-11 boxes. We've started > to dip our toes into the 12.x waters, but have had trouble getting > FreeBSD-12 to pxeboot. It would crash and burn like so: > > Startup error in /boot/lua/loader.lua: > LUA ERROR: cannot open /boot/lua/loader.lua: device not configured > > On a whim, I pulled the boot/pxeboot binary from our FreeBSD-11 > environment into the new FreeBSD-12 environment, and PXE clients started > coming right up. > > Is FreeBSD-12's pxeboot broken or have I missed something? > You need to set the NFS mount point properly. I've been able to boot the FreeBSD 12.0R installer with PXE (after fixing some issues downstream) and had that error before I had dnsmasq answering queries properly: dhcp-vendorclass=BIOS,PXEClient:Arch:00000 dhcp-userclass=FreeBSD,FreeBSD dhcp-boot=net:BIOS,12.0R-i386-bootonly/boot/pxeboot,10.0.0.5,10.0.0.5 dhcp-boot=net:BIOS,12.0R-i386-bootonly/boot/pxeboot,10.0.0.5,10.0.0.5 dhcp-option=net:BIOS,option:root-path,10.0.0.5:/tftpboot/12.0R-i386-bootonly dhcp-host=mr_noodle,set:mr_noodle dhcp-boot=tag:mr_noodle,12.0R-i386-bootonly/boot/pxeboot,10.0.0.5,10.0.0.5 dhcp-option=tag:mr_noodle,option:root-path,10.0.0.5: /tftpboot/12.0R-i386-bootonly dhcp-boot=tag:FreeBSD,12.0R-i386-bootonly/boot/pxeboot,10.0.0.5,10.0.0.5 dhcp-option=tag:FreeBSD,option:root-path,10.0.0.5: /tftpboot/12.0R-i386-bootonly is what I used in dnsmasq to get the job done. It was likely overkill (10.0.0.5 was the NFS, ftfpd and other servers for this exercise). I had to (a) create a blank /etc/fstab in the mdconfig mounted image and (b) create the proper /etc/resolv.conf in the F4 shell window just after I hit commit to make things work. And then configure the network by hand because the installer's config was wrong. So we've had some regression, just not the regression you are seeing. Warner From owner-freebsd-stable@freebsd.org Wed Mar 20 07:28:14 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D7665154A850 for ; Wed, 20 Mar 2019 07:28:14 +0000 (UTC) (envelope-from borjam@sarenet.es) Received: from cu01176b.smtpx.saremail.com (cu01176b.smtpx.saremail.com [195.16.151.151]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 89FE4897E6 for ; Wed, 20 Mar 2019 07:28:13 +0000 (UTC) (envelope-from borjam@sarenet.es) Received: from [172.16.8.5] (unknown [192.148.167.11]) by proxypop01.sare.net (Postfix) with ESMTPA id 8D3619DCD7D for ; Wed, 20 Mar 2019 08:28:03 +0100 (CET) From: Borja Marcos Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Problem with Emulex OCE 10 GbE cards Message-Id: <085EA458-D4EE-463E-AE7D-1844D5611751@sarenet.es> Date: Wed, 20 Mar 2019 08:28:02 +0100 To: freebsd-stable Stable X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: 89FE4897E6 X-Spamd-Bar: ------ X-Spamd-Result: default: False [-6.16 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:195.16.151.0/24]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCPT_COUNT_ONE(0.00)[1]; RCVD_TLS_LAST(0.00)[]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[smtp.sarenet.es,smtp.sarenet.es,smtp.sarenet.es]; DMARC_POLICY_ALLOW(-0.50)[sarenet.es,reject]; RCVD_IN_DNSWL_NONE(0.00)[151.151.16.195.list.dnswl.org : 127.0.10.0]; NEURAL_HAM_SHORT(-0.92)[-0.925,0]; TO_MATCH_ENVRCPT_ALL(0.00)[]; IP_SCORE(-2.92)[ip: (-7.97), ipnet: 195.16.128.0/19(-3.71), asn: 3262(-2.97), country: ES(0.05)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:3262, ipnet:195.16.128.0/19, country:ES]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 20 Mar 2019 07:28:15 -0000 Hello, I am trying to use several Emulex OpenConnect cards and the driver fails = to attach them. oce0: mem = 0x92c00000-0x92c03fff,0x92bc0000-0x92bdffff,0x92be0000-0x92bfffff irq 38 = at device 0.7 on pci2 oce0: oce_mq_create failed - cmd status: 2 oce0: MQ create failed device_attach: oce0 attach returned 1 Any ideas? Running 12-STABLE as of last Friday, it also failed on = 12-RELEASE. none24@pci0:16:0:6: class=3D0x020000 card=3D0xe62910df = chip=3D0x070019a2 rev=3D0x02 hdr=3D0x00 vendor =3D 'Emulex Corporation' device =3D 'OneConnect OCe10100/OCe10102 Series 10 GbE' class =3D network subclass =3D ethernet none25@pci0:16:0:7: class=3D0x020000 card=3D0xe62910df = chip=3D0x070019a2 rev=3D0x02 hdr=3D0x00 vendor =3D 'Emulex Corporation' device =3D 'OneConnect OCe10100/OCe10102 Series 10 GbE' class =3D network subclass =3D ethernet Thanks! Borja. From owner-freebsd-stable@freebsd.org Wed Mar 20 09:43:42 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 93A39154DBC2 for ; Wed, 20 Mar 2019 09:43:42 +0000 (UTC) (envelope-from juanjones100@googlemail.com) Received: from mail-wr1-x435.google.com (mail-wr1-x435.google.com [IPv6:2a00:1450:4864:20::435]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9384F8DB3C for ; Wed, 20 Mar 2019 09:43:41 +0000 (UTC) (envelope-from juanjones100@googlemail.com) Received: by mail-wr1-x435.google.com with SMTP id w1so1969545wrp.2 for ; Wed, 20 Mar 2019 02:43:41 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:content-transfer-encoding:from:mime-version:date :subject:message-id:to; bh=waZ5A6wVZlwg49/FiPGOB17pptuP8tP2xrNBSniNgiA=; b=p1HRGiPMfjQa+gVcqJalbGGawbBpGqMDUt5I2JumHdIxtTZIeGIhJpQfw5yA6mzoo1 23K/mXCpGn2LiKe8TQR7KZV0b7o25CwgrPVAHrQ5ECujUc+touP9DRhL8/1Uid8VLIK+ vGviFRbIRtTfq/y0F0duK1elNVlm4s7mVO/C7dExgzDMsotXPqYnphKKdLOH1Lzc+BFr jEPJIuYypA2hKBhkvAEOlUZK+PuUUxNmb0c2ITQK9ntXNz8BrIlHzXK+QFuTNKrBBiUo PJPbQFAw3ZeK9CB9HQAivtEB5tdbj/5KZeodnee3duT8ENuVxtwFz9q7OZIG3Stl75eS kBew== X-Gm-Message-State: APjAAAXqLVCBgsRRxeK2VhDYt0vj/YF59roFE3fiAll1dlNYyCjHuo4u fG8ib2Djijb6FSpI4Hqaf3AqVB4O X-Google-Smtp-Source: APXvYqynjpDoklF1xqbXk8mBsmSY2Cyk0Jmool3rpgSzMDqW3dspqCADPIwCpbKb7eZMqtsXOzuI4Q== X-Received: by 2002:adf:edca:: with SMTP id v10mr1551661wro.157.1553075019137; Wed, 20 Mar 2019 02:43:39 -0700 (PDT) Received: from [192.168.1.244] (host109-158-49-84.range109-158.btcentralplus.com. [109.158.49.84]) by smtp.gmail.com with ESMTPSA id o63sm1641899wmo.46.2019.03.20.02.43.37 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 20 Mar 2019 02:43:37 -0700 (PDT) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit From: Juan Jones Mime-Version: 1.0 (1.0) Date: Wed, 20 Mar 2019 09:43:36 +0000 Subject: Re: Don't Wait! Get your website top ranked...TODAY! Message-Id: <0CAC3EE9-CCB5-494F-959E-AC2852F20D56@googlemail.com> To: freebsd-stable@freebsd.org X-Mailer: iPad Mail (16D57) X-Rspamd-Queue-Id: 9384F8DB3C X-Spamd-Bar: ----- X-Spamd-Result: default: False [-5.21 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; MV_CASE(0.50)[]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[googlemail.com]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[googlemail.com:+]; DMARC_POLICY_ALLOW(-0.50)[googlemail.com,quarantine]; MX_GOOD(-0.01)[alt3.gmail-smtp-in.l.google.com,alt4.gmail-smtp-in.l.google.com,gmail-smtp-in.l.google.com,alt2.gmail-smtp-in.l.google.com,alt1.gmail-smtp-in.l.google.com]; SUBJECT_ENDS_EXCLAIM(0.00)[]; NEURAL_HAM_SHORT(-0.94)[-0.944,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[googlemail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[googlemail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; FAKE_REPLY(1.00)[]; R_DKIM_ALLOW(-0.20)[googlemail.com:s=20161025]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; IP_SCORE(-2.76)[ip: (-9.24), ipnet: 2a00:1450::/32(-2.38), asn: 15169(-2.11), country: US(-0.07)]; RCVD_IN_DNSWL_NONE(0.00)[5.3.4.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 20 Mar 2019 09:43:42 -0000 Please remove contact@tfsrcymru.org.uk from your distribution list From owner-freebsd-stable@freebsd.org Wed Mar 20 11:28:31 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BABCF1550D6A for ; Wed, 20 Mar 2019 11:28:31 +0000 (UTC) (envelope-from anna@e9.kccode.cn) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 3741C91E2B for ; Wed, 20 Mar 2019 11:28:31 +0000 (UTC) (envelope-from anna@e9.kccode.cn) Received: by mailman.ysv.freebsd.org (Postfix) id EB8E11550D68; Wed, 20 Mar 2019 11:28:30 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C693E1550D67 for ; Wed, 20 Mar 2019 11:28:30 +0000 (UTC) (envelope-from anna@e9.kccode.cn) Received: from mail.kccode.cn (mail.kccode.cn [198.2.247.15]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E162D91E27 for ; Wed, 20 Mar 2019 11:28:28 +0000 (UTC) (envelope-from anna@e9.kccode.cn) Received: from mail.kccode.cn (mail.kccode.cn [127.0.0.1]) by mail.kccode.cn (Postfix) with ESMTP id 44PSMx1pQgz814 for ; Wed, 20 Mar 2019 19:28:13 +0800 (CST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kccode.cn; h= content-type:content-type:subject:subject:date:date:reply-to:to :from:from:mime-version:message-id; s=dkim; i=@e9.kccode.cn; t= 1553081293; x=1584617294; bh=oGnyqqZIQNsu4GCn0WeFTkmdse0HRPutlbE 1NhJB+t0=; b=LygTGa+WTecWPBAU+GN95c2qiv2Q9DMAzdSwTMvWAreWUh0v99K dLHCnEH2fUzfehkBgxdJxmBnPvp4HrEcsdlCbJ31G2+M3F2Z7r/M3hbMGAPPqNda ohGNIchfvJraqZs+bPsz+wi1u4mlLcojkbd5wa6eXY2tNnZCkxfIO6y4= X-Virus-Scanned: amavisd-new at mail.kccode.cn Received: from mail.kccode.cn ([127.0.0.1]) by mail.kccode.cn (mail.kccode.cn [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id 1IAHnoGkhU-l for ; Wed, 20 Mar 2019 19:28:13 +0800 (CST) Received: from YH-201803231204 (unknown [119.123.0.201]) by mail.kccode.cn (Postfix) with ESMTPSA id 44PSMw54Gqz3CM for ; Wed, 20 Mar 2019 19:28:12 +0800 (CST) Message-ID: <20190320192821703.anna@e9.kccode.cn> MIME-Version: 1.0 From: "anna" To: "Stable" Reply-To: carl@bigwaveo.com Date: 20 Mar 2019 19:28:24 +0800 Subject: Stable 1D Wired Barcode Scanner 03/20/201919:28:19 X-Rspamd-Queue-Id: E162D91E27 X-Spamd-Bar: ++++++ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=kccode.cn header.s=dkim header.b=LygTGa+W; spf=pass (mx1.freebsd.org: domain of anna@e9.kccode.cn designates 198.2.247.15 as permitted sender) smtp.mailfrom=anna@e9.kccode.cn X-Spamd-Result: default: False [6.55 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; HAS_REPLYTO(0.00)[carl@bigwaveo.com]; R_SPF_ALLOW(-0.20)[+mx]; ZERO_FONT(0.20)[3]; URI_COUNT_ODD(1.00)[1]; RCVD_COUNT_THREE(0.00)[4]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[kccode.cn:+]; MX_GOOD(-0.01)[mail.kccode.cn]; RECEIVED_SPAMHAUS_PBL(0.00)[201.0.123.119.zen.spamhaus.org : 127.0.0.11]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; ASN(0.00)[asn:54600, ipnet:198.2.192.0/18, country:US]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[kccode.cn:s=dkim]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.99)[0.988,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[stable@freebsd.org]; DMARC_NA(0.00)[kccode.cn]; NEURAL_SPAM_MEDIUM(1.00)[0.998,0]; RCPT_COUNT_ONE(0.00)[1]; MANY_INVISIBLE_PARTS(0.50)[6]; REPLYTO_DOM_NEQ_FROM_DOM(0.00)[]; NEURAL_SPAM_LONG(1.00)[1.000,0]; MID_CONTAINS_FROM(1.00)[]; IP_SCORE(1.38)[ipnet: 198.2.192.0/18(4.03), asn: 54600(2.93), country: US(-0.07)] X-Spam: Yes Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 20 Mar 2019 11:28:32 -0000 hi Stable Barcode readers from China, QR code reader manufacturer= s, product quality and price are very good, if you need to know o= ur company's product information, please copy the following URL t= o open the browser=0D=0A=0D=0AOfficial website=EF=BC=9Awww.bigwav= eo.com=0D=0Acompany name: Guangzhou Create Electronic Technology = Co., Ltd. =EF=BC=88china=EF=BC=89company address=EF=BC=9A Plant O= f Whole Floor 2, Bldg. B2, Yinsha Ind. Zone, Guandao Village, Sha= pu, Xintang Town, Zengcheng Dist., Guangzhou, Guangdong, China (M= ainland)Contact email=EF=BC=9A carl@bigwaveo.com=0D=0Awechat: 159= 86783300=0D=0A-oiPqc5eo --PuisLrLP --qRgdwztk - =20 From owner-freebsd-stable@freebsd.org Fri Mar 22 01:25:29 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5875715553DA for ; Fri, 22 Mar 2019 01:25:29 +0000 (UTC) (envelope-from snow@teardrop.org) Received: from hoopy.teardrop.org (hoopy.teardrop.org [52.27.92.245]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3EAB688F99 for ; Fri, 22 Mar 2019 01:25:28 +0000 (UTC) (envelope-from snow@teardrop.org) Received: by hoopy.teardrop.org (Postfix, from userid 1002) id 7ABF7DDE2B; Fri, 22 Mar 2019 01:27:01 +0000 (UTC) Date: Fri, 22 Mar 2019 01:27:01 +0000 From: James Snow To: Warner Losh Cc: FreeBSD-STABLE Mailing List Subject: Re: boot/pxeboot broken in freebsd-12? Message-ID: <20190322012701.GE91288@teardrop.org> References: <20190319225319.GD91288@teardrop.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.11.2 (2019-01-07) X-Rspamd-Queue-Id: 3EAB688F99 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of snow@teardrop.org designates 52.27.92.245 as permitted sender) smtp.mailfrom=snow@teardrop.org X-Spamd-Result: default: False [-3.07 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:52.27.92.245]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; MIME_TRACE(0.00)[0:+]; DMARC_NA(0.00)[teardrop.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[hoopy.teardrop.org]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.82)[-0.819,0]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:16509, ipnet:52.24.0.0/14, country:US]; MID_RHS_MATCH_FROM(0.00)[]; IP_SCORE(-0.94)[ipnet: 52.24.0.0/14(-3.33), asn: 16509(-1.32), country: US(-0.07)]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 22 Mar 2019 01:25:29 -0000 Thanks Warner... On Tue, Mar 19, 2019 at 05:14:15PM -0600, Warner Losh wrote: > You need to set the NFS mount point properly. I think I have? The 12.0 environment was basically a copy of a functioning 11.0 PXE environment, and 12 worked fine with 11's pxeboot. Regardless, turns out neither 12 nor 13 will boot on my hardware under UEFI, so PXE woes are less of a concern now. I'm running J1900s; they seem to have a history. -Snow From owner-freebsd-stable@freebsd.org Sat Mar 23 00:50:07 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B23F015568A9 for ; Sat, 23 Mar 2019 00:50:07 +0000 (UTC) (envelope-from graham@menhennitt.com.au) Received: from catfish.maple.relay.mailchannels.net (catfish.maple.relay.mailchannels.net [23.83.214.32]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E00B76C736 for ; Sat, 23 Mar 2019 00:50:05 +0000 (UTC) (envelope-from graham@menhennitt.com.au) X-Sender-Id: dreamhost|x-authsender|graham@menhennitt.com.au Received: from relay.mailchannels.net (localhost [127.0.0.1]) by relay.mailchannels.net (Postfix) with ESMTP id E538C5C39A6 for ; Sat, 23 Mar 2019 00:49:57 +0000 (UTC) Received: from pdx1-sub0-mail-a47.g.dreamhost.com (unknown [100.96.14.45]) (Authenticated sender: dreamhost) by relay.mailchannels.net (Postfix) with ESMTPA id 98D985C4680 for ; Sat, 23 Mar 2019 00:49:57 +0000 (UTC) X-Sender-Id: dreamhost|x-authsender|graham@menhennitt.com.au Received: from pdx1-sub0-mail-a47.g.dreamhost.com (pop.dreamhost.com [64.90.62.162]) (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384) by 0.0.0.0:2500 (trex/5.17.2); Sat, 23 Mar 2019 00:49:57 +0000 X-MC-Relay: Neutral X-MailChannels-SenderId: dreamhost|x-authsender|graham@menhennitt.com.au X-MailChannels-Auth-Id: dreamhost X-Harmony-Whimsical: 53af0a8170a78d3b_1553302197806_1498302333 X-MC-Loop-Signature: 1553302197806:304778817 X-MC-Ingress-Time: 1553302197806 Received: from pdx1-sub0-mail-a47.g.dreamhost.com (localhost [127.0.0.1]) by pdx1-sub0-mail-a47.g.dreamhost.com (Postfix) with ESMTP id 41FEE81874 for ; Fri, 22 Mar 2019 17:49:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=menhennitt.com.au; h=to :from:subject:message-id:date:mime-version:content-type :content-transfer-encoding; s=menhennitt.com.au; bh=LPrrbv9Hjt/1 op+ocDAvEf48iTg=; b=PFugoWgE5Q/BQQnYHR8fxB90ENMIWl9x7w8/SUiT/cJP IdRe3nG7Po45/ahdSXlmRoZyHb0d80XndyePLCvfzwHkSq3BgX8NV3n0WC1oOA5h pTAaYMTOeztgW47TyoFZPceMbDrdmx7U09oovOde3EyE1+IC2GazzLxZxP6cJac= Received: from [203.2.73.68] (c220-239-210-241.mckinn3.vic.optusnet.com.au [220.239.210.241]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) (Authenticated sender: graham@menhennitt.com.au) by pdx1-sub0-mail-a47.g.dreamhost.com (Postfix) with ESMTPSA id BDEBE809C5 for ; Fri, 22 Mar 2019 17:49:54 -0700 (PDT) To: FreeBSD stable X-DH-BACKEND: pdx1-sub0-mail-a47 From: Graham Menhennitt Subject: ipfw "unknown interface name igb1" Message-ID: <3f4fab26-b569-e430-0f50-8293ee736073@menhennitt.com.au> Date: Sat, 23 Mar 2019 11:49:52 +1100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.5.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US X-VR-OUT-STATUS: OK X-VR-OUT-SCORE: -100 X-VR-OUT-SPAMCAUSE: gggruggvucftvghtrhhoucdtuddrgedutddrjedvgddvhecutefuodetggdotefrodftvfcurfhrohhfihhlvgemucggtfgfnhhsuhgsshgtrhhisggvpdfftffgtefojffquffvnecuuegrihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnthhsucdlqddutddtmdenucfjughrpefvhffukffffgggtgfgsehtkeertddtfeejnecuhfhrohhmpefirhgrhhgrmhcuofgvnhhhvghnnhhithhtuceoghhrrghhrghmsehmvghnhhgvnhhnihhtthdrtghomhdrrghuqeenucfkphepvddvtddrvdefledrvddutddrvdegudenucfrrghrrghmpehmohguvgepshhmthhppdhhvghloheplgdvtdefrddvrdejfedrieekngdpihhnvghtpedvvddtrddvfeelrddvuddtrddvgedupdhrvghtuhhrnhdqphgrthhhpefirhgrhhgrmhcuofgvnhhhvghnnhhithhtuceoghhrrghhrghmsehmvghnhhgvnhhnihhtthdrtghomhdrrghuqedpmhgrihhlfhhrohhmpehgrhgrhhgrmhesmhgvnhhhvghnnhhithhtrdgtohhmrdgruhdpnhhrtghpthhtohepfhhrvggvsghsugdqshhtrggslhgvsehfrhgvvggsshgurdhorhhgnecuvehluhhsthgvrhfuihiivgeptd Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: E00B76C736 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=menhennitt.com.au header.s=menhennitt.com.au header.b=PFugoWgE; spf=pass (mx1.freebsd.org: domain of graham@menhennitt.com.au designates 23.83.214.32 as permitted sender) smtp.mailfrom=graham@menhennitt.com.au X-Spamd-Result: default: False [-1.98 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[menhennitt.com.au:s=menhennitt.com.au]; RCVD_COUNT_FIVE(0.00)[6]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:23.83.208.1/20]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; DMARC_NA(0.00)[menhennitt.com.au]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.98)[-0.978,0]; IP_SCORE(0.15)[ipnet: 23.83.208.0/21(0.46), asn: 36483(0.36), country: CA(-0.09)]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[menhennitt.com.au:+]; MX_GOOD(-0.01)[vade-in1.mail.dreamhost.com,vade-in2.mail.dreamhost.com]; RCVD_IN_DNSWL_NONE(0.00)[32.214.83.23.list.dnswl.org : 127.0.3.0]; NEURAL_SPAM_SHORT(0.09)[0.087,0]; NEURAL_HAM_MEDIUM(-0.72)[-0.723,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:36483, ipnet:23.83.208.0/21, country:CA]; MID_RHS_MATCH_FROM(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 23 Mar 2019 00:50:08 -0000 Hi all, I recently upgraded (via source) from 11-Stable to 12-Stable on my=20 router box (PC Engines APU). My firewall rules don't appear to work any=20 longer during boot. I can see on the console "Line 98: unknown interface=20 name igb1" when it tries to load them. The last few rules after the=20 error line are not loaded. Line 98 is the "nat 1 config" line. After boot, I run "ipfw flush;service ipfw restart" and everything works=20 ok. It looks like the igb1 interface isn't fully available at the time=20 when it originally tries to load. My relevant lines (redacted) from /etc/rc.conf, /etc/ipfw.rules, and=20 tail of /var/log/messages are below. Any clues, please? Thanks in advance, =C2=A0=C2=A0=C2=A0 Graham firewall_enable=3D"YES" firewall_flags=3D"-p m4 -DOUTSIDE_IF=3Digb1 -DLAN_IF=3Digb0=20 -DLAN_NET=3DX.X.X.X/25 -DWIFI_IF=3Digb2 -DWIFI_NET=3DY.Y.Y.Y/26 -DVPN_IF=3D= tap0=20 -DVPN_NET=3DZ.Z.Z.Z/26 -DPS4_ADDR=3DA.A.A.A -DIPV6_IF=3Dgif0" firewall_type=3D"/etc/ipfw.rules" # stop spoofing add deny all from LAN_NET to any in via OUTSIDE_IF add deny all from WIFI_NET to any in via OUTSIDE_IF # allow anything on the LAN add allow all from any to any via LAN_IF # and from the VPN add allow all from any to any via VPN_IF # allow anything from the wireless network to the outside world (but not=20 to the LAN) add allow ip from any to not LAN_NET via WIFI_IF table all destroy # create a table of addresses to block table 1 create type addr # add RFC1918 nets table 1 add 10.0.0.0/8 table 1 add 172.16.0.0/12 table 1 add 192.168.0.0/16 # and draft-manning-dsua-03.txt nets table 1 add 0.0.0.0/8 table 1 add 169.254.0.0/16 table 1 add 192.0.2.0/24 table 1 add 224.0.0.0/4 table 1 add 240.0.0.0/4 # stop entries in the table coming in on the outside interface add deny all from table(1) to any in recv OUTSIDE_IF # similarly for IPv6 table 2 create type addr # Stop unique local unicast address on the outside interface table 2 add fc00::/7 # Stop site-local on the outside interface table 2 add fec0::/10 # Disallow "internal" addresses to appear on the wire. table 2 add ::ffff:0.0.0.0/96 # Disallow packets to malicious IPv4 compatible prefix. #table 2 add ::224.0.0.0/100 gives error #table 2 add ::127.0.0.0/104 ditto table 2 add ::0.0.0.0/104 #table 2 add ::255.0.0.0/104 ditto # table 2 add ::0.0.0.0/96 # Disallow packets to malicious 6to4 prefix. table 2 add 2002:e000::/20 table 2 add 2002:7f00::/24 table 2 add 2002:0000::/24 table 2 add 2002:ff00::/24 # table 2 add 2002:0a00::/24 table 2 add 2002:ac10::/28 table 2 add 2002:c0a8::/32 # table 2 add ff05::/16 # block these addresses both incoming and outgoing add deny all from table(2) to any via IPV6_IF add deny all from any to table(2) via IPV6_IF # block sshguard entries add reset ip from table(22) to me ######################################################### # temporarily block lots of ports from outside (remove when these rules=20 are fixed) #add deny tcp from any to me 2049,5000-5999 in via OUTSIDE_IF ########################################################## # allow IPSEC #add allow esp from any to any #add allow ah from any to any #add allow ipencap from any to any #add allow udp from any 500 to any # allow setup of incoming SSH, IMAPS, and OpenVPN add allow tcp from any to me ssh setup add allow tcp from any to me6 ssh setup add allow tcp from any to me imaps setup add allow tcp from any to me6 imaps setup add allow tcp from any to me openvpn setup add allow tcp from any to me6 openvpn setup add allow udp from any to me openvpn # allow IPP, IMAPS, and SMTP from wireless add allow ip from any to LAN_NET dst-port printer setup via WIFI_IF add allow ip from any to me dst-port ipp setup via WIFI_IF add allow ip from any to me dst-port smtp setup via WIFI_IF add allow ip from any to me dst-port imaps setup via WIFI_IF # allow some ICMP types but nothing else add allow icmp from any to any icmptypes 0,3,8,11 add deny icmp from any to any #add allow ipv6 from any to any # NAT # redirect ports to PS4 nat 1 config if OUTSIDE_IF same_ports deny_in redirect_port tcp=20 PS4_ADDR:1935 1935 redirect_port tcp PS4_ADDR:3478 3478 redirect_port=20 tcp PS4_ADDR:3479 3479 redirect_port tcp PS4_ADDR:3480 3480=20 redirect_port udp PS4_ADDR:3074 3074 redirect_port udp PS4_ADDR:3478=20 3478 redirect_port udp PS4_ADDR:3479 3479 #nat 1 config if OUTSIDE_IF same_ports deny_in add nat 1 ip4 from any to any via OUTSIDE_IF # and block the above table again outbound add deny all from table(1) to any out xmit OUTSIDE_IF # allow TCP through if setup succeeded add pass tcp from any to any established # allow IP fragments to pass through add pass all from any to any frag # allow TCP ports needed for PS4 add allow tcp from any to PS4_ADDR 1935 in via OUTSIDE_IF setup add allow tcp from any to PS4_ADDR 3478 in via OUTSIDE_IF setup add allow tcp from any to PS4_ADDR 3479 in via OUTSIDE_IF setup add allow tcp from any to PS4_ADDR 3480 in via OUTSIDE_IF setup add allow udp from any to PS4_ADDR 3478 in via OUTSIDE_IF add allow udp from any to PS4_ADDR 3479 in via OUTSIDE_IF # allow DNS & NTP queries out to the world (and their replies back in) add allow udp from me to any 53 keep-state add allow udp from me to any 123 keep-state # but no other UDP in from outside add deny udp from any to any in via OUTSIDE_IF # and allow any other UDP add allow udp from any to any # reject all setup of incoming connections from the outside add deny tcp from any to any in via OUTSIDE_IF setup # reject all setup of incoming connections from the IPV6 tunnel add deny tcp from any to any in via gif0 setup # reject all setup of incoming connections from the wireless add deny tcp from any to any in via WIFI_IF setup # allow setup of any other TCP connection add pass tcp from any to any setup # Everything else is denied by default, unless the=20 IPFIREWALL_DEFAULT_TO_ACCEPT option is set in your kernel config file.=20 But we add this rule anyway to allow logging. add deny all from any to any Mar 23 11:35:31 maxwell kernel: ---<>--- Mar 23 11:35:31 maxwell kernel: Copyright (c) 1992-2019 The FreeBSD Proje= ct. Mar 23 11:35:31 maxwell kernel: Copyright (c) 1979, 1980, 1983, 1986,=20 1988, 1989, 1991, 1992, 1993, 1994 Mar 23 11:35:31 maxwell kernel:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 The Regents of the University of=20 California. All rights reserved. Mar 23 11:35:31 maxwell kernel: FreeBSD is a registered trademark of The=20 FreeBSD Foundation. Mar 23 11:35:31 maxwell kernel: FreeBSD 12.0-STABLE maxwell amd64 Mar 23 11:35:31 maxwell kernel: FreeBSD clang version 7.0.1=20 (tags/RELEASE_701/final 349250) (based on LLVM 7.0.1) Mar 23 11:35:31 maxwell kernel: CPU: AMD GX-412TC=20 SOC=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 (998.15-MHz K8-class CPU) Mar 23 11:35:31 maxwell kernel:=C2=A0=C2=A0 Origin=3D"AuthenticAMD" Id=3D= 0x730f01=C2=A0=20 Family=3D0x16=C2=A0 Model=3D0x30=C2=A0 Stepping=3D1 Mar 23 11:35:31 maxwell kernel:=20 Features=3D0x178bfbff Mar 23 11:35:31 maxwell kernel:=20 Features2=3D0x3ed8220b Mar 23 11:35:31 maxwell kernel:=C2=A0=C2=A0 AMD=20 Features=3D0x2e500800 Mar 23 11:35:31 maxwell kernel:=C2=A0=C2=A0 AMD=20 Features2=3D0x1d4037ff Mar 23 11:35:31 maxwell kernel:=C2=A0=C2=A0 Structured Extended Features=3D= 0x8 Mar 23 11:35:31 maxwell kernel:=C2=A0=C2=A0 XSAVE Features=3D0x1 Mar 23 11:35:31 maxwell kernel:=C2=A0=C2=A0 SVM: NP,NRIP,AFlush,DAssist,N= Asids=3D8 Mar 23 11:35:31 maxwell kernel:=C2=A0=C2=A0 TSC: P-state invariant, perfo= rmance=20 statistics Mar 23 11:35:31 maxwell kernel: real memory=C2=A0 =3D 4815060992 (4592 MB= ) Mar 23 11:35:31 maxwell kernel: avail memory =3D 4110790656 (3920 MB) Mar 23 11:35:31 maxwell kernel: Event timer "LAPIC" quality 600 Mar 23 11:35:31 maxwell kernel: ACPI APIC Table: Mar 23 11:35:31 maxwell kernel: FreeBSD/SMP: Multiprocessor System=20 Detected: 4 CPUs Mar 23 11:35:31 maxwell kernel: FreeBSD/SMP: 1 package(s) x 4 core(s) Mar 23 11:35:31 maxwell kernel: random: unblocking device. Mar 23 11:35:31 maxwell kernel: ioapic1: Changing APIC ID to 5 Mar 23 11:35:31 maxwell kernel: ioapic0 irqs 0-23 on=20 motherboard Mar 23 11:35:31 maxwell kernel: ioapic1 irqs 24-55 on=20 motherboard Mar 23 11:35:31 maxwell kernel: Launching APs: 2 1 3 Mar 23 11:35:31 maxwell kernel: Timecounter "TSC" frequency 998148269 Hz=20 quality 1000 Mar 23 11:35:31 maxwell kernel: random: entropy device external interface Mar 23 11:35:31 maxwell kernel: 000.000022 [4212]=20 netmap_init=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0 netmap: loaded module Mar 23 11:35:31 maxwell kernel: nexus0 Mar 23 11:35:31 maxwell kernel: cryptosoft0: on=20 motherboard Mar 23 11:35:31 maxwell kernel: acpi0: on motherboard Mar 23 11:35:31 maxwell kernel: acpi0: Power Button (fixed) Mar 23 11:35:31 maxwell kernel: cpu0: on acpi0 Mar 23 11:35:31 maxwell kernel: atrtc0: port=20 0x70-0x71 irq 8 on acpi0 Mar 23 11:35:31 maxwell kernel: atrtc0: registered as a time-of-day=20 clock, resolution 1.000000s Mar 23 11:35:31 maxwell kernel: Event timer "RTC" frequency 32768 Hz=20 quality 0 Mar 23 11:35:31 maxwell kernel: attimer0: port 0x40-0x43 irq=20 0 on acpi0 Mar 23 11:35:31 maxwell kernel: Timecounter "i8254" frequency 1193182 Hz=20 quality 0 Mar 23 11:35:31 maxwell kernel: Event timer "i8254" frequency 1193182 Hz=20 quality 100 Mar 23 11:35:31 maxwell kernel: hpet0: =20 iomem 0xfed00000-0xfed003ff on acpi0 Mar 23 11:35:31 maxwell kernel: Timecounter "HPET" frequency 14318180 Hz=20 quality 950 Mar 23 11:35:31 maxwell kernel: Timecounter "ACPI-safe" frequency=20 3579545 Hz quality 850 Mar 23 11:35:31 maxwell kernel: acpi_timer0: <32-bit timer at=20 3.579545MHz> port 0x818-0x81b on acpi0 Mar 23 11:35:31 maxwell kernel: acpi_button0: on acpi0 Mar 23 11:35:31 maxwell kernel: pcib0: port=20 0xcf8-0xcff on acpi0 Mar 23 11:35:31 maxwell kernel: pci0: on pcib0 Mar 23 11:35:31 maxwell kernel: pcib1: at device=20 2.2 on pci0 Mar 23 11:35:31 maxwell kernel: pcib1: failed to allocate initial I/O=20 port window: 0x1000-0x1fff Mar 23 11:35:31 maxwell kernel: pci1: on pcib1 Mar 23 11:35:31 maxwell kernel: pci1: at device 0.0=20 (no driver attached) Mar 23 11:35:31 maxwell kernel: pcib2: at device=20 2.3 on pci0 Mar 23 11:35:31 maxwell kernel: pci2: on pcib2 Mar 23 11:35:31 maxwell kernel: pci2: at device 0.0=20 (no driver attached) Mar 23 11:35:31 maxwell kernel: pcib3: at device=20 2.4 on pci0 Mar 23 11:35:31 maxwell kernel: pci3: on pcib3 Mar 23 11:35:31 maxwell kernel: pci3: at device 0.0=20 (no driver attached) Mar 23 11:35:31 maxwell kernel: pci0: at device 8.0=20 (no driver attached) Mar 23 11:35:31 maxwell kernel: xhci0: mem=20 0xfeb22000-0xfeb23fff at device 16.0 on pci0 Mar 23 11:35:31 maxwell kernel: xhci0: 32 bytes context size, 64-bit DMA Mar 23 11:35:31 maxwell kernel: xhci0: Unable to map MSI-X table Mar 23 11:35:31 maxwell kernel: usbus0 on xhci0 Mar 23 11:35:31 maxwell kernel: usbus0: 5.0Gbps Super Speed USB v3.0 Mar 23 11:35:31 maxwell kernel: ahci0: port=20 0x4010-0x4017,0x4020-0x4023,0x4018-0x401f,0x4024-0x4027,0x4000-0x400f=20 mem 0xfeb25000-0xfeb253ff at device 17.0 on pci0 Mar 23 11:35:31 maxwell kernel: ahci0: AHCI v1.30 with 2 6Gbps ports,=20 Port Multiplier supported with FBS Mar 23 11:35:31 maxwell kernel: ahcich0: at channel 0 on=20 ahci0 Mar 23 11:35:31 maxwell kernel: ahcich1: at channel 1 on=20 ahci0 Mar 23 11:35:31 maxwell kernel: ehci0: mem=20 0xfeb25400-0xfeb254ff at device 19.0 on pci0 Mar 23 11:35:31 maxwell kernel: usbus1: EHCI version 1.0 Mar 23 11:35:31 maxwell kernel: usbus1 on ehci0 Mar 23 11:35:31 maxwell kernel: usbus1: 480Mbps High Speed USB v2.0 Mar 23 11:35:31 maxwell kernel: isab0: at device 20.3=20 on pci0 Mar 23 11:35:31 maxwell kernel: isa0: on isab0 Mar 23 11:35:31 maxwell kernel: pci0: at device 20.7 (no driver attached) Mar 23 11:35:31 maxwell kernel: uart0: <16550 or compatible> port=20 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 Mar 23 11:35:31 maxwell kernel: uart0: console (115200,n,8,1) Mar 23 11:35:31 maxwell kernel: orm0: at iomem=20 0xc0000-0xc0fff,0xef000-0xeffff pnpid ORM0000 on isa0 Mar 23 11:35:31 maxwell kernel: uart1: <16550 or compatible> at port=20 0x2f8 irq 3 on isa0 Mar 23 11:35:31 maxwell kernel: hwpstate0: on cpu0 Mar 23 11:35:31 maxwell kernel: Timecounters tick every 1.000 msec Mar 23 11:35:31 maxwell kernel: ipfw2 (+ipv6) initialized, divert=20 loadable, nat loadable, default to deny, logging disabled Mar 23 11:35:31 maxwell kernel: ugen0.1: <0x1022 XHCI root HUB> at usbus0 Mar 23 11:35:31 maxwell kernel: ugen1.1: at usbus1 Mar 23 11:35:31 maxwell kernel: uhub0: <0x1022 XHCI root HUB, class 9/0,=20 rev 3.00/1.00, addr 1> on usbus0 Mar 23 11:35:31 maxwell kernel: uhub1: on usbus1 Mar 23 11:35:31 maxwell kernel: uhub0: 4 ports with 4 removable, self=20 powered Mar 23 11:35:31 maxwell kernel: uhub1: 2 ports with 2 removable, self=20 powered Mar 23 11:35:31 maxwell kernel: ugen0.2: at usbus0 Mar 23 11:35:31 maxwell kernel: ugen1.2: =20 at usbus1 Mar 23 11:35:31 maxwell kernel: uhub2 on uhub1 Mar 23 11:35:31 maxwell kernel: uhub2: on usbus1 Mar 23 11:35:31 maxwell kernel: uhub2: 4 ports with 4 removable, self=20 powered Mar 23 11:35:31 maxwell kernel: ada0 at ahcich0 bus 0 scbus0 target 0 lun= 0 Mar 23 11:35:31 maxwell kernel: ada0: ACS-3 ATA SATA=20 3.x device Mar 23 11:35:31 maxwell kernel: ada0: Serial Number 6834076A125700012038 Mar 23 11:35:31 maxwell kernel: ada0: 600.000MB/s transfers (SATA 3.x,=20 UDMA6, PIO 8192bytes) Mar 23 11:35:31 maxwell kernel: ada0: Command Queueing enabled Mar 23 11:35:31 maxwell kernel: ada0: 15272MB (31277232 512 byte sectors) Mar 23 11:35:31 maxwell kernel: ada1 at ahcich1 bus 0 scbus1 target 0 lun= 0 Mar 23 11:35:31 maxwell kernel: ada1: ACS-3=20 ATA SATA 3.x device Mar 23 11:35:31 maxwell kernel: ada1: Serial Number WDZ4G592 Mar 23 11:35:31 maxwell kernel: ada1: 300.000MB/s transfers (SATA 2.x,=20 UDMA6, PIO 8192bytes) Mar 23 11:35:31 maxwell kernel: ada1: Command Queueing enabled Mar 23 11:35:31 maxwell kernel: ada1: 1907729MB (3907029168 512 byte=20 sectors) Mar 23 11:35:31 maxwell kernel: Trying to mount root from=20 ufs:/dev/ada0p2 [rw]... Mar 23 11:35:31 maxwell kernel: WARNING: /usr/data was not properly=20 dismounted Mar 23 11:35:31 maxwell kernel: lo0: link state changed to UP Mar 23 11:35:31 maxwell kernel: intsmb0: at=20 device 20.0 on pci0 Mar 23 11:35:31 maxwell kernel: smbus0: on intsmb= 0 Mar 23 11:35:32 maxwell mountd[618]: can't change attributes for /var:=20 netcred already exists for given addr/mask Mar 23 11:35:32 maxwell mountd[618]: bad exports list line '/var=20 -alldirs -maproot' Mar 23 11:35:32 maxwell mountd[618]: can't change attributes for /mnt:=20 netcred already exists for given addr/mask Mar 23 11:35:32 maxwell mountd[618]: bad exports list line '/mnt=20 -alldirs -maproot' Mar 23 11:35:32 maxwell kernel: igb0: mem 0xfe600000-0xfe61ffff,0xfe620000-0xfe623fff at=20 device 0.0 on pci1 Mar 23 11:35:32 maxwell kernel: igb0: Using 1024 tx descriptors and 1024=20 rx descriptors Mar 23 11:35:32 maxwell kernel: igb0: Using 4 rx queues 4 tx queues Mar 23 11:35:32 maxwell kernel: igb0: Using MSI-X interrupts with 5 vecto= rs Mar 23 11:35:32 maxwell kernel: igb0: Ethernet address: 00:0d:b9:42:ea:38 Mar 23 11:35:32 maxwell kernel: igb0: netmap queues/slots: TX 4/1024, RX=20 4/1024 Mar 23 11:35:32 maxwell kernel: igb1: port 0x2000-0x201f mem=20 0xfe700000-0xfe71ffff,0xfe720000-0xfe723fff at device 0.0 on pci2 Mar 23 11:35:32 maxwell kernel: igb1: Using 1024 tx descriptors and 1024=20 rx descriptors Mar 23 11:35:32 maxwell kernel: igb1: Using 4 rx queues 4 tx queues Mar 23 11:35:32 maxwell kernel: igb1: Using MSI-X interrupts with 5 vecto= rs Mar 23 11:35:32 maxwell kernel: igb1: Ethernet address: 00:0d:b9:42:ea:39 Mar 23 11:35:33 maxwell kernel: igb1: netmap queues/slots: TX 4/1024, RX=20 4/1024 Mar 23 11:35:33 maxwell kernel: igb2: port 0x3000-0x301f mem=20 0xfe800000-0xfe81ffff,0xfe820000-0xfe823fff at device 0.0 on pci3 Mar 23 11:35:33 maxwell kernel: igb2: Using 1024 tx descriptors and 1024=20 rx descriptors Mar 23 11:35:33 maxwell kernel: igb2: Using 4 rx queues 4 tx queues Mar 23 11:35:33 maxwell kernel: igb2: Using MSI-X interrupts with 5 vecto= rs Mar 23 11:35:33 maxwell kernel: igb2: Ethernet address: 00:0d:b9:42:ea:3a Mar 23 11:35:33 maxwell ntpd[759]: ntpd 4.2.8p12-a (1): Starting Mar 23 11:35:33 maxwell kernel: igb2: netmap queues/slots: TX 4/1024, RX=20 4/1024 Mar 23 11:35:33 maxwell kernel: Security policy loaded: MAC/ntpd (mac_ntp= d) Mar 23 11:35:34 maxwell upsmon[789]: Login on UPS [maxwell@localhost]=20 failed - got [ERR ACCESS-DENIED] Mar 23 11:35:37 maxwell kernel: igb0: link state changed to UP Mar 23 11:35:48 maxwell kernel: igb1: link state changed to UP Mar 23 11:35:48 maxwell kernel: igb1: link state changed to DOWN Mar 23 11:35:49 maxwell root[1698]: /etc/rc: WARNING: failed to start spa= md Mar 23 11:35:49 maxwell kernel: tun0: link state changed to UP Mar 23 11:35:50 maxwell kernel: igb2: link state changed to UP Mar 23 11:35:50 maxwell kernel: igb2: link state changed to DOWN Mar 23 11:35:51 maxwell kernel: igb1: link state changed to UP Mar 23 11:35:51 maxwell dhclient[2608]: New IP Address (igb1): X.X.X.X Mar 23 11:35:51 maxwell dhclient[2610]: New Subnet Mask (igb1):=20 255.255.255.0 Mar 23 11:35:51 maxwell dhclient[2612]: New Broadcast Address (igb1):=20 X.X.X.255 Mar 23 11:35:51 maxwell dhclient[2614]: New Routers (igb1): X.X.X.1 Mar 23 11:35:53 maxwell kernel: igb2: link state changed to UP From owner-freebsd-stable@freebsd.org Sat Mar 23 06:14:20 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C58C41561667 for ; Sat, 23 Mar 2019 06:14:20 +0000 (UTC) (envelope-from graham@menhennitt.com.au) Received: from ladybird.maple.relay.mailchannels.net (ladybird.maple.relay.mailchannels.net [23.83.214.98]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 915EE81213 for ; Sat, 23 Mar 2019 06:14:17 +0000 (UTC) (envelope-from graham@menhennitt.com.au) X-Sender-Id: dreamhost|x-authsender|graham@menhennitt.com.au Received: from relay.mailchannels.net (localhost [127.0.0.1]) by relay.mailchannels.net (Postfix) with ESMTP id 643A42C04DE; Sat, 23 Mar 2019 06:14:11 +0000 (UTC) Received: from pdx1-sub0-mail-a47.g.dreamhost.com (100-96-9-125.trex.outbound.svc.cluster.local [100.96.9.125]) (Authenticated sender: dreamhost) by relay.mailchannels.net (Postfix) with ESMTPA id 887842C11BB; Sat, 23 Mar 2019 06:14:10 +0000 (UTC) X-Sender-Id: dreamhost|x-authsender|graham@menhennitt.com.au Received: from pdx1-sub0-mail-a47.g.dreamhost.com ([TEMPUNAVAIL]. [64.90.62.162]) (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384) by 0.0.0.0:2500 (trex/5.17.2); Sat, 23 Mar 2019 06:14:11 +0000 X-MC-Relay: Neutral X-MailChannels-SenderId: dreamhost|x-authsender|graham@menhennitt.com.au X-MailChannels-Auth-Id: dreamhost X-Language-Relation: 0fdcd38c5fef1b87_1553321651232_2995735695 X-MC-Loop-Signature: 1553321651232:1989197710 X-MC-Ingress-Time: 1553321651231 Received: from pdx1-sub0-mail-a47.g.dreamhost.com (localhost [127.0.0.1]) by pdx1-sub0-mail-a47.g.dreamhost.com (Postfix) with ESMTP id 2B32381F42; Fri, 22 Mar 2019 23:14:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=menhennitt.com.au; h= subject:to:references:from:message-id:date:mime-version :in-reply-to:content-type; s=menhennitt.com.au; bh=vExkCXH61MmU+ rsMD+dV2euBdJ4=; b=mm0MmCrm/4A0IP1HwezLeSzYfyEyOZZQhZ+d0pKJPMaAC lYSdZNIsESJ4YVlDCcMnb2uKNgKmWxq0XerzNUy2T0Zca7Nm1IMPAhrtLYX+AEH/ /AjORZCwe/PBf9jAPz51kud+kN5s2hgbJECNVHbkl/O0XHK621ZaqfGjFub1ao= Received: from [203.2.73.68] (c220-239-210-241.mckinn3.vic.optusnet.com.au [220.239.210.241]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) (Authenticated sender: graham@menhennitt.com.au) by pdx1-sub0-mail-a47.g.dreamhost.com (Postfix) with ESMTPSA id 2475281E93; Fri, 22 Mar 2019 23:14:02 -0700 (PDT) Subject: Re: ipfw "unknown interface name igb1" SOLVED To: Korolev Sergey , FreeBSD stable References: <3f4fab26-b569-e430-0f50-8293ee736073@menhennitt.com.au> <13A0A3D6-1D62-444F-8619-FBA0E20ED240@febras.net> X-DH-BACKEND: pdx1-sub0-mail-a47 From: Graham Menhennitt Message-ID: <2d256605-124b-b210-ee7c-7dae64a6ba90@menhennitt.com.au> Date: Sat, 23 Mar 2019 17:13:59 +1100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.5.0 MIME-Version: 1.0 In-Reply-To: <13A0A3D6-1D62-444F-8619-FBA0E20ED240@febras.net> Content-Language: en-US X-VR-OUT-STATUS: OK X-VR-OUT-SCORE: -100 X-VR-OUT-SPAMCAUSE: gggruggvucftvghtrhhoucdtuddrgedutddrjedvgdelvdcutefuodetggdotefrodftvfcurfhrohhfihhlvgemucggtfgfnhhsuhgsshgtrhhisggvpdfftffgtefojffquffvnecuuegrihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnthhsucdlqddutddtmdenucfjughrpefuvfhfhffkffgfgggjtgesrgdtreertdefheenucfhrhhomhepifhrrghhrghmucfovghnhhgvnhhnihhtthcuoehgrhgrhhgrmhesmhgvnhhhvghnnhhithhtrdgtohhmrdgruheqnecukfhppedvvddtrddvfeelrddvuddtrddvgedunecurfgrrhgrmhepmhhouggvpehsmhhtphdphhgvlhhopeglvddtfedrvddrjeefrdeikegnpdhinhgvthepvddvtddrvdefledrvddutddrvdeguddprhgvthhurhhnqdhprghthhepifhrrghhrghmucfovghnhhgvnhhnihhtthcuoehgrhgrhhgrmhesmhgvnhhhvghnnhhithhtrdgtohhmrdgruheqpdhmrghilhhfrhhomhepghhrrghhrghmsehmvghnhhgvnhhnihhtthdrtghomhdrrghupdhnrhgtphhtthhopehsvghrvghjkhesfhgvsghrrghsrdhnvghtnecuvehluhhsthgvrhfuihiivgeptd X-Rspamd-Queue-Id: 915EE81213 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=menhennitt.com.au header.s=menhennitt.com.au header.b=mm0MmCrm; spf=pass (mx1.freebsd.org: domain of graham@menhennitt.com.au designates 23.83.214.98 as permitted sender) smtp.mailfrom=graham@menhennitt.com.au X-Spamd-Result: default: False [-1.84 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[menhennitt.com.au:s=menhennitt.com.au]; RCVD_COUNT_FIVE(0.00)[6]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:23.83.208.1/20]; NEURAL_HAM_LONG(-0.99)[-0.989,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; DMARC_NA(0.00)[menhennitt.com.au]; NEURAL_HAM_MEDIUM(-0.89)[-0.889,0]; NEURAL_SPAM_SHORT(0.42)[0.417,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: vade-in1.mail.dreamhost.com]; DKIM_TRACE(0.00)[menhennitt.com.au:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[98.214.83.23.list.dnswl.org : 127.0.3.0]; IP_SCORE(0.13)[ipnet: 23.83.208.0/21(0.40), asn: 36483(0.32), country: CA(-0.09)]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:36483, ipnet:23.83.208.0/21, country:CA]; MID_RHS_MATCH_FROM(0.00)[] Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 23 Mar 2019 06:14:21 -0000 Thanks for replying, Sergey. The "igb" device is no longer available as an option in the kernel source - I need to use "em" instead. Without "em" most things still work, though - just not the ipfw rules on boot. Strangely, my interfaces still come up as "igb". Anyway, with "em" it all now works. Thanks! Graham On 23/3/19 11:55 am, Korolev Sergey wrote: > Hello! > Igb device was removed in version 12. Maybe this causes a problem. > Maybe you should rename it to new appropriate one. > >> On 23 Mar 2019, at 10:49, Graham Menhennitt > > wrote: >> >> Hi all, >> >> I recently upgraded (via source) from 11-Stable to 12-Stable on my >> router box (PC Engines APU). My firewall rules don't appear to work >> any longer during boot. I can see on the console "Line 98: unknown >> interface name igb1" when it tries to load them. The last few rules >> after the error line are not loaded. Line 98 is the "nat 1 config" line. >> >> After boot, I run "ipfw flush;service ipfw restart" and everything >> works ok. It looks like the igb1 interface isn't fully available at >> the time when it originally tries to load. >> >> My relevant lines (redacted) from /etc/rc.conf, /etc/ipfw.rules, and >> tail of /var/log/messages are below. >> >> Any clues, please? >> >> Thanks in advance, From owner-freebsd-stable@freebsd.org Sat Mar 23 13:31:35 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8F8DB154FA2A for ; Sat, 23 Mar 2019 13:31:34 +0000 (UTC) (envelope-from etnapierala@gmail.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 996FE6A2D2 for ; Sat, 23 Mar 2019 13:31:33 +0000 (UTC) (envelope-from etnapierala@gmail.com) Received: by mailman.ysv.freebsd.org (Postfix) id 56D37154FA0D; Sat, 23 Mar 2019 13:31:33 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DCAEF154FA09; Sat, 23 Mar 2019 13:31:32 +0000 (UTC) (envelope-from etnapierala@gmail.com) Received: from mail-wr1-x444.google.com (mail-wr1-x444.google.com [IPv6:2a00:1450:4864:20::444]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 533BA6A2CC; Sat, 23 Mar 2019 13:31:31 +0000 (UTC) (envelope-from etnapierala@gmail.com) Received: by mail-wr1-x444.google.com with SMTP id g3so1722628wrx.9; Sat, 23 Mar 2019 06:31:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:date:from:to:cc:subject:message-id:mail-followup-to :mime-version:content-disposition:user-agent; bh=FI2W5HMl4HJtAfKJrlJ1qQXlGZDKb7esfC6wDWBizF8=; b=ID7qMtaeuS4Mi7dsHeEXlDEjwuxOI8KXxfVLWHpuB8HJlmTyNJmBi4b/enrcVdksOR AueTzPd/GpfsYp2LVhzkHJsV8rw6GvHZFYS1P1N7Ciz191jsDKtdDRWNQXd/5RRQ7tZi acUzzfFqkFjaQA6gKGLqfNPRfP/EPyXKEO4SmXVILdyPj47x08MsgnQsmjFF8jOB3aE7 +SdNIcKWm78hWTGSHwRR5hbfl+dU5JuUW3sNm43h2OnX7e6Ra66RLItL/vKU+ShsPNm8 xTJGkdCAXBDwCMaEAFfUcv4HMJ/hKFSnCHZmcgxvqLZrx3VfojBpGlAsplZxK/W2x4+C Elrw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :mail-followup-to:mime-version:content-disposition:user-agent; bh=FI2W5HMl4HJtAfKJrlJ1qQXlGZDKb7esfC6wDWBizF8=; b=Yyj94J/FLDu+rYRKBS27ex6Ln4wc+a+z570+7hKEWp4nw7OisJp+dsO5wIUVg83ORV DPzvyPuZf2lvmjCIvwfO/VRDtUfNWg+FckcrLVnYBRf0fRH/i9VZME+6S07oDSF5Poy+ MEq0NkORzztJb45m3KBoGEYzszedLN5pBU6+HHUtdOqPxpmGSZKX9AGwMu2TnGhRzsMu 2l6fZd4Nh7GflpiKTXf0QV8rXTXfYuk7Dvfeq3+f33EyHLtEpU6It1hWG9pB0VsRXInt Mh2lMyyBJ3UseVX7zcQaR1lwruc6yI2aaK8T53MZiO/WYBh0AgXRpa/9z4U0D/FIl84i XT2g== X-Gm-Message-State: APjAAAXm5BVjako2jizlTjzyJUYO3vC+aBhSXBTvghVjYq4cbIgbwztD TnE5nTnTTP5lUbTZJBjZHwz51N8F X-Google-Smtp-Source: APXvYqz5Hl0JLBOjmqAOaIOZ3uQm1DxiPoblUd1TfpO4oktDhyQYYWU/JFV9/GNbTbPrDYE6IVrYrQ== X-Received: by 2002:adf:ebce:: with SMTP id v14mr9597672wrn.69.1553347400005; Sat, 23 Mar 2019 06:23:20 -0700 (PDT) Received: from v2 (cpc92302-cmbg19-2-0-cust461.5-4.cable.virginm.net. [82.1.209.206]) by smtp.gmail.com with ESMTPSA id t81sm9201545wmb.5.2019.03.23.06.23.18 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Sat, 23 Mar 2019 06:23:18 -0700 (PDT) Sender: =?UTF-8?Q?Edward_Tomasz_Napiera=C5=82a?= Date: Sat, 23 Mar 2019 13:23:16 +0000 From: Edward Tomasz =?utf-8?Q?Napiera=C5=82a?= To: hackers@freebsd.org Cc: current@freebsd.org, stable@freebsd.org Subject: FreeBSD Quarterly Status Report - Fourth Quarter 2018 Message-ID: <20190323132316.GA1786@v2> Mail-Followup-To: hackers@freebsd.org, current@freebsd.org, stable@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="qDbXVdCdHGoSgWSk" Content-Disposition: inline User-Agent: Mutt/1.11.3 (2019-02-01) X-Rspamd-Queue-Id: 533BA6A2CC X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=ID7qMtae; spf=pass (mx1.freebsd.org: domain of etnapierala@gmail.com designates 2a00:1450:4864:20::444 as permitted sender) smtp.mailfrom=etnapierala@gmail.com X-Spamd-Result: default: False [-4.90 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.49)[-0.487,0]; SIGNED_PGP(-2.00)[]; FORGED_SENDER(0.30)[trasz@freebsd.org,etnapierala@gmail.com]; MIME_TRACE(0.00)[0:+,1:+]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[trasz@freebsd.org,etnapierala@gmail.com]; FORGED_RECIPIENTS(0.00)[hackers@freebsd.org ..,hackers@freebsd.org ...]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; DMARC_NA(0.00)[freebsd.org]; IP_SCORE(-0.61)[ip: (1.56), ipnet: 2a00:1450::/32(-2.38), asn: 15169(-2.13), country: US(-0.07)]; RCVD_IN_DNSWL_NONE(0.00)[4.4.4.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; MID_RHS_NOT_FQDN(0.50)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 23 Mar 2019 13:31:35 -0000 --qDbXVdCdHGoSgWSk Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable FreeBSD Project Quarterly Status Report - 4th Quarter 2018 Since we are still on this island among many in this vast ocean of the Internet, we write this message in a bottle to inform you of the work we have finished and what lies ahead of us. These deeds that we have wrought with our minds and hands, they are for all to partake of - in the hopes that anyone of their free will, will join us in making improvements. In todays message the following by no means complete or ordered set of improvements and additions will be covered: i386 PAE Pagetables for up to 24GB memory support, Continuous Integration efforts, driver updates to ENA and graphics, ARM enhancements such as RochChip, Marvell 8K, and Broadcom support as well as more DTS files, more Capsicum possibilities, as well as pfsync improvements, and many more things that you can read about for yourselves. Additionally, we bring news from some islands further down stream, namely the nosh project, HardenedBSD, ClonOS, and the Polish BSD User-Group. We would, selfishly, encourage those of you who give us the good word to please send in your submissions sooner than just before the deadline, and also encourage anyone willing to share the good word to please read the section on which submissions we're also interested in having. Yours hopefully, Daniel Ebdrup, on behalf of the status report team. __________________________________________________________________ FreeBSD Team Reports * Continuous Integration * FreeBSD Core Team * FreeBSD Foundation * FreeBSD Graphics Team status report * FreeBSD Release Engineering Team * Ports Collection Projects * amd64 Usermode Protection Keys * bhyve - Live Migration * bhyve - Save/Restore * Capsicum * Collection of vt(4) color schemes * i386 PAE Pagetables * Improving FreeBSD boot security * pfsync performance improvement * PWM Kernel API and userland utility Architectures * Broadcom ARM64 SoC support * DTS Update * ENA FreeBSD Driver Update * FreeBSD on Power9 (ppc64) Parity * FreeBSD/RISC-V update * libvdsk - QCOW2 implementation * Marvell 8K SoC support * Pinebook SDCard Image * RockChip Support Ports * FreeBSD KDE status report Miscellaneous * BSD PL Third-Party Projects * ClonOS: virtualization platform on top of FreeBSD Operating System * HardenedBSD 2018Q4 Update * The nosh project __________________________________________________________________ FreeBSD Team Reports Entries from the various official and semi-official teams, as found in the Administration Page. Continuous Integration Links FreeBSD Jenkins Instance URL: https://ci.FreeBSD.org FreeBSD CI artifact archive URL: https://artifact.ci.FreeBSD.org/ FreeBSD Jenkins wiki URL: https://wiki.freebsd.org/Jenkins freebsd-testing Mailing List URL: https://lists.FreeBSD.org/mailman/listinfo/freebsd-testing freebsd-ci Repository URL: https://github.com/freebsd/freebsd-ci Tickets related to freebsd-testing@ URL: https://preview.tinyurl.com/y9maauwg Hosted CI wiki URL: https://wiki.freebsd.org/HostedCI Contact: Jenkins Admin Contact: Li-Wen Hsu The FreeBSD CI team maintains continuous integration system and related tasks for the FreeBSD project. The CI system regularly checks the changes committed to the project's Subversion repository can be successfully built, and performs various tests and analysis over the results. The results from build jobs are archived in artifact server, for the further testing and debugging needs. The members on the CI team examine the failing builds and unstable tests, and work with the experts in that area to fix the code or build and test infrastructure, to improve the software quality of the FreeBSD base system. The CI team member and the FreeBSD foundation staff Li-Wen is the maintainer of Jenkins and Jenkins related ports. In this quarter, we worked on extending test executing environment to improve the coverage, temporarily disabling flakey test cases (and opening tickets to work with domain experts). Please see freebsd-testing@ related tickets for more information. In addition to that, starting from this quarter, we also work on collaboration with external projects to extend their CI to cover FreeBSD. See "HostedCI" wiki page for more information. Work in progress: * Fixing the failing test cases and builds * Adding drm ports building test against -CURRENT * Adding tests for selected project branches, e.g.: clang800-import * Implementing automatic tests on bare metal hardware * Planning the embedded testbed * Planning running ztest and network stack tests __________________________________________________________________ FreeBSD Core Team Contact: FreeBSD Core Team Noteworthy events since the last quarterly report: * Yuri Pankov (yuripv@) was awarded a source commit bit under the mentorship of Konstantin Belousov (kib@). * Core agrees that portmgr@ may enforce a 12-month commit bit expiration for ports committers. * Thomas Munro (tmunro@) was awarded a source commit bit under the mentorship of Mateusz Guzik (mgj@) and co-mentorship of Allan Jude (allanjude@). * With the approval of FCP-0101, 10/100 Ethernet drivers will be deprecated. * Core approved the promotion of Remko Lodder (remko@) to Deputy Security Officer. __________________________________________________________________ FreeBSD Foundation Contact: Deb Goodkin The FreeBSD Foundation is a 501(c)(3) non-profit organization dedicated to supporting and promoting the FreeBSD Project and community worldwide. Funding comes from individual and corporate donations and is used to fund and manage software development projects, conferences and developer summits, and provide travel grants to FreeBSD contributors. The Foundation purchases and supports hardware to improve and maintain FreeBSD infrastructure and provides resources to improve security, quality assurance, and release engineering efforts; publishes marketing material to promote, educate, and advocate for the FreeBSD Project; facilitates collaboration between commercial vendors and FreeBSD developers; and finally, represents the FreeBSD Project in executing contracts, license agreements, and other legal arrangements that require a recognized legal entity. Here are some highlights of what we did to help FreeBSD last quarter: Partnerships and Commercial User Support As a 501(c)(3) non-profit, we don't directly support commercial users, but we do work with them to understand their needs and help facilitate collaboration with the community. Last quarter, we were able to meet with a number of FreeBSD users and supporters at the October FreeBSD Developer Summit and MeetBSD conference in addition to our regular company meetings. These in-person meetings provide the opportunity to discuss pain points, identify how they can contribute back to FreeBSD, talk about what technologies they would like to see supported, and what can be done to support FreeBSD over more of their technologies and products. Fundraising Efforts By end of last year, we raised over $1.3M and were able to add Juniper, Netflix and Facebook and Handshake.org to our list of Foundation Partners. You can view the entire list here https://www.freebsdfoundation.org/donors/. We are still finalizing total donations, and will report the final numbers in early February. Thank you to everyone who supported our efforts in 2018. OS Improvements In the fourth quarter of 2018 six authors made a total of 315 commits to the FreeBSD development tree that were identified as being sponsored by the FreeBSD Foundation. These included staff members Konstantin Belousov, Glen Barber, Li-Wen Hsu and Ed Maste, and grant recipients Mateusz Guzik and Mark Johnston. Mateusz' work over the quarter consisted of identifying and fixing bottlenecks in the FreeBSD kernel and system libraries. The FreeBSD base system build, and ports built via Poudriere, were used as motivating cases. Mark added an in-kernel Intel CPU microcode loader. This simplifies and increases the robustness of microcode updates, which is increasingly important as mitigations for speculative execution vulnerabilities are delivered in microcode. Mark also fixed a number of issues relating to capsicum support in base system utilities, implemented a number of NUMA enhancements and bug fixes, and fixed a number of high profile kernel bugs. Ed committed a large number of tool chain fixes to LLVM's lld linker and ELF Tool Chain components. Along with several FreeBSD developers Ed worked on the OpenSSL 1.1.1 import in preparation for FreeBSD 12.0, including incorporating OpenSSH and ntp changes for compatibility. Ed also added build-time knobs for to enable userland retpoline and to enable BIND_NOW which can be used as part of a vulnerability mitigation strategy. Continuous Integration and Quality Assurance The Foundation provides a full-time staff member who is working on improving our automated testing, continuous integration, and overall quality assurance efforts. During the fourth quarter of 2018, Foundation employee Li-Wen Hsu continuously worked on improving the project's CI infrastructure, examining the failing build and test cases, and work with other teams in the project for their testing needs. In this period, we also worked on collaboration with external projects to improve their CI on FreeBSD. See the FreeBSD CI section of this report for more information. Release Engineering The Foundation provides a full-time staff member to lead the release engineering efforts. This has provided timely and reliable releases over the last five years. During the fourth quarter of 2018, Glen Barber led the the FreeBSD Release Engineering team in continuing working on the 12.0-RELEASE with the official announcement sent December 11. See the FreeBSD Release Engineering Team section of this report for more information. Supporting FreeBSD Infrastructure The Foundation provides hardware and support to improve the FreeBSD infrastructure. Last quarter, we continued supporting FreeBSD hardware located around the world. FreeBSD Advocacy and Education A large part of our efforts are dedicated to advocating for the Project. This includes promoting work being done by others with FreeBSD; producing advocacy literature to teach people about FreeBSD and help make the path to starting using FreeBSD or contributing to the Project easier; and attending and getting other FreeBSD contributors to volunteer to run FreeBSD events, staff FreeBSD tables, and give FreeBSD presentations. The FreeBSD Foundation sponsors many conferences, events, and summits around the globe. These events can be BSD-related, open source, or technology events geared towards underrepresented groups. We support the FreeBSD-focused events to help provide a venue for sharing knowledge, to work together on projects, and to facilitate collaboration between developers and commercial users. This all helps provide a healthy ecosystem. We support the non-FreeBSD events to promote and raise awareness of FreeBSD, to increase the use of FreeBSD in different applications, and to recruit more contributors to the Project. Some of the advocacy and education work we did last quarter includes: * Organized, sponsored, and presented at the October 2018 FreeBSD Developers Summit in Santa Clara, CA * Sponsored and exhibited at MeetBSD 2018 in Santa Clara, CA * Exhibited for the first time at All Things Open in Raleigh, NC * Exhibited and sponsored as an Industry Partner at LISA' 18 in Nashville, TN * Sponsored USENIX OSDI `18 in Carlsbad, CA as an Industry Partner * Held an Intro to FreeBSD workshop and a "Why You Should Contribute to FreeBSD" talk at the Rocky Mountain Celebration of Women in Computing in Lakewood, Colorado We continued producing FreeBSD advocacy material to help people promote FreeBSD around the world. Read more about our conference adventures in the conference recaps and trip reports in our monthly newsletters: https://www.freebsdfoundation.org/news-and-events/newsletter/ We help educate the world about FreeBSD by publishing the professionally produced FreeBSD Journal. We recently announced that the FreeBSD Journal will become a Free publication with the January/February 2019 issue. https://www.FreeBSDfoundation.org/journal/. You can find out more about events we attended and upcoming events at https://www.FreeBSDfoundation.org/news-and-events/. For a look back at all of efforts in 2018, please see the year-end video at https://www.freebsdfoundation.org/blog/thank-you-for-supporting-freebsd/. Legal/FreeBSD IP The Foundation owns the FreeBSD trademarks, and it is our responsibility to protect them. We also provide legal support for the core team to investigate questions that arise. Last quarter, we approved 6 requests to use the Trademark. Go to http://www.FreeBSDfoundation.org to find out how we support FreeBSD and how we can help you! __________________________________________________________________ FreeBSD Graphics Team status report Links Project GitHub page URL: https://github.com/FreeBSDDesktop Contact: FreeBSD Graphics Team Contact: Niclas Zeising The FreeBSD X11/Graphics team maintains the lower levels of the FreeBSD graphics stack. This includes graphics drivers, graphics libraries such as the MESA OpenGL implementation, the X.org xserver with related libraries and applications, and Wayland with related libraries and applications. In the forth quarter, the team focused on stablizing the graphics drivers and ports for the FreeBSD 12.0 release. The graphics drivers have been updated with new versions for both FreeBSD 11.2 and FreeBSD 12.0. The ports have been renamed in order to make it clearer which version of a port runs on which version on FreeBSD. We also created a new meta port, graphics/drm-kmod, which will install the correct driver based on FreeBSD version and architecture. Moving forward this is the recommended way to install the FreeBSD graphics drivers. The DRM drivers themselves are named graphics/drm-current-kmod and graphics/drm-fbsd12.0-kmod for CURRENT and 12.0 respectively, both of which have been updated to use the 4.16 Linux Kernel source. For FreeBSD 11.2 we have graphics/drm-fbsd11.2-kmod which uses the 4.11 Linux Kernel source. Finally, we created graphics/drm-legacy-kmod, which works on FreeBSD 12.0 and CURRENT. This is a copy of the legacy drivers from the FreeBSD base system. This work will make it possible for us to remove the drm2 code from CURRENT, something we are planning to do in early February. A remnant of the drm2 code will remain in the base after this due to an unresolved dependency for the NVIDIA Tegra ARM chip. Plans for its migration are expected to be finalized in first quarter in 2019. Support for i386 and PowerPC 64 has been added to the drm kernel drivers. This is currently in an alpha state. Wayland has been enabled by default in the ports tree, meaning that all packages are build with Wayland support enabled. This makes it much easier to use and test Wayland. Support for VMware graphics pass through has been added to the kernel driver. Support for this is still missing in graphcs/mesa-dri though, so it currently does not work out of the box. The input stack has been updated and is now for the most part current with upstream. Evdev headers were split off from multimedia/v4l_compat into their own port, devel/evdev-proto. This makes it easier to update those headers and keep them current with upstream, as needed. The input stack is still an area where more work needs to be done to make it easier to use various input devices with X and Wayland on FreeBSD. Several meetings has been held over the course of the period. Meeting notes have been sent out to the public x11@FreeBSD.org mailing list. People who are interested in helping out can find us on the x11@FreeBSD.org mailing list, or on our gitter chat: https://gitter.im/FreeBSDDesktop/Lobby. We are also available in #freebsd-xorg on EFNet. We also have a team area on GitHub where our work repositories can be found: https://github.com/FreeBSDDesktop __________________________________________________________________ FreeBSD Release Engineering Team Category: team The FreeBSD Release Engineering Team is responsible for setting and publishing release schedules for official project releases of FreeBSD, announcing code freezes and maintaining the respective branches, among other things. During the fourth quarter of 2018, the FreeBSD Release Engineering team continued working on the 12.0-RELEASE. The stable/12 branch was created on October 19, with the first BETA build being started shortly after. The release cycle slipped slightly with the addition of 12.0-BETA4, after which the releng/12.0 branch was created on November 16. The remainder of the release cycle continued relatively smoothly for the duration of the release candidate (RC) phase, with the final release builds starting December 7, and the official announcement sent December 11. Throughout the quarter, several development snapshots builds were released for the head and stable/11 branches. Much of this work was sponsored by the FreeBSD Foundation. __________________________________________________________________ Ports Collection Links About FreeBSD Ports URL: https://www.FreeBSD.org/ports/ Contributing to Ports URL: https://www.freebsd.org/doc/en_US.ISO8859-1/articles/contributing/ports-= contributing.html FreeBSD Ports Monitoring URL: http://portsmon.freebsd.org/index.html Ports Management Team">Ports Management Team URL: https://www.freebsd.org/portmgr/index.html Contact: Ren=E9 Ladan Contact: FreeBSD Ports Management Team The number of ports in the last quarter shrunk a bit to 32,900. At the end of the quarter there were 2365 open port PRs of which a small 500 were unassigned. The last quarter saw 7333 commits from 174 committers. This means that more port PRs were resolved than last quarter and the number of commits remained approximately the same. During the last quarter, we welcomed Alexandre C. Guimar=E3es (rigoletto@) and Vin=EDcius Zavam (egypcio@). The port commit bits of Alberto Villa (avilla@), Lars Thegler (lth@), Dryice Dong Liu (dryice@), Ion-Mihai Tetcu (itetcu@), Gabor Pali (pgj@), Tom Judge (tj@), Ollivier Robert (roberto@), and Maxim Sobolev (sobomax@) were taken in for safekeeping. The number of commit bits safekept is higher than usual because for port commit bits the idle timeout changed from 18 months to 12 months. Some default versions were changed: * PHP from 7.1 to 7.2 * Perl5 from 5.26 to 5.28 * Ruby from 2.4 to 2.5 * For LLVM, version 7.0 is now supported as a default version. Other big changes are: * info files are stored in the share/info directory just as other operating systems do. * PyQt ports can now be installed concurrently. * As FreeBSD 10 reached its end of life, support for this branch has been removed from the Ports Collection. People still requiring FreeBSD 10 support can use the RELEASE\_10\_EOL tag. * USES=3Dcmake now defaults to outsource * KDE 4 has reached its end-of-life and has been removed from the Ports Collection. Eager as ever, antoine@ ran 36 exp-runs this quarter to ensure major port upgrades were correct. __________________________________________________________________ Projects Projects that span multiple categories, from the kernel and userspace to the Ports Collection or external projects. amd64 Usermode Protection Keys Links The patch URL: https://reviews.freebsd.org/D18893 Contact: Konstantin Belousov Skylake Xeons have a new feature in 4-level paging implementation called Usermode Protection Keys. It is a complementary page access permission management mechanism, which provides very low-overhead disabling of all accesses or only modifications, on per-page basis. Each thread of execution gets 16 slots, called protection keys, while each userspace page mapping is tagged with one key. Processor provides a new 32bit register PKRU, which holds access and modification disable bits per key, the PKRU register is automatically context-switched, and managed by userspace using RDPKRU and WRPKRU instructions. See Intel SDM rev. 68 Vol 3 4.6.2 Protection Keys for further details. Since a key index must be always specified, this makes the key zero a default key, which permissions are tricky to modify without breaking the process environment. The rest 15 keys are usable, for instance process might put some sensitive data like decoded private key into the key protected area, and only enable access on as needed basis, without issuing costly mprotect(2) syscall. Note that permissions are enforced even for kernel access, so sneaky read(2) from other thread is subject to the same permission checks. I implemented the support for the amd64 pmap and provided convenient wrappers in libc both for 64bit and 32bit processes. Prototypes for the API are presented below and their use should be obvious from the explanation. int x86_pkru_get_perm(unsigned int keyidx, int access, int modify); int x86_pkru_set_perm(unsigned int keyidx, int access, int modify); int x86_pkru_protect_range(void *addr, unsigned long len, unsigned int keyidx, int flag); int x86_pkru_unprotect_range(void *addr, unsigned long len); This project was sponsored by The FreeBSD Foundation. __________________________________________________________________ bhyve - Live Migration Links Github wiki - How to Warm Migrate a bhyve guest URL: https://github.com/FreeBSD-UPB/freebsd/wiki/Virtual-Machine-Migration-us= ing-bhyve Github - Warm Migration branch URL: https://github.com/FreeBSD-UPB/freebsd/tree/projects/bhyve_migration Github - Live Migration branch URL: https://github.com/FreeBSD-UPB/freebsd/tree/projects/bhyve_migration_dev Contact: Elena Mihailescu Contact: Darius Mihai Contact: Sergiu Weisz Contact: Mihai Carabas The Migration feature uses the Save/Restore feature to migrate a bhyve guest from a FreeBSD host to another FreeBSD host. To migrate a bhyve guest, one needs to start an empty guest on the destination host from a shared guest image using the bhyve tool with the -R option followed by the source host IP and the port to listen to migration request. On the source host, the migration is started by executing the bhyvectl command with the --migrate or --migrate-live option, followed by the destination host IP and the port to send to the messages. New features added: * Prove that live migration cannot be implemented using the FreeBSD's Copy-on-Write mechanism; * Add --migrate-live option to bhyvectl; * Add additional message exchange between source and destination host to establish the migration type and the number of rounds; * Implement a dirty-bit approach for live migrating the guest's wired memory; Future tasks: * Clear the dirty bit after each migration round; * Extend live migration to highmem segment; * Extend live migration to unwired memory; This project was sponsored by Matthew Grooms. __________________________________________________________________ bhyve - Save/Restore Links Github repository for the save/restore and migration features URL: https://github.com/FreeBSD-UPB/freebsd/tree/projects/bhyve_migration Github wiki - How to Save and Restore a bhyve guest URL: https://github.com/FreeBSD-UPB/freebsd/wiki/Save-and-Restore-a-virtual-m= achine-using-bhyve Github wiki - Suspend/resume test matrix URL: https://github.com/FreeBSD-UPB/freebsd/wiki/Suspend-Resume-test-matrix Contact: Elena Mihailescu Contact: Darius Mihai Contact: Sergiu Weisz Contact: Mihai Carabas The Save/Restore for bhyve feature is a suspend and resume facility added to the FreeBSD/amd64's hypervisor, bhyve. The bhyvectl tool is used to save the guest state in three files (a file for the guest memory, a file for devices' and CPU's state and another one for some metadata that are used in the restore process). To suspend a bhyve guest, the bhyvectl tool must be run with the --suspend option followed by the guest name. To restore a bhyve guest from a checkpoint, one simply has to add the -r option followed by the main state file (the same file that was given to the --suspend option for bhyvectl) when starting the VM. New features added: * Improve timers' save and restore state feature; * Fix synchronization issues related to the ahci device save and restore state feature; * Add suspend/resume support for Windows guests; * Refactor save and restore code - save component's state field by field Future tasks: * Open ticket on Phabricator; * Add suspend/resume support for nvme; * Add suspend/resume support for virtio-console; * Add suspend/resume support for virtio-scsi; * Add TSC offseting for restore for AMD CPUs; This project was sponsored by Matthew Grooms; iXsystems;. __________________________________________________________________ Capsicum Links Capsicum Wiki Page URL: https://wiki.FreeBSD.org/Capsicum Contact: Mark Johnston Contact: Ed Maste Contact: Mariusz Zaborski The major improvement in Capsicum is introducing a Casper service fileargs, which is an easy way helps to sandbox the utils which need access to the filesystem. There are several examples of usage fileargs in applications like brandelf(1), wc(1), savecore(1), head(1) and strings(1). The fileargs service also helps to bring new features to the bhyve like audio device which is secured using Capsicum. Another big step was introducing a private Casper service and sandboxing the rtsold(8) and rtsol(8). Next major improvement, which is still under the review, is rewriting the sysctl service. The new sysctl service will allow in an easy way to use cap_sysctl() and cap_sysctlnametomib(). __________________________________________________________________ Collection of vt(4) color schemes Links iTerm2-Color-Schemes repository with previews URL: https://github.com/mbadolato/iTerm2-Color-Schemes iTerm2-Color-Schemes vt color schemes URL: https://github.com/mbadolato/iTerm2-Color-Schemes/tree/master/freebsd_vt Contact: Tobias Kortkamp Since 11.2-RELEASE vt(4) supports setting custom color schemes via the kern.vt.color.X.rgb tunables. This is nice but what was missing were some ready to use themes. iTerm2-Color-Schemes is a collection of around 200 color schemes for various terminals. It has recently gained support for vt(4). Customizing your console is now as easy as copy and pasting your favorite theme to /boot/loader.conf or /boot/loader.conf.local. __________________________________________________________________ i386 PAE Pagetables Links https://reviews.freebsd.org/D18894 URL: https://reviews.freebsd.org/D188= 94 Contact: Konstantin Belousov The i386 architecture (in modern terms, x86 architecture in 32bit protected mode), has supported hardware execute-disable since early 200x. The only problem preventing the i386 FreeBSD kernel from using it was that default page table format used by the kernel is 2-level paging, while nx bit is only available for PAE (2.5 levels) page table structures. PAE option is too intrusive, it changes both vm_paddr_t and bus_addr_t to 64bit, which is not too friendly to many drivers. I tried to provide PAE_PAGETABLES kernel option which only changed page table format, without affecting vm_paddr_t or bus_addr_t, thus keeping kernel/driver interfaces intact. But I was not able to make i386 releases carry two kernels, one to support relic hardware which cannot use PAE pagetables, and another for newer machines. So I finally did a merge which makes single i386 kernel carry two pmap modules, one for PAE and one for old two-level paging structures. Also I did not find a reason to not expand vm_paddr_t, while I have to keep bus_addr_t at 32bit. With a single boot-time knob, i386 kernel can now also utilize up to 24G or memory, if drivers correctly use busdma(9). I tried to fix iflib(4) and ahci(4) so that the most common hardware work, but I cannot do the pass over the whole tree. Hopefully, together with earlier 4/4G split work, this gives enough life for i386 kernel. This project was sponsored by The FreeBSD Foundation. __________________________________________________________________ Improving FreeBSD boot security Links TPM 2.0 driver URL: https://svnweb.freebsd.org/base/head/sys/dev/tpm/tpm20.c?revision=3D3420= 84&nview=3Dmarkup Loader Secure Boot support URL: https://reviews.freebsd.org/D18798 Secure Boot library URL: https://reviews.freebsd.org/D18797 binsign utility URL: https://reviews.freebsd.org/D18799 Contact: Michal Stanek Contact: Marcin Wojtas Contact: Kornel Duleba FreeBSD now supports TPM 2.0 devices. TPM (Trusted Platform Module) is a discrete chip which provides secure computation and secure NVRAM storage. It is most commonly associated with Measured Boot i.e. providing hash measurements of boot elements such as firmware images and boot configuration to the OS. In FreeBSD, the TPM can be used to strengthen security of services such as Strongswan IPsec, SSH or TLS by performing cryptographic operations in the TPM chip itself using embedded keys inaccessible to software. TPM facilities such as secure NVRAM storage, data sealing, random number generation and others are also available to any software via the IBM TSS library. UEFI Secure Boot is a technology which provides authentication of images that are executed on the host during boot. This prevents persistence of unauthorized malicious boot code such as rootkits. UEFI stores a list of allowed and blacklisted certificates and verifies signatures of all boot images and UEFI applications before they are executed on the CPU. Semihalf has developed support for X509 certificates and signature verification code in EFI loader with the help of the minimal BearSSL library. Lists of allowed and forbidden certificates are retrieved from UEFI environmental variables. This allows users to sign kernel binaries with a self-signed certificate, append the signature and let the loader verify its authenticity. UEFI Secure Boot support code will most likely be integrated with sjg's Veriexec support which is currently being reviewed on Phabricator. Semihalf is also working on improving security of Veriexec by moving manifest signature verification to the kernel. This project was sponsored by Stormshield. __________________________________________________________________ pfsync performance improvement Contact: Kristof Provost While pf itself can operate on multiple states simultaneously (on different cores), pfsync could not. It used a single PFSYNC_LOCK. This greatly reduced throughput on multicore systems as soon as pfsync was loaded. This was improved by splitting the pfsync queues into buckets, based on the state ID. This ensures that updates for a given connection always end up in the same bucket, allowing pfsync to still collapse multiple updates into one, while allowing multiple cores to proceed at the same time. The buckets are independently locked, allowing multiple cores to proceed at once. The number of buckets is tunable, but defaults to twice the number of cpus. Benchmarking has shown improvement of 30 to 100% depending on hardware and setup. During this effort several vnet-related issues were fixed as well, and a basic pfsync test case was added. This was committed into head in r341646, and later merged into stable/12 and stable/11. This project was sponsored by Orange Business Services. __________________________________________________________________ PWM Kernel API and userland utility Contact: Emmanuel Vadot A new subsystem was added to the kernel for PWM drivers to register themselves. In pair with the kernel subsystem, a pwm(8) utility is also available so users can configure PWM on their embedded boards. For now the only PWM driver compatible with this subsystem is for ARM Allwinner SoCs. __________________________________________________________________ Architectures Updating platform-specific features and bringing in support for new hardware platforms. Broadcom ARM64 SoC support Contact: Michal Stanek Contact: Marcin Wojtas Semihalf has recently started work on FreeBSD support for BCM5871X SoC series. These are quad-core 64-bit ARMv8 Cortex-A57 communication processors targeted for networking applications such as 10G routers, gateways, control plane processing and NAS. Initial support will include iProc PCIe, internal BNXT Ethernet controller, OTP (One Time Programmable memory) and crypto engine acceleration for IPsec offloading. This work is expected to be ready for FreeBSD-HEAD before Q3 2019. This project was sponsored by Juniper. __________________________________________________________________ DTS Update Contact: Emmanuel Vadot DTS files (Device Tree Sources) were updated to be on par with Linux 4.20 for head and 4.19 for the 12-STABLE branch. The DTS are now compiled for some arm64 boards, as the one present in U-Boot are not always up-to-date. __________________________________________________________________ ENA FreeBSD Driver Update Links ENA README URL: https://github.com/amzn/amzn-drivers/blob/master/kernel/fbsd/ena/README Contact: Michal Krawczyk ENA (Elastic Network Adapter) is the smart NIC which is used in the virtualized environment of Amazon Web Services (AWS). It supports multiple queues and can handle up to 25 Gb/s, depending on the instance type on which it is used. ENAv2 has been under development for FreeBSD, similar to Linux OS and DPDK. New changes are including: * Upgrade of the HAL to the version supporting ENAv2 * Optimization of the logging on the Tx path * LLQ (Low Latency Queue) feature, which is reducing latency on instances supporting ENAv2 * Optimization of the locks on hot paths by adding Tx queue management and lockless Rx queue cleanup * Fixes on the error handling paths * Use bitfield for tracking device states * Add additional doorbells on Tx path * Add queue depth setup in the runtime and allows Rx queue depth to be configured independently * And more minor bug fixes and code reorganization Todo: * Internal review and validation * Upstream of the patches This project was sponsored by Amazon.com Inc. __________________________________________________________________ FreeBSD on Power9 (ppc64) Parity * NMI semantics: NMIs need to be emulated by only soft disabling interrupts, disabling interrupts blocks all interrupts except machine check exceptions and system resets. * Superpage support is stable and on by default in the POWER9BSD staging branch * NUMA support: Parse OFW and set up appropriate structures for memory to be allocated from the correct domain and interrupts to be bound to the correct socket. * LKPI support for POWER9, Drm-next supports radeonkms. Some additional big endian changes required for amdgpu. * Interrupt handling improvements resulting in up to a 10% reduction in buildkernel time. * Cached XICS IPI vector * Added XIVE exploitation mode driver * Rust support in review. * Successfully booted an LLVM compiled kernel. __________________________________________________________________ FreeBSD/RISC-V update Contact: Ruslan Bukin Contact: Mark Johnston FreeBSD/RISC-V is getting more mature during last quarter. We have optimised RISC-V copyin(9)/copyout(9) routines. They now support word-sized copies where possible to dramatically increase speed of copying data between kernel and userspace. We made a series of improvements and bug fixes to pmap support (machine-dependent portion of virtual memory subsystem). This part was not touched during the last years, and is now getting attention. RISC-V GENERIC kernel gets support for witness(4) (The FreeBSD lock validation facility). The British company Embecosm has reported that they were able to boot FreeBSD on real hardware -- a SiFive Unleashed board. The support is limited to a single core only. We are expecting patches from them. __________________________________________________________________ libvdsk - QCOW2 implementation Links Github - Libvdsk QCOW2 branch URL: https://github.com/FreeBSD-UPB/freebsd/tree/projects/bhyve_libvdsk Contact: Sergiu Weisz Contact: Marcelo Araujo Contact: Mihai Carabas New features added: * Extend libvdsk to make it easier to implement new formats; * Implement read/write/probe functionalities in order to parse QCOW2 image files; Future tasks: * Add support for Copy-On-Write; * Add support for multiple snapshots; * Integrate libvdsk in bhyve This project was sponsored by Matthew Grooms. __________________________________________________________________ Marvell 8K SoC support Contact: Emmanuel Vadot Contact: Luis Octavio O Souza Support for booting FreeBSD on Marvell 8K SoC (present on the MacchiatoBin for example) has been commited. As of today, clocks, gpio, thermal, sdcard/eMMC drivers has been commited. SATA and USB were already working. This project was sponsored by Rubicon Communications, LLC ("Netgate"). __________________________________________________________________ Pinebook SDCard Image Contact: Emmanuel Vadot SDCard image is now produced for the Pinebook. By default the console is directed in the EFI Framebuffer and the serial console. __________________________________________________________________ RockChip Support Contact: Emmanuel Vadot Early support for the RockChip RK3399 has been commited. For now it's only possible to netboot boards (Like the RockPro64). Original patch was submitted by Greg V . Support for the RK805 and RK808 PMIC (Power Management IC) has been added. This allow changing some regulators voltage such as the cores one so cpufreq support works. You can change core frequencies with sysctl or powerd(8). __________________________________________________________________ Ports Changes affecting the Ports Collection, whether sweeping changes that touch most of the tree, or individual ports themselves. FreeBSD KDE status report Links KDE FreeBSD URL: https://freebsd.kde.org/ Contact: Adriaan de Groot Contact: Tobias C. Berner First of all, we removed KDE 4 from the ports tree this quarter. Qt4 will follow it by the end of march. Thanks to the update of libinput in ports we could finally update Plasma Desktop past 5.12, and are now again in sync with the upstream releases. KDE Frameworks and Applications were also kept in sync with upstream. We've also updated Qt5 to 5.12 -- with QtWebEngine still hanging on on 5.9.5 for now, but thanks to a new contributor we should have 5.12 by the end of Q1. In the background we changed the default behavior of cmake in the ports tree to default to outsource builds. People who are willing to contribute can find us on #kde-freebsd on freenode, and the kde@FreeBSD.org mailing list. Further we accept pull-requests and contributions on github.com/freebsd/freebsd-ports-kde. __________________________________________________________________ Miscellaneous Objects that defy categorization. BSD PL Links https://bsd-pl.org/ URL: https://bsd-pl.org/ Contact: Official Contact: Konrad Witaszczyk Contact: Mariusz Zaborski Contact: Jarosl/aw Zurek The Polish BSD User group is an initiative promoting systems from the BSD family. We organize both meetings and as well as tutorial sessions. In general, we have three presentations which last around 15 minutes. Afterwards there's an open discussions about topics related to operating systems and security. There's something for everybody, and the first presentation is about something connected to BSD and it's aimed at beginners. The second presentation is for more advanced BSD users but the final talk is more general and not connected to BSD. Usually it covers an interesting topic related to technology. Everyone can suggest a subject for the presentations and discussions. Some presentations from the past were about: ZFS checkpoints, GELI, FreeNAS, PAM, DTrace, Yubikey, Pytest, ZeroTrust, Jenkins and the iocage training session. Hope to see you there! __________________________________________________________________ Third-Party Projects Many projects build upon FreeBSD or incorporate components of FreeBSD into their project. As these projects may be of interest to the broader FreeBSD community, we sometimes include brief updates submitted by these projects in our quarterly report. The FreeBSD project makes no representation as to the accuracy or veracity of any claims in these submissions. ClonOS: virtualization platform on top of FreeBSD Operating System Links ClonOS Main Site URL: https://clonos.tekroutine.com Contact: Oleg Ginzburg What is ClonOS? ClonOS is a turnkey open-source platform based on FreeBSD and the CBSD framework. ClonOS offers a complete web UI for an easy control, deployment and management of FreeBSD jails containers and bhyve/Xen hypervisor virtual environments. ClonOS is currently the only available platform which allows both Xen and bhyve hypervisors to coexist on the same host. Since ClonOS is a FreeBSD-based platform, it has the ability to create and manage jails natively, allowing you to run FreeBSD applications without losing performance. Features: * easy management via web UI interface * bhyve management (create, delete VM) * Xen management (create, delete VM) [coming soon, roadmap] * connection to the "physical" guest console via VNC from the browser or directly * real time system monitoring * access to load statistics through SQLite3 and beanstalkd * support for ZFS features (cloning, snapshots) * import/export of virtual environments * public repository with virtual machine templates * puppet-based helpers for configuring popular services ClonOS 2018Q4 Status Report During this period, work was carried out to: * implement real-time graph for jail/bhyve based on RACCT statistics * test bhyve live migration, support live migration in CBSD * prepare ClonOS 19.01-RELEASE Open task: * ClonOS roadmap: https://clonos.tekroutine.com/roadmap.html * FreeNAS/XigmaNAS or any other NAS integration * I would like to see ClonOS in real-world use. In this regard, I am interested in finding more people and companies that use FreeBSD for vm/jail services. __________________________________________________________________ HardenedBSD 2018Q4 Update Links https://hardenedbsd.org URL: https://hardenedbsd.org Contact: Shawn Webb Introduction to HardenedBSD HardenedBSD is a security-enhanced fork of FreeBSD that aims to provide the BSD community with a clean-room reimplementation of the publicly-documented parts of the grsecurity patchset for Linux. We maintain close compatibility with FreeBSD by syncing every six hours with FreeBSD. HardenedBSD Foundation Update Through a generous donation by DEF CON, the computer security conference held each year in Las Vegas, and an anonymous member of the community, the HardenedBSD Foundation was able to provide the HardenedBSD project with a new Cavium ThunderX2 server. HardenedBSD has been working closely with FreeBSD's and Cavium's Jayachandran (jchandra@freebsd) to gain working support for the ThunderX2. As soon as the ThunderX2 becomes functional, HardenedBSD will be able to support both 12-STABLE and 13-CURRENT for arm64. We assisted OPNsense's migration from FreeBSD to HardenedBSD as the base operating system. OPNsense's January 2019 release (19.1) will complete the migration. Further work will be done to enable HardenedBSD's PaX NOEXEC implementation in OPNsense. PaX NOEXEC is a strong form of W^X, which prevents memory allocations from being both writable and executable, and toggling between the two. The HardenedBSD Foundation Corp. is a registered 501(c)(3) tax-exempt not-for-profit charitable organization in the United States. We look forward to a productive 2019, with work to support Cross-DSO CFI still ongoing. HardenedBSD 12-STABLE Released In December 2018, HardenedBSD published is first official release of 12-STABLE. From the release announcement: Improvements in 12-STABLE from 11-STABLE: * Non-Cross-DSO Control-Flow Integrity (CFI) for applications on amd64 and arm64. At this time, CFI is not applied to the kernel. More info on CFI is below. * Jailed bhyve (upstreamed to FreeBSD) * Per-jail toggles for unprivileged process debugging (the security.bsd.unprivileged_process_debug sysctl node. Upstreamed to FreeBSD.) * Spectre v2 mitigation with retpoline applied to the entirety of base and ports (with only a few ports opting out.) * Symmetric Multi-Threading (SMT) disabled by default (re-enable by setting machdep.hyperthreading_allowed to 1 in loader.conf(5)). * Migration of more compiler toolchain components to llvm's implementations (llvm-ar, llvm-nm, and llvm-objdump). * Compilation of applications with Link-Time Optimization (LTO). Non-Cross-DSO CFI Non-Cross-DSO CFI is an exploit mitigation technique that helps to prevent attackers from modifying the behavior of a program and jumping to undefined or arbitrary memory locations. Microsoft has implemented a variant of CFI, which they term Control Flow Guard, or CFG. The PaX team has spent the last few years perfecting their Reuse Attack Protector, RAP. CFI, CFG, and RAP all attempt to accomplish the same goal, with RAP being the most complete and effective implementation. Clang's CFI is stronger than Microsoft's CFG and PaX Team's RAP is stronger than both CFI and CFG. RAP would be a great addition to HardenedBSD; however, it requires a GPLv3 toolchain and is patented. Clang's CFI requires a linker that supports Link-Time Optimization (LTO). HardenedBSD 12-STABLE ships with lld as the default linker. All CFI schemes have been enabled for nearly all applications in base. Please note that any application that calls function pointers resolved via dlopen + dlsym will require the cfi-icall scheme to be disabled. HardenedBSD is the first enterprise operating system to apply Non-Cross-DSO CFI broadly to userland. __________________________________________________________________ The nosh project Links Introduction and blurb URL: http://jdebp.eu./Softwares/nosh/ Guide URL: http://jdebp.eu./Softwares/nosh/guide.html FreeBSD binary packages URL: http://jdebp.eu./Softwares/nosh/freebsd-binary-packages.html Installation how-to URL: http://jdebp.eu./Softwares/nosh/timorous-admin-installation-how-to.html Roadmap URL: http://jdebp.eu./Softwares/nosh/roadmap.html Contact: Jonathan de Boyne Pollard Background The nosh project is a suite of system-level utilities for initializing, running, and shutting down BSD systems; and for managing daemons, terminals, and logging. It supersedes BSD init, the Mewburn rc system, and OpenRC, drawing inspiration from daemontools-encore for service control/status mechanisms, UCSPI for networked services, Solaris SMF for named milestones, and IBM AIX for separated service and system management. It includes a range of compatibility mechanisms, including shims for familiar commands from other systems, and an automatic import mechanism that takes existing configuration data from /etc/fstab, /etc/rc.conf{,.local}, /etc/ttys, and elsewhere, applying them to its native service definitions and creating additional native services. It is portable (including to Linux) and composable, it provides a migration path from the world of systemd Linux, and it does not require new kernel APIs. It provides clean service environments, has orderings and dependencies between services, has parallelized startup and shutdown (including fsck), provides strictly size-capped and autorotated logging, has the service manager as a "subreaper", provides per-user service management as well as system-wide, provides user-space virtual terminals, brings TTY login under the general service management umbrella, and uses kevent(2) for event-driven parallelism. For more, see the aforelinked Introduction and blurb, and the nosh Guide. News The project has seen a lot of development since the last status report in 2017. To briefly touch upon just some of the things that have been worked on: * There are several more packages for things like running Bruce Guenter's bcron, shims for OpenRC's rc-update and rc-service tools, and shims for portable substitutes for a couple of Linux's util-linux tools. * There are quite a lot of new tools, including getuidgid, userenv-fromenv, setgid-fromenv, envgid, printenv, setlogin, console-decode-ecma48, console-control-sequence, console-flat-table-viewer, console-input-method, and local-stream-socket-connect. To look at just two of these: * printenv as a built-in allows more convenient use in conjunction with clearenv. It can also generate output in some additional formats. * console-control-sequence also responds to the name setterm, and can do most of what the non-portable util-linux tool by that name does; excluding the things that are specific to non-portable Linux ioctl()s and control codes (such as display adapter power management), but also including _extra_ standard DEC VT and ECMA-48 things that the util-linux tool does _not_ do (such as turning strikethrough, calculator keypad application mode, mouse reports, and the alternative screen buffer on and off). * There are a lot of new service bundles for more services, too many to list here. One can find them listed in the 1.37 and 1.38 + 1.39 release announcements. * There are new chapters in the nosh Guide, on packages and ports, on resources for terminals such as keyboard maps, input methods, and fonts, and on how the head0 user-space virtual terminal is structured. There are also new manual pages - in addition to the ones for all of the new commands, of course - on the subjects of the http://jdebp.eu./Softwares/nosh/guide/TerminalCapabilities.html system. There are also some replacements for some Linux manual pages that have gone missing over the past decade. * The external format configuration import subsystem has seen some major improvements in per-user service configuration. The per-user service manager itself gained a control FIFO, addressing a long-standing bug. A particular area of improvement since the last status report is the inclusion of input method capabilities in user-space virtual terminals. The input method mechanism uses the same CIN files as used by several other softwares, similar to how one can use existing SCO/FreeBSD keyboard maps and FreeBSD vt fonts. It places a simple textual user interface on top of a user-space virtual terminal, can switch amongst multiple input methods on the fly, and responds to both the dedicated keys on a JIS 106/109-key keyboard or a Korean 103/106-key keyboard and the conventional keys used on other keyboards. The blurb includes an example of how this works for a Japanese user, and the virtual terminal chapters of the nosh Guide now incorporate input methods into the doco. Another area of work was eliminating Wide NCurses from almost all of the tools, apart from the one tool that by definition uses it (console-ncurses-realizer). Wide NCurses has long been a porting difficulty for several operating systems, including Gentoo Linux and OpenBSD, and does not really model modern real world terminals and terminal emulators very well. It has been replaced by a new TerminalCapabilities library, in conjunction with a library for handling ECMA-48 character sequence decoding and ECMA-48/DEC VT control sequence generation. The decoder is the basis for the new console-decode-ecma48 tool, for example, as well as being the decoder for terminal input in console-termio-realizer and in full-screen TUI tools like chkservice and the new console-flat-table-viewer. The external formats import subsystem will also now make a replacement /etc/system-control/convert/termcap/termcap.db that one can use, which includes amongst other things the currently missing teken terminal type. Roadmap In addition to what is on the aforelinked roadmap, several things are on the cards for forthcoming versions. Tools that can feed the process table into console-flat-table-viewer in the proper vis(3) form. The ability to have different keyboard maps for different keyboards if one has multiple keyboards. A Linux shim for login.conf. Proper handling of CSI sub-parameters in SoftTerm. A manual page for the CIN file format. A time-env-next-matching tool. How you can help * The Z shell completions now have extensive coverage of the toolset, but there are no completions for the Bourne Again shell or the Friendly Interactive shell. Work on such completions would be welcome. The users who use those shells would welcome it especially. * The system-manager already recognizes a -b option for emergency mode. Work to make the FreeBSD loader and kernel send such an option to process #1, in response to an additional emergency mode boot menu choice, would be very welcome. * The monitor-fsck-progress and monitored-fsck tools stand ready to work with a -C option to fsck that makes it spit out progress information to an open file descriptor. Another way to help is to add this capability to fsck. * teken needs to be added to base termcap. It was put into NCurses terminfo back in 2014. __________________________________________________________________ --qDbXVdCdHGoSgWSk Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQGmBAEBCgCQFiEEbvjBe1hu6u1NeinjJCKD+Vwk/7oFAlyWM0RfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDZF RjhDMTdCNTg2RUVBRUQ0RDdBMjlFMzI0MjI4M0Y5NUMyNEZGQkESHHRyYXN6QGZy ZWVic2Qub3JnAAoJECQig/lcJP+6rcAIAJ9nIdRqBFEmGZRBkW5JtdiakjdT8ZMJ IK7+a1tl4yQKynZdNCrsdD6QbKK6rMBsVK3QNQR8d6wKTRCRhgm7DyFOr5E49MFx C+ESjPjgHFuUUFKlSUiFn23m5YAjAoPl1YoEo40GIYdAGsCg4yIJQrlXn6vwpmUX ba5mGUiOK6PnqjUm1tF3A9LEw0hE3eYCZS+ZgAqs56GUTtN7b6KMeuibX1uPAUgs 2hOmiOv3iQholzl5V+swmiKPbR1H5qp/j0TttS4Zf1KKC9+Zh0A8SzSvtdlyoWZD b7zsRCn4RlJypa4lztrMZld0euU9OCQ7gnYQmtN0bJLZy9opI4t3h+g= =eP4w -----END PGP SIGNATURE----- --qDbXVdCdHGoSgWSk-- From owner-freebsd-stable@freebsd.org Sat Mar 23 16:19:18 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A5AB01555359 for ; Sat, 23 Mar 2019 16:19:18 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: from mail-it1-f176.google.com (mail-it1-f176.google.com [209.85.166.176]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5D7616FEDA for ; Sat, 23 Mar 2019 16:19:17 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: by mail-it1-f176.google.com with SMTP id m18so7952145ita.3 for ; Sat, 23 Mar 2019 09:19:17 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=VY6XOf7+habO8nfZb0vBncLLSSb7BRmb8DFmZxDY7Pg=; b=kmJMZCQOj1/WanFFMV86o0tyKgFGnvL2C7cYneW+x4w2NXJh26dZp9i+6yNmLbziUF +YIJPabSGDxNJfDlEYy508MulWQ9oB+W4Vn9/VYspRnF+xNsWBMzJRcRE0j59Xw6R/ek qk0AySXaEg8OAILlifI0ieIvlOJiexMpIrdooyAOfBk7J0RPZKLRKxTEjrcgV9KFvN2M cneSulktIosnRvFXww/rOSG72fkpOPismMb6vl3NEHsAF3rV/car7Q4Crs23qCGJZfVd Jfp2wQtXf3ynbuOEyd93Wjafwd1u25b9ZVOoEBcMgiFxqUisPRMs6/DhSqV/NLcrKjvq TpfA== X-Gm-Message-State: APjAAAVGIF7Tt0A0LSjDgScRqBShtYXVRuaLspANh1ut+wOZkdOpO2Ym nxYkIsBJB3aWXL34jEmVBunCOp6VbrfOEI0DSWU= X-Google-Smtp-Source: APXvYqxR+ANCTAwgq6Ome17xeYmqnQTX+RF22Y4vhIr2da8eRygkvfCWxKTRAnqNsB1DKDE7QKP8Am9csRgp+YSWXfs= X-Received: by 2002:a02:1209:: with SMTP id i9mr11901389jad.111.1553357596140; Sat, 23 Mar 2019 09:13:16 -0700 (PDT) MIME-Version: 1.0 References: <35A0AE5B-B25D-4067-86E3-325E65F3C1F4@gmail.com> <046A9FEB-32C5-40E2-8E9D-1D3503101056@gmail.com> In-Reply-To: <046A9FEB-32C5-40E2-8E9D-1D3503101056@gmail.com> From: Ed Maste Date: Sat, 23 Mar 2019 12:13:03 -0400 Message-ID: Subject: Re: ifuncs check flawed? To: Dan Allen Cc: "freebsd-stable@freebsd.org Mailing FreeBSD-STABLE" Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 5D7616FEDA X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of carpeddiem@gmail.com designates 209.85.166.176 as permitted sender) smtp.mailfrom=carpeddiem@gmail.com X-Spamd-Result: default: False [-4.57 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; IP_SCORE(-2.66)[ip: (-7.21), ipnet: 209.85.128.0/17(-3.87), asn: 15169(-2.13), country: US(-0.07)]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_TRACE(0.00)[0:+]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[176.166.85.209.list.dnswl.org : 127.0.5.0]; NEURAL_HAM_SHORT(-0.90)[-0.902,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_TLS_LAST(0.00)[]; FORGED_SENDER(0.30)[emaste@freebsd.org,carpeddiem@gmail.com]; FREEMAIL_TO(0.00)[gmail.com]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[emaste@freebsd.org,carpeddiem@gmail.com]; SUBJECT_ENDS_QUESTION(1.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 23 Mar 2019 16:19:18 -0000 On Tue, 19 Mar 2019 at 16:54, Dan Allen wrote: > > That is why I think the check is flawed! The check works as intended, as suggested by the non-booting kernel produced with the checks removed. To help track this down can you run `make buildenv` and then in the resulting shell collect the output of `which ld` and `ld --version`? From owner-freebsd-stable@freebsd.org Sat Mar 23 18:13:31 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8DCA81558420 for ; Sat, 23 Mar 2019 18:13:31 +0000 (UTC) (envelope-from unga888@yahoo.com) Received: from sonic306-47.consmr.mail.gq1.yahoo.com (sonic306-47.consmr.mail.gq1.yahoo.com [98.137.68.110]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 52B9074A91 for ; Sat, 23 Mar 2019 18:13:30 +0000 (UTC) (envelope-from unga888@yahoo.com) X-YMail-OSG: SRgCN_IVM1kHfLseJa3.1kiQ7j68MCM5MZhVso9NzsQqBAflvS4erfMck7DZpyK MDoc88I4WCnalWCWeuhuMiTz3cgXjS3pIEVYcH51xmw8Df2issdvC8lYxcTDgSc1E2CLfSOKsraB kb1YtBg4avt8Cd..6PaZfOUZZkxdS7ul7hdCDaAYK0WqmafJVeIemioCMPwnRJ6jyUXsnMfz.66c Vs7Ywi09r1lROBa4UjgUhgz0YrEBXSCdfM4hkR7MIOKbWzITMfquDROIBZRldsLdtXl_v9nafOSg KcYPr18kYx1Qw_Xto6PSiiMHY9cTiRcbLyu.8FzMl.ddiJO3EBintbmQeZSvCz6XGsliH4yvxArM JuU92vxAEw..GBBxVpInjcd0TXELg.2Cy2W7XBviLINTSAkRVUpnwGO6LvMj6SDNb_i4sSRxCi5w .F9ijelU4uplkWkCZQ79B7EqmcAAVjidoB6K.ByCr5kVnYc0b7VXEnGhcjKbSTgyyAJDDSkvKMOR Y27oAEXOLzpqxuvSfzuWUOd7SRxP8N4UU3ZCKcareKZ9.U8AMlA6GayCYjwFyAXTgDh.vC4nkqXi 887fmJQoYOkr3iXOntCVvQoAgG9XTwweUIm7LzG09w_L58OenL8BsME7S3HqKwpeOhZFXPexBA_9 bqzjDqIA__tThvN6.NT7U3hY7uNohhstP0B69W3kfhxBKv64zYi846U9k2yBFW8uNYHpYwmfkfj5 TCbGAGojSgbJGbaDtFXIw8IwkdvkyZKHZnnV.TcRQdLMCyO3FW4xF9BhNs9uoR5ahreAEyUhorit j_LuQbgSjYP9oK24XMKLhuIWXvkoGmcQ0OR8qijXzRz0NrPZWvf6wLc6LQ..dav7S3SvOwUVmGK3 dFXigRvy1er2XUbrIWsHEoBgh7Iq1KJ8GxuZFijgDIcYk8NcCuWAh1g0WPMBfUdEf_A2UUD8Z5iD _bDLRLUt7Af4xsMOL.w0qRd9uehmjuozcK2WFR81y7z5KQUs2EpValpu1w907OdR8ua7DhoAUFej 9iDXbN8C2IiEeMJOVdcDnc72Mm_m3OfKOtA-- Received: from sonic.gate.mail.ne1.yahoo.com by sonic306.consmr.mail.gq1.yahoo.com with HTTP; Sat, 23 Mar 2019 18:13:26 +0000 Date: Sat, 23 Mar 2019 17:10:40 +0000 (UTC) From: Unga To: "freebsd-stable@freebsd.org" Message-ID: <671534126.8932488.1553361040673@mail.yahoo.com> Subject: Nvidia driver cannot compile on FreeBSD 12.0 MIME-Version: 1.0 References: <671534126.8932488.1553361040673.ref@mail.yahoo.com> X-Mailer: WebService/1.1.13212 YMailNorrin Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.75 Safari/537.36 X-Rspamd-Queue-Id: 52B9074A91 X-Spamd-Bar: / X-Spamd-Result: default: False [-0.47 / 15.00]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; FREEMAIL_FROM(0.00)[yahoo.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-0.76)[-0.758,0]; NEURAL_SPAM_MEDIUM(0.45)[0.454,0]; RCPT_COUNT_ONE(0.00)[1]; RCVD_TLS_LAST(0.00)[]; NEURAL_SPAM_SHORT(0.51)[0.511,0]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; DKIM_TRACE(0.00)[yahoo.com:+]; RCVD_IN_DNSWL_NONE(0.00)[110.68.137.98.list.dnswl.org : 127.0.5.0]; TO_DN_EQ_ADDR_ALL(0.00)[]; IP_SCORE(0.33)[ipnet: 98.137.64.0/21(0.95), asn: 36647(0.76), country: US(-0.07)]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/21, country:US]; RCVD_COUNT_TWO(0.00)[2]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0] Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 23 Mar 2019 18:13:31 -0000 Hi all I tried to install=C2=A0NVIDIA-FreeBSD-x86_64-418.56 display driver but I g= et following compilation error: # make install=3D=3D=3D> src (install)=3D=3D=3D> src/nvidia (install)cc=C2= =A0 -O2 -pipe -DNV_VERSION_STRING=3D\"418.56\" -D__KERNEL__ -DNVRM -Wno-unu= sed-function -Wuninitialized -O2 -fno-strict-aliasing -mno-red-zone -mcmode= l=3Dkernel -UDEBUG -U_DEBUG -DNDEBUG -Werror=3Dundef=C2=A0 -Werror -D_KERNE= L -DKLD_MODULE -nostdinc=C2=A0 -I. -I../common/inc -I. -I/usr/src/sys -I/us= r/src/sys/contrib/ck/include -fno-common=C2=A0 -fno-omit-frame-pointer -mno= -omit-leaf-frame-pointer=C2=A0 =C2=A0 -mcmodel=3Dkernel -mno-red-zone -mno-= mmx -mno-sse -msoft-float=C2=A0 -fno-asynchronous-unwind-tables -ffreestand= ing -fwrapv -fstack-protector -Wall -Wredundant-decls -Wnested-externs -Wst= rict-prototypes -Wmissing-prototypes -Wpointer-arith -Wcast-qual -Wundef -W= no-pointer-sign -D__printf__=3D__freebsd_kprintf__ -Wmissing-include-dirs -= fdiagnostics-show-option -Wno-unknown-pragmas -Wno-error-tautological-compa= re -Wno-error-empty-body -Wno-error-parentheses-equality -Wno-error-unused-= function -Wno-error-pointer-sign -Wno-error-shift-negative-value -Wno-addre= ss-of-packed-member=C2=A0 -mno-aes -mno-avx=C2=A0 -std=3Diso9899:1999 -c nv= idia_acpi.c -o nvidia_acpi.oIn file included from nvidia_acpi.c:12:./os-int= erface.h:27:10: fatal error: 'stdarg.h' file not found#include = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0^~~~~~~~~~1 error generated. My OS:# uname -aFreeBSD unga 12.0-RELEASE FreeBSD 12.0-RELEASE r341666 GENE= RIC=C2=A0 amd64 I used to have a previous version of Nvidia driver running well on FreeBSD = 11.2 on the same machine. Any idea? Best regardsUnga