From owner-freebsd-arm@freebsd.org Tue Dec 15 16:22:56 2015 Return-Path: Delivered-To: freebsd-arm@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E4FCDA43065 for ; Tue, 15 Dec 2015 16:22:56 +0000 (UTC) (envelope-from karl@denninger.net) Received: from mail.denninger.net (wsip-70-169-168-7.pn.at.cox.net [70.169.168.7]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 996AF1D2D for ; Tue, 15 Dec 2015 16:22:56 +0000 (UTC) (envelope-from karl@denninger.net) Received: from [192.168.1.40] (Karl-Desktop.Denninger.net [192.168.1.40]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.denninger.net (Postfix) with ESMTPSA id 3DBBF235E2C for ; Tue, 15 Dec 2015 10:22:48 -0600 (CST) Subject: Re: Updating / keeping current strategies? To: "freebsd-arm@freebsd.org" References: <5666F37C.4060908@denninger.net> <10BBDDBB-75AA-4034-B494-9EB28D009882@gromit.dlib.vt.edu> <566EEAC4.1060306@denninger.net> <566F0238.9060605@denninger.net> <1450190791.25138.30.camel@freebsd.org> <567031C9.2090109@denninger.net> <1450195123.25138.42.camel@freebsd.org> From: Karl Denninger X-Enigmail-Draft-Status: N1110 Message-ID: <56703E2D.8050504@denninger.net> Date: Tue, 15 Dec 2015 10:22:05 -0600 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.4.0 MIME-Version: 1.0 In-Reply-To: <1450195123.25138.42.camel@freebsd.org> Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-512; boundary="------------ms040102000306060807030605" X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Dec 2015 16:22:57 -0000 This is a cryptographically signed message in MIME format. --------------ms040102000306060807030605 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable On 12/15/2015 09:58, Ian Lepore wrote: > On Tue, 2015-12-15 at 09:29 -0600, Karl Denninger wrote: >> On 12/15/2015 08:46, Ian Lepore wrote: >>>>> There seem to be some problems with this in the general sense, >>>>> unless >>>>> you're willing to move the media around (I'm generally not.) >>>>> >>>>> Using that script in the Wiki appears to work, but there are >>>>> problems.=20 >>>>> If you try to nfs mount the object and source directories on >>>>> the >>>>> target >>>>> so you can do a "make installworld" or "make installkernel" on >>>>> the >>>>> target you quickly find that clang wasn't cross-built in the >>>>> object >>>>> directory; the "tmp" directory in object contains a copy of it, >>>>> but >>>>> it's >>>>> compiled for your _*source*_ machine (in this case >>>>> FreeBSD/amd64) >>>>> and >>>>> the install blows up as it can't determine the cc version. The >>>>> interesting thing is that what's in ~/nfsroot/usr/bin/cc is >>>>> correct >>>>> which doesn't appear to make sense, but it is what it is. >>>>> >>>>> I'm going to see if I can get a rsync-type thing to work.... >>>>> >>>> It.... gets.... worse. >>>> >>>> I can update using rsync. However, the armv6hf target given in >>>> the >>>> wiki >>>> at https://wiki.freebsd.org/FreeBSD/arm/crossbuild produces >>>> binaries >>>> that blow up when floating point is attempted. Armv6 is >>>> deprecated >>>> and >>>> won't build at all. >>>> >>> I'm having a hard time understanding this. Nobody else is >>> reporting >>> problems with cross-built binaries that use floating point. Also, >>> armv6 is deprecated only in the sense that armv6hf is more >>> efficient >>> and there's no reason to use the old softfp ABI anymore. But that >>> doesn't mean it can't be built, it builds and cross-builds just >>> fine. >>> >>> -- Ian >> Well, I'm reporting what I got. I followed the instructions in the >> Wiki, got a product nfsroot directory and the expected src and obj >> directories, attempted to mount the src and obj directories over nfs >> and >> execute a "make installworld" on the target and that blew up with >> complaints about expected directories being missing. >> > Oh, you can't do that. The pathnames in the obj directory are correct > for the build machine, but wrong when nfs-mounted on another machine. Well, but they are if I maintain the paths. Example: I have the build at /pics/CrossBuild on the source (10.2-STABLE amd64) machine. I export /pics/CrossBuild. I then mount that at /pics/CrossBuild on the target. Now the paths are the same. But..... when I try to do a "make installkernel" as you would do if doing this on a consistent architecture what I get is this: root@Pool-MCP:/pics/CrossBuild # ./mk installkernel TARGET_ARCH=3Darmv6hf= + cd /pics/CrossBuild/src + nice -10 make -j 4 -DNO_CLEAN 'TARGET_ARCH=3Darmv6hf' 'DESTDIR=3D/pics/CrossBuild/nfsroot' '__MAKE_CONF=3D/pics/CrossBuild/config/make.conf' 'srcconf=3D/pics/CrossBuild/config/src.conf' 'KERNCONF=3DRPI2' 'UBLDR_LOADADDR=3D0x2000000' installkernel 'TARGET_ARCH=3Darmv6hf' --- installkernel --- --- installkernel --- -------------------------------------------------------------- >>> Installing kernel RPI2 -------------------------------------------------------------- cd /pics/CrossBuild/obj/arm.armv6hf/pics/CrossBuild/src/sys/RPI2;=20 MAKEOBJDIRPREFIX=3D/pics/CrossBuild/obj/arm.armv6hf MACHINE_ARCH=3Darmv6= hf=20 MACHINE=3Darm CPUTYPE=3D GROFF_BIN_PATH=3D/pics/CrossBuild/obj/arm.armv6hf/pics/CrossBuild/src/tmp= /legacy/usr/bin=20 GROFF_FONT_PATH=3D/pics/CrossBuild/obj/arm.armv6hf/pics/CrossBuild/src/tm= p/legacy/usr/share/groff_font=20 GROFF_TMAC_PATH=3D/pics/CrossBuild/obj/arm.armv6hf/pics/CrossBuild/src/tm= p/legacy/usr/share/tmac CC=3D"cc " CXX=3D"c++ " DEPFLAGS=3D"" CPP=3D"cpp " AS=3D"as" AR=3D"ar= " LD=3D"ld" NM=3Dnm OBJDUMP=3Dobjdump OBJCOPY=3D"objcopy" RANLIB=3Dranlib STRINGS=3D= =20 SIZE=3D"size" PATH=3D/pics/CrossBuild/obj/arm.armv6hf/pics/CrossBuild/src/tmp/legacy/us= r/sbin:/pics/CrossBuild/obj/arm.armv6hf/pics/CrossBuild/src/tmp/legacy/us= r/bin:/pics/CrossBuild/obj/arm.armv6hf/pics/CrossBuild/src/tmp/legacy/bin= :/pics/CrossBuild/obj/arm.armv6hf/pics/CrossBuild/src/tmp/usr/sbin:/pics/= CrossBuild/obj/arm.armv6hf/pics/CrossBuild/src/tmp/usr/bin:/sbin:/bin:/us= r/sbin:/usr/bin=20 make KERNEL=3Dkernel install sh: cc: Exec format error make[2]: "/pics/CrossBuild/src/share/mk/bsd.compiler.mk" line 137: Unable to determine compiler type for cc . Consider setting COMPILER_TYP= E. *** [installkernel] Error code 1 make[1]: stopped in /pics/CrossBuild/src 1 error make[1]: stopped in /pics/CrossBuild/src *** [installkernel] Error code 2 make: stopped in /pics/CrossBuild/src 1 error make: stopped in /pics/CrossBuild/src root@Pool-MCP:/pics/CrossBuild # When investigating this what I find is that the executable in the path for "cc" is in fact an arm64 executable! So I have a built system but no way to install it. > > The instructions in the wiki page you cited are how to set up a > development environment that uses an nfs-mounted root directory. You > can also use it as a source for rsync, but you can't install directly > from the objdir of such a build environment using an nfs mount unless > the target system has the exact directory layout of the build system > after nfs-mounting the source and obj dirs. Except that doesn't work because the PATH contains executables for the source which is a different architecture. And when I tried to rsync it I got a system that booted and ran, sort of, but anything that did floating point blew up. That might be because of schg flags prevented some of the copies and rsync has no good way to get around that (removing them from the target is undesirable for all the obvious reasons.) > > Another way to make it work is to nfs-mount the target's root directory= > on your build machine, then you can make installworld DESTDIR=3D That's an interesting idea that I will look into. It's undesirable for a number of reasons down the road (enabling nfs server on these machines isn't my idea of a good thing over time) but it might get me going for the moment. >> I then attempted to rsync the nfsroot directory to the target machine >> (a >> Raspberry Pi2); that succeeded. But, once the machine was rebooted >> any >> attempt to execute anything that had floating point operations >> dumped; >> "awk", for example, blows up. >> > I built on a 10.2-STABLE machine, if that matters. > Using a kernel and world built yesterday for armv6hf... > > root@wand :~ # awk "BEGIN {print 2.7+4.2 }" > 6.9 > > I do all my building on a 10-stable machine. > > I wonder if your first attempt to installworld somehow installed some > x86 stuff by accident and now you've got a mixed/broken world, and rsyn= > c didn't fix it because some of the broken files were more recent? > > -- Ian Maybe. But I don't think so; I suspect the issue revolves around schg flags (in other words some things didn't update) and if so it's a problem since I don't believe rsync can deal with that. --=20 Karl Denninger karl@denninger.net /The Market Ticker/ /[S/MIME encrypted email preferred]/ --------------ms040102000306060807030605 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC Bl8wggZbMIIEQ6ADAgECAgEpMA0GCSqGSIb3DQEBCwUAMIGQMQswCQYDVQQGEwJVUzEQMA4G A1UECBMHRmxvcmlkYTESMBAGA1UEBxMJTmljZXZpbGxlMRkwFwYDVQQKExBDdWRhIFN5c3Rl bXMgTExDMRwwGgYDVQQDExNDdWRhIFN5c3RlbXMgTExDIENBMSIwIAYJKoZIhvcNAQkBFhND dWRhIFN5c3RlbXMgTExDIENBMB4XDTE1MDQyMTAyMjE1OVoXDTIwMDQxOTAyMjE1OVowWjEL MAkGA1UEBhMCVVMxEDAOBgNVBAgTB0Zsb3JpZGExGTAXBgNVBAoTEEN1ZGEgU3lzdGVtcyBM TEMxHjAcBgNVBAMTFUthcmwgRGVubmluZ2VyIChPQ1NQKTCCAiIwDQYJKoZIhvcNAQEBBQAD ggIPADCCAgoCggIBALmEWPhAdphrWd4K5VTvE5pxL3blRQPyGF3ApjUjgtavqU1Y8pbI3Byg XDj2/Uz9Si8XVj/kNbKEjkRh5SsNvx3Fc0oQ1uVjyCq7zC/kctF7yLzQbvWnU4grAPZ3IuAp 3/fFxIVaXpxEdKmyZAVDhk9az+IgHH43rdJRIMzxJ5vqQMb+n2EjadVqiGPbtG9aZEImlq7f IYDTnKyToi23PAnkPwwT+q1IkI2DTvf2jzWrhLR5DTX0fUYC0nxlHWbjgpiapyJWtR7K2YQO aevQb/3vN9gSojT2h+cBem7QIj6U69rEYcEDvPyCMXEV9VcXdcmW42LSRsPvZcBHFkWAJqMZ Myiz4kumaP+s+cIDaXitR/szoqDKGSHM4CPAZV9Yh8asvxQL5uDxz5wvLPgS5yS8K/o7zDR5 vNkMCyfYQuR6PAJxVOk5Arqvj9lfP3JSVapwbr01CoWDBkpuJlKfpQIEeC/pcCBKknllbMYq yHBO2TipLyO5Ocd1nhN/nOsO+C+j31lQHfOMRZaPQykXVPWG5BbhWT7ttX4vy5hOW6yJgeT/ o3apynlp1cEavkQRS8uJHoQszF6KIrQMID/JfySWvVQ4ksnfzwB2lRomrdrwnQ4eG/HBS+0l eozwOJNDIBlAP+hLe8A5oWZgooIIK/SulUAsfI6Sgd8dTZTTYmlhAgMBAAGjgfQwgfEwNwYI KwYBBQUHAQEEKzApMCcGCCsGAQUFBzABhhtodHRwOi8vY3VkYXN5c3RlbXMubmV0Ojg4ODgw CQYDVR0TBAIwADARBglghkgBhvhCAQEEBAMCBaAwCwYDVR0PBAQDAgXgMCwGCWCGSAGG+EIB DQQfFh1PcGVuU1NMIEdlbmVyYXRlZCBDZXJ0aWZpY2F0ZTAdBgNVHQ4EFgQUxRyULenJaFwX RtT79aNmIB/u5VkwHwYDVR0jBBgwFoAUJHGbnYV9/N3dvbDKkpQDofrTbTUwHQYDVR0RBBYw FIESa2FybEBkZW5uaW5nZXIubmV0MA0GCSqGSIb3DQEBCwUAA4ICAQBPf3cYtmKowmGIYsm6 eBinJu7QVWvxi1vqnBz3KE+HapqoIZS8/PolB/hwiY0UAE1RsjBJ7yEjihVRwummSBvkoOyf G30uPn4yg4vbJkR9lTz8d21fPshWETa6DBh2jx2Qf13LZpr3Pj2fTtlu6xMYKzg7cSDgd2bO sJGH/rcvva9Spkx5Vfq0RyOrYph9boshRN3D4tbWgBAcX9POdXCVfJONDxhfBuPHsJ6vEmPb An+XL5Yl26XYFPiODQ+Qbk44Ot1kt9s7oS3dVUrh92Qv0G3J3DF+Vt6C15nED+f+bk4gScu+ JHT7RjEmfa18GT8DcT//D1zEke1Ymhb41JH+GyZchDRWtjxsS5OBFMzrju7d264zJUFtX7iJ 3xvpKN7VcZKNtB6dLShj3v/XDsQVQWXmR/1YKWZ93C3LpRs2Y5nYdn6gEOpL/WfQFThtfnat HNc7fNs5vjotaYpBl5H8+VCautKbGOs219uQbhGZLYTv6okuKcY8W+4EJEtK0xB08vqr9Jd0 FS9MGjQE++GWo+5eQxFt6nUENHbVYnsr6bYPQsZH0CRNycgTG9MwY/UIXOf4W034UpR82TBG 1LiMsYfb8ahQJhs3wdf1nzipIjRwoZKT1vGXh/cj3gwSr64GfenURBxaFZA5O1acOZUjPrRT n3ci4McYW/0WVVA3lDGCBRMwggUPAgEBMIGWMIGQMQswCQYDVQQGEwJVUzEQMA4GA1UECBMH RmxvcmlkYTESMBAGA1UEBxMJTmljZXZpbGxlMRkwFwYDVQQKExBDdWRhIFN5c3RlbXMgTExD MRwwGgYDVQQDExNDdWRhIFN5c3RlbXMgTExDIENBMSIwIAYJKoZIhvcNAQkBFhNDdWRhIFN5 c3RlbXMgTExDIENBAgEpMA0GCWCGSAFlAwQCAwUAoIICTTAYBgkqhkiG9w0BCQMxCwYJKoZI hvcNAQcBMBwGCSqGSIb3DQEJBTEPFw0xNTEyMTUxNjIyMDVaME8GCSqGSIb3DQEJBDFCBEBo hDmCaE3XP5zzpRiI9sx9BF2ldKgseB3HIYtb4jEEoc4zFjvZhVpnGsiO9CsFvX9kQ+ljfkRs CloOCj4U8R+/MGwGCSqGSIb3DQEJDzFfMF0wCwYJYIZIAWUDBAEqMAsGCWCGSAFlAwQBAjAK BggqhkiG9w0DBzAOBggqhkiG9w0DAgICAIAwDQYIKoZIhvcNAwICAUAwBwYFKw4DAgcwDQYI KoZIhvcNAwICASgwgacGCSsGAQQBgjcQBDGBmTCBljCBkDELMAkGA1UEBhMCVVMxEDAOBgNV BAgTB0Zsb3JpZGExEjAQBgNVBAcTCU5pY2V2aWxsZTEZMBcGA1UEChMQQ3VkYSBTeXN0ZW1z IExMQzEcMBoGA1UEAxMTQ3VkYSBTeXN0ZW1zIExMQyBDQTEiMCAGCSqGSIb3DQEJARYTQ3Vk YSBTeXN0ZW1zIExMQyBDQQIBKTCBqQYLKoZIhvcNAQkQAgsxgZmggZYwgZAxCzAJBgNVBAYT AlVTMRAwDgYDVQQIEwdGbG9yaWRhMRIwEAYDVQQHEwlOaWNldmlsbGUxGTAXBgNVBAoTEEN1 ZGEgU3lzdGVtcyBMTEMxHDAaBgNVBAMTE0N1ZGEgU3lzdGVtcyBMTEMgQ0ExIjAgBgkqhkiG 9w0BCQEWE0N1ZGEgU3lzdGVtcyBMTEMgQ0ECASkwDQYJKoZIhvcNAQEBBQAEggIAg4/1Rj1Q Ln42M5xrax6SjTnTUvLdjJIcnYRQTcqCFhcQ0sWtfZxln6AsQ1GSTixHE5Ha1I9dgu45Wtam VbysQOnBZPqiX3r7TnLlPNEvxM58rG515ITXEZQWyCbltn7+kJUXmO2IsHvPl/CB2qsCV4b9 EQSCmUyHsXxcvts1CliT4Zi/kivZBt9+crqrpeJHpUm3LsYCFBk03dUlV0bwyTzfUTxC2WGE /CvsTUae7H7cfC7G5JSvDmwOOTkDVmU9ZhHM3rh/XXzdZiF3k8B+XK0OiP/ElnWdXc+GCW4P lH5EAGnBE6GW5LlYMwUEqr8WVCD1igu6oKUoku0NjvSob/hHMAKFqon56R/QmQqoGjfzAbF/ TgotuamVRog90sd6o97AeIAE6TurYwtTswaF60cH76k7xutd0/wjVOZd+T4HMUBynObQ0SX3 1YW1Bzy+kSPUkv05n16/+z0uE5IUaySlr23FoiosCG5FeWFZIXGDKP80bl08QcpvSukrcrah d+oaGVX7YPvE6iS4Cf4yhAzkW1unD3Ji2nIfBnLGtXMy+sl9V6eBV3DosoP3gN5k58Ed4Gl+ lx+fjB4oVhXHYLzOd0WRtDkDhPfHXDzejZYBz26WDhYley7fpVB4lEwDfLphG5DfKarvRBlY oAcVK0GMTp8nkHTwvghIK0kYqbsAAAAAAAA= --------------ms040102000306060807030605--