From owner-freebsd-current@freebsd.org Sat Jan 21 21:20:16 2017 Return-Path: Delivered-To: freebsd-current@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 85322CBA69F for ; Sat, 21 Jan 2017 21:20:16 +0000 (UTC) (envelope-from o.hartmann@walstatt.org) Received: from mout.gmx.net (mout.gmx.net [212.227.15.19]) (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mout.gmx.net", Issuer "TeleSec ServerPass DE-2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 00077A2C; Sat, 21 Jan 2017 21:20:15 +0000 (UTC) (envelope-from o.hartmann@walstatt.org) Received: from thor.intern.walstatt.dynvpn.de ([85.179.134.145]) by mail.gmx.com (mrgmx001 [212.227.17.190]) with ESMTPSA (Nemesis) id 0M2c1V-1cE4ck1xiv-00sMlZ; Sat, 21 Jan 2017 22:20:07 +0100 Date: Sat, 21 Jan 2017 22:20:01 +0100 From: "O. Hartmann" To: Glen Barber Cc: "O. Hartmann" , freebsd-current@freebsd.org Subject: Re: ISO image: where is the CLANG compiler? Message-ID: <20170121222001.40ce534c@thor.intern.walstatt.dynvpn.de> In-Reply-To: <20170119193830.GH1451@FreeBSD.org> References: <20170118101915.523d7d7b@freyja.zeit4.iv.bundesimmobilien.de> <20170118123515.GE58505@zxy.spb.ru> <20170118160801.229b4134@freyja.zeit4.iv.bundesimmobilien.de> <20170118153832.GA6905@c720-r292778-amd64> <20170118203726.7dea0515@thor.intern.walstatt.dynvpn.de> <20170119055816.GA2184@c720-r292778-amd64> <20170119101636.5537f4fd@freyja.zeit4.iv.bundesimmobilien.de> <20170119191000.GG1451@FreeBSD.org> <20170119193830.GH1451@FreeBSD.org> Organization: WALSTATT User-Agent: OutScare 3.1415926 X-Operating-System: ImNotAnOperatingSystem 3.141592527 MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; boundary="Sig_/c4eNjqeh+9ZISaXiY2GJr1K"; protocol="application/pgp-signature" X-Provags-ID: V03:K0:7H/cn2UlgGUlrAa7DHBWIJdlihSGv74/hArh+DWaismB6YyOdJ/ MppJAvb9T2L0HZ1CZmjlW453U6JqEKKTz8+vkUnTYdm15CdSzEl69hqep8+C/8/xZPvaRcm UO1qtwQ4/F0bMnOsON0YH1pB0/06qmeGAJAEjj8P//A75BXe4r6pcQd93cbu2wYDQs0SOn7 rCM4PzFxAp9IBD6REACdA== X-UI-Out-Filterresults: notjunk:1;V01:K0:XuAQ7nhyL3Y=:ZvL4UUUpkGs0oDC1ToP/S+ wWnoi3L+NAPKM9UWU5eqW6eqqFS497zJLpeSN4SNhWJaseTv4+aPHDMavLuRz34bdModWfCTR 2NA29vSFf5j8QA4wJhnluc2bf79kqJsCZKPrF1yPBrKPm6bGeM3yyPOVf0UgVLl4aghEWpZ2i C2G3omGOkuhlab2AucsV/pkAZ5I4rxDVn3D7NDhQN+PVGNsJxHi7KJI6JnjCq0YrbM/g/hq8v E7H+Ma/5Wr8cZJpdu50iWPbebeBCmH5K8Iz6p+x428CWJojLtQEHaW7RMW21802TszVTbS65W JspXH/OnoB/8U4vZNeZFNmBEUy/iaJc8gYff2oDF2sd6ZUff1VO2lIN9PIywO/Ey3EAN+lt3M dlDMm4HiQ4akZpG1nD73MGH6WMjDRjGxBoYOyP7pCKZQuybkcMZ7NinV6Z1ShD3yHtv2E3WNo NqB+IXVw6DNNo5ZFndS/pCWse4UO0vVc8m4Vs82e0z01aKgKcDXefKFIT4GISqArOz5OjvS8e QOjG+K7t8J8iUD22v/L9tD5hZCm84oMjUlx98w3dJ9EEftFQHXE+qLe15JZTgrmmxJg7Snu+v sjF9YfMHHJZo392gnFChDUphfWTDadN3if/WtUPrtRWD51R2/nssOo9voAy0KpbfUxaravcMc TXFCHJ7UTfUXstUNyBn+nPvt/VoV2aigtnRrErbTWrAaKsEgTo77AaZ8zJ6wwbIwGlpDh32NF /gyYZw/OQzbBsqXmsQP3eCfxQsx/62bA1hut3b+n7GiOYXV8prsk9zF3fWo= X-Mailman-Approved-At: Sun, 22 Jan 2017 01:53:37 +0000 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 21 Jan 2017 21:20:16 -0000 --Sig_/c4eNjqeh+9ZISaXiY2GJr1K Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable Am Thu, 19 Jan 2017 19:38:30 +0000 Glen Barber schrieb: > On Thu, Jan 19, 2017 at 07:10:00PM +0000, Glen Barber wrote: > > On Thu, Jan 19, 2017 at 10:16:46AM +0100, O. Hartmann wrote: =20 > > > On Thu, 19 Jan 2017 06:58:16 +0100 > > > Matthias Apitz wrote: > > > =20 > > > > El d=EDa Wednesday, January 18, 2017 a las 08:00:04PM -0500, Allan = Jude > > > > escribi=F3: > > > > =20 > > > > > On 2017-01-18 14:37, O. Hartmann wrote: =20 > > > > > > Am Wed, 18 Jan 2017 16:38:32 +0100 > > > > > > Matthias Apitz schrieb: > > > > > > =20 > > > > > >> Why you do not just boot from USB some mem stick image, mount = some disk > > > > > >> space to /mnt, svn checkout CURRENT to /mnt and build a bootea= ble system > > > > > >> (world and kernel) and install to DESTDIR=3D/mnt ? > > > > > >> > > > > > >> I do not understand all this hassle? > > > > > >> > > > > > >> matthias > > > > > >> =20 > > > > > >=20 > > > > > > Wow! > > > > > >=20 > > > > > > As I initially stated, that is EXACTLY what I was inclined to d= o except > > > > > > the fact that I had already an intact /usr/obj and usr/src with= a > > > > > > complete compiled system. > > > > > >=20 > > > > > > I booted from mem stick and I was lost due to no cc! > > > > > >=20 > > > > > > Even for "make installworld" it seems I have to rely on the com= piler. And > > > > > > the images (ISO, memstick et cetera) provided these days do not= contain > > > > > > any clang. =20 > > > >=20 > > > > Yes, you will need it and it will complain about missing it, if for > > > > example you moved 'obj and 'src' to other dirs after 'make build...' > > > >=20 > > > > But, in your case the mem image really is lacking the cc/clang; I > > > > fetched the image an did: > > > >=20 > > > >=20 > > > > # mdconfig -a -t vnode -u 1 -f > > > > ~guru/Downloads/FreeBSD-11.0-RELEASE-amd64-memstick.img # mount -o > > > > ro /dev/md1p3 /mnt # find /mnt -name clang > > > > /mnt/usr/share/doc/llvm/clang > > > > /mnt/usr/lib/clang > > > > /mnt/usr/lib/debug/usr/lib/clang > > > > # find /mnt -name cc > > > > /mnt/usr/include/netinet/cc > > > >=20 > > > > With this img alone, you can't compile a system :-( > > > >=20 > > > > Setup a system from DVD and build your own image containing a compl= ete > > > > system on an USB key; with this boot your damaged system, recompile= and > > > > reinstall world and kernel. If you (O. Hartmann) need a step by step > > > > guide, I could send it to you. > > > >=20 > > > > matthias > > > > =20 > > >=20 > > > Hello, > > >=20 > > > thanks for your help offering! very kind. > > >=20 > > > I've already solved the problem - not with the suggested process, but= via > > > copying missing libs and files from and identical intact source. Afte= r that, I > > > ran make buildword/buildkernel and was able to successfully install t= he new > > > system. > > >=20 > > > As I stated before: I already had a complete compiled world and kerne= l existing > > > in their proper, intact folders (usr/src and usr/obj). There was no n= eed to > > > compile a whole world. > > > Intending to "make installworld" failed, this is the real problem, be= cause the > > > ISO/memstick images provided lack obviously in the required infrastru= cture and > > > so these images are worthless for sophisticated rescue operations - o= r even > > > such a simple ask as described initially in my posting. > > >=20 > > > I created images on CURRENT of my own - they all lack in the ability = of having > > > the necessary tools aboard. So I consider every image useless for res= cue > > > operations except, maybe, the DVD image - but this one is not provide= d anymore. > > > For what reason? Time? Accepted. Space/disk usage? Well, welcome back= in the > > > stoneage of computer technology ...=20 > > >=20 > > > I remember faintly that there was a small discussion on the @CURRENT = list, but > > > I didn't realize that the result would be the extraction of the compi= ler. > > >=20 > > > Just for the record: most servers delivered to us do not have CD/DVD = drives > > > anymore - they are outdated and considered an extra these days. Purch= asing 1 GB > > > USB thumbdrives is getting even harder, smallest size my employer pro= vides now > > > is 2 GB. And most optical drives are DVD. From my point of view - and= this is a > > > personal view - the "standard" is > 1GB so there is no need to break = down by > > > force the FreeBSD image (if size is the reason) down to < 800 MB or <= 1 GB. I'd > > > consider having < 2GB the line of standards (2 GB USB mem drive). > > > And for those, with need of very small images, smaller images could b= e provided > > > as the extra. > > > =20 > >=20 > > I do want to weigh in here and inform I am actively watching this > > thread. clang(1) is not in disc1.iso or bootonly.iso because the > > MK_TOOLCHAIN knob is disabled in the targets that generate them. This > > has actually been the case for quite some time for these images. > >=20 > > dvd1.iso does contain clang, but very rarely (if ever, actually) are > > there dvd1.iso images produced for development snapshots. This is, in > > part, solely because of the additional space/bandwidth required on the > > mirrors (not just mirrors controlled by the Project, but third-party > > mirrors as well). > >=20 > > I am working on splitting out how the memstick.img and disc1.iso images > > are produced, but ran into a problem which I'm looking into a workaround > > that is backwards-compatible. Since for USB images, a 700MB limit does > > not make sense, and right now it just so happens that the memstick.img > > is created from the same contents of disc1.iso. > >=20 > > I know this does not help with the immediate issue, but wanted to chime > > in with I do see and understand the larger issue, and am working on > > a more long-term resolution instead of a one-line workaround. > > =20 >=20 > Random thought: >=20 > Brought up out-of-band, can you try this from a memstick.img and your > already-built userland/kernel to do what you had originally tried to > install the system? >=20 > # make -C /usr/src WITHOUT_SYSTEM_COMPILER=3D1 DESTDIR=3D/wherever insta= llworld >=20 > I think this is why cc(1)/clang(1) is not being used from /usr/obj, and > you don't have a compiler to compile the compiler. >=20 > Glen >=20 I ran on a different(!!!!) machine in the very same situation while install= ing kernel and world in SINGLE USER mode! Different machine, also SSD (different model): t= he symptomes are the very same. Close to the end of installations of lib32, the box goes= down, crashes. After reboot, it can not find any kernel because /boot/kernel as well as ev= ery "per default" installed file/directory is not existent anymore - except thiose f= iles I touched/copied. Files in /rescue do have all NULL size! That was the same on the other box = on which crash I initiated this thread. The same in /sbin, /bin, /usr/bin, /usr/sbin and /= lib. Some libs/files are NULL in size. So, apart from the fact that CURRENT disrupts obviously filesystems on inst= allations, I had the doubtful chance to take a test on your suggestion above: It doesn't= work! I booted this time again from the USB thumdrive with the recent FreeBSD 12-= CURRENT image without the compiler and mount the still intact usr/obj and usr/src from th= e corrupted SSD onto the USB thumdrive and tried to do as requested. make -C /usr/src WITHOUT_SYSTEM_COMPILER=3D1 DESTDIR=3D/wherever installwor= ld The script bugs out at "bsd.compiler.mk line 145: Unable to determine compi= ler type for CC=3Dcc. Consider setting COMPILER_TYPE" Setting COMPILE_TYPE=3Dcc results in "sh: cc not found", setting to "clang"= doesn't work either. Apart from the fact of CURRENT to be incapable of rescuing, there seems to = be a very serious issue with CURRENT regarding its filesystem stability and I do not = know how to address this in the correct way :-( I use NanoBSD for about a year for several projects and I already have a us= eful USB thumdrive with a full grown system (~ 836 MB if I'm not confused including = the compiler). I tried to makeinstallworld, but this time, it seems that also the usr/obj = has been corrupted, so I had to perform a buildworld, which is still running. =46rom my little experiences with building NanoBSD and the use of etc/src.con= f as the source for delegating what is used in the target image and not, I was reall= y wondering that the "RELEASE" build infrastructure is not using a predefined src.conf = to reduce the size and content of the resulting image. Instead, some "WITHOUT_TOOLCHAIN"= hidden and hard coded knobs are used :-( Somehow the whole thing got more confusing. I can understand that some people want some small images for their installa= tion processes, but I think they can perform the task of creating their own imag= es via make relaese very easily. In cases were someone crashed, like me, it would a great benefit having som= e real rescue stuff around instead of crippled images. But this might be a different view. regards, oh=20 --=20 O. Hartmann Ich widerspreche der Nutzung oder =DCbermittlung meiner Daten f=FCr Werbezwecke oder f=FCr die Markt- oder Meinungsforschung (=A7 28 Abs. 4 BDS= G). --Sig_/c4eNjqeh+9ZISaXiY2GJr1K Content-Type: application/pgp-signature Content-Description: OpenPGP digital signature -----BEGIN PGP SIGNATURE----- iLUEARMKAB0WIQQZVZMzAtwC2T/86TrS528fyFhYlAUCWIPQgQAKCRDS528fyFhY lHOdAgCCWqmO/mSE5j7rS05Rg/A2mDvPzPiiBtkmvTUNUNQiauKXlq8OZxe6kY5R Kc4+VgWdS1Y5GM2P3/3hs5iASKqQAfsGW16TFRX46JKXPkznsDH0htQopxXpMd0h 9MWmv7pLo2+YEsAkGHXy0qZNW4QZDV99mMrC79sMK3AYLcORH3s8 =543d -----END PGP SIGNATURE----- --Sig_/c4eNjqeh+9ZISaXiY2GJr1K--