From owner-freebsd-testing@freebsd.org Tue Mar 29 09:41:50 2016 Return-Path: Delivered-To: freebsd-testing@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 15710AE0DD0 for ; Tue, 29 Mar 2016 09:41:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 05AA41714 for ; Tue, 29 Mar 2016 09:41:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u2T9fmeV097853 for ; Tue, 29 Mar 2016 09:41:49 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-testing@freebsd.org Subject: [Bug 203094] Unable to make installworld without disabling tests and setting COMPILER_TYPE=clang Date: Tue, 29 Mar 2016 09:41:49 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: tests X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: p.kraschinski@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-testing@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Mar 2016 09:41:50 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D203094 Pierre Kraschinski changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |p.kraschinski@gmail.com --- Comment #13 from Pierre Kraschinski --- I'm able to confirm and reproduce (a similar/this) problem during the build-/installworld process in combination with ccache.=20 1. TEST-ENV - ThinkPad X220 (4290-DD1) - Fresh installed FreeBSD 11.0-CURRENT amd64 r296485 2. WORKING REFERENCE - check out freebsd-current (r297375) # svnlite co -r 297375 https://svn.freebsd.org/base/head/ /usr/src - modify /etc/make.conf # vi /etc/make.conf <-- MALLOC_PRODUCTION=3DYES --> - start build and install process # make -j16 buildworld # make -j16 buildkernel KERNCONF=3DGENERIC-NODEBUG =20 # mergemaster -Fp # make installworld # mergemaster -Fi # make delete-old - Everything works as usual 2. NON-WORKING EXAMPLE - install ccache version 3.2.4 # pkg install ccache - modify /etc/make.conf # vi /etc/make.conf <-- MALLOC_PRODUCTION=3DYES WITH_CCACHE_BUILD=3DYES .if (!empty(.CURDIR:M/usr/src*) || !empty(.CURDIR:M/usr/obj*)) .if !defined(NOCCACHE) && exists(/usr/local/libexec/ccache/world/cc) CC:=3D${CC:C,^cc,/usr/local/libexec/ccache/world/cc,1} CXX:=3D${CXX:C,^c\+\+,/usr/local/libexec/ccache/world/c++,1} .endif .endif --> - modify /etc/csh.cshrc # vi /etc/csh.cshrc <-- setenv PATH /usr/local/libexec/ccache:$PATH setenv CCACHE_PATH /usr/bin:/usr/local/bin --> - check out freebsd-current (r297375) # svnlite co -r 297375 https://svn.freebsd.org/base/head/ /usr/src - start build and install process # make -j16 buildworld # make -j16 buildkernel KERNCONF=3DGENERIC-NODEBUG =20 # mergemaster -Fp # make installworld - the problem occurs <-- mkdir -p /tmp/install.KI6wjBV6 progs=3D$(for prog in [ awk cap_mkdb cat chflags chmod chown cmp cp date e= cho egrep find grep id install ln make mkdir mtree mv pwd_mkdb rm sed services_mkdb sh strip sysctl test true uname wc zic tzsetup makewhatis; = do=20 if progpath=3D`which $prog`; then echo $progpath; else echo "Required to= ol $prog not found in PATH." >&2; exit 1; fi; done); libs=3D$(ldd -f "%o %= p\n" -f "%o %p\n" $progs 2>/dev/null | sort -u | while read line; do set -- $l= ine; if [ "$2 $3" !=3D "not found" ]; then echo $2; else echo "Required libr= ary $1 not found." >&2; exit 1; fi; done); cp $libs $progs /tmp/install.KI6wjB= V6 cp -R ${PATH_LOCALE:-"/usr/share/locale"} /tmp/install.KI6wjBV6/locale cd /usr/src; MAKEOBJDIRPREFIX=3D/usr/obj MACHINE_ARCH=3Damd64 MACHINE=3Damd= 64 CPUTYPE=3D GROFF_BIN_PATH=3D/usr/obj/usr/src/tmp/legacy/usr/bin GROFF_FONT_PATH=3D/usr/obj/usr/src/tmp/legacy/usr/share/groff_font GROFF_TMAC_PATH=3D/usr/obj/usr/src/tmp/legacy/usr/share/tmac CC=3D"/usr/local/libexec/ccache/world/cc -target x86_64-unknown-freebsd11.0 --sysroot=3D/usr/obj/usr/src/tmp -B/usr/obj/usr/src/tmp/usr/bin" CXX=3D"/usr/local/libexec/ccache/world/c++ -target x86_64-unknown-freebsd11= .0 --sysroot=3D/usr/obj/usr/src/tmp -B/usr/obj/usr/src/tmp/usr/bin " DEPFLAGS= =3D"" CPP=3D"cpp -target x86_64-unknown-freebsd11.0 --sysroot=3D/usr/obj/usr/src/= tmp -B/usr/obj/usr/src/tmp/usr/bin" AS=3D"as" AR=3D"ar" LD=3D"ld" NM=3Dnm OBJDU= MP=3Dobjdump OBJCOPY=3D"objcopy" RANLIB=3Dranlib STRINGS=3D SIZE=3D"size" PATH=3D/usr/obj/usr/src/tmp/legacy/usr/sbin:/usr/obj/usr/src/tmp/legacy/usr= /bin:/usr/obj/usr/src/tmp/legacy/bin:/usr/obj/usr/src/tmp/usr/sbin:/usr/obj= /usr/src/tmp/usr/bin:/tmp/install.KI6wjBV6 LD_LIBRARY_PATH=3D/tmp/install.KI6wjBV6=20 PATH_LOCALE=3D/tmp/install.KI6wjBV6/locale /usr/obj/usr/src/make.amd64/bmak= e -f Makefile.inc1 __MAKE_SHELL=3D/tmp/install.KI6wjBV6/sh reinstall;=20 MAKEOBJDIRPREFIX=3D/usr/obj MACHINE_ARCH=3Damd64 MACHINE=3Damd64 CPUTYPE=3D GROFF_BIN_PATH=3D/usr/obj/usr/src/tmp/legacy/usr/bin GROFF_FONT_PATH=3D/usr/obj/usr/src/tmp/legacy/usr/share/groff_font GROFF_TMAC_PATH=3D/usr/obj/usr/src/tmp/legacy/usr/share/tmac CC=3D"/usr/local/libexec/ccache/world/cc -target x86_64-unknown-freebsd11.0 --sysroot=3D/usr/obj/usr/src/tmp -B/usr/obj/usr/src/tmp/usr/bin" CXX=3D"/usr/local/libexec/ccache/world/c++ -target x86_64-unknown-freebsd11= .0 --sysroot=3D/usr/obj/usr/src/tmp -B/usr/obj/usr/src/tmp/usr/bin " DEPFLAGS= =3D"" CPP=3D"cpp -target x86_64-unknown-freebsd11.0 --sysroot=3D/usr/obj/usr/src/= tmp -B/usr/obj/usr/src/tmp/usr/bin" AS=3D"as" AR=3D"ar" LD=3D"ld" NM=3Dnm OBJDU= MP=3Dobjdump OBJCOPY=3D"objcopy" RANLIB=3Dranlib STRINGS=3D SIZE=3D"size" PATH=3D/usr/obj/usr/src/tmp/legacy/usr/sbin:/usr/obj/usr/src/tmp/legacy/usr= /bin:/usr/obj/usr/src/tmp/legacy/bin:/usr/obj/usr/src/tmp/usr/sbin:/usr/obj= /usr/src/tmp/usr/bin:/tmp/install.KI6wjBV6 LD_LIBRARY_PATH=3D/tmp/install.KI6wjBV6=20 PATH_LOCALE=3D/tmp/install.KI6wjBV6/locale rm -rf /tmp/install.KI6wjBV6 ccache: error: Could not find compiler "cc" in PATH bmake[2]: "/usr/src/share/mk/bsd.compiler.mk" line 141: Unable to determine compiler type for /usr/local/libexec/ccache/world/cc -target x86_64-unknown-freebsd11.0 --sysroot=3D/usr/obj/usr/src/tmp -B/usr/obj/usr/src/tmp/usr/bin. Consider setting COMPILER_TYPE. *** Error code 1 Stop. bmake[1]: stopped in /usr/src *** Error code 1 Stop. make: stopped in /usr/src --> - NOTE: to proceed at this step it is necessary to set "COMPILER_TYPE=3Dcla= ng -DWITHOUT_TESTS" as Juan wrote before. # make COMPILER_TYPE=3Dclang -DWITHOUT_TESTS installworld ... --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-testing@freebsd.org Tue Mar 29 17:03:12 2016 Return-Path: Delivered-To: freebsd-testing@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B3FA9AE2A02 for ; Tue, 29 Mar 2016 17:03:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A456E1FAE for ; Tue, 29 Mar 2016 17:03:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u2TH3CvQ059824 for ; Tue, 29 Mar 2016 17:03:12 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-testing@freebsd.org Subject: [Bug 203094] Unable to make installworld without disabling tests and setting COMPILER_TYPE=clang Date: Tue, 29 Mar 2016 17:03:12 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: tests X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: p.kraschinski@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-testing@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Mar 2016 17:03:12 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D203094 --- Comment #14 from Pierre Kraschinski --- During my research I've found SVN:290526 (https://svnweb.freebsd.org/base?view=3Drevision&revision=3D290526). Bryan = added ccache build support via WITH_CCACHE_BUILD option to "base". This removes t= he need to add the following lines (as suggested in /usr/local/share/doc/ccache/ccache-howto-freebsd.txt) to /etc/make.conf: <-- .if (!empty(.CURDIR:M/usr/src*) || !empty(.CURDIR:M/usr/obj*)) .if !defined(NOCCACHE) && exists(/usr/local/libexec/ccache/world/cc) CC:=3D${CC:C,^cc,/usr/local/libexec/ccache/world/cc,1} CXX:=3D${CXX:C,^c\+\+,/usr/local/libexec/ccache/world/c++,1} .endif .endif --> Remove them and just add WITH_CCACHE_BUILD to /etc/make.conf: <-- WITH_CCACHE_BUILD=3DYES --> Regarding to SVN:290526 Bryans work should have been fixed all known issues with buildworld and ccache.=20 After modifying my /etc/make.conf I was able to rebuild world and install i= t as usual. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-testing@freebsd.org Fri Apr 1 10:21:02 2016 Return-Path: Delivered-To: freebsd-testing@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 37E88AEB9CB for ; Fri, 1 Apr 2016 10:21:02 +0000 (UTC) (envelope-from freebsd-listen@fabiankeil.de) Received: from smtprelay03.ispgateway.de (smtprelay03.ispgateway.de [80.67.31.37]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 0038F1DA1 for ; Fri, 1 Apr 2016 10:21:01 +0000 (UTC) (envelope-from freebsd-listen@fabiankeil.de) Received: from [78.35.178.145] (helo=fabiankeil.de) by smtprelay03.ispgateway.de with esmtpsa (TLSv1.2:AES128-GCM-SHA256:128) (Exim 4.84) (envelope-from ) id 1alvwi-00057i-Fu; Fri, 01 Apr 2016 12:04:52 +0200 Date: Fri, 1 Apr 2016 12:03:10 +0200 From: Fabian Keil To: Alex Denisov <1101.debian@gmail.com> Cc: freebsd-testing@freebsd.org Subject: Re: Available Tests Message-ID: <20160401120310.3be9446a@fabiankeil.de> In-Reply-To: References: MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; boundary="Sig_/cEFAIs2MDhGqM+6AZ.X4SJ_"; protocol="application/pgp-signature" X-Df-Sender: Nzc1MDY3 X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 01 Apr 2016 10:21:02 -0000 --Sig_/cEFAIs2MDhGqM+6AZ.X4SJ_ Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Alex Denisov <1101.debian@gmail.com> wrote: > I just built FreeBSD 10 using =E2=80=9CWITH_TESTS=3D1=E2=80=9D, and run t= ests from =E2=80=98/usr/tests=E2=80=99 using =E2=80=98root' user. >=20 > I have found that there are ~3,5k test results, which makes me curious: a= re there other tests? Yes. If you take a closer look at /usr/src you'll find various other tests that aren't integrated into the kyua/atf tool chain (yet). I also believe that your ~3,5k test results represent more that ~3,5k individual tests due to suboptimal integration of other test suites. Various external test frameworks are also potentially relevant for FreeBSD, but have too much dependencies to integrate. As an example, a TCP/IP regression was found through Privoxy-Regression-Tes= t: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D173309 Obviously the regression could have been found with a FreeBSD-specific test as well, but somebody would have to spent the time to write such a test first. > I=E2=80=99m asking because, for instance, LLVM test suite has ~17k tests > (unit, regression, and performance tests). Some of these tests are probably also run on FreeBSD systems to test the clang integration ... > FreeBSD seems to be bigger, but has less tests. Unlike LLVM, FreeBSD contains a lot of old code from a time where automated testing was less common. Comparing it with other operating systems might make more sense. Fabian --Sig_/cEFAIs2MDhGqM+6AZ.X4SJ_ Content-Type: application/pgp-signature Content-Description: OpenPGP digital signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iEYEARECAAYFAlb+R18ACgkQBYqIVf93VJ1b+QCfekCLHuzlGVJvcZqYCWIBQczI MgoAoKmbdX59jTqZFJNngl0HxrECGWEN =eFle -----END PGP SIGNATURE----- --Sig_/cEFAIs2MDhGqM+6AZ.X4SJ_--