From owner-freebsd-stable@FreeBSD.ORG Sun Apr 21 08:51:21 2013 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 2EF69506 for ; Sun, 21 Apr 2013 08:51:21 +0000 (UTC) (envelope-from paulz@vanderzwan.org) Received: from cpsmtpb-ews09.kpnxchange.com (cpsmtpb-ews09.kpnxchange.com [213.75.39.14]) by mx1.freebsd.org (Postfix) with ESMTP id 7829DBE7 for ; Sun, 21 Apr 2013 08:51:20 +0000 (UTC) Received: from cpsps-ews07.kpnxchange.com ([10.94.84.174]) by cpsmtpb-ews09.kpnxchange.com with Microsoft SMTPSVC(7.5.7601.17514); Sun, 21 Apr 2013 10:50:09 +0200 Received: from CPSMTPM-TLF102.kpnxchange.com ([195.121.3.5]) by cpsps-ews07.kpnxchange.com with Microsoft SMTPSVC(7.5.7601.17514); Sun, 21 Apr 2013 10:50:09 +0200 Received: from mailvm.vanderzwan.org ([77.172.189.82]) by CPSMTPM-TLF102.kpnxchange.com with Microsoft SMTPSVC(7.5.7601.17514); Sun, 21 Apr 2013 10:50:09 +0200 Received: from gaspode.vanderzwan.org (gaspode.vanderzwan.org [192.168.178.22]) (authenticated bits=0) by mailvm.vanderzwan.org (8.14.6/8.14.6) with ESMTP id r3L8o8Al032133 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NO); Sun, 21 Apr 2013 10:50:09 +0200 (CEST) (envelope-from paulz@vanderzwan.org) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 6.3 \(1503\)) Subject: Re: Make buildworld broken on RELENG_9? From: Paul van der Zwan In-Reply-To: <20130419202140.GA93675@icarus.home.lan> Date: Sun, 21 Apr 2013 10:50:07 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: <5327C831-C7FB-4F28-92E8-665700741636@vanderzwan.org> References: <20130418211628.GA37504@icarus.home.lan> <20130418233626.GA39582@icarus.home.lan> <20130419202140.GA93675@icarus.home.lan> To: Jeremy Chadwick X-Mailer: Apple Mail (2.1503) X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.3.9 (mailvm.vanderzwan.org [192.168.178.25]); Sun, 21 Apr 2013 10:50:09 +0200 (CEST) X-OriginalArrivalTime: 21 Apr 2013 08:50:09.0720 (UTC) FILETIME=[3AAE9380:01CE3E6D] X-RcptDomain: freebsd.org Cc: freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 21 Apr 2013 08:51:21 -0000 On 19 Apr 2013, at 22:21 , Jeremy Chadwick wrote: > On Fri, Apr 19, 2013 at 09:57:46PM +0200, Paul van der Zwan wrote: >>=20 >> On 19 Apr 2013, at 1:36 , Jeremy Chadwick wrote: >>=20 >>> On Thu, Apr 18, 2013 at 02:16:28PM -0700, Jeremy Chadwick wrote: >>>> On Thu, Apr 18, 2013 at 10:59:29PM +0200, Paul van der Zwan wrote: >>>>> Since last weekend or so my make buildworld terminate at the = following error: >>>>> =3D=3D=3D> share/tabset (all) >>>>> uudecode < /usr/src/share/tabset/3101.uu >>>>> uudecode < /usr/src/share/tabset/9837.uu >>>>> uudecode < /usr/src/share/tabset/aa.uu >>>>> uudecode < /usr/src/share/tabset/aed512.uu >>>>> uudecode < /usr/src/share/tabset/beehive.uu >>>>> uudecode < /usr/src/share/tabset/diablo.uu >>>>> uudecode < /usr/src/share/tabset/dtc382.uu >>>>> uudecode < /usr/src/share/tabset/hp700-wy.uu >>>>> uudecode < /usr/src/share/tabset/ibm3101.uu >>>>> uudecode < /usr/src/share/tabset/std.uu >>>>> uudecode < /usr/src/share/tabset/stdcrt.uu >>>>> uudecode < /usr/src/share/tabset/tandem653.uu >>>>> uudecode < /usr/src/share/tabset/teleray.uu >>>>> uudecode < /usr/src/share/tabset/vt100.uu >>>>> uudecode < /usr/src/share/tabset/vt100-w.uu >>>>> uudecode < /usr/src/share/tabset/wyse-adds.uu >>>>> uudecode < /usr/src/share/tabset/xerox1720.uu >>>>> uudecode < /usr/src/share/tabset/xerox1730.uu >>>>> uudecode < /usr/src/share/tabset/xerox1730-lm.uu >>>>> uudecode < /usr/src/share/tabset/zenith29.uu >>>>> =3D=3D=3D> share/termcap (all) >>>>> gzip -cn /usr/src/share/termcap/termcap.5 > termcap.5.gz >>>>> TERM=3Ddumb TERMCAP=3Ddumb: ex - = /usr/src/share/termcap/termcap.src < /usr/src/share/termcap/reorder >>>>> script, 2: Pattern not found >>>>> *** [termcap] Error code 1 >>>>>=20 >>>>> Stop in /usr/src/share/termcap. >>>>> *** [all] Error code 1 >>>>>=20 >>>>> Stop in /usr/src/share. >>>>> *** [share.all__D] Error code 1 >>>>>=20 >>>>> Stop in /usr/src. >>>>> *** [everything] Error code 1 >>>>>=20 >>>>> Stop in /usr/src. >>>>> *** [buildworld] Error code 1 >>>>>=20 >>>>> Stop in /usr/src. >>>>>=20 >>>>> Even after updateing /usr/src using svn I keep this. >>>>> Before this build I updated it: >>>>> $ cd /data/src ; svn up ;=20 >>>>> U sys/sys/vnode.h >>>>> U sys/sys >>>>> U sys/geom/geom_disk.c >>>>> U sys/geom/geom_int.h >>>>> U sys/geom/geom_subr.c >>>>> U sys/geom/geom_dev.c >>>>> U sys/geom/geom_event.c >>>>> U sys/ufs/ufs/ufs_lookup.c >>>>> U sys/ufs/ffs/ffs_softdep.c >>>>> U sys/cam/cam_xpt.c >>>>> U sys/cam/cam_periph.c >>>>> U sys/cam/cam_sim.c >>>>> U sys/cam/cam_periph.h >>>>> U sys/cam/cam_sim.h >>>>> U sys/cam/scsi/scsi_xpt.c >>>>> U sys/cam/scsi/scsi_da.c >>>>> U sys/cam/scsi/scsi_pass.c >>>>> U sys/cam/scsi/scsi_cd.c >>>>> U sys/cam/ata/ata_da.c >>>>> U sys/cam/ata/ata_all.c >>>>> U sys/cam/ata/ata_xpt.c >>>>> U sys/dev/usb/controller/xhci_pci.c >>>>> U sys/dev >>>>> U sys/kern/vfs_cache.c >>>>> U sys >>>>> Updated to revision 249624. >>>>>=20 >>>>> /etc/make.conf is almost empty : >>>>> $ cat /etc/make.conf >>>>> KERNCONF=3Dvbox >>>>> CFLAGS=3D -O2 -fno-strict-aliasing -pipe >>>>> COPTFLAGS=3D -O -pipe >>>>>=20 >>>>> # added by use.perl 2013-03-12 18:50:12 >>>>> PERL_VERSION=3D5.14.2 >>>>>=20 >>>>> Any ideas ? >>>>=20 >>>> I've been able to build stable/9 world without issue even as recent = as >>>> last night. I'll rm -fr /usr/obj/* and rebuild world under = "script" >>>> then go look at the output to see if I see anything anomalous = around >>>> the area you've shown. I'll reply when that's done. >>>>=20 >>>> {snip} >>>=20 >>> Can't reproduce the issue. >>>=20 >>> root@testbox:/usr/src # svn info >>> Path: . >>> Working Copy Root Path: /usr/src >>> URL: svn://svn.freebsd.org/base/stable/9 >>> Repository Root: svn://svn.freebsd.org/base >>> Repository UUID: ccf9f872-aa2e-dd11-9fc8-001c23d0bc1f >>> Revision: 249628 >>> Node Kind: directory >>> Schedule: normal >>> Last Changed Author: mav >>> Last Changed Rev: 249624 >>> Last Changed Date: 2013-04-18 06:19:41 -0700 (Thu, 18 Apr 2013) >>>=20 >>> Here's what I get, around where yours fails: >>>=20 >>> =3D=3D=3D> share/termcap (all) >>> gzip -cn /usr/src/share/termcap/termcap.5 > termcap.5.gz >>> TERM=3Ddumb TERMCAP=3Ddumb: ex - /usr/src/share/termcap/termcap.src = < /usr/src/share/termcap/reorder >>> cap_mkdb -l termcap >>> =3D=3D=3D> share/timedef (all) >>> grep -v '^#' < /usr/src/share/timedef/am_ET.UTF-8.src > = am_ET.UTF-8.out >>>=20 >>> Note that yours says "script, 2: Pattern not found" with no mention = of >>> cap_mkdb. >>>=20 >>> My guess is that you have one of the following: >>>=20 >>> a) A corrupted src/share/termcap/Makefile, >>> b) A corrupted SVN repo, >>=20 >> Deleted the content of src/share/termcap and reran svn. >> Now the build succeeds. >=20 > Not surprised. :-) >=20 >>> c) Silent filesystem corruption, >>> d) Physical disk issues (e.g. bit rot). >>>=20 >> /usr/src is NFS mounted from an OpenIndiana server so the underlying = FS is ZFS, so no bitrot or silent corruption >> should be possible. >=20 > As long as the pool configuration is using something that ZFS can = induce > recovery from (specifically: mirrors, raidzX, or a combination of = vdevs > that make such possible), then that's true. If a stripe of disks, or = a > single disk, then only detection of such problems is possible. >=20 > zpool status will shed light on the situation. >=20 Pool is made up of two drives in a mirror and scrubbed regularly so I = can almost certainly rule that out. >> I made a snapshot before I deleted the files and ran svn: >> $ ls -l /data//src/.zfs/snapshot/20130419/share/termcap/ >> total 669 >> -rw-r--r-- 1 paulz home 731 Nov 18 22:26 Makefile >> -rw-r--r-- 1 paulz home 2501 Nov 18 22:26 README >> -rw-r--r-- 1 paulz home 1467 Nov 18 22:26 reorder >> -rw-r--r-- 1 paulz home 3531 Nov 18 22:26 tck >> -rw-r--r-- 1 paulz home 66181 Nov 18 22:26 termcap.5 >> -rw-r--r-- 1 paulz home 214309 Apr 16 18:55 termcap.src >> $ ls -l >> total 669 >> -rw-r--r-- 1 paulz home 731 Apr 19 17:01 Makefile >> -rw-r--r-- 1 paulz home 2501 Apr 19 17:01 README >> -rw-r--r-- 1 paulz home 1467 Apr 19 17:01 reorder >> -rw-r--r-- 1 paulz home 3531 Apr 19 17:01 tck >> -rw-r--r-- 1 paulz home 66181 Apr 19 17:01 termcap.5 >> -rw-r--r-- 1 paulz home 208289 Apr 19 17:01 termcap.src >>=20 >> So it looks like termcap.src was very different but somehow svn never = updated that file. >> I have only used svn to pull in the FreeBSD source so at the moment = no idea if that is normal, >> but it surprised my that this happened.. >=20 > I also find this interesting -- note that multiple files I have are > different sizes than yours (the only ones which are the same size are > README and tck). >=20 > root@icarus:/usr/src # ls -l /usr/src/share/termcap/ > total 288 > -rw-r--r-- 1 root wheel 797 Jan 24 16:58 Makefile > -rw-r--r-- 1 root wheel 2501 Jan 24 16:58 README > -rw-r--r-- 1 root wheel 1533 Jan 24 16:58 reorder > -rw-r--r-- 1 root wheel 3531 Jan 24 16:58 tck > -rw-r--r-- 1 root wheel 66248 Jan 24 16:58 termcap.5 > -rw-r--r-- 1 root wheel 208361 Jan 24 16:58 termcap.src > root@icarus:/usr/src # svn info > Path: . > Working Copy Root Path: /usr/src > URL: svn://svn.freebsd.org/base/stable/9 > Repository Root: svn://svn.freebsd.org/base > Repository UUID: ccf9f872-aa2e-dd11-9fc8-001c23d0bc1f > Revision: 249650 > Node Kind: directory > Schedule: normal > Last Changed Author: mm > Last Changed Rev: 249643 > Last Changed Date: 2013-04-19 02:19:10 -0700 (Fri, 19 Apr 2013) >=20 In the share/termcap directory of snapshot svn info showed: $ svn info termcap.src=20 Path: termcap.src Name: termcap.src URL: svn://svn.freebsd.org/base/stable/9/share/termcap/termcap.src Repository Root: svn://svn.freebsd.org/base Repository UUID: ccf9f872-aa2e-dd11-9fc8-001c23d0bc1f Revision: 249624 Node Kind: file Schedule: normal Last Changed Author: eadler Last Changed Rev: 243259 Last Changed Date: 2012-11-19 05:10:23 +0100 (Mon, 19 Nov 2012) Text Last Updated: 2012-11-19 20:55:35 +0100 (Mon, 19 Nov 2012) Checksum: 5e795d6e162acc92997796f13228ffe9 But if I run svn diff I get quite a lot of output. > And now to try something: >=20 > root@icarus:/usr/src # cp -pR share/termcap /tmp > root@icarus:/usr/src # rm -fr share/termcap > root@icarus:/usr/src # svn update > Updating '.': > Restored 'share/termcap' > Restored 'share/termcap/Makefile' > Restored 'share/termcap/README' > Restored 'share/termcap/termcap.5' > Restored 'share/termcap/tck' > Restored 'share/termcap/termcap.src' > Restored 'share/termcap/reorder' > A lib/libpmc/pmc.haswelluc.3 > A lib/libpmc/pmc.haswell.3 > U lib/libpmc/Makefile > U lib/libpmc/libpmc.c > U lib/libpmc > U sys/dev/hwpmc/pmc_events.h > U sys/dev/hwpmc/hwpmc_intel.c > U sys/dev/hwpmc/hwpmc_core.c > U sys/dev/hwpmc/hwpmc_uncore.c > U sys/dev > U sys/sys/pmc.h > U sys/sys > U sys > Updated to revision 249658. > root@icarus:/usr/src # ls -l /usr/src/share/termcap/ > total 288 > -rw-r--r-- 1 root wheel 797 Apr 19 13:14 Makefile > -rw-r--r-- 1 root wheel 2501 Apr 19 13:14 README > -rw-r--r-- 1 root wheel 1533 Apr 19 13:14 reorder > -rw-r--r-- 1 root wheel 3531 Apr 19 13:14 tck > -rw-r--r-- 1 root wheel 66248 Apr 19 13:14 termcap.5 > -rw-r--r-- 1 root wheel 208361 Apr 19 13:14 termcap.src > root@icarus:/usr/src # diff -ruN share/termcap /tmp/termcap > root@icarus:/usr/src # >=20 > Are you following a different branch than I am? I'm using stable/9, > as shown. The SVN mirror I use is also shown. >=20 > If you're following stable/9, then something is very much out of whack > on your system, or the SVN repo you're using is giving you very = strange > results. >=20 As far as I can tell from the repo uuid we are using the same repo. > My recommendations: >=20 > 1. Try a different SVN repo mirror, >=20 > 2. Remove NFS from the picture entirely; use a local disk instead, > at least for testing/figuring this out, >=20 svn is running locally on the OpenIndiana so only the FreeBSD VMs use NFS. > 3. Start over fresh. DO NOT just delete individual files or dirs -- > there is a "database" SVN uses (just like csup/cvsup!) to try and keep > track of what's what. To start over fresh: >=20 > rm -fr /usr/src /usr/src/.svn > svn checkout svn://wherever/base/stable/9 /usr/src >=20 > Good luck, and I look forward to the results of your investigation. >=20 Done that and that seems to give a buildable source. Not sure if it's worth it or possible to find out what happened. Thanks for your help, Paul > --=20 > | Jeremy Chadwick jdc@koitsu.org | > | UNIX Systems Administrator http://jdc.koitsu.org/ | > | Mountain View, CA, US | > | Making life hard for others since 1977. PGP 4BD6C0CB | > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to = "freebsd-stable-unsubscribe@freebsd.org" >=20