Date: Fri, 19 Apr 2013 13:21:40 -0700 From: Jeremy Chadwick <jdc@koitsu.org> To: Paul van der Zwan <paulz@vanderzwan.org> Cc: freebsd-stable@freebsd.org Subject: Re: Make buildworld broken on RELENG_9? Message-ID: <20130419202140.GA93675@icarus.home.lan> In-Reply-To: <EF83582E-A45F-4EE0-AC02-9E248F652E59@vanderzwan.org> References: <A2839C0B-667A-4614-9118-D14D3C70BF12@vanderzwan.org> <20130418211628.GA37504@icarus.home.lan> <20130418233626.GA39582@icarus.home.lan> <EF83582E-A45F-4EE0-AC02-9E248F652E59@vanderzwan.org>
next in thread | previous in thread | raw e-mail | index | archive | help
On Fri, Apr 19, 2013 at 09:57:46PM +0200, Paul van der Zwan wrote:
>
> On 19 Apr 2013, at 1:36 , Jeremy Chadwick <jdc@koitsu.org> wrote:
>
> > On Thu, Apr 18, 2013 at 02:16:28PM -0700, Jeremy Chadwick wrote:
> >> On Thu, Apr 18, 2013 at 10:59:29PM +0200, Paul van der Zwan wrote:
> >>> Since last weekend or so my make buildworld terminate at the following error:
> >>> ===> share/tabset (all)
> >>> uudecode < /usr/src/share/tabset/3101.uu
> >>> uudecode < /usr/src/share/tabset/9837.uu
> >>> uudecode < /usr/src/share/tabset/aa.uu
> >>> uudecode < /usr/src/share/tabset/aed512.uu
> >>> uudecode < /usr/src/share/tabset/beehive.uu
> >>> uudecode < /usr/src/share/tabset/diablo.uu
> >>> uudecode < /usr/src/share/tabset/dtc382.uu
> >>> uudecode < /usr/src/share/tabset/hp700-wy.uu
> >>> uudecode < /usr/src/share/tabset/ibm3101.uu
> >>> uudecode < /usr/src/share/tabset/std.uu
> >>> uudecode < /usr/src/share/tabset/stdcrt.uu
> >>> uudecode < /usr/src/share/tabset/tandem653.uu
> >>> uudecode < /usr/src/share/tabset/teleray.uu
> >>> uudecode < /usr/src/share/tabset/vt100.uu
> >>> uudecode < /usr/src/share/tabset/vt100-w.uu
> >>> uudecode < /usr/src/share/tabset/wyse-adds.uu
> >>> uudecode < /usr/src/share/tabset/xerox1720.uu
> >>> uudecode < /usr/src/share/tabset/xerox1730.uu
> >>> uudecode < /usr/src/share/tabset/xerox1730-lm.uu
> >>> uudecode < /usr/src/share/tabset/zenith29.uu
> >>> ===> share/termcap (all)
> >>> gzip -cn /usr/src/share/termcap/termcap.5 > termcap.5.gz
> >>> TERM=dumb TERMCAP=dumb: ex - /usr/src/share/termcap/termcap.src < /usr/src/share/termcap/reorder
> >>> script, 2: Pattern not found
> >>> *** [termcap] Error code 1
> >>>
> >>> Stop in /usr/src/share/termcap.
> >>> *** [all] Error code 1
> >>>
> >>> Stop in /usr/src/share.
> >>> *** [share.all__D] Error code 1
> >>>
> >>> Stop in /usr/src.
> >>> *** [everything] Error code 1
> >>>
> >>> Stop in /usr/src.
> >>> *** [buildworld] Error code 1
> >>>
> >>> Stop in /usr/src.
> >>>
> >>> Even after updateing /usr/src using svn I keep this.
> >>> Before this build I updated it:
> >>> $ cd /data/src ; svn up ;
> >>> U sys/sys/vnode.h
> >>> U sys/sys
> >>> U sys/geom/geom_disk.c
> >>> U sys/geom/geom_int.h
> >>> U sys/geom/geom_subr.c
> >>> U sys/geom/geom_dev.c
> >>> U sys/geom/geom_event.c
> >>> U sys/ufs/ufs/ufs_lookup.c
> >>> U sys/ufs/ffs/ffs_softdep.c
> >>> U sys/cam/cam_xpt.c
> >>> U sys/cam/cam_periph.c
> >>> U sys/cam/cam_sim.c
> >>> U sys/cam/cam_periph.h
> >>> U sys/cam/cam_sim.h
> >>> U sys/cam/scsi/scsi_xpt.c
> >>> U sys/cam/scsi/scsi_da.c
> >>> U sys/cam/scsi/scsi_pass.c
> >>> U sys/cam/scsi/scsi_cd.c
> >>> U sys/cam/ata/ata_da.c
> >>> U sys/cam/ata/ata_all.c
> >>> U sys/cam/ata/ata_xpt.c
> >>> U sys/dev/usb/controller/xhci_pci.c
> >>> U sys/dev
> >>> U sys/kern/vfs_cache.c
> >>> U sys
> >>> Updated to revision 249624.
> >>>
> >>> /etc/make.conf is almost empty :
> >>> $ cat /etc/make.conf
> >>> KERNCONF=vbox
> >>> CFLAGS= -O2 -fno-strict-aliasing -pipe
> >>> COPTFLAGS= -O -pipe
> >>>
> >>> # added by use.perl 2013-03-12 18:50:12
> >>> PERL_VERSION=5.14.2
> >>>
> >>> Any ideas ?
> >>
> >> I've been able to build stable/9 world without issue even as recent as
> >> last night. I'll rm -fr /usr/obj/* and rebuild world under "script"
> >> then go look at the output to see if I see anything anomalous around
> >> the area you've shown. I'll reply when that's done.
> >>
> >> {snip}
> >
> > Can't reproduce the issue.
> >
> > root@testbox:/usr/src # svn info
> > Path: .
> > Working Copy Root Path: /usr/src
> > URL: svn://svn.freebsd.org/base/stable/9
> > Repository Root: svn://svn.freebsd.org/base
> > Repository UUID: ccf9f872-aa2e-dd11-9fc8-001c23d0bc1f
> > Revision: 249628
> > Node Kind: directory
> > Schedule: normal
> > Last Changed Author: mav
> > Last Changed Rev: 249624
> > Last Changed Date: 2013-04-18 06:19:41 -0700 (Thu, 18 Apr 2013)
> >
> > Here's what I get, around where yours fails:
> >
> > ===> share/termcap (all)
> > gzip -cn /usr/src/share/termcap/termcap.5 > termcap.5.gz
> > TERM=dumb TERMCAP=dumb: ex - /usr/src/share/termcap/termcap.src < /usr/src/share/termcap/reorder
> > cap_mkdb -l termcap
> > ===> share/timedef (all)
> > grep -v '^#' < /usr/src/share/timedef/am_ET.UTF-8.src > am_ET.UTF-8.out
> >
> > Note that yours says "script, 2: Pattern not found" with no mention of
> > cap_mkdb.
> >
> > My guess is that you have one of the following:
> >
> > a) A corrupted src/share/termcap/Makefile,
> > b) A corrupted SVN repo,
>
> Deleted the content of src/share/termcap and reran svn.
> Now the build succeeds.
Not surprised. :-)
> > c) Silent filesystem corruption,
> > d) Physical disk issues (e.g. bit rot).
> >
> /usr/src is NFS mounted from an OpenIndiana server so the underlying FS is ZFS, so no bitrot or silent corruption
> should be possible.
As long as the pool configuration is using something that ZFS can induce
recovery from (specifically: mirrors, raidzX, or a combination of vdevs
that make such possible), then that's true. If a stripe of disks, or a
single disk, then only detection of such problems is possible.
zpool status will shed light on the situation.
> I made a snapshot before I deleted the files and ran svn:
> $ ls -l /data//src/.zfs/snapshot/20130419/share/termcap/
> total 669
> -rw-r--r-- 1 paulz home 731 Nov 18 22:26 Makefile
> -rw-r--r-- 1 paulz home 2501 Nov 18 22:26 README
> -rw-r--r-- 1 paulz home 1467 Nov 18 22:26 reorder
> -rw-r--r-- 1 paulz home 3531 Nov 18 22:26 tck
> -rw-r--r-- 1 paulz home 66181 Nov 18 22:26 termcap.5
> -rw-r--r-- 1 paulz home 214309 Apr 16 18:55 termcap.src
> $ ls -l
> total 669
> -rw-r--r-- 1 paulz home 731 Apr 19 17:01 Makefile
> -rw-r--r-- 1 paulz home 2501 Apr 19 17:01 README
> -rw-r--r-- 1 paulz home 1467 Apr 19 17:01 reorder
> -rw-r--r-- 1 paulz home 3531 Apr 19 17:01 tck
> -rw-r--r-- 1 paulz home 66181 Apr 19 17:01 termcap.5
> -rw-r--r-- 1 paulz home 208289 Apr 19 17:01 termcap.src
>
> So it looks like termcap.src was very different but somehow svn never updated that file.
> I have only used svn to pull in the FreeBSD source so at the moment no idea if that is normal,
> but it surprised my that this happened..
I also find this interesting -- note that multiple files I have are
different sizes than yours (the only ones which are the same size are
README and tck).
root@icarus:/usr/src # ls -l /usr/src/share/termcap/
total 288
-rw-r--r-- 1 root wheel 797 Jan 24 16:58 Makefile
-rw-r--r-- 1 root wheel 2501 Jan 24 16:58 README
-rw-r--r-- 1 root wheel 1533 Jan 24 16:58 reorder
-rw-r--r-- 1 root wheel 3531 Jan 24 16:58 tck
-rw-r--r-- 1 root wheel 66248 Jan 24 16:58 termcap.5
-rw-r--r-- 1 root wheel 208361 Jan 24 16:58 termcap.src
root@icarus:/usr/src # svn info
Path: .
Working Copy Root Path: /usr/src
URL: svn://svn.freebsd.org/base/stable/9
Repository Root: svn://svn.freebsd.org/base
Repository UUID: ccf9f872-aa2e-dd11-9fc8-001c23d0bc1f
Revision: 249650
Node Kind: directory
Schedule: normal
Last Changed Author: mm
Last Changed Rev: 249643
Last Changed Date: 2013-04-19 02:19:10 -0700 (Fri, 19 Apr 2013)
And now to try something:
root@icarus:/usr/src # cp -pR share/termcap /tmp
root@icarus:/usr/src # rm -fr share/termcap
root@icarus:/usr/src # svn update
Updating '.':
Restored 'share/termcap'
Restored 'share/termcap/Makefile'
Restored 'share/termcap/README'
Restored 'share/termcap/termcap.5'
Restored 'share/termcap/tck'
Restored 'share/termcap/termcap.src'
Restored 'share/termcap/reorder'
A lib/libpmc/pmc.haswelluc.3
A lib/libpmc/pmc.haswell.3
U lib/libpmc/Makefile
U lib/libpmc/libpmc.c
U lib/libpmc
U sys/dev/hwpmc/pmc_events.h
U sys/dev/hwpmc/hwpmc_intel.c
U sys/dev/hwpmc/hwpmc_core.c
U sys/dev/hwpmc/hwpmc_uncore.c
U sys/dev
U sys/sys/pmc.h
U sys/sys
U sys
Updated to revision 249658.
root@icarus:/usr/src # ls -l /usr/src/share/termcap/
total 288
-rw-r--r-- 1 root wheel 797 Apr 19 13:14 Makefile
-rw-r--r-- 1 root wheel 2501 Apr 19 13:14 README
-rw-r--r-- 1 root wheel 1533 Apr 19 13:14 reorder
-rw-r--r-- 1 root wheel 3531 Apr 19 13:14 tck
-rw-r--r-- 1 root wheel 66248 Apr 19 13:14 termcap.5
-rw-r--r-- 1 root wheel 208361 Apr 19 13:14 termcap.src
root@icarus:/usr/src # diff -ruN share/termcap /tmp/termcap
root@icarus:/usr/src #
Are you following a different branch than I am? I'm using stable/9,
as shown. The SVN mirror I use is also shown.
If you're following stable/9, then something is very much out of whack
on your system, or the SVN repo you're using is giving you very strange
results.
My recommendations:
1. Try a different SVN repo mirror,
2. Remove NFS from the picture entirely; use a local disk instead,
at least for testing/figuring this out,
3. Start over fresh. DO NOT just delete individual files or dirs --
there is a "database" SVN uses (just like csup/cvsup!) to try and keep
track of what's what. To start over fresh:
rm -fr /usr/src /usr/src/.svn
svn checkout svn://wherever/base/stable/9 /usr/src
Good luck, and I look forward to the results of your investigation.
--
| Jeremy Chadwick jdc@koitsu.org |
| UNIX Systems Administrator http://jdc.koitsu.org/ |
| Mountain View, CA, US |
| Making life hard for others since 1977. PGP 4BD6C0CB |
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20130419202140.GA93675>