Date: Sun, 21 Apr 2013 10:50:07 +0200 From: Paul van der Zwan <paulz@vanderzwan.org> To: Jeremy Chadwick <jdc@koitsu.org> Cc: freebsd-stable@freebsd.org Subject: Re: Make buildworld broken on RELENG_9? Message-ID: <5327C831-C7FB-4F28-92E8-665700741636@vanderzwan.org> In-Reply-To: <20130419202140.GA93675@icarus.home.lan> References: <A2839C0B-667A-4614-9118-D14D3C70BF12@vanderzwan.org> <20130418211628.GA37504@icarus.home.lan> <20130418233626.GA39582@icarus.home.lan> <EF83582E-A45F-4EE0-AC02-9E248F652E59@vanderzwan.org> <20130419202140.GA93675@icarus.home.lan>
next in thread | previous in thread | raw e-mail | index | archive | help
On 19 Apr 2013, at 22:21 , Jeremy Chadwick <jdc@koitsu.org> wrote:
> On Fri, Apr 19, 2013 at 09:57:46PM +0200, Paul van der Zwan wrote:
>>=20
>> On 19 Apr 2013, at 1:36 , Jeremy Chadwick <jdc@koitsu.org> wrote:
>>=20
>>> On Thu, Apr 18, 2013 at 02:16:28PM -0700, Jeremy Chadwick wrote:
>>>> On Thu, Apr 18, 2013 at 10:59:29PM +0200, Paul van der Zwan wrote:
>>>>> Since last weekend or so my make buildworld terminate at the =
following error:
>>>>> =3D=3D=3D> share/tabset (all)
>>>>> uudecode < /usr/src/share/tabset/3101.uu
>>>>> uudecode < /usr/src/share/tabset/9837.uu
>>>>> uudecode < /usr/src/share/tabset/aa.uu
>>>>> uudecode < /usr/src/share/tabset/aed512.uu
>>>>> uudecode < /usr/src/share/tabset/beehive.uu
>>>>> uudecode < /usr/src/share/tabset/diablo.uu
>>>>> uudecode < /usr/src/share/tabset/dtc382.uu
>>>>> uudecode < /usr/src/share/tabset/hp700-wy.uu
>>>>> uudecode < /usr/src/share/tabset/ibm3101.uu
>>>>> uudecode < /usr/src/share/tabset/std.uu
>>>>> uudecode < /usr/src/share/tabset/stdcrt.uu
>>>>> uudecode < /usr/src/share/tabset/tandem653.uu
>>>>> uudecode < /usr/src/share/tabset/teleray.uu
>>>>> uudecode < /usr/src/share/tabset/vt100.uu
>>>>> uudecode < /usr/src/share/tabset/vt100-w.uu
>>>>> uudecode < /usr/src/share/tabset/wyse-adds.uu
>>>>> uudecode < /usr/src/share/tabset/xerox1720.uu
>>>>> uudecode < /usr/src/share/tabset/xerox1730.uu
>>>>> uudecode < /usr/src/share/tabset/xerox1730-lm.uu
>>>>> uudecode < /usr/src/share/tabset/zenith29.uu
>>>>> =3D=3D=3D> share/termcap (all)
>>>>> gzip -cn /usr/src/share/termcap/termcap.5 > termcap.5.gz
>>>>> TERM=3Ddumb TERMCAP=3Ddumb: ex - =
/usr/src/share/termcap/termcap.src < /usr/src/share/termcap/reorder
>>>>> script, 2: Pattern not found
>>>>> *** [termcap] Error code 1
>>>>>=20
>>>>> Stop in /usr/src/share/termcap.
>>>>> *** [all] Error code 1
>>>>>=20
>>>>> Stop in /usr/src/share.
>>>>> *** [share.all__D] Error code 1
>>>>>=20
>>>>> Stop in /usr/src.
>>>>> *** [everything] Error code 1
>>>>>=20
>>>>> Stop in /usr/src.
>>>>> *** [buildworld] Error code 1
>>>>>=20
>>>>> Stop in /usr/src.
>>>>>=20
>>>>> Even after updateing /usr/src using svn I keep this.
>>>>> Before this build I updated it:
>>>>> $ cd /data/src ; svn up ;=20
>>>>> U sys/sys/vnode.h
>>>>> U sys/sys
>>>>> U sys/geom/geom_disk.c
>>>>> U sys/geom/geom_int.h
>>>>> U sys/geom/geom_subr.c
>>>>> U sys/geom/geom_dev.c
>>>>> U sys/geom/geom_event.c
>>>>> U sys/ufs/ufs/ufs_lookup.c
>>>>> U sys/ufs/ffs/ffs_softdep.c
>>>>> U sys/cam/cam_xpt.c
>>>>> U sys/cam/cam_periph.c
>>>>> U sys/cam/cam_sim.c
>>>>> U sys/cam/cam_periph.h
>>>>> U sys/cam/cam_sim.h
>>>>> U sys/cam/scsi/scsi_xpt.c
>>>>> U sys/cam/scsi/scsi_da.c
>>>>> U sys/cam/scsi/scsi_pass.c
>>>>> U sys/cam/scsi/scsi_cd.c
>>>>> U sys/cam/ata/ata_da.c
>>>>> U sys/cam/ata/ata_all.c
>>>>> U sys/cam/ata/ata_xpt.c
>>>>> U sys/dev/usb/controller/xhci_pci.c
>>>>> U sys/dev
>>>>> U sys/kern/vfs_cache.c
>>>>> U sys
>>>>> Updated to revision 249624.
>>>>>=20
>>>>> /etc/make.conf is almost empty :
>>>>> $ cat /etc/make.conf
>>>>> KERNCONF=3Dvbox
>>>>> CFLAGS=3D -O2 -fno-strict-aliasing -pipe
>>>>> COPTFLAGS=3D -O -pipe
>>>>>=20
>>>>> # added by use.perl 2013-03-12 18:50:12
>>>>> PERL_VERSION=3D5.14.2
>>>>>=20
>>>>> Any ideas ?
>>>>=20
>>>> I've been able to build stable/9 world without issue even as recent =
as
>>>> last night. I'll rm -fr /usr/obj/* and rebuild world under =
"script"
>>>> then go look at the output to see if I see anything anomalous =
around
>>>> the area you've shown. I'll reply when that's done.
>>>>=20
>>>> {snip}
>>>=20
>>> Can't reproduce the issue.
>>>=20
>>> root@testbox:/usr/src # svn info
>>> Path: .
>>> Working Copy Root Path: /usr/src
>>> URL: svn://svn.freebsd.org/base/stable/9
>>> Repository Root: svn://svn.freebsd.org/base
>>> Repository UUID: ccf9f872-aa2e-dd11-9fc8-001c23d0bc1f
>>> Revision: 249628
>>> Node Kind: directory
>>> Schedule: normal
>>> Last Changed Author: mav
>>> Last Changed Rev: 249624
>>> Last Changed Date: 2013-04-18 06:19:41 -0700 (Thu, 18 Apr 2013)
>>>=20
>>> Here's what I get, around where yours fails:
>>>=20
>>> =3D=3D=3D> share/termcap (all)
>>> gzip -cn /usr/src/share/termcap/termcap.5 > termcap.5.gz
>>> TERM=3Ddumb TERMCAP=3Ddumb: ex - /usr/src/share/termcap/termcap.src =
< /usr/src/share/termcap/reorder
>>> cap_mkdb -l termcap
>>> =3D=3D=3D> share/timedef (all)
>>> grep -v '^#' < /usr/src/share/timedef/am_ET.UTF-8.src > =
am_ET.UTF-8.out
>>>=20
>>> Note that yours says "script, 2: Pattern not found" with no mention =
of
>>> cap_mkdb.
>>>=20
>>> My guess is that you have one of the following:
>>>=20
>>> a) A corrupted src/share/termcap/Makefile,
>>> b) A corrupted SVN repo,
>>=20
>> Deleted the content of src/share/termcap and reran svn.
>> Now the build succeeds.
>=20
> Not surprised. :-)
>=20
>>> c) Silent filesystem corruption,
>>> d) Physical disk issues (e.g. bit rot).
>>>=20
>> /usr/src is NFS mounted from an OpenIndiana server so the underlying =
FS is ZFS, so no bitrot or silent corruption
>> should be possible.
>=20
> As long as the pool configuration is using something that ZFS can =
induce
> recovery from (specifically: mirrors, raidzX, or a combination of =
vdevs
> that make such possible), then that's true. If a stripe of disks, or =
a
> single disk, then only detection of such problems is possible.
>=20
> zpool status will shed light on the situation.
>=20
Pool is made up of two drives in a mirror and scrubbed regularly so I =
can almost certainly rule that out.
>> I made a snapshot before I deleted the files and ran svn:
>> $ ls -l /data//src/.zfs/snapshot/20130419/share/termcap/
>> total 669
>> -rw-r--r-- 1 paulz home 731 Nov 18 22:26 Makefile
>> -rw-r--r-- 1 paulz home 2501 Nov 18 22:26 README
>> -rw-r--r-- 1 paulz home 1467 Nov 18 22:26 reorder
>> -rw-r--r-- 1 paulz home 3531 Nov 18 22:26 tck
>> -rw-r--r-- 1 paulz home 66181 Nov 18 22:26 termcap.5
>> -rw-r--r-- 1 paulz home 214309 Apr 16 18:55 termcap.src
>> $ ls -l
>> total 669
>> -rw-r--r-- 1 paulz home 731 Apr 19 17:01 Makefile
>> -rw-r--r-- 1 paulz home 2501 Apr 19 17:01 README
>> -rw-r--r-- 1 paulz home 1467 Apr 19 17:01 reorder
>> -rw-r--r-- 1 paulz home 3531 Apr 19 17:01 tck
>> -rw-r--r-- 1 paulz home 66181 Apr 19 17:01 termcap.5
>> -rw-r--r-- 1 paulz home 208289 Apr 19 17:01 termcap.src
>>=20
>> So it looks like termcap.src was very different but somehow svn never =
updated that file.
>> I have only used svn to pull in the FreeBSD source so at the moment =
no idea if that is normal,
>> but it surprised my that this happened..
>=20
> I also find this interesting -- note that multiple files I have are
> different sizes than yours (the only ones which are the same size are
> README and tck).
>=20
> root@icarus:/usr/src # ls -l /usr/src/share/termcap/
> total 288
> -rw-r--r-- 1 root wheel 797 Jan 24 16:58 Makefile
> -rw-r--r-- 1 root wheel 2501 Jan 24 16:58 README
> -rw-r--r-- 1 root wheel 1533 Jan 24 16:58 reorder
> -rw-r--r-- 1 root wheel 3531 Jan 24 16:58 tck
> -rw-r--r-- 1 root wheel 66248 Jan 24 16:58 termcap.5
> -rw-r--r-- 1 root wheel 208361 Jan 24 16:58 termcap.src
> root@icarus:/usr/src # svn info
> Path: .
> Working Copy Root Path: /usr/src
> URL: svn://svn.freebsd.org/base/stable/9
> Repository Root: svn://svn.freebsd.org/base
> Repository UUID: ccf9f872-aa2e-dd11-9fc8-001c23d0bc1f
> Revision: 249650
> Node Kind: directory
> Schedule: normal
> Last Changed Author: mm
> Last Changed Rev: 249643
> Last Changed Date: 2013-04-19 02:19:10 -0700 (Fri, 19 Apr 2013)
>=20
In the share/termcap directory of snapshot svn info showed:
$ svn info termcap.src=20
Path: termcap.src
Name: termcap.src
URL: svn://svn.freebsd.org/base/stable/9/share/termcap/termcap.src
Repository Root: svn://svn.freebsd.org/base
Repository UUID: ccf9f872-aa2e-dd11-9fc8-001c23d0bc1f
Revision: 249624
Node Kind: file
Schedule: normal
Last Changed Author: eadler
Last Changed Rev: 243259
Last Changed Date: 2012-11-19 05:10:23 +0100 (Mon, 19 Nov 2012)
Text Last Updated: 2012-11-19 20:55:35 +0100 (Mon, 19 Nov 2012)
Checksum: 5e795d6e162acc92997796f13228ffe9
But if I run svn diff I get quite a lot of output.
> And now to try something:
>=20
> root@icarus:/usr/src # cp -pR share/termcap /tmp
> root@icarus:/usr/src # rm -fr share/termcap
> root@icarus:/usr/src # svn update
> Updating '.':
> Restored 'share/termcap'
> Restored 'share/termcap/Makefile'
> Restored 'share/termcap/README'
> Restored 'share/termcap/termcap.5'
> Restored 'share/termcap/tck'
> Restored 'share/termcap/termcap.src'
> Restored 'share/termcap/reorder'
> A lib/libpmc/pmc.haswelluc.3
> A lib/libpmc/pmc.haswell.3
> U lib/libpmc/Makefile
> U lib/libpmc/libpmc.c
> U lib/libpmc
> U sys/dev/hwpmc/pmc_events.h
> U sys/dev/hwpmc/hwpmc_intel.c
> U sys/dev/hwpmc/hwpmc_core.c
> U sys/dev/hwpmc/hwpmc_uncore.c
> U sys/dev
> U sys/sys/pmc.h
> U sys/sys
> U sys
> Updated to revision 249658.
> root@icarus:/usr/src # ls -l /usr/src/share/termcap/
> total 288
> -rw-r--r-- 1 root wheel 797 Apr 19 13:14 Makefile
> -rw-r--r-- 1 root wheel 2501 Apr 19 13:14 README
> -rw-r--r-- 1 root wheel 1533 Apr 19 13:14 reorder
> -rw-r--r-- 1 root wheel 3531 Apr 19 13:14 tck
> -rw-r--r-- 1 root wheel 66248 Apr 19 13:14 termcap.5
> -rw-r--r-- 1 root wheel 208361 Apr 19 13:14 termcap.src
> root@icarus:/usr/src # diff -ruN share/termcap /tmp/termcap
> root@icarus:/usr/src #
>=20
> Are you following a different branch than I am? I'm using stable/9,
> as shown. The SVN mirror I use is also shown.
>=20
> If you're following stable/9, then something is very much out of whack
> on your system, or the SVN repo you're using is giving you very =
strange
> results.
>=20
As far as I can tell from the repo uuid we are using the same repo.
> My recommendations:
>=20
> 1. Try a different SVN repo mirror,
>=20
> 2. Remove NFS from the picture entirely; use a local disk instead,
> at least for testing/figuring this out,
>=20
svn is running locally on the OpenIndiana so only the FreeBSD VMs use
NFS.
> 3. Start over fresh. DO NOT just delete individual files or dirs --
> there is a "database" SVN uses (just like csup/cvsup!) to try and keep
> track of what's what. To start over fresh:
>=20
> rm -fr /usr/src /usr/src/.svn
> svn checkout svn://wherever/base/stable/9 /usr/src
>=20
> Good luck, and I look forward to the results of your investigation.
>=20
Done that and that seems to give a buildable source.
Not sure if it's worth it or possible to find out what happened.
Thanks for your help,
Paul
> --=20
> | Jeremy Chadwick jdc@koitsu.org |
> | UNIX Systems Administrator http://jdc.koitsu.org/ |
> | Mountain View, CA, US |
> | Making life hard for others since 1977. PGP 4BD6C0CB |
> _______________________________________________
> freebsd-stable@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-stable
> To unsubscribe, send any mail to =
"freebsd-stable-unsubscribe@freebsd.org"
>=20
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?5327C831-C7FB-4F28-92E8-665700741636>