From owner-freebsd-fs@FreeBSD.ORG Wed Apr 15 14:18:22 2015 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 269C4237 for ; Wed, 15 Apr 2015 14:18:22 +0000 (UTC) Received: from esa-jnhn.mail.uoguelph.ca (esa-jnhn.mail.uoguelph.ca [131.104.91.44]) by mx1.freebsd.org (Postfix) with ESMTP id CF6496E8 for ; Wed, 15 Apr 2015 14:18:21 +0000 (UTC) X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2C6CAA5ci5V/95baINcg15cBYMQujqIEwmBRQqFNU4CgXIUAQEBAQEBAX1BA4NcAQEBAwEBAQEgKyALBRYYAgINGQIpAQkmBggHBAEcBIV0gg0IDa5kliMBAQEBAQEEAQEBAQEBARuBIYoKhCoBAQUXNAeCaIFFBYYmjmGDb4QAkxgihAsiMQd7CRcifwEBAQ X-IronPort-AV: E=Sophos;i="5.11,582,1422939600"; d="scan'208";a="203950636" Received: from muskoka.cs.uoguelph.ca (HELO zcs3.mail.uoguelph.ca) ([131.104.91.222]) by esa-jnhn.mail.uoguelph.ca with ESMTP; 15 Apr 2015 10:18:15 -0400 Received: from zcs3.mail.uoguelph.ca (localhost.localdomain [127.0.0.1]) by zcs3.mail.uoguelph.ca (Postfix) with ESMTP id 21EC0B3F88; Wed, 15 Apr 2015 10:18:15 -0400 (EDT) Date: Wed, 15 Apr 2015 10:18:15 -0400 (EDT) From: Rick Macklem To: J David Cc: freebsd-fs@freebsd.org Message-ID: <718753704.19327489.1429107495125.JavaMail.root@uoguelph.ca> In-Reply-To: Subject: Re: FreeBSD 10.1 can't "make -j5 buildworld" over NFS? MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [172.17.95.11] X-Mailer: Zimbra 7.2.6_GA_2926 (ZimbraWebClient - FF3.0 (Win)/7.2.6_GA_2926) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 15 Apr 2015 14:18:22 -0000 J David wrote: > On identical hardware, against the exact same NFS server, FreeBSD 9.3 > can do a parallel buildworld, but FreeBSD 10.1 dies in cleandir with > a > bunch of "stale NFS file handle" errors. > Well, the NFS client is almost identical in the two systems. (A couple of NFSv4 specific changes and a removal of a redundant check for creation of a hard link across mount points are the only ones I can see.) As such, I'd suspect userland differences. There is a different "make" in 10 (which I don't think is in 9.3?), so this would be a good starting point. Btw, "stale NFS file handle" means that the file has been deleted on the server. rick > The mount options are the same on both clients: > > 192.168.20.161:/data/software/freebsd/releng-9.3/src /usr/src nfs > rw,tcp,nfsv3,noauto 0 0 > 192.168.20.161:/data/software/freebsd/releng-9.3/amd64/obj /usr/obj > nfs rw,tcp,nfsv3,noauto 0 0 > > > 192.168.20.161:/data/software/freebsd/releng-10.1/src /usr/src nfs > rw,tcp,nfsv3,noauto 0 0 > 192.168.20.161:/data/software/freebsd/releng-10.1/amd64/obj /usr/obj > nfs rw,tcp,nfsv3,noauto 0 0 > > FreeBSD 9.3 build output: > > $ sudo make -j 5 buildworld > -------------------------------------------------------------- > >>> World build started on Tue Apr 14 23:47:38 UTC 2015 > -------------------------------------------------------------- > [ ... time passes ... ] > -------------------------------------------------------------- > >>> World build completed on Wed Apr 15 00:51:24 UTC 2015 > -------------------------------------------------------------- > > FreeBSD 10.1 build output: > > c$ sudo make -j 5 buildworld > --- buildworld --- > --- buildworld_prologue --- > -------------------------------------------------------------- > >>> World build started on Wed Apr 15 01:01:09 UTC 2015 > -------------------------------------------------------------- > [ ... time passes ... ] > ===> lib/libthr (cleandir) > --- usr.sbin.cleandir__D --- > --- cleandir_subdir_bhyve --- > ===> usr.sbin/bhyve (cleandir) > --- usr.bin.cleandir__D --- > --- cleandir_subdir_gzip --- > ===> usr.bin/gzip (cleandir) > --- usr.sbin.cleandir__D --- > --- cleanobj --- > --- share.cleandir__D --- > cat: .tmpfiles: Stale NFS file handle > bmake[6]: "/usr/src/share/i18n/esdb/Makefile.part" line 78: warning: > "cat .tmpfiles" returned non-zero status > --- usr.bin.cleandir__D --- > --- cleanobj --- > --- lib.cleandir__D --- > --- cleanobj --- > --- usr.bin.cleandir__D --- > --- cleandir_subdir_head --- > ===> usr.bin/head (cleandir) > --- usr.sbin.cleandir__D --- > --- cleandir_subdir_bhyvectl --- > ===> usr.sbin/bhyvectl (cleandir) > --- share.cleandir__D --- > --- clean --- > rm -f Big5-2003.esdb Big5-E.esdb Big5-ETen.esdb Big5-HKSCS.esdb > Big5-IBM.esdb Big5-Plus.esdb esdb.dir.BIG5 esdb.alias.BIG5 .tmpfiles > rm: Big5-2003.esdb: Stale NFS file handle > rm: Big5-E.esdb: Stale NFS file handle > rm: Big5-ETen.esdb: Stale NFS file handle > rm: Big5-HKSCS.esdb: Stale NFS file handle > rm: Big5-IBM.esdb: Stale NFS file handle > rm: Big5-Plus.esdb: Stale NFS file handle > rm: esdb.dir.BIG5: Stale NFS file handle > rm: esdb.alias.BIG5: Stale NFS file handle > rm: .tmpfiles: Stale NFS file handle > *** [clean] Error code 1 > > bmake[6]: stopped in /usr/src/share/i18n/esdb/BIG5 > 1 error > > bmake[6]: stopped in /usr/src/share/i18n/esdb/BIG5 > *** [_sub.cleandir] Error code 2 > > bmake[5]: stopped in /usr/src/share/i18n/esdb > --- usr.bin.cleandir__D --- > A failure has been detected in another branch of the parallel make > > bmake[4]: stopped in /usr/src/usr.bin/head > *** [cleandir_subdir_head] Error code 2 > > bmake[3]: stopped in /usr/src/usr.bin > 1 error > > bmake[3]: stopped in /usr/src/usr.bin > *** [usr.bin.cleandir__D] Error code 2 > > bmake[2]: stopped in /usr/src > --- usr.sbin.cleandir__D --- > A failure has been detected in another branch of the parallel make > > bmake[4]: stopped in /usr/src/usr.sbin/bhyvectl > *** [cleandir_subdir_bhyvectl] Error code 2 > > bmake[3]: stopped in /usr/src/usr.sbin > 1 error > > bmake[3]: stopped in /usr/src/usr.sbin > *** [usr.sbin.cleandir__D] Error code 2 > > bmake[2]: stopped in /usr/src > --- share.cleandir__D --- > 1 error > > bmake[5]: stopped in /usr/src/share/i18n/esdb > *** [_sub.cleandir] Error code 2 > > bmake[4]: stopped in /usr/src/share/i18n > 1 error > > bmake[4]: stopped in /usr/src/share/i18n > *** [_sub.cleandir] Error code 2 > > bmake[3]: stopped in /usr/src/share > 1 error > > bmake[3]: stopped in /usr/src/share > *** [share.cleandir__D] Error code 2 > > bmake[2]: stopped in /usr/src > --- lib.cleandir__D --- > A failure has been detected in another branch of the parallel make > > bmake[4]: stopped in /usr/src/lib/libthr > *** [cleandir_subdir_libthr] Error code 2 > > bmake[3]: stopped in /usr/src/lib > 1 error > > bmake[3]: stopped in /usr/src/lib > *** [lib.cleandir__D] Error code 2 > > bmake[2]: stopped in /usr/src > 4 errors > > bmake[2]: stopped in /usr/src > *** [_cleanobj] Error code 2 > > bmake[1]: stopped in /usr/src > 1 error > > bmake[1]: stopped in /usr/src > *** [buildworld] Error code 2 > > make: stopped in /usr/src > 1 error > > make: stopped in /usr/src > > > What could be going wrong here? > > Thanks for any advice! > _______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" >