From owner-freebsd-arch@FreeBSD.ORG Wed May 28 04:59:18 2014 Return-Path: Delivered-To: freebsd-arch@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 80D8EEDD; Wed, 28 May 2014 04:59:18 +0000 (UTC) Received: from mail-ob0-x235.google.com (mail-ob0-x235.google.com [IPv6:2607:f8b0:4003:c01::235]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3E81E2A36; Wed, 28 May 2014 04:59:18 +0000 (UTC) Received: by mail-ob0-f181.google.com with SMTP id wm4so10399581obc.12 for ; Tue, 27 May 2014 21:59:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=KRji66ieKoJcTjoYQAX5qP3GConv1LlID7fxVRcALVM=; b=MsBPrevDMh8CQhI3dU3k0Syzjowcm35iJI6rhXS78aPCbdENVpQqOi+/o0S5Jc7qaA GBBEcmZDRtrhH+WWzzJOFQHwk33KyqXnJ6uSFEA2vmB1F9wfb8SlNi/CU8wlu5wKgaRQ iqmAGuNy+0CISAuOxdz5FFGIohqZXZ72INRpOfta5xPR2ucMLrbY6lfSJSnFpZG2LWf/ QdJ55fA7QATfzyRfOjWfROni73FcyPBYS/Hwrzu/apcsNkmykNpvTOwU+8Z/NxhOZaf5 dL/L04xotScgrY53L0T4vqiXfLHQh1sH4hG1KPRCvQrGBCgsD2alOlgin86YGNfL4UTS ofmA== X-Received: by 10.60.161.6 with SMTP id xo6mr9214546oeb.78.1401253157568; Tue, 27 May 2014 21:59:17 -0700 (PDT) MIME-Version: 1.0 Received: by 10.76.123.178 with HTTP; Tue, 27 May 2014 21:58:46 -0700 (PDT) In-Reply-To: <1401115733.1152.339.camel@revolution.hippie.lan> References: <1401115733.1152.339.camel@revolution.hippie.lan> From: Jia-Shiun Li Date: Wed, 28 May 2014 12:58:46 +0800 Message-ID: Subject: Re: CFR, CFT: Fine-grained SUBDIR dependencies for parallel builds To: Ian Lepore Content-Type: multipart/mixed; boundary=089e0117784db310c304fa6eac79 Cc: freebsd-arch X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 May 2014 04:59:18 -0000 --089e0117784db310c304fa6eac79 Content-Type: text/plain; charset=UTF-8 It failed cleandir at libmb with -j4. Test script attached and log snippet below. Tested with: - HW: i5-3450 CPU w/ 8GB memory - /usr/obj & src mounted on tmpfs. src uses ~1GB without .svn dir. /usr/obj uses another ~2GB for buildworld, not including buildkernel. If memory is not constrained I think it is easier to use tmpfs to uncover parallel timing/race issues hidden by slower I/O. -Jia-shiun. --- 8< ---------------------------------------- ===> cddl/usr.bin/ctfdump (cleandir) --- bin.cleandir__D --- --- clean --- rm -f rcp rcp.o util.o rcp.1.gz rcp.1.cat.gz --- lib.cleandir__D --- --- cleanobj --- --- libexec.cleandir__D --- --- clean --- rm -f rpc.sprayd sprayd.o rpc.sprayd.8.gz rpc.sprayd.8.cat.gz --- bin.cleandir__D --- --- cleandepend --- rm -f .depend GPATH GRTAGS GSYMS GTAGS --- lib.cleandir__D --- make[3]: make[3]: don't know how to make cleandir_subdir_libmb. Stop make[3]: stopped in /mnt/src/lib *** [lib.cleandir__D] Error code 2 make[2]: stopped in /mnt/src --- libexec.cleandir__D --- --- cleandepend --- rm -f .depend GPATH GRTAGS GSYMS GTAGS --- bin.cleandir__D --- --- cleanobj --- A failure has been detected in another branch of the parallel make make[4]: stopped in /mnt/src/bin/rcp --- libexec.cleandir__D --- A failure has been detected in another branch of the parallel make make[4]: stopped in /mnt/src/libexec/rpc.sprayd --- bin.cleandir__D --- *** [cleandir_subdir_rcp] Error code 2 make[3]: stopped in /mnt/src/bin 1 error make[3]: stopped in /mnt/src/bin --- libexec.cleandir__D --- *** [_sub.cleandir] Error code 2 make[3]: stopped in /mnt/src/libexec 1 error make[3]: stopped in /mnt/src/libexec *** [libexec.cleandir__D] Error code 2 make[2]: stopped in /mnt/src --- bin.cleandir__D --- *** [bin.cleandir__D] Error code 2 make[2]: stopped in /mnt/src --- cddl.cleandir__D --- A failure has been detected in another branch of the parallel make make[5]: stopped in /mnt/src/cddl/usr.bin/ctfdump *** [_sub.cleandir] Error code 2 make[4]: stopped in /mnt/src/cddl/usr.bin 1 error make[4]: stopped in /mnt/src/cddl/usr.bin *** [_sub.cleandir] Error code 2 make[3]: stopped in /mnt/src/cddl 1 error make[3]: stopped in /mnt/src/cddl *** [cddl.cleandir__D] Error code 2 make[2]: stopped in /mnt/src 4 errors make[2]: stopped in /mnt/src *** [_cleanobj] Error code 2 make[1]: stopped in /mnt/src 1 error make[1]: stopped in /mnt/src *** [buildworld] Error code 2 make: stopped in /mnt/src make: stopped in /mnt/src --089e0117784db310c304fa6eac79 Content-Type: text/plain; charset=US-ASCII; name="run.sh.txt" Content-Disposition: attachment; filename="run.sh.txt" Content-Transfer-Encoding: base64 X-Attachment-Id: f_hvq5w5v61 IyEvYmluL3NoCgplY2hvID09PT09PT0gPj4gcGNtLmxvZwpwY20ueCAxIC1jc3YgPj4gcGNtLmxv ZyAmClBJRD0kIQoKZWNobyBwaWQgJFBJRAoKZGF0ZSA+PiBidWlsZC5sb2cKCm1ha2UgLWo0IGJ1 aWxkd29ybGQgPj4gYnVpbGQubG9nICYKUFBJRD0kIQplY2hvIHdhaXRpbmcuLi4Kd2FpdCAkUFBJ RAoKZGF0ZSA+PiBidWlsZC5sb2cKCmtpbGwgJFBJRAoKZWNobyBkb25lCgo= --089e0117784db310c304fa6eac79--