Date: Fri, 30 May 2014 13:54:18 +0800 From: Jia-Shiun Li <jiashiun@gmail.com> To: Ian Lepore <ian@freebsd.org> Cc: freebsd-arch <freebsd-arch@freebsd.org> Subject: Re: CFR, CFT: Fine-grained SUBDIR dependencies for parallel builds Message-ID: <CAHNYxxME-XTFR1a3CSLPjrf8oJCF%2BeM3jDeR1pp%2B91bYaoxMBw@mail.gmail.com> In-Reply-To: <1401280050.1152.377.camel@revolution.hippie.lan> References: <1401115733.1152.339.camel@revolution.hippie.lan> <CAHNYxxMkK5LpNdCOUyi33nh7xpU8qz4Xs8FvqMSyHmJo54TEeg@mail.gmail.com> <1401280050.1152.377.camel@revolution.hippie.lan>
next in thread | previous in thread | raw e-mail | index | archive | help
Updated patch works fine for me surviving -j64 buildworld on quad-core. Compile time did not differ much, ~35 mins. I 'd guess that's because build has already been well paralleled inside each subdirs for ~4 jobs. It would be even better if someone can stress it on multicore system, say 12+ cores, to explore higher hw concurrency to see the difference. Looks other targets using .for loops can be translated to this finer dependency rules as well? e.g. _bootstrap-tools, probably already on your todo list? -Jia-Shiun. On Wed, May 28, 2014 at 8:27 PM, Ian Lepore <ian@freebsd.org> wrote: > On Wed, 2014-05-28 at 12:58 +0800, Jia-Shiun Li wrote: >> It failed cleandir at libmb with -j4. Test script attached and log >> snippet below. >> >> Tested with: >> - HW: i5-3450 CPU w/ 8GB memory >> - /usr/obj & src mounted on tmpfs. >> >> src uses ~1GB without .svn dir. /usr/obj uses another ~2GB for >> buildworld, not including buildkernel. If memory is not constrained I >> think it is easier to use tmpfs to uncover parallel timing/race issues >> hidden by slower I/O. >> >> >> -Jia-shiun. > > Doh! There was a typo, libmb should have been libmd. More importantly, > it shows that my testing didn't test anything at all. I think I applied > the patch in one sandbox and then ran make universe in a different one. > Here's an updated patch (this time I'll try to test it correctly myself > too). > > Thanks for testing. > > -- Ian >
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAHNYxxME-XTFR1a3CSLPjrf8oJCF%2BeM3jDeR1pp%2B91bYaoxMBw>