Date: Mon, 17 Oct 2016 14:56:03 +1100 From: Dewayne Geraghty <dewaynegeraghty@gmail.com> To: Kubilay Kocak <koobs@freebsd.org> Cc: ports-list freebsd <freebsd-ports@freebsd.org> Subject: Re: gcc5 dependency challenges Message-ID: <CAGnMC6pZC2is-eJQE2KZ3geMS_9YAUxWf=B_=puKAAefxNSNbg@mail.gmail.com> In-Reply-To: <053f7002-8195-c907-dfc7-c790a563da26@FreeBSD.org> References: <CAGnMC6rjJOHGvYNM43DKHgq6bJS65QBzwZVsMYF-OKVt_5vP%2BA@mail.gmail.com> <053f7002-8195-c907-dfc7-c790a563da26@FreeBSD.org>
next in thread | previous in thread | raw e-mail | index | archive | help
On 14 October 2016 at 21:22, Kubilay Kocak <koobs@freebsd.org> wrote: > On 14/10/2016 6:48 PM, Dewayne Geraghty wrote: > > After some rudimentary performance testing I note that we get up > > around 3% improvement in application performance when we use gcc5 for > > our package builds. > > > > However building ports with gcc results in gcc5 being a dependency. > > Examining ldd, we find that rarely does anything require gcc5's > > shared libs for their execution. Even simple things like ftp/wget > > and devel/ccache depend on gcc5 for building but NOT runtime. As we > > aren't allowed to install compilers onto production systems, what is > > the best course of action to address? (We could just install gcc5 and > > then remove it but then of course, the base pkg wants to remove > > everything (600+ packages) that depends on gcc5!) > > > > So the question is - how should we build our packages or install them > > so that gcc5 is not (unnecessarily) installed? > > > > We've added to our /etc/make.conf USE_GCC= 5 but I wonder if there's > > something like a build_depends mechanism? > > > > > > Background: Our FreeBSD 10.3 Stable uses pkg 1.8.3; whereas ports > > uses 1.8.7_3, minor point. > > > > Why gcc5? Well most ports use clang 3.4.1 to compile, some ports do > > use gcc 4.8.5; and if we move to FreeBSD11 then we also need to add > > llvm3.6 into the build/migrating equation. So to aid our migration > > effort we "think" choosing gcc5 now is a good idea; particularly as > > /usr/ports/base/gcc uses gcc 5.4.0 (rather than /usr/ports/lang/gcc > > which is 4.8.5) > > > > All production systems use local package repositories (as heimdal is > > widely used as are non-default options). > > > > Kind regards, Dewayne > > This (in progress thing) may help: > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=211154 > > See dependent Bugzilla issue: > > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=211079 > > ./koobs > Kubilay, Thank-you very much for the pointers. I have appended the following to /usr/ports/Mk/bsd.port.mk .if defined(PRODUCTION_USE) # defined in make.conf :) RUN_DEPENDS:=${RUN_DEPENDS:Ngcc*} RUN_DEPENDS:=${RUN_DEPENDS:Npkg*} RUN_DEPENDS:=${RUN_DEPENDS:Nindexinfo*} .endif which has achieved the desired goal. So I've gone from a virgin system without gcc or binutils where: b1# pkg-static add /root/build/i386/portconf-1.6_1.txz [b1.hs] Installing portconf-1.6_1... [b1.hs] `-- Installing gcc5-5.4.0... [b1.hs] | `-- Installing binutils-2.27_4,1... [b1.hs] | | `-- Installing gcc5-5.4.0... [b1.hs] | | `-- Installing binutils-2.27_4,1... to b2# pkg-static add /root/build/amd64/portconf-1.6_1.txz [b2.hs] Installing portconf-1.6_1... [b2.hs] Extracting portconf-1.6_1: 100% (Note that portconf is a text script!) Julian, I agree with you. I have been using a similar approach for many years on our production boxes, essentially repackaging our packages to achieve the purpose that you require. (Note though I also use pkg 1.6.4 to install as the 1.8 series didn't work as it tried to do something to directories that didn't exist (I vaguely recall man page directories)). This is the kludge of excluded files to be repackaged by tar: cat << EOM > $EXCL man/man?/ include/* */man/man?/ share/doc/* share/examples/* */doc/html/ */doc/pdf/ /lib/edoc-* lib/erl_docgen* usr/local/share/doc/ usr/local/share/*/doc/ lib/*.a EOM Then walk through your packages and tar -cJp -X $EXCL --options='xz:compression-level=6' -f /packages-reduced/$P @${P} where P is the package (eg wget-1.18.txz) Kind regards, Dewayne.
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAGnMC6pZC2is-eJQE2KZ3geMS_9YAUxWf=B_=puKAAefxNSNbg>