Date: Sat, 4 Mar 2017 12:08:57 +0100 From: Matthias Apitz <guru@unixarea.de> To: freebsd-ports@freebsd.org Subject: running poudriere with 8 builders Message-ID: <20170304110857.GA2793@c720-r292778-amd64>
next in thread | raw e-mail | index | archive | help
Hello, I acquired a server which my company sent to dust (called it "decommissioning"), a Dell PowerEdge r210 with 8 CPU 3.3 GHz and 16 GByte RAM. I have had to insert 2 SAS disks, each of 300 GByte. The beast compiled CURRENT's world in an hour, and the kernel in 6 minutes, wow! Now I setup poudriere and a ports tree in it, all from CURRENT too. I started with 8 builders and poudriere needs halv an hour to start/clone the builders: root@jet:/usr/home/guru # poudriere bulk -f /usr/local/etc/poudriere-list -J 8 -j freebsd-r314251 -p ports-20170303 [00:00:00] ====>> Creating the reference jail... done [00:03:46] ====>> Mounting system devices for freebsd-r314251-ports-20170303 [00:03:46] ====>> Mounting ports/packages/distfiles [00:03:46] ====>> Using packages from previously failed build [00:03:46] ====>> Mounting packages from: /usr/local/poudriere/data/packages/freebsd-r314251-ports-20170303 [00:03:46] ====>> Copying /var/db/ports from: /usr/local/etc/poudriere.d/freebsd-r314251-options [00:03:47] ====>> Appending to make.conf: /usr/local/etc/poudriere.d/freebsd-r314251-make.conf /etc/resolv.conf -> /usr/local/poudriere/data/.m/freebsd-r314251-ports-20170303/ref/etc/resolv.conf [00:03:47] ====>> Starting jail freebsd-r314251-ports-20170303 [00:03:48] ====>> Logs: /usr/local/poudriere/data/logs/bulk/freebsd-r314251-ports-20170303/2017-03-04_09h50m18s [00:03:48] ====>> Loading MOVED [00:04:06] ====>> Calculating ports order and dependencies [00:09:17] ====>> pkg package missing, skipping sanity [00:09:17] ====>> Skipping incremental rebuild and repository sanity checks [00:09:17] ====>> Cleaning the build queue [00:09:20] ====>> Recording filesystem state for prepkg... done [00:09:20] ====>> Building 1760 packages using 8 builders [00:09:20] ====>> Starting/Cloning builders [00:33:47] ====>> Hit CTRL+t at any time to see build progress and stats [00:33:47] ====>> [01][00:00:00] Starting build of ports-mgmt/pkg [00:35:01] ====>> [01][00:01:14] Finished build of ports-mgmt/pkg: Success ... During this time (00:09:20 - 00:33:47) the CPUs are idling and top shows 8x 'cpdup' (I do not see any man page for this, what proc is this?). The overall throughput now is around 70 ports per hour. And top shows little CPU usage and a lot of pkg-static processes, perhaps for unpacking dependency packages. Any hints about how to improve the setup? Thanks matthias -- Matthias Apitz, ✉ guru@unixarea.de, ⌂ http://www.unixarea.de/ ☎ +49-176-38902045
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20170304110857.GA2793>