From owner-freebsd-sparc64@FreeBSD.ORG Tue Oct 11 05:25:29 2011 Return-Path: Delivered-To: freebsd-sparc64@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C6968106566C for ; Tue, 11 Oct 2011 05:25:29 +0000 (UTC) (envelope-from peterjeremy@acm.org) Received: from fallbackmx10.syd.optusnet.com.au (fallbackmx10.syd.optusnet.com.au [211.29.132.251]) by mx1.freebsd.org (Postfix) with ESMTP id 507138FC12 for ; Tue, 11 Oct 2011 05:25:28 +0000 (UTC) Received: from mail11.syd.optusnet.com.au (mail11.syd.optusnet.com.au [211.29.132.192]) by fallbackmx10.syd.optusnet.com.au (8.13.1/8.13.1) with ESMTP id p9B35dSH027206 for ; Tue, 11 Oct 2011 14:05:39 +1100 Received: from server.vk2pj.dyndns.org (c220-239-116-103.belrs4.nsw.optusnet.com.au [220.239.116.103]) by mail11.syd.optusnet.com.au (8.13.1/8.13.1) with ESMTP id p9B35VZF013972 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 11 Oct 2011 14:05:32 +1100 X-Bogosity: Ham, spamicity=0.000000 Received: from server.vk2pj.dyndns.org (localhost.vk2pj.dyndns.org [127.0.0.1]) by server.vk2pj.dyndns.org (8.14.5/8.14.4) with ESMTP id p9B35UHK004997; Tue, 11 Oct 2011 14:05:30 +1100 (EST) (envelope-from peter@server.vk2pj.dyndns.org) Received: (from peter@localhost) by server.vk2pj.dyndns.org (8.14.5/8.14.4/Submit) id p9B35TMG004996; Tue, 11 Oct 2011 14:05:29 +1100 (EST) (envelope-from peter) Date: Tue, 11 Oct 2011 14:05:29 +1100 From: Peter Jeremy To: Marius Strobl Message-ID: <20111011030529.GA4093@server.vk2pj.dyndns.org> References: <20110601231237.GA5267@server.vk2pj.dyndns.org> <20110608224801.GB35494@alchemy.franken.de> <20110613235144.GA12470@server.vk2pj.dyndns.org> <20110813143807.GY48988@alchemy.franken.de> <20110816214820.GA35017@server.vk2pj.dyndns.org> <20110817094541.GJ48988@alchemy.franken.de> <20110830152725.GA28552@alchemy.franken.de> <20110831212458.GA25926@server.vk2pj.dyndns.org> <20110902153206.GR40781@alchemy.franken.de> <20111006120411.GA903@alchemy.franken.de> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="h31gzZEtNLTqOjlF" Content-Disposition: inline In-Reply-To: <20111006120411.GA903@alchemy.franken.de> X-PGP-Key: http://members.optusnet.com.au/peterjeremy/pubkey.asc User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-sparc64@freebsd.org Subject: Re: 'make -j16 universe' gives SIReset X-BeenThere: freebsd-sparc64@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Porting FreeBSD to the Sparc List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 11 Oct 2011 05:25:30 -0000 --h31gzZEtNLTqOjlF Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 2011-Oct-06 14:04:11 +0200, Marius Strobl wr= ote: >FYI, as of r226057 I made sparc64 compatible with SCHED_ULE and vice versa >as requested. It would be great if you could test SCHED_ULE with buildworl= ds >your V890. Thank you for that. I've updated my V890 to r226167 and done some -j20 buildworlds with both SCHED_4BSD and SCHED_ULE immediately after rebooting. Raw time(1) results are: SCHED_4BSD: 16090.866u 9405.784s 51:18.57 828.1% 4514+1841k 31780+5809io 13927pf+0w 16061.213u 9530.148s 50:02.60 852.3% 4493+1837k 2970+5844io 12101pf+0w 16044.606u 9527.613s 50:08.29 850.0% 4493+1837k 3016+5840io 12082pf+0w 16073.767u 9514.049s 50:05.28 851.4% 4496+1838k 2955+5822io 12081pf+0w SCHED_ULE: 15160.032u 8739.799s 50:03.55 795.7% 4540+1848k 30162+4604io 13920pf+0w 15196.869u 8753.567s 48:49.01 817.6% 4537+1849k 2988+5891io 12094pf+0w 15193.226u 8726.949s 49:02.73 812.8% 4541+1850k 3031+5990io 12083pf+0w 15194.957u 8753.260s 49:03.19 813.6% 4537+1849k 2965+6028io 12082pf+0w 15167.735u 8744.979s 48:55.28 814.6% 4538+1849k 2964+6011io 12081pf+0w 15170.366u 8737.994s 49:01.01 812.9% 4537+1849k 2977+5930io 12081pf+0w Ignoring the first buildworld in both cases (when the caches were cold), ministat shows that ULE is faster (which I would expect): User time: x buildtimes.4BSD + buildtimes.ULE +----------------------------------------------------------------------+ | + | |+ + | |+ + xxx| ||AM |A|| +----------------------------------------------------------------------+ N Min Max Median Avg Stddev x 3 16044.606 16073.767 16061.213 16059.862 14.627368 + 5 15167.735 15196.869 15193.226 15184.631 14.311132 Difference at 95.0% confidence -875.231 +/- 25.7643 -5.44981% +/- 0.160426% (Student's t, pooled s =3D 14.4173) System time: x buildtimes.4BSD + buildtimes.ULE +----------------------------------------------------------------------+ | + | | + x| |+++ x x| ||AM AM| +----------------------------------------------------------------------+ N Min Max Median Avg Stddev x 3 9514.049 9530.148 9527.613 9523.9367 8.6562706 + 5 8726.949 8753.567 8744.979 8743.3498 11.213032 Difference at 95.0% confidence -780.587 +/- 18.6399 -8.19605% +/- 0.195717% (Student's t, pooled s =3D 10.4306) Wallclock time: x buildtimes.4BSD + buildtimes.ULE +----------------------------------------------------------------------+ | + | |+ + + + x x x| | |____A_M__| |_A__|| +----------------------------------------------------------------------+ N Min Max Median Avg Stddev x 3 3002.6 3008.29 3005.28 3005.39 2.8465945 + 5 2929.01 2943.19 2941.01 2938.244 6.0475185 Difference at 95.0% confidence -67.146 +/- 9.29992 -2.23419% +/- 0.309441% (Student's t, pooled s =3D 5.2041) I also ran 6 parallel -j16 buildworlds as a stress test and that was less successful: panic: mutex vm object not owned at /usr/src/sys/vm/vm_object.c:281 VNASSERT failed VNASSERT failed 0xfffff8a3467cdc20: VNASSERT failed tag ufs, type VDIR 0xfffff8a3467cdc20: 0xfffff8a3467cdc20: usecount 7, writecount 0, refco= unt 1 0 mountedhere 0 tag ufs, type VDIR flags () VNASSERT failed cpuid =3D 13 VNASSERT failed KDB: enter: panic tag ufs, type VDIR [ thread pid 1299 tid 100640 ] Stopped at kdb_enter+0x80: ta %xcc, 1 db> KDB: stack backtrace: KDB: stack backtrace: mi_switch() at mi_switch+0x1a8 sched_preempt() at sched_preempt+0xbc cpu_ipi_preempt() at cpu_ipi_preempt+0x4 -- interrupt level=3D0x6 pil=3D0x5 %o7=3D0xc085f414 -- cpu_ipi_stop() at cpu_ipi_stop+0x110 -- interrupt level=3D0x5 pil=3D0 %o7=3D0x3d280c -- userland() at 0x3d2458 user trace: trap %o7=3D0x3d280c pc 0x3d2458, sp 0x7fdffffccd1 pc 0x179724, sp 0x7fdffffcda1 pc 0x179b38, sp 0x7fdffffce61 pc 0x179c64, sp 0x7fdffffcf21 pc 0x179c84, sp 0x7fdffffcfe1 pc 0x415af0, sp 0x7fdffffd0a1 pc 0x143fe0, sp 0x7fdffffd161 pc 0x164c58, sp 0x7fdffffd221 pc 0x165840, sp 0x7fdffffd2e1 pc 0x148670, sp 0x7fdffffd3a1 pc 0x1a0c30, sp 0x7fdffffd471 pc 0x1001d0, sp 0x7fdffffd531 pc 0, sp 0x7fdffffd5f1 done KDB: stack backtrace: KDB: stack backtrace: mi_switch() at mi_switch+0x1a8 sched_preempt() at sched_preempt+0xbc cpu_ipi_preempt() at cpu_ipi_preempt+0x4 -- interrupt level=3D0x6 pil=3D0x5 %o7=3D0xc085f414 -- cpu_ipi_stop() at cpu_ipi_stop+0x110 -- interrupt level=3D0x5 pil=3D0 %o7=3D0xc04ec15c -- _mtx_lock_spin() at _mtx_lock_spin+0xb4 _mtx_lock_spin_flags() at _mtx_lock_spin_flags+0x1b8 cnputs() at cnputs+0x5c vprintf() at vprintf+0x9c printf() at printf+0x20 vn_printf() at vn_printf+0x60 _vn_lock() at _vn_lock+0x2c cache_lookup() at cache_lookup+0x9a4 vfs_cache_lookup() at vfs_cache_lookup+0xbc VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x110 lookup() at lookup+0x7e0 namei() at namei+0x6c0 vn_open_cred() at vn_open_cred+0x31c vn_open() at vn_open+0x1c kern_openat() at kern_openat+0x1a4 kern_open() at kern_open+0x18 sys_open() at sys_open+0x14 syscall() at syscall+0x2d8 -- syscall (5, FreeBSD ELF64, sys_open) %o7=3D0x49fb98 -- userland() at 0x4e6bc8 user trace: trap %o7=3D0x49fb98 pc 0x4e6bc8, sp 0x7fdffffca81 pc 0x4a11a8, sp 0x7fdffffcb41 pc 0x4a15f4, sp 0x7fdffffcc81 pc 0x4a5904, sp 0x7fdffffcd41 pc 0x4a6930, sp 0x7fdffffce11 pc 0x49ebb0, sp 0x7fdffffced1 pc 0x49a4f4, sp 0x7fdffffcf91 pc 0x14fbf8, sp 0x7fdffffd0b1 pc 0x101160, sp 0x7fdffffd1f1 pc 0x10ecf8, sp 0x7fdffffd2b1 pc 0x1144c4, sp 0x7fdffffd3c1 pc 0x1a05a8, sp 0x7fdffffd481 pc 0x1001d0, sp 0x7fdffffd541 pc 0, sp 0x7fdffffd601 done KDB: stack backtrace: KDB: stack backtrace: mi_switch() at mi_switch+0x1a8 sched_preempt() at sched_preempt+0xbc cpu_ipi_preempt() at cpu_ipi_preempt+0x4 -- interrupt level=3D0x6 pil=3D0x5 %o7=3D0xc085f414 -- cpu_ipi_stop() at cpu_ipi_stop+0x110 -- interrupt level=3D0x5 pil=3D0 %o7=3D0xc04ec15c -- _mtx_lock_spin() at _mtx_lock_spin+0x70 _mtx_lock_spin_flags() at _mtx_lock_spin_flags+0x1b8 cnputs() at cnputs+0x5c vprintf() at vprintf+0x9c printf() at printf+0x20 vn_printf() at vn_printf+0x60 _vn_lock() at _vn_lock+0x2c cache_lookup() at cache_lookup+0x9a4 vfs_cache_lookup() at vfs_cache_lookup+0xbc VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x110 lookup() at lookup+0x7e0 namei() at namei+0x6c0 vn_open_cred() at vn_open_cred+0x31c vn_open() at vn_open+0x1c kern_openat() at kern_openat+0x1a4 kern_open() at kern_open+0x18 sys_open() at sys_open+0x14 syscall() at syscall+0x2d8 -- syscall (5, FreeBSD ELF64, sys_open) %o7=3D0x49fb98 -- userland() at 0x4e6bc8 user trace: trap %o7=3D0x49fb98 pc 0x4e6bc8, sp 0x7fdffffc4f1 pc 0x4a11a8, sp 0x7fdffffc5b1 pc 0x4a15f4, sp 0x7fdffffc6f1 pc 0x4a5904, sp 0x7fdffffc7b1 pc 0x4a6930, sp 0x7fdffffc881 pc 0x49ebb0, sp 0x7fdffffc941 pc 0x49a4f4, sp 0x7fdffffca01 pc 0x14fbf8, sp 0x7fdffffcb21 pc 0x101160, sp 0x7fdffffcc61 pc 0x10ecf8, sp 0x7fdffffcd21 pc 0x1144c4, sp 0x7fdffffce31 pc 0x1a05a8, sp 0x7fdffffcef1 pc 0x1001d0, sp 0x7fdffffcfb1 pc 0, sp 0x7fdffffd071 done KDB: stack backtrace: KDB: stack backtrace: mi_switch() at mi_switch+0x1a8 sched_preempt() at sched_preempt+0xac cpu_ipi_preempt() at cpu_ipi_preempt+0x4 -- interrupt level=3D0x6 pil=3D0x5 %o7=3D0xc085f414 -- cpu_ipi_stop() at cpu_ipi_stop+0x114 -- interrupt level=3D0x5 pil=3D0 %o7=3D0xc085bb84 -- spinlock_exit() at spinlock_exit+0x28 _mtx_unlock_spin_flags() at _mtx_unlock_spin_flags+0x16c sched_idletd() at sched_idletd+0x258 fork_exit() at fork_exit+0x9c fork_trampoline() at fork_trampoline+0x8 db>=20 I haven't looked into this further. --=20 Peter Jeremy --h31gzZEtNLTqOjlF Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.18 (FreeBSD) iEUEARECAAYFAk6TsnkACgkQ/opHv/APuIfI9QCgvO46uFesW+Iu3dNpsyIG2ifl aUgAmJezL60GhFrnfhhNgr5n2CjiBR0= =Q4WE -----END PGP SIGNATURE----- --h31gzZEtNLTqOjlF--