From owner-freebsd-sparc64@FreeBSD.ORG Fri May 6 19:16:02 2005 Return-Path: Delivered-To: freebsd-sparc64@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 01A7416A4D4 for ; Fri, 6 May 2005 19:16:02 +0000 (GMT) Received: from obsecurity.dyndns.org (CPE0050040655c8-CM00111ae02aac.cpe.net.cable.rogers.com [69.194.102.111]) by mx1.FreeBSD.org (Postfix) with ESMTP id A831843D8F for ; Fri, 6 May 2005 19:16:01 +0000 (GMT) (envelope-from kris@obsecurity.org) Received: by obsecurity.dyndns.org (Postfix, from userid 1000) id 1E01051449; Fri, 6 May 2005 12:16:01 -0700 (PDT) Date: Fri, 6 May 2005 12:16:01 -0700 From: Kris Kennaway To: sparc64@FreeBSD.org Message-ID: <20050506191600.GA77799@xor.obsecurity.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="tKW2IUtsqtDRztdT" Content-Disposition: inline User-Agent: Mutt/1.4.2.1i Subject: [kris@obsecurity.org: Re: Benchmarking mpsafevfs with parallel tarball extraction] X-BeenThere: freebsd-sparc64@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Porting FreeBSD to the Sparc List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 May 2005 19:16:02 -0000 --tKW2IUtsqtDRztdT Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable BTW, any ideas why md is so slow on sparc64? Kris ----- Forwarded message from Kris Kennaway ----- Date: Fri, 6 May 2005 11:48:52 -0700 From: Kris Kennaway To: Kris Kennaway Cc: smp@FreeBSD.org, current@FreeBSD.org Subject: Re: Benchmarking mpsafevfs with parallel tarball extraction In-Reply-To: <20050506183529.GA46411@xor.obsecurity.org> User-Agent: Mutt/1.4.2.1i On Fri, May 06, 2005 at 11:35:29AM -0700, Kris Kennaway wrote: > I might be bumping into the bandwidth of md here - when I ran less > rigorous tests with lower concurrency of extractions I seemed to be > getting marginally better performance (about an effective concurrency > of 2.2 for both 3 and 10 simultaneous extractions - so at least it > doesn't seem to degrade badly). Or this might be reflecting VFS lock > contention (which there is certainly a lot of, according to mutex > profiling traces). I suspect that I am hitting the md bandwidth: # dd if=3D/dev/zero of=3D/dev/md0 bs=3D1024k count=3D500 500+0 records in 500+0 records out 524288000 bytes transferred in 9.501760 secs (55177988 bytes/sec) which is a lot worse than I expected (even for a 400MHz CPU). For some reason I get better performance writing to a filesystem mounted on this md: # dd if=3D/dev/zero of=3Dfoo bs=3D1024k count=3D500 500+0 records in 500+0 records out 524288000 bytes transferred in 7.943042 secs (66005946 bytes/sec) # rm foo # dd if=3D/dev/zero of=3Dfoo bs=3D1024k count=3D500 500+0 records in 500+0 records out 524288000 bytes transferred in 7.126929 secs (73564364 bytes/sec) # rm foo # dd if=3D/dev/zero of=3Dfoo bs=3D1024k count=3D500 500+0 records in 500+0 records out 524288000 bytes transferred in 7.237668 secs (72438804 bytes/sec) If the write bandwidth is only 50-70MB/sec, then it won't be hard to saturate, so I won't probe the full scalability of mpsafevfs here. Kris ----- End forwarded message ----- --tKW2IUtsqtDRztdT Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.1 (FreeBSD) iD8DBQFCe8JwWry0BWjoQKURAir+AJ9/iOZMC/metn1FZBUHLAdqKLr4qACg829d a/6mGtZAuDq60RicLplMpRo= =yLXE -----END PGP SIGNATURE----- --tKW2IUtsqtDRztdT--