From owner-freebsd-stable@FreeBSD.ORG Mon Jan 25 00:29:59 2010 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A424E1065670; Mon, 25 Jan 2010 00:29:59 +0000 (UTC) (envelope-from dan.naumov@gmail.com) Received: from mail-yw0-f197.google.com (mail-yw0-f197.google.com [209.85.211.197]) by mx1.freebsd.org (Postfix) with ESMTP id 22C368FC18; Mon, 25 Jan 2010 00:29:58 +0000 (UTC) Received: by ywh35 with SMTP id 35so2328435ywh.7 for ; Sun, 24 Jan 2010 16:29:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:cc:content-type :content-transfer-encoding; bh=I1rTt5+AtkuF3NDO8eiHPav4aNN1MzV8f6fQzMt6M2o=; b=nFlhTdrrGcnTNDP04CbMdgueZF/TVHKYCOVrjUvV6M3mRPZPJ0/r196MVWaVuzBFg6 3RHTPgiiOV8yZYJsOK7cnGYtvs08DSHgNUWuH6a7A9QOZFt3LmPeQJCKnxAthWD+SPmo hsr26e9Duu/8GRoWPTFLzae7X6pO9K2NY2AlA= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; b=RRz4XmYnSpIYQbMaj1fTu0CAk1gV4frh4LkR8pa1zHdsw/IZPK4UBITtNoCxTFpzlC Mt5CyAzj6TNixWqSV6WsL/wZxqfIc/hGECFd7Y9v6Pah7HtkqRWwQ0OBvQhWuq5VpLjI 7bvpH6+MyRP9T/V6vP85ZOYwEfpQKLStuPjWc= MIME-Version: 1.0 Received: by 10.101.186.1 with SMTP id n1mr6994422anp.124.1264379389237; Sun, 24 Jan 2010 16:29:49 -0800 (PST) In-Reply-To: References: <883b2dc51001240905r4cfbf830i3b9b400969ac261b@mail.gmail.com> <1264368182.00211075.1264355402@10.7.7.3> <4B5CC167.5010604@FreeBSD.org> Date: Mon, 25 Jan 2010 02:29:49 +0200 Message-ID: From: Dan Naumov To: Alexander Motin Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: freebsd-fs@freebsd.org, Jason Edwards , FreeBSD-STABLE Mailing List , freebsd-questions@freebsd.org Subject: Re: 8.0-RELEASE/amd64 - full ZFS install - low read and write disk performance X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 Jan 2010 00:29:59 -0000 On Mon, Jan 25, 2010 at 2:14 AM, Dan Naumov wrote: > On Sun, Jan 24, 2010 at 11:53 PM, Alexander Motin wrote= : >> Dan Naumov wrote: >>> This works out to 1GB in 36,2 seconds / 28,2mb/s in the first test and >>> 4GB in 143.8 seconds / 28,4mb/s and somewhat consistent with the >>> bonnie results. It also sadly seems to confirm the very slow speed :( >>> The disks are attached to a 4-port Sil3124 controller and again, my >>> Windows benchmarks showing 65mb/s+ were done on exact same machine, >>> with same disks attached to the same controller. Only difference was >>> that in Windows the disks weren't in a mirror configuration but were >>> tested individually. I do understand that a mirror setup offers >>> roughly the same write speed as individual disk, while the read speed >>> usually varies from "equal to individual disk speed" to "nearly the >>> throughput of both disks combined" depending on the implementation, >>> but there is no obvious reason I am seeing why my setup offers both >>> read and write speeds roughly 1/3 to 1/2 of what the individual disks >>> are capable of. Dmesg shows: >>> >>> atapci0: port 0x1000-0x100f mem >>> 0x90108000-0x9010807f,0x90100000-0x90107fff irq 21 at device 0.0 on >>> pci4 >>> ad8: 1907729MB at ata4-master SATA300 >>> ad10: 1907729MB at ata5-master SATA300 >> >> 8.0-RELEASE, and especially 8-STABLE provide alternative, much more >> functional driver for this controller, named siis(4). If your SiI3124 >> card installed into proper bus (PCI-X or PCIe x4/x8), it can be really >> fast (up to 1GB/s was measured). >> >> -- >> Alexander Motin > > Sadly, it seems that utilizing the new siis driver doesn't do much good: > > Before utilizing siis: > > iozone -s 4096M -r 512 -i0 -i1 > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0random > random =A0 =A0bkwd =A0 record =A0 stride > =A0 =A0 =A0 =A0 =A0 =A0 =A0KB =A0reclen =A0 write rewrite =A0 =A0read =A0= =A0reread =A0 =A0read > write =A0 =A0read =A0rewrite =A0 =A0 read =A0 fwrite frewrite =A0 fread = =A0freread > =A0 =A0 =A0 =A0 4194304 =A0 =A0 512 =A0 28796 =A0 28766 =A0 =A051610 =A0 = =A050695 > > After enabling siis in loader.conf (and ensuring the disks show up as ada= ): > > iozone -s 4096M -r 512 -i0 -i1 > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0random > random =A0 =A0bkwd =A0 record =A0 stride > =A0 =A0 =A0 =A0 =A0 =A0 =A0KB =A0reclen =A0 write rewrite =A0 =A0read =A0= =A0reread =A0 =A0read > write =A0 =A0read =A0rewrite =A0 =A0 read =A0 fwrite frewrite =A0 fread = =A0freread > =A0 =A0 =A0 =A0 4194304 =A0 =A0 512 =A0 28781 =A0 28897 =A0 =A047214 =A0 = =A050540 Just to add to the numbers above, exact same benchmark, on 1 disk (detached 2nd disk from the mirror) while using the siis driver: random random bkwd record stride KB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 4194304 512 57760 56371 68867 74047 - Dan