From owner-freebsd-geom@FreeBSD.ORG Mon Sep 17 02:16:37 2007 Return-Path: Delivered-To: geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C414616A418; Mon, 17 Sep 2007 02:16:37 +0000 (UTC) (envelope-from jonny@jonny.eng.br) Received: from coe.ufrj.br (roma.coe.ufrj.br [146.164.53.65]) by mx1.freebsd.org (Postfix) with ESMTP id 7BB0313C461; Mon, 17 Sep 2007 02:16:37 +0000 (UTC) (envelope-from jonny@jonny.eng.br) Received: from localhost (localhost [127.0.0.1]) by coe.ufrj.br (Postfix) with ESMTP id CBC32125411; Sun, 16 Sep 2007 22:52:08 -0300 (BRT) X-Virus-Scanned: amavisd-new at coe.ufrj.br Received: from coe.ufrj.br ([146.164.53.65]) by localhost (roma.coe.ufrj.br [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id zfwmVaCELjWd; Sun, 16 Sep 2007 22:52:02 -0300 (BRT) Received: from [201.19.116.51] (unknown [201.19.116.51]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by coe.ufrj.br (Postfix) with ESMTP id 1C73B125409; Sun, 16 Sep 2007 22:52:02 -0300 (BRT) Message-ID: <46EDDDD0.2070409@jonny.eng.br> Date: Sun, 16 Sep 2007 22:52:16 -0300 From: =?ISO-8859-1?Q?Jo=E3o_Carlos_Mendes_Lu=EDs?= User-Agent: Thunderbird 2.0.0.6 (Windows/20070728) MIME-Version: 1.0 To: geom@freebsd.org, hardware@freebsd.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit Cc: Subject: SATA mirrror performance X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Sep 2007 02:16:37 -0000 Hi, I've sent this to -performance, but maybe one of these is the right forum. Sorry to crosspost. Also, I am not currently subscribed to these two lists, so please CC me. ... I have just installed two 500G SATA discs from Seagate, model ST3500641AS in an ASUS M2N-E motherboard (nVidia MCP55 chipset). Since this is a home desktop and I need dual boot, I used nVidia's RAID technology to create the array, while still using the previous disks for booting. Well, the suggested device to control these disks, IIRC, is ataraid, so I went for it. But its performance was incredibly slow. I had less than half a megabyte per second in a raw transfer (dd). Formating 100G UFS2 partitions take more than a minute. And all this was drivers fault, as far as I could notice from "systat -v" output. The array was operating near 100% capacity. While running newfs, and this I remember for sure, the array was performing at 4 (four!) transfers per second, and near 100% load. I also noticed that ataraid does not integrate with GEOM. Shouldn't it be by now? Just to be sure it was no defect in disks, they worked perfectly in Windows XP. So my solution was to build a whole disk RAID1 device using gmirror, but now I have two independent and non-interoperational RAID technologies. Indeed, I am very luck that nVidia's RAID does not use the same sector as gmirror for metadata, or if they use, that it does not clash. After using gmirror, now I have the RAID in its full performance, getting over 60Mbytes per second at raw reads, very near the 70MBps from the specs. Could only be better if we already had NCQ working. Now the question: Is this expected? Is ataraid somehow deprecated? If that matters, this has been done on the last week's RELENG_6 source build. The CPU is an AMD Athlon 64 X2 5200+, with 3G RAM. Jonny -- João Carlos Mendes Luís - Networking Engineer - jonny@jonny.eng.br From owner-freebsd-geom@FreeBSD.ORG Mon Sep 17 11:08:01 2007 Return-Path: Delivered-To: freebsd-geom@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 52AA416A4F6 for ; Mon, 17 Sep 2007 11:08:01 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 22FB713C465 for ; Mon, 17 Sep 2007 11:08:01 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (gnats@localhost [127.0.0.1]) by freefall.freebsd.org (8.14.1/8.14.1) with ESMTP id l8HB80ZL049377 for ; Mon, 17 Sep 2007 11:08:00 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.1/8.14.1/Submit) id l8HB7xbq049373 for freebsd-geom@FreeBSD.org; Mon, 17 Sep 2007 11:07:59 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 17 Sep 2007 11:07:59 GMT Message-Id: <200709171107.l8HB7xbq049373@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-geom@FreeBSD.org Cc: Subject: Current problem reports assigned to you X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Sep 2007 11:08:01 -0000 Current FreeBSD problem reports Critical problems Serious problems S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/73177 geom kldload geom_* causes panic due to memory exhaustion o kern/76538 geom [gbde] nfs-write on gbde partition stalls and continue o kern/83464 geom [geom] [patch] Unhandled malloc failures within libgeo o kern/84556 geom [geom] GBDE-encrypted swap causes panic at shutdown o kern/87544 geom [gbde] mmaping large files on a gbde filesystem deadlo o kern/89102 geom [geom_vfs] [panic] panic when forced unmount FS from u o bin/90093 geom fdisk(8) incapable of altering in-core geometry o kern/90582 geom [geom_mirror] [panic] Restore cause panic string (ffs_ o kern/98034 geom [geom] dereference of NULL pointer in acd_geom_detach o kern/104389 geom [geom] [patch] sys/geom/geom_dump.c doesn't encode XML o kern/113419 geom [geom] geom fox multipathing not failing back o misc/113543 geom [geom] [patch] geom(8) utilities don't work inside the o kern/113957 geom [gmirror] gmirror is intermittently reporting a degrad o kern/115572 geom [gbde] gbde partitions fail at 28bit/48bit LBA address 14 problems total. Non-critical problems S Tracker Resp. Description -------------------------------------------------------------------------------- o bin/78131 geom gbde "destroy" not working. o kern/79251 geom [2TB] newfs fails on 2.6TB gbde device o kern/94632 geom [geom] Kernel output resets input while GELI asks for f kern/105390 geom [geli] filesystem on a md backed by sparse file with s o kern/107707 geom [geom] [patch] add new class geom_xbox360 to slice up p bin/110705 geom gmirror control utility does not exit with correct exi o kern/113837 geom [geom] unable to access 1024 sector size storage o kern/113885 geom [geom] [patch] improved gmirror balance algorithm o kern/114532 geom GEOM_MIRROR shows up in kldstat even if compiled in th o kern/115547 geom [geom] [patch] for GEOM Eli to get password from stdin 10 problems total. From owner-freebsd-geom@FreeBSD.ORG Mon Sep 17 16:40:06 2007 Return-Path: Delivered-To: freebsd-geom@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5242016A421 for ; Mon, 17 Sep 2007 16:40:06 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 4038513C4B3 for ; Mon, 17 Sep 2007 16:40:06 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (gnats@localhost [127.0.0.1]) by freefall.freebsd.org (8.14.1/8.14.1) with ESMTP id l8HGe60x073010 for ; Mon, 17 Sep 2007 16:40:06 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.1/8.14.1/Submit) id l8HGe6ol073009; Mon, 17 Sep 2007 16:40:06 GMT (envelope-from gnats) Date: Mon, 17 Sep 2007 16:40:06 GMT Message-Id: <200709171640.l8HGe6ol073009@freefall.freebsd.org> To: freebsd-geom@FreeBSD.org From: =?ISO-8859-1?Q?S=F8ren_Schmidt?= Cc: Subject: Re: kern/115572: [gbde] gbde partitions fail at 28bit/48bit LBA addressing boundary X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: =?ISO-8859-1?Q?S=F8ren_Schmidt?= List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Sep 2007 16:40:06 -0000 The following reply was made to PR kern/115572; it has been noted by GNATS. From: =?ISO-8859-1?Q?S=F8ren_Schmidt?= To: Pete Cc: bug-followup@FreeBSD.org Subject: Re: kern/115572: [gbde] gbde partitions fail at 28bit/48bit LBA addressing boundary Date: Mon, 17 Sep 2007 18:32:45 +0200 Pete wrote: > Does anyone know if S=F8ren Schmidt's patch (repeated below) is safe to= > use, and if it is, when it will be commited? > > I'm also experiencing this problem, but I haven't dared to try the > patch yet. > > =20 It is safe to use, it fixes a real bug :) Its just me being way too busy that has held it back from asking commit=20 approval.. -S=F8ren > The patch: > > --- ata-all.c 23 Feb 2007 16:25:08 -0000 1.279 > +++ ata-all.c 19 Aug 2007 09:25:58 -0000 > @@ -738,7 +738,7 @@ > > =20 >> atadev-flags &=3D ~ATA_D_48BIT_ACTIVE; >> =20 > > - if ((request->u.ata.lba >=3D ATA_MAX_28BIT_LBA || > + if (((request->u.ata.lba + request->u.ata.count) >=3D ATA_MAX_28BIT_L= BA || > =20 >> request-> u.ata.count256) && >> atadev-param.support.command2 & ATA_SUPPORT_ADDRESS48) { >> =20 > > . > > =20 From owner-freebsd-geom@FreeBSD.ORG Mon Sep 17 16:50:11 2007 Return-Path: Delivered-To: freebsd-geom@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 82D6816A46B for ; Mon, 17 Sep 2007 16:50:11 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 7E42413C468 for ; Mon, 17 Sep 2007 16:50:11 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (gnats@localhost [127.0.0.1]) by freefall.freebsd.org (8.14.1/8.14.1) with ESMTP id l8HGoBLw073291 for ; Mon, 17 Sep 2007 16:50:11 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.1/8.14.1/Submit) id l8HGoBbE073290; Mon, 17 Sep 2007 16:50:11 GMT (envelope-from gnats) Date: Mon, 17 Sep 2007 16:50:11 GMT Message-Id: <200709171650.l8HGoBbE073290@freefall.freebsd.org> To: freebsd-geom@FreeBSD.org From: Pete Cc: Subject: Re: kern/115572: [gbde] gbde partitions fail at 28bit/48bit LBA addressing boundary X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Pete List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Sep 2007 16:50:11 -0000 The following reply was made to PR kern/115572; it has been noted by GNATS. From: Pete To: bug-followup@FreeBSD.org Cc: sos@deepcore.dk Subject: Re: kern/115572: [gbde] gbde partitions fail at 28bit/48bit LBA addressing boundary Date: Mon, 17 Sep 2007 18:30:11 +0200 Does anyone know if Søren Schmidt's patch (repeated below) is safe to use, and if it is, when it will be commited? I'm also experiencing this problem, but I haven't dared to try the patch yet. The patch: --- ata-all.c 23 Feb 2007 16:25:08 -0000 1.279 +++ ata-all.c 19 Aug 2007 09:25:58 -0000 @@ -738,7 +738,7 @@ > atadev-flags &= ~ATA_D_48BIT_ACTIVE; - if ((request->u.ata.lba >= ATA_MAX_28BIT_LBA || + if (((request->u.ata.lba + request->u.ata.count) >= ATA_MAX_28BIT_LBA || > request-> u.ata.count256) && > atadev-param.support.command2 & ATA_SUPPORT_ADDRESS48) { From owner-freebsd-geom@FreeBSD.ORG Mon Sep 17 16:57:56 2007 Return-Path: Delivered-To: freebsd-geom@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8943F16A421 for ; Mon, 17 Sep 2007 16:57:56 +0000 (UTC) (envelope-from phk@critter.freebsd.dk) Received: from phk.freebsd.dk (phk.freebsd.dk [130.225.244.222]) by mx1.freebsd.org (Postfix) with ESMTP id 52A4D13C465 for ; Mon, 17 Sep 2007 16:57:56 +0000 (UTC) (envelope-from phk@critter.freebsd.dk) Received: from critter.freebsd.dk (critter.freebsd.dk [192.168.48.2]) by phk.freebsd.dk (Postfix) with ESMTP id A68A317104; Mon, 17 Sep 2007 16:57:54 +0000 (UTC) Received: from critter.freebsd.dk (localhost [127.0.0.1]) by critter.freebsd.dk (8.14.1/8.14.1) with ESMTP id l8HGvsgg006283; Mon, 17 Sep 2007 16:57:54 GMT (envelope-from phk@critter.freebsd.dk) To: Pete From: "Poul-Henning Kamp" In-Reply-To: Your message of "Mon, 17 Sep 2007 16:50:11 GMT." <200709171650.l8HGoBbE073290@freefall.freebsd.org> Date: Mon, 17 Sep 2007 16:57:54 +0000 Message-ID: <6282.1190048274@critter.freebsd.dk> Sender: phk@critter.freebsd.dk Cc: freebsd-geom@FreeBSD.org Subject: Re: kern/115572: [gbde] gbde partitions fail at 28bit/48bit LBA addressing boundary X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Sep 2007 16:57:56 -0000 In message <200709171650.l8HGoBbE073290@freefall.freebsd.org>, Pete writes: > Does anyone know if Søren Schmidt's patch (repeated below) is safe to > use, and if it is, when it will be commited? It is safe and it should be committed. Seems like soren doesn't have time to. -- Poul-Henning Kamp | UNIX since Zilog Zeus 3.20 phk@FreeBSD.ORG | TCP/IP since RFC 956 FreeBSD committer | BSD since 4.3-tahoe Never attribute to malice what can adequately be explained by incompetence. From owner-freebsd-geom@FreeBSD.ORG Fri Sep 21 11:34:16 2007 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C209316A417 for ; Fri, 21 Sep 2007 11:34:16 +0000 (UTC) (envelope-from softsearch@gmail.com) Received: from rv-out-0910.google.com (rv-out-0910.google.com [209.85.198.186]) by mx1.freebsd.org (Postfix) with ESMTP id 9C22613C467 for ; Fri, 21 Sep 2007 11:34:16 +0000 (UTC) (envelope-from softsearch@gmail.com) Received: by rv-out-0910.google.com with SMTP id l15so682705rvb for ; Fri, 21 Sep 2007 04:34:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:mime-version:content-type; bh=CtBRN3O2lZ4N7n3tL/syiBAkMe+J5vHAro9TxnDG1HE=; b=EHPwfWCcAay/cDuk48RI8HVwAjbk7jdy0CaPa2b49qkrYuBcRjxdqWIGQxxE+9tvPQW6wrvONiE4K6QaKozNJTFhvAHM/9glDF/lcK18BjI0StreIJ6ioe9IxChDfyrGk55CQXxjSDNBvVS7vaQ7MG6fgMUcGJPaF+QxxT1kM9c= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:mime-version:content-type; b=aS3qrHbM5NUe5UduSL3BR8oVG88TaKZh8CcDKaSI108hPTr7BZ8wpyjc40s3z8Am87giWtrGhf5TDtFOsF/HdNb2fBeAnajEUcGCpL7+49n58SnvZCsk+UJ1LSuUyVWKLFBGejsYPfQJYacZUmSWcu/1uoUwptODDySsDt0gdJU= Received: by 10.141.209.7 with SMTP id l7mr665087rvq.1190372815347; Fri, 21 Sep 2007 04:06:55 -0700 (PDT) Received: by 10.141.85.16 with HTTP; Fri, 21 Sep 2007 04:06:55 -0700 (PDT) Message-ID: Date: Fri, 21 Sep 2007 15:06:55 +0400 From: "=?KOI8-R?B?7cnIwcnMIO3PzsHbo9c=?=" To: freebsd-geom@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: raidtest for zfs X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Sep 2007 11:34:16 -0000 Hello! How to run raidtest ( http://www.freebsdsoftware.org/benchmarks/raidtest.html ) on zfs? diskinfo dos'n work. -- Michael From owner-freebsd-geom@FreeBSD.ORG Fri Sep 21 11:37:38 2007 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1063416A41A for ; Fri, 21 Sep 2007 11:37:38 +0000 (UTC) (envelope-from nino80@gmail.com) Received: from qb-out-0506.google.com (qb-out-0506.google.com [72.14.204.227]) by mx1.freebsd.org (Postfix) with ESMTP id BEDC413C4BB for ; Fri, 21 Sep 2007 11:37:37 +0000 (UTC) (envelope-from nino80@gmail.com) Received: by qb-out-0506.google.com with SMTP id a10so614823qbd for ; Fri, 21 Sep 2007 04:37:37 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=9FmJyaoJkIvnwk4QnOplBPfIF6jN1mMo3p8kg7KU6IY=; b=sCcTnm6Rxv9Pdvutyjxmsm4ICsxxq3/vnRaLWHuO8fVOC5jCn7MfW0A2vgMov7oPD4oRvmqJ8YqqQkIZYw4CfyAejMhFLUjRk0wTlGRZxqlitmlK2EQN03IOhr4CFwqmnz++km9MQo0d0lS0rkpP4iyMpBHO+UMKkrpIU67GQBc= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=SMjfPRXhFekeEfKiFdD1TV2HgMrG9zvmHgOnSfyiO0unkvOrnSchxmKa3nUHPCvfUn6UFZeiFdfI2JetWsKwL7NSLbMKT8RomnWg+B2S1AHeK/BkklMlMER8z1KXCNrpjXra/9OHAAU/eN8kLZgZp0t5m8xNsQkbzd1GyEzRbRc= Received: by 10.140.170.12 with SMTP id s12mr761171rve.1190374656588; Fri, 21 Sep 2007 04:37:36 -0700 (PDT) Received: by 10.141.18.7 with HTTP; Fri, 21 Sep 2007 04:37:36 -0700 (PDT) Message-ID: <92bcbda50709210437g590df3f9y94f32d3d4d5cd1f@mail.gmail.com> Date: Fri, 21 Sep 2007 13:37:36 +0200 From: "n j" To: freebsd-geom@freebsd.org In-Reply-To: <20070913081748.GA1155@garage.freebsd.pl> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <92bcbda50709120843o6af4bd38v8725be3f5b765b0e@mail.gmail.com> <20070913081748.GA1155@garage.freebsd.pl> Subject: Re: Gmirror on a partition of a slice X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Sep 2007 11:37:38 -0000 Pawel wrote: > > 6) fdisk -BI /dev/mirror/gm0 to create a slice in gm0 > Don't do this. > > 7) bsdlabel -w -B /dev/mirror/gm0s1 to create root partition > And this. > newfs /dev/mirror/gm0. Copy the data from da0s1a to /dev/mirror/gm0. > Modify /etc/fstab on da0s1a to mount root as /dev/mirror/gm0. Just wanted to say thanks. I don't know if the solution should have been obvious to me; perhaps it is to someone with more geom experience. For me, the two "skip this" instructions were an enlightenment. Anyway, here is what I learned, maybe the archives will help someone in the future. Put simply: a) if you are using whole disk as consumers, you can partition (fdisk) and label (bsdlabel) the resulting gmirror provider, b) if you are using slices as consumers, you should skip the partitioning and only label the partitions of the resulting gmirror provider, c) finally, if you are using partitions as consumers, you must skip both the partition and label steps and directly do a newfs on the resulting gmirror provider. The logic behind this is probably that if you already partition or label the underlying consumers, you must not do the same with the provided mirror, i.e. you can't really treat the provided mirror as an entirely fresh new disk. As I said, this is maybe obvious to someone, but for me it was new. For the record, here's my current setup using two 17G disks. I hope that mounting swap on a gstripe partition is not a Bad Thing. # df -h Filesystem Size Used Avail Capacity Mounted on /dev/mirror/gm0 989M 36M 874M 4% / devfs 1.0K 1.0K 0B 100% /dev /dev/stripe/st0s1a 29G 718M 26G 3% /big # swapinfo -h Device 1K-blocks Used Avail Capacity /dev/stripe/st0s1b 2097152 0B 2.0G 0% # gmirror status Name Status Components mirror/gm0 COMPLETE da0s1a da1s1a # gstripe status Name Status Components stripe/st0 UP da0s1d da1s1d Once again, Pawel, thanks for help (and for the geom system, of course). Regards, -- Nino From owner-freebsd-geom@FreeBSD.ORG Fri Sep 21 13:21:17 2007 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B370E16A418 for ; Fri, 21 Sep 2007 13:21:17 +0000 (UTC) (envelope-from gcubfg-freebsd-geom@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id 6903D13C447 for ; Fri, 21 Sep 2007 13:21:17 +0000 (UTC) (envelope-from gcubfg-freebsd-geom@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1IYiRJ-0006Vd-Q7 for freebsd-geom@freebsd.org; Fri, 21 Sep 2007 15:21:01 +0200 Received: from lara.cc.fer.hr ([161.53.72.113]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Fri, 21 Sep 2007 15:21:01 +0200 Received: from ivoras by lara.cc.fer.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Fri, 21 Sep 2007 15:21:01 +0200 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-geom@freebsd.org From: Ivan Voras Date: Fri, 21 Sep 2007 15:20:53 +0200 Lines: 33 Message-ID: References: <92bcbda50709120843o6af4bd38v8725be3f5b765b0e@mail.gmail.com> <20070913081748.GA1155@garage.freebsd.pl> <92bcbda50709210437g590df3f9y94f32d3d4d5cd1f@mail.gmail.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-ripemd160; protocol="application/pgp-signature"; boundary="------------enig248E822868710C9537C89AB9" X-Complaints-To: usenet@sea.gmane.org X-Gmane-NNTP-Posting-Host: lara.cc.fer.hr User-Agent: Thunderbird 1.5.0.12 (X11/20060911) In-Reply-To: <92bcbda50709210437g590df3f9y94f32d3d4d5cd1f@mail.gmail.com> X-Enigmail-Version: 0.94.4.0 Sender: news Subject: Re: Gmirror on a partition of a slice X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Sep 2007 13:21:17 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig248E822868710C9537C89AB9 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable n j wrote: > The logic behind this is probably that if you already partition or > label the underlying consumers, you must not do the same with the > provided mirror, i.e. you can't really treat the provided mirror as an > entirely fresh new disk. As I said, this is maybe obvious to someone, > but for me it was new. Actually, you *can* do it if you really want to, because every GEOM=20 provider is a "whole disk" to the system, it's just that usually it's=20 not what you want. --------------enig248E822868710C9537C89AB9 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.5 (GNU/Linux) Comment: Using GnuPG with SUSE - http://enigmail.mozdev.org iD8DBQFG88U1ldnAQVacBcgRA+NOAJwLWRg4ESGu4HQqsT6r1s7LVrv8FQCfenGD twBOzGtD46LTgNY4NCz+lAQ= =AAHn -----END PGP SIGNATURE----- --------------enig248E822868710C9537C89AB9-- From owner-freebsd-geom@FreeBSD.ORG Fri Sep 21 14:34:57 2007 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2C1A216A418 for ; Fri, 21 Sep 2007 14:34:57 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.freebsd.org (Postfix) with ESMTP id 7C14413C4A5 for ; Fri, 21 Sep 2007 14:34:56 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id F06C745E90; Fri, 21 Sep 2007 16:34:53 +0200 (CEST) Received: from localhost (pjd.wheel.pl [10.0.1.1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 0A870456AB; Fri, 21 Sep 2007 16:34:45 +0200 (CEST) Date: Fri, 21 Sep 2007 16:33:18 +0200 From: Pawel Jakub Dawidek To: ?????? ??????? Message-ID: <20070921143318.GC5690@garage.freebsd.pl> References: Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="EgVrEAR5UttbsTXg" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.3i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-5.9 required=3.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-geom@freebsd.org Subject: Re: raidtest for zfs X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Sep 2007 14:34:57 -0000 --EgVrEAR5UttbsTXg Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Sep 21, 2007 at 03:06:55PM +0400, ?????? ??????? wrote: > Hello! >=20 > How to run raidtest ( > http://www.freebsdsoftware.org/benchmarks/raidtest.html ) on zfs? >=20 > diskinfo dos'n work. raidtest is for block device testing. If you want to test ZFS with it, you need to create ZVOL with 'zfs create -V' command, eg. # zpool create tank raidz da{0,1,2,3,4} # zfs create -V 100g tank/vol # diskinfo -v /dev/zvol/tank/vol --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --EgVrEAR5UttbsTXg Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4 (FreeBSD) iD8DBQFG89YuForvXbEpPzQRAh3wAJ0UOlTck5IycU7Wt4YaclipPpo7NgCeI8kN e7ppYnUAmLucq497n+OhJys= =+DFm -----END PGP SIGNATURE----- --EgVrEAR5UttbsTXg-- From owner-freebsd-geom@FreeBSD.ORG Fri Sep 21 16:33:48 2007 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 266FE16A418 for ; Fri, 21 Sep 2007 16:33:48 +0000 (UTC) (envelope-from softsearch@gmail.com) Received: from rv-out-0910.google.com (rv-out-0910.google.com [209.85.198.187]) by mx1.freebsd.org (Postfix) with ESMTP id EC36C13C447 for ; Fri, 21 Sep 2007 16:33:47 +0000 (UTC) (envelope-from softsearch@gmail.com) Received: by rv-out-0910.google.com with SMTP id l15so741812rvb for ; Fri, 21 Sep 2007 09:33:47 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:references; bh=RHOxZOG+JRIq22Z4qAxqn/R8wpeAk6FRn738oNcAfUU=; b=mwoRN7LDx5Uek5tVqJsvxTWGpbY++nTa3cNrZZ3v8Ss+K9XIhj11LEdkJWDJb/2hipHH6nqUAsDoP4FDh1+cf+XesRINlG++2w3cMJwYivXABwi5syCJUv5nn3J+IeKpgEyBKqbmCZaPLgcuk/7UW8yi+fQaxnfaPg89Rd274uc= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:references; b=lbVRHG2nPPWHALpaHCo7f137Xkk4j7dKF9Sl7oZ5qvuWX2XPrDg/C1kq/ZbfttScQZmsyDGMDNdaWcSiUXcBnkmbCioTgcHufaWz6E6XDqeUaa2Ayv7plfxZxTPWFgnqe/xHLzvGjrNydnARjOQ27NTim0g3vKdthTSle6+Kzb8= Received: by 10.114.153.18 with SMTP id a18mr3677464wae.1190392427095; Fri, 21 Sep 2007 09:33:47 -0700 (PDT) Received: by 10.141.85.16 with HTTP; Fri, 21 Sep 2007 09:33:47 -0700 (PDT) Message-ID: Date: Fri, 21 Sep 2007 20:33:47 +0400 From: "=?KOI8-R?B?7cnIwcnMIO3PzsHbo9c=?=" To: "Pawel Jakub Dawidek" In-Reply-To: <20070921143318.GC5690@garage.freebsd.pl> MIME-Version: 1.0 References: <20070921143318.GC5690@garage.freebsd.pl> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: Re: raidtest for zfs X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Sep 2007 16:33:48 -0000 > > How to run raidtest ( > > http://www.freebsdsoftware.org/benchmarks/raidtest.html ) on zfs? > > > > diskinfo dos'n work. > > raidtest is for block device testing. If you want to test ZFS with it, > you need to create ZVOL with 'zfs create -V' command, eg. > > # zpool create tank raidz da{0,1,2,3,4} > # zfs create -V 100g tank/vol > # diskinfo -v /dev/zvol/tank/vol I get strange and fantastic results: > raidtest genfile -s 209715200 -S 512 -n 50000 -r -f File raidtest.data generated. Number of READ requests: 50000. Number of WRITE requests: 0. Number of bytes to transmit: 3279956992. > raidtest test -d /dev/zvol/tank/vol -n 10 Read 50000 requests from raidtest.data. Number of READ requests: 50000. Number of WRITE requests: 0. Number of bytes to transmit: 3279956992. Number of processes: 10. Bytes per second: 245146813 Requests per second: 3737 ^^^^^ - too big! > raidtest genfile -s 209715200 -S 512 -n 50000 -f File raidtest.data generated. Number of READ requests: 25046. Number of WRITE requests: 24954. Number of bytes to transmit: 3311506944. > raidtest test -d /dev/zvol/tank/vol -n 10 Read 50000 requests from raidtest.data. Number of READ requests: 25046. Number of WRITE requests: 24954. Number of bytes to transmit: 3311506944. Number of processes: 10. Bytes per second: 195043585 Requests per second: 2944 ^^^^^ - too big! The real results is: > raidtest test -d /dev/raid3/g3 -n 10 Read 50000 requests from raidtest.data. Number of READ requests: 50000. Number of WRITE requests: 0. Number of bytes to transmit: 3316146176. Number of processes: 10. Bytes per second: 11398078 Requests per second: 171 What is wrong? How to run raidtest correctly on /dev/zvol/tank/vol ? -- Michael From owner-freebsd-geom@FreeBSD.ORG Fri Sep 21 16:59:25 2007 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C9C9216A417 for ; Fri, 21 Sep 2007 16:59:25 +0000 (UTC) (envelope-from softsearch@gmail.com) Received: from rv-out-0910.google.com (rv-out-0910.google.com [209.85.198.185]) by mx1.freebsd.org (Postfix) with ESMTP id 9BD0D13C45A for ; Fri, 21 Sep 2007 16:59:25 +0000 (UTC) (envelope-from softsearch@gmail.com) Received: by rv-out-0910.google.com with SMTP id l15so747026rvb for ; Fri, 21 Sep 2007 09:59:25 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:references; bh=0j1GCnSzSjuwdGzMfytov8ROP8Tt5VVxAquXkeGINl0=; b=US/m5oTZhNQrUheuSykQbyR39CxaLjXfmaBncdIELIi9PeqoPb7RDbpmYilA2Lm5og1XWu+dKVuSmiNzmZBJWxNd9RA8EN83TP711JCGmPgVcmB+y50BPEa1yAiLM65hmxu7Xdz1uwuhzwls/xMKH636kueJUycAUQFWFeGUsQM= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:references; b=WV9iGXxLyqUcrrixyG8HooLgF7X5AdXNLhPjgqXo0/jmBJQyrnBwJU+U0xSsKzbQ8udzQJMiZBuS4zNznMDgQjqhT9roWwWc58R0Et2ltoBsLoGKc2OK/DqdVjTq2ycYsyiN0RFAByIEYHru4CmIotILF+1FVc1LIfcdQKaYmzU= Received: by 10.141.20.7 with SMTP id x7mr835521rvi.1190393965291; Fri, 21 Sep 2007 09:59:25 -0700 (PDT) Received: by 10.141.85.16 with HTTP; Fri, 21 Sep 2007 09:59:25 -0700 (PDT) Message-ID: Date: Fri, 21 Sep 2007 20:59:25 +0400 From: "=?KOI8-R?B?7cnIwcnMIO3PzsHbo9c=?=" To: "Pawel Jakub Dawidek" In-Reply-To: <20070921143318.GC5690@garage.freebsd.pl> MIME-Version: 1.0 References: <20070921143318.GC5690@garage.freebsd.pl> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: Re: raidtest for zfs X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Sep 2007 16:59:25 -0000 How to compare _correctrly_ read performance graid3, graid5 and zfs? -- Michael From owner-freebsd-geom@FreeBSD.ORG Fri Sep 21 17:06:47 2007 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 142BB16A419 for ; Fri, 21 Sep 2007 17:06:47 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.freebsd.org (Postfix) with ESMTP id 67D0F13C45D for ; Fri, 21 Sep 2007 17:06:46 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 1F4CF45E90; Fri, 21 Sep 2007 19:06:45 +0200 (CEST) Received: from localhost (154.81.datacomsa.pl [195.34.81.154]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 7AAE3456AB; Fri, 21 Sep 2007 19:06:35 +0200 (CEST) Date: Fri, 21 Sep 2007 19:05:07 +0200 From: Pawel Jakub Dawidek To: ?????? ??????? Message-ID: <20070921170506.GB9445@garage.freebsd.pl> References: <20070921143318.GC5690@garage.freebsd.pl> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="tjCHc7DPkfUGtrlw" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.3i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-2.6 required=3.0 tests=BAYES_00 autolearn=ham version=3.0.4 Cc: Pawel Jakub Dawidek Subject: Re: raidtest for zfs X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Sep 2007 17:06:47 -0000 --tjCHc7DPkfUGtrlw Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Sep 21, 2007 at 08:33:47PM +0400, ?????? ??????? wrote: > > > How to run raidtest ( > > > http://www.freebsdsoftware.org/benchmarks/raidtest.html ) on zfs? > > > > > > diskinfo dos'n work. > > > > raidtest is for block device testing. If you want to test ZFS with it, > > you need to create ZVOL with 'zfs create -V' command, eg. > > > > # zpool create tank raidz da{0,1,2,3,4} > > # zfs create -V 100g tank/vol > > # diskinfo -v /dev/zvol/tank/vol >=20 >=20 >=20 > I get strange and fantastic results: >=20 > > raidtest genfile -s 209715200 -S 512 -n 50000 -r -f > File raidtest.data generated. > Number of READ requests: 50000. > Number of WRITE requests: 0. > Number of bytes to transmit: 3279956992. >=20 > > raidtest test -d /dev/zvol/tank/vol -n 10 > Read 50000 requests from raidtest.data. > Number of READ requests: 50000. > Number of WRITE requests: 0. > Number of bytes to transmit: 3279956992. > Number of processes: 10. > Bytes per second: 245146813 > Requests per second: 3737 > ^^^^^ - too big! >=20 > > raidtest genfile -s 209715200 -S 512 -n 50000 -f > File raidtest.data generated. > Number of READ requests: 25046. > Number of WRITE requests: 24954. > Number of bytes to transmit: 3311506944. >=20 > > raidtest test -d /dev/zvol/tank/vol -n 10 > Read 50000 requests from raidtest.data. > Number of READ requests: 25046. > Number of WRITE requests: 24954. > Number of bytes to transmit: 3311506944. > Number of processes: 10. > Bytes per second: 195043585 > Requests per second: 2944 > ^^^^^ - too big! >=20 >=20 > The real results is: >=20 > > raidtest test -d /dev/raid3/g3 -n 10 > Read 50000 requests from raidtest.data. > Number of READ requests: 50000. > Number of WRITE requests: 0. > Number of bytes to transmit: 3316146176. > Number of processes: 10. > Bytes per second: 11398078 > Requests per second: 171 >=20 > What is wrong? >=20 > How to run raidtest correctly on /dev/zvol/tank/vol ? Ok. Here it how it works. ZFS has this COW model. It doesn't preallocate space. When you read blocks you never written, it won't touch the disks, but will just return zeros. To properly test read performance, you first need to write, so you should first run raidtest with -w flag, then zpool export/import your pool to remove cache and then retest with or without -r flag. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --tjCHc7DPkfUGtrlw Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4 (FreeBSD) iD8DBQFG8/nCForvXbEpPzQRAp9iAJ9iGXN7TtJRVuYhF/g8Sfr9HHxDkQCg1Qav 4y3k9cf5w4OQ3UnuX0fcxN0= =a6vi -----END PGP SIGNATURE----- --tjCHc7DPkfUGtrlw-- From owner-freebsd-geom@FreeBSD.ORG Fri Sep 21 19:58:40 2007 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3DA3E16A417 for ; Fri, 21 Sep 2007 19:58:40 +0000 (UTC) (envelope-from softsearch@gmail.com) Received: from mu-out-0910.google.com (mu-out-0910.google.com [209.85.134.187]) by mx1.freebsd.org (Postfix) with ESMTP id B06AC13C48A for ; Fri, 21 Sep 2007 19:58:39 +0000 (UTC) (envelope-from softsearch@gmail.com) Received: by mu-out-0910.google.com with SMTP id w9so1052272mue for ; Fri, 21 Sep 2007 12:58:36 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:date:from:reply-to:organization:x-priority:message-id:to:subject:in-reply-to:references:mime-version:content-type:content-transfer-encoding; bh=BcrRFI3YB6/nX+fYu8PxWmvJ95FOwaSgFFKnrU4qsfk=; b=Dy1avrRqgxPlmGg1jfLuYrdcadCtAgzdYxAvCsi/68/BsRCEP/nN/+QZhNAtoQh/cV2Bf/vPq9Pg7jpgskcB8XrceTgsvHQLnjJRQuo+kkHZKFMAI9BxF+gbr5ZpOGkESzZxEG1qZxxo1DYYD9/vo0rft0Ku6sKlrqAcoIZPm9M= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:date:from:reply-to:organization:x-priority:message-id:to:subject:in-reply-to:references:mime-version:content-type:content-transfer-encoding; b=rIMTu1eFZ2WhlLByexOZSetU7RdSyNreZ1QqUlUeXnhdn64eyTN39lIelqjNSQ2dL30Z1OVog/VtOlroKfi7DubUwomdLYoHzaofJT1tRohHu6u0to6hSxlbnuoZ3ABjcG5aUHimu3bPlaCL/uNOkogRFWd7scVgfWN7587v+QA= Received: by 10.82.114.3 with SMTP id m3mr1846882buc.1190404716121; Fri, 21 Sep 2007 12:58:36 -0700 (PDT) Received: from rover ( [83.222.4.74]) by mx.google.com with ESMTPS id f7sm2031081nfh.2007.09.21.12.58.32 (version=SSLv3 cipher=OTHER); Fri, 21 Sep 2007 12:58:34 -0700 (PDT) Date: Fri, 21 Sep 2007 23:58:02 +0400 From: Michael Monashev Organization: SoftSearch.ru X-Priority: 3 (Normal) Message-ID: <1310567292.20070921235802@gmail.com> To: Pawel Jakub Dawidek In-Reply-To: <20070921170506.GB9445@garage.freebsd.pl> References: <20070921143318.GC5690@garage.freebsd.pl> <20070921170506.GB9445@garage.freebsd.pl> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Subject: Re[2]: raidtest for zfs X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Michael Monashev List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Sep 2007 19:58:40 -0000 Hello, Pawel. >> > > How to run raidtest ( >> > > http://www.freebsdsoftware.org/benchmarks/raidtest.html ) on zfs? >> > > >> > > diskinfo dos'n work. >> > >> > raidtest is for block device testing. If you want to test ZFS with it, >> > you need to create ZVOL with 'zfs create -V' command, eg. >> > >> > # zpool create tank raidz da{0,1,2,3,4} >> > # zfs create -V 100g tank/vol >> > # diskinfo -v /dev/zvol/tank/vol >> >> >> >> I get strange and fantastic results: >> >> > raidtest genfile -s 209715200 -S 512 -n 50000 -r -f >> File raidtest.data generated. >> Number of READ requests: 50000. >> Number of WRITE requests: 0. >> Number of bytes to transmit: 3279956992. >> >> > raidtest test -d /dev/zvol/tank/vol -n 10 >> Read 50000 requests from raidtest.data. >> Number of READ requests: 50000. >> Number of WRITE requests: 0. >> Number of bytes to transmit: 3279956992. >> Number of processes: 10. >> Bytes per second: 245146813 >> Requests per second: 3737 >> ^^^^^ - too big! >> >> > raidtest genfile -s 209715200 -S 512 -n 50000 -f >> File raidtest.data generated. >> Number of READ requests: 25046. >> Number of WRITE requests: 24954. >> Number of bytes to transmit: 3311506944. >> >> > raidtest test -d /dev/zvol/tank/vol -n 10 >> Read 50000 requests from raidtest.data. >> Number of READ requests: 25046. >> Number of WRITE requests: 24954. >> Number of bytes to transmit: 3311506944. >> Number of processes: 10. >> Bytes per second: 195043585 >> Requests per second: 2944 >> ^^^^^ - too big! >> >> >> The real results is: >> >> > raidtest test -d /dev/raid3/g3 -n 10 >> Read 50000 requests from raidtest.data. >> Number of READ requests: 50000. >> Number of WRITE requests: 0. >> Number of bytes to transmit: 3316146176. >> Number of processes: 10. >> Bytes per second: 11398078 >> Requests per second: 171 >> >> What is wrong? >> >> How to run raidtest correctly on /dev/zvol/tank/vol ? > Ok. Here it how it works. ZFS has this COW model. It doesn't preallocate > space. When you read blocks you never written, it won't touch the disks, > but will just return zeros. > To properly test read performance, you first need to write, so you > should first run raidtest with -w flag, then zpool export/import your > pool to remove cache and then retest with or without -r flag. I run: > raidtest test -d /dev/zvol/tank/vol -n 10 -w Read 50000 requests from raidtest.data. Number of READ requests: 0. Number of WRITE requests: 50000. Number of bytes to transmit: 3281546240. Number of processes: 10. Bytes per second: 120195634 Requests per second: 1831 > zpool export tank > zpool import tank > raidtest test -d /dev/zvol/tank/vol -n 10 -r Read 50000 requests from raidtest.data. Number of READ requests: 50000. Number of WRITE requests: 0. Number of bytes to transmit: 3281546240. Number of processes: 10. Bytes per second: 69264127 Requests per second: 1055 Results seems too strange again. How to turn off zfs cache completely? FreeBSD 7.0-CURRENT amd64 -- Michael From owner-freebsd-geom@FreeBSD.ORG Sat Sep 22 01:20:24 2007 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 730BB16A480 for ; Sat, 22 Sep 2007 01:20:24 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.freebsd.org (Postfix) with ESMTP id 1D99C13C458 for ; Sat, 22 Sep 2007 01:20:23 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 49C6645E90; Sat, 22 Sep 2007 03:20:21 +0200 (CEST) Received: from localhost (154.81.datacomsa.pl [195.34.81.154]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 00AF145CD9; Sat, 22 Sep 2007 03:20:15 +0200 (CEST) Date: Sat, 22 Sep 2007 03:18:47 +0200 From: Pawel Jakub Dawidek To: Michael Monashev Message-ID: <20070922011847.GH9445@garage.freebsd.pl> References: <20070921143318.GC5690@garage.freebsd.pl> <20070921170506.GB9445@garage.freebsd.pl> <1310567292.20070921235802@gmail.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="+9faIjRurCDpBc7U" Content-Disposition: inline In-Reply-To: <1310567292.20070921235802@gmail.com> User-Agent: Mutt/1.4.2.3i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-2.6 required=3.0 tests=BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-geom@freebsd.org Subject: Re: raidtest for zfs X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Sep 2007 01:20:24 -0000 --+9faIjRurCDpBc7U Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Sep 21, 2007 at 11:58:02PM +0400, Michael Monashev wrote: > I run: >=20 > > raidtest test -d /dev/zvol/tank/vol -n 10 -w > Read 50000 requests from raidtest.data. > Number of READ requests: 0. > Number of WRITE requests: 50000. > Number of bytes to transmit: 3281546240. > Number of processes: 10. > Bytes per second: 120195634 > Requests per second: 1831 > > zpool export tank > > zpool import tank > > raidtest test -d /dev/zvol/tank/vol -n 10 -r > Read 50000 requests from raidtest.data. > Number of READ requests: 50000. > Number of WRITE requests: 0. > Number of bytes to transmit: 3281546240. > Number of processes: 10. > Bytes per second: 69264127 > Requests per second: 1055 >=20 > Results seems too strange again. [...] What's strange about those results? Can you show us 'zpool status' and explain what you expect and why? > [...] How to turn off zfs cache completely? You can't, but for reading you just need to export/import your pool to get rid of existing cache. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --+9faIjRurCDpBc7U Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4 (FreeBSD) iD8DBQFG9G13ForvXbEpPzQRAk3SAKDpIPttImEL9UjJHMH4fKekxeugLgCfYUPU a48W71lYaterBUafVJ8od8Q= =35Bw -----END PGP SIGNATURE----- --+9faIjRurCDpBc7U-- From owner-freebsd-geom@FreeBSD.ORG Sat Sep 22 11:21:44 2007 Return-Path: Delivered-To: freebsd-geom@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1F9CC16A418 for ; Sat, 22 Sep 2007 11:21:44 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.freebsd.org (Postfix) with ESMTP id A848713C44B for ; Sat, 22 Sep 2007 11:21:43 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 1371245E8F; Sat, 22 Sep 2007 13:21:42 +0200 (CEST) Received: from localhost (cvl74.internetdsl.tpnet.pl [83.19.93.74]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id DB35245F3F; Sat, 22 Sep 2007 13:21:30 +0200 (CEST) Date: Sat, 22 Sep 2007 13:19:58 +0200 From: Pawel Jakub Dawidek To: Michael Monashev Message-ID: <20070922111958.GA1614@garage.freebsd.pl> References: <20070921143318.GC5690@garage.freebsd.pl> <20070921170506.GB9445@garage.freebsd.pl> <1310567292.20070921235802@gmail.com> <20070922011847.GH9445@garage.freebsd.pl> <1231480340.20070922112446@gmail.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="azLHFNyN32YCQGCU" Content-Disposition: inline In-Reply-To: <1231480340.20070922112446@gmail.com> User-Agent: Mutt/1.4.2.3i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-2.5 required=3.0 tests=BAYES_00,RCVD_IN_NJABL_DUL, RCVD_IN_SORBS_WEB autolearn=no version=3.0.4 Cc: freebsd-geom@FreeBSD.org Subject: Re: raidtest for zfs X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Sep 2007 11:21:44 -0000 --azLHFNyN32YCQGCU Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sat, Sep 22, 2007 at 11:24:46AM +0400, Michael Monashev wrote: > ????????????, Pawel. >=20 > > What's strange about those results? Can you show us 'zpool status' and > > explain what you expect and why? >=20 > > zpool status > pool: tank > state: ONLINE > scrub: none requested > config: >=20 > NAME STATE READ WRITE CKSUM > tank ONLINE 0 0 0 > raidz1 ONLINE 0 0 0 > ad6s1 ONLINE 0 0 0 > ad8s2 ONLINE 0 0 0 > ad10s3 ONLINE 0 0 0 > ad12s1 ONLINE 0 0 0 > ad14s2 ONLINE 0 0 0 >=20 > errors: No known data errors >=20 > I compare graid5, graid3+gcache, raidz. My target is find software > RAID with better read performance and huge storage size. I planing > place a lot of little (1-100kb) images on it. >=20 > Here is my test results: http://michael.mindmix.ru/168-958-rezul-taty-tes= tirovanija-graid5-graid3-gcache-i-raidz.zhtml >=20 > graid3+gcache with round-robin reading is 1.25 faster than 1 disk. > graid5 is 2.18 faster than 1 disk. > raidz is 7.7 faster than 1 disk. >=20 > 5 disks cant read faster than 5 times. raidz is 7.7 faster than 1 > disk! >=20 > This is strange for me. ZFS ZVOL doesn't present raw blocks to use, like graid3/graid5, so it's quite possible that because of how the data was written and how ZFS prefetches the data it's faster than one disk. You may want to compare one raw disk to single disk pool. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --azLHFNyN32YCQGCU Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4 (FreeBSD) iD8DBQFG9PpeForvXbEpPzQRAmLNAJ4kYFXVPNT9pdXtpAv2kautYMk5kgCg7KZV V/7Juhq5x3JR1lltyQ47IVM= =biwW -----END PGP SIGNATURE----- --azLHFNyN32YCQGCU-- From owner-freebsd-geom@FreeBSD.ORG Sat Sep 22 11:37:48 2007 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9AF6E16A41A for ; Sat, 22 Sep 2007 11:37:48 +0000 (UTC) (envelope-from softsearch@gmail.com) Received: from fk-out-0910.google.com (fk-out-0910.google.com [209.85.128.187]) by mx1.freebsd.org (Postfix) with ESMTP id 1E82E13C455 for ; Sat, 22 Sep 2007 11:37:47 +0000 (UTC) (envelope-from softsearch@gmail.com) Received: by fk-out-0910.google.com with SMTP id b27so1354108fka for ; Sat, 22 Sep 2007 04:37:46 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:date:from:reply-to:organization:x-priority:message-id:to:subject:in-reply-to:references:mime-version:content-type:content-transfer-encoding; bh=w38MFCz/frsczquh9fAv2QUflYaP6WEbSr0mU/6GPXA=; b=qEbsbJEYZdhcH2m4ou3PohKjrW+uJxFwvHQ06GkMyj11XD3MPh4glvCg5oxbf6SlIlxWQHbJ7gxLRSuFmLe3hSD+ueiw2td+qHGvaqLsnHJxMco8Ls35YdDG+Xo4Ppai2mChcOGmmw5kCJzsKl/IxyGMdVEMRgdKh4/Kn1iqbik= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:date:from:reply-to:organization:x-priority:message-id:to:subject:in-reply-to:references:mime-version:content-type:content-transfer-encoding; b=MmQS30FxdyxsUBxOrhFWOrlIbwRd0NtlUTJtVwaMTq5ILNhnvvIs3h5UjHrl0b26FfsCXQqGd2sCZJSNNy0prN91zRyQLbcWF1RbqFcrKpfwF+KUjxsCzgVBlm8GiBxeHmsH6bc0a2ExWj/aYOxAYfMCu02A0HVud/4bC0A5AZk= Received: by 10.82.178.11 with SMTP id a11mr2056692buf.1190461066156; Sat, 22 Sep 2007 04:37:46 -0700 (PDT) Received: from ?81.200.123.45? ( [81.200.123.45]) by mx.google.com with ESMTPS id d2sm1968667nfc.2007.09.22.04.37.44 (version=SSLv3 cipher=OTHER); Sat, 22 Sep 2007 04:37:45 -0700 (PDT) Date: Sat, 22 Sep 2007 15:37:12 +0400 From: Michael Monashev Organization: SoftSearch.ru X-Priority: 3 (Normal) Message-ID: <135686599.20070922153712@gmail.com> To: Pawel Jakub Dawidek In-Reply-To: <20070922011847.GH9445@garage.freebsd.pl> References: <20070921143318.GC5690@garage.freebsd.pl> <20070921170506.GB9445@garage.freebsd.pl> <1310567292.20070921235802@gmail.com> <20070922011847.GH9445@garage.freebsd.pl> MIME-Version: 1.0 Content-Type: text/plain; charset=Windows-1251 Content-Transfer-Encoding: 8bit Subject: Re[2]: raidtest for zfs X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Michael Monashev List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Sep 2007 11:37:48 -0000 Çäðàâñòâóéòå, Pawel. > What's strange about those results? Can you show us 'zpool status' and > explain what you expect and why? > zpool status pool: tank state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM tank ONLINE 0 0 0 raidz1 ONLINE 0 0 0 ad6s1 ONLINE 0 0 0 ad8s2 ONLINE 0 0 0 ad10s3 ONLINE 0 0 0 ad12s1 ONLINE 0 0 0 ad14s2 ONLINE 0 0 0 errors: No known data errors I compare graid5, graid3+gcache, raidz. My target is find software RAID with better read performance and huge storage size. I planing place a lot of little (1-100kb) images on it. Here is my test results: http://michael.mindmix.ru/168-958-rezul-taty-testirovanija-graid5-graid3-gcache-i-raidz.zhtml graid3+gcache with round-robin reading is 1.25 faster than 1 disk. graid5 is 2.18 faster than 1 disk. raidz is 7.7 faster than 1 disk. 5 disks cant read faster than 5 times. raidz is 7.7 faster than 1 disk! This is strange for me. >> [...] How to turn off zfs cache completely? > You can't, but for reading you just need to export/import your pool to > get rid of existing cache. -- Ñ óâàæåíèåì, Michael mailto:softsearch@gmail.com From owner-freebsd-geom@FreeBSD.ORG Sat Sep 22 17:21:28 2007 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 399E216A419 for ; Sat, 22 Sep 2007 17:21:28 +0000 (UTC) (envelope-from yarodin@gmail.com) Received: from nf-out-0910.google.com (nf-out-0910.google.com [64.233.182.184]) by mx1.freebsd.org (Postfix) with ESMTP id B895F13C4B7 for ; Sat, 22 Sep 2007 17:21:27 +0000 (UTC) (envelope-from yarodin@gmail.com) Received: by nf-out-0910.google.com with SMTP id b2so930438nfb for ; Sat, 22 Sep 2007 10:21:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:from:reply-to:to:subject:date:user-agent:mime-version:content-type:content-transfer-encoding:content-disposition:message-id; bh=ocGnC1K+BzTt9YT/lmD0LnCKiXai8lrkctMLme6eAgQ=; b=mhU4nxt2V+/+q9284Aw1ifqBx68C+EZaK/p9nVBSrvXan6mNbKy96UTk+7fzdC5VzC15wdF10O+BhpnZsRmw0bHX2hz512V04eaNI0ctz1yRfjx+pWITxetiot9vVwWDeHH2b513LP5y8pPm2ech6qpJ8M1H9ySm/tYbfnyBExE= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:from:reply-to:to:subject:date:user-agent:mime-version:content-type:content-transfer-encoding:content-disposition:message-id; b=UDE3KJr9cRpIVkmlME/cCI18GBPVNdqUoN31eNldbTpK/EV4347f3GQPP35MrwKNe2T7yxXmnezSNOA9un4rbphO10059T2QbqBFtJJNqw2N4MdE8RYs1wbGuIVPm8h/+RFQGzEYvqn8tAXlEK117pRJLHh5WJejbcXe/RePi50= Received: by 10.78.138.14 with SMTP id l14mr1852297hud.1190480180431; Sat, 22 Sep 2007 09:56:20 -0700 (PDT) Received: from ?192.168.1.2? ( [88.205.252.197]) by mx.google.com with ESMTPS id 31sm1460624hub.2007.09.22.09.56.17 (version=SSLv3 cipher=OTHER); Sat, 22 Sep 2007 09:56:19 -0700 (PDT) From: yarodin To: freebsd-geom@freebsd.org Date: Sat, 22 Sep 2007 22:56:17 +0600 User-Agent: KMail/1.9.7 MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200709222256.17692.yarodin@gmail.com> Subject: Pipes password from kdialog to geli attach X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: yarodin@gmail.com List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Sep 2007 17:21:28 -0000 init: password=`kdialog --password "Enter the password"` echo $password|sha256|geli init -s 4096 -P -K - /dev/ad0s1e atach: password=`kdialog --password "Enter the password"` echo $password|sha256|geli attach -p -k - /dev/ad0s1e Is it very unsecure? May be a better method exists?