From owner-freebsd-fs@FreeBSD.ORG Sun May 4 09:03:30 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DAD5B1065679 for ; Sun, 4 May 2008 09:03:30 +0000 (UTC) (envelope-from engywook@gmail.com) Received: from wf-out-1314.google.com (wf-out-1314.google.com [209.85.200.169]) by mx1.freebsd.org (Postfix) with ESMTP id BB9088FC18 for ; Sun, 4 May 2008 09:03:30 +0000 (UTC) (envelope-from engywook@gmail.com) Received: by wf-out-1314.google.com with SMTP id 28so400330wfa.7 for ; Sun, 04 May 2008 02:03:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=MTWm7m6XtdhDR3NK9soKr3rQE1Dbds1oEykzk3h/eFg=; b=voJeQLW5DYHiI2ee+06a3OyMGHeUlka/eibcucmU8OwTLk3IWhNh0clFSe83Kn2hxc3Avj0/s9ox+YgtY1AG3K69kPxWMm2NweVBFNbxZiJqO9yFwiyOZgroURfpE/sMZRfNlB6MpzmR/+2qPxvUdSoLx1kS2YookNGvtnTc0rE= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=XXPykD7kxGfU15U8ALICoW+YjEf0jjO9ANhKveOSdw0QeTlgY1K6KNYcVyzKBQwfIJfN0S6Ft3Wl7YXNEnfWeyJhkmSGVl11AutFUrkIsqHGcimU+l2zBFSULJr33aiTlytohHIspXjSnEELQtSfEPFkxfXiogHY+U+CemzVN+o= Received: by 10.142.57.17 with SMTP id f17mr1983467wfa.340.1209891810252; Sun, 04 May 2008 02:03:30 -0700 (PDT) Received: by 10.143.3.10 with HTTP; Sun, 4 May 2008 02:03:30 -0700 (PDT) Message-ID: <24adbbc00805040203nbe92a2u140586abbbeb4a73@mail.gmail.com> Date: Sun, 4 May 2008 11:03:30 +0200 From: "Daniel Andersson" To: yalur@mail.ru In-Reply-To: <200805031855.43218.yalur@mail.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=KOI8-R Content-Transfer-Encoding: base64 Content-Disposition: inline References: <24adbbc00804151529m2a74085ds468eaac55ba94a32@mail.gmail.com> <200804162212.32560.yalur@mail.ru> <24adbbc00804270501t48b9a1c5le2f1d0bce18572cf@mail.gmail.com> <200805031855.43218.yalur@mail.ru> Cc: freebsd-fs@freebsd.org Subject: Re: Choppy performance. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 04 May 2008 09:03:30 -0000 PiBTb3JyeSwgbWF5YmUgSSBtaXNzIHNvbWV0aGluZy4KPiAgV2hhdCAibWVtb3J5IGFsbG9jYXRp b24gZXJyb3JzIGluIHJ0b3JyZW50IiBkbyB5b3UgbWVhbj8KCiJTdG9yYWdlIGVycm9yOiBbRmls ZSBjaHVuayB3cml0ZSBlcnJvcjogQ2Fubm90IGFsbG9jYXRlIG1lbW9yeV0iCiJTdG9yYWdlIGVy cm9yOiBbRmlsZSBjaHVuayByZWFkIGVycm9yOiBDYW5ub3QgYWxsb2NhdGUgbWVtb3J5XSIKCkl0 IGhhcHBlbnMgd2l0aCBiaWcgdG9ycmVudHMgfjQwZ2IrLiBJdCBwcm9iYWJseSBoYXBwZW5zCmJl Y2F1c2UgSSBoYXZlOgpzZW5kX2J1ZmZlcl9zaXplPTFNCnJlY2VpdmVfYnVmZmVyX3NpemU9MU0K CjFNQiBzZW5kL3JlY2VpdmUgYnVmZmVycyBwbHVzIGJpZyB0b3JyZW50IGNodW5rcyBlYXRzIHRo ZSBtZW1vcnkKcHJldHR5IGZhc3QuIEkgaGF2ZSBpdCBhdCAxTSB0byBsZXNzZW4gdGhlIGRpc2sg bG9hZC4gQnV0IG1heWJlIEkKZG9uJ3QgbmVlZCBpdCB0aGF0IGhpZ2ggYW55bW9yZSB3aXRoIHR3 byB6ZnMgZGlza3M/CgoKPgo+Cj4gID4gQnV0IGlmIGl0IGlzbid0IHJlYWxseSB1c2luZyB0aGF0 IG11Y2ggbWVtb3J5IGhvdyBjb21lIEkgZ2V0Cj4gID4gbWVtb3J5IGFsbG9jYXRpb24gZXJyb3Jz IGluIHJ0b3JyZW50IGlmIHRoZXJlJ3MgbW9yZSBtZW1vcnkKPiAgPiBhdmFsaWFibGU/Cj4KPiAg T25lIHdlZWsgYWdvIHdhcyBvYnNlcnZlZCBwcm9ibGVtIHdpdGggd3JpdGUgc3BlZWQgb24gWkZT IHBvb2wgd2l0aCBmb2xsb3dpbmcKPiAgY29uZmlndXJhdGlvbiBvbiBpMzg2Ogo+Cj4gdm0ua21l bV9zaXplX21heD0iMTA3Mzc0MTgyNCIKPiAgdm0ua21lbV9zaXplPSIxMDczNzQxODI0Igo+ICBL VkFfUEFHRVM9NTEyCj4gIFdyaXRlIHNwZWVkIGluIDggZGlza3MgKHJhaWR6KSBpcyA0MCBNYi9z ZWMgYW5kIHZlcnkgY2hvcHB5Lgo+ICBJZiBJIGNoYW5nZSB0byB2bS5rbWVtX3NpemVfbWF4PSI5 OTlNIiwgd3JpdGUgc3BlZWQgaW5jcmVhc2UgaW4gNCB0aW1lcwo+ICAoMTYwTWIvc2VjKS4gSSB0 aGluayB0aGlzIGlzIGJ1Zy4KPiAgV2hhdCBpcyB5b3VycyBjb25maWd1cmF0aW9uPwo+Ck15IGxv YWRlci5jb25mKEFNRDY0KToKCnZmcy56ZnMucHJlZmV0Y2hfZGlzYWJsZT0xCnZtLmttZW1fc2l6 ZV9tYXg9IjEwNzM3NDE4MjQiCnZtLmttZW1fc2l6ZT0iMTA3Mzc0MTgyNCIKCkknbGwgdHJ5IHNl dHRpbmcgaXQgdG8gOTk5TSBpbnN0ZWFkLCB0aGFua3MhCgo+ICAtLQo+ICBfX19fX19fX19fX19f X19fCj4gIPMg1dfB1sXOycXNCj4gIOvP19TVziDy1dPMwc4gbWFpbHRvIDx5YWx1ckBtYWlsLnJ1 PgoKQ2hlZXJzIQpEYW5pZWwK From owner-freebsd-fs@FreeBSD.ORG Sun May 4 14:08:05 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7A4CE106567F for ; Sun, 4 May 2008 14:08:05 +0000 (UTC) (envelope-from gary.jennejohn@freenet.de) Received: from mout1.freenet.de (mout1.freenet.de [IPv6:2001:748:100:40::2:3]) by mx1.freebsd.org (Postfix) with ESMTP id 252078FC17 for ; Sun, 4 May 2008 14:08:05 +0000 (UTC) (envelope-from gary.jennejohn@freenet.de) Received: from [195.4.92.13] (helo=3.mx.freenet.de) by mout1.freenet.de with esmtpa (Exim 4.69) (envelope-from ) id 1Jsesl-0001Af-5J; Sun, 04 May 2008 16:08:03 +0200 Received: from r8dcf.r.pppool.de ([89.54.141.207]:38890 helo=peedub.jennejohn.org) by 3.mx.freenet.de with esmtpa (ID gary.jennejohn@freenet.de) (port 25) (Exim 4.69 #12) id 1Jsesk-0004On-Sd; Sun, 04 May 2008 16:08:03 +0200 Date: Sun, 4 May 2008 16:08:02 +0200 From: Gary Jennejohn To: "Daniel Andersson" Message-ID: <20080504160802.745afcc2@peedub.jennejohn.org> In-Reply-To: <24adbbc00805040203nbe92a2u140586abbbeb4a73@mail.gmail.com> References: <24adbbc00804151529m2a74085ds468eaac55ba94a32@mail.gmail.com> <200804162212.32560.yalur@mail.ru> <24adbbc00804270501t48b9a1c5le2f1d0bce18572cf@mail.gmail.com> <200805031855.43218.yalur@mail.ru> <24adbbc00805040203nbe92a2u140586abbbeb4a73@mail.gmail.com> X-Mailer: Claws Mail 3.4.0 (GTK+ 2.10.14; amd64-portbld-freebsd8.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: freebsd-fs@freebsd.org Subject: Re: Choppy performance. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: gary.jennejohn@freenet.de List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 04 May 2008 14:08:05 -0000 On Sun, 4 May 2008 11:03:30 +0200 "Daniel Andersson" wrote: > > vm.kmem_size_max="1073741824" > > vm.kmem_size="1073741824" > > KVA_PAGES=512 > > Write speed in 8 disks (raidz) is 40 Mb/sec and very choppy. > > If I change to vm.kmem_size_max="999M", write speed increase in 4 times > > (160Mb/sec). I think this is bug. > > What is yours configuration? > > > My loader.conf(AMD64): > > vfs.zfs.prefetch_disable=1 > vm.kmem_size_max="1073741824" > vm.kmem_size="1073741824" > > I'll try setting it to 999M instead, thanks! > I just tried setting it to 999M for kicks (amd64) and saw no significant speed up doing a ``make -j4 buildworld''. I only saw a time difference of 20 seconds between 1024M and 999M, which is just in the noise. --- Gary Jennejohn From owner-freebsd-fs@FreeBSD.ORG Sun May 4 14:57:28 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F338F1065673 for ; Sun, 4 May 2008 14:57:28 +0000 (UTC) (envelope-from engywook@gmail.com) Received: from wf-out-1314.google.com (wf-out-1314.google.com [209.85.200.170]) by mx1.freebsd.org (Postfix) with ESMTP id DB9088FC18 for ; Sun, 4 May 2008 14:57:28 +0000 (UTC) (envelope-from engywook@gmail.com) Received: by wf-out-1314.google.com with SMTP id 28so478932wfa.7 for ; Sun, 04 May 2008 07:57:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=fm1Mc8e8VkX6URZt3BN7F3Tpdsx99ELkrr7qOAwtOpE=; b=tjhf4RWfblWC7yMGF8uJMm7dAdQUdeb6NedlDH7s9/CaZCYETywffUR+YP2hRMAvUXb2L1vd1re4M3FrH1AKfFWbl8KTkcUAMTziaDzAul3PdmSnu+MzhrgeLv3GEa2EYoIHv3wwvRDoWRfxsrvB9E7d27wyQjwqswVgMInuF0k= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=uG/8LqbXPNcesCLph9jfC1g1nyTB4ldebh6yqXDSM0vkVdL+gJmIrJpjLfRD+5LKoHAZCBnZFh4+BFxiDtuFE8Ly81HafYP5WaWSDCFIRx2mqOo4esEsArJfdf6jA/0T673kOQI6i0FrjNd3R9QrAPog8m5vhBduH1EwRDQ7Smk= Received: by 10.142.13.13 with SMTP id 13mr2087199wfm.163.1209913047186; Sun, 04 May 2008 07:57:27 -0700 (PDT) Received: by 10.143.3.10 with HTTP; Sun, 4 May 2008 07:57:27 -0700 (PDT) Message-ID: <24adbbc00805040757k32a1795fw8057bb7df0812452@mail.gmail.com> Date: Sun, 4 May 2008 16:57:27 +0200 From: "Daniel Andersson" To: gary.jennejohn@freenet.de In-Reply-To: <20080504160802.745afcc2@peedub.jennejohn.org> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <24adbbc00804151529m2a74085ds468eaac55ba94a32@mail.gmail.com> <200804162212.32560.yalur@mail.ru> <24adbbc00804270501t48b9a1c5le2f1d0bce18572cf@mail.gmail.com> <200805031855.43218.yalur@mail.ru> <24adbbc00805040203nbe92a2u140586abbbeb4a73@mail.gmail.com> <20080504160802.745afcc2@peedub.jennejohn.org> Cc: freebsd-fs@freebsd.org Subject: Re: Choppy performance. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 04 May 2008 14:57:29 -0000 > I just tried setting it to 999M for kicks (amd64) and saw no significant > speed up doing a ``make -j4 buildworld''. I only saw a time difference > of 20 seconds between 1024M and 999M, which is just in the noise. > > --- > Gary Jennejohn What kind of speeds do you get when/if you ftp stuff? I seem to have trouble getting above 30MB/s. What kind of setup do you have? How many disks? raidz? Cheers; Daniel From owner-freebsd-fs@FreeBSD.ORG Sun May 4 15:11:14 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 37E311065673 for ; Sun, 4 May 2008 15:11:14 +0000 (UTC) (envelope-from yalur@mail.ru) Received: from mx33.mail.ru (mx33.mail.ru [194.67.23.194]) by mx1.freebsd.org (Postfix) with ESMTP id 0AAA28FC14 for ; Sun, 4 May 2008 15:11:13 +0000 (UTC) (envelope-from yalur@mail.ru) Received: from [77.123.105.27] (port=59212 helo=reluctant-operater.volia.net) by mx33.mail.ru with asmtp id 1Jsfrs-000FCs-00; Sun, 04 May 2008 19:11:12 +0400 From: Ruslan Kovtun Organization: Home To: gary.jennejohn@freenet.de Date: Sun, 4 May 2008 18:11:11 +0300 User-Agent: KMail/1.9.7 References: <24adbbc00804151529m2a74085ds468eaac55ba94a32@mail.gmail.com> <24adbbc00805040203nbe92a2u140586abbbeb4a73@mail.gmail.com> <20080504160802.745afcc2@peedub.jennejohn.org> In-Reply-To: <20080504160802.745afcc2@peedub.jennejohn.org> MIME-Version: 1.0 Content-Type: text/plain; charset="koi8-r" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Message-Id: <200805041811.11266.yalur@mail.ru> X-Spam: Not detected Cc: freebsd-fs@freebsd.org, Daniel Andersson Subject: Re: Choppy performance. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: yalur@mail.ru List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 04 May 2008 15:11:14 -0000 =F7 =D3=CF=CF=C2=DD=C5=CE=C9=C9 =CF=D4 =F7=CF=D3=CB=D2=C5=D3=C5=CE=D8=C5 04= =CD=C1=D1 2008 Gary Jennejohn =CE=C1=D0=C9=D3=C1=CC(a): > On Sun, 4 May 2008 11:03:30 +0200 > > "Daniel Andersson" wrote: > > > vm.kmem_size_max=3D"1073741824" > > > vm.kmem_size=3D"1073741824" > > > KVA_PAGES=3D512 > > > Write speed in 8 disks (raidz) is 40 Mb/sec and very choppy. > > > If I change to vm.kmem_size_max=3D"999M", write speed increase in 4 > > > times (160Mb/sec). I think this is bug. > > > What is yours configuration? > > > > My loader.conf(AMD64): > > > > vfs.zfs.prefetch_disable=3D1 > > vm.kmem_size_max=3D"1073741824" > > vm.kmem_size=3D"1073741824" > > > > I'll try setting it to 999M instead, thanks! > > I just tried setting it to 999M for kicks (amd64) and saw no significant > speed up doing a ``make -j4 buildworld''. I only saw a time difference > of 20 seconds between 1024M and 999M, which is just in the noise. So, This bug related with i386 only. > > --- > Gary Jennejohn =2D-=20 ________________ =F3 =D5=D7=C1=D6=C5=CE=C9=C5=CD =EB=CF=D7=D4=D5=CE =F2=D5=D3=CC=C1=CE mailto From owner-freebsd-fs@FreeBSD.ORG Mon May 5 01:39:36 2008 Return-Path: Delivered-To: freebsd-fs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C94D01065670; Mon, 5 May 2008 01:39:36 +0000 (UTC) (envelope-from linimon@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 930D78FC14; Mon, 5 May 2008 01:39:36 +0000 (UTC) (envelope-from linimon@FreeBSD.org) Received: from freefall.freebsd.org (linimon@localhost [127.0.0.1]) by freefall.freebsd.org (8.14.2/8.14.2) with ESMTP id m451daTF098251; Mon, 5 May 2008 01:39:36 GMT (envelope-from linimon@freefall.freebsd.org) Received: (from linimon@localhost) by freefall.freebsd.org (8.14.2/8.14.1/Submit) id m451daRx098247; Mon, 5 May 2008 01:39:36 GMT (envelope-from linimon) Date: Mon, 5 May 2008 01:39:36 GMT Message-Id: <200805050139.m451daRx098247@freefall.freebsd.org> To: linimon@FreeBSD.org, freebsd-amd64@FreeBSD.org, freebsd-fs@FreeBSD.org From: linimon@FreeBSD.org Cc: Subject: Re: kern/122888: [zfs] zfs hang w/ prefetch on, zil off while running transmission-daemon X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 May 2008 01:39:36 -0000 Synopsis: [zfs] zfs hang w/ prefetch on, zil off while running transmission-daemon Responsible-Changed-From-To: freebsd-amd64->freebsd-fs Responsible-Changed-By: linimon Responsible-Changed-When: Mon May 5 01:39:18 UTC 2008 Responsible-Changed-Why: Reclassify. http://www.freebsd.org/cgi/query-pr.cgi?pr=122888 From owner-freebsd-fs@FreeBSD.ORG Mon May 5 11:07:04 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8575910656BB for ; Mon, 5 May 2008 11:07:04 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 704518FC24 for ; Mon, 5 May 2008 11:07:04 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.2/8.14.2) with ESMTP id m45B7440070686 for ; Mon, 5 May 2008 11:07:04 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.2/8.14.1/Submit) id m45B73XT070682 for freebsd-fs@FreeBSD.org; Mon, 5 May 2008 11:07:03 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 5 May 2008 11:07:03 GMT Message-Id: <200805051107.m45B73XT070682@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-fs@FreeBSD.org Cc: Subject: Current problem reports assigned to freebsd-fs@FreeBSD.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 May 2008 11:07:04 -0000 Current FreeBSD problem reports Critical problems Serious problems S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/112658 fs [smbfs] [patch] smbfs and caching problems (resolves b o kern/114676 fs [ufs] snapshot creation panics: snapacct_ufs2: bad blo o kern/116170 fs [panic] Kernel panic when mounting /tmp o bin/121072 fs [smbfs] mount_smbfs(8) cannot normally convert the cha o bin/122172 fs [amd] [fs]: amd(8) automount daemon dies on 6.3-STABLE o kern/122888 fs [zfs] zfs hang w/ prefetch on, zil off while running t 6 problems total. Non-critical problems S Tracker Resp. Description -------------------------------------------------------------------------------- o bin/113049 fs [patch] [request] make quot(8) use getopt(3) and show o bin/113838 fs [patch] [request] mount(8): add support for relative p o bin/114468 fs [patch] [request] add -d option to umount(8) to detach o kern/114847 fs [ntfs] [patch] [request] dirmask support for NTFS ala o kern/114955 fs [cd9660] [patch] [request] support for mask,dirmask,ui o bin/118249 fs mv(1): moving a directory changes its mtime 6 problems total. From owner-freebsd-fs@FreeBSD.ORG Mon May 5 13:21:37 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5D6F81065683 for ; Mon, 5 May 2008 13:21:37 +0000 (UTC) (envelope-from anderson@freebsd.org) Received: from ns.trinitel.com (186.161.36.72.static.reverse.ltdomains.com [72.36.161.186]) by mx1.freebsd.org (Postfix) with ESMTP id 2A6178FC18 for ; Mon, 5 May 2008 13:21:37 +0000 (UTC) (envelope-from anderson@freebsd.org) Received: from proton.storspeed.com (209-163-168-124.static.tenantsolutions.net [209.163.168.124] (may be forged)) (authenticated bits=0) by ns.trinitel.com (8.14.1/8.14.1) with ESMTP id m45DLTwB075638; Mon, 5 May 2008 08:21:30 -0500 (CDT) (envelope-from anderson@freebsd.org) Message-Id: From: Eric Anderson To: ticso@cicely.de In-Reply-To: <20080503125050.GG40730@cicely12.cicely.de> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v919.2) Date: Mon, 5 May 2008 08:21:29 -0500 References: <48070DCF.9090902@fsn.hu> <4CA7BA82-E95C-45FF-9B94-8EF27B6DB024@freebsd.org> <20080503125050.GG40730@cicely12.cicely.de> X-Mailer: Apple Mail (2.919.2) X-Spam-Status: No, score=-2.2 required=5.0 tests=AWL,BAYES_00 autolearn=ham version=3.1.8 X-Spam-Checker-Version: SpamAssassin 3.1.8 (2007-02-13) on ns.trinitel.com Cc: freebsd-fs@freebsd.org Subject: Re: Consistent inodes between distinct machines X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 May 2008 13:21:37 -0000 On May 3, 2008, at 7:50 AM, Bernd Walter wrote: > On Fri, May 02, 2008 at 03:40:11PM -0500, Eric Anderson wrote: >> On Apr 17, 2008, at 3:43 AM, Attila Nagy wrote: >> >>> Hello, >>> >>> I have several NFS servers, where the service must be available >>> 0-24. The servers are mounted read only on the clients and I've >>> solved the problem of maintaining consistent inodes between them by >>> rsyncing an UFS image and mounting it via md on the NFS servers. >>> The machines have a common IP address with CARP, so if one of them >>> falls out, the other(s) can take over. >>> >>> This works nice, but rsyncing multi gigabyte files are becoming more >>> and more annoying, so I've wondered whether it would be possible to >>> get constant inodes between machines via alternative ways. >> >> >> Why not avoid syncing multi-gigabyte files by splitting your huge FS >> image into many smaller say 512MB files, then use md and geom concat/ >> stripe/etc to make them all one image that you mount? > > Where would be the positive effect by doing this? > FFS distributes data over the media, so all the small files changes > in almost every case and you have to checksum-compare the whole > virtual > disk anyway. > With multiple files the syncing is more complex. For example a normal > rsync run can garantie that you get a complete file synced or none > at all, but this doesn't work out of the box with multiple files, so > you risk half updated data. The positive effect is when your image size is smaller than the cylinder group size, so every image is not getting changes. The smaller your image, the better the efficiency, but the more difficult the concat becomes. Possibly another way is to mirror devices over a ggate or iscsi link. Eric From owner-freebsd-fs@FreeBSD.ORG Thu May 8 19:26:54 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B6956106566C; Thu, 8 May 2008 19:26:54 +0000 (UTC) (envelope-from peter.schuller@infidyne.com) Received: from smtp.infidyne.com (ds9.infidyne.com [88.80.6.206]) by mx1.freebsd.org (Postfix) with ESMTP id 6EF3F8FC18; Thu, 8 May 2008 19:26:54 +0000 (UTC) (envelope-from peter.schuller@infidyne.com) Received: from c-a916e555.03-51-73746f3.cust.bredbandsbolaget.se (c-a916e555.03-51-73746f3.cust.bredbandsbolaget.se [85.229.22.169]) by smtp.infidyne.com (Postfix) with ESMTPSA id 325788C0A1; Thu, 8 May 2008 21:10:09 +0200 (CEST) From: Peter Schuller To: freebsd-fs@freebsd.org Date: Thu, 8 May 2008 21:11:03 +0200 User-Agent: KMail/1.9.7 References: <48142ABE.4050107@psg.com> <20080428083133.GA81628@eos.sc1.parodius.com> <9bbcef730804280145x6961c43ekab916ec289396361@mail.gmail.com> In-Reply-To: <9bbcef730804280145x6961c43ekab916ec289396361@mail.gmail.com> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="nextPart7422846.eyZcgVXkOY"; protocol="application/pgp-signature"; micalg=pgp-sha1 Content-Transfer-Encoding: 7bit Message-Id: <200805082111.12655.peter.schuller@infidyne.com> Cc: Randy Bush , Ivan Voras Subject: Re: zfs and vfs.zfs.prefetch_disable="1" X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 08 May 2008 19:26:54 -0000 --nextPart7422846.eyZcgVXkOY Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline > The change you reference is apparently about zil_disable, which wasn't > removed, just moved. But the prefetch_disable setting was added and > removed a couple of times to the page, the latest being that it was > added since Pawel uses it in his post. I don't know whether this has changed, but at least some people reported th= at=20 prefetch caused very poor streaming performance. I had the same problem=20 (e.g., more or less unable to play a movie) until I disabled it. I have, however, not tried re-enabling it with newer versions (this was fro= m=20 the earlier days of ZFS in current). =2D-=20 / Peter Schuller PGP userID: 0xE9758B7D or 'Peter Schuller ' Key retrieval: Send an E-Mail to getpgpkey@scode.org E-Mail: peter.schuller@infidyne.com Web: http://www.scode.org --nextPart7422846.eyZcgVXkOY Content-Type: application/pgp-signature; name=signature.asc Content-Description: This is a digitally signed message part. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.8 (FreeBSD) iEYEABECAAYFAkgjUFAACgkQDNor2+l1i30sQwCgicUzGGHEgNp+2/wxIAq7ynl4 PmcAoIo5cK12cKo4ns8xtJQpOMC2YeZl =U9yT -----END PGP SIGNATURE----- --nextPart7422846.eyZcgVXkOY-- From owner-freebsd-fs@FreeBSD.ORG Sat May 10 05:18:00 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4B72D106566B for ; Sat, 10 May 2008 05:18:00 +0000 (UTC) (envelope-from mm@FreeBSD.org) Received: from mail.vx.sk (neo.vx.sk [213.239.219.9]) by mx1.freebsd.org (Postfix) with ESMTP id 0B4D38FC0C for ; Sat, 10 May 2008 05:17:59 +0000 (UTC) (envelope-from mm@FreeBSD.org) Received: from localhost (localhost [127.0.0.1]) by mail.vx.sk (Postfix) with ESMTP id 386C1116CC for ; Sat, 10 May 2008 07:02:55 +0200 (CEST) X-Virus-Scanned: amavisd-new at mail.vx.sk Received: from mail.vx.sk ([127.0.0.1]) by localhost (mail.vx.sk [127.0.0.1]) (amavisd-new, port 10024) with LMTP id osDkn4Tqt6st for ; Sat, 10 May 2008 07:02:53 +0200 (CEST) Received: from [10.2.0.1] (f2-fiber.radiolan.sk [193.93.72.46]) by mail.vx.sk (Postfix) with ESMTPSA id 0ADC511472 for ; Sat, 10 May 2008 07:02:52 +0200 (CEST) Message-ID: <48252C89.8@FreeBSD.org> Date: Sat, 10 May 2008 07:03:05 +0200 From: Martin Matuska User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; sk; rv:1.8.1.14) Gecko/20080421 Thunderbird/2.0.0.14 Mnenhy/0.7.5.0 MIME-Version: 1.0 To: freebsd-fs@FreeBSD.org X-Enigmail-Version: 0.95.6 Content-Type: text/plain; charset=ISO-8859-2; format=flowed Content-Transfer-Encoding: 7bit Cc: Subject: ZFS lockup in "zfs" state X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 10 May 2008 05:18:00 -0000 Hi, I just experienced the same lockup in zfs state as other people did (Ivan Voras, Peter Schuller) - UFS filesystems still intact. There was heavy backup tar/gzip activity on the filesystem (read-only, write was to NFS) and lots of reads via NFS, the server was doing this job without problems for 11 days. FreeBSD: 7-STABLE 2008-04-29 ARCH: amd64 RAM: 6 GB ZFS: prefetch disabled vm.kmem_size_max="1073741824"