From owner-freebsd-fs@FreeBSD.ORG Sun Jan 4 16:00:48 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4BA551065672 for ; Sun, 4 Jan 2009 16:00:48 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from mail.terabit.net.ua (mail.terabit.net.ua [195.137.202.147]) by mx1.freebsd.org (Postfix) with ESMTP id E5C638FC18 for ; Sun, 4 Jan 2009 16:00:47 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from skuns.zoral.com.ua ([91.193.166.194] helo=mail.zoral.com.ua) by mail.terabit.net.ua with esmtps (TLSv1:AES256-SHA:256) (Exim 4.63 (FreeBSD)) (envelope-from ) id 1LJVPC-0002Xj-Bt; Sun, 04 Jan 2009 18:00:46 +0200 Received: from deviant.kiev.zoral.com.ua (root@deviant.kiev.zoral.com.ua [10.1.1.148]) by mail.zoral.com.ua (8.14.2/8.14.2) with ESMTP id n04G0h1W092457 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Sun, 4 Jan 2009 18:00:43 +0200 (EET) (envelope-from kostikbel@gmail.com) Received: from deviant.kiev.zoral.com.ua (kostik@localhost [127.0.0.1]) by deviant.kiev.zoral.com.ua (8.14.3/8.14.3) with ESMTP id n04G0hNs062148; Sun, 4 Jan 2009 18:00:43 +0200 (EET) (envelope-from kostikbel@gmail.com) Received: (from kostik@localhost) by deviant.kiev.zoral.com.ua (8.14.3/8.14.3/Submit) id n04G0hPX062146; Sun, 4 Jan 2009 18:00:43 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: deviant.kiev.zoral.com.ua: kostik set sender to kostikbel@gmail.com using -f Date: Sun, 4 Jan 2009 18:00:43 +0200 From: Kostik Belousov To: Jaakko Heinonen Message-ID: <20090104160043.GI93900@deviant.kiev.zoral.com.ua> References: <20090103182107.GA4119@a91-153-125-115.elisa-laajakaista.fi> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="wZdghQXYJzyo6AGC" Content-Disposition: inline In-Reply-To: <20090103182107.GA4119@a91-153-125-115.elisa-laajakaista.fi> User-Agent: Mutt/1.4.2.3i X-Virus-Scanned: ClamAV version 0.94.2, clamav-milter version 0.94.2 on skuns.kiev.zoral.com.ua X-Virus-Status: Clean X-Spam-Status: No, score=-4.4 required=5.0 tests=ALL_TRUSTED,AWL,BAYES_00 autolearn=ham version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on skuns.kiev.zoral.com.ua X-Virus-Scanned: mail.terabit.net.ua 1LJVPC-0002Xj-Bt 3af7db5cff8db4364b6c701704f3747b X-Terabit: YES Cc: freebsd-fs@freebsd.org Subject: Re: [patch] ext2fs freeze/corruption on amd64 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 04 Jan 2009 16:00:48 -0000 --wZdghQXYJzyo6AGC Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sat, Jan 03, 2009 at 08:21:08PM +0200, Jaakko Heinonen wrote: >=20 > Hi, >=20 > I can quite easily reproduce a hard freeze while writing to an ext2fs > filesystem on amd64. I can reliably reproduce it by building a kernel > with "make -j2" on ext2fs. >=20 > This has been reported by other people too: >=20 > http://lists.freebsd.org/pipermail/freebsd-fs/2008-March/004504.html > http://lists.freebsd.org/pipermail/freebsd-bugs/2008-January/027555.html > http://www.freebsd.org/cgi/query-pr.cgi?pr=3Dkern/119529 > http://www.freebsd.org/cgi/query-pr.cgi?pr=3Damd64/99561 >=20 > I tracked the problem down to find_next_zero_bit() in ext2_bitops.h. > The bug doesn't affect i386 because it uses asm bitops from > i386-bitops.h. (There's also sparc64-bitops.h file but it's not used > anywhere.) >=20 > The problem is that if the offset (ofs) has one or more of it's five low > bits set those bits are incorrectly re-added to the result. With > following patch applied I can't reproduce the problem. >=20 > %%% > Index: sys/gnu/fs/ext2fs/ext2_bitops.h > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > --- sys/gnu/fs/ext2fs/ext2_bitops.h (revision 186639) > +++ sys/gnu/fs/ext2fs/ext2_bitops.h (working copy) > @@ -84,7 +84,7 @@ find_next_zero_bit(void *data, size_t sz > mask =3D ~0U << (ofs & 31); > bit =3D *p | ~mask; > if (bit !=3D ~0U) > - return (ffs(~bit) + ofs - 1); > + return (ffs(~bit) + (ofs & ~31U) - 1); > p++; > ofs =3D (ofs + 31U) & ~31U; > } > %%% >=20 > I hope that someone would commit this or similar fix. It might be also > reasonable to delete the unused sparc64-bitops.h file. Please note that find_next_zero_bit() uses gcc extension to perform void-pointer arithmetic. Also, at the +2 line, it performs unaligned access to the uint32_t entities. --wZdghQXYJzyo6AGC Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (FreeBSD) iEYEARECAAYFAklg3SoACgkQC3+MBN1Mb4jasACgnVBp7ehnPSciZTa4jT3R771M NfEAn2bUN458Uav6daqeGf5NOEjrTXPg =3Dqp -----END PGP SIGNATURE----- --wZdghQXYJzyo6AGC-- From owner-freebsd-fs@FreeBSD.ORG Sun Jan 4 23:22:29 2009 Return-Path: Delivered-To: fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 96630106564A for ; Sun, 4 Jan 2009 23:22:29 +0000 (UTC) (envelope-from sales@1stchoiceauctions.net) Received: from eastrmmtao105.cox.net (eastrmmtao105.cox.net [68.230.240.47]) by mx1.freebsd.org (Postfix) with ESMTP id 277E48FC13 for ; Sun, 4 Jan 2009 23:22:28 +0000 (UTC) (envelope-from sales@1stchoiceauctions.net) Received: from eastrmimpo01.cox.net ([68.1.16.119]) by eastrmmtao102.cox.net (InterMail vM.7.08.02.01 201-2186-121-102-20070209) with ESMTP id <20090104230353.TQPR19141.eastrmmtao102.cox.net@eastrmimpo01.cox.net> for ; Sun, 4 Jan 2009 18:03:53 -0500 Received: from 1stChoiceAuctions.net ([68.97.51.139]) by eastrmimpo01.cox.net with bizsmtp id zb3r1a00E30C2Hg02b3rQW; Sun, 04 Jan 2009 18:03:51 -0500 X-Authority-Analysis: v=1.0 c=1 a=gmDKXE9HZq_Rgj_r-GMA:9 a=_vGLV_jue-EPFw4Zv5AA:7 a=rsljgOkItMQqCfehH-a7snNKSigA:4 a=vQkFOG4Ak90A:10 a=AfD3MYMu9mQA:10 X-CM-Score: 0.00 From: Gareth To: Date: Sun, 04 Jan 2009 17:03:53 -0600 X-Mailer: TOL Mailer MIME-Version: 1.0 Content-Type: multipart/mixed; boundary=_0_.__.__TOL__Mailer__Part_Boundary_ Message-Id: <20090104230353.TQPR19141.eastrmmtao102.cox.net@eastrmimpo01.cox.net> X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: Subject: auctions X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 04 Jan 2009 23:22:29 -0000 This is a multi-part message in MIME format. --_0_.__.__TOL__Mailer__Part_Boundary_ Content-Type: multipart/related; boundary=_1_.__.__TOL__Mailer__Part_Boundary_ --_1_.__.__TOL__Mailer__Part_Boundary_ Content-Type: multipart/alternative; boundary=_2_.__.__TOL__Mailer__Part_Boundary_ --_2_.__.__TOL__Mailer__Part_Boundary_ Content-Type: text/plain Content-Transfer-Encoding: 7Bit

Hello,

 

Please feel free to call me with any questions about having an auction.

Thanks

Gareth

Direct line

405-487-7994

--_2_.__.__TOL__Mailer__Part_Boundary_ Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Hello, Please feel free to call me with any questions about having an auction. Thanks Gareth Direct line 405-487-7994 --_2_.__.__TOL__Mailer__Part_Boundary_-- --_1_.__.__TOL__Mailer__Part_Boundary_-- --_0_.__.__TOL__Mailer__Part_Boundary_-- From owner-freebsd-fs@FreeBSD.ORG Mon Jan 5 07:50:13 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C1D961065679 for ; Mon, 5 Jan 2009 07:50:13 +0000 (UTC) (envelope-from jh@saunalahti.fi) Received: from emh03.mail.saunalahti.fi (emh03.mail.saunalahti.fi [62.142.5.109]) by mx1.freebsd.org (Postfix) with ESMTP id 7C1E88FC1F for ; Mon, 5 Jan 2009 07:50:13 +0000 (UTC) (envelope-from jh@saunalahti.fi) Received: from saunalahti-vams (vs3-12.mail.saunalahti.fi [62.142.5.96]) by emh03-2.mail.saunalahti.fi (Postfix) with SMTP id 8CED4EBE8C; Mon, 5 Jan 2009 09:50:12 +0200 (EET) Received: from emh03.mail.saunalahti.fi ([62.142.5.109]) by vs3-12.mail.saunalahti.fi ([62.142.5.96]) with SMTP (gateway) id A01B3B57E34; Mon, 05 Jan 2009 09:50:12 +0200 Received: from a91-153-125-115.elisa-laajakaista.fi (a91-153-125-115.elisa-laajakaista.fi [91.153.125.115]) by emh03.mail.saunalahti.fi (Postfix) with SMTP id 3C1B5158A73; Mon, 5 Jan 2009 09:50:10 +0200 (EET) Date: Mon, 5 Jan 2009 09:50:10 +0200 From: Jaakko Heinonen To: Kostik Belousov Message-ID: <20090105075009.GB7863@a91-153-125-115.elisa-laajakaista.fi> References: <20090103182107.GA4119@a91-153-125-115.elisa-laajakaista.fi> <20090104160043.GI93900@deviant.kiev.zoral.com.ua> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20090104160043.GI93900@deviant.kiev.zoral.com.ua> User-Agent: Mutt/1.5.18 (2008-05-17) X-Antivirus: VAMS Cc: freebsd-fs@freebsd.org Subject: Re: [patch] ext2fs freeze/corruption on amd64 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Jan 2009 07:50:14 -0000 On 2009-01-04, Kostik Belousov wrote: > Please note that find_next_zero_bit() uses gcc extension to perform > void-pointer arithmetic. Also, at the +2 line, it performs unaligned > access to the uint32_t entities. 76 find_next_zero_bit(void *data, size_t sz, size_t ofs) 77 { 78 uint32_t *p; 79 uint32_t mask; 80 int bit; 81 82 p = (uint32_t*)data + (ofs >> 5); Hmmm, I don't think so. Did you notice that the type of p is uint32_t * (line 78) and that data is casted to uint32_t * for pointer arithmetic (line 82)? Thank you for looking at this. -- Jaakko From owner-freebsd-fs@FreeBSD.ORG Mon Jan 5 11:06:51 2009 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CFBB61065672 for ; Mon, 5 Jan 2009 11:06:51 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id BD51D8FC21 for ; Mon, 5 Jan 2009 11:06:51 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.3/8.14.3) with ESMTP id n05B6p8V002776 for ; Mon, 5 Jan 2009 11:06:51 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.3/8.14.3/Submit) id n05B6pFh002772 for freebsd-fs@FreeBSD.org; Mon, 5 Jan 2009 11:06:51 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 5 Jan 2009 11:06:51 GMT Message-Id: <200901051106.n05B6pFh002772@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-fs@FreeBSD.org Cc: Subject: Current problem reports assigned to freebsd-fs@FreeBSD.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Jan 2009 11:06:52 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o bin/130105 fs [zfs] zfs send -R dumps core o kern/129760 fs [nfs] after 'umount -f' of a stale NFS share FreeBSD l o kern/129231 fs [ufs] [patch] New UFS mount (norandom) option - mostly o kern/129174 fs [nfs][zfs][panic] NFS v3 Panic when under high load ex o kern/129152 fs [panic] non-userfriendly panic when trying to mount(8) o kern/129084 fs [udf] [panic] udf panic: getblk: size(67584) > MAXBSIZ f kern/128829 fs smbd(8) causes periodic panic on 7-RELEASE o kern/128633 fs [zfs] [lor] lock order reversal in zfs o kern/128514 fs [zfs] [mpt] problems with ZFS and LSILogic SAS/SATA Ad o kern/128173 fs [ext2fs] ls gives "Input/output error" on mounted ext3 o kern/127420 fs [gjournal] [panic] Journal overflow on gmirrored gjour o kern/127213 fs [tmpfs] sendfile on tmpfs data corruption o kern/127029 fs [panic] mount(8): trying to mount a write protected zi o kern/126287 fs [ufs] [panic] Kernel panics while mounting an UFS file o kern/125536 fs [ext2fs] ext 2 mounts cleanly but fails on commands li o kern/125149 fs [nfs][panic] changing into .zfs dir from nfs client ca o kern/124621 fs [ext3] [patch] Cannot mount ext2fs partition o kern/122888 fs [zfs] zfs hang w/ prefetch on, zil off while running t o bin/122172 fs [fs]: amd(8) automount daemon dies on 6.3-STABLE i386, o bin/121072 fs [smbfs] mount_smbfs(8) cannot normally convert the cha o bin/118249 fs mv(1): moving a directory changes its mtime o kern/116170 fs [panic] Kernel panic when mounting /tmp o kern/114955 fs [cd9660] [patch] [request] support for mask,dirmask,ui o kern/114847 fs [ntfs] [patch] [request] dirmask support for NTFS ala o kern/114676 fs [ufs] snapshot creation panics: snapacct_ufs2: bad blo o bin/114468 fs [patch] [request] add -d option to umount(8) to detach o bin/113838 fs [patch] [request] mount(8): add support for relative p o bin/113049 fs [patch] [request] make quot(8) use getopt(3) and show o kern/112658 fs [smbfs] [patch] smbfs and caching problems (resolves b o kern/93942 fs [vfs] [patch] panic: ufs_dirbad: bad dir (patch from D 30 problems total. From owner-freebsd-fs@FreeBSD.ORG Mon Jan 5 15:52:10 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 07F94106567C for ; Mon, 5 Jan 2009 15:52:10 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from mail.terabit.net.ua (mail.terabit.net.ua [195.137.202.147]) by mx1.freebsd.org (Postfix) with ESMTP id 9F2B68FC17 for ; Mon, 5 Jan 2009 15:52:09 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from skuns.zoral.com.ua ([91.193.166.194] helo=mail.zoral.com.ua) by mail.terabit.net.ua with esmtps (TLSv1:AES256-SHA:256) (Exim 4.63 (FreeBSD)) (envelope-from ) id 1LJrkN-0008YL-CJ; Mon, 05 Jan 2009 17:52:07 +0200 Received: from deviant.kiev.zoral.com.ua (root@deviant.kiev.zoral.com.ua [10.1.1.148]) by mail.zoral.com.ua (8.14.2/8.14.2) with ESMTP id n05Fq33K076409 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Mon, 5 Jan 2009 17:52:04 +0200 (EET) (envelope-from kostikbel@gmail.com) Received: from deviant.kiev.zoral.com.ua (kostik@localhost [127.0.0.1]) by deviant.kiev.zoral.com.ua (8.14.3/8.14.3) with ESMTP id n05Fq3sq002514; Mon, 5 Jan 2009 17:52:03 +0200 (EET) (envelope-from kostikbel@gmail.com) Received: (from kostik@localhost) by deviant.kiev.zoral.com.ua (8.14.3/8.14.3/Submit) id n05Fq3AY002513; Mon, 5 Jan 2009 17:52:03 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: deviant.kiev.zoral.com.ua: kostik set sender to kostikbel@gmail.com using -f Date: Mon, 5 Jan 2009 17:52:03 +0200 From: Kostik Belousov To: Jaakko Heinonen Message-ID: <20090105155203.GN93900@deviant.kiev.zoral.com.ua> References: <20090103182107.GA4119@a91-153-125-115.elisa-laajakaista.fi> <20090104160043.GI93900@deviant.kiev.zoral.com.ua> <20090105075009.GB7863@a91-153-125-115.elisa-laajakaista.fi> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="O27Gs9jTTFWz3gAR" Content-Disposition: inline In-Reply-To: <20090105075009.GB7863@a91-153-125-115.elisa-laajakaista.fi> User-Agent: Mutt/1.4.2.3i X-Virus-Scanned: ClamAV version 0.94.2, clamav-milter version 0.94.2 on skuns.kiev.zoral.com.ua X-Virus-Status: Clean X-Spam-Status: No, score=-4.4 required=5.0 tests=ALL_TRUSTED,AWL,BAYES_00 autolearn=ham version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on skuns.kiev.zoral.com.ua X-Virus-Scanned: mail.terabit.net.ua 1LJrkN-0008YL-CJ 6bbd114bd7f9968d987e6ec4d8a793b9 X-Terabit: YES Cc: freebsd-fs@freebsd.org Subject: Re: [patch] ext2fs freeze/corruption on amd64 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Jan 2009 15:52:10 -0000 --O27Gs9jTTFWz3gAR Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Jan 05, 2009 at 09:50:10AM +0200, Jaakko Heinonen wrote: > On 2009-01-04, Kostik Belousov wrote: > > Please note that find_next_zero_bit() uses gcc extension to perform > > void-pointer arithmetic. Also, at the +2 line, it performs unaligned > > access to the uint32_t entities. >=20 > 76 find_next_zero_bit(void *data, size_t sz, size_t ofs) > 77 { > 78 uint32_t *p; > 79 uint32_t mask; > 80 int bit; > 81=09 > 82 p =3D (uint32_t*)data + (ofs >> 5); >=20 > Hmmm, I don't think so. Did you notice that the type of p is uint32_t * > (line 78) and that data is casted to uint32_t * for pointer arithmetic > (line 82)? You are right, I misparsed that line. --O27Gs9jTTFWz3gAR Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (FreeBSD) iEYEARECAAYFAkliLKIACgkQC3+MBN1Mb4gBPgCglxiskeDah2zy8lhzDftT70iB SS4Anii+3c4sfCZovsTNXaPpcCpDFv3Z =dYg8 -----END PGP SIGNATURE----- --O27Gs9jTTFWz3gAR-- From owner-freebsd-fs@FreeBSD.ORG Mon Jan 5 20:46:31 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 00D60106567B for ; Mon, 5 Jan 2009 20:46:31 +0000 (UTC) (envelope-from kgysmits@gmail.com) Received: from mail-bw0-f19.google.com (mail-bw0-f19.google.com [209.85.218.19]) by mx1.freebsd.org (Postfix) with ESMTP id 4149C8FC16 for ; Mon, 5 Jan 2009 20:46:29 +0000 (UTC) (envelope-from kgysmits@gmail.com) Received: by bwz12 with SMTP id 12so20521136bwz.19 for ; Mon, 05 Jan 2009 12:46:28 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:mime-version:content-type; bh=3vhsbtUTprLMPhDTLHvBk6uno7kHpdTQJ/V1MqvrSF4=; b=tgXxbvDp5e20D+3ufzEoDiJoXoU3abLiec2JSzxhr9uENgFn7Dm5wtW3ggIho599lY hx3gI0b2w2AaJfZM05SnDW1ZnwA/fM2339maVRktO7XV6xGCHfH/VNk+ITkz6e+O3U7Y iDLQTWIH+XUAnWDRhJ2fWTAMaqF2curgOoZ2c= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type; b=iul3Gzk9SGoH6p8aJlHCtSQIinOlBmRdfSKhRFFoRjw/ShDTYqn2o7xxZlHUghdenS dHx1snfyuolFup3icsfv/BKGvtDmICLtykSVhuJeDY7/dmNL4t5bDJtPEvL7VK3HXJnl 9DxGX/M7yz0GJUY3SC3M5/6R3ziTbuWU/38ZQ= Received: by 10.223.114.79 with SMTP id d15mr14892592faq.88.1231186892592; Mon, 05 Jan 2009 12:21:32 -0800 (PST) Received: by 10.223.108.136 with HTTP; Mon, 5 Jan 2009 12:21:32 -0800 (PST) Message-ID: Date: Mon, 5 Jan 2009 21:21:32 +0100 From: "Koen Smits" To: freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: FreeBSD, SSD's and partition alignment X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Jan 2009 20:46:31 -0000 Hello all, I'm building a new NAS for home use and want to use a CompactFlash card for initial boot, ZFS for the rest. While doing some research on Flash based media performance, i stumbled on the following. Flash based media uses cells which are very often bigger than the usual HDD 512 Byte sector. When you change even one bit in a cell, you have to read, modify, write the whole cell. Just like with RAID5. When using the normal MBR disk layout one could easily mess up the fs alignment when starting the first primary partition on the default 63th sector. In this situation, when a fs block occupies a part of two flash cells, and both have to be read and written. This is bad for performance and for flash cell wear. On almost all flash based media (and also many RAID controllers) performance suffers greatly if the fs blocks are misaligned with the media stripe/cells. Some CF cards for example compensate internally for this by starting the second cell on sector #63, but this is not common practice and standards don't exist. Some SSD's like the OCZ Core series and other jMicron JMF602 based SSD's don't like misaligned writes and choke up because writes not aligned to the flash cells ups the write time latency. In my limited testing I created an MBR partition layout on a Kingston Ultimate 266x 2GB CF card, using a starting sector of 2048 instead of the default 63. I accomplished this by using the free MS Vista recovery disk, as Vista and Win2008 Server use a default alignment of 1MB when creating a new primary partition. There really doesn't seem to be a lot of tools out there that can create and/or resize a partition while allowing you to set the starting sector exactly. I must admit I used the first solution that worked though. When installing i changed the partition type and added the default BootMgr, installed, etc. fdisk warned about the partition not starting on a cylinder boundary, this was to be expected. Upon rebooting after finishing the install, the FreeBSD BootMgr fails to boot and beeps when trying. Looks like a problem. I'd like to discuss this subject a bit if anyone's interested. - partition alignment seems to be a real problem with some of today's flash and RAID media. I think people need to know one could easily increase performance (and media wear!) as no one knows this problem exists. - Is GPT the only supported way of creating correctly aligned partitions? - Did I make any mistakes in the above example? I've had to read a lot about the low-level layout of storage media and it could be I messed something up. - Should FreeBSD offer the option of aligned partitions in sysinstall, or offer (easy) GPT partitioning? Some reading material for the interested: http://blogs.msdn.com/jimmymay/archive/2008/10/14/disk-partition-alignment-for-sql-server-slide-deck.aspx Also check out the link to the presentation. Sincerely, Koen From owner-freebsd-fs@FreeBSD.ORG Tue Jan 6 00:12:21 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C2DEA106567A for ; Tue, 6 Jan 2009 00:12:21 +0000 (UTC) (envelope-from andrew@modulus.org) Received: from email.octopus.com.au (email.octopus.com.au [122.100.2.232]) by mx1.freebsd.org (Postfix) with ESMTP id 827338FC0C for ; Tue, 6 Jan 2009 00:12:21 +0000 (UTC) (envelope-from andrew@modulus.org) Received: by email.octopus.com.au (Postfix, from userid 1002) id 98A5517D9C; Tue, 6 Jan 2009 11:12:19 +1100 (EST) X-Spam-Checker-Version: SpamAssassin 3.2.3 (2007-08-08) on email.octopus.com.au X-Spam-Level: X-Spam-Status: No, score=-1.0 required=10.0 tests=ALL_TRUSTED, SUBJECT_FUZZY_TION autolearn=no version=3.2.3 Received: from [10.1.50.60] (ppp121-44-0-132.lns10.syd7.internode.on.net [121.44.0.132]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: admin@email.octopus.com.au) by email.octopus.com.au (Postfix) with ESMTP id 8AAC617231; Tue, 6 Jan 2009 11:12:15 +1100 (EST) Message-ID: <4962A1D6.4040508@modulus.org> Date: Tue, 06 Jan 2009 11:12:06 +1100 From: Andrew Snow User-Agent: Thunderbird 2.0.0.14 (X11/20080523) MIME-Version: 1.0 To: Koen Smits References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-fs@freebsd.org Subject: Re: FreeBSD, SSD's and partition alignment X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Jan 2009 00:12:22 -0000 > I'd like to discuss this subject a bit if anyone's interested. > - partition alignment seems to be a real problem with some of today's flash > and RAID media. I think people need to know one could easily increase > performance (and media wear!) as no one knows this problem exists. Thanks for your interesting post! In my humble opinion, FreeBSD should not worry about this problem for the following reasons: 1. Performance for random write I/O still sucks even when the sector boundary is correct. Doing something like untarring src or ports causes many small write I/Os, and it is simply a shortcoming of early generation flash controller technology that they erase and rewrite in large blocks. 2. This problem will go away when flash controller technology improves. Intel SSDs have already demonstrated they can have great performance *and* a small erase block size, mitigating the issue completely. This technology will trickle down to the cheaper flash SSDs over time. - Andrew From owner-freebsd-fs@FreeBSD.ORG Tue Jan 6 09:15:32 2009 Return-Path: Delivered-To: freebsd-fs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E8191106564A; Tue, 6 Jan 2009 09:15:32 +0000 (UTC) (envelope-from remko@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id C02DE8FC1C; Tue, 6 Jan 2009 09:15:32 +0000 (UTC) (envelope-from remko@FreeBSD.org) Received: from freefall.freebsd.org (remko@localhost [127.0.0.1]) by freefall.freebsd.org (8.14.3/8.14.3) with ESMTP id n069FWDl040042; Tue, 6 Jan 2009 09:15:32 GMT (envelope-from remko@freefall.freebsd.org) Received: (from remko@localhost) by freefall.freebsd.org (8.14.3/8.14.3/Submit) id n069FWrV040038; Tue, 6 Jan 2009 09:15:32 GMT (envelope-from remko) Date: Tue, 6 Jan 2009 09:15:32 GMT Message-Id: <200901060915.n069FWrV040038@freefall.freebsd.org> To: remko@FreeBSD.org, freebsd-i386@FreeBSD.org, freebsd-fs@FreeBSD.org From: remko@FreeBSD.org Cc: Subject: Re: i386/130210: Error by check nullfs X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Jan 2009 09:15:33 -0000 Synopsis: Error by check nullfs Responsible-Changed-From-To: freebsd-i386->freebsd-fs Responsible-Changed-By: remko Responsible-Changed-When: Tue Jan 6 09:15:32 UTC 2009 Responsible-Changed-Why: This feels like an user question, reassign to -fs tea http://www.freebsd.org/cgi/query-pr.cgi?pr=130210 From owner-freebsd-fs@FreeBSD.ORG Tue Jan 6 15:05:44 2009 Return-Path: Delivered-To: freebsd-fs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 80BB0106567E; Tue, 6 Jan 2009 15:05:44 +0000 (UTC) (envelope-from remko@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 56DF88FC16; Tue, 6 Jan 2009 15:05:44 +0000 (UTC) (envelope-from remko@FreeBSD.org) Received: from freefall.freebsd.org (remko@localhost [127.0.0.1]) by freefall.freebsd.org (8.14.3/8.14.3) with ESMTP id n06F5iVc000397; Tue, 6 Jan 2009 15:05:44 GMT (envelope-from remko@freefall.freebsd.org) Received: (from remko@localhost) by freefall.freebsd.org (8.14.3/8.14.3/Submit) id n06F5iuC000393; Tue, 6 Jan 2009 15:05:44 GMT (envelope-from remko) Date: Tue, 6 Jan 2009 15:05:44 GMT Message-Id: <200901061505.n06F5iuC000393@freefall.freebsd.org> To: remko@FreeBSD.org, freebsd-bugs@FreeBSD.org, freebsd-fs@FreeBSD.org From: remko@FreeBSD.org Cc: Subject: Re: kern/130229: usermount fails on fs that need iconv X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Jan 2009 15:05:45 -0000 Synopsis: usermount fails on fs that need iconv Responsible-Changed-From-To: freebsd-bugs->freebsd-fs Responsible-Changed-By: remko Responsible-Changed-When: Tue Jan 6 15:05:43 UTC 2009 Responsible-Changed-Why: Over to maintainer. http://www.freebsd.org/cgi/query-pr.cgi?pr=130229 From owner-freebsd-fs@FreeBSD.ORG Tue Jan 6 17:20:05 2009 Return-Path: Delivered-To: freebsd-fs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 64F9B106564A for ; Tue, 6 Jan 2009 17:20:05 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 3A5278FC13 for ; Tue, 6 Jan 2009 17:20:05 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (gnats@localhost [127.0.0.1]) by freefall.freebsd.org (8.14.3/8.14.3) with ESMTP id n06HK5MP098812 for ; Tue, 6 Jan 2009 17:20:05 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.3/8.14.3/Submit) id n06HK5lQ098805; Tue, 6 Jan 2009 17:20:05 GMT (envelope-from gnats) Date: Tue, 6 Jan 2009 17:20:05 GMT Message-Id: <200901061720.n06HK5lQ098805@freefall.freebsd.org> To: freebsd-fs@FreeBSD.org From: "Garrett Cooper" Cc: Subject: Re: kern/130229: usermount fails on fs that need iconv X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Garrett Cooper List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Jan 2009 17:20:05 -0000 The following reply was made to PR kern/130229; it has been noted by GNATS. From: "Garrett Cooper" To: "Artyom Zuikov" <4ertus2@mail.ru> Cc: freebsd-gnats-submit@freebsd.org Subject: Re: kern/130229: usermount fails on fs that need iconv Date: Tue, 6 Jan 2009 09:14:55 -0800 sysctl -n vfs.usermount says? Thanks, -Garrett From owner-freebsd-fs@FreeBSD.ORG Tue Jan 6 20:50:04 2009 Return-Path: Delivered-To: freebsd-fs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 29998106566C for ; Tue, 6 Jan 2009 20:50:04 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id BB9198FC12 for ; Tue, 6 Jan 2009 20:50:03 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (gnats@localhost [127.0.0.1]) by freefall.freebsd.org (8.14.3/8.14.3) with ESMTP id n06Ko30C056839 for ; Tue, 6 Jan 2009 20:50:03 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.3/8.14.3/Submit) id n06Ko34x056838; Tue, 6 Jan 2009 20:50:03 GMT (envelope-from gnats) Date: Tue, 6 Jan 2009 20:50:03 GMT Message-Id: <200901062050.n06Ko34x056838@freefall.freebsd.org> To: freebsd-fs@FreeBSD.org From: Maxim Konovalov Cc: Subject: Re: kern/130229: usermount fails on fs that need iconv X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Maxim Konovalov List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Jan 2009 20:50:05 -0000 The following reply was made to PR kern/130229; it has been noted by GNATS. From: Maxim Konovalov To: Garrett Cooper Cc: bug-followup@freebsd.org Subject: Re: kern/130229: usermount fails on fs that need iconv Date: Tue, 6 Jan 2009 23:44:30 +0300 (MSK) > sysctl -n vfs.usermount says? That's about wellknown problem with the usermount -- *iconv.ko modules won't be loaded by non-root user. -- Maxim Konovalov From owner-freebsd-fs@FreeBSD.ORG Wed Jan 7 02:40:05 2009 Return-Path: Delivered-To: freebsd-fs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 83FFA1065675 for ; Wed, 7 Jan 2009 02:40:05 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 592998FC2C for ; Wed, 7 Jan 2009 02:40:05 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (gnats@localhost [127.0.0.1]) by freefall.freebsd.org (8.14.3/8.14.3) with ESMTP id n072e572025782 for ; Wed, 7 Jan 2009 02:40:05 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.3/8.14.3/Submit) id n072e5k3025781; Wed, 7 Jan 2009 02:40:05 GMT (envelope-from gnats) Date: Wed, 7 Jan 2009 02:40:05 GMT Message-Id: <200901070240.n072e5k3025781@freefall.freebsd.org> To: freebsd-fs@FreeBSD.org From: 4ertus2 <4ertus2@mail.ru> Cc: Subject: Re: kern/130229: usermount fails on fs that need iconv X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: 4ertus2 <4ertus2@mail.ru> List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Jan 2009 02:40:05 -0000 The following reply was made to PR kern/130229; it has been noted by GNATS. From: 4ertus2 <4ertus2@mail.ru> To: "Garrett Cooper" Cc: freebsd-gnats-submit@freebsd.org Subject: Re: kern/130229: usermount fails on fs that need iconv Date: Wed, 7 Jan 2009 04:59:01 +0300 > sysctl -n vfs.usermount says? ~> sysctl -n vfs.usermount 1 The problem looks like FreeBSD tryes to load *iconv modules the first time I mount filesystem, but user have't permitions for this operation. In this case kldload should have an option to load modules immediately. From owner-freebsd-fs@FreeBSD.ORG Wed Jan 7 03:20:03 2009 Return-Path: Delivered-To: freebsd-fs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E75951065672 for ; Wed, 7 Jan 2009 03:20:03 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id BA3BA8FC24 for ; Wed, 7 Jan 2009 03:20:03 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (gnats@localhost [127.0.0.1]) by freefall.freebsd.org (8.14.3/8.14.3) with ESMTP id n073K3gv055302 for ; Wed, 7 Jan 2009 03:20:03 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.3/8.14.3/Submit) id n073K3di055301; Wed, 7 Jan 2009 03:20:03 GMT (envelope-from gnats) Date: Wed, 7 Jan 2009 03:20:03 GMT Message-Id: <200901070320.n073K3di055301@freefall.freebsd.org> To: freebsd-fs@FreeBSD.org From: Mateusz Guzik Cc: Subject: Re: kern/130229: [iconv] usermount fails on fs that need iconv X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Mateusz Guzik List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Jan 2009 03:20:04 -0000 The following reply was made to PR kern/130229; it has been noted by GNATS. From: Mateusz Guzik To: bug-followup@freebsd.org Cc: Subject: Re: kern/130229: [iconv] usermount fails on fs that need iconv Date: Wed, 7 Jan 2009 04:10:39 +0100 Hi, this is a duplicate of kern/109024. As described, mount_msdosfs calls kiconv_add_xlat16_cspairs and it fails. While mounting using root credentials, kiconv_add_xlat16_cspairs is successfull and that's why after mount/umount it works fine for non-root users. bin/93857 contains possible fix. Thanks, -- Mateusz Guzik From owner-freebsd-fs@FreeBSD.ORG Wed Jan 7 12:54:52 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CF569106566B for ; Wed, 7 Jan 2009 12:54:52 +0000 (UTC) (envelope-from kgysmits@gmail.com) Received: from mail-fx0-f11.google.com (mail-fx0-f11.google.com [209.85.220.11]) by mx1.freebsd.org (Postfix) with ESMTP id 35DED8FC17 for ; Wed, 7 Jan 2009 12:54:52 +0000 (UTC) (envelope-from kgysmits@gmail.com) Received: by fxm4 with SMTP id 4so1537629fxm.19 for ; Wed, 07 Jan 2009 04:54:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type:references; bh=ZuSRrQYdjrmwTE5ydkKPJCBPi7Hyy8nd5MeL8UBSsn4=; b=aXDDVsX61P1kbgzWsw0fyadQNOlfg84q/jSWf+k1zQ7S6DOfPFPbCyZtGcN9GnaWRI v7c+lBCll7eI6kd2p8IhApAE0xgJglAAj0ZiFlDbE3nbgc/7+LCTnoUaLsswf+6ZxaeJ 8xO1RznI2KyzizguDg8+vqD5DhbHgI8r+4KXM= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:references; b=s5EVIaArqrmeK/igJMkxeIMNiaByI9nWS6sWr92Swc8Oo6OoWrkNAQh7FCkdhIu+L5 iyvXAOyxeRcwh0JmQY26LVzw4qDUDdw3sqzzaGI3v9HPbM/pXxnDWfFpa08PO5yTq60L vhzs8DB1xSh+TUZ2ScSA3gohgfC2yhMU72Z9Y= Received: by 10.223.104.68 with SMTP id n4mr16415813fao.4.1231332891155; Wed, 07 Jan 2009 04:54:51 -0800 (PST) Received: by 10.223.108.136 with HTTP; Wed, 7 Jan 2009 04:54:50 -0800 (PST) Message-ID: Date: Wed, 7 Jan 2009 13:54:50 +0100 From: "Koen Smits" To: "Andrew Snow" In-Reply-To: <4962A1D6.4040508@modulus.org> MIME-Version: 1.0 References: <4962A1D6.4040508@modulus.org> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-fs@freebsd.org Subject: Re: FreeBSD, SSD's and partition alignment X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Jan 2009 12:54:53 -0000 On Tue, Jan 6, 2009 at 01:12, Andrew Snow wrote: > I'd like to discuss this subject a bit if anyone's interested. >> - partition alignment seems to be a real problem with some of today's >> flash >> and RAID media. I think people need to know one could easily increase >> performance (and media wear!) as no one knows this problem exists. >> > > Thanks for your interesting post! > > In my humble opinion, FreeBSD should not worry about this problem for the > following reasons: > > 1. Performance for random write I/O still sucks even when the sector > boundary is correct. Doing something like untarring src or ports causes > many small write I/Os, and it is simply a shortcoming of early generation > flash controller technology that they erase and rewrite in large blocks. > > 2. This problem will go away when flash controller technology improves. > Intel SSDs have already demonstrated they can have great performance *and* > a small erase block size, mitigating the issue completely. This technology > will trickle down to the cheaper flash SSDs over time. > > > - Andrew > Sorry for the late reply. I've been busy. I agree with point 1, if the controller is able to 'save up' small writes and write this sequentially without making a mess out of it, this is preferred. We will never completely remove the 'virtual layers' between the OS and the storage medium itself and that is fine. point 2 however, i disagree. It's time we dump the whole track/cylinder/head thing. Even back in 1984 this was already outdated, lets just throw it overboard! Let's assume that from FreeBSD 8 and onward, we just use GPT and a partition offset of 1MB by default. Everybody would benefit, and no-one would really have any problems with it, right? We would all benefit in my opinion. Note that even the Intel X25-M series seem to slow down in random write speed when the complete disk is filled and there are no cells left that the controller knows are free. Most benchmarks out there are run on an empty Intel SSD. When you rerun that test several times, it'll slowly settle on a much lower random write speed. From owner-freebsd-fs@FreeBSD.ORG Wed Jan 7 23:28:15 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4C470106564A for ; Wed, 7 Jan 2009 23:28:15 +0000 (UTC) (envelope-from andrew@modulus.org) Received: from email.octopus.com.au (email.octopus.com.au [122.100.2.232]) by mx1.freebsd.org (Postfix) with ESMTP id 0CDBC8FC0A for ; Wed, 7 Jan 2009 23:28:14 +0000 (UTC) (envelope-from andrew@modulus.org) Received: by email.octopus.com.au (Postfix, from userid 1002) id 2F92117D1C; Thu, 8 Jan 2009 10:28:14 +1100 (EST) X-Spam-Checker-Version: SpamAssassin 3.2.3 (2007-08-08) on email.octopus.com.au X-Spam-Level: X-Spam-Status: No, score=-1.4 required=10.0 tests=ALL_TRUSTED autolearn=failed version=3.2.3 Received: from [10.1.50.60] (ppp121-44-0-132.lns10.syd7.internode.on.net [121.44.0.132]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: admin@email.octopus.com.au) by email.octopus.com.au (Postfix) with ESMTP id 14A83172D8; Thu, 8 Jan 2009 10:28:10 +1100 (EST) Message-ID: <49653A7D.30906@modulus.org> Date: Thu, 08 Jan 2009 10:27:57 +1100 From: Andrew Snow User-Agent: Thunderbird 2.0.0.14 (X11/20080523) MIME-Version: 1.0 To: Danny Braniss References: <6c1e076a0901070247l7c006efajda8fddee84c337a@mail.gmail.com> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-fs@freebsd.org, freebsd-scsi@freebsd.org Subject: Re: iscsi client hangs performing I/O on a dead target X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Jan 2009 23:28:15 -0000 Danny Braniss wrote: > freebsd likes to > panic if a disc goes away, so don't hold your breath for a solution soon. You hit the nail on the head. This is going to be a increasingly bad problem as we continue pushing in this of networked storage. It would be REALLY nice, if an I/O fails, to simply have the process attempting the I/O to be killed, instead of bringing the machine to its knees and locking up or panic the kernel. - Andrew From owner-freebsd-fs@FreeBSD.ORG Thu Jan 8 01:11:02 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4D5E1106564A; Thu, 8 Jan 2009 01:11:02 +0000 (UTC) (envelope-from fbsd@dannysplace.net) Received: from mail.dannysplace.net (mail.dannysplace.net [213.133.54.210]) by mx1.freebsd.org (Postfix) with ESMTP id F00678FC1B; Thu, 8 Jan 2009 01:11:01 +0000 (UTC) (envelope-from fbsd@dannysplace.net) Received: from 203-206-171-212.perm.iinet.net.au ([203.206.171.212] helo=[192.168.10.10]) by mail.dannysplace.net with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.69 (FreeBSD)) (envelope-from ) id 1LKiqN-000LWW-Me; Thu, 08 Jan 2009 10:34:09 +1000 Message-ID: <496549D9.7010003@dannysplace.net> Date: Thu, 08 Jan 2009 10:33:29 +1000 From: Danny Carroll User-Agent: Thunderbird 2.0.0.19 (Windows/20081209) MIME-Version: 1.0 To: Jeremy Chadwick References: <20081031033208.GA21220@icarus.home.lan> <490A849C.7030009@dannysplace.net> <20081031043412.GA22289@icarus.home.lan> <490A8FAD.8060009@dannysplace.net> <491BBF38.9010908@dannysplace.net> <491C5AA7.1030004@samsco.org> <491C9535.3030504@dannysplace.net> <4920E1DD.7000101@dannysplace.net> <20081117070818.GA22231@icarus.home.lan> In-Reply-To: <20081117070818.GA22231@icarus.home.lan> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Authenticated-User: danny X-Authenticator: plain X-Sender-Verify: SUCCEEDED (sender exists & accepts mail) X-Exim-Version: 4.69 (build at 08-Jul-2008 08:59:40) X-Date: 2009-01-08 10:33:52 X-Connected-IP: 203.206.171.212:1690 X-Message-Linecount: 80 X-Body-Linecount: 66 X-Message-Size: 3713 X-Body-Size: 2768 X-Received-Count: 1 X-Recipient-Count: 3 X-Local-Recipient-Count: 3 X-Local-Recipient-Defer-Count: 0 X-Local-Recipient-Fail-Count: 0 X-SA-Exim-Connect-IP: 203.206.171.212 X-SA-Exim-Rcpt-To: koitsu@FreeBSD.org, freebsd-fs@freebsd.org, freebsd-hardware@freebsd.org X-SA-Exim-Mail-From: fbsd@dannysplace.net X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on ferrari.dannysplace.net X-Spam-Level: X-Spam-Status: No, score=0.2 required=8.0 tests=ALL_TRUSTED,TVD_RCVD_IP autolearn=disabled version=3.2.5 X-SA-Exim-Version: 4.2 X-SA-Exim-Scanned: Yes (on mail.dannysplace.net) Cc: freebsd-fs@freebsd.org, freebsd-hardware@freebsd.org Subject: Re: Areca vs. ZFS performance testing. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: fbsd@dannysplace.net List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 08 Jan 2009 01:11:02 -0000 I'd like to post some results of what I have found with my tests. I did a few different types of tests. Basically a set of 5-disk tests and a set of 12-disk tests. I did this because I only had 5 ports available on my onboard controller and I wanted to see how the areca compared to that. I also wanted to see comparisons between JBOD, Passthru and hardware raid5. I have not tested raid6 or raidz2. You can see the results here: http://www.dannysplace.net/quickweb/filesystem%20tests.htm An explanation of each of the tests: ICH9_ZFS 5 disk zfs raidz test with onboard SATA ports. ARECAJBOD_ZFS 5 disk zfs raidz test with Areca SATA ports configured in JBOD mode. ARECAJBOD_ZFS_NoWriteCache 5 disk zfs raidz test with Areca SATA ports configured in JBOD mode and with disk caches disabled. ARECARAID 5 disk zfs single-disk test with Areca raid5 array. ARECAPASSTHRU 5 disk zfs raidz test with Areca SATA ports configured in Passthru mode. This means that the onboard areca cache is active. ARECARAID-UFS2 5 disk ufs2 single-disk test with Areca raid5 array. ARECARAID-BIG 12 disk zfs single-disk test with Areca raid5 array. ARECAPASSTHRU_12 12 disk zfs raidz test with Areca SATA ports configured in Passthru mode. This means that the onboard areca cache is active. I'll probably be opting for the ARECAPASSTHRU_12 configuration. Mainly because I do not need amazing read speeds (network port would be saturated anyway) and I think that the raidz implementation would be more fault tolerant. By that I mean if you have a disk read error during a rebuild then as I understand it, raidz will write off that block (and hopefully tell me about dead files) but continue with the rest of the rebuild. This is something I'd love to test for real, just to see what happens. But I am not sure how I could do that. Perhaps removing one drive, then a few random writes to a remaining disk (or two) and seeing how it goes with a rebuild. Something else worth mentioning. When I converted from JBOD to passthrough, I was able to re-import the disks without any problems. This must mean that the areca passthrough option does not alter the disk much, perhaps not at all. After a 21 hour rebuild I have to say I am not that keen to do more of these tests, but if there is something someone wants to see, then I'll definitely consider it. One thing I am at a loss to understand is why turning off the disk caches when testing the JBOD performance produced almost identical (very slightly better) results. Perhaps it was a case of the ZFS internal cache making the disks cache redundant? Comparing to the ARECA passthrough (where the areca cache is used) shows again, similar results. -D From owner-freebsd-fs@FreeBSD.ORG Thu Jan 8 07:40:38 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E742B1065670 for ; Thu, 8 Jan 2009 07:40:37 +0000 (UTC) (envelope-from zbeeble@gmail.com) Received: from yw-out-2324.google.com (yw-out-2324.google.com [74.125.46.28]) by mx1.freebsd.org (Postfix) with ESMTP id 889258FC26 for ; Thu, 8 Jan 2009 07:40:37 +0000 (UTC) (envelope-from zbeeble@gmail.com) Received: by yw-out-2324.google.com with SMTP id 9so3732675ywe.13 for ; Wed, 07 Jan 2009 23:40:37 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type:references; bh=a+An8lw3ZcZx8cmBCEOL95JBKIi1YrVNB723Yfk9myo=; b=Cs0LaCYMu4ht3E5nVFFX4OJBMgGihBVooHp0n7Ile2mewQ8Nbut/dDMQnZtOK/2L8K TTc7gj6IxZt8i4LaDOIux/GXedhrmFM6TG4O5P14q0DTXR6AetzCE1JBMrkUgKf442GS 10pcYtV/G1WhI4naJf17OBL1IrMqew6s1r2nY= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:references; b=l9eNGqqIQ1ZQvP+U0XAOdAHgkR5ZhT6erRPNb2QXuCbTaJjNGiq2MMWlV1qcaoLDCl 5wKs0uPRuxBQRmqppvlVYZFhHm3JIB4gQ6RPnN9psTFX7YTmHd/jtw68zON98Mm1AziQ roSwkL0ErIMSiYw4w0JqOgT1Yv+rddw7HpCm0= Received: by 10.150.177.20 with SMTP id z20mr1497817ybe.89.1231400436677; Wed, 07 Jan 2009 23:40:36 -0800 (PST) Received: by 10.151.132.5 with HTTP; Wed, 7 Jan 2009 23:40:36 -0800 (PST) Message-ID: <5f67a8c40901072340u1dd514b4x21506d4ca491ff6d@mail.gmail.com> Date: Thu, 8 Jan 2009 02:40:36 -0500 From: "Zaphod Beeblebrox" To: fbsd@dannysplace.net In-Reply-To: <496549D9.7010003@dannysplace.net> MIME-Version: 1.0 References: <20081031033208.GA21220@icarus.home.lan> <490A8FAD.8060009@dannysplace.net> <491BBF38.9010908@dannysplace.net> <491C5AA7.1030004@samsco.org> <491C9535.3030504@dannysplace.net> <4920E1DD.7000101@dannysplace.net> <20081117070818.GA22231@icarus.home.lan> <496549D9.7010003@dannysplace.net> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-fs@freebsd.org, Jeremy Chadwick , freebsd-hardware@freebsd.org Subject: Re: Areca vs. ZFS performance testing. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 08 Jan 2009 07:40:38 -0000 On Wed, Jan 7, 2009 at 7:33 PM, Danny Carroll wrote: > I'd like to post some results of what I have found with my tests. > I did a few different types of tests. Basically a set of 5-disk tests > and a set of 12-disk tests. > > I did this because I only had 5 ports available on my onboard controller > and I wanted to see how the areca compared to that. I also wanted to > see comparisons between JBOD, Passthru and hardware raid5. > > I have not tested raid6 or raidz2. > > You can see the results here: > http://www.dannysplace.net/quickweb/filesystem%20tests.htm > ... been a long time since I've seen someone link stuff on this list that won't shot in Firefox. Pretty sad that it's just a table of values that would be just as well presented as text. From owner-freebsd-fs@FreeBSD.ORG Thu Jan 8 07:48:36 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 381111065670 for ; Thu, 8 Jan 2009 07:48:36 +0000 (UTC) (envelope-from kgysmits@gmail.com) Received: from mail-bw0-f20.google.com (mail-bw0-f20.google.com [209.85.218.20]) by mx1.freebsd.org (Postfix) with ESMTP id 526588FC13 for ; Thu, 8 Jan 2009 07:48:34 +0000 (UTC) (envelope-from kgysmits@gmail.com) Received: by bwz13 with SMTP id 13so334197bwz.19 for ; Wed, 07 Jan 2009 23:48:34 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type:references; bh=47Cgxh67xr351wKdymHuwkVoxum4jzShpVAQkq8YnbI=; b=hD0AuexoGEirHbdGS3DrNXb9VgSMVif9ehuxsygzLCZQxysh02nFhhv9V1LWwRa/mE LKBjTXJdzv2++AUkTMVzG0synsxvXw6vpB7ktlTO4asqEwCGb2JQut49cV2N11ez91mY t9yc6e/Vrm6KAdBTX0FniZzICpvADa0uxvUhQ= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:references; b=pF3YSpgyUdnVpm8pcLz1L8G7JMVKy/xtzpwNsEs57gXa12c62sukUCU7grOweq+SHA +DrsehtaGQTxd7CMByCSuA0j1hfgxLXrWZGxvs4GoEK5SGMlbCrEjbwQXHA0V1hm8YeU v2OOU7LyLWl5enbFr1OdKRhtSQgXp+eHNpOn4= Received: by 10.223.114.68 with SMTP id d4mr17236566faq.86.1231400913955; Wed, 07 Jan 2009 23:48:33 -0800 (PST) Received: by 10.223.108.136 with HTTP; Wed, 7 Jan 2009 23:48:33 -0800 (PST) Message-ID: Date: Thu, 8 Jan 2009 08:48:33 +0100 From: "Koen Smits" To: fbsd@dannysplace.net In-Reply-To: <496549D9.7010003@dannysplace.net> MIME-Version: 1.0 References: <20081031033208.GA21220@icarus.home.lan> <490A8FAD.8060009@dannysplace.net> <491BBF38.9010908@dannysplace.net> <491C5AA7.1030004@samsco.org> <491C9535.3030504@dannysplace.net> <4920E1DD.7000101@dannysplace.net> <20081117070818.GA22231@icarus.home.lan> <496549D9.7010003@dannysplace.net> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-fs@freebsd.org, Jeremy Chadwick , freebsd-hardware@freebsd.org Subject: Re: Areca vs. ZFS performance testing. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 08 Jan 2009 07:48:37 -0000 > One thing I am at a loss to understand is why turning off the disk > caches when testing the JBOD performance produced almost identical (very > slightly better) results. Perhaps it was a case of the ZFS internal > cache making the disks cache redundant? Comparing to the ARECA > passthrough (where the areca cache is used) shows again, similar results. > > -D > _______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" My guess is it probably has to do with the way ZFS does cache flushes: http://www.solarisinternals.com/wiki/index.php/ZFS_Evil_Tuning_Guide#Cache_Flushes It might be worth it to disable the forced flushing and test again, if you feel like it. -Koen From owner-freebsd-fs@FreeBSD.ORG Thu Jan 8 09:37:54 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7C7EF106564A; Thu, 8 Jan 2009 09:37:53 +0000 (UTC) (envelope-from peterjeremy@optushome.com.au) Received: from fallbackmx08.syd.optusnet.com.au (fallbackmx08.syd.optusnet.com.au [211.29.132.10]) by mx1.freebsd.org (Postfix) with ESMTP id D8A998FC23; Thu, 8 Jan 2009 09:36:08 +0000 (UTC) (envelope-from peterjeremy@optushome.com.au) Received: from mail17.syd.optusnet.com.au (mail17.syd.optusnet.com.au [211.29.132.198]) by fallbackmx08.syd.optusnet.com.au (8.13.1/8.13.1) with ESMTP id n087HreT018567; Thu, 8 Jan 2009 18:17:53 +1100 Received: from server.vk2pj.dyndns.org (c122-106-215-175.belrs3.nsw.optusnet.com.au [122.106.215.175]) by mail17.syd.optusnet.com.au (8.13.1/8.13.1) with ESMTP id n087HoAS004649 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 8 Jan 2009 18:17:51 +1100 X-Bogosity: Ham, spamicity=0.000000 Received: from server.vk2pj.dyndns.org (localhost.vk2pj.dyndns.org [127.0.0.1]) by server.vk2pj.dyndns.org (8.14.3/8.14.3) with ESMTP id n087Hofv057629; Thu, 8 Jan 2009 18:17:50 +1100 (EST) (envelope-from peter@server.vk2pj.dyndns.org) Received: (from peter@localhost) by server.vk2pj.dyndns.org (8.14.3/8.14.3/Submit) id n087HnBw057628; Thu, 8 Jan 2009 18:17:49 +1100 (EST) (envelope-from peter) Date: Thu, 8 Jan 2009 18:17:49 +1100 From: Peter Jeremy To: Andrew Snow Message-ID: <20090108071749.GM87057@server.vk2pj.dyndns.org> References: <6c1e076a0901070247l7c006efajda8fddee84c337a@mail.gmail.com> <49653A7D.30906@modulus.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="p7qwJlK53pWzbayA" Content-Disposition: inline In-Reply-To: <49653A7D.30906@modulus.org> X-PGP-Key: http://members.optusnet.com.au/peterjeremy/pubkey.asc User-Agent: Mutt/1.5.18 (2008-05-17) Cc: freebsd-fs@freebsd.org, freebsd-scsi@freebsd.org Subject: Re: iscsi client hangs performing I/O on a dead target X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 08 Jan 2009 09:37:54 -0000 --p7qwJlK53pWzbayA Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 2009-Jan-08 10:27:57 +1100, Andrew Snow wrote: >It would be REALLY nice, if an I/O fails, to simply have the process=20 >attempting the I/O to be killed, instead of bringing the machine to its=20 >knees and locking up or panic the kernel. And if it was that easy, it would have been done about a decade ago. --=20 Peter Jeremy Please excuse any delays as the result of my ISP's inability to implement an MTA that is either RFC2821-compliant or matches their claimed behaviour. --p7qwJlK53pWzbayA Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (FreeBSD) iEYEARECAAYFAkllqJ0ACgkQ/opHv/APuIf2xACfcDeN/QQNyVPTS5Y8wiQGpnEX cGMAnA8baEtNGyTZOGaaq5Qo5ecuQsH3 =fMRS -----END PGP SIGNATURE----- --p7qwJlK53pWzbayA-- From owner-freebsd-fs@FreeBSD.ORG Thu Jan 8 09:45:53 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EBA551065670 for ; Thu, 8 Jan 2009 09:45:52 +0000 (UTC) (envelope-from ndenev@gmail.com) Received: from mail-fx0-f26.google.com (mail-fx0-f26.google.com [209.85.220.26]) by mx1.freebsd.org (Postfix) with ESMTP id 4855C8FC18 for ; Thu, 8 Jan 2009 09:45:52 +0000 (UTC) (envelope-from ndenev@gmail.com) Received: by fxm7 with SMTP id 7so1671175fxm.19 for ; Thu, 08 Jan 2009 01:45:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:cc:message-id:from:to :in-reply-to:content-type:content-transfer-encoding:mime-version :subject:date:references:x-pgp-agent:x-mailer; bh=Ny5henz2xXHJNiqfGN23yUDUgqVpw3XgMKlY1205QOU=; b=IqGUJ9MbaCYCV1G5QDPKwW0WF5Onen6zYntHkfTKc4OG9aGf2jbv9wGWzHg/4RMuKZ UZKgDyEpjBDW9ygf6gp7unvMTB5pwBaxQhzwbmxyOxPRYEewYrJMJnYZqs0j31rD5QpU ZOTtS8JkZKUntAZ9SbJ53EwGJtpjTRB5FzSOM= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=cc:message-id:from:to:in-reply-to:content-type :content-transfer-encoding:mime-version:subject:date:references :x-pgp-agent:x-mailer; b=V9oEhxeNv3iOj0r5tzUCiKbnU/fvNYsbeh/6Yj5SCmVZWe8jpYMaqpARKIG3leOFqB NYQJyv2pyZ7PN9gtqnx4iaoyejNDq62e1L8aaH2cMnQ4BnXOQCjkXBFQTAmdReJRgtm8 gm55ylBg/Pxp3HQsIVCA/52oz5N1F8Q7LrZbY= Received: by 10.103.92.10 with SMTP id u10mr8676819mul.22.1231406404220; Thu, 08 Jan 2009 01:20:04 -0800 (PST) Received: from ndenev.cmotd.com (blah.sun-fish.com [217.18.249.150]) by mx.google.com with ESMTPS id e9sm50656510muf.51.2009.01.08.01.20.01 (version=TLSv1/SSLv3 cipher=RC4-MD5); Thu, 08 Jan 2009 01:20:02 -0800 (PST) Message-Id: From: Nikolay Denev To: fbsd@dannysplace.net In-Reply-To: <496549D9.7010003@dannysplace.net> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Apple Message framework v930.3) Date: Thu, 8 Jan 2009 11:19:59 +0200 References: <20081031033208.GA21220@icarus.home.lan> <490A849C.7030009@dannysplace.net> <20081031043412.GA22289@icarus.home.lan> <490A8FAD.8060009@dannysplace.net> <491BBF38.9010908@dannysplace.net> <491C5AA7.1030004@samsco.org> <491C9535.3030504@dannysplace.net> <4920E1DD.7000101@dannysplace.net> <20081117070818.GA22231@icarus.home.lan> <496549D9.7010003@dannysplace.net> X-Pgp-Agent: GPGMail d55 (v55, Leopard) X-Mailer: Apple Mail (2.930.3) Cc: freebsd-fs@freebsd.org, Jeremy Chadwick , freebsd-hardware@freebsd.org Subject: Re: Areca vs. ZFS performance testing. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 08 Jan 2009 09:45:53 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 8 Jan, 2009, at 02:33 , Danny Carroll wrote: > I'd like to post some results of what I have found with my tests. > I did a few different types of tests. Basically a set of 5-disk tests > and a set of 12-disk tests. > > I did this because I only had 5 ports available on my onboard =20 > controller > and I wanted to see how the areca compared to that. I also wanted to > see comparisons between JBOD, Passthru and hardware raid5. > > I have not tested raid6 or raidz2. > > You can see the results here: > http://www.dannysplace.net/quickweb/filesystem%20tests.htm > > An explanation of each of the tests: > ICH9_ZFS 5 disk zfs raidz test with onboard SATA > ports. > ARECAJBOD_ZFS 5 disk zfs raidz test with Areca SATA > ports configured in JBOD mode. > ARECAJBOD_ZFS_NoWriteCache 5 disk zfs raidz test with Areca SATA = =09 > ports configured in JBOD mode and with > disk caches disabled. > ARECARAID 5 disk zfs single-disk test with Areca > raid5 array. > ARECAPASSTHRU 5 disk zfs raidz test with Areca SATA = ports > configured in Passthru mode. This > means that the onboard areca cache is > active. > ARECARAID-UFS2 5 disk ufs2 single-disk test = with Areca > raid5 array. > ARECARAID-BIG 12 disk zfs single-disk test with Areca > raid5 array. > ARECAPASSTHRU_12 12 disk zfs raidz test with Areca SATA = ports > configured in Passthru mode. This > means that the onboard areca cache is > active. > > > I'll probably be opting for the ARECAPASSTHRU_12 configuration. =20 > Mainly > because I do not need amazing read speeds (network port would be > saturated anyway) and I think that the raidz implementation would be > more fault tolerant. By that I mean if you have a disk read error > during a rebuild then as I understand it, raidz will write off that > block (and hopefully tell me about dead files) but continue with the > rest of the rebuild. > > This is something I'd love to test for real, just to see what happens. > But I am not sure how I could do that. Perhaps removing one drive, =20= > then > a few random writes to a remaining disk (or two) and seeing how it =20 > goes > with a rebuild. > > Something else worth mentioning. When I converted from JBOD to > passthrough, I was able to re-import the disks without any problems. > This must mean that the areca passthrough option does not alter the =20= > disk > much, perhaps not at all. > > After a 21 hour rebuild I have to say I am not that keen to do more of > these tests, but if there is something someone wants to see, then I'll > definitely consider it. > > One thing I am at a loss to understand is why turning off the disk > caches when testing the JBOD performance produced almost identical =20 > (very > slightly better) results. Perhaps it was a case of the ZFS internal > cache making the disks cache redundant? Comparing to the ARECA > passthrough (where the areca cache is used) shows again, similar =20 > results. > > -D > _______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" There is a big difference betweeen hardware and ZFS raidz with 12 disk =20= on the get_block test, maybe it would be interesting to rerun this test with zfs prefetch =20 disabled? - -- Regards, Nikolay Denev -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (Darwin) iEYEARECAAYFAkllxT8ACgkQHNAJ/fLbfrnHnwCeJ8nSjBY6fc0Lvu2+fSN5E4HI zb0Ani2ZFLdxYCWYBuCnoo+D244O2lg5 =3DEKgi -----END PGP SIGNATURE----- From owner-freebsd-fs@FreeBSD.ORG Thu Jan 8 13:25:48 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4F511106566B for ; Thu, 8 Jan 2009 13:25:48 +0000 (UTC) (envelope-from scode@hyperion.scode.org) Received: from hyperion.scode.org (cl-1361.ams-04.nl.sixxs.net [IPv6:2001:960:2:550::2]) by mx1.freebsd.org (Postfix) with ESMTP id 10A808FC16 for ; Thu, 8 Jan 2009 13:25:47 +0000 (UTC) (envelope-from scode@hyperion.scode.org) Received: by hyperion.scode.org (Postfix, from userid 1001) id E993123C443; Thu, 8 Jan 2009 14:25:46 +0100 (CET) Date: Thu, 8 Jan 2009 14:25:46 +0100 From: Peter Schuller To: Koen Smits Message-ID: <20090108132546.GA57786@hyperion.scode.org> References: <4962A1D6.4040508@modulus.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="BOKacYhQ+x31HxR3" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.18 (2008-05-17) Cc: freebsd-fs@freebsd.org Subject: Re: FreeBSD, SSD's and partition alignment X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 08 Jan 2009 13:25:48 -0000 --BOKacYhQ+x31HxR3 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable > Note that even the Intel X25-M series seem to slow down in random write > speed when the complete disk is filled and there are no cells left that t= he > controller knows are free. Most benchmarks out there are run on an empty > Intel SSD. When you rerun that test several times, it'll slowly settle on= a > much lower random write speed. My understanding is that the performance drop should only come from *sustained* high write iops; i.e., when you effectively exhaust the free space necessary to perform the writes sequentially but temporarily. But on the other hand if you are only bursting, I was under the impression these guys did background re-writing such that no permanent performance drop need be expected. Is this not the case for the X25-M or others? --=20 / Peter Schuller PGP userID: 0xE9758B7D or 'Peter Schuller ' Key retrieval: Send an E-Mail to getpgpkey@scode.org E-Mail: peter.schuller@infidyne.com Web: http://www.scode.org --BOKacYhQ+x31HxR3 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (FreeBSD) iEYEARECAAYFAkll/tkACgkQDNor2+l1i33DAgCfe77a9WZOkQa/NdI1MQY7Bgr8 PMwAn1Ku8iJunO4nlntHKJwQNPgl16JM =CB7q -----END PGP SIGNATURE----- --BOKacYhQ+x31HxR3-- From owner-freebsd-fs@FreeBSD.ORG Thu Jan 8 15:14:23 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B7BCD106564A for ; Thu, 8 Jan 2009 15:14:23 +0000 (UTC) (envelope-from john@kozubik.com) Received: from kozubik.com (kozubik.com [69.43.165.2]) by mx1.freebsd.org (Postfix) with ESMTP id 8432B8FC23 for ; Thu, 8 Jan 2009 15:14:23 +0000 (UTC) (envelope-from john@kozubik.com) Received: from kozubik.com (localhost [127.0.0.1]) by kozubik.com (8.12.11/8.12.11) with ESMTP id n08EtA21033302 for ; Thu, 8 Jan 2009 06:55:10 -0800 (PST) (envelope-from john@kozubik.com) Received: from localhost (john@localhost) by kozubik.com (8.12.11/8.12.11/Submit) with ESMTP id n08EtApR033299 for ; Thu, 8 Jan 2009 06:55:10 -0800 (PST) (envelope-from john@kozubik.com) Date: Thu, 8 Jan 2009 06:55:10 -0800 (PST) From: John Kozubik To: freebsd-fs@freebsd.org Message-ID: <20090108065139.M61433@kozubik.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Subject: 64-bit quota support now available for 6.x and 7.x X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 08 Jan 2009 15:14:23 -0000 Hello, Kirk McKusick has responded to the bounty I posted in June for 64-bit quota support in FreeBSD. He has provided patches for both 6.x and 7.x which I, and others, have tested. I am currently using them in a production environment at rsync.net. Full details: http://blog.kozubik.com/john_kozubik/2009/01/64bit-freebsd-quotas.html --- John Kozubik - john@kozubik.com - http://www.kozubik.com From owner-freebsd-fs@FreeBSD.ORG Thu Jan 8 15:31:53 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A9DEE1065673 for ; Thu, 8 Jan 2009 15:31:53 +0000 (UTC) (envelope-from kgysmits@gmail.com) Received: from mail-bw0-f20.google.com (mail-bw0-f20.google.com [209.85.218.20]) by mx1.freebsd.org (Postfix) with ESMTP id 03DEC8FC08 for ; Thu, 8 Jan 2009 15:31:52 +0000 (UTC) (envelope-from kgysmits@gmail.com) Received: by bwz13 with SMTP id 13so936711bwz.19 for ; Thu, 08 Jan 2009 07:31:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type:references; bh=CmmEPc/VkSP82hqgDfoC7Rd1cQ6Hh/5S7a3p9GpR7rw=; b=StxzaK021phQKYRI2Wk3ZGAPWvYXogXHC3TyujdRV/6dtLfR1CnsYsSvaiTePJJsc5 FJkjXQITn4ctRC27VLHgZt86M8gc8Yi3glNBfITv7AefNBv749J5eH8iqFvySNeE/nWv GFU6+jx8swzd3MXINipixmk3ZhRQlq59wXxcc= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:references; b=NBHVFl+Vq4CAgQS5K+Nlr9pR8aHnixI19/HlIEDLqYcHoAxWi3LL9QszqwZb8cAhgV asKqJFfPiMTNsdHpMCfFBjHrmOHN9J0LKx8mF8ZGoDaxbFW2cr+I6PT7SlgrBvF0A47f yzmkMUB7a7Z+X2p2M5YvJAeQbEIL8F1/oWhtI= Received: by 10.223.108.210 with SMTP id g18mr17632468fap.38.1231428711807; Thu, 08 Jan 2009 07:31:51 -0800 (PST) Received: by 10.223.108.136 with HTTP; Thu, 8 Jan 2009 07:31:51 -0800 (PST) Message-ID: Date: Thu, 8 Jan 2009 16:31:51 +0100 From: "Koen Smits" To: "Peter Schuller" In-Reply-To: <20090108132546.GA57786@hyperion.scode.org> MIME-Version: 1.0 References: <4962A1D6.4040508@modulus.org> <20090108132546.GA57786@hyperion.scode.org> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-fs@freebsd.org Subject: Re: FreeBSD, SSD's and partition alignment X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 08 Jan 2009 15:31:53 -0000 I have not tested this to an extent that I can be sure this is the way it works. Sorry. On Thu, Jan 8, 2009 at 14:25, Peter Schuller wrote: > > Note that even the Intel X25-M series seem to slow down in random write > > speed when the complete disk is filled and there are no cells left that > the > > controller knows are free. Most benchmarks out there are run on an empty > > Intel SSD. When you rerun that test several times, it'll slowly settle on > a > > much lower random write speed. > > My understanding is that the performance drop should only come from > *sustained* high write iops; i.e., when you effectively exhaust the > free space necessary to perform the writes sequentially but > temporarily. But on the other hand if you are only bursting, I was > under the impression these guys did background re-writing such that no > permanent performance drop need be expected. > > Is this not the case for the X25-M or others? > > -- > / Peter Schuller > > PGP userID: 0xE9758B7D or 'Peter Schuller ' > Key retrieval: Send an E-Mail to getpgpkey@scode.org > E-Mail: peter.schuller@infidyne.com Web: http://www.scode.org > > From owner-freebsd-fs@FreeBSD.ORG Thu Jan 8 23:57:25 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9D783106564A for ; Thu, 8 Jan 2009 23:57:25 +0000 (UTC) (envelope-from freebsd@edvax.de) Received: from mx02.qsc.de (mx02.qsc.de [213.148.130.14]) by mx1.freebsd.org (Postfix) with ESMTP id 61BDC8FC0C for ; Thu, 8 Jan 2009 23:57:25 +0000 (UTC) (envelope-from freebsd@edvax.de) Received: from r55.edvax.de (port-92-196-14-53.dynamic.qsc.de [92.196.14.53]) by mx02.qsc.de (Postfix) with ESMTP id 3E97616C009D; Fri, 9 Jan 2009 00:28:53 +0100 (CET) Received: from r55.edvax.de (localhost [127.0.0.1]) by r55.edvax.de (8.14.2/8.14.2) with SMTP id n08NSlLu003847; Fri, 9 Jan 2009 00:28:47 +0100 (CET) (envelope-from freebsd@edvax.de) Date: Fri, 9 Jan 2009 00:28:46 +0100 From: Polytropon To: FreeBSD Questions , FreeBSD FS Message-Id: <20090109002846.c67d962f.freebsd@edvax.de> Organization: EDVAX X-Mailer: Sylpheed 2.4.7 (GTK+ 2.12.1; i386-portbld-freebsd7.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: Subject: Restore deleted files X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Polytropon List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 08 Jan 2009 23:57:25 -0000 Hi, I'd like to ask a two-stage question: 1. Is it possible to recover files that have been deleted? 2. Which tools or procedures are suggested for recovery? While sorting out some files and transfering them to another hard disk, I accidentally deleted too much: the directory with my videos taken by a digital camera. They were located in a directory within a subtree, and I deleted the whole subtree without first copying these files. I used the Midnight Commander to do this. As I read from its source code, it seems to use the unlink() call to delete the subtree recursively. Pressing PF8 can really ruin your day... Just after I noticed what I had done I unmounted the file system, powered off the machine and put the disk on the shelf (it's still there), no further write accesses. I would be glad if someone could enlighten me if there is any chance to get the files back, even with the loss of the file names (doesn't matter), and which tools seem to serve best in this difficult task. And if it's impossible, please tell me. I can newfs the disk then and free it, along with my mind. PS. I'm posting this question to -fs, too. Answers from this list please keep me in CC because I'm not subscribed to -fs. Thank you! -- Polytropon >From Magdeburg, Germany Happy FreeBSD user since 4.0 Andra moi ennepe, Mousa, ... From owner-freebsd-fs@FreeBSD.ORG Fri Jan 9 00:35:42 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 54DCF10656C4; Fri, 9 Jan 2009 00:35:42 +0000 (UTC) (envelope-from prvs=julian=25380973a@elischer.org) Received: from smtp-outbound.ironport.com (smtp-outbound.ironport.com [63.251.108.112]) by mx1.freebsd.org (Postfix) with ESMTP id 3E7268FC18; Fri, 9 Jan 2009 00:35:42 +0000 (UTC) (envelope-from prvs=julian=25380973a@elischer.org) Received: from unknown (HELO julian-mac.elischer.org) ([10.251.60.63]) by smtp-outbound.ironport.com with ESMTP; 08 Jan 2009 16:07:06 -0800 Message-ID: <49669529.4010501@elischer.org> Date: Thu, 08 Jan 2009 16:07:05 -0800 From: Julian Elischer User-Agent: Thunderbird 2.0.0.19 (Macintosh/20081209) MIME-Version: 1.0 To: Polytropon References: <20090109002846.c67d962f.freebsd@edvax.de> In-Reply-To: <20090109002846.c67d962f.freebsd@edvax.de> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: FreeBSD FS , FreeBSD Questions Subject: Re: Restore deleted files X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 09 Jan 2009 00:35:43 -0000 Polytropon wrote: > Hi, > > I'd like to ask a two-stage question: > > 1. Is it possible to recover files that have been deleted? > > 2. Which tools or procedures are suggested for recovery? > > While sorting out some files and transfering them to another > hard disk, I accidentally deleted too much: the directory with > my videos taken by a digital camera. They were located in a > directory within a subtree, and I deleted the whole subtree > without first copying these files. > > I used the Midnight Commander to do this. As I read from its > source code, it seems to use the unlink() call to delete the > subtree recursively. Pressing PF8 can really ruin your day... > > Just after I noticed what I had done I unmounted the file system, > powered off the machine and put the disk on the shelf (it's still > there), no further write accesses. unmounting could have made things worse :-/ it then actually cleaned up and wrote the changes.... the best would have been to ahve hit and dropped into the debugger and then unplugged the drive.. still you MIGHT be lucky if the files are contiguous on disk (which images are likely to be. I don't know hte tools bu there are some... they are usually more useful for recovering from crashes etc. the trouble with accidental deletes is that they often leave no information as to what went where. hopefully someone else can give you more info as to tools. > > I would be glad if someone could enlighten me if there is any > chance to get the files back, even with the loss of the file > names (doesn't matter), and which tools seem to serve best in > this difficult task. > > And if it's impossible, please tell me. I can newfs the disk > then and free it, along with my mind. > > > > > PS. > I'm posting this question to -fs, too. Answers from this list > please keep me in CC because I'm not subscribed to -fs. Thank you! > From owner-freebsd-fs@FreeBSD.ORG Fri Jan 9 00:55:58 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 57469106564A for ; Fri, 9 Jan 2009 00:55:58 +0000 (UTC) (envelope-from cswiger@mac.com) Received: from mail-out4.apple.com (mail-out4.apple.com [17.254.13.23]) by mx1.freebsd.org (Postfix) with ESMTP id 3CBE58FC1C for ; Fri, 9 Jan 2009 00:55:58 +0000 (UTC) (envelope-from cswiger@mac.com) Received: from relay13.apple.com (relay13.apple.com [17.128.113.29]) by mail-out4.apple.com (Postfix) with ESMTP id CAF184DD6318; Thu, 8 Jan 2009 16:36:00 -0800 (PST) Received: from relay13.apple.com (unknown [127.0.0.1]) by relay13.apple.com (Symantec Brightmail Gateway) with ESMTP id B52222808C; Thu, 8 Jan 2009 16:36:00 -0800 (PST) X-AuditID: 1180711d-ad82fbb000000ff0-bf-49669bf0f4bf Received: from cswiger1.apple.com (cswiger1.apple.com [17.227.140.124]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by relay13.apple.com (Apple SCV relay) with ESMTP id 9901B28088; Thu, 8 Jan 2009 16:36:00 -0800 (PST) Message-Id: From: Chuck Swiger To: Polytropon In-Reply-To: <20090109002846.c67d962f.freebsd@edvax.de> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v930.3) Date: Thu, 8 Jan 2009 16:36:00 -0800 References: <20090109002846.c67d962f.freebsd@edvax.de> X-Mailer: Apple Mail (2.930.3) X-Brightmail-Tracker: AAAAAA== Cc: FreeBSD FS , FreeBSD Questions Subject: Re: Restore deleted files X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 09 Jan 2009 00:55:59 -0000 On Jan 8, 2009, at 3:28 PM, Polytropon wrote: > I'd like to ask a two-stage question: > > 1. Is it possible to recover files that have been deleted? > > 2. Which tools or procedures are suggested for recovery? The preferred method is to recover files from backup. If you don't take backups, you've decided that you don't really care about the data. This being said, you might take a look at something like: > % cat /usr/ports/sysutils/sleuthkit/pkg-descr > The Sleuth Kit (previously known as TASK) is a collection of UNIX- > based > command line file system and media management forensic analysis > tools. The > file system tools allow you to examine file systems of a suspect > computer in > a non-intrusive fashion. > > The media management tools allow you to examine the layout of disks > and > other media. The Sleuth Kit supports DOS partitions, BSD partitions > (disk > labels), Mac partitions, Sun slices (Volume Table of Contents), and > GPT > disks. With these tools, you can identify where partitions are > located and > extract them so that they can be analyzed with file system analysis > tools. > > WWW: http://www.sleuthkit.org/sleuthkit/ This can be used to attempt to "undelete" files from a UFS filesystem.... Regards, -- -Chuck From owner-freebsd-fs@FreeBSD.ORG Fri Jan 9 02:30:21 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F0B26106566B; Fri, 9 Jan 2009 02:30:21 +0000 (UTC) (envelope-from fbsd@dannysplace.net) Received: from mail.dannysplace.net (mail.dannysplace.net [213.133.54.210]) by mx1.freebsd.org (Postfix) with ESMTP id A00348FC08; Fri, 9 Jan 2009 02:30:21 +0000 (UTC) (envelope-from fbsd@dannysplace.net) Received: from 203-206-171-212.perm.iinet.net.au ([203.206.171.212] helo=[192.168.10.10]) by mail.dannysplace.net with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.69 (FreeBSD)) (envelope-from ) id 1LL78U-0005u0-IL; Fri, 09 Jan 2009 12:30:20 +1000 Message-ID: <4966B6B1.8020502@dannysplace.net> Date: Fri, 09 Jan 2009 12:30:09 +1000 From: Danny Carroll User-Agent: Thunderbird 2.0.0.19 (Windows/20081209) MIME-Version: 1.0 To: Koen Smits References: <20081031033208.GA21220@icarus.home.lan> <490A8FAD.8060009@dannysplace.net> <491BBF38.9010908@dannysplace.net> <491C5AA7.1030004@samsco.org> <491C9535.3030504@dannysplace.net> <4920E1DD.7000101@dannysplace.net> <20081117070818.GA22231@icarus.home.lan> <496549D9.7010003@dannysplace.net> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Authenticated-User: danny X-Authenticator: plain X-Sender-Verify: SUCCEEDED (sender exists & accepts mail) X-Exim-Version: 4.69 (build at 08-Jul-2008 08:59:40) X-Date: 2009-01-09 12:30:11 X-Connected-IP: 203.206.171.212:2346 X-Message-Linecount: 37 X-Body-Linecount: 22 X-Message-Size: 1938 X-Body-Size: 909 X-Received-Count: 1 X-Recipient-Count: 4 X-Local-Recipient-Count: 4 X-Local-Recipient-Defer-Count: 0 X-Local-Recipient-Fail-Count: 0 X-SA-Exim-Connect-IP: 203.206.171.212 X-SA-Exim-Rcpt-To: kgysmits@gmail.com, koitsu@freebsd.org, freebsd-fs@freebsd.org, freebsd-hardware@freebsd.org X-SA-Exim-Mail-From: fbsd@dannysplace.net X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on ferrari.dannysplace.net X-Spam-Level: X-Spam-Status: No, score=0.2 required=8.0 tests=ALL_TRUSTED,TVD_RCVD_IP autolearn=disabled version=3.2.5 X-SA-Exim-Version: 4.2 X-SA-Exim-Scanned: Yes (on mail.dannysplace.net) Cc: freebsd-fs@freebsd.org, Jeremy Chadwick , freebsd-hardware@freebsd.org Subject: Re: Areca vs. ZFS performance testing. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: fbsd@dannysplace.net List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 09 Jan 2009 02:30:22 -0000 Koen Smits wrote: > My guess is it probably has to do with the way ZFS does cache flushes: > http://www.solarisinternals.com/wiki/index.php/ZFS_Evil_Tuning_Guide#Cache_Flushes > It might be worth it to disable the forced flushing and test again, if > you feel like it. I've just done this and the results are on the same page: http://www.dannysplace.net/quickweb/filesystem%20tests.htm The Excel version is here: http://www.dannysplace.net/quickweb/filesystem%20tests.xls It is a major improvement but I do not know 100% for sure if the disks are protected by the write cache/battery backup when in Passthrough mode. When creating a passthrough disk the "Volume Cache Mode" can be set to "Write Back" or "Write Through". This makes me feel as though the cache is being used and that when the cache is used, so is the BBU. But I cannot be 100% sure. I will send an email to Areca support to ask. -D From owner-freebsd-fs@FreeBSD.ORG Fri Jan 9 08:46:58 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AD9091065675; Fri, 9 Jan 2009 08:46:58 +0000 (UTC) (envelope-from kgysmits@gmail.com) Received: from fk-out-0910.google.com (fk-out-0910.google.com [209.85.128.184]) by mx1.freebsd.org (Postfix) with ESMTP id D50B18FC0A; Fri, 9 Jan 2009 08:46:57 +0000 (UTC) (envelope-from kgysmits@gmail.com) Received: by fk-out-0910.google.com with SMTP id k31so6149717fkk.11 for ; Fri, 09 Jan 2009 00:46:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type:references; bh=6u/k8u1Jq+vGNREoamDRInJeIkllpxF5NuOZNvGuUjM=; b=krnMLAtzUhv23MqCJ6jZsfALPwdWYGwPcREXWmjnTQXXnV79vuVzMNkrEK7cXrB/Io opxOuRAwaluVvVaLXf+BVvBMdYlFUwao0b35BE3Ek6e6qmMCzvHnXaiTYId8Ww/GDTnA szSxRvn25bFRS55XQvr1LO8o7GSAyTy5rVIaY= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:references; b=D9SCdhdrEksQQzOvGgLWtcN4fpYTaoawHA150GSZiKniFLk72rwitVYUr3ES0Ksr1p r+j7B7dYCtU+jNQYX082u3TMT6XDYe4LK8cYVqcRb/vDeDFHSxdM41xJ/YwXHELKi8YT 1ZdgNPwSGRNdLi9z9KF7DZuQSRkIfhoF8jvN0= Received: by 10.223.111.211 with SMTP id t19mr1365569fap.64.1231490816489; Fri, 09 Jan 2009 00:46:56 -0800 (PST) Received: by 10.223.108.136 with HTTP; Fri, 9 Jan 2009 00:46:56 -0800 (PST) Message-ID: Date: Fri, 9 Jan 2009 09:46:56 +0100 From: "Koen Smits" To: fbsd@dannysplace.net In-Reply-To: <4966B6B1.8020502@dannysplace.net> MIME-Version: 1.0 References: <20081031033208.GA21220@icarus.home.lan> <491C5AA7.1030004@samsco.org> <491C9535.3030504@dannysplace.net> <4920E1DD.7000101@dannysplace.net> <20081117070818.GA22231@icarus.home.lan> <496549D9.7010003@dannysplace.net> <4966B6B1.8020502@dannysplace.net> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-fs@freebsd.org, Jeremy Chadwick , freebsd-hardware@freebsd.org Subject: Re: Areca vs. ZFS performance testing. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 09 Jan 2009 08:46:59 -0000 Those numbers are pretty good, right? Who needs onboard XOR anyway :) On Fri, Jan 9, 2009 at 03:30, Danny Carroll wrote: > Koen Smits wrote: > > My guess is it probably has to do with the way ZFS does cache flushes: > > > http://www.solarisinternals.com/wiki/index.php/ZFS_Evil_Tuning_Guide#Cache_Flushes > > It might be worth it to disable the forced flushing and test again, if > > you feel like it. > > I've just done this and the results are on the same page: > > http://www.dannysplace.net/quickweb/filesystem%20tests.htm > The Excel version is here: > > http://www.dannysplace.net/quickweb/filesystem%20tests.xls > > It is a major improvement but I do not know 100% for sure if the disks > are protected by the write cache/battery backup when in Passthrough mode. > > When creating a passthrough disk the "Volume Cache Mode" can be set to > "Write Back" or "Write Through". This makes me feel as though the cache > is being used and that when the cache is used, so is the BBU. But I > cannot be 100% sure. I will send an email to Areca support to ask. > > -D > From owner-freebsd-fs@FreeBSD.ORG Fri Jan 9 09:02:10 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DE8A5106567F; Fri, 9 Jan 2009 09:02:10 +0000 (UTC) (envelope-from fbsd@dannysplace.net) Received: from mail.dannysplace.net (mail.dannysplace.net [213.133.54.210]) by mx1.freebsd.org (Postfix) with ESMTP id 8C1648FC20; Fri, 9 Jan 2009 09:02:10 +0000 (UTC) (envelope-from fbsd@dannysplace.net) Received: from 60-242-243-193.static.tpgi.com.au ([60.242.243.193] helo=[192.168.10.10]) by mail.dannysplace.net with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.69 (FreeBSD)) (envelope-from ) id 1LLDFe-0008F1-MC; Fri, 09 Jan 2009 19:02:09 +1000 Message-ID: <496712A2.4020800@dannysplace.net> Date: Fri, 09 Jan 2009 19:02:26 +1000 From: Danny Carroll User-Agent: Thunderbird 2.0.0.19 (Windows/20081209) MIME-Version: 1.0 To: Koen Smits References: <20081031033208.GA21220@icarus.home.lan> <491C5AA7.1030004@samsco.org> <491C9535.3030504@dannysplace.net> <4920E1DD.7000101@dannysplace.net> <20081117070818.GA22231@icarus.home.lan> <496549D9.7010003@dannysplace.net> <4966B6B1.8020502@dannysplace.net> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Authenticated-User: danny X-Authenticator: plain X-Sender-Verify: SUCCEEDED (sender exists & accepts mail) X-Exim-Version: 4.69 (build at 08-Jul-2008 08:59:40) X-Date: 2009-01-09 19:01:59 X-Connected-IP: 60.242.243.193:2227 X-Message-Linecount: 30 X-Body-Linecount: 15 X-Message-Size: 1648 X-Body-Size: 591 X-Received-Count: 1 X-Recipient-Count: 4 X-Local-Recipient-Count: 4 X-Local-Recipient-Defer-Count: 0 X-Local-Recipient-Fail-Count: 0 X-SA-Exim-Connect-IP: 60.242.243.193 X-SA-Exim-Rcpt-To: kgysmits@gmail.com, koitsu@freebsd.org, freebsd-fs@freebsd.org, freebsd-hardware@freebsd.org X-SA-Exim-Mail-From: fbsd@dannysplace.net X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on ferrari.dannysplace.net X-Spam-Level: X-Spam-Status: No, score=0.2 required=8.0 tests=ALL_TRUSTED,TVD_RCVD_IP autolearn=disabled version=3.2.5 X-SA-Exim-Version: 4.2 X-SA-Exim-Scanned: Yes (on mail.dannysplace.net) Cc: freebsd-fs@freebsd.org, Jeremy Chadwick , freebsd-hardware@freebsd.org Subject: Re: Areca vs. ZFS performance testing. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: fbsd@dannysplace.net List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 09 Jan 2009 09:02:11 -0000 Koen Smits wrote: > Those numbers are pretty good, right? Who needs onboard XOR anyway :) > Those numbers are great, but I would love to know that writes to the disks are also protected by the battery backup. If not then I'll be forced to use either hardware raid5/6 or perhaps some other configuration. Maybe 6 stripe sets in a raidz array? At the end of the day however I really don't care about the performance, even the slowest of the tests I did would be fast enough to saturate a gigabit ethernet port, which is way fast enough for me. But its an interesting set of tests... -D From owner-freebsd-fs@FreeBSD.ORG Fri Jan 9 15:58:06 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 76C6D106568B; Fri, 9 Jan 2009 15:58:06 +0000 (UTC) (envelope-from kgysmits@gmail.com) Received: from mail-bw0-f20.google.com (mail-bw0-f20.google.com [209.85.218.20]) by mx1.freebsd.org (Postfix) with ESMTP id 821C48FC21; Fri, 9 Jan 2009 15:58:05 +0000 (UTC) (envelope-from kgysmits@gmail.com) Received: by bwz13 with SMTP id 13so2729134bwz.19 for ; Fri, 09 Jan 2009 07:58:04 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type:references; bh=pJ00ba9WhUzDMbO3Ud6rEDRlNJ52UsSugL8T/kaDX1M=; b=Icz4MNWP8UxsHDcmBxHqnESoYW+mxDTawHTdA3w71z9yKiwBgTTsHsbiwV7KrUyEFc 6sql94bz1LgdQg7Bmg4gXfdxByZY3BzgtwUNkiAWKyJFmnBZA5yIsHgFwKYmqVkcQKq/ YlmgwQ70JaR9l4f3o/3RmgW/lnXXRCgdJJDGk= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:references; b=xKls5E/X4znqcWLq9yuAwW+YzCsQQ6HLwwbKCxHTtHfE7acM5scsAEOsfgEFXB8AsR Jhf0fh5/0Nf+j7u7jCPJKLM+Ue19/6pA5yGZ0RwTiyO+b/fBCoVfkz5uWdmoRqOdgoZ9 3tuxfkBwCfOctT/ohE1ZPyex5zJknV6NQiNl0= Received: by 10.223.113.199 with SMTP id b7mr18664454faq.83.1231516683926; Fri, 09 Jan 2009 07:58:03 -0800 (PST) Received: by 10.223.108.136 with HTTP; Fri, 9 Jan 2009 07:58:03 -0800 (PST) Message-ID: Date: Fri, 9 Jan 2009 16:58:03 +0100 From: "Koen Smits" To: fbsd@dannysplace.net In-Reply-To: <496712A2.4020800@dannysplace.net> MIME-Version: 1.0 References: <20081031033208.GA21220@icarus.home.lan> <4920E1DD.7000101@dannysplace.net> <20081117070818.GA22231@icarus.home.lan> <496549D9.7010003@dannysplace.net> <4966B6B1.8020502@dannysplace.net> <496712A2.4020800@dannysplace.net> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-fs@freebsd.org, Jeremy Chadwick , freebsd-hardware@freebsd.org Subject: Re: Areca vs. ZFS performance testing. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 09 Jan 2009 15:58:07 -0000 Please let us know what Areca says about the caching. If you ask me, these results definitely are cached. On Fri, Jan 9, 2009 at 10:02, Danny Carroll wrote: > Koen Smits wrote: > > Those numbers are pretty good, right? Who needs onboard XOR anyway :) > > > > Those numbers are great, but I would love to know that writes to the > disks are also protected by the battery backup. If not then I'll be > forced to use either hardware raid5/6 or perhaps some other > configuration. Maybe 6 stripe sets in a raidz array? > > At the end of the day however I really don't care about the performance, > even the slowest of the tests I did would be fast enough to saturate a > gigabit ethernet port, which is way fast enough for me. But its an > interesting set of tests... > > -D > From owner-freebsd-fs@FreeBSD.ORG Sat Jan 10 02:38:55 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 91CD5106566C for ; Sat, 10 Jan 2009 02:38:55 +0000 (UTC) (envelope-from andrew@modulus.org) Received: from email.octopus.com.au (email.octopus.com.au [122.100.2.232]) by mx1.freebsd.org (Postfix) with ESMTP id 4CAEC8FC08 for ; Sat, 10 Jan 2009 02:38:55 +0000 (UTC) (envelope-from andrew@modulus.org) Received: by email.octopus.com.au (Postfix, from userid 1002) id 3B8EF17E3F; Sat, 10 Jan 2009 13:38:54 +1100 (EST) X-Spam-Checker-Version: SpamAssassin 3.2.3 (2007-08-08) on email.octopus.com.au X-Spam-Level: X-Spam-Status: No, score=-1.4 required=10.0 tests=ALL_TRUSTED autolearn=failed version=3.2.3 Received: from [10.1.50.60] (ppp121-44-0-132.lns10.syd7.internode.on.net [121.44.0.132]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: admin@email.octopus.com.au) by email.octopus.com.au (Postfix) with ESMTP id A0C8617D9C; Sat, 10 Jan 2009 13:38:48 +1100 (EST) Message-ID: <49680A26.1020502@modulus.org> Date: Sat, 10 Jan 2009 13:38:30 +1100 From: Andrew Snow User-Agent: Thunderbird 2.0.0.14 (X11/20080523) MIME-Version: 1.0 To: fbsd@dannysplace.net, freebsd-fs@freebsd.org References: <20081031033208.GA21220@icarus.home.lan> <491C5AA7.1030004@samsco.org> <491C9535.3030504@dannysplace.net> <4920E1DD.7000101@dannysplace.net> <20081117070818.GA22231@icarus.home.lan> <496549D9.7010003@dannysplace.net> <4966B6B1.8020502@dannysplace.net> <496712A2.4020800@dannysplace.net> In-Reply-To: <496712A2.4020800@dannysplace.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: Subject: Re: Areca vs. ZFS performance testing. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 10 Jan 2009 02:38:55 -0000 ZFS does not require battery-backed disk cache, as long as disks and controller flush their cache when they are told to by the OS. Then ZFS only issues sync/flush commands for the ZIL (transaction log), but majority of I/Os are free to sit in cache to complete when they are ready. Data that is not fsync()'d by the application may be lost on power outage, but stuff like databases do fsync() so they are protected. - Andrew From owner-freebsd-fs@FreeBSD.ORG Sat Jan 10 04:58:50 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 81FE31065670; Sat, 10 Jan 2009 04:58:50 +0000 (UTC) (envelope-from fbsd@dannysplace.net) Received: from mail.dannysplace.net (mail.dannysplace.net [213.133.54.210]) by mx1.freebsd.org (Postfix) with ESMTP id 304598FC14; Sat, 10 Jan 2009 04:58:50 +0000 (UTC) (envelope-from fbsd@dannysplace.net) Received: from 203-206-171-212.perm.iinet.net.au ([203.206.171.212] helo=[192.168.10.10]) by mail.dannysplace.net with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.69 (FreeBSD)) (envelope-from ) id 1LLVvr-000Le2-2g; Sat, 10 Jan 2009 14:58:49 +1000 Message-ID: <49682AEF.8010006@dannysplace.net> Date: Sat, 10 Jan 2009 14:58:23 +1000 From: Danny Carroll User-Agent: Thunderbird 2.0.0.19 (Windows/20081209) MIME-Version: 1.0 To: Koen Smits References: <20081031033208.GA21220@icarus.home.lan> <4920E1DD.7000101@dannysplace.net> <20081117070818.GA22231@icarus.home.lan> <496549D9.7010003@dannysplace.net> <4966B6B1.8020502@dannysplace.net> <496712A2.4020800@dannysplace.net> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Authenticated-User: danny X-Authenticator: plain X-Sender-Verify: SUCCEEDED (sender exists & accepts mail) X-Exim-Version: 4.69 (build at 08-Jul-2008 08:59:40) X-Date: 2009-01-10 14:58:47 X-Connected-IP: 203.206.171.212:1143 X-Message-Linecount: 23 X-Body-Linecount: 8 X-Message-Size: 1295 X-Body-Size: 205 X-Received-Count: 1 X-Recipient-Count: 4 X-Local-Recipient-Count: 4 X-Local-Recipient-Defer-Count: 0 X-Local-Recipient-Fail-Count: 0 X-SA-Exim-Connect-IP: 203.206.171.212 X-SA-Exim-Rcpt-To: kgysmits@gmail.com, koitsu@freebsd.org, freebsd-fs@freebsd.org, freebsd-hardware@freebsd.org X-SA-Exim-Mail-From: fbsd@dannysplace.net X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on ferrari.dannysplace.net X-Spam-Level: X-Spam-Status: No, score=0.2 required=8.0 tests=ALL_TRUSTED,TVD_RCVD_IP autolearn=disabled version=3.2.5 X-SA-Exim-Version: 4.2 X-SA-Exim-Scanned: Yes (on mail.dannysplace.net) Cc: freebsd-fs@freebsd.org, Jeremy Chadwick , freebsd-hardware@freebsd.org Subject: Re: Areca vs. ZFS performance testing. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: fbsd@dannysplace.net List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 10 Jan 2009 04:58:51 -0000 Koen Smits wrote: > Please let us know what Areca says about the caching. > If you ask me, these results definitely are cached. > Are yes but are they cached by the OS or by the array controller :-) -D From owner-freebsd-fs@FreeBSD.ORG Sat Jan 10 11:56:46 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 411191065670 for ; Sat, 10 Jan 2009 11:56:46 +0000 (UTC) (envelope-from ndenev@gmail.com) Received: from fg-out-1718.google.com (fg-out-1718.google.com [72.14.220.153]) by mx1.freebsd.org (Postfix) with ESMTP id BC1528FC12 for ; Sat, 10 Jan 2009 11:56:45 +0000 (UTC) (envelope-from ndenev@gmail.com) Received: by fg-out-1718.google.com with SMTP id l26so3304901fgb.35 for ; Sat, 10 Jan 2009 03:56:44 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:cc:message-id:from:to :in-reply-to:content-type:content-transfer-encoding:mime-version :subject:date:references:x-pgp-agent:x-mailer; bh=TN1ma94qKmLesejuZ6Gqa/hl0moq7jqM8mhh/u/loFw=; b=rmWyimjYvWvMPXZwDZVNL32Cg5xCw0xMks4BJnOz6QwncK7JKvAz0FqZ0cttjfGr7Q 7G05RXfdamiPDfrW2zOJNhMlFX2vpXUMnEcQpDOsy3LjrP+g1rC/5pyf/KLlnPno4MnL IWTN027/EsmQfBBJ6y1eMduggk/9zMrig4SDQ= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=cc:message-id:from:to:in-reply-to:content-type :content-transfer-encoding:mime-version:subject:date:references :x-pgp-agent:x-mailer; b=nH6LEz/KaxmmuqJuio9Kpn6+qoVsGal79QrZS3qFPyP7Bann+iq8j1K8ud3zFYE2Hh wcadP1eYbZHbzspxf1x3Zx6joMNjNMZQDuymfe2csbTAp3O9JpFVLwo26/6epsymILoa IVUYECqzDJcNv0+PD9ZAnJO4BFPoJisgGZriI= Received: by 10.86.51.10 with SMTP id y10mr15404531fgy.9.1231588604637; Sat, 10 Jan 2009 03:56:44 -0800 (PST) Received: from ndenev.cmotd.com (blah.sun-fish.com [217.18.249.150]) by mx.google.com with ESMTPS id 4sm39859351fgg.24.2009.01.10.03.56.40 (version=TLSv1/SSLv3 cipher=RC4-MD5); Sat, 10 Jan 2009 03:56:42 -0800 (PST) Message-Id: <12C6C9A1-D4F0-442A-A92C-1B4565AEEAF8@gmail.com> From: Nikolay Denev To: Doug Rabson In-Reply-To: <459358DB-15A6-4E27-A99E-D76A2A7DC73F@rabson.org> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Apple Message framework v930.3) Date: Sat, 10 Jan 2009 13:56:37 +0200 References: <9461581F-F354-486D-961D-3FD5B1EF007C@rabson.org> <2F0DF92C-4240-48D4-9A5F-8B826D6D6E95@rabson.org> <87E89284-D3BF-4A5A-B6F7-C30709A3F2D9@lassitu.de> <4AC3BEB2-B47E-4280-85E1-C72891412D09@rabson.org> <494F6C21.2000801@tzim.net> <459358DB-15A6-4E27-A99E-D76A2A7DC73F@rabson.org> X-Pgp-Agent: GPGMail d55 (v55, Leopard) X-Mailer: Apple Mail (2.930.3) Cc: freebsd-fs@freebsd.org Subject: Re: Booting from ZFS raidz X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 10 Jan 2009 11:56:46 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 2 Jan, 2009, at 15:17 , Doug Rabson wrote: > > On 22 Dec 2008, at 10:29, Arnaud Houdelette wrote: > >> As I'm fairly interrested in this kind of setup, I set up a virtual =20= >> machine (VirtualBox) with 3 HD. >> Sources are from a fresh current (csup yesterday). Applied your =20 >> patch successfully. >> >> Done a make installworld / installkernel to the zfs root. >> Applied the bootcode as Stephan. >> >> The seem's the loader gets loaded, but it cant proceed further. >> I got those kind of errors : > > I'm going to have to try and reproduce this but it looks as if you =20 > make have installed a gptzfsboot which doesn't include the raidz =20 > support. > I have just tried installing the new gptzfsboot with a 7.1-STABLE =20 install, but all i got is a : "No ZFS pools located, can't boot" message. I used 7.1-STABLE DVD, but I have copied and installed /boot/pmbr /=20 boot/gptzfsboot and /boot/loader from a - -CURRENT system built with your patch and LOADER_ZFS_SUPPORT All my disks have valid guid partition tables with p1 of type freebsd-=20= boot with installed pmbr and gptzfsboot from -CURRENT, and p2 partition of type freebsd-zfs with a valid pool that i can =20 mount using LiveFS. Any suggestions? - -- Regards, Nikolay Denev -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (Darwin) iEYEARECAAYFAklojPYACgkQHNAJ/fLbfrlBZgCfbD6m7KuyyZEJueYLirOi7GhX Nd0AoJrOB7t2n/KOtbECbMrrAMs0pxs9 =3DsEqt -----END PGP SIGNATURE-----