From owner-freebsd-fs@FreeBSD.ORG Mon Dec 17 11:06:56 2007 Return-Path: Delivered-To: freebsd-fs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CE62D16A41B for ; Mon, 17 Dec 2007 11:06:56 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id D16FD13C4DD for ; Mon, 17 Dec 2007 11:06:56 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.2/8.14.2) with ESMTP id lBHB6uBp088207 for ; Mon, 17 Dec 2007 11:06:56 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.2/8.14.1/Submit) id lBHB6ujH088203 for freebsd-fs@FreeBSD.org; Mon, 17 Dec 2007 11:06:56 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 17 Dec 2007 11:06:56 GMT Message-Id: <200712171106.lBHB6ujH088203@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-fs@FreeBSD.org Cc: Subject: Current problem reports assigned to freebsd-fs@FreeBSD.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Dec 2007 11:06:56 -0000 Current FreeBSD problem reports Critical problems Serious problems S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/112658 fs [smbfs] [patch] smbfs and caching problems (resolves b o kern/114676 fs [ufs] snapshot creation panics: snapacct_ufs2: bad blo o kern/114856 fs [ntfs] [patch] Bug in NTFS allows bogus file modes. o kern/116170 fs Kernel panic when mounting /tmp o kern/118322 fs [panic] Sometimes (seldom), "panic:page fault" happens 5 problems total. Non-critical problems S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/114847 fs [ntfs] [patch] dirmask support for NTFS ala MSDOSFS o bin/118249 fs mv(1): moving a directory changes its mtime 2 problems total. From owner-freebsd-fs@FreeBSD.ORG Tue Dec 18 09:41:12 2007 Return-Path: Delivered-To: fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 388C616A58E for ; Tue, 18 Dec 2007 09:41:12 +0000 (UTC) (envelope-from joe@tao.org.uk) Received: from mailhost.tao.org.uk (tao.uscs.susx.ac.uk [139.184.131.101]) by mx1.freebsd.org (Postfix) with ESMTP id D82D113C468 for ; Tue, 18 Dec 2007 09:41:11 +0000 (UTC) (envelope-from joe@tao.org.uk) Received: by mailhost.tao.org.uk (Postfix, from userid 1000) id E2454766D; Tue, 18 Dec 2007 09:40:16 +0000 (GMT) Date: Tue, 18 Dec 2007 09:40:16 +0000 From: Josef Karthauser To: Gary Palmer Message-ID: <20071218094005.GA76349@transwarp.tao.org.uk> References: <20071206210848.GA63825@transwarp.tao.org.uk> <20071206215352.GA986@in-addr.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20071206215352.GA986@in-addr.com> User-Agent: Mutt/1.5.13 (2006-08-11) X-taoresearch-MailScanner-Information: Please contact Tao Research for more information X-taoresearch-MailScanner: Found to be clean X-MailScanner-From: joe@tao.org.uk Cc: fs@freebsd.org Subject: Re: -14% available on /tmp X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Dec 2007 09:41:12 -0000 On Thu, Dec 06, 2007 at 04:53:52PM -0500, Gary Palmer wrote: > On Thu, Dec 06, 2007 at 09:08:48PM +0000, Josef Karthauser wrote: > > One of my servers is reporting: > > > > # df | grep tmp > > /dev/mirror/boot0e 507630 -64328 531348 -14% /tmp > > > > How weird is that? I wonder what is going on. > > The kernel is dated: > > > > 6.2-PRERELEASE FreeBSD 6.2-PRERELEASE #68: Mon Oct 2 14:36:13 BST 2006 > > http://www.freebsd.org/doc/en_US.ISO8859-1/books/faq/disks.html#DISK-MORE-THAN-FULL > > Not sure why its -14% rather than the more normal -8%, but I suspect thats > whats happened. > No, this is a different problem surely. The device has plenty of space. it's over empty, not over full. Joe From owner-freebsd-fs@FreeBSD.ORG Thu Dec 20 14:16:56 2007 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EF7F516A418 for ; Thu, 20 Dec 2007 14:16:56 +0000 (UTC) (envelope-from amdmi3@amdmi3.ru) Received: from cp65.agava.net (cp65.agava.net [89.108.66.215]) by mx1.freebsd.org (Postfix) with ESMTP id A1E6C13C458 for ; Thu, 20 Dec 2007 14:16:56 +0000 (UTC) (envelope-from amdmi3@amdmi3.ru) Received: from [213.148.20.85] (helo=hive.panopticon) by cp65.agava.net with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.63 (FreeBSD)) (envelope-from ) id 1J5Lsv-000ID9-4g for freebsd-fs@freebsd.org; Thu, 20 Dec 2007 16:56:25 +0300 Received: from hades.panopticon (hades.panopticon [192.168.0.32]) by hive.panopticon (Postfix) with ESMTP id 56BFE762F for ; Thu, 20 Dec 2007 16:55:06 +0300 (MSK) Received: by hades.panopticon (Postfix, from userid 1000) id 9454317023; Thu, 20 Dec 2007 16:55:25 +0300 (MSK) Date: Thu, 20 Dec 2007 16:55:25 +0300 From: Dmitry Marakasov To: freebsd-fs@freebsd.org Message-ID: <20071220135525.GA3804@hades.panopticon> Mail-Followup-To: freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=koi8-r Content-Disposition: inline User-Agent: Mutt/1.5.16 (2007-06-09) X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - cp65.agava.net X-AntiAbuse: Original Domain - freebsd.org X-AntiAbuse: Originator/Caller UID/GID - [0 0] / [26 6] X-AntiAbuse: Sender Address Domain - amdmi3.ru X-Source: X-Source-Args: X-Source-Dir: Subject: alternative automounter solution X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Dec 2007 14:16:57 -0000 Hi! I have all my data on NAS available via NFS. NAS uses zfs, so there are many filesystems for movies, music, iso's etc. I use standart AMD to automatically mount all the filesystems on my desktop, and it works well, but I also have vsftpd in jail, and I want to make some data accessible via that ftp as well. Actually, I don't want to run amd inside the jail for security. NFS has no secrity at all, and I don't want all filesystems to be mountable from within the jail. Using host system amd could work, but there's problem with symlinks. While on host system everything is OK: /.amd_mnt/nas/music /data/music -> /.amd.mnt/nas/music it won't work for the jail: /ftpjail/.amd_mnt/nas/music /ftpjail/anonftp/music -> /ftpjail/.amd.mnt/nas/music i.e. amd creates absolute symlink, which won't work in /ftpjail chroot. What will work is: /ftpjail/anonftp/music -> /.amd.mnt/nas/music /ftpjail/anonftp/music -> ../.amd.mnt/nas/music But as far as I understand there's no way to make amd behave like that. Any solutions? The best thing will be amd alternative with clearer config and map syntax. -- Dmitry A. Marakasov | jabber: amdmi3@jabber.ru amdmi3@amdmi3.ru | http://www.amdmi3.ru From owner-freebsd-fs@FreeBSD.ORG Thu Dec 20 15:35:08 2007 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6869616A419 for ; Thu, 20 Dec 2007 15:35:08 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from ccshst09.cs.uoguelph.ca (ccshst09.cs.uoguelph.ca [131.104.94.206]) by mx1.freebsd.org (Postfix) with ESMTP id 0CF1413C44B for ; Thu, 20 Dec 2007 15:35:07 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from muncher.cs.uoguelph.ca (muncher.cs.uoguelph.ca [131.104.91.102]) by ccshst09.cs.uoguelph.ca (8.13.1/8.13.1) with ESMTP id lBKFLSK9026588; Thu, 20 Dec 2007 10:21:28 -0500 Received: from localhost (rmacklem@localhost) by muncher.cs.uoguelph.ca (8.11.7p3+Sun/8.11.6) with ESMTP id lBKFNVY06339; Thu, 20 Dec 2007 10:23:31 -0500 (EST) X-Authentication-Warning: muncher.cs.uoguelph.ca: rmacklem owned process doing -bs Date: Thu, 20 Dec 2007 10:23:31 -0500 (EST) From: Rick Macklem X-X-Sender: rmacklem@muncher.cs.uoguelph.ca To: Dmitry Marakasov In-Reply-To: <20071220135525.GA3804@hades.panopticon> Message-ID: References: <20071220135525.GA3804@hades.panopticon> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed X-Scanned-By: MIMEDefang 2.63 on 131.104.94.206 Cc: freebsd-fs@freebsd.org Subject: Re: alternative automounter solution X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Dec 2007 15:35:08 -0000 On Thu, 20 Dec 2007, Dmitry Marakasov wrote: [stuff snipped] > with symlinks. While on host system everything is OK: > > /.amd_mnt/nas/music > /data/music -> /.amd.mnt/nas/music > > it won't work for the jail: > > /ftpjail/.amd_mnt/nas/music > /ftpjail/anonftp/music -> /ftpjail/.amd.mnt/nas/music > > i.e. amd creates absolute symlink, which won't work in /ftpjail chroot. > What will work is: > > /ftpjail/anonftp/music -> /.amd.mnt/nas/music > /ftpjail/anonftp/music -> ../.amd.mnt/nas/music > > But as far as I understand there's no way to make amd behave like that. > > Any solutions? The best thing will be amd alternative with clearer > config and map syntax. > I think someone was working on an auto_fs port, but I don't know anything about auto_fs or the current state of any port. Alternately, it's open source, so you could hack it? (Again, I haven't looked at the sources, so I don't know if this is easy.) rick, who always just uses static nfs mounts From owner-freebsd-fs@FreeBSD.ORG Thu Dec 20 20:40:08 2007 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 61AAF16A4E1; Thu, 20 Dec 2007 20:40:08 +0000 (UTC) (envelope-from peter.schuller@infidyne.com) Received: from smtp.infidyne.com (ds9.infidyne.com [88.80.6.206]) by mx1.freebsd.org (Postfix) with ESMTP id 1684D13C455; Thu, 20 Dec 2007 20:40:08 +0000 (UTC) (envelope-from peter.schuller@infidyne.com) Received: from c-8216e555.03-51-73746f3.cust.bredbandsbolaget.se (c-8216e555.03-51-73746f3.cust.bredbandsbolaget.se [85.229.22.130]) by smtp.infidyne.com (Postfix) with ESMTP id 77FC677539; Thu, 20 Dec 2007 21:40:06 +0100 (CET) From: Peter Schuller To: freebsd-fs@freebsd.org, ticso@cicely.de Date: Thu, 20 Dec 2007 21:40:00 +0100 User-Agent: KMail/1.9.7 References: <20071207174914.GQ10459@cicely12.cicely.de> In-Reply-To: <20071207174914.GQ10459@cicely12.cicely.de> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="nextPart1892641.kd1lzOhxf9"; protocol="application/pgp-signature"; micalg=pgp-sha1 Content-Transfer-Encoding: 7bit Message-Id: <200712202140.08367.peter.schuller@infidyne.com> Cc: Ivan Voras Subject: Re: readv: parallel or sequential? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Dec 2007 20:40:08 -0000 --nextPart1892641.kd1lzOhxf9 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline > Yes, but how can it now that it is on a RAID0 and taking advantage of > multiple spindles instead of making it worse? > The FS has to do sensible things for single spindle as well. > And normaly disks are fastest when reading linear and with disk read > caches this doesn't even have to be interleaved. > I don't see any potential for parallell access within the same file > beside some special constructed cases maybe. I strongly disagree here. I would expect the operating system to not serial= ize=20 all I/O to the same file descriptor/file, if done in paralell from multiple= =20 threads or through AIO. I have at least on use case heavily dependent on=20 this - does this mean FreeBSD would not be usable for this? Not to mention things like databases (e.g. high concurrency I/O in PostgreS= QL=20 or whatever). You most definitely want concurrent I/O if supported by the=20 underlying device. Are we saying here that I/O scheduling happens at a just below the file=20 system, rather than at the individual device level? I would have assumed th= at=20 a particular geom class would just forward (modified) I/O requests to the=20 underlying device, such that when the request reaches a device actually doi= ng=20 I/O to some external entity, it can intelligently schedule in a way that is= =20 optimal. Or am I misunderstanding something in this discussion? =2D-=20 / Peter Schuller PGP userID: 0xE9758B7D or 'Peter Schuller ' Key retrieval: Send an E-Mail to getpgpkey@scode.org E-Mail: peter.schuller@infidyne.com Web: http://www.scode.org --nextPart1892641.kd1lzOhxf9 Content-Type: application/pgp-signature; name=signature.asc Content-Description: This is a digitally signed message part. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4 (FreeBSD) iD8DBQBHatMoDNor2+l1i30RAr2LAKCD3H/CKuMJn9ylOddOJNkpdfk2fgCgsVz9 PBPccGBzLdAi7ZeRwaEAjv0= =ZnGO -----END PGP SIGNATURE----- --nextPart1892641.kd1lzOhxf9-- From owner-freebsd-fs@FreeBSD.ORG Thu Dec 20 22:17:47 2007 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3C5EE16A418; Thu, 20 Dec 2007 22:17:47 +0000 (UTC) (envelope-from ticso@cicely12.cicely.de) Received: from raven.bwct.de (raven.bwct.de [85.159.14.73]) by mx1.freebsd.org (Postfix) with ESMTP id A384813C4E3; Thu, 20 Dec 2007 22:17:46 +0000 (UTC) (envelope-from ticso@cicely12.cicely.de) Received: from cicely5.cicely.de ([10.1.1.7]) by raven.bwct.de (8.13.4/8.13.4) with ESMTP id lBKMHit6053006; Thu, 20 Dec 2007 23:17:44 +0100 (CET) (envelope-from ticso@cicely12.cicely.de) Received: from cicely12.cicely.de (cicely12.cicely.de [10.1.1.14]) by cicely5.cicely.de (8.13.4/8.13.4) with ESMTP id lBKMHaiv081939 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 20 Dec 2007 23:17:36 +0100 (CET) (envelope-from ticso@cicely12.cicely.de) Received: from cicely12.cicely.de (localhost [127.0.0.1]) by cicely12.cicely.de (8.13.4/8.13.3) with ESMTP id lBKMHZRr068282; Thu, 20 Dec 2007 23:17:35 +0100 (CET) (envelope-from ticso@cicely12.cicely.de) Received: (from ticso@localhost) by cicely12.cicely.de (8.13.4/8.13.3/Submit) id lBKMHZLj068281; Thu, 20 Dec 2007 23:17:35 +0100 (CET) (envelope-from ticso) Date: Thu, 20 Dec 2007 23:17:35 +0100 From: Bernd Walter To: Peter Schuller Message-ID: <20071220221735.GB67140@cicely12.cicely.de> References: <20071207174914.GQ10459@cicely12.cicely.de> <200712202140.08367.peter.schuller@infidyne.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <200712202140.08367.peter.schuller@infidyne.com> X-Operating-System: FreeBSD cicely12.cicely.de 5.4-STABLE alpha User-Agent: Mutt/1.5.9i X-Spam-Status: No, score=-4.4 required=5.0 tests=ALL_TRUSTED=-1.8, BAYES_00=-2.599 autolearn=ham version=3.1.7 X-Spam-Checker-Version: SpamAssassin 3.1.7 (2006-10-05) on cicely12.cicely.de Cc: freebsd-fs@freebsd.org, ticso@cicely.de, Ivan Voras Subject: Re: readv: parallel or sequential? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: ticso@cicely.de List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Dec 2007 22:17:47 -0000 On Thu, Dec 20, 2007 at 09:40:00PM +0100, Peter Schuller wrote: > > Yes, but how can it now that it is on a RAID0 and taking advantage of > > multiple spindles instead of making it worse? > > The FS has to do sensible things for single spindle as well. > > And normaly disks are fastest when reading linear and with disk read > > caches this doesn't even have to be interleaved. > > I don't see any potential for parallell access within the same file > > beside some special constructed cases maybe. > > I strongly disagree here. I would expect the operating system to not serialize > all I/O to the same file descriptor/file, if done in paralell from multiple > threads or through AIO. I have at least on use case heavily dependent on > this - does this mean FreeBSD would not be usable for this? No - I just didn't though about this. In most cases a single file means serialized use from the application, but of course this is not true in every case. In case the application uses serialized access there is not much to do beside preread or caching writes to make use of multiple spindles. But an application has to be carefull, because parallel access within a single file almost always mean that access is not linear anymore, so many opther performance tunings won't work as good as they could, so this could easily outweight the performance gain from multiple access. Nonlinear access from within an application has to be for another reason and not as a performance tuning. -- B.Walter http://www.bwct.de http://www.fizon.de bernd@bwct.de info@bwct.de support@fizon.de From owner-freebsd-fs@FreeBSD.ORG Thu Dec 20 22:25:24 2007 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2C0D016A41B for ; Thu, 20 Dec 2007 22:25:24 +0000 (UTC) (envelope-from julian@elischer.org) Received: from outL.internet-mail-service.net (outL.internet-mail-service.net [216.240.47.235]) by mx1.freebsd.org (Postfix) with ESMTP id 1401313C458 for ; Thu, 20 Dec 2007 22:25:23 +0000 (UTC) (envelope-from julian@elischer.org) Received: from mx0.idiom.com (HELO idiom.com) (216.240.32.160) by out.internet-mail-service.net (qpsmtpd/0.40) with ESMTP; Thu, 20 Dec 2007 14:25:23 -0800 Received: from julian-mac.elischer.org (localhost [127.0.0.1]) by idiom.com (Postfix) with ESMTP id A66C2126D39; Thu, 20 Dec 2007 14:25:22 -0800 (PST) Message-ID: <476AEBD1.5020307@elischer.org> Date: Thu, 20 Dec 2007 14:25:21 -0800 From: Julian Elischer User-Agent: Thunderbird 2.0.0.9 (Macintosh/20071031) MIME-Version: 1.0 To: ticso@cicely.de References: <20071207174914.GQ10459@cicely12.cicely.de> <200712202140.08367.peter.schuller@infidyne.com> <20071220221735.GB67140@cicely12.cicely.de> In-Reply-To: <20071220221735.GB67140@cicely12.cicely.de> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-fs@freebsd.org, Ivan Voras Subject: Re: readv: parallel or sequential? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Dec 2007 22:25:24 -0000 Bernd Walter wrote: > On Thu, Dec 20, 2007 at 09:40:00PM +0100, Peter Schuller wrote: >>> Yes, but how can it now that it is on a RAID0 and taking advantage of >>> multiple spindles instead of making it worse? >>> The FS has to do sensible things for single spindle as well. >>> And normaly disks are fastest when reading linear and with disk read >>> caches this doesn't even have to be interleaved. >>> I don't see any potential for parallell access within the same file >>> beside some special constructed cases maybe. >> I strongly disagree here. I would expect the operating system to not serialize >> all I/O to the same file descriptor/file, if done in paralell from multiple >> threads or through AIO. I have at least on use case heavily dependent on >> this - does this mean FreeBSD would not be usable for this? > > No - I just didn't though about this. > In most cases a single file means serialized use from the application, > but of course this is not true in every case. > In case the application uses serialized access there is not much to do > beside preread or caching writes to make use of multiple spindles. > But an application has to be carefull, because parallel access within > a single file almost always mean that access is not linear anymore, so > many opther performance tunings won't work as good as they could, so > this could easily outweight the performance gain from multiple access. > Nonlinear access from within an application has to be for another reason > and not as a performance tuning. If you want to write to different points in a file you can always open multiple file descriptors to the same file. All IO to a single descriptor MUST be serialised. From owner-freebsd-fs@FreeBSD.ORG Thu Dec 20 22:35:41 2007 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5B2AB16A41B; Thu, 20 Dec 2007 22:35:41 +0000 (UTC) (envelope-from ticso@cicely12.cicely.de) Received: from raven.bwct.de (raven.bwct.de [85.159.14.73]) by mx1.freebsd.org (Postfix) with ESMTP id DAA2713C461; Thu, 20 Dec 2007 22:35:40 +0000 (UTC) (envelope-from ticso@cicely12.cicely.de) Received: from cicely5.cicely.de ([10.1.1.7]) by raven.bwct.de (8.13.4/8.13.4) with ESMTP id lBKMZaVX053574; Thu, 20 Dec 2007 23:35:36 +0100 (CET) (envelope-from ticso@cicely12.cicely.de) Received: from cicely12.cicely.de (cicely12.cicely.de [10.1.1.14]) by cicely5.cicely.de (8.13.4/8.13.4) with ESMTP id lBKMZSZf082054 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 20 Dec 2007 23:35:28 +0100 (CET) (envelope-from ticso@cicely12.cicely.de) Received: from cicely12.cicely.de (localhost [127.0.0.1]) by cicely12.cicely.de (8.13.4/8.13.3) with ESMTP id lBKMZSo1068328; Thu, 20 Dec 2007 23:35:28 +0100 (CET) (envelope-from ticso@cicely12.cicely.de) Received: (from ticso@localhost) by cicely12.cicely.de (8.13.4/8.13.3/Submit) id lBKMZR1C068327; Thu, 20 Dec 2007 23:35:27 +0100 (CET) (envelope-from ticso) Date: Thu, 20 Dec 2007 23:35:27 +0100 From: Bernd Walter To: Julian Elischer Message-ID: <20071220223527.GC67140@cicely12.cicely.de> References: <20071207174914.GQ10459@cicely12.cicely.de> <200712202140.08367.peter.schuller@infidyne.com> <20071220221735.GB67140@cicely12.cicely.de> <476AEBD1.5020307@elischer.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <476AEBD1.5020307@elischer.org> X-Operating-System: FreeBSD cicely12.cicely.de 5.4-STABLE alpha User-Agent: Mutt/1.5.9i X-Spam-Status: No, score=-4.4 required=5.0 tests=ALL_TRUSTED=-1.8, BAYES_00=-2.599 autolearn=ham version=3.1.7 X-Spam-Checker-Version: SpamAssassin 3.1.7 (2006-10-05) on cicely12.cicely.de Cc: freebsd-fs@freebsd.org, ticso@cicely.de, Ivan Voras Subject: Re: readv: parallel or sequential? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: ticso@cicely.de List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Dec 2007 22:35:41 -0000 On Thu, Dec 20, 2007 at 02:25:21PM -0800, Julian Elischer wrote: > Bernd Walter wrote: > >On Thu, Dec 20, 2007 at 09:40:00PM +0100, Peter Schuller wrote: > >>>Yes, but how can it now that it is on a RAID0 and taking advantage of > >>>multiple spindles instead of making it worse? > >>>The FS has to do sensible things for single spindle as well. > >>>And normaly disks are fastest when reading linear and with disk read > >>>caches this doesn't even have to be interleaved. > >>>I don't see any potential for parallell access within the same file > >>>beside some special constructed cases maybe. > >>I strongly disagree here. I would expect the operating system to not > >>serialize all I/O to the same file descriptor/file, if done in paralell > >>from multiple threads or through AIO. I have at least on use case heavily > >>dependent on this - does this mean FreeBSD would not be usable for this? > > > >No - I just didn't though about this. > >In most cases a single file means serialized use from the application, > >but of course this is not true in every case. > >In case the application uses serialized access there is not much to do > >beside preread or caching writes to make use of multiple spindles. > >But an application has to be carefull, because parallel access within > >a single file almost always mean that access is not linear anymore, so > >many opther performance tunings won't work as good as they could, so > >this could easily outweight the performance gain from multiple access. > >Nonlinear access from within an application has to be for another reason > >and not as a performance tuning. > > If you want to write to different points in a file you can always open > multiple file descriptors to the same file. Or mmap the file and access it with multiple threads. > All IO to a single descriptor MUST be serialised. -- B.Walter http://www.bwct.de http://www.fizon.de bernd@bwct.de info@bwct.de support@fizon.de From owner-freebsd-fs@FreeBSD.ORG Thu Dec 20 23:36:51 2007 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E390116A421; Thu, 20 Dec 2007 23:36:51 +0000 (UTC) (envelope-from peter.schuller@infidyne.com) Received: from smtp.infidyne.com (ds9.infidyne.com [88.80.6.206]) by mx1.freebsd.org (Postfix) with ESMTP id A14E313C448; Thu, 20 Dec 2007 23:36:51 +0000 (UTC) (envelope-from peter.schuller@infidyne.com) Received: from c-8216e555.03-51-73746f3.cust.bredbandsbolaget.se (c-8216e555.03-51-73746f3.cust.bredbandsbolaget.se [85.229.22.130]) by smtp.infidyne.com (Postfix) with ESMTP id 4C1B57785C; Fri, 21 Dec 2007 00:36:50 +0100 (CET) From: Peter Schuller To: ticso@cicely.de Date: Fri, 21 Dec 2007 00:36:40 +0100 User-Agent: KMail/1.9.7 References: <200712202140.08367.peter.schuller@infidyne.com> <20071220221735.GB67140@cicely12.cicely.de> In-Reply-To: <20071220221735.GB67140@cicely12.cicely.de> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="nextPart2867901.o7Q3KWBikV"; protocol="application/pgp-signature"; micalg=pgp-sha1 Content-Transfer-Encoding: 7bit Message-Id: <200712210036.49040.peter.schuller@infidyne.com> Cc: freebsd-fs@freebsd.org, Ivan Voras Subject: Re: readv: parallel or sequential? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Dec 2007 23:36:52 -0000 --nextPart2867901.o7Q3KWBikV Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline > In case the application uses serialized access there is not much to do > beside preread or caching writes to make use of multiple spindles. Agreed. > But an application has to be carefull, because parallel access within > a single file almost always mean that access is not linear anymore, so > many opther performance tunings won't work as good as they could, so > this could easily outweight the performance gain from multiple access. =46or seek bound applications you don't really care anyway. If you have a=20 mixture of stream bound and seak bound I/O going on you will run into vario= us=20 issues which are difficult to avoid without very careful application-specif= ic=20 tuning I think. But for the simple case of doing concurrent seek-bound I/O = I=20 would expect it to be handled gracefully by the OS. And I do mean to the same file, rather than file descriptor (in response to= =20 the other post on descriptors). > Nonlinear access from within an application has to be for another reason > and not as a performance tuning. Why? Again, PostgreSQL, other databases, or any file access pattern which i= s=20 seek bound stands to gain more or less linearly from concurrent I/O being=20 propagated to constituent devices in a non-serialized fashion. This is a=20 pretty basic assumption in my book when designing an application. Whenever= =20 something is seek bound, assuming I have concurrency in my app, I look at t= he=20 number of constituent devices on the device and the type of RAID or similar= =20 being used (including stripe sizes in relation to the size of my I/O=20 requests, etc). I fully expect to be able to scale linearly with the number of underlying=20 devices, assuming raid0/raid10 or something equivalent, and assuming I have= a=20 concurrency that is sufficiently high to keep all drives busy. (There are valid exceptions of course, such as raidz/raidz2. But that's bey= ond=20 the scope of this discussion.) =2D-=20 / Peter Schuller PGP userID: 0xE9758B7D or 'Peter Schuller ' Key retrieval: Send an E-Mail to getpgpkey@scode.org E-Mail: peter.schuller@infidyne.com Web: http://www.scode.org --nextPart2867901.o7Q3KWBikV Content-Type: application/pgp-signature; name=signature.asc Content-Description: This is a digitally signed message part. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4 (FreeBSD) iD8DBQBHavyQDNor2+l1i30RAn9BAJ4ookJhNAFYuq2ft6B+Gb2TcU4wKgCeI6mI /9J8DnwEekbyfZcTLUEO/+Y= =P/2n -----END PGP SIGNATURE----- --nextPart2867901.o7Q3KWBikV-- From owner-freebsd-fs@FreeBSD.ORG Thu Dec 20 23:41:51 2007 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 405A916A417 for ; Thu, 20 Dec 2007 23:41:51 +0000 (UTC) (envelope-from julian@elischer.org) Received: from outT.internet-mail-service.net (outT.internet-mail-service.net [216.240.47.243]) by mx1.freebsd.org (Postfix) with ESMTP id 250BD13C474 for ; Thu, 20 Dec 2007 23:41:51 +0000 (UTC) (envelope-from julian@elischer.org) Received: from mx0.idiom.com (HELO idiom.com) (216.240.32.160) by out.internet-mail-service.net (qpsmtpd/0.40) with ESMTP; Thu, 20 Dec 2007 15:41:50 -0800 Received: from julian-mac.elischer.org (localhost [127.0.0.1]) by idiom.com (Postfix) with ESMTP id CB7C6126D15; Thu, 20 Dec 2007 15:41:49 -0800 (PST) Message-ID: <476AFDBC.9040301@elischer.org> Date: Thu, 20 Dec 2007 15:41:48 -0800 From: Julian Elischer User-Agent: Thunderbird 2.0.0.9 (Macintosh/20071031) MIME-Version: 1.0 To: Peter Schuller References: <200712202140.08367.peter.schuller@infidyne.com> <20071220221735.GB67140@cicely12.cicely.de> <200712210036.49040.peter.schuller@infidyne.com> In-Reply-To: <200712210036.49040.peter.schuller@infidyne.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-fs@freebsd.org, ticso@cicely.de, Ivan Voras Subject: Re: readv: parallel or sequential? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Dec 2007 23:41:51 -0000 Peter Schuller wrote: >> In case the application uses serialized access there is not much to do >> beside preread or caching writes to make use of multiple spindles. > > Agreed. > >> But an application has to be carefull, because parallel access within >> a single file almost always mean that access is not linear anymore, so >> many opther performance tunings won't work as good as they could, so >> this could easily outweight the performance gain from multiple access. > > For seek bound applications you don't really care anyway. If you have a > mixture of stream bound and seak bound I/O going on you will run into various > issues which are difficult to avoid without very careful application-specific > tuning I think. But for the simple case of doing concurrent seek-bound I/O I > would expect it to be handled gracefully by the OS. > > And I do mean to the same file, rather than file descriptor (in response to > the other post on descriptors). > >> Nonlinear access from within an application has to be for another reason >> and not as a performance tuning. > > Why? Again, PostgreSQL, other databases, or any file access pattern which is > seek bound stands to gain more or less linearly from concurrent I/O being > propagated to constituent devices in a non-serialized fashion. This is a > pretty basic assumption in my book when designing an application. Whenever > something is seek bound, assuming I have concurrency in my app, I look at the > number of constituent devices on the device and the type of RAID or similar > being used (including stripe sizes in relation to the size of my I/O > requests, etc). > > I fully expect to be able to scale linearly with the number of underlying > devices, assuming raid0/raid10 or something equivalent, and assuming I have a > concurrency that is sufficiently high to keep all drives busy. > > (There are valid exceptions of course, such as raidz/raidz2. But that's beyond > the scope of this discussion.) multiple reads and writes to the same file *From different file descriptors* (same process or not) might proceed in "parallel" but readv and writev will be implemented serially to the filesystem. now IF THE FILESYSTEM IS NOT DOING SYNCHRONOUS DISK ACCESSES the reads and writes might proceed in parallel or be grouped, clustered or otherwise rearanged. > From owner-freebsd-fs@FreeBSD.ORG Thu Dec 20 23:51:42 2007 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4C33916A417; Thu, 20 Dec 2007 23:51:42 +0000 (UTC) (envelope-from peter.schuller@infidyne.com) Received: from smtp.infidyne.com (ds9.infidyne.com [88.80.6.206]) by mx1.freebsd.org (Postfix) with ESMTP id 0AD5713C45B; Thu, 20 Dec 2007 23:51:41 +0000 (UTC) (envelope-from peter.schuller@infidyne.com) Received: from c-8216e555.03-51-73746f3.cust.bredbandsbolaget.se (c-8216e555.03-51-73746f3.cust.bredbandsbolaget.se [85.229.22.130]) by smtp.infidyne.com (Postfix) with ESMTP id 3D20677887; Fri, 21 Dec 2007 00:51:40 +0100 (CET) From: Peter Schuller To: Julian Elischer Date: Fri, 21 Dec 2007 00:51:33 +0100 User-Agent: KMail/1.9.7 References: <200712210036.49040.peter.schuller@infidyne.com> <476AFDBC.9040301@elischer.org> In-Reply-To: <476AFDBC.9040301@elischer.org> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="nextPart1325381.rZX7Dr3quE"; protocol="application/pgp-signature"; micalg=pgp-sha1 Content-Transfer-Encoding: 7bit Message-Id: <200712210051.41936.peter.schuller@infidyne.com> Cc: freebsd-fs@freebsd.org, ticso@cicely.de, Ivan Voras Subject: Re: readv: parallel or sequential? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Dec 2007 23:51:42 -0000 --nextPart1325381.rZX7Dr3quE Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline > multiple reads and writes to the same file *From different file > descriptors* (same process or not) might proceed in "parallel" but readv > and writev will be implemented serially to the filesystem. now IF THE > FILESYSTEM IS NOT DOING SYNCHRONOUS DISK ACCESSES the reads and writes > might proceed in parallel or be grouped, clustered or otherwise rearanged. If the original claims were just as applied to readv/writev, I don't really= =20 have a problem since there is no guarantee that it will be performed in=20 parallel (though even then, assuming non-synchronous writes, it would=20 certainly be nice if it did pass it along to the device layer in a fashion= =20 that allowed concurrency). But when I/O is clearly being done with the intent of concurrency (by using= =20 AIO or by performing the I/O in different threads/processes), it is more=20 important. =2D-=20 / Peter Schuller PGP userID: 0xE9758B7D or 'Peter Schuller ' Key retrieval: Send an E-Mail to getpgpkey@scode.org E-Mail: peter.schuller@infidyne.com Web: http://www.scode.org --nextPart1325381.rZX7Dr3quE Content-Type: application/pgp-signature; name=signature.asc Content-Description: This is a digitally signed message part. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4 (FreeBSD) iD8DBQBHawANDNor2+l1i30RApKtAJ42aWOvXKnYbC73AoXaZvza/I1MVwCdFei1 0FAfRm9x1swgNtx3YDTVmww= =NQ+4 -----END PGP SIGNATURE----- --nextPart1325381.rZX7Dr3quE-- From owner-freebsd-fs@FreeBSD.ORG Fri Dec 21 03:11:28 2007 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 75E2B16A418 for ; Fri, 21 Dec 2007 03:11:28 +0000 (UTC) (envelope-from moonshade@pnhz.kz) Received: from relay.pnhz.kz (relay.pnhz.kz [212.154.198.217]) by mx1.freebsd.org (Postfix) with ESMTP id B12B813C442 for ; Fri, 21 Dec 2007 03:11:27 +0000 (UTC) (envelope-from moonshade@pnhz.kz) Received: from [192.168.121.40] (abyss.pnhz.kz [192.168.121.40]) by relay.pnhz.kz with ESMTP id lBL3BIxd072173; Fri, 21 Dec 2007 09:11:18 +0600 (ALMT) (envelope-from moonshade@pnhz.kz) From: Denis Eremenko To: Lowell Gilbert In-Reply-To: <44mysdjrum.fsf@Lowell-Desk.lan> References: <1197437356.5183.24.camel@abyss.pnhz.kz> <44mysdjrum.fsf@Lowell-Desk.lan> Content-Type: text/plain; charset=KOI8-R Date: Fri, 21 Dec 2007 09:11:15 +0600 Message-Id: <1198206675.12065.5.camel@abyss.pnhz.kz> Mime-Version: 1.0 X-Mailer: Evolution 2.12.1 FreeBSD GNOME Team Port Content-Transfer-Encoding: 8bit Cc: freebsd-fs@freebsd.org Subject: Re: fstat and filenames X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Dec 2007 03:11:28 -0000 ÷ ÐÔ, 14/12/2007 × 09:03 -0500, Lowell Gilbert ÐÉÛÅÔ: > moonshade@pnhz.kz (Denis Eremenko) writes: > > > Why fstat so secretive about file names and unix domain sockets? > > With respect to file names, you need to remember that there may not be > a unique answer. A file handle's metadata doesn't keep information > about how it was opened, just the inode. That inode could belong to > multiple directory entries, or none -- this is why, as the fstat(1) > manual points out, "there is no mapping from an open file back to the > directory entry that was used to open that file." Yes. I clearly understand difficulties of exact inode-name mapping. And i saw manpage note too. But doesn't _some_and_maybe_wrong_ information better than nothing? Additionally - most files has one filesystem record. > As far as unix domain sockets, I don't understand the question. Sorry. fstat doesn't show their names too. From owner-freebsd-fs@FreeBSD.ORG Fri Dec 21 20:27:36 2007 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 512CE16A417 for ; Fri, 21 Dec 2007 20:27:36 +0000 (UTC) (envelope-from jklimek@gmail.com) Received: from hs-out-2122.google.com (hs-out-0708.google.com [64.233.178.241]) by mx1.freebsd.org (Postfix) with ESMTP id EE5E413C457 for ; Fri, 21 Dec 2007 20:27:35 +0000 (UTC) (envelope-from jklimek@gmail.com) Received: by hs-out-2122.google.com with SMTP id j58so446560hsj.11 for ; Fri, 21 Dec 2007 12:27:35 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition; bh=fegCvTuJ71Qi5hlxBd6ouT53ZpuF/+n4MdE8oxo+3gQ=; b=fhZdnNPlUx7LpG7ckvF5BCWNfW8jv8P2gFeZdKykTo9W4FhDp5RQ8teyjnzxk65H4LXeb3B9AonB/6HvOqlvsz5/i+wNrXTO5b8eYc4y0tHUuNMWj3yGVHoknHlt5ssV07El9t+fA7OMLLnD8hvBYDG2QnPmHBoFO+GrtJr4m/A= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition; b=xs+glVtYvyn921Krm6dYBFM37fKLPi2RUOC71xSxu/xtttAtOf3nZk9rRebnNQhcFDOnVAJzg86BFST+3iEzEGez+2TTyd4inOPp5+OQ0BQeMzrrFN9tvkgPUSmr/6kOOKzPXl93otSfXFpTVNdvSB4MDKqH551LevGD/1oGNXI= Received: by 10.142.237.20 with SMTP id k20mr894068wfh.174.1198267286027; Fri, 21 Dec 2007 12:01:26 -0800 (PST) Received: by 10.142.254.3 with HTTP; Fri, 21 Dec 2007 12:01:25 -0800 (PST) Message-ID: Date: Fri, 21 Dec 2007 15:01:25 -0500 From: "John Klimek" To: freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline Subject: How safe is ZFS to use for a home user? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Dec 2007 20:27:36 -0000 I'm looking to setup a file server using RAID 5 (or the equivilant RAID-Z) and I'm interested in using ZFS. It looks like my primary options are Solaris or FreeBSD and since I'm beginning to really dislike Solaris I'm leaning towards using FreeBSD however I've heard that there are some issues with ZFS on FreeBSD specifically regarding some "kmap_mem" or something like that. Can anybody tell me if ZFS is safe to use for home users? I'm just looking to setup RAID-Z with 3x 300 GB and another pool for 1x80GB (I guess). Thanks for any help! From owner-freebsd-fs@FreeBSD.ORG Sat Dec 22 01:28:41 2007 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7F6ED16A417 for ; Sat, 22 Dec 2007 01:28:41 +0000 (UTC) (envelope-from rwatson@FreeBSD.org) Received: from cyrus.watson.org (cyrus.watson.org [209.31.154.42]) by mx1.freebsd.org (Postfix) with ESMTP id 406D413C442 for ; Sat, 22 Dec 2007 01:28:41 +0000 (UTC) (envelope-from rwatson@FreeBSD.org) Received: from fledge.watson.org (fledge.watson.org [209.31.154.41]) by cyrus.watson.org (Postfix) with ESMTP id CBC5748C13; Fri, 21 Dec 2007 20:10:16 -0500 (EST) Date: Sat, 22 Dec 2007 01:10:16 +0000 (GMT) From: Robert Watson X-X-Sender: robert@fledge.watson.org To: Denis Eremenko In-Reply-To: <1198206675.12065.5.camel@abyss.pnhz.kz> Message-ID: <20071222010629.F67327@fledge.watson.org> References: <1197437356.5183.24.camel@abyss.pnhz.kz> <44mysdjrum.fsf@Lowell-Desk.lan> <1198206675.12065.5.camel@abyss.pnhz.kz> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: freebsd-fs@freebsd.org, Lowell Gilbert Subject: Re: fstat and filenames X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Dec 2007 01:28:41 -0000 On Fri, 21 Dec 2007, Denis Eremenko wrote: > ? ??, 14/12/2007 ? 09:03 -0500, Lowell Gilbert ?????: >> moonshade@pnhz.kz (Denis Eremenko) writes: >> >>> Why fstat so secretive about file names and unix domain sockets? >> >> With respect to file names, you need to remember that there may not be a >> unique answer. A file handle's metadata doesn't keep information about how >> it was opened, just the inode. That inode could belong to multiple >> directory entries, or none -- this is why, as the fstat(1) manual points >> out, "there is no mapping from an open file back to the directory entry >> that was used to open that file." > > Yes. I clearly understand difficulties of exact inode-name mapping. And i > saw manpage note too. But doesn't _some_and_maybe_wrong_ information better > than nothing? Additionally - most files has one filesystem record. > >> As far as unix domain sockets, I don't understand the question. Sorry. > fstat doesn't show their names too. The procstat(1) command now present in 8.x, and likely to be MFC'd to 7.x after 7.0 but before 7.1 will allow you to inspect that information. And indeed, it will sometimes fail to be able to resolve a path for the object in which case it won't return one. It needs a bit of refinement before it can be MFC'd; it relies on the kernel vn_fullpath(9) KPI, which uses the name cache, but some synthetic file systems (i.e., devfs) don't use the name cache, so it fails for all device nodes (for example). Robert N M Watson Computer Laboratory University of Cambridge From owner-freebsd-fs@FreeBSD.ORG Sat Dec 22 02:01:59 2007 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7018C16A418 for ; Sat, 22 Dec 2007 02:01:59 +0000 (UTC) (envelope-from hugo@barafranca.com) Received: from mail.barafranca.com (mail.barafranca.com [67.19.101.164]) by mx1.freebsd.org (Postfix) with ESMTP id 37AE813C458 for ; Sat, 22 Dec 2007 02:01:59 +0000 (UTC) (envelope-from hugo@barafranca.com) Received: from localhost (localhost [127.0.0.1]) by mail.barafranca.com (Postfix) with ESMTP id 0A855C382E; Sat, 22 Dec 2007 01:51:47 +0000 (UTC) Received: from mail.barafranca.com ([67.19.101.164]) by localhost (mail.barafranca.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 51760-08; Sat, 22 Dec 2007 01:51:10 +0000 (UTC) Received: from nexus.bsdlan.org (a213-22-38-76.cpe.netcabo.pt [213.22.38.76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.barafranca.com (Postfix) with ESMTP id A1F84C50E4; Sat, 22 Dec 2007 01:51:09 +0000 (UTC) Message-ID: <476C6BE1.3000403@barafranca.com> Date: Sat, 22 Dec 2007 01:44:01 +0000 From: Hugo Silva User-Agent: Thunderbird 2.0.0.6 (X11/20070816) MIME-Version: 1.0 To: John Klimek , freebsd-fs@freebsd.org References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: amavisd-new at barafranca.com X-Spam-Status: No, score=0 tagged_above=-1 required=4 tests=[none] X-Spam-Score: 0 X-Spam-Level: Cc: Subject: Re: How safe is ZFS to use for a home user? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Dec 2007 02:01:59 -0000 John Klimek wrote: > I'm looking to setup a file server using RAID 5 (or the equivilant > RAID-Z) and I'm interested in using ZFS. > > It looks like my primary options are Solaris or FreeBSD and since I'm > beginning to really dislike Solaris I'm leaning towards using FreeBSD > however I've heard that there are some issues with ZFS on FreeBSD > specifically regarding some "kmap_mem" or something like that. > > Can anybody tell me if ZFS is safe to use for home users? I'm just > looking to setup RAID-Z with 3x 300 GB and another pool for 1x80GB (I > guess). > > Thanks for any help! > _______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > Pretty safe, I've been using it on my workstation for several months, and on my new home file server for a month. I have a mirror of 2 disks on the workstation and 2 mirrors of 2 disks on the fileserver. Regards, Hugo From owner-freebsd-fs@FreeBSD.ORG Sat Dec 22 03:34:07 2007 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E87F916A418 for ; Sat, 22 Dec 2007 03:34:07 +0000 (UTC) (envelope-from jklimek@gmail.com) Received: from wa-out-1112.google.com (wa-out-1112.google.com [209.85.146.176]) by mx1.freebsd.org (Postfix) with ESMTP id A984E13C45A for ; Sat, 22 Dec 2007 03:34:07 +0000 (UTC) (envelope-from jklimek@gmail.com) Received: by wa-out-1112.google.com with SMTP id k17so973988waf.3 for ; Fri, 21 Dec 2007 19:34:07 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=5RTqKqBEnj4banomoF7ADNU7G1DGlv3VVfVhnt3FLzc=; b=tcAWwqdY/gK2y5LoJSMClIT9wyNIKQ5C1E5PHFdm6uJTvfwKsQOCt19A9ygAgjNeocRMyLwMtqkJhMb/IjlNe3psfiRJ1fKljcoQZ7X8FZJqmAerI/7eiLO7STtGD4aI++tECRVEQzZHRilxxCWPHgk+R2NXO8uC2gQe9s5dU80= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=BDSsDNIaUX2AGRddEv44Bgn3nxpguijZtttoq2JkEm2ZMA3QUKCfgB4fE3/bmbhOvQxsRhzHEwbzGzL821pLYQXo1qGAQLhQVlHO/z5aFpeaD+odwGhwSqxmiU2f/c+e+vNmqcPsjB7rZzf5hZ1Cz7eHaQ2hhvhPMIUL/aPy9U0= Received: by 10.142.110.3 with SMTP id i3mr992375wfc.178.1198294447242; Fri, 21 Dec 2007 19:34:07 -0800 (PST) Received: by 10.142.254.3 with HTTP; Fri, 21 Dec 2007 19:34:07 -0800 (PST) Message-ID: Date: Fri, 21 Dec 2007 22:34:07 -0500 From: "John Klimek" To: "Wes Morgan" In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: Cc: freebsd-fs@freebsd.org Subject: Re: How safe is ZFS to use for a home user? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Dec 2007 03:34:08 -0000 Has anybody ever lost data due to any bugs or anything like that? I'm going to use this ZFS as my primary storage medium (and poor man's backup solution), so I would be devastated if I lost my entire array due to a bug or other issue (aside from losing two hard drives in a three hard drive RAID-Z array). Also, my system is going to have 3x 400 GB (RAID-Z) and 1x 80 GB (Standalone ZFS) and has 1.5 GB RAM (P3-1.0 GHz). What should I be setting my kmem and kmem_max to (or whatever) to avoid this bug I keep hearing about? On Dec 21, 2007 10:20 PM, Wes Morgan wrote: > > On Fri, 21 Dec 2007, John Klimek wrote: > > > I'm looking to setup a file server using RAID 5 (or the equivilant > > RAID-Z) and I'm interested in using ZFS. > > > > It looks like my primary options are Solaris or FreeBSD and since I'm > > beginning to really dislike Solaris I'm leaning towards using FreeBSD > > however I've heard that there are some issues with ZFS on FreeBSD > > specifically regarding some "kmap_mem" or something like that. > > > > Can anybody tell me if ZFS is safe to use for home users? I'm just > > looking to setup RAID-Z with 3x 300 GB and another pool for 1x80GB (I > > guess). > > I got tired of waiting for fsck's and have been using zfs for both my i386 > laptop and amd64 media server. I had a couple panics on the media server > before I upgraded to 4gb of ram, but basically none since then. On the > laptop, I can't recall having any, and it only has 1.5gb. > > I think that by the design of zfs, the panic might not even have a chance > of damaging your data, only losing a write that had not completed, but I > can't say I am an expert. > > In short, it has not given me any problems at all on two different > configurations. > > From owner-freebsd-fs@FreeBSD.ORG Sat Dec 22 04:12:03 2007 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D6C4116A418 for ; Sat, 22 Dec 2007 04:12:03 +0000 (UTC) (envelope-from morganw@chemikals.org) Received: from cdptpa-omtalb.mail.rr.com (cdptpa-omtalb.mail.rr.com [75.180.132.121]) by mx1.freebsd.org (Postfix) with ESMTP id 8659013C455 for ; Sat, 22 Dec 2007 04:12:03 +0000 (UTC) (envelope-from morganw@chemikals.org) Received: from shop.chemikals.org ([75.182.2.94]) by cdptpa-omta01.mail.rr.com with ESMTP id <20071222032045.GWZD16228.cdptpa-omta01.mail.rr.com@shop.chemikals.org>; Sat, 22 Dec 2007 03:20:45 +0000 Received: from volatile.chemikals.org (root@r74-193-170-223.bssrcmta01.bscyla.by.dh.suddenlink.net [74.193.170.223] (may be forged)) by shop.chemikals.org (8.14.1/8.14.1) with ESMTP id lBM3KiPX006459; Fri, 21 Dec 2007 22:20:44 -0500 (EST) (envelope-from morganw@chemikals.org) Received: from localhost (morganw@localhost [127.0.0.1]) by volatile.chemikals.org (8.14.2/8.14.2) with ESMTP id lBM3KgP4056571; Fri, 21 Dec 2007 21:20:43 -0600 (CST) (envelope-from morganw@chemikals.org) Date: Fri, 21 Dec 2007 21:20:42 -0600 (CST) From: Wes Morgan To: John Klimek In-Reply-To: Message-ID: References: User-Agent: Alpine 0.99999 (BSF 796 2007-11-08) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; format=flowed; charset=US-ASCII Cc: freebsd-fs@freebsd.org Subject: Re: How safe is ZFS to use for a home user? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Dec 2007 04:12:03 -0000 On Fri, 21 Dec 2007, John Klimek wrote: > I'm looking to setup a file server using RAID 5 (or the equivilant > RAID-Z) and I'm interested in using ZFS. > > It looks like my primary options are Solaris or FreeBSD and since I'm > beginning to really dislike Solaris I'm leaning towards using FreeBSD > however I've heard that there are some issues with ZFS on FreeBSD > specifically regarding some "kmap_mem" or something like that. > > Can anybody tell me if ZFS is safe to use for home users? I'm just > looking to setup RAID-Z with 3x 300 GB and another pool for 1x80GB (I > guess). I got tired of waiting for fsck's and have been using zfs for both my i386 laptop and amd64 media server. I had a couple panics on the media server before I upgraded to 4gb of ram, but basically none since then. On the laptop, I can't recall having any, and it only has 1.5gb. I think that by the design of zfs, the panic might not even have a chance of damaging your data, only losing a write that had not completed, but I can't say I am an expert. In short, it has not given me any problems at all on two different configurations. From owner-freebsd-fs@FreeBSD.ORG Sat Dec 22 06:49:59 2007 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 14E9516A418 for ; Sat, 22 Dec 2007 06:49:59 +0000 (UTC) (envelope-from jklimek@gmail.com) Received: from rv-out-0910.google.com (rv-out-0910.google.com [209.85.198.185]) by mx1.freebsd.org (Postfix) with ESMTP id DDEB913C4D1 for ; Sat, 22 Dec 2007 06:49:58 +0000 (UTC) (envelope-from jklimek@gmail.com) Received: by rv-out-0910.google.com with SMTP id l15so851502rvb.43 for ; Fri, 21 Dec 2007 22:49:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition; bh=Aov0TWBY/SfOTLX4XF7V5AmIETvFlV/cTww+bbWFv1Q=; b=LIg4K9lcz3IejqrEDcnzYl9zfDHzuRPTnlHvkVv2jvtUaMelkwCVgh07HKhrBnCy07ZDaaliclMSszyD6KnEE92xHG4zH34Ud4trdXDHFul8TWAMxl9u5rwGxrdvsCv5tBQnmIcWy8lGLFsoyuURPRsjFyt/vqZGDwQrMGlBlpA= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition; b=NiYzobBdc+IPUjrmWMlNpWsiCwqgjXCr1AQeFpLiuDwWjuhKXkDBWqw1rppfSfTnMTnPFzM3ljm7i0suvA05u7xy7NfwQZT502TlBzykLlpc0ESJDG7BMCjk1fXIW4d5H6MFRnGqGjscwOduGoMY4V/YGdF+aV4JK5qm3os7K5Q= Received: by 10.143.187.2 with SMTP id o2mr1007612wfp.162.1198306198365; Fri, 21 Dec 2007 22:49:58 -0800 (PST) Received: by 10.142.254.3 with HTTP; Fri, 21 Dec 2007 22:49:58 -0800 (PST) Message-ID: Date: Sat, 22 Dec 2007 01:49:58 -0500 From: "John Klimek" To: freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline Subject: Why do my samba shares (using ZFS) not immediately refresh when I make a change to them via CIFS? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Dec 2007 06:49:59 -0000 I have a simple ZFS pool and am sharing it via samba to my Windows XP machine. Using my Windows XP machine, I browse to the samba/zfs share and create a directory but it doesn't show up unless I hit F5 to refresh. However, my other samba shares (not using ZFS) immediately show all changes. Has anybody experienced this problem? It's kind-of annoying and is fairly dangerous because you can delete directories (or files) and they will still appear to be there unless you refresh the directory... Thanks for any help... From owner-freebsd-fs@FreeBSD.ORG Sat Dec 22 15:02:07 2007 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6FA4F16A469 for ; Sat, 22 Dec 2007 15:02:07 +0000 (UTC) (envelope-from jklimek@gmail.com) Received: from py-out-1112.google.com (py-out-1112.google.com [64.233.166.177]) by mx1.freebsd.org (Postfix) with ESMTP id 3770113C4CE for ; Sat, 22 Dec 2007 15:02:06 +0000 (UTC) (envelope-from jklimek@gmail.com) Received: by py-out-1112.google.com with SMTP id u77so1659138pyb.3 for ; Sat, 22 Dec 2007 07:02:06 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=2lRPJHJWxHXN5XoUqwKhq0PbpFurUDwrTcrUzbewrTE=; b=bt2A1jd4MnP1rIbqnXJrsAWysQgm1UYSrpMvax2PqP1nRoo7K36SF1YA5OfTsIyWBKdpWrf3gWSfUojsxp4i2wPkhP1PojYsP0XLDMfTRLzG5KZyoywUfJSdo7xGkg5d32xpq/ZzyRQM13FvBz6apTxGK2hVa6qMkZDvhVvB09Y= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=X/SnI3/gg7BilBKvKcn1Nx96IgCrlC2UCC6uxqcqXYrYDiYbZFyUEUSFs4XhKRXC9oYwxuA1Tg+hWEi2jmfRDazjz6/k3oQv8S/OWE49j7ypZygRG2TGGIg2ZPGTuFf7uAWNSBMLDMyfMiBBjDGQWGf3SI96SBMtCvkSCO6wpco= Received: by 10.142.126.17 with SMTP id y17mr1064189wfc.170.1198335725090; Sat, 22 Dec 2007 07:02:05 -0800 (PST) Received: by 10.142.254.3 with HTTP; Sat, 22 Dec 2007 07:02:05 -0800 (PST) Message-ID: Date: Sat, 22 Dec 2007 10:02:05 -0500 From: "John Klimek" To: "XP 2600" In-Reply-To: <8eba712d0712212259i44e8c169ha0914813926bd092@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <8eba712d0712212259i44e8c169ha0914813926bd092@mail.gmail.com> Cc: freebsd-fs@freebsd.org Subject: Re: Why do my samba shares (using ZFS) not immediately refresh when I make a change to them via CIFS? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Dec 2007 15:02:07 -0000 It shouldn't be client side because the non-ZFS samba shares automatically refresh just fine... On Dec 22, 2007 1:59 AM, XP 2600 wrote: > Are you sure its not a client side problem ? cause i remember a Registry > tweak which change the behavior of Windows XP from auto refresh to not. > > > > On Dec 22, 2007 8:49 AM, John Klimek < jklimek@gmail.com> wrote: > > > > > > > > I have a simple ZFS pool and am sharing it via samba to my Windows XP > machine. > > > > Using my Windows XP machine, I browse to the samba/zfs share and > > create a directory but it doesn't show up unless I hit F5 to refresh. > > > > However, my other samba shares (not using ZFS) immediately show all > changes. > > > > Has anybody experienced this problem? It's kind-of annoying and is > > fairly dangerous because you can delete directories (or files) and > > they will still appear to be there unless you refresh the directory... > > > > Thanks for any help... > > _______________________________________________ > > freebsd-fs@freebsd.org mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > > > > > > -- > Emam > MCSA MCSE From owner-freebsd-fs@FreeBSD.ORG Sat Dec 22 15:38:40 2007 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CA1EC16A417 for ; Sat, 22 Dec 2007 15:38:40 +0000 (UTC) (envelope-from gary.jennejohn@freenet.de) Received: from mout2.freenet.de (mout2.freenet.de [IPv6:2001:748:100:40::2:4]) by mx1.freebsd.org (Postfix) with ESMTP id 7900313C447 for ; Sat, 22 Dec 2007 15:38:40 +0000 (UTC) (envelope-from gary.jennejohn@freenet.de) Received: from [195.4.92.11] (helo=1.mx.freenet.de) by mout2.freenet.de with esmtpa (Exim 4.68) (envelope-from ) id 1J66Qx-0006YG-3q for freebsd-fs@freebsd.org; Sat, 22 Dec 2007 16:38:39 +0100 Received: from x0777.x.pppool.de ([89.59.7.119]:65392 helo=peedub.jennejohn.org) by 1.mx.freenet.de with esmtpa (ID gary.jennejohn@freenet.de) (port 25) (Exim 4.68 #1) id 1J66Qw-0005cK-VD for freebsd-fs@freebsd.org; Sat, 22 Dec 2007 16:38:39 +0100 Date: Sat, 22 Dec 2007 16:38:38 +0100 From: Gary Jennejohn To: freebsd-fs@freebsd.org Message-ID: <20071222163838.199f0811@peedub.jennejohn.org> In-Reply-To: References: Organization: DENX Softwre Engineering GmbH X-Mailer: Claws Mail 3.0.2 (GTK+ 2.10.14; amd64-portbld-freebsd8.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Subject: Re: How safe is ZFS to use for a home user? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: gary.jennejohn@freenet.de List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Dec 2007 15:38:40 -0000 On Fri, 21 Dec 2007 22:34:07 -0500 "John Klimek" wrote: > Has anybody ever lost data due to any bugs or anything like that? I'm > going to use this ZFS as my primary storage medium (and poor man's > backup solution), so I would be devastated if I lost my entire array > due to a bug or other issue (aside from losing two hard drives in a > three hard drive RAID-Z array). > I lost a mirror on 2 SATA drives when I installed a new mobo. A plain ZFS concatenation of 2 partitions on a SCSI drive didn't get lost. I've never lost data due to a crash. Might have been pilot error. Might have had something to do with the way the new mobo assigned the disks. Luckily I had a backup of the really important stuff. > Also, my system is going to have 3x 400 GB (RAID-Z) and 1x 80 GB > (Standalone ZFS) and has 1.5 GB RAM (P3-1.0 GHz). > > What should I be setting my kmem and kmem_max to (or whatever) to > avoid this bug I keep hearing about? > This sort of question has been answered umpteen times already. Check out the ML archive or the wiki (http://wiki.freebsd.org/ZFSTuningGuide). -- Gary Jennejohn From owner-freebsd-fs@FreeBSD.ORG Sat Dec 22 15:51:10 2007 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9FDDB16A417 for ; Sat, 22 Dec 2007 15:51:10 +0000 (UTC) (envelope-from morganw@chemikals.org) Received: from cdptpa-omtalb.mail.rr.com (cdptpa-omtalb.mail.rr.com [75.180.132.120]) by mx1.freebsd.org (Postfix) with ESMTP id 706A513C4CE for ; Sat, 22 Dec 2007 15:51:10 +0000 (UTC) (envelope-from morganw@chemikals.org) Received: from shop.chemikals.org ([75.182.2.94]) by cdptpa-omta02.mail.rr.com with ESMTP id <20071222155109.TBZD14132.cdptpa-omta02.mail.rr.com@shop.chemikals.org>; Sat, 22 Dec 2007 15:51:09 +0000 Received: from volatile.chemikals.org (root@r74-193-170-223.bssrcmta01.bscyla.by.dh.suddenlink.net [74.193.170.223] (may be forged)) by shop.chemikals.org (8.14.1/8.14.1) with ESMTP id lBMFp8Oj013584; Sat, 22 Dec 2007 10:51:08 -0500 (EST) (envelope-from morganw@chemikals.org) Received: from localhost (morganw@localhost [127.0.0.1]) by volatile.chemikals.org (8.14.2/8.14.2) with ESMTP id lBMFp7Y9064161; Sat, 22 Dec 2007 09:51:07 -0600 (CST) (envelope-from morganw@chemikals.org) Date: Sat, 22 Dec 2007 09:51:06 -0600 (CST) From: Wes Morgan To: Gary Jennejohn In-Reply-To: <20071222163838.199f0811@peedub.jennejohn.org> Message-ID: References: <20071222163838.199f0811@peedub.jennejohn.org> User-Agent: Alpine 0.99999 (BSF 796 2007-11-08) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: freebsd-fs@freebsd.org Subject: Re: How safe is ZFS to use for a home user? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Dec 2007 15:51:10 -0000 On Sat, 22 Dec 2007, Gary Jennejohn wrote: > On Fri, 21 Dec 2007 22:34:07 -0500 > "John Klimek" wrote: > >> Has anybody ever lost data due to any bugs or anything like that? I'm >> going to use this ZFS as my primary storage medium (and poor man's >> backup solution), so I would be devastated if I lost my entire array >> due to a bug or other issue (aside from losing two hard drives in a >> three hard drive RAID-Z array). >> > > I lost a mirror on 2 SATA drives when I installed a new mobo. A plain > ZFS concatenation of 2 partitions on a SCSI drive didn't get lost. I've > never lost data due to a crash. If it was a zfs mirror, you probably could have recovered it with a forced import or something similar. > > Might have been pilot error. Might have had something to do with the > way the new mobo assigned the disks. Luckily I had a backup of the > really important stuff.