From owner-freebsd-fs@FreeBSD.ORG Mon Jan 19 00:40:48 2004 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9484816A4CE for ; Mon, 19 Jan 2004 00:40:48 -0800 (PST) Received: from moe.ilimit.es (38.Red-213-96-13.pooles.rima-tde.net [213.96.13.38]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2DEAB43D39 for ; Mon, 19 Jan 2004 00:40:41 -0800 (PST) (envelope-from d.ortiz@in.ilimit.es) Received: from dani.ilimit.lan ([192.168.1.57] helo=in.ilimit.es) by moe.ilimit.es with smtp (Exim 3.35 #1 (Debian)) id 1AiUxV-0002Qi-00 for ; Mon, 19 Jan 2004 09:40:33 +0100 Received: by in.ilimit.es (sSMTP sendmail emulation); Mon, 19 Jan 2004 09:40:32 +0100 Date: Mon, 19 Jan 2004 09:34:51 +0100 From: Daniel Ortiz To: Doug White Message-ID: <20040119083451.GA204@in.ilimit.es> References: <20040116181704.GA10079@in.ilimit.es> <20040116160313.U93165@carver.gumbysoft.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="HlL+5n6rz5pIUxbD" Content-Disposition: inline In-Reply-To: <20040116160313.U93165@carver.gumbysoft.com> User-Agent: Mutt/1.4.1i Resent-From: Daniel Ortiz Resent-Date: Mon, 19 Jan 2004 09:40:32 +0100 Resent-To: freebsd-fs@freebsd.org Resent-Message-Id: X-ILIMIT-MailScanner-Information: ILIMIT Comunicacions X-ILIMIT-MailScanner: Found to be clean Subject: Re: atacontrol raid X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Jan 2004 08:40:48 -0000 --HlL+5n6rz5pIUxbD Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable My Raid controller aren't supported yet.=20 It's possible to do a soft raid only with atacontrol?=20 With a Fixit floppy I can mount ar0s1 and the other slices (I've changed fstab entries with ar0s1 etc, but when I boot tries to boot with ad0s1a) Possibly I've made the changes on the mirrored disk? If is that, how I can change the other disk fstab? Thanks in advance. On Fri, Jan 16, 2004 at 04:04:03PM -0800, Doug White wrote: > Explain "doesn't work." Does the ATA RAID BIOS find the mirrored volume? > Does FreeBSD find the volume? Have you updated fstab? Did you make a new > filesystem? :) --=20 -- Daniel Ortiz d.ortiz@in.ilimit.es --HlL+5n6rz5pIUxbD Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.3 (FreeBSD) iD8DBQFAC5arPprEQTARuLoRAtFPAKCO/yZMZX3z2d0hN2mielu34n4cHACcDutY V8/brQoLA/s6Gr8X+nfTpL0= =53DI -----END PGP SIGNATURE----- --HlL+5n6rz5pIUxbD-- From owner-freebsd-fs@FreeBSD.ORG Mon Jan 19 10:51:52 2004 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3FE9B16A4CE; Mon, 19 Jan 2004 10:51:52 -0800 (PST) Received: from mx.nsu.ru (mx.nsu.ru [212.192.164.5]) by mx1.FreeBSD.org (Postfix) with ESMTP id 47E2A43D39; Mon, 19 Jan 2004 10:51:45 -0800 (PST) (envelope-from fjoe@iclub.nsu.ru) Received: from mail by mx.nsu.ru with drweb-scanned (Exim 3.35 #1 (Debian)) id 1Aieev-0007QA-00; Tue, 20 Jan 2004 01:02:01 +0600 Received: from iclub.nsu.ru ([193.124.215.97] ident=root) by mx.nsu.ru with esmtp (Exim 3.35 #1 (Debian)) id 1Aieet-0007PM-00; Tue, 20 Jan 2004 01:02:00 +0600 Received: from iclub.nsu.ru (smmsp@localhost [127.0.0.1]) by iclub.nsu.ru (8.12.8p2/8.12.8) with ESMTP id i0JIpdNA061381; Tue, 20 Jan 2004 00:51:39 +0600 (NS) (envelope-from fjoe@iclub.nsu.ru) Received: (from fjoe@localhost) by iclub.nsu.ru (8.12.8p2/8.12.8/Submit) id i0JITuFQ060889; Tue, 20 Jan 2004 00:29:56 +0600 (NS) Date: Tue, 20 Jan 2004 00:29:55 +0600 From: Max Khon To: freebsd-fs@freebsd.org Message-ID: <20040119182955.GA60760@iclub.nsu.ru> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.1i X-Envelope-To: freebsd-fs@freebsd.org, freebsd-current@freebsd.org cc: freebsd-current@freebsd.org Subject: read-only compressed fs (call for testers) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Jan 2004 18:51:52 -0000 Hello! I have seen some requests for read-only compressed fs support recently. Last weekend I had a few spare cycles and implemented GEOM class that allows to use cloop V2.0 (compressed loopback device for Linux) fs images. More details, tarballs with geom_ugz and a port for tools needed to create/extract compressed fs images are available at http://people.freebsd.org/~fjoe/geom_ugz/ Any feedback is highly appreciated. /fjoe From owner-freebsd-fs@FreeBSD.ORG Mon Jan 19 11:54:25 2004 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6751C16A4CE; Mon, 19 Jan 2004 11:54:25 -0800 (PST) Received: from critter.freebsd.dk (critter.freebsd.dk [212.242.86.163]) by mx1.FreeBSD.org (Postfix) with ESMTP id E874243D31; Mon, 19 Jan 2004 11:54:23 -0800 (PST) (envelope-from phk@phk.freebsd.dk) Received: from critter.freebsd.dk (localhost [127.0.0.1]) by critter.freebsd.dk (8.12.10/8.12.10) with ESMTP id i0JJs8Cf098093; Mon, 19 Jan 2004 20:54:08 +0100 (CET) (envelope-from phk@phk.freebsd.dk) To: Max Khon From: "Poul-Henning Kamp" In-Reply-To: Your message of "Tue, 20 Jan 2004 00:29:55 +0600." <20040119182955.GA60760@iclub.nsu.ru> Date: Mon, 19 Jan 2004 20:54:08 +0100 Message-ID: <98092.1074542048@critter.freebsd.dk> cc: freebsd-fs@freebsd.org cc: freebsd-current@freebsd.org Subject: Re: read-only compressed fs (call for testers) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Jan 2004 19:54:25 -0000 In message <20040119182955.GA60760@iclub.nsu.ru>, Max Khon writes: >Hello! > >I have seen some requests for read-only compressed fs support recently. >Last weekend I had a few spare cycles and implemented GEOM class that >allows to use cloop V2.0 (compressed loopback device for Linux) fs images. > >More details, tarballs with geom_ugz and a port for tools needed >to create/extract compressed fs images are available at >http://people.freebsd.org/~fjoe/geom_ugz/ I quickly glanced at this: The one thing which stuck in my mind is that for performance reasons running inflate in the "up" geom path may be wrong. Doing CPU intensive stuff in the "up" and "down" paths is generally a bad idea and should be avoided because it will hold up other disk-trafic while the CPU chews. In GBDE I stuck all the crypto off to a kthread for this reason. In this case it may be a valid trade-off, I can't tell, just keep it in mind down the road. Ohh, Have I told anyone how positively delighted I am to see people grow GEOM classes all the places ? Wheeeeeeee! :-> Poul-Henning -- Poul-Henning Kamp | UNIX since Zilog Zeus 3.20 phk@FreeBSD.ORG | TCP/IP since RFC 956 FreeBSD committer | BSD since 4.3-tahoe Never attribute to malice what can adequately be explained by incompetence. From owner-freebsd-fs@FreeBSD.ORG Mon Jan 19 20:01:58 2004 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A8F9516A4CE; Mon, 19 Jan 2004 20:01:58 -0800 (PST) Received: from mx.nsu.ru (mx.nsu.ru [212.192.164.5]) by mx1.FreeBSD.org (Postfix) with ESMTP id 4361743D1F; Mon, 19 Jan 2004 20:01:57 -0800 (PST) (envelope-from fjoe@iclub.nsu.ru) Received: from mail by mx.nsu.ru with drweb-scanned (Exim 3.35 #1 (Debian)) id 1AinFS-0007bm-00; Tue, 20 Jan 2004 10:12:18 +0600 Received: from iclub.nsu.ru ([193.124.215.97] ident=root) by mx.nsu.ru with esmtp (Exim 3.35 #1 (Debian)) id 1AinFO-0007a7-00; Tue, 20 Jan 2004 10:12:14 +0600 Received: from iclub.nsu.ru (fjoe@localhost [127.0.0.1]) by iclub.nsu.ru (8.12.8p2/8.12.8) with ESMTP id i0K41mNA076999; Tue, 20 Jan 2004 10:01:48 +0600 (NS) (envelope-from fjoe@iclub.nsu.ru) Received: (from fjoe@localhost) by iclub.nsu.ru (8.12.8p2/8.12.8/Submit) id i0K41lXZ076998; Tue, 20 Jan 2004 10:01:47 +0600 (NS) Date: Tue, 20 Jan 2004 10:01:47 +0600 From: Max Khon To: freebsd-fs@freebsd.org Message-ID: <20040120040147.GA76892@iclub.nsu.ru> References: <20040119182955.GA60760@iclub.nsu.ru> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20040119182955.GA60760@iclub.nsu.ru> User-Agent: Mutt/1.4.1i X-Envelope-To: freebsd-fs@freebsd.org, freebsd-current@freebsd.org cc: freebsd-current@freebsd.org Subject: Re: read-only compressed fs (call for testers) [UPDATE] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Jan 2004 04:01:58 -0000 Hello! On Tue, Jan 20, 2004 at 12:29:55AM +0600, Max Khon wrote: > I have seen some requests for read-only compressed fs support recently. > Last weekend I had a few spare cycles and implemented GEOM class that > allows to use cloop V2.0 (compressed loopback device for Linux) fs images. > > More details, tarballs with geom_ugz and a port for tools needed > to create/extract compressed fs images are available at > http://people.freebsd.org/~fjoe/geom_ugz/ > > Any feedback is highly appreciated. I fixed some bugs that were reported to me: - create_compressed_fs should do padding to 512 bytes boundary - kernel panic in geom_ugz and added last uncompressed block caching (which should significantly speed up geom_ugz especially for large block sizes). Updated tarballs are available at http://people.freebsd.org/~fjoe/geom_ugz/ Thanks for your feedback! /fjoe From owner-freebsd-fs@FreeBSD.ORG Tue Jan 20 18:28:53 2004 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6416D16A4CF for ; Tue, 20 Jan 2004 18:28:53 -0800 (PST) Received: from ozlabs.org (ozlabs.org [203.10.76.45]) by mx1.FreeBSD.org (Postfix) with ESMTP id E84BC43D2F for ; Tue, 20 Jan 2004 18:28:51 -0800 (PST) (envelope-from grog@lemis.com) Received: from blackwater.lemis.com (blackwater.lemis.com [192.109.197.80]) by ozlabs.org (Postfix) with ESMTP id 18EB42BD75 for ; Wed, 21 Jan 2004 13:28:50 +1100 (EST) Received: by blackwater.lemis.com (Postfix, from userid 1004) id 4F08851205; Wed, 21 Jan 2004 12:58:48 +1030 (CST) Date: Wed, 21 Jan 2004 12:58:48 +1030 From: Greg 'groggy' Lehey To: Darcy Buskermolen Message-ID: <20040121022848.GX47639@wantadilla.lemis.com> References: <200401161205.53937.darcy@wavefire.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="kM/PxlMMHsUUNZZW" Content-Disposition: inline In-Reply-To: <200401161205.53937.darcy@wavefire.com> User-Agent: Mutt/1.4.1i Organization: The FreeBSD Project Phone: +61-8-8388-8286 Fax: +61-8-8388-8725 Mobile: +61-418-838-708 WWW-Home-Page: http://www.FreeBSD.org/ X-PGP-Fingerprint: 9A1B 8202 BCCE B846 F92F 09AC 22E6 F290 507A 4223 cc: freebsd-fs@freebsd.org Subject: Re: 32k directory limit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Jan 2004 02:28:53 -0000 --kM/PxlMMHsUUNZZW Content-Type: text/plain; charset=us-ascii Content-Disposition: inline On Friday, 16 January 2004 at 12:05:53 -0800, Darcy Buskermolen wrote: > Is there a way i can bump up the limit of 32k directories in a directory on > either 4.9 or 5.2 ? I don't think so. It's really the link count that's biting you, and it's a signed 16 bit number. FWIW, System V limits to 1000. Why do you want that many directories? UNIX directories aren't designed to be that big, whether the entries point to files or directories. Greg -- See complete headers for address and phone numbers. --kM/PxlMMHsUUNZZW Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.0 (FreeBSD) iD8DBQFADePgIubykFB6QiMRAmm2AJ9PpHD5wE1b85qFfj1h7owU0JOzhACfYbUn TBtG74QxEeTCT9MN/EarZG8= =CtLY -----END PGP SIGNATURE----- --kM/PxlMMHsUUNZZW-- From owner-freebsd-fs@FreeBSD.ORG Wed Jan 21 08:32:55 2004 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8120C16A4CF for ; Wed, 21 Jan 2004 08:32:55 -0800 (PST) Received: from mail2.dbitech.ca (radius.wavefire.com [64.141.13.252]) by mx1.FreeBSD.org (Postfix) with SMTP id 4666943D31 for ; Wed, 21 Jan 2004 08:32:52 -0800 (PST) (envelope-from darcy@wavefire.com) Received: (qmail 13757 invoked from network); 21 Jan 2004 17:15:11 -0000 Received: from dbitech.wavefire.com (HELO 64.141.15.253) (darcy@64.141.15.253) by radius.wavefire.com with SMTP; 21 Jan 2004 17:15:11 -0000 From: Darcy Buskermolen Organization: Wavefire Technologies Corp. To: "Greg 'groggy' Lehey" Date: Wed, 21 Jan 2004 08:32:51 -0800 User-Agent: KMail/1.5.4 References: <200401161205.53937.darcy@wavefire.com> <20040121022848.GX47639@wantadilla.lemis.com> In-Reply-To: <20040121022848.GX47639@wantadilla.lemis.com> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200401210832.52068.darcy@wavefire.com> cc: freebsd-fs@FreeBSD.org Subject: Re: 32k directory limit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Jan 2004 16:32:55 -0000 Problem is some brain dead software (to which I don't have source) creating these dirs all under one dir and not nesting them in a way to ensure that the 32k number isn't broken. On January 20, 2004 06:28 pm, Greg 'groggy' Lehey wrote: > On Friday, 16 January 2004 at 12:05:53 -0800, Darcy Buskermolen wrote: > > Is there a way i can bump up the limit of 32k directories in a directory > > on either 4.9 or 5.2 ? > > I don't think so. It's really the link count that's biting you, and > it's a signed 16 bit number. FWIW, System V limits to 1000. > > Why do you want that many directories? UNIX directories aren't > designed to be that big, whether the entries point to files or > directories. > > Greg > -- > See complete headers for address and phone numbers. -- Darcy Buskermolen Wavefire Technologies Corp. ph: 250.717.0200 fx: 250.763.1759 http://www.wavefire.com From owner-freebsd-fs@FreeBSD.ORG Wed Jan 21 09:55:25 2004 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id BCE0A16A4CE for ; Wed, 21 Jan 2004 09:55:25 -0800 (PST) Received: from euclide.usr.dico.unimi.it (euclide.usr.dico.unimi.it [159.149.148.97]) by mx1.FreeBSD.org (Postfix) with ESMTP id 656EE43D2D for ; Wed, 21 Jan 2004 09:55:22 -0800 (PST) (envelope-from saturnero@euclide.usr.dico.unimi.it) Received: from euclide.usr.dico.unimi.it (localhost [127.0.0.1]) i0LHtLX5058703 for ; Wed, 21 Jan 2004 18:55:21 +0100 (CET) (envelope-from saturnero@euclide.usr.dico.unimi.it) Received: (from saturnero@localhost) by euclide.usr.dico.unimi.it (8.12.9/8.12.9/Submit) id i0LHtLpW058701; Wed, 21 Jan 2004 18:55:21 +0100 (CET) (envelope-from saturnero) Date: Wed, 21 Jan 2004 18:55:21 +0100 (CET) Message-Id: <200401211755.i0LHtLpW058701@euclide.usr.dico.unimi.it> From: Dario Freni To: freebsd-fs@freebsd.org References: <20040120040147.GA76892@iclub.nsu.ru> User-Agent: tin/1.6.2-20030910 ("Pabbay") (UNIX) (FreeBSD/4.8-STABLE (i386)) Subject: (fwd) Re: read-only compressed fs (call for testers) [UPDATE] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Jan 2004 17:55:25 -0000 Up to freebsd-fs -- forwarded message -- Path: main.gmane.org!not-for-mail From: Dario Freni Newsgroups: gmane.os.freebsd.current,gmane.os.freebsd.devel.hackers Subject: Re: read-only compressed fs (call for testers) [UPDATE] Date: Wed, 21 Jan 2004 18:47:56 +0100 (CET) Lines: 33 Sender: owner-freebsd-current@freebsd.org Approved: news@gmane.org Message-ID: <200401211747.i0LHluBk057788@euclide.usr.dico.unimi.it> References: <20040120040147.GA76892@iclub.nsu.ru> NNTP-Posting-Host: deer.gmane.org X-Trace: sea.gmane.org 1074707312 20854 80.91.224.253 (21 Jan 2004 17:48:32 GMT) X-Complaints-To: usenet@sea.gmane.org NNTP-Posting-Date: Wed, 21 Jan 2004 17:48:32 +0000 (UTC) Cc: freebsd-hackers@freebsd.org Original-X-From: owner-freebsd-current@freebsd.org Wed Jan 21 18:48:25 2004 Return-path: Original-Received: from mx2.freebsd.org ([216.136.204.119]) by deer.gmane.org with esmtp (Exim 3.35 #1 (Debian)) id 1AjMSn-0001Ks-00 for ; Wed, 21 Jan 2004 18:48:25 +0100 Original-Received: from hub.freebsd.org (hub.freebsd.org [216.136.204.18]) by mx2.freebsd.org (Postfix) with ESMTP id BAEC058219; Wed, 21 Jan 2004 09:48:17 -0800 (PST) (envelope-from owner-freebsd-current@freebsd.org) Original-Received: from hub.freebsd.org (localhost [127.0.0.1]) by hub.freebsd.org (Postfix) with ESMTP id 3ABAB16A4D2; Wed, 21 Jan 2004 09:48:15 -0800 (PST) Delivered-To: freebsd-current@freebsd.org Original-Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5F98216A4CE; Wed, 21 Jan 2004 09:48:01 -0800 (PST) Original-Received: from euclide.usr.dico.unimi.it (euclide.usr.dico.unimi.it [159.149.148.97]) by mx1.FreeBSD.org (Postfix) with ESMTP id D4A3443D1D; Wed, 21 Jan 2004 09:47:59 -0800 (PST) (envelope-from saturnero@euclide.usr.dico.unimi.it) Original-Received: from euclide.usr.dico.unimi.it (localhost [127.0.0.1]) i0LHlvX5057791; Wed, 21 Jan 2004 18:47:57 +0100 (CET) (envelope-from saturnero@euclide.usr.dico.unimi.it) Original-Received: (from saturnero@localhost) by euclide.usr.dico.unimi.it (8.12.9/8.12.9/Submit) id i0LHluBk057788; Wed, 21 Jan 2004 18:47:56 +0100 (CET) (envelope-from saturnero) Original-To: Max Khon In-Reply-To: <20040120040147.GA76892@iclub.nsu.ru> X-Newsgroups: gmane.os.freebsd.current,gmane.os.freebsd.devel.file-systems User-Agent: tin/1.6.2-20030910 ("Pabbay") (UNIX) (FreeBSD/4.8-STABLE (i386)) Original-Cc: freebsd-current@freebsd.org X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: owner-freebsd-current@freebsd.org Xref: main.gmane.org gmane.os.freebsd.current:38782 gmane.os.freebsd.devel.hackers:13579 X-Report-Spam: http://spam.gmane.org/gmane.os.freebsd.current:38782 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 In article <20040120040147.GA76892@iclub.nsu.ru> you wrote: >> Any feedback is highly appreciated. A FreeSBIE developer has successfully made an ISO image with /usr/X11R6 and /usr/local mounted via cloop. If you are interested, I can inform you when that iso is public. I'm personally very curious about performance growth :) Thank you by the FreeSBIE team. Bye, Dario - -- Dario Freni (saturnero@gufi.org) - SaturNero on IRCNet, Azzurra Gruppo Utenti FreeBSD Italia (http://www.gufi.org) GPG Public key at http://www.saturnero.net/saturnero.asc -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.2 (FreeBSD) iD8DBQFADrtGZ1XqWj1OqUERAhSFAJwMTm8jM1YGNQkk3ae53wLE6FtElwCg1CGI pBU5Kjj4ReTkXKuZZL2uJRc= =lVnp -----END PGP SIGNATURE----- _______________________________________________ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" -- end of forwarded message -- -- Dario Freni (saturnero@gufi.org) - SaturNero on IRCNet, Azzurra Gruppo Utenti FreeBSD Italia (http://www.gufi.org) GPG Public key at http://www.saturnero.net/saturnero.asc From owner-freebsd-fs@FreeBSD.ORG Wed Jan 21 10:29:04 2004 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id CA6A016A4CE; Wed, 21 Jan 2004 10:29:04 -0800 (PST) Received: from mxsf18.cluster1.charter.net (mxsf18.cluster1.charter.net [209.225.28.218]) by mx1.FreeBSD.org (Postfix) with ESMTP id 1571443D1F; Wed, 21 Jan 2004 10:28:51 -0800 (PST) (envelope-from ups@stups.com) Received: from stups.com ([209.187.143.11])i0LIHviJ027284; Wed, 21 Jan 2004 13:17:57 -0500 (EST) (envelope-from ups@stups.com) Received: from tree.com (localhost [127.0.0.1]) by stups.com (8.9.3/8.9.3) with ESMTP id NAA04118; Wed, 21 Jan 2004 13:17:56 -0500 Message-Id: <200401211817.NAA04118@stups.com> X-Mailer: exmh version 2.0.2 To: Darcy Buskermolen In-Reply-To: Message from Darcy Buskermolen <200401210832.52068.darcy@wavefire.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Wed, 21 Jan 2004 13:17:56 -0500 From: Stephan Uphoff cc: Greg 'groggy' Lehey cc: freebsd-fs@FreeBSD.org Subject: Re: 32k directory limit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Jan 2004 18:29:04 -0000 Darcy Buskermolen wrote: > Problem is some brain dead software (to which I don't have source) creating > these dirs all under one dir and not nesting them in a way to ensure that the > 32k number isn't broken. The easiest solution would be a to nfs mount the directory from a server supporting >32k file directories. I this is not possible you may want to intercept file requests to the directory and map the requests to a multi-level directory structure. (Example: directory/filename => directory/hash(filename)/filename ) File requests can be intercepted on multiple layers - from inserting dynamic libraries to layered file systems. (with lots of possibilities between the layers) Mhhh ... FiST did something like this: http://www.filesystems.org/docs/usenetfs/index.html Stephan > > > On January 20, 2004 06:28 pm, Greg 'groggy' Lehey wrote: > > On Friday, 16 January 2004 at 12:05:53 -0800, Darcy Buskermolen wrote: > > > Is there a way i can bump up the limit of 32k directories in a directory > > > on either 4.9 or 5.2 ? > > > > I don't think so. It's really the link count that's biting you, and > > it's a signed 16 bit number. FWIW, System V limits to 1000. > > > > Why do you want that many directories? UNIX directories aren't > > designed to be that big, whether the entries point to files or > > directories. > > > > Greg > > -- > > See complete headers for address and phone numbers. > > -- > Darcy Buskermolen > Wavefire Technologies Corp. > ph: 250.717.0200 > fx: 250.763.1759 > http://www.wavefire.com > > _______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > From owner-freebsd-fs@FreeBSD.ORG Wed Jan 21 10:36:13 2004 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 1F4D416A4CE; Wed, 21 Jan 2004 10:36:13 -0800 (PST) Received: from fledge.watson.org (fledge.watson.org [204.156.12.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id 460FD43D2D; Wed, 21 Jan 2004 10:36:08 -0800 (PST) (envelope-from robert@fledge.watson.org) Received: from fledge.watson.org (localhost [127.0.0.1]) by fledge.watson.org (8.12.10/8.12.10) with ESMTP id i0LIY6Ud050905; Wed, 21 Jan 2004 13:34:06 -0500 (EST) (envelope-from robert@fledge.watson.org) Received: from localhost (robert@localhost)i0LIY6Ue050902; Wed, 21 Jan 2004 13:34:06 -0500 (EST) (envelope-from robert@fledge.watson.org) Date: Wed, 21 Jan 2004 13:34:06 -0500 (EST) From: Robert Watson X-Sender: robert@fledge.watson.org To: Darcy Buskermolen In-Reply-To: <200401210832.52068.darcy@wavefire.com> Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII cc: Greg 'groggy' Lehey cc: freebsd-fs@FreeBSD.org Subject: Re: 32k directory limit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Jan 2004 18:36:13 -0000 On Wed, 21 Jan 2004, Darcy Buskermolen wrote: > Problem is some brain dead software (to which I don't have source) > creating these dirs all under one dir and not nesting them in a way to > ensure that the 32k number isn't broken. The largest number of files (not directories) I have in a single directory appears to be about 1.1 million. Other than the link count, there's no real reason there couldn't be more, although you might well bump into other scalability limits (I have to remember not to let ls sort the directory listing for that directory, for example). Changing the link count would be a binary layout change, however. We have more reserve fields in the UFS2 inode, and it might well not be hard to experiment with. But we'd need to be very careful if deploying that change more broadly. Robert N M Watson FreeBSD Core Team, TrustedBSD Projects robert@fledge.watson.org Senior Research Scientist, McAfee Research > > > On January 20, 2004 06:28 pm, Greg 'groggy' Lehey wrote: > > On Friday, 16 January 2004 at 12:05:53 -0800, Darcy Buskermolen wrote: > > > Is there a way i can bump up the limit of 32k directories in a directory > > > on either 4.9 or 5.2 ? > > > > I don't think so. It's really the link count that's biting you, and > > it's a signed 16 bit number. FWIW, System V limits to 1000. > > > > Why do you want that many directories? UNIX directories aren't > > designed to be that big, whether the entries point to files or > > directories. > > > > Greg > > -- > > See complete headers for address and phone numbers. > > -- > Darcy Buskermolen > Wavefire Technologies Corp. > ph: 250.717.0200 > fx: 250.763.1759 > http://www.wavefire.com > > _______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > From owner-freebsd-fs@FreeBSD.ORG Wed Jan 21 10:49:15 2004 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 2CD1516A4CE for ; Wed, 21 Jan 2004 10:49:15 -0800 (PST) Received: from mail2.dbitech.ca (radius.wavefire.com [64.141.13.252]) by mx1.FreeBSD.org (Postfix) with SMTP id B6E4343D41 for ; Wed, 21 Jan 2004 10:49:09 -0800 (PST) (envelope-from darcy@wavefire.com) Received: (qmail 23028 invoked from network); 21 Jan 2004 19:31:30 -0000 Received: from dbitech.wavefire.com (HELO 64.141.15.253) (darcy@64.141.15.253) by radius.wavefire.com with SMTP; 21 Jan 2004 19:31:30 -0000 From: Darcy Buskermolen Organization: Wavefire Technologies Corp. To: Robert Watson Date: Wed, 21 Jan 2004 10:49:10 -0800 User-Agent: KMail/1.5.4 References: In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200401211049.10168.darcy@wavefire.com> cc: Greg 'groggy' Lehey cc: freebsd-fs@freebsd.org Subject: Re: 32k directory limit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Jan 2004 18:49:15 -0000 On January 21, 2004 10:34 am, Robert Watson wrote: > On Wed, 21 Jan 2004, Darcy Buskermolen wrote: > > Problem is some brain dead software (to which I don't have source) > > creating these dirs all under one dir and not nesting them in a way to > > ensure that the 32k number isn't broken. > > The largest number of files (not directories) I have in a single directory > appears to be about 1.1 million. Other than the link count, there's no > real reason there couldn't be more, although you might well bump into > other scalability limits (I have to remember not to let ls sort the > directory listing for that directory, for example). Changing the link > count would be a binary layout change, however. We have more reserve > fields in the UFS2 inode, and it might well not be hard to experiment > with. But we'd need to be very careful if deploying that change more > broadly. I wouldn't be against trying/testing such a solution/hack in my environment any hints/patches would be most usefull. > > Robert N M Watson FreeBSD Core Team, TrustedBSD Projects > robert@fledge.watson.org Senior Research Scientist, McAfee Research > > > On January 20, 2004 06:28 pm, Greg 'groggy' Lehey wrote: > > > On Friday, 16 January 2004 at 12:05:53 -0800, Darcy Buskermolen wrote: > > > > Is there a way i can bump up the limit of 32k directories in a > > > > directory on either 4.9 or 5.2 ? > > > > > > I don't think so. It's really the link count that's biting you, and > > > it's a signed 16 bit number. FWIW, System V limits to 1000. > > > > > > Why do you want that many directories? UNIX directories aren't > > > designed to be that big, whether the entries point to files or > > > directories. > > > > > > Greg > > > -- > > > See complete headers for address and phone numbers. > > > > -- > > Darcy Buskermolen > > Wavefire Technologies Corp. > > ph: 250.717.0200 > > fx: 250.763.1759 > > http://www.wavefire.com > > > > _______________________________________________ > > freebsd-fs@freebsd.org mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > > _______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" -- Darcy Buskermolen Wavefire Technologies Corp. ph: 250.717.0200 fx: 250.763.1759 http://www.wavefire.com From owner-freebsd-fs@FreeBSD.ORG Wed Jan 21 13:56:20 2004 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 95D9716A4CE for ; Wed, 21 Jan 2004 13:56:20 -0800 (PST) Received: from eternal.slumber.org (eternal.slumber.org [68.98.216.195]) by mx1.FreeBSD.org (Postfix) with ESMTP id 85A8443D39 for ; Wed, 21 Jan 2004 13:56:15 -0800 (PST) (envelope-from flagg@eternal.slumber.org) Received: from eternal.slumber.org (localhost [127.0.0.1]) i0LLpSLQ000921 for ; Wed, 21 Jan 2004 14:51:28 -0700 Received: (from flagg@localhost) by eternal.slumber.org (8.12.11/8.12.11/Debian-1) id i0LLpS7t000919 for freebsd-fs@freebsd.org; Wed, 21 Jan 2004 14:51:28 -0700 Date: Wed, 21 Jan 2004 14:51:28 -0700 From: Shawn Ostapuk To: freebsd-fs@freebsd.org Message-ID: <20040121215128.GB32719@slumber.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.5.1+cvs20040105i Subject: Vinum / 5.2 cant mount/growfs/newfs terabyte X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Jan 2004 21:56:20 -0000 Well its been quite a few months, and FreeBSD 5.2 got released today so I quickly went to see if my problem has been fixed yet, specially since the release notes were quite hopeful: "The sizes of some members of the statfs structure have changed from 32 bits to 64 bits in order to better support multi-terabyte filesystems." I was hoping that was the fix...but it wasnt... And now my problem... I use vinum and a number of IDE drives on two boxes, primary server and backup. Around 5 or 6 months ago the size grew to be needing a terabyte or more -- so I did the usual and added a new drive to the vinum configuration, went to growfs (which has saved me more time than you can imagine, thanks freebsd) and no luck, newfs, no luck, mount the old one without modifying? no luck...it just breaks after making it larger than 1 tb. I've tried this one two boxes, various drives configs. I can rearranage them all i want and they all work fine, but the second i make it larger than 1 terabyte, everything fails on it. bash-2.05b# vinum list 9 drives: D vinumdrive1 State: up /dev/ad1s1e A: 0/156327 MB (0%) D vinumdrive2 State: up /dev/ad2s1e A: 0/76316 MB (0%) D vinumdrive3 State: up /dev/ad4s1e A: 0/117239 MB (0%) D vinumdrive4 State: up /dev/ad5s1e A: 0/114470 MB (0%) D vinumdrive5 State: up /dev/ad6s1e A: 0/76292 MB (0%) D vinumdrive6 State: up /dev/ad7s1e A: 0/76292 MB (0%) D vinumdrive7 State: up /dev/ad8s1e A: 0/156327 MB (0%) D vinumdrive8 State: up /dev/ad9s1e A: 0/78159 MB (0%) D vinumdrive9 State: up /dev/ad11s1e A: 0/286102 MB (0%) 1 volumes: V pr0n State: up Plexes: 1 Size: 1110 GB 1 plexes: P vinum0.p0 C State: up Subdisks: 9 Size: 1110 GB 9 subdisks: S vinum0.p0.s1 State: up D: vinumdrive1 Size: 152 GB S vinum0.p0.s2 State: up D: vinumdrive2 Size: 74 GB S vinum0.p0.s3 State: up D: vinumdrive3 Size: 114 GB S vinum0.p0.s4 State: up D: vinumdrive4 Size: 111 GB S vinum0.p0.s5 State: up D: vinumdrive5 Size: 74 GB S vinum0.p0.s6 State: up D: vinumdrive6 Size: 74 GB S vinum0.p0.s7 State: up D: vinumdrive7 Size: 152 GB S vinum0.p0.s8 State: up D: vinumdrive8 Size: 76 GB S vinum0.p0.s9 State: up D: vinumdrive9 Size: 279 GB (no its not really porn stupid name i madeup too long ago to change =) All the drives work. In fact i've used two vinum configs at the same time using all the drives because of this terabyte limit :( Now with the above setup, vinum thinks everything is fine and looks fine as far as I can tell. And i've heard of vinum being used in greater than 1tb situations making me think there is no problem with it. But the second i try to do anything... bash-2.05b# mount /dev/vinum/pr0n mount: /dev/vinum/pr0n: unknown special file or file system ---- bash-2.05b# growfs /dev/vinum/pr0n growfs: rdfs: read error: 128: Invalid argument ---- bash-2.05b# newfs /dev/vinum/pr0n /dev/vinum/pr0n: 1137530.4MB (2329662200 sectors) block size 16384, fragment size 2048 using 6191 cylinder groups of 183.77MB, 11761 blks, 23552 inodes. newfs: can't read old UFS1 superblock: read error from block device: Invalid argument ---- No, it is NOT using ufs1, it is ufs2 -- in fact that code it hits in newfs only comes up when dealing with ufs2 partitions. The second i remove any drives that make it past the 1TB barrior i can mount/newfs it again no problems. Again, in any order and any drives on two different machines with a whole new set of drives. So thoughts anyone? is no one else in the world using vinum to concat some IDE drives past 1tb? i've heard of mount correctly mounting ufs2 partitions off hardware raids that are larger than 1tb no problem... it just seems to be some sort of problem with the two together...i'll be enternally grateful for anyone who can help me past this barrior, it is getting more and more difficult to work around separate partitions, etc -- and i see this becoming more and more common now that 300 gig drives are $299 retail... I should note also i've had roughly a dozen responses from my last post to questions recently and again to -fs/-questions about 6 months back who have the same problem wanting to know if i've found a way around it. Hopefully someone knows whats up :) Thanks, Shawn. From owner-freebsd-fs@FreeBSD.ORG Wed Jan 21 14:20:38 2004 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E785E16A4CE for ; Wed, 21 Jan 2004 14:20:38 -0800 (PST) Received: from ozlabs.org (ozlabs.org [203.10.76.45]) by mx1.FreeBSD.org (Postfix) with ESMTP id A1E1443D2F for ; Wed, 21 Jan 2004 14:20:37 -0800 (PST) (envelope-from grog@lemis.com) Received: from blackwater.lemis.com (blackwater.lemis.com [192.109.197.80]) by ozlabs.org (Postfix) with ESMTP id CB4FD2BD75 for ; Thu, 22 Jan 2004 09:20:35 +1100 (EST) Received: by blackwater.lemis.com (Postfix, from userid 1004) id 14B8651206; Thu, 22 Jan 2004 08:50:34 +1030 (CST) Date: Thu, 22 Jan 2004 08:50:34 +1030 From: Greg 'groggy' Lehey To: Shawn Ostapuk Message-ID: <20040121222033.GM86671@wantadilla.lemis.com> References: <20040121215128.GB32719@slumber.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="ibq+fG+Ci5ONsaof" Content-Disposition: inline In-Reply-To: <20040121215128.GB32719@slumber.org> User-Agent: Mutt/1.4.1i Organization: The FreeBSD Project Phone: +61-8-8388-8286 Fax: +61-8-8388-8725 Mobile: +61-418-838-708 WWW-Home-Page: http://www.FreeBSD.org/ X-PGP-Fingerprint: 9A1B 8202 BCCE B846 F92F 09AC 22E6 F290 507A 4223 cc: freebsd-fs@freebsd.org Subject: Re: Vinum / 5.2 cant mount/growfs/newfs terabyte X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Jan 2004 22:20:39 -0000 --ibq+fG+Ci5ONsaof Content-Type: text/plain; charset=us-ascii Content-Disposition: inline On Wednesday, 21 January 2004 at 14:51:28 -0700, Shawn Ostapuk wrote: > Well its been quite a few months, and FreeBSD 5.2 got released today so > I quickly went to see if my problem has been fixed yet, specially since > the release notes were quite hopeful: > > "The sizes of some members of the statfs structure have changed from 32 > bits to 64 bits in order to better support multi-terabyte filesystems." This seems to be a repeat of your recent message to FreeBSD-questions. That was the right forum. I'll answer it there as soon as my work permits. Greg -- See complete headers for address and phone numbers. --ibq+fG+Ci5ONsaof Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.0 (FreeBSD) iD8DBQFADvsxIubykFB6QiMRAhHxAJ9kPgsNY9WaVXnqjbP7Sf+vjPdMdwCeNOzd 44gXMh2N3rg2sR1FsWlz9Ks= =+vkV -----END PGP SIGNATURE----- --ibq+fG+Ci5ONsaof-- From owner-freebsd-fs@FreeBSD.ORG Wed Jan 21 16:08:54 2004 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7829016A4CF for ; Wed, 21 Jan 2004 16:08:54 -0800 (PST) Received: from mx.nsu.ru (mx.nsu.ru [212.192.164.5]) by mx1.FreeBSD.org (Postfix) with ESMTP id CF18F43D1F for ; Wed, 21 Jan 2004 16:08:23 -0800 (PST) (envelope-from fjoe@iclub.nsu.ru) Received: from mail by mx.nsu.ru with drweb-scanned (Exim 3.35 #1 (Debian)) id 1AjSYv-00026D-00; Thu, 22 Jan 2004 06:19:09 +0600 Received: from iclub.nsu.ru ([193.124.215.97] ident=root) by mx.nsu.ru with esmtp (Exim 3.35 #1 (Debian)) id 1AjSYu-00025w-00; Thu, 22 Jan 2004 06:19:08 +0600 Received: from iclub.nsu.ru (fjoe@localhost [127.0.0.1]) by iclub.nsu.ru (8.12.10/8.12.10) with ESMTP id i0M08IkH025439; Thu, 22 Jan 2004 06:08:18 +0600 (NS) (envelope-from fjoe@iclub.nsu.ru) Received: (from fjoe@localhost) by iclub.nsu.ru (8.12.10/8.12.10/Submit) id i0M08HiW025437; Thu, 22 Jan 2004 06:08:17 +0600 (NS) (envelope-from fjoe) Date: Thu, 22 Jan 2004 06:08:17 +0600 From: Max Khon To: Dario Freni Message-ID: <20040122000816.GA24093@iclub.nsu.ru> References: <20040120040147.GA76892@iclub.nsu.ru> <200401211755.i0LHtLpW058701@euclide.usr.dico.unimi.it> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <200401211755.i0LHtLpW058701@euclide.usr.dico.unimi.it> User-Agent: Mutt/1.4.1i X-Envelope-To: saturnero@gufi.org, freebsd-fs@freebsd.org cc: freebsd-fs@freebsd.org Subject: Re: (fwd) Re: read-only compressed fs (call for testers) [UPDATE] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Jan 2004 00:08:54 -0000 Hello! On Wed, Jan 21, 2004 at 06:55:21PM +0100, Dario Freni wrote: > >> Any feedback is highly appreciated. > > A FreeSBIE developer has successfully made an ISO image with > /usr/X11R6 and /usr/local mounted via cloop. If you are > interested, I can inform you when that iso is public. I think you can mount / from compressed image (mount to /mnt and the chroot there). > I'm personally very curious about performance growth :) I would like to see the numbers as well. By the way you can use makefs to create UFS/UFS2 compressed image (or just simply mdconfig/newfs and then create compressed image from md). Another option will be to sort file list before feeding it to mkisofs. According to LiveCD mailing lists this gives noticable performance boost. > Thank you by the FreeSBIE team. /fjoe From owner-freebsd-fs@FreeBSD.ORG Thu Jan 22 01:10:42 2004 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 1E64716A4CE; Thu, 22 Jan 2004 01:10:42 -0800 (PST) Received: from VARK.homeunix.com (adsl-69-104-247-110.dsl.pltn13.pacbell.net [69.104.247.110]) by mx1.FreeBSD.org (Postfix) with ESMTP id CFD0E43D31; Thu, 22 Jan 2004 01:10:40 -0800 (PST) (envelope-from das@FreeBSD.ORG) Received: from VARK.homeunix.com (localhost [127.0.0.1]) by VARK.homeunix.com (8.12.10/8.12.10) with ESMTP id i0M9A3Ku007285; Thu, 22 Jan 2004 01:10:03 -0800 (PST) (envelope-from das@FreeBSD.ORG) Received: (from das@localhost) by VARK.homeunix.com (8.12.10/8.12.10/Submit) id i0M9A3uf007284; Thu, 22 Jan 2004 01:10:03 -0800 (PST) (envelope-from das@FreeBSD.ORG) Date: Thu, 22 Jan 2004 01:10:03 -0800 From: David Schultz To: Robert Watson Message-ID: <20040122091003.GA7231@VARK.homeunix.com> Mail-Followup-To: Robert Watson , Darcy Buskermolen , Greg 'groggy' Lehey , freebsd-fs@FreeBSD.ORG References: <200401210832.52068.darcy@wavefire.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: cc: Greg 'groggy' Lehey cc: freebsd-fs@FreeBSD.ORG cc: Darcy Buskermolen Subject: Re: 32k directory limit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Jan 2004 09:10:42 -0000 On Wed, Jan 21, 2004, Robert Watson wrote: > On Wed, 21 Jan 2004, Darcy Buskermolen wrote: > > > Problem is some brain dead software (to which I don't have source) > > creating these dirs all under one dir and not nesting them in a way to > > ensure that the 32k number isn't broken. > > The largest number of files (not directories) I have in a single directory > appears to be about 1.1 million. Other than the link count, there's no > real reason there couldn't be more, although you might well bump into > other scalability limits (I have to remember not to let ls sort the > directory listing for that directory, for example). The fact that UFS lacks a hash-based on-disk directory format limits scalability. Even though lookups are optimized via hashing once the directory has been read into memory, it is still necessary to transfer the entire directory from disk (or about half of it if all lookups are successful ones). If I recall correctly, some Linux folks addressed this problem in ext2 with a hackish but reverse-compatible trick, documented in Proc. FREENIX ('98 or 2000, IIRC). Several other filesystems use a hash-based on-disk format natively. From owner-freebsd-fs@FreeBSD.ORG Fri Jan 23 18:15:26 2004 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id AEBD516A4CE; Fri, 23 Jan 2004 18:15:26 -0800 (PST) Received: from euclide.usr.dico.unimi.it (euclide.usr.dico.unimi.it [159.149.148.97]) by mx1.FreeBSD.org (Postfix) with ESMTP id 3086A43D1D; Fri, 23 Jan 2004 18:15:25 -0800 (PST) (envelope-from saturnero@euclide.usr.dico.unimi.it) Received: from euclide.usr.dico.unimi.it (localhost [127.0.0.1]) i0O2FMX5067248; Sat, 24 Jan 2004 03:15:22 +0100 (CET) (envelope-from saturnero@euclide.usr.dico.unimi.it) Received: (from saturnero@localhost) by euclide.usr.dico.unimi.it (8.12.9/8.12.9/Submit) id i0O2FMWi067247; Sat, 24 Jan 2004 03:15:22 +0100 (CET) (envelope-from saturnero) Date: Sat, 24 Jan 2004 03:15:22 +0100 (CET) Message-Id: <200401240215.i0O2FMWi067247@euclide.usr.dico.unimi.it> From: Dario Freni To: freebsd-hackers@freebsd.org, freebsd-fs@freebsd.org In-Reply-To: <200401211747.i0LHluBk057788@euclide.usr.dico.unimi.it> X-Newsgroups: gmane.os.freebsd.current,gmane.os.freebsd.devel.hackers User-Agent: tin/1.6.2-20030910 ("Pabbay") (UNIX) (FreeBSD/4.8-STABLE (i386)) Subject: Re: read-only compressed fs (call for testers) [UPDATE] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Jan 2004 02:15:26 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 > Thank you by the FreeSBIE team. You can try a FreeSBIE iso with the geom_ugz patch (compressed fs) at: http://www.willystudios.com/freesbie/FreeSBIE-cloop-test.iso.bz2 I haven't exact numbers to explain the perfomance growth, but it's really _very_ fast compared to "normal" version. As filename said, this is a test version, then any feedback is appreciated. Bye, Dario - -- Dario Freni (saturnero@gufi.org) - SaturNero on IRCNet, Azzurra Gruppo Utenti FreeBSD Italia (http://www.gufi.org) GPG Public key at http://www.saturnero.net/saturnero.asc -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.2 (FreeBSD) iD8DBQFAEdU3Z1XqWj1OqUERAsONAKDAMP7L/UIJYwC6r+SSuoA+tqt28gCcDstb nrcFjHFrhvQzuvFZguJcUk4= =OCPC -----END PGP SIGNATURE----- From owner-freebsd-fs@FreeBSD.ORG Sat Jan 24 01:24:58 2004 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0625B16A4CF; Sat, 24 Jan 2004 01:24:57 -0800 (PST) Received: from venus.vincentjardin.net (AVelizy-102-1-5-112.w193-253.abo.wanadoo.fr [193.253.220.112]) by mx1.FreeBSD.org (Postfix) with ESMTP id 95AC043D7D; Sat, 24 Jan 2004 01:24:13 -0800 (PST) (envelope-from jardin@venus.vincentjardin.net) Received: from venus.vincentjardin.net (localhost [127.0.0.1]) i0O9Qeom006491; Sat, 24 Jan 2004 10:26:40 +0100 (CET) (envelope-from jardin@venus.vincentjardin.net) Received: from localhost (localhost [[UNIX: localhost]]) by venus.vincentjardin.net (8.12.9/8.12.9/Submit) id i0O9Qdu9006490; Sat, 24 Jan 2004 10:26:39 +0100 (CET) From: Vincent Jardin To: Dario Freni , freebsd-hackers@freebsd.org, freebsd-fs@freebsd.org Date: Sat, 24 Jan 2004 10:26:36 +0100 User-Agent: KMail/1.5.2 References: <200401240215.i0O2FMWi067247@euclide.usr.dico.unimi.it> In-Reply-To: <200401240215.i0O2FMWi067247@euclide.usr.dico.unimi.it> MIME-Version: 1.0 Content-Type: Text/Plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Description: clearsigned data Content-Disposition: inline Message-Id: <200401241026.39679.vjardin@free.fr> Subject: Re: read-only compressed fs (call for testers) [UPDATE] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Jan 2004 09:24:58 -0000 Does it support XIP (eXecution In Place too) ? Regards, Vincent On Saturday 24 January 2004 03:15, Dario Freni wrote: > > Thank you by the FreeSBIE team. > > You can try a FreeSBIE iso with the geom_ugz patch (compressed fs) at: > > http://www.willystudios.com/freesbie/FreeSBIE-cloop-test.iso.bz2 > > I haven't exact numbers to explain the perfomance growth, but it's > really _very_ fast compared to "normal" version. As filename said, this > is a test version, then any feedback is appreciated. > > Bye, > Dario From owner-freebsd-fs@FreeBSD.ORG Sat Jan 24 15:56:43 2004 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B5AFD16A4CE for ; Sat, 24 Jan 2004 15:56:43 -0800 (PST) Received: from mail.codefusionis.com (ns.codefusionis.com [208.33.29.188]) by mx1.FreeBSD.org (Postfix) with SMTP id 44E1B43D31 for ; Sat, 24 Jan 2004 15:56:42 -0800 (PST) (envelope-from tedu@zeitbombe.org) Received: (qmail 16076 invoked by uid 1049); 24 Jan 2004 23:57:04 -0000 Received: from localhost (sendmail-bs@127.0.0.1) by localhost with SMTP; 24 Jan 2004 23:57:04 -0000 Date: Sat, 24 Jan 2004 18:57:04 -0500 (EST) From: Ted Unangst X-X-Sender: tedu@ns.codefusionis.com To: freebsd-fs@freebsd.org Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Subject: bug in ffs_vget/ufs_reclaim X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Jan 2004 23:56:43 -0000 in ffs_vget, there is a VREF(i_devvp) call a ways into the function. before this happens, there are several vput(vp) calls for various errors. ufs_reclaim() will call vrele(i_devvp), but maybe it was never VREF'd, meaning there will be a mismatch, eventually leading to a panic when the ref goes below zero. is this correct? -- we owe so much money we're not broke we're broken we're so poor we can't even pay attention