From owner-freebsd-fs Sun Nov 3 20:29:40 2002 Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 326D037B401 for ; Sun, 3 Nov 2002 20:29:40 -0800 (PST) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.FreeBSD.org (Postfix) with ESMTP id 09B2A43E77 for ; Sun, 3 Nov 2002 20:29:40 -0800 (PST) (envelope-from bright@elvis.mu.org) Received: by elvis.mu.org (Postfix, from userid 1192) id 970DDAE272; Sun, 3 Nov 2002 20:29:31 -0800 (PST) Date: Sun, 3 Nov 2002 20:29:31 -0800 From: Alfred Perlstein To: fs@freebsd.org Subject: how does one know if you're using ufs2? Message-ID: <20021104042931.GQ24139@elvis.mu.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4i Sender: owner-freebsd-fs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org How do you know if you're using ufs1 or ufs2 disks? To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-fs" in the body of the message From owner-freebsd-fs Mon Nov 4 0:34:55 2002 Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3FA0D37B401; Mon, 4 Nov 2002 00:34:54 -0800 (PST) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.FreeBSD.org (Postfix) with ESMTP id 0EEA343E3B; Mon, 4 Nov 2002 00:34:54 -0800 (PST) (envelope-from bright@elvis.mu.org) Received: by elvis.mu.org (Postfix, from userid 1192) id E40E6AE28A; Mon, 4 Nov 2002 00:34:53 -0800 (PST) Date: Mon, 4 Nov 2002 00:34:53 -0800 From: Alfred Perlstein To: fs@freebsd.org Cc: Kirk McKusick , Poul-Henning Kamp Subject: snapshots+dump/restore Message-ID: <20021104083453.GR24139@elvis.mu.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4i Sender: owner-freebsd-fs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org I'm cc'ing the those most involved with the current code. When taking a dump(8) on a ufs filesystem with a snapshot node the dump grabs the snapshot file and trys to dump it, shouldn't some flag or something be set on the file that tells dump(8) to skip over it? If the semantics can be agreed on I can take a shot at implementing a fix/workaround/whatever. I particularly think that dump should _never_ try to grab a .fsck_snapshot file. Comments/suggestions? -- -Alfred Perlstein [alfred@freebsd.org] 'Instead of asking why a piece of software is using "1970s technology," start asking why software is ignoring 30 years of accumulated wisdom.' To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-fs" in the body of the message From owner-freebsd-fs Mon Nov 4 0:45:44 2002 Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4796337B401; Mon, 4 Nov 2002 00:45:43 -0800 (PST) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.FreeBSD.org (Postfix) with ESMTP id 1065B43E7B; Mon, 4 Nov 2002 00:45:43 -0800 (PST) (envelope-from bright@elvis.mu.org) Received: by elvis.mu.org (Postfix, from userid 1192) id E451FAE27E; Mon, 4 Nov 2002 00:45:42 -0800 (PST) Date: Mon, 4 Nov 2002 00:45:42 -0800 From: Alfred Perlstein To: fs@freebsd.org Cc: Kirk McKusick , Poul-Henning Kamp Subject: statfs and how do show the users that they are using ufs2 vs ufs1? Message-ID: <20021104084542.GS24139@elvis.mu.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4i Sender: owner-freebsd-fs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org I recently had the (mis)fortune of having to redo my filesystems and I noticed that there doesn't seem to be an indicator of the filesystem I've created/mounted being either ufs1 or ufs2. As I started to drill down in the code I noticed some reentrancy problems with the way that statfs(2) is done. The kernel API allows/encourages one to pass the cached statfs structure hung off of the mount structure into the VFS_STATFS call. This can/will cause races in the code once Giant is pushed down into VFS. So I'm wondering: .) Do we really need the cached statfs structure? (I think leaving it is probably ok and will require less code changes) .) Shouldn't we have a generic routine to copy in the constant values from the struct mount->statfs that the filesystem specific STATFS routine can call? (although we could add the call automagically to the VFS_STATFS macro.) .) Shouldn't we stop passing in the 'cached' structure into the STATFS routine? (i think we should stop, it causes reentrancy issues) .) Any problems with me taking a shot at making the statfs structure for ufs2 mounts have the string "ufs2" instead of "ufs"? (Any gotchas I should be aware of for this?) Suggestions and comments appreciated. thanks, -- -Alfred Perlstein [alfred@freebsd.org] 'Instead of asking why a piece of software is using "1970s technology," start asking why software is ignoring 30 years of accumulated wisdom.' To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-fs" in the body of the message From owner-freebsd-fs Mon Nov 4 11: 1: 4 2002 Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6594C37B401 for ; Mon, 4 Nov 2002 11:01:03 -0800 (PST) Received: from freefall.freebsd.org (freefall.freebsd.org [216.136.204.21]) by mx1.FreeBSD.org (Postfix) with ESMTP id 40EC943E97 for ; Mon, 4 Nov 2002 11:01:00 -0800 (PST) (envelope-from owner-bugmaster@freebsd.org) Received: from freefall.freebsd.org (peter@localhost [127.0.0.1]) by freefall.freebsd.org (8.12.6/8.12.6) with ESMTP id gA4J0xx3036696 for ; Mon, 4 Nov 2002 11:00:59 -0800 (PST) (envelope-from owner-bugmaster@freebsd.org) Received: (from peter@localhost) by freefall.freebsd.org (8.12.6/8.12.6/Submit) id gA4J0x3R036680 for fs@freebsd.org; Mon, 4 Nov 2002 11:00:59 -0800 (PST) Date: Mon, 4 Nov 2002 11:00:59 -0800 (PST) Message-Id: <200211041900.gA4J0x3R036680@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: peter set sender to owner-bugmaster@freebsd.org using -f From: FreeBSD bugmaster To: fs@FreeBSD.org Subject: Current problem reports assigned to you Sender: owner-freebsd-fs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Current FreeBSD problem reports Critical problems Serious problems Non-critical problems S Submitted Tracker Resp. Description ------------------------------------------------------------------------------- a [2000/10/06] kern/21807 fs [patches] Make System attribute correspon 1 problem total. To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-fs" in the body of the message From owner-freebsd-fs Tue Nov 5 17:32:48 2002 Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E9EA637B404 for ; Tue, 5 Nov 2002 17:32:47 -0800 (PST) Received: from cs.rpi.edu (mumble.cs.rpi.edu [128.213.8.16]) by mx1.FreeBSD.org (Postfix) with ESMTP id DDAE443E42 for ; Tue, 5 Nov 2002 17:32:46 -0800 (PST) (envelope-from guptar@cs.rpi.edu) Received: from jenolen.cs.rpi.edu (jenolen.cs.rpi.edu [128.213.12.42]) by cs.rpi.edu (8.9.3/8.9.3) with ESMTP id UAA97929; Tue, 5 Nov 2002 20:32:31 -0500 (EST) Received: from localhost (guptar@localhost) by jenolen.cs.rpi.edu (8.11.6+Sun/8.9.3) with ESMTP id gA61WV600292; Tue, 5 Nov 2002 20:32:31 -0500 (EST) X-Authentication-Warning: jenolen.cs.rpi.edu: guptar owned process doing -bs Date: Tue, 5 Nov 2002 20:32:31 -0500 (EST) From: Rashim Gupta To: Alfred Perlstein Cc: "David E. Cross" , Subject: Block alloc question In-Reply-To: <20021101093713.GK24139@elvis.mu.org> Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-freebsd-fs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Hi, I have a question about the Block Alloc operation. When I have to log a block alloc operation, I think I need to log the Inode number of the file, the corresponding block and the position in the file where the block is added. My question is how can I know at what position in the file is the block added? What function/structure handles this operation? -- Thanks Rashim To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-fs" in the body of the message From owner-freebsd-fs Tue Nov 5 18:39:33 2002 Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B5A9537B401 for ; Tue, 5 Nov 2002 18:39:32 -0800 (PST) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.FreeBSD.org (Postfix) with ESMTP id 789BA43E42 for ; Tue, 5 Nov 2002 18:39:32 -0800 (PST) (envelope-from bright@elvis.mu.org) Received: by elvis.mu.org (Postfix, from userid 1192) id 489FBAE341; Tue, 5 Nov 2002 18:39:32 -0800 (PST) Date: Tue, 5 Nov 2002 18:39:32 -0800 From: Alfred Perlstein To: Rashim Gupta Cc: "David E. Cross" , fs@freebsd.org Subject: Re: Block alloc question Message-ID: <20021106023932.GC24139@elvis.mu.org> References: <20021101093713.GK24139@elvis.mu.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4i Sender: owner-freebsd-fs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org * Rashim Gupta [021105 17:33] wrote: > > Hi, > > I have a question about the Block Alloc operation. When I have to log > a block alloc operation, I think I need to log the Inode number of the > file, the corresponding block and the position in the file where the > block is added. My question is how can I know at what position in the > file is the block added? What function/structure handles this operation? see src/sys/ufs/ffs/ffs_alloc.c:ffs_alloc(ip, lbn, bpref, size, cred, bnp) ip is the inode, and lbn seems to he the logical block offset into the file, i'm not sure offhand what scaling needs to be applied to 'lbn' to get the byte offset. -- -Alfred Perlstein [alfred@freebsd.org] 'Instead of asking why a piece of software is using "1970s technology," start asking why software is ignoring 30 years of accumulated wisdom.' To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-fs" in the body of the message From owner-freebsd-fs Wed Nov 6 8:21:41 2002 Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 66F9037B401 for ; Wed, 6 Nov 2002 08:21:40 -0800 (PST) Received: from fledge.watson.org (fledge.watson.org [204.156.12.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id BED2443E4A for ; Wed, 6 Nov 2002 08:21:39 -0800 (PST) (envelope-from robert@fledge.watson.org) Received: from fledge.watson.org (fledge.pr.watson.org [192.0.2.3]) by fledge.watson.org (8.12.4/8.12.4) with SMTP id gA6GL3Oo051319; Wed, 6 Nov 2002 11:21:03 -0500 (EST) (envelope-from robert@fledge.watson.org) Date: Wed, 6 Nov 2002 11:21:02 -0500 (EST) From: Robert Watson X-Sender: robert@fledge.watson.org To: Alfred Perlstein Cc: fs@freebsd.org, mux@FreeBSD.ogr Subject: Re: how does one know if you're using ufs2? In-Reply-To: <20021104042931.GQ24139@elvis.mu.org> Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-freebsd-fs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org It might be worth exporting this information via nmount using a 'version' field, which would be set to a value of '1' if ufs1, and '2' if ufs2. Since the file name string is tied up with things like module support, we probably want to avoid tweaking that. BTW, from a practical perspective, you can probe for UFS1 vs. UFS2 by checking for extended attribute support using error = extattr_get_file("/file/system/root", "", "", 0); or something to that extent: UFS1, even with EA support, doesn't currently support listing available EAs, whereas UFS2 does. Exporting a version string would be preferred. mux@ CC'd because he's Mr Nmount. Robert N M Watson FreeBSD Core Team, TrustedBSD Projects robert@fledge.watson.org Network Associates Laboratories On Sun, 3 Nov 2002, Alfred Perlstein wrote: > How do you know if you're using ufs1 or ufs2 disks? > > To Unsubscribe: send mail to majordomo@FreeBSD.org > with "unsubscribe freebsd-fs" in the body of the message > To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-fs" in the body of the message From owner-freebsd-fs Wed Nov 6 9:46:59 2002 Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D8B0F37B404; Wed, 6 Nov 2002 09:46:58 -0800 (PST) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.FreeBSD.org (Postfix) with ESMTP id 8292843E75; Wed, 6 Nov 2002 09:46:58 -0800 (PST) (envelope-from bright@elvis.mu.org) Received: by elvis.mu.org (Postfix, from userid 1192) id 57F3DAE2DD; Wed, 6 Nov 2002 09:46:58 -0800 (PST) Date: Wed, 6 Nov 2002 09:46:58 -0800 From: Alfred Perlstein To: Robert Watson Cc: fs@freebsd.org, mux@FreeBSD.ogr Subject: Re: how does one know if you're using ufs2? Message-ID: <20021106174658.GF24139@elvis.mu.org> References: <20021104042931.GQ24139@elvis.mu.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4i Sender: owner-freebsd-fs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org * Robert Watson [021106 08:21] wrote: > It might be worth exporting this information via nmount using a 'version' > field, which would be set to a value of '1' if ufs1, and '2' if ufs2. > Since the file name string is tied up with things like module support, we > probably want to avoid tweaking that. I think this sort of info should be returned via statfs(2). Some things have picked up here but I'll be having a shot at it soon. -Alfred To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-fs" in the body of the message From owner-freebsd-fs Wed Nov 6 9:57:32 2002 Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id BB21337B401 for ; Wed, 6 Nov 2002 09:57:31 -0800 (PST) Received: from k6.locore.ca (k6.locore.ca [198.96.117.170]) by mx1.FreeBSD.org (Postfix) with ESMTP id 1680643EA3 for ; Wed, 6 Nov 2002 09:57:31 -0800 (PST) (envelope-from jake@k6.locore.ca) Received: from k6.locore.ca (jake@localhost.locore.ca [127.0.0.1]) by k6.locore.ca (8.12.5/8.12.5) with ESMTP id gA6ICgbd064983; Wed, 6 Nov 2002 13:12:42 -0500 (EST) (envelope-from jake@k6.locore.ca) Received: (from jake@localhost) by k6.locore.ca (8.12.5/8.12.5/Submit) id gA6ICf51064982; Wed, 6 Nov 2002 13:12:42 -0500 (EST) Date: Wed, 6 Nov 2002 13:12:41 -0500 From: Jake Burkholder To: Alfred Perlstein Cc: fs@FreeBSD.ORG Subject: Re: how does one know if you're using ufs2? Message-ID: <20021106131241.D22677@locore.ca> References: <20021104042931.GQ24139@elvis.mu.org> <20021106174658.GF24139@elvis.mu.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2.5i In-Reply-To: <20021106174658.GF24139@elvis.mu.org>; from bright@mu.org on Wed, Nov 06, 2002 at 09:46:58AM -0800 Sender: owner-freebsd-fs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Apparently, On Wed, Nov 06, 2002 at 09:46:58AM -0800, Alfred Perlstein said words to the effect of; > * Robert Watson [021106 08:21] wrote: > > It might be worth exporting this information via nmount using a 'version' > > field, which would be set to a value of '1' if ufs1, and '2' if ufs2. > > Since the file name string is tied up with things like module support, we > > probably want to avoid tweaking that. > > I think this sort of info should be returned via statfs(2). Some things > have picked up here but I'll be having a shot at it soon. You can find out with dumpfs. Jake To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-fs" in the body of the message From owner-freebsd-fs Wed Nov 6 15: 7:39 2002 Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8DDE637B401 for ; Wed, 6 Nov 2002 15:07:36 -0800 (PST) Received: from mail.tuke.sk (mailand.tuke.sk [147.232.3.2]) by mx1.FreeBSD.org (Postfix) with ESMTP id BAA5B43E88 for ; Wed, 6 Nov 2002 15:07:35 -0800 (PST) (envelope-from ) From: Antivirus-Daemon@mail.tuke.sk Subject: Recipient Virus-alert (sender: webmaster@tuke.sk) MIME-Version: 1.0 Content-Type: multipart/report; report-type=delivery-status; boundary="avcheck-rcpt-22499-20021107000721@mail.tuke.sk" Message-Id: <20021106230721.55C09166A33@mail.tuke.sk> Date: Thu, 7 Nov 2002 00:07:21 +0100 (CET) To: undisclosed-recipients: ; Sender: owner-freebsd-fs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org This is a multi-part message in MIME format. --avcheck-rcpt-22499-20021107000721@mail.tuke.sk Content-Type: text/plain; charset=iso-8859-2 Content-Description: Notification See English message below. Pozdrav od antiviroveho programu zo servera mail.tuke.sk Postovy server dostal spravu od webmaster@tuke.sk urcenu vam, ktora vsak obsahovala napadnuty alebo podozrivy subor(y) a nebola vam preto dorucena. Podla hlavicky posty bola posta odoslana z: Received: from Bjxeojyts (pc2i.fei.tuke.sk [147.232.34.109]) POZOR!!! Najnovsie virusy si nielenze nahodne vyberaju prijemcu, ale aj odosielatela, takze webmaster@tuke.sk v skutocnosti vobec nemusel byt odosielatelom zavirenej spravy - presvedcit sa mozete prezretim jej kompletnej hlavicky, kde najdete uplnu cestu od odosielatela k prijemcovi. (dolezite su polia Received: - postupnost je zobrazena smerom zdola nahor) Pokial chcete, aby vam bola sprava dorucena, poziadajte prosim jej odosielatela, webmaster@tuke.sk (ak to bol skutocne on), aby najprv odviroval svoj pocitac s pomocou antiviroveho programu a odoslal spravu znova alebo poziadajte o pomoc svojho spravcu siete. Hlavicka povodnej spravy, vid priloha. Sprava(y) antiviru: suspicion: Exploit.IFrame.FileDownload infected: I-Worm.Klez.h Na spravu, ktoru prave citate, prosim neodpovedajte -- vasa odpoved nebude dorucena. A ja, antivirovy program, by som si ju bohuzial aj tak nevedel precitat... :) --- This is a mail anti-virus program at host mail.tuke.sk. The mail system received a message from webmaster@tuke.sk destined to you that contains either infected or suspicious file(s) and it has not reached you. In order to receive that message, please ask sender of it, webmaster@tuke.sk, to clean his/her machine using antivirus software, and resend the message to you again, or ask your system administrator for help. Original message headers given below. Antivirus message(s): suspicion: Exploit.IFrame.FileDownload infected: I-Worm.Klez.h Please, do not respond to *this* message you're reading now -- your response will be lost. I, the antivirus program, will be unable to read your response, sorry... :) --avcheck-rcpt-22499-20021107000721@mail.tuke.sk Content-Type: message/rfc822-headers Content-Description: Infected message headers Received: from smtp.tuke.sk (dot.tuke.sk [147.232.16.16]) by mail.tuke.sk (Postfix) with ESMTP id D1929166983 for ; Thu, 7 Nov 2002 00:07:20 +0100 (CET) Received: from Bjxeojyts (pc2i.fei.tuke.sk [147.232.34.109]) by smtp.tuke.sk (Postfix) with SMTP id 8CFFFB4187 for ; Thu, 7 Nov 2002 00:07:14 +0100 (CET) From: nemecek To: freebsd-fs@FreeBSD.org Subject: Arial, ms MIME-Version: 1.0 Content-Type: multipart/alternative; boundary=S095DIeaXh0sL15 Message-Id: <20021106230714.8CFFFB4187@smtp.tuke.sk> Date: Thu, 7 Nov 2002 00:07:14 +0100 (CET) --avcheck-rcpt-22499-20021107000721@mail.tuke.sk-- To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-fs" in the body of the message From owner-freebsd-fs Thu Nov 7 7:48:55 2002 Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id C7AD537B401 for ; Thu, 7 Nov 2002 07:48:53 -0800 (PST) Received: from dastardly.newsbastards.org.72.27.172.IN-addr.ARPA.NetScum.dyndns.dk (dclient80-218-16-8.hispeed.ch [80.218.16.8]) by mx1.FreeBSD.org (Postfix) with ESMTP id A59A443E42 for ; Thu, 7 Nov 2002 07:48:48 -0800 (PST) (envelope-from bounce@dcf77-zeit.netscum.dyndns.dk) Received: from MAIL.NetScum.DynDNS.dK (ipv6.NetScum.dyndns.dk [2002:50da:1008:0:200:c0ff:fefc:19aa]) by dastardly.newsbastards.org.72.27.172.IN-addr.ARPA.NetScum.dyndns.dk (8.11.6/8.11.6-SPAMMERS-DeLiGHt) with ESMTP id gA7Fmhh00516 (using TLSv1/SSLv3 with cipher EDH-RSA-DES-CBC3-SHA (168 bits) verified NO) for ; Thu, 7 Nov 2002 16:48:46 +0100 (CET) (envelope-from bounce@dcf77-zeit.netscum.dyndns.dk) Received: (from root@localhost) by MAIL.NetScum.DynDNS.dK (8.11.6/SMI-4.1-R00T0WNED) id gA7Fmhl00515; Thu, 7 Nov 2002 16:48:43 +0100 (CET) (envelope-from bounce@dcf77-zeit.netscum.dyndns.dk) Date: Thu, 7 Nov 2002 16:48:43 +0100 (CET) Message-Id: <200211071548.gA7Fmhl00515@MAIL.NetScum.DynDNS.dK> From: BOUWSMA Beery Organization: Men not wearing any pants that dont shave To: freebsd-fs@freebsd.org Subject: B0rken -current handling of UFS1 filesystems with 64k block size... X-Hacked: via telnet to your port 25, what else? X-Internet-Access-Provided-By: CABAL MODEM (all hail CABAL) X-NetScum: Yes X-One-And-Only-Real-True-Fluffy: No Sender: owner-freebsd-fs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org [IPv6-only address above; strip the obvious for IPv4-only mail] Howdy y'all, I'm trying to track down why many parts of -current seem to have been broken when handling filesystems I've been successfully using with -stable (and with ancient -current), that I created with 64k block size. It seems that dumpfs (in particular, since it's easiest to try) worked fine as of 19.Jun (before the UFS2 commit) based on a binary found on current.freeebsd.org, while 07.Jul binary (one of only a few available before the libufs commit) fails just as a binary from today. It appears that that since 21.Jun (the UFS2 commit), the search for a superblock happens first at a location 64k into the disk (default UFS2 location), then at 8k (original UFS1 location), then at the beginning (floppies), then at 256k (piggy location)? That's what ufs/ffs/fs.h implies to me. If I have a UFS1 filesystem that I created with 64k block size, is it possible that in addition to the real superblock at 8k, there is an alternate superblock, or something similar, at 64k, which is found, but which does not have the up-to-date data, which confuses dumpfs, fsck, df, and who knows what all, under -current? In fact, adding debugging to libufs/sblock.c indicates that the bogus superblock info I see is found by the search at a 64k offset, and that by ignoring this data, I get the proper data when the search continues at the 8k offset. If this is true, explaining the difference in `ndir' and free inodes and date and so on between the -current and -stable `dumpfs' output, maybe something like a sanity check that at 64k, it really is a UFS2 magic superblock that is found, else skip to the next check at 8k or wherever for the UFS1 superblock... Or something -- not sure what. (maybe there are issues, like specifying an alternate superblock location to fsck, that would preclude this, but a quick look showed me that the problematic fsck didn't even seem to use libufs in recent -current. maybe there are also problems with a real superblock offset for floppy at 0, and something at 8k?) I will happily post info about the problems I've observed, which can be readily reproduced under -current by creating a new filesystem as UFS1 with -b blocksize of 65536, after which -current's `fsck' complains that numdir is zero, and the output of `dumpfs' differs greatly from that of -stable, and mounting the `newfs'ed filesystem and checking with `df' shows zero inodes or space used, even after filling the disk under -stable (don't remember if filling under -current worked or if I tried). These filesystems *seem* to have no problems (at least nothing significant) when created by -current but used by -stable. Just ask me for the detailed message I composed before deciding to try to track this down first before posting. thanks, barry bouwsma To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-fs" in the body of the message From owner-freebsd-fs Fri Nov 8 10:24:21 2002 Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7AD0C37B401 for ; Fri, 8 Nov 2002 10:24:20 -0800 (PST) Received: from web13207.mail.yahoo.com (web13207.mail.yahoo.com [216.136.174.192]) by mx1.FreeBSD.org (Postfix) with SMTP id 349F943E6E for ; Fri, 8 Nov 2002 10:24:20 -0800 (PST) (envelope-from vm2908tml@yahoo.com) Message-ID: <20021108182420.5418.qmail@web13207.mail.yahoo.com> Received: from [66.162.33.178] by web13207.mail.yahoo.com via HTTP; Fri, 08 Nov 2002 10:24:20 PST Date: Fri, 8 Nov 2002 10:24:20 -0800 (PST) From: vishal mittal Subject: Question regarding filesystem performance To: freebsd-fs@FreeBSD.ORG MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Sender: owner-freebsd-fs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Hi, I am working on a 4.4-RELEASE. I have about 30,000 1K files in a directory. Any delete or move operation on a file in this directory introduces unacceptable delays in some other time-critical processes that I am running on the machine. I am assuming that the delay is because of the large number of files due to which it takes a longer time to update the inode information and, delete and move being atomic operations, they do not relinquish the CPU for the other processes during that time. If the problem is what I think it is then is there a way to overcome this problem by tuning some parameter or something? I am not sure if this is the right mailing list to ask this question on. If it is not, then I would appreciate someone pointing me to right one. Thanks -Vishal __________________________________________________ Do you Yahoo!? U2 on LAUNCH - Exclusive greatest hits videos http://launch.yahoo.com/u2 To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-fs" in the body of the message From owner-freebsd-fs Fri Nov 8 10:35:29 2002 Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 2A27237B401 for ; Fri, 8 Nov 2002 10:35:28 -0800 (PST) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.FreeBSD.org (Postfix) with ESMTP id E397143E6E for ; Fri, 8 Nov 2002 10:35:27 -0800 (PST) (envelope-from bright@elvis.mu.org) Received: by elvis.mu.org (Postfix, from userid 1192) id A6277AE265; Fri, 8 Nov 2002 10:35:27 -0800 (PST) Date: Fri, 8 Nov 2002 10:35:27 -0800 From: Alfred Perlstein To: vishal mittal Cc: freebsd-fs@FreeBSD.ORG Subject: Re: Question regarding filesystem performance Message-ID: <20021108183527.GN39178@elvis.mu.org> References: <20021108182420.5418.qmail@web13207.mail.yahoo.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20021108182420.5418.qmail@web13207.mail.yahoo.com> User-Agent: Mutt/1.4i Sender: owner-freebsd-fs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org * vishal mittal [021108 10:24] wrote: > Hi, > > I am working on a 4.4-RELEASE. I have about 30,000 1K > files in a directory. Any delete or move operation on > a file in this directory introduces unacceptable > delays in some other time-critical processes that I am > running on the machine. > > I am assuming that the delay is because of the large > number of files due to which it takes a longer time to > update the inode information and, delete and move > being atomic operations, they do not relinquish the > CPU for the other processes during that time. No. The problem is that each operation causes linear searches on the directory contents which is expensive. > If the problem is what I think it is then is there a > way to overcome this problem by tuning some parameter > or something? Yes, by using the UFS_DIRHASH kernel option, however I really recommend that you upgrade to a more recent version of FreeBSD 4, (4.7) because the version of the code for UFS_DIRHASH in 4.4 is marked experimental and may not be stable. -- -Alfred Perlstein [alfred@freebsd.org] 'Instead of asking why a piece of software is using "1970s technology," start asking why software is ignoring 30 years of accumulated wisdom.' To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-fs" in the body of the message From owner-freebsd-fs Fri Nov 8 14:26:26 2002 Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 37AEF37B401 for ; Fri, 8 Nov 2002 14:26:25 -0800 (PST) Received: from scaup.mail.pas.earthlink.net (scaup.mail.pas.earthlink.net [207.217.120.49]) by mx1.FreeBSD.org (Postfix) with ESMTP id D1E3343E4A for ; Fri, 8 Nov 2002 14:26:24 -0800 (PST) (envelope-from tlambert2@mindspring.com) Received: from pool0224.cvx22-bradley.dialup.earthlink.net ([209.179.198.224] helo=mindspring.com) by scaup.mail.pas.earthlink.net with esmtp (Exim 3.33 #1) id 18AHa3-0005Nk-00; Fri, 08 Nov 2002 14:26:24 -0800 Message-ID: <3DCC39BD.53818C3E@mindspring.com> Date: Fri, 08 Nov 2002 14:25:01 -0800 From: Terry Lambert X-Mailer: Mozilla 4.79 [en] (Win98; U) X-Accept-Language: en MIME-Version: 1.0 To: vishal mittal Cc: freebsd-fs@FreeBSD.ORG Subject: Re: Question regarding filesystem performance References: <20021108182420.5418.qmail@web13207.mail.yahoo.com> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Sender: owner-freebsd-fs@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org vishal mittal wrote: > I am working on a 4.4-RELEASE. I have about 30,000 1K > files in a directory. Any delete or move operation on > a file in this directory introduces unacceptable > delays in some other time-critical processes that I am > running on the machine. > > I am assuming that the delay is because of the large > number of files due to which it takes a longer time to > update the inode information and, delete and move > being atomic operations, they do not relinquish the > CPU for the other processes during that time. No. The delay is because in order to locate the files, it must do an average of 15,000 strncmp()'s on a hit, and 30,000 strncmp()'s on a miss. Use a hashed directory structure, instead. -- Terry To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-fs" in the body of the message