From owner-freebsd-fs Mon Mar 5 12:59:12 2001 Delivered-To: freebsd-fs@freebsd.org Received: from mail.cise.ufl.edu (beach.cise.ufl.edu [128.227.205.211]) by hub.freebsd.org (Postfix) with ESMTP id 1B8F037B718 for ; Mon, 5 Mar 2001 12:59:10 -0800 (PST) (envelope-from jfh@cise.ufl.edu) Received: from cise.ufl.edu (waterspout.cise.ufl.edu [128.227.205.52]) by mail.cise.ufl.edu (Postfix) with ESMTP id E659BDCD2 for ; Mon, 5 Mar 2001 15:59:06 -0500 (EST) To: freebsd-fs@freebsd.org Subject: Re: Softupdates umount bug? Or vinum problem? In-Reply-To: Message from "James F. Hranicky" of "Thu, 22 Feb 2001 00:33:23 EST." <20010222053323.631B4DCD9@mail.cise.ufl.edu> Date: Mon, 05 Mar 2001 15:59:06 -0500 From: "James F. Hranicky" Message-Id: <20010305205906.E659BDCD2@mail.cise.ufl.edu> Sender: owner-freebsd-fs@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org "James F. Hranicky" wrote: > > I stress tested a new fs for about 4 hours, creating and removing > 100,000+ files at a time, and all went well until I tried to add > a larger plex to the vinum volume. This time, I got a crash in > the vinum routines: For anyone still wondering about this, I goofed and didn't look in the known bugs section at http://www.vinumvm.com/bugs.html : * 23 September 2000: When reviving a striped plex, writes will be lost to the area which has already been written. This does not apply to concatenated plexes, nor to RAID-4 and RAID-5 plexes. Technical explanation: This is a bug. I had forgotten to write the code. Workaround: When reviving striped plexes, ensure that no other write I/O takes place. The simplest way to achieve this is to unmount the volume. Status: Fix in planning. My bad, a sync to a striped plex on an unmounted fs worked fine. ---------------------------------------------------------------------- | Jim Hranicky, Senior SysAdmin UF/CISE Department | | E314D CSE Building Phone (352) 392-1499 | | jfh@cise.ufl.edu http://www.cise.ufl.edu/~jfh | ---------------------------------------------------------------------- - Encryption: its use by criminals is far less - - frightening than its banishment by governments - - Vote for Privacy - To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-fs" in the body of the message From owner-freebsd-fs Sat Mar 10 3:15:23 2001 Delivered-To: freebsd-fs@freebsd.org Received: from obsecurity.dyndns.org (adsl-63-207-60-158.dsl.lsan03.pacbell.net [63.207.60.158]) by hub.freebsd.org (Postfix) with ESMTP id 526CE37B71F; Sat, 10 Mar 2001 03:15:18 -0800 (PST) (envelope-from kris@obsecurity.org) Received: by obsecurity.dyndns.org (Postfix, from userid 1000) id 59D8466BC9; Sat, 10 Mar 2001 03:15:16 -0800 (PST) Date: Sat, 10 Mar 2001 03:15:15 -0800 From: Kris Kennaway To: hackers@FreeBSD.org Cc: fs@FreeBSD.org Subject: httpfs Message-ID: <20010310031515.A8998@mollari.cthul.hu> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-md5; protocol="application/pgp-signature"; boundary="IJpNTDwzlM2Ie8A6" Content-Disposition: inline User-Agent: Mutt/1.2.5i Sender: owner-freebsd-fs@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org --IJpNTDwzlM2Ie8A6 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline A few of us were talking on IRC tonight about how cool it would be to have an httpfs filesystem -- then it occurred to me we almost have this already, in the form of the (under-utilised) portalfs. Portalfs works by handing off everything to a userland daemon which handles the actual transaction request, so you could easily imagine extending it to provide an http method similar to the tcp method it currently has for initiating tcp connections. One could probably make this more generic and finish implementing the undocumented 'exec' method (which currently exists as a stub): this would run an administrator-specified command (i.e. fixed in /etc/portal.conf) and pipe the output back to the user. A fully navigable httpfs (e.g. one you can ls and cd around in) is more work and probably requires a full stacking layer, but this would still be pretty cool. Is anyone feeling inspired to implement this? :-) Kris --IJpNTDwzlM2Ie8A6 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.0.4 (FreeBSD) Comment: For info see http://www.gnupg.org iD8DBQE6qgzDWry0BWjoQKURAk8QAKDG8KRZDePyH1IVlS2e1U4B3B63fQCgyTc9 7sLZBMrBbsH/NG4YeHbpApk= =G5nl -----END PGP SIGNATURE----- --IJpNTDwzlM2Ie8A6-- To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-fs" in the body of the message From owner-freebsd-fs Sat Mar 10 3:33:44 2001 Delivered-To: freebsd-fs@freebsd.org Received: from sdmail0.sd.bmarts.com (sdmail0.sd.bmarts.com [209.247.77.155]) by hub.freebsd.org (Postfix) with ESMTP id 396E637B718; Sat, 10 Mar 2001 03:33:39 -0800 (PST) (envelope-from gordont@bluemtn.net) Received: from localhost (gordont@localhost) by sdmail0.sd.bmarts.com (8.11.3/8.11.2/BMA1.1) with ESMTP id f2ABXB386871; Sat, 10 Mar 2001 03:33:11 -0800 (PST) Date: Sat, 10 Mar 2001 03:33:11 -0800 (PST) From: Gordon Tetlow X-X-Sender: To: Kris Kennaway Cc: , Subject: Re: httpfs In-Reply-To: <20010310031515.A8998@mollari.cthul.hu> Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-freebsd-fs@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org I don't have a link handy, but if you search for it, I'm sure it's out there. Linux had something like this called PerlFS which was much more generic. The general gist of it was you could use it to make fs's of things like http and ftp. It was extendable (I think) so you could make your own fs handlers out of perl scripts. I could be making alot of this up as this was a long time ago, and I'm too lazy/tired to pull up a web browser and look. In any event, it might be a good spot to look for ideas. If no one else has, I'll see what I can dig up in the morning. Night. -gordon On Sat, 10 Mar 2001, Kris Kennaway wrote: > A few of us were talking on IRC tonight about how cool it would be to > have an httpfs filesystem -- then it occurred to me we almost have > this already, in the form of the (under-utilised) portalfs. Portalfs > works by handing off everything to a userland daemon which handles the > actual transaction request, so you could easily imagine extending it > to provide an http method similar to the tcp method it currently has > for initiating tcp connections. > > One could probably make this more generic and finish implementing the > undocumented 'exec' method (which currently exists as a stub): this > would run an administrator-specified command (i.e. fixed in > /etc/portal.conf) and pipe the output back to the user. > > A fully navigable httpfs (e.g. one you can ls and cd around in) is > more work and probably requires a full stacking layer, but this would > still be pretty cool. > > Is anyone feeling inspired to implement this? :-) > > Kris > To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-fs" in the body of the message From owner-freebsd-fs Sat Mar 10 8:13:54 2001 Delivered-To: freebsd-fs@freebsd.org Received: from milquetoast.cs.mcgill.ca (milquetoast.CS.McGill.CA [132.206.2.5]) by hub.freebsd.org (Postfix) with ESMTP id B17E637B718; Sat, 10 Mar 2001 08:13:50 -0800 (PST) (envelope-from mat@milquetoast.cs.mcgill.ca) Received: (from mat@localhost) by milquetoast.cs.mcgill.ca (8.9.3/8.9.3) id LAA14413; Sat, 10 Mar 2001 11:12:13 -0500 (EST) Date: Sat, 10 Mar 2001 11:12:13 -0500 From: Mathew KANNER To: Kris Kennaway Cc: hackers@FreeBSD.ORG, fs@FreeBSD.ORG Subject: Re: httpfs Message-ID: <20010310111213.A13278@cs.mcgill.ca> References: <20010310031515.A8998@mollari.cthul.hu> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2.5i In-Reply-To: Kris Kennaway's message [httpfs] as of Sat, Mar 10, 2001 at 03:15:15AM -0800 Organization: I speak for myself, operating in Montreal, CANADA Sender: owner-freebsd-fs@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org On Mar 10, Kris Kennaway wrote: > A few of us were talking on IRC tonight about how cool it would be to > have an httpfs filesystem -- then it occurred to me we almost have > this already, in the form of the (under-utilised) portalfs. Portalfs > works by handing off everything to a userland daemon which handles the > actual transaction request, so you could easily imagine extending it > to provide an http method similar to the tcp method it currently has > for initiating tcp connections. [...] Reminds me on something I read. http://zowie.metnet.navy.mil/~oleg/ftp/USENIX99/ --Mat -- Mathew Kanner Sys Admin at large Obtuse quote: He [not me] understands: "This field of perception is void of perception of man." -- The Quintessence of Buddhism To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-fs" in the body of the message From owner-freebsd-fs Sat Mar 10 10:40:13 2001 Delivered-To: freebsd-fs@freebsd.org Received: from fledge.watson.org (fledge.watson.org [204.156.12.50]) by hub.freebsd.org (Postfix) with ESMTP id D422437B719; Sat, 10 Mar 2001 10:40:08 -0800 (PST) (envelope-from robert@fledge.watson.org) Received: from fledge.watson.org (robert@fledge.pr.watson.org [192.0.2.3]) by fledge.watson.org (8.11.1/8.11.1) with SMTP id f2AIaVh18783; Sat, 10 Mar 2001 13:36:31 -0500 (EST) (envelope-from robert@fledge.watson.org) Date: Sat, 10 Mar 2001 13:36:30 -0500 (EST) From: Robert Watson X-Sender: robert@fledge.watson.org To: Kris Kennaway Cc: hackers@FreeBSD.org, fs@FreeBSD.org Subject: Re: httpfs In-Reply-To: <20010310031515.A8998@mollari.cthul.hu> Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-freebsd-fs@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org I need not remind you that file systems front-ending onto random protocols are a bad idea for a huge number of reasons :-). That said, you might take a look at Intermezzo, which someone has already refered to indirectly in response to your e-mail -- Intermezzo is a file system for Linux (based on Coda) that allows perl programs to provide the back-end for a file system. I assume this is done in the style of AFS/Arla/Coda by having a small kernel module that up-calls to userland using a /dev/whatever entry, and then a userland program that satisfies the requests in some or another way. If you're really interested in implementing yet-another-nasty-file-system-abomination, take a look at Arla and rip out the AFS bits and replace them with HTTP bits :-). Robert N M Watson FreeBSD Core Team, TrustedBSD Project robert@fledge.watson.org NAI Labs, Safeport Network Services On Sat, 10 Mar 2001, Kris Kennaway wrote: > A few of us were talking on IRC tonight about how cool it would be to > have an httpfs filesystem -- then it occurred to me we almost have > this already, in the form of the (under-utilised) portalfs. Portalfs > works by handing off everything to a userland daemon which handles the > actual transaction request, so you could easily imagine extending it > to provide an http method similar to the tcp method it currently has > for initiating tcp connections. > > One could probably make this more generic and finish implementing the > undocumented 'exec' method (which currently exists as a stub): this > would run an administrator-specified command (i.e. fixed in > /etc/portal.conf) and pipe the output back to the user. > > A fully navigable httpfs (e.g. one you can ls and cd around in) is > more work and probably requires a full stacking layer, but this would > still be pretty cool. > > Is anyone feeling inspired to implement this? :-) > > Kris > To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-fs" in the body of the message