From owner-freebsd-fs@FreeBSD.ORG Mon Oct 2 15:03:37 2006 Return-Path: X-Original-To: fs@freebsd.org Delivered-To: freebsd-fs@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id EE48E16A47C for ; Mon, 2 Oct 2006 15:03:37 +0000 (UTC) (envelope-from joe@tao.org.uk) Received: from mailhost.tao.org.uk (transwarp.tao.org.uk [87.74.4.34]) by mx1.FreeBSD.org (Postfix) with ESMTP id 49EC043D72 for ; Mon, 2 Oct 2006 15:03:36 +0000 (GMT) (envelope-from joe@tao.org.uk) Received: from genius.tao.org.uk (genius.pact.cpes.susx.ac.uk [139.184.130.240]) by mailhost.tao.org.uk (Postfix) with ESMTP id 88E615C68 for ; Mon, 2 Oct 2006 16:03:35 +0100 (BST) Received: by genius.tao.org.uk (Postfix, from userid 100) id 7F9844075; Mon, 2 Oct 2006 16:03:33 +0100 (BST) Date: Mon, 2 Oct 2006 16:03:33 +0100 From: Josef Karthauser To: fs@freebsd.org Message-ID: <20061002150333.GB2587@genius.tao.org.uk> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="vtzGhvizbBRQ85DL" Content-Disposition: inline User-Agent: Mutt/1.5.11 Cc: Subject: Snapshots not being created... [brooks@one-eyed-alien.net: Re: Drives always come up dirty after shutdown on 6.2-PRERELEASE.] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Oct 2006 15:03:38 -0000 --vtzGhvizbBRQ85DL Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hi guys, It looks like snapshots are failing on my laptop, so background fscks don't work :/. Can someone help me get to the bottom of it please? Thanks :). Joe ----- Forwarded message from Brooks Davis ----- Date: Mon, 2 Oct 2006 09:58:04 -0500 =46rom: Brooks Davis To: Josef Karthauser , Brooks Davis , stable@FreeBSD.org Subject: Re: Drives always come up dirty after shutdown on 6.2-PRERELEASE. On Mon, Oct 02, 2006 at 12:10:10PM +0100, Josef Karthauser wrote: > On Fri, Sep 29, 2006 at 09:44:07AM -0500, Brooks Davis wrote: > > On Fri, Sep 29, 2006 at 02:16:12PM +0100, Josef Karthauser wrote: > > > Hey guys, > > >=20 > > > I'm not really on the ball with reading the lists now-a-days, and so > > > I've not idea whether this has been discussed already. > > >=20 > > > On my laptop running 6.2-PRERELEASE the drives always mount dirty, wh= ich > > > suggests that they are not being shutdown clean; however the machine > > > always syncs the disks and switches itself off after a 'shutdown -p > > > now', and so I'm not sure what it could be. > > >=20 > > > Has anyone else seen this? > >=20 > > I haven't seen any other reports of this. Have you tried running a > > "fsck -f" on the drives? It's possible there's a latent error that > > isn't being fixed by bgfsck. > >=20 >=20 > Closer investigation reveals that I've getting this error: >=20 > laptop# fsck -B /var > background fsck lacks a snapshot >=20 > So, that explains it. The background fsck isn't running. So, any ideas > why it isn't snapshotting? >=20 > laptop# ls -ld /var/.snap > drwxrwx--- 2 root operator 512 Oct 2 12:09 /var/.snap This message appears to be the result of fsck thinking it created a snapshot, but not actually doing so. You might try asking over on -fs. -- Brooks ----- End forwarded message ----- --=20 Josef Karthauser (joe@tao.org.uk) http://www.josef-k.net/ Physics Particle Theory (student) http://www.pact.cpes.sussex.ac.uk/ =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D An eclectic mix of fact an= d theory. =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D --vtzGhvizbBRQ85DL Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.4 (FreeBSD) iEYEARECAAYFAkUhKkQACgkQXVIcjOaxUBacpACg6Zj78Wgv6pmMZRh93foLaxh1 DVwAoLwJtk0rOh+SI3YGBDPj4IOHTyFW =dQRy -----END PGP SIGNATURE----- --vtzGhvizbBRQ85DL-- From owner-freebsd-fs@FreeBSD.ORG Mon Oct 2 15:08:42 2006 Return-Path: X-Original-To: fs@freebsd.org Delivered-To: freebsd-fs@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7997A16A412; Mon, 2 Oct 2006 15:08:42 +0000 (UTC) (envelope-from anderson@centtech.com) Received: from mh2.centtech.com (moat3.centtech.com [64.129.166.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id 1657843D73; Mon, 2 Oct 2006 15:08:41 +0000 (GMT) (envelope-from anderson@centtech.com) Received: from [10.177.171.220] (neutrino.centtech.com [10.177.171.220]) by mh2.centtech.com (8.13.1/8.13.1) with ESMTP id k92F8fg2087220; Mon, 2 Oct 2006 10:08:41 -0500 (CDT) (envelope-from anderson@centtech.com) Message-ID: <45212B77.2040906@centtech.com> Date: Mon, 02 Oct 2006 10:08:39 -0500 From: Eric Anderson User-Agent: Thunderbird 1.5.0.7 (X11/20060923) MIME-Version: 1.0 To: Josef Karthauser References: <20061002150333.GB2587@genius.tao.org.uk> In-Reply-To: <20061002150333.GB2587@genius.tao.org.uk> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV 0.87.1/1972/Mon Oct 2 09:25:50 2006 on mh2.centtech.com X-Virus-Status: Clean Cc: fs@freebsd.org Subject: Re: Snapshots not being created... [brooks@one-eyed-alien.net: Re: Drives always come up dirty after shutdown on 6.2-PRERELEASE.] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Oct 2006 15:08:42 -0000 Can you send more information, like: tunefs -p /var grep var /etc/fstab mount | grep var Thanks! Eric On 10/02/06 10:03, Josef Karthauser wrote: > Hi guys, > > It looks like snapshots are failing on my laptop, so background fscks > don't work :/. Can someone help me get to the bottom of it please? > > Thanks :). > Joe > > ----- Forwarded message from Brooks Davis ----- > > Date: Mon, 2 Oct 2006 09:58:04 -0500 > From: Brooks Davis > To: Josef Karthauser , > Brooks Davis , stable@FreeBSD.org > Subject: Re: Drives always come up dirty after shutdown on 6.2-PRERELEASE. > > On Mon, Oct 02, 2006 at 12:10:10PM +0100, Josef Karthauser wrote: >> On Fri, Sep 29, 2006 at 09:44:07AM -0500, Brooks Davis wrote: >>> On Fri, Sep 29, 2006 at 02:16:12PM +0100, Josef Karthauser wrote: >>>> Hey guys, >>>> >>>> I'm not really on the ball with reading the lists now-a-days, and so >>>> I've not idea whether this has been discussed already. >>>> >>>> On my laptop running 6.2-PRERELEASE the drives always mount dirty, which >>>> suggests that they are not being shutdown clean; however the machine >>>> always syncs the disks and switches itself off after a 'shutdown -p >>>> now', and so I'm not sure what it could be. >>>> >>>> Has anyone else seen this? >>> I haven't seen any other reports of this. Have you tried running a >>> "fsck -f" on the drives? It's possible there's a latent error that >>> isn't being fixed by bgfsck. >>> >> Closer investigation reveals that I've getting this error: >> >> laptop# fsck -B /var >> background fsck lacks a snapshot >> >> So, that explains it. The background fsck isn't running. So, any ideas >> why it isn't snapshotting? >> >> laptop# ls -ld /var/.snap >> drwxrwx--- 2 root operator 512 Oct 2 12:09 /var/.snap > > This message appears to be the result of fsck thinking it created a > snapshot, but not actually doing so. You might try asking over on -fs. > > -- Brooks > > > > ----- End forwarded message ----- > -- ------------------------------------------------------------------------ Eric Anderson Sr. Systems Administrator Centaur Technology Anything that works is better than anything that doesn't. ------------------------------------------------------------------------ From owner-freebsd-fs@FreeBSD.ORG Mon Oct 2 17:59:23 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A2AC116A403 for ; Mon, 2 Oct 2006 17:59:23 +0000 (UTC) (envelope-from andrew@areilly.bpa.nu) Received: from omta05sl.mx.bigpond.com (omta05sl.mx.bigpond.com [144.140.93.195]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9309443D7B for ; Mon, 2 Oct 2006 17:59:21 +0000 (GMT) (envelope-from andrew@areilly.bpa.nu) Received: from areilly.bpa.nu ([141.168.2.3]) by omta05sl.mx.bigpond.com with ESMTP id <20061002175920.QQNM15497.omta05sl.mx.bigpond.com@areilly.bpa.nu> for ; Mon, 2 Oct 2006 17:59:20 +0000 Received: (qmail 49692 invoked by uid 501); 2 Oct 2006 17:57:48 -0000 Date: Tue, 3 Oct 2006 03:57:48 +1000 From: Andrew Reilly To: Jacques Marneweck Message-ID: <20061002175748.GA48064@duncan.reilly.home> References: <20060929015352.GA46546@duncan.reilly.home> <20060929143749.GO64985@prometheus.powertrip.co.za> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20060929143749.GO64985@prometheus.powertrip.co.za> User-Agent: Mutt/1.4.2.2i Cc: freebsd-fs@freebsd.org Subject: Re: Doesn't *anyone* (else) use an atacontrol-built software RAID1 (mirror)? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Oct 2006 17:59:23 -0000 On Fri, Sep 29, 2006 at 04:37:49PM +0200, Jacques Marneweck wrote: > On Fri, Sep 29, 2006 at 11:53:52AM +1000, Andrew Reilly wrote: > I normally would reinstall a machine from scratch rather than having a mission > to upgrade from one major release to another major release. That's what I think that I'll have to do. It's a pity, as I've had good success doing the 5->6 transition in place on other machines. That's a much smaller step than the gargantuan 4->5 upgrade, which definitely needed a from-scratch switch (to get UFS2 on the disks). I suppose that I should report the raid breakage in a pr, so that it becomes a known problem. > Also the software pseudo raid behaves quite well from my usage of it in > production environments. Yes, it's certainly been working well for me on 5-stable, so far. Cheers, -- Andrew From owner-freebsd-fs@FreeBSD.ORG Tue Oct 3 01:12:44 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7964316A40F for ; Tue, 3 Oct 2006 01:12:44 +0000 (UTC) (envelope-from adamsch1@yahoo.com) Received: from web31812.mail.mud.yahoo.com (web31812.mail.mud.yahoo.com [68.142.207.75]) by mx1.FreeBSD.org (Postfix) with SMTP id 077FE43D58 for ; Tue, 3 Oct 2006 01:12:43 +0000 (GMT) (envelope-from adamsch1@yahoo.com) Received: (qmail 19535 invoked by uid 60001); 3 Oct 2006 01:12:43 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:Received:Date:From:Subject:To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=pvE4bw6IFyEiHvS9RGUhRZRs955n7taJUFlgI4btTZRPZiGBAH5B8Qdhzw0QwuwZMrNxDp161ivE/65MeZo9KfkWZasRE/KQ7K1N/Dn5WOXdVcmo1fvOpDtftOV8Valgbnz9v4D7sx+t/2LPjYMD/a1PQWsLiLu4/sNWS6MtRkk= ; Message-ID: <20061003011243.19533.qmail@web31812.mail.mud.yahoo.com> Received: from [69.236.99.151] by web31812.mail.mud.yahoo.com via HTTP; Mon, 02 Oct 2006 18:12:43 PDT Date: Mon, 2 Oct 2006 18:12:42 -0700 (PDT) From: Shane Adams To: freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ascii Content-Transfer-Encoding: quoted-printable Subject: curiosity between bread and UFS_BALLOC on struct buf X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Oct 2006 01:12:44 -0000 Hey all,=0A=0AI've been puzzling with a bit of code. I'm creating a file f= rom within a kernel module, that works fine, but I've got a question if per= haps I'm missing something:=0A=0AI use UFS_BALLOC to allocate some space. = That function has a struct buf thats returned. What I would expect is that= I could manipulate the bp->b_data field then do a bwrite and have my chang= es saved. Doesnt work that way. Only way=0AI can get it to work is=0A=0A1= UFS_BALLOC( ... )=0A=0A2 bwrite( .. )=0A=0A3 bread( ... )=0A=0A4 /* Make c= hanges to what I read */=0A=0A5 bwrite()=0A=0ASeems like I could get rid of= , 2 and 3. I'm not sure why I have to bwrite the buffer returned from UFS_= BALLOC. I dug around and there are a few examples of where ffs/ufs manipul= ate the buffer returned from UFS_BALLOC so I am guessing I'm missing a flag= or something.=0A=0AHope the question is clear enough!=0A=0ACheers,=0A Sha= ne=0A=0A From owner-freebsd-fs@FreeBSD.ORG Tue Oct 3 03:31:51 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 1680216A407 for ; Tue, 3 Oct 2006 03:31:51 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from pooker.samsco.org (pooker.samsco.org [168.103.85.57]) by mx1.FreeBSD.org (Postfix) with ESMTP id A2C5643D46 for ; Tue, 3 Oct 2006 03:31:50 +0000 (GMT) (envelope-from scottl@samsco.org) Received: from pooker.samsco.home (pooker.samsco.home [192.168.254.1]) by pooker.samsco.org (8.13.4/8.13.4) with ESMTP id k933ViA5055539; Mon, 2 Oct 2006 21:31:49 -0600 (MDT) (envelope-from scottl@samsco.org) Date: Mon, 2 Oct 2006 21:31:44 -0600 (MDT) From: Scott Long To: Shane Adams In-Reply-To: <20061003011243.19533.qmail@web31812.mail.mud.yahoo.com> Message-ID: <20061002212040.V38801@pooker.samsco.org> References: <20061003011243.19533.qmail@web31812.mail.mud.yahoo.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed X-Spam-Status: No, score=-1.4 required=3.8 tests=ALL_TRUSTED autolearn=failed version=3.1.1 X-Spam-Checker-Version: SpamAssassin 3.1.1 (2006-03-10) on pooker.samsco.org Cc: freebsd-fs@freebsd.org Subject: Re: curiosity between bread and UFS_BALLOC on struct buf X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Oct 2006 03:31:51 -0000 On Mon, 2 Oct 2006, Shane Adams wrote: > Hey all, > I've been puzzling with a bit of code. I'm creating a file from within > a kernel module, that works fine, but I've got a question if perhaps I'm > missing something: > > I use UFS_BALLOC to allocate some space. That function has a struct buf > thats returned. What I would expect is that I could manipulate the > bp->b_data field then do a bwrite and have my changes saved. Doesnt > workthat way. Only way I can get it to work is > > 1 UFS_BALLOC( ... ) > > 2 bwrite( .. ) > > 3 bread( ... ) > > 4 /* Make changes to what I read */ > > 5 bwrite() > > Seems like I could get rid of, 2 and 3. I'm not sure why I have to > bwrite the buffer returned from UFS_BALLOC. I dug around and there are > a few examples of where ffs/ufs manipulate the buffer returned from > UFS_BALLOC so I am guessing I'm missing a flag or something. > > Hope the question is clear enough! You shouldn't be groping around in UFS internals like this. Using VOP_WRITE will probably serve you much better. Look at something like kern_ktrace.c to see how file writing in the kernel is done. Scott From owner-freebsd-fs@FreeBSD.ORG Tue Oct 3 06:26:49 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id F3C0B16A403 for ; Tue, 3 Oct 2006 06:26:48 +0000 (UTC) (envelope-from adamsch1@yahoo.com) Received: from web31810.mail.mud.yahoo.com (web31810.mail.mud.yahoo.com [68.142.207.73]) by mx1.FreeBSD.org (Postfix) with SMTP id 8F48743D46 for ; Tue, 3 Oct 2006 06:26:48 +0000 (GMT) (envelope-from adamsch1@yahoo.com) Received: (qmail 24346 invoked by uid 60001); 3 Oct 2006 06:26:48 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:Received:Date:From:Subject:To:Cc:MIME-Version:Content-Type:Content-Transfer-Encoding; b=BIbO3J1LF5n2izD38teyX+Qm52H05fP+sFKT/lqOr6XquLund9o395YsBmBPGWmtZZO+FEYS5bc//4wQbQmVOXSSQSDcVyTKBd8BdCNYDAMIplrhcH6tr6i8koR7JEcq+2Yq9Rs9B0hBJILwoObSYviTLbToGwoYzZuX5mLmHoU= ; Message-ID: <20061003062648.24344.qmail@web31810.mail.mud.yahoo.com> Received: from [69.236.99.151] by web31810.mail.mud.yahoo.com via HTTP; Mon, 02 Oct 2006 23:26:48 PDT Date: Mon, 2 Oct 2006 23:26:48 -0700 (PDT) From: Shane Adams To: Scott Long MIME-Version: 1.0 Content-Type: text/plain; charset=ascii Content-Transfer-Encoding: quoted-printable Cc: freebsd-fs@freebsd.org Subject: Re: curiosity between bread and UFS_BALLOC on struct buf X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Oct 2006 06:26:49 -0000 Hey thanks for the response! I should of mentioned that I am hacking on my= own filesystem, using UFS/FFS as a basis. So I'm actually below VOP_*. = I did find in my digging throught the code that UFS_BALLOC ultimatly for my= code path gets the bufer from a call to getblk.=0A=0AFrom the documentatio= n I've read I would think that I could then immediatly bwrite on that buffe= r, which I attempt, but my change application specific changes to the buffe= r do not persist. I have a couple of anciallary functions that do the brea= d/bwrite and those work perfectly.=0A=0A*shrug*=0A=0AHopefully I'll nail it= !=0A=0ACheers,=0A Shane=0A=0A=0A----- Original Message ----=0AFrom: Scott = Long =0ATo: Shane Adams =0ACc: freeb= sd-fs@freebsd.org=0ASent: Monday, October 2, 2006 8:31:44 PM=0ASubject: Re:= curiosity between bread and UFS_BALLOC on struct buf=0A=0A=0A=0AOn Mon, 2 = Oct 2006, Shane Adams wrote:=0A=0A> Hey all,=0A=0A> I've been puzzling with= a bit of code. I'm creating a file from within=0A> a kernel module, that = works fine, but I've got a question if perhaps I'm=0A> missing something:= =0A>=0A> I use UFS_BALLOC to allocate some space. That function has a stru= ct buf=0A> thats returned. What I would expect is that I could manipulate = the=0A> bp->b_data field then do a bwrite and have my changes saved. Doesn= t =0A> workthat way. Only way I can get it to work is=0A> =0A> 1 UFS_BALLO= C( ... )=0A> =0A> 2 bwrite( .. )=0A> =0A> 3 bread( ... )=0A> =0A> 4 /* Make= changes to what I read */=0A> =0A> 5 bwrite()=0A> =0A> Seems like I could = get rid of, 2 and 3. I'm not sure why I have to =0A> bwrite the buffer ret= urned from UFS_BALLOC. I dug around and there are=0A> a few examples of wh= ere ffs/ufs manipulate the buffer returned from=0A> UFS_BALLOC so I am gues= sing I'm missing a flag or something.=0A> =0A> Hope the question is clear e= nough!=0A=0AYou shouldn't be groping around in UFS internals like this. Us= ing =0AVOP_WRITE will probably serve you much better. Look at something li= ke=0Akern_ktrace.c to see how file writing in the kernel is done.=0A=0AScot= t=0A=0A=0A=0A From owner-freebsd-fs@FreeBSD.ORG Tue Oct 3 06:51:42 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 1C2C416A403 for ; Tue, 3 Oct 2006 06:51:42 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from pooker.samsco.org (pooker.samsco.org [168.103.85.57]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7E75343D45 for ; Tue, 3 Oct 2006 06:51:41 +0000 (GMT) (envelope-from scottl@samsco.org) Received: from [192.168.254.11] (phobos.samsco.home [192.168.254.11]) (authenticated bits=0) by pooker.samsco.org (8.13.4/8.13.4) with ESMTP id k936pYWM056298; Tue, 3 Oct 2006 00:51:40 -0600 (MDT) (envelope-from scottl@samsco.org) Message-ID: <45220876.1060109@samsco.org> Date: Tue, 03 Oct 2006 00:51:34 -0600 From: Scott Long User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.0.7) Gecko/20060910 SeaMonkey/1.0.5 MIME-Version: 1.0 To: Shane Adams References: <20061003062648.24344.qmail@web31810.mail.mud.yahoo.com> In-Reply-To: <20061003062648.24344.qmail@web31810.mail.mud.yahoo.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-1.4 required=3.8 tests=ALL_TRUSTED autolearn=failed version=3.1.1 X-Spam-Checker-Version: SpamAssassin 3.1.1 (2006-03-10) on pooker.samsco.org Cc: freebsd-fs@freebsd.org Subject: Re: curiosity between bread and UFS_BALLOC on struct buf X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Oct 2006 06:51:42 -0000 Ok, that makes more sense. Yes, you need to use getblk(). Once you've modified the bp->b_data, you need to set appropriate flags on the buf so the the VM system knows that buffer is dirty and needs to be flushed to disk. Although B_DIRTY looks like the obvious flag, it apparently only has meaning to ext2fs. What you need to do is clear B_INVAL if it is set. You might also need to twiddle B_CACHE, but I can't recall for sure anymore. Scott Shane Adams wrote: > Hey thanks for the response! I should of mentioned that I am hacking on my own filesystem, using UFS/FFS as a basis. So I'm actually below VOP_*. I did find in my digging throught the code that UFS_BALLOC ultimatly for my code path gets the bufer from a call to getblk. > > From the documentation I've read I would think that I could then immediatly bwrite on that buffer, which I attempt, but my change application specific changes to the buffer do not persist. I have a couple of anciallary functions that do the bread/bwrite and those work perfectly. > > *shrug* > > Hopefully I'll nail it! > > Cheers, > Shane > > > ----- Original Message ---- > From: Scott Long > To: Shane Adams > Cc: freebsd-fs@freebsd.org > Sent: Monday, October 2, 2006 8:31:44 PM > Subject: Re: curiosity between bread and UFS_BALLOC on struct buf > > > > On Mon, 2 Oct 2006, Shane Adams wrote: > >> Hey all, > >> I've been puzzling with a bit of code. I'm creating a file from within >> a kernel module, that works fine, but I've got a question if perhaps I'm >> missing something: >> >> I use UFS_BALLOC to allocate some space. That function has a struct buf >> thats returned. What I would expect is that I could manipulate the >> bp->b_data field then do a bwrite and have my changes saved. Doesnt >> workthat way. Only way I can get it to work is >> >> 1 UFS_BALLOC( ... ) >> >> 2 bwrite( .. ) >> >> 3 bread( ... ) >> >> 4 /* Make changes to what I read */ >> >> 5 bwrite() >> >> Seems like I could get rid of, 2 and 3. I'm not sure why I have to >> bwrite the buffer returned from UFS_BALLOC. I dug around and there are >> a few examples of where ffs/ufs manipulate the buffer returned from >> UFS_BALLOC so I am guessing I'm missing a flag or something. >> >> Hope the question is clear enough! > > You shouldn't be groping around in UFS internals like this. Using > VOP_WRITE will probably serve you much better. Look at something like > kern_ktrace.c to see how file writing in the kernel is done. > > Scott > > > > From owner-freebsd-fs@FreeBSD.ORG Tue Oct 3 10:39:33 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0EF5C16A403; Tue, 3 Oct 2006 10:39:33 +0000 (UTC) (envelope-from schilling@fokus.fraunhofer.de) Received: from mailhub.fokus.fraunhofer.de (mailhub.fokus.fraunhofer.de [193.174.154.14]) by mx1.FreeBSD.org (Postfix) with ESMTP id EF90643D4C; Tue, 3 Oct 2006 10:39:31 +0000 (GMT) (envelope-from schilling@fokus.fraunhofer.de) Received: from burner.fokus.fraunhofer.de (burner [10.147.65.166]) by mailhub.fokus.fraunhofer.de (8.11.6p2/8.11.6) with ESMTP id k93AcKd06071; Tue, 3 Oct 2006 12:38:20 +0200 (MEST) Received: (from jes@localhost) by burner.fokus.fraunhofer.de (8.12.9+Sun/8.12.9/Submit) id k93Aakbm007244; Tue, 3 Oct 2006 12:36:46 +0200 (CEST) Date: Tue, 03 Oct 2006 12:36:45 +0200 From: Joerg.Schilling@fokus.fraunhofer.de (Joerg Schilling) To: freebsd-fs@freebsd.org, freebsd-current@freebsd.org Message-ID: <45223d3d.5Il+WW9HwkAuGvSH%Joerg.Schilling@fokus.fraunhofer.de> User-Agent: nail 11.22 3/20/05 MIME-Version: 1.0 Content-Type: text/plain; charset=ISO8859-1 Content-Transfer-Encoding: 8bit Cc: Subject: Reliable hard links with mkisofs/ISO-9660/RR X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Oct 2006 10:39:33 -0000 Hi, I just started to implement a long planned extension to mkisofs and Solaris hsfs that will allow hard links to work correctly. Is there any interest to also support this on FreeBSD? Jörg -- EMail:joerg@schily.isdn.cs.tu-berlin.de (home) Jörg Schilling D-13353 Berlin js@cs.tu-berlin.de (uni) schilling@fokus.fraunhofer.de (work) Blog: http://schily.blogspot.com/ URL: http://cdrecord.berlios.de/old/private/ ftp://ftp.berlios.de/pub/schily From owner-freebsd-fs@FreeBSD.ORG Tue Oct 3 12:38:58 2006 Return-Path: X-Original-To: freebsd-fs@FreeBSD.ORG Delivered-To: freebsd-fs@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8F75816A403 for ; Tue, 3 Oct 2006 12:38:58 +0000 (UTC) (envelope-from des@des.no) Received: from tim.des.no (tim.des.no [194.63.250.121]) by mx1.FreeBSD.org (Postfix) with ESMTP id 1DD0B43D49 for ; Tue, 3 Oct 2006 12:38:58 +0000 (GMT) (envelope-from des@des.no) Received: from tim.des.no (localhost [127.0.0.1]) by spam.des.no (Postfix) with ESMTP id 55FA82087; Tue, 3 Oct 2006 14:38:54 +0200 (CEST) X-Spam-Tests: AWL X-Spam-Learn: disabled X-Spam-Score: 0.0/3.0 X-Spam-Checker-Version: SpamAssassin 3.1.4 (2006-07-25) on tim.des.no Received: from dwp.des.no (des.no [80.203.243.180]) by tim.des.no (Postfix) with ESMTP id 3C0A62086; Tue, 3 Oct 2006 14:38:54 +0200 (CEST) Received: by dwp.des.no (Postfix, from userid 1001) id 235F2B80E; Tue, 3 Oct 2006 14:38:54 +0200 (CEST) From: des@des.no (Dag-Erling =?iso-8859-1?Q?Sm=F8rgrav?=) To: Eric Anderson References: <200609271744.k8RHipTS032655@lurza.secnetix.de> <451AC81E.5070803@centtech.com> Date: Tue, 03 Oct 2006 14:38:54 +0200 In-Reply-To: <451AC81E.5070803@centtech.com> (Eric Anderson's message of "Wed, 27 Sep 2006 13:51:10 -0500") Message-ID: <86y7rxh8v5.fsf@dwp.des.no> User-Agent: Gnus/5.110004 (No Gnus v0.4) Emacs/21.3 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable Cc: freebsd-fs@FreeBSD.ORG, Oliver Fromme Subject: Re: Hi: Porting Cramfs on FreeBSD X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Oct 2006 12:38:58 -0000 Eric Anderson writes: > No, only inode+direntries need to fit into memory. So an FS with > 1million inodes might take .5MB of memory (estimate). How are you going to do that? Whenever you want to read a file, you'll have to start decompressing the entire tarball from the beginning, since it's a single gzip stream. You can't just seek to an arbitrary position in the stream and start decompressing there. DES --=20 Dag-Erling Sm=F8rgrav - des@des.no From owner-freebsd-fs@FreeBSD.ORG Tue Oct 3 14:03:51 2006 Return-Path: X-Original-To: freebsd-fs@FreeBSD.ORG Delivered-To: freebsd-fs@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6D90416A4C9 for ; Tue, 3 Oct 2006 14:03:51 +0000 (UTC) (envelope-from anderson@centtech.com) Received: from mh2.centtech.com (moat3.centtech.com [64.129.166.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id D087A43D55 for ; Tue, 3 Oct 2006 14:03:50 +0000 (GMT) (envelope-from anderson@centtech.com) Received: from [10.177.171.220] (neutrino.centtech.com [10.177.171.220]) by mh2.centtech.com (8.13.1/8.13.1) with ESMTP id k93E3lic009220; Tue, 3 Oct 2006 09:03:47 -0500 (CDT) (envelope-from anderson@centtech.com) Message-ID: <45226DC1.3080302@centtech.com> Date: Tue, 03 Oct 2006 09:03:45 -0500 From: Eric Anderson User-Agent: Thunderbird 1.5.0.7 (X11/20060923) MIME-Version: 1.0 To: =?ISO-8859-1?Q?Dag-Erling_Sm=F8rgrav?= References: <200609271744.k8RHipTS032655@lurza.secnetix.de> <451AC81E.5070803@centtech.com> <86y7rxh8v5.fsf@dwp.des.no> In-Reply-To: <86y7rxh8v5.fsf@dwp.des.no> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit X-Virus-Scanned: ClamAV 0.87.1/1984/Tue Oct 3 05:01:28 2006 on mh2.centtech.com X-Virus-Status: Clean Cc: freebsd-fs@FreeBSD.ORG, Oliver Fromme Subject: Re: Hi: Porting Cramfs on FreeBSD X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Oct 2006 14:03:51 -0000 On 10/03/06 07:38, Dag-Erling Smørgrav wrote: > Eric Anderson writes: >> No, only inode+direntries need to fit into memory. So an FS with >> 1million inodes might take .5MB of memory (estimate). > > How are you going to do that? Whenever you want to read a file, > you'll have to start decompressing the entire tarball from the > beginning, since it's a single gzip stream. You can't just seek to an > arbitrary position in the stream and start decompressing there. > > DES First, that .5MB estimate was off by quite a bit - I'm not sure what I was calculating when I did that, but I know I was tired. :) Anyway, I'm not currently supporting compressed archives, but obviously they would be very useful and are on my roadmap. Tim Kientzle gave me some ideas, and I'll ping him again when I get to that point.' Eric -- ------------------------------------------------------------------------ Eric Anderson Sr. Systems Administrator Centaur Technology Anything that works is better than anything that doesn't. ------------------------------------------------------------------------ From owner-freebsd-fs@FreeBSD.ORG Tue Oct 3 18:26:53 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 608E516A403; Tue, 3 Oct 2006 18:26:53 +0000 (UTC) (envelope-from prvs=julian=42450540e@elischer.org) Received: from a50.ironport.com (a50.ironport.com [63.251.108.112]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2338743D5D; Tue, 3 Oct 2006 18:26:53 +0000 (GMT) (envelope-from prvs=julian=42450540e@elischer.org) Received: from unknown (HELO [10.251.18.229]) ([10.251.18.229]) by a50.ironport.com with ESMTP; 03 Oct 2006 11:26:53 -0700 Message-ID: <4522AB6D.9050309@elischer.org> Date: Tue, 03 Oct 2006 11:26:53 -0700 From: Julian Elischer User-Agent: Thunderbird 1.5.0.7 (Macintosh/20060909) MIME-Version: 1.0 To: Joerg Schilling References: <45223d3d.5Il+WW9HwkAuGvSH%Joerg.Schilling@fokus.fraunhofer.de> In-Reply-To: <45223d3d.5Il+WW9HwkAuGvSH%Joerg.Schilling@fokus.fraunhofer.de> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit Cc: freebsd-fs@freebsd.org, freebsd-current@freebsd.org Subject: Re: Reliable hard links with mkisofs/ISO-9660/RR X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Oct 2006 18:26:53 -0000 Joerg Schilling wrote: > Hi, > > I just started to implement a long planned extension to mkisofs > and Solaris hsfs that will allow hard links to work correctly. > > Is there any interest to also support this on FreeBSD? > Sorry to be obtuse, but if you write it in mkisofs then won't it automatically be supported on FreeBSD when we use mkisofs? Is it possible that you are asking about our kernel isofs support? > > > > Jörg > > From owner-freebsd-fs@FreeBSD.ORG Tue Oct 3 18:43:58 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5A11D16A47B; Tue, 3 Oct 2006 18:43:58 +0000 (UTC) (envelope-from schilling@fokus.fraunhofer.de) Received: from mailhub.fokus.fraunhofer.de (mailhub.fokus.fraunhofer.de [193.174.154.14]) by mx1.FreeBSD.org (Postfix) with ESMTP id 5873743D45; Tue, 3 Oct 2006 18:43:56 +0000 (GMT) (envelope-from schilling@fokus.fraunhofer.de) Received: from burner.fokus.fraunhofer.de (burner [10.147.65.166]) by mailhub.fokus.fraunhofer.de (8.11.6p2/8.11.6) with ESMTP id k93Igfd15900; Tue, 3 Oct 2006 20:42:41 +0200 (MEST) Received: (from jes@localhost) by burner.fokus.fraunhofer.de (8.12.9+Sun/8.12.9/Submit) id k93If94f007505; Tue, 3 Oct 2006 20:41:09 +0200 (CEST) Date: Tue, 03 Oct 2006 20:41:09 +0200 From: Joerg.Schilling@fokus.fraunhofer.de (Joerg Schilling) To: julian@elischer.org Message-ID: <4522aec5.4ZbRSHkZMuJ7r3BT%Joerg.Schilling@fokus.fraunhofer.de> References: <45223d3d.5Il+WW9HwkAuGvSH%Joerg.Schilling@fokus.fraunhofer.de> <4522AB6D.9050309@elischer.org> In-Reply-To: <4522AB6D.9050309@elischer.org> User-Agent: nail 11.22 3/20/05 MIME-Version: 1.0 Content-Type: text/plain; charset=ISO8859-1 Content-Transfer-Encoding: 8bit Cc: freebsd-fs@freebsd.org, freebsd-current@freebsd.org Subject: Re: Reliable hard links with mkisofs/ISO-9660/RR X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Oct 2006 18:43:58 -0000 Julian Elischer wrote: > Joerg Schilling wrote: > > Hi, > > > > I just started to implement a long planned extension to mkisofs > > and Solaris hsfs that will allow hard links to work correctly. > > > > Is there any interest to also support this on FreeBSD? > > > > Sorry to be obtuse, but if you write it in mkisofs then won't it > automatically be supported > on FreeBSD when we use mkisofs? > > Is it possible that you are asking about our kernel isofs support? FreeBSD currently seems to bascally implement the same fake inode algorithm as SunOS does since ~ 1989. I did extend mkisofs during the past days and started to extend hsfs from Solaris. Once I am ready, I could present the results in case there is someone who is willing to work on the FreeBSD filesystem module, I could explain what needs to be done. Jörg -- EMail:joerg@schily.isdn.cs.tu-berlin.de (home) Jörg Schilling D-13353 Berlin js@cs.tu-berlin.de (uni) schilling@fokus.fraunhofer.de (work) Blog: http://schily.blogspot.com/ URL: http://cdrecord.berlios.de/old/private/ ftp://ftp.berlios.de/pub/schily From owner-freebsd-fs@FreeBSD.ORG Wed Oct 4 12:17:59 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 47C0B16A61B for ; Wed, 4 Oct 2006 12:17:59 +0000 (UTC) (envelope-from r.c.ladan@gmail.com) Received: from wx-out-0506.google.com (wx-out-0506.google.com [66.249.82.239]) by mx1.FreeBSD.org (Postfix) with ESMTP id C9F0343D49 for ; Wed, 4 Oct 2006 12:17:58 +0000 (GMT) (envelope-from r.c.ladan@gmail.com) Received: by wx-out-0506.google.com with SMTP id i27so147089wxd for ; Wed, 04 Oct 2006 05:17:58 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition; b=kUyqiy0jNuMR/dkTzmvGC4Z1MPuY3Q7Vn/oGcnGupdQ/vxnZAMHFIueN01389CrUPueIFvGb5WwVgoS6PxZl5X+nbjJbSY+w93BjrWh2xlEzo4r6jbRbyk/YW/bEnaWHsuK8brTgJL18Cd+Ri6VmZIXsGR7wVg+j+dN/H483HDE= Received: by 10.70.67.2 with SMTP id p2mr970787wxa; Wed, 04 Oct 2006 05:17:57 -0700 (PDT) Received: by 10.70.124.15 with HTTP; Wed, 4 Oct 2006 05:17:57 -0700 (PDT) Message-ID: Date: Wed, 4 Oct 2006 14:17:57 +0200 From: "Rene Ladan" To: freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline Subject: how about XTAF / FATX support ? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Oct 2006 12:17:59 -0000 Hi, I was thinking about (trying to) implementing FATX / XTAF support in FreeBSD. FATX and XTAF are the two filesystems used on Xbox 360 hard disks, FATX is also used on Xbox 1 hard disks. The implementation would add 2 new mount commands and some kernel stuff (which can be based on /sys/fs/mdosfs). Opinions? Please cc me, I'm not (yet) subscribed to this list. Regards, Rene -- GPG fingerprint = E738 5471 D185 7013 0EE0 4FC8 3C1D 6F83 12E1 84F6 (subkeys.pgp.net) "It won't fit on the line." -- me, 2001 From owner-freebsd-fs@FreeBSD.ORG Wed Oct 4 12:24:49 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id F167416A415 for ; Wed, 4 Oct 2006 12:24:49 +0000 (UTC) (envelope-from anderson@centtech.com) Received: from mh1.centtech.com (moat3.centtech.com [64.129.166.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7619E43D46 for ; Wed, 4 Oct 2006 12:24:49 +0000 (GMT) (envelope-from anderson@centtech.com) Received: from [10.177.171.220] (neutrino.centtech.com [10.177.171.220]) by mh1.centtech.com (8.13.1/8.13.1) with ESMTP id k94COmlg090905; Wed, 4 Oct 2006 07:24:49 -0500 (CDT) (envelope-from anderson@centtech.com) Message-ID: <4523A810.4050305@centtech.com> Date: Wed, 04 Oct 2006 07:24:48 -0500 From: Eric Anderson User-Agent: Thunderbird 1.5.0.7 (X11/20060923) MIME-Version: 1.0 To: Rene Ladan References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV 0.87.1/1994/Tue Oct 3 23:10:39 2006 on mh1.centtech.com X-Virus-Status: Clean Cc: freebsd-fs@freebsd.org Subject: Re: how about XTAF / FATX support ? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Oct 2006 12:24:50 -0000 On 10/04/06 07:17, Rene Ladan wrote: > Hi, > > I was thinking about (trying to) implementing FATX / XTAF support in > FreeBSD. FATX and XTAF are the two filesystems used on Xbox 360 hard > disks, FATX is also used on Xbox 1 hard disks. > > The implementation would add 2 new mount commands and some kernel > stuff (which can be based on /sys/fs/mdosfs). > > Opinions? > > Please cc me, I'm not (yet) subscribed to this list. > > Regards, > Rene Will it be BSD licensed, or a port from another licensed open source fs? Eric -- ------------------------------------------------------------------------ Eric Anderson Sr. Systems Administrator Centaur Technology Anything that works is better than anything that doesn't. ------------------------------------------------------------------------ From owner-freebsd-fs@FreeBSD.ORG Wed Oct 4 13:23:29 2006 Return-Path: X-Original-To: fs@freebsd.org Delivered-To: freebsd-fs@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 2F01416A566; Wed, 4 Oct 2006 13:23:29 +0000 (UTC) (envelope-from OscarMarting@arcor-ip.net) Received: from arcor-ip.net (dslb-088-073-196-004.pools.arcor-ip.net [88.73.196.4]) by mx1.FreeBSD.org (Postfix) with SMTP id 2020343D49; Wed, 4 Oct 2006 13:23:27 +0000 (GMT) (envelope-from OscarMarting@arcor-ip.net) Message-Id: <535413052.13745957@arcor-ip.net> From: "Bridgett Roth" To: , Date: Wed, 04 Oct 2006 15:23:27 +0100 MIME-Version: 1.0 Cc: furuta@freebsd.org Subject: lengthenj X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Oct 2006 13:23:29 -0000 Energy Prices are near all time low, This is the best time to lock in a quality energy stock Introducing : WBRS Exchange Pinksheets Price: 0.05 3 Day Estimated : .50 ( +1000%) WILD BRUSH MAKES A MOVE! Wild Brush Acquires Additional Powder River Oil & Gas Lease. Who is Wild Brush? Wild Brush Energy is a diversified energy company whose primary goal is to identify and develop Oil & Coalbed Methane sites within the State of Wyoming. In addition, Wild Brush Energy continues to evaluate clean air alternative energy producing technologies such as Wind Power. Wild Brush trades in the U.S. under the symbol "WBRS." ADD THIS ENERGY STOCK TO YOUR LIST AND WATCH IT TRADE CLOSELY ON WEDNESDAY OCTOBER 4! Get In NOW !!! Stubborn as a mule. Wet behind the ears. Rare as walking on water. Water it down. Still water runs dirty and deep. The shoes on the other foot now. That's a real stem winder. Sly as a fox. Waking up with the chickens. A thing of beauty is a joy forever. Water under the bridge. From owner-freebsd-fs@FreeBSD.ORG Wed Oct 4 15:12:09 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E270E16A521 for ; Wed, 4 Oct 2006 15:12:09 +0000 (UTC) (envelope-from r.c.ladan@gmail.com) Received: from wx-out-0506.google.com (wx-out-0506.google.com [66.249.82.237]) by mx1.FreeBSD.org (Postfix) with ESMTP id AD84C43D8B for ; Wed, 4 Oct 2006 15:12:02 +0000 (GMT) (envelope-from r.c.ladan@gmail.com) Received: by wx-out-0506.google.com with SMTP id i27so193425wxd for ; Wed, 04 Oct 2006 08:12:02 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=LpI4VukZYv1y5SpcqnCqD7mYPMPxfhgSdr9FYkTtp97gqhiac4T4vmGwBj3CMvCcJXdkozi5Pmt7LuHqLKSMGlZqrBCchlFvcAWrTsHqsgN3nwe/5aLLc5drCv25+JXhSrllcP3PS6KZgHdgIc31RjIi24OkadI7rCNB/4YvHaI= Received: by 10.70.19.16 with SMTP id 16mr1174482wxs; Wed, 04 Oct 2006 08:12:01 -0700 (PDT) Received: by 10.70.124.15 with HTTP; Wed, 4 Oct 2006 08:12:01 -0700 (PDT) Message-ID: Date: Wed, 4 Oct 2006 17:12:01 +0200 From: "Rene Ladan" To: "Eric Anderson" In-Reply-To: <4523A810.4050305@centtech.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <4523A810.4050305@centtech.com> Cc: freebsd-fs@freebsd.org Subject: Re: how about XTAF / FATX support ? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Oct 2006 15:12:10 -0000 2006/10/4, Eric Anderson : > On 10/04/06 07:17, Rene Ladan wrote: > > Hi, > > > > I was thinking about (trying to) implementing FATX / XTAF support in > > FreeBSD. FATX and XTAF are the two filesystems used on Xbox 360 hard > > disks, FATX is also used on Xbox 1 hard disks. > > > > The implementation would add 2 new mount commands and some kernel > > stuff (which can be based on /sys/fs/mdosfs). > > > > Opinions? > > > > Please cc me, I'm not (yet) subscribed to this list. > > > > Regards, > > Rene > > Will it be BSD licensed, or a port from another licensed open source fs? > The goal is to make it BSD-licensed. I have some documentation available about the filesystems and an actual Xbox 360 hard disk which I can connect to a USB port using a 3rd party connector. Regards, Rene -- GPG fingerprint = E738 5471 D185 7013 0EE0 4FC8 3C1D 6F83 12E1 84F6 (subkeys.pgp.net) "It won't fit on the line." -- me, 2001 From owner-freebsd-fs@FreeBSD.ORG Wed Oct 4 19:36:04 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id DD25016A407 for ; Wed, 4 Oct 2006 19:36:04 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from pooker.samsco.org (pooker.samsco.org [168.103.85.57]) by mx1.FreeBSD.org (Postfix) with ESMTP id 5D38743D78 for ; Wed, 4 Oct 2006 19:36:03 +0000 (GMT) (envelope-from scottl@samsco.org) Received: from [10.10.3.185] ([165.236.175.187]) (authenticated bits=0) by pooker.samsco.org (8.13.4/8.13.4) with ESMTP id k94JZtmJ086143; Wed, 4 Oct 2006 13:36:00 -0600 (MDT) (envelope-from scottl@samsco.org) Message-ID: <45240D13.5060202@samsco.org> Date: Wed, 04 Oct 2006 13:35:47 -0600 From: Scott Long User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.7.12) Gecko/20060206 X-Accept-Language: en-us, en MIME-Version: 1.0 To: Rene Ladan References: <4523A810.4050305@centtech.com> In-Reply-To: Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.0 required=3.8 tests=none autolearn=failed version=3.1.1 X-Spam-Checker-Version: SpamAssassin 3.1.1 (2006-03-10) on pooker.samsco.org Cc: freebsd-fs@freebsd.org Subject: Re: how about XTAF / FATX support ? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Oct 2006 19:36:04 -0000 Rene Ladan wrote: > 2006/10/4, Eric Anderson : > >> On 10/04/06 07:17, Rene Ladan wrote: >> > Hi, >> > >> > I was thinking about (trying to) implementing FATX / XTAF support in >> > FreeBSD. FATX and XTAF are the two filesystems used on Xbox 360 hard >> > disks, FATX is also used on Xbox 1 hard disks. >> > >> > The implementation would add 2 new mount commands and some kernel >> > stuff (which can be based on /sys/fs/mdosfs). >> > >> > Opinions? >> > >> > Please cc me, I'm not (yet) subscribed to this list. >> > >> > Regards, >> > Rene >> >> Will it be BSD licensed, or a port from another licensed open source fs? >> > The goal is to make it BSD-licensed. I have some documentation > available about the filesystems and an actual Xbox 360 hard disk which > I can connect to a USB port using a 3rd party connector. > > Regards, > Rene Sounds like a very good idea to me. Scott From owner-freebsd-fs@FreeBSD.ORG Thu Oct 5 20:25:32 2006 Return-Path: X-Original-To: fs@freebsd.org Delivered-To: freebsd-fs@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 468EA16A403 for ; Thu, 5 Oct 2006 20:25:32 +0000 (UTC) (envelope-from bde@zeta.org.au) Received: from mailout1.pacific.net.au (mailout1-3.pacific.net.au [61.8.2.210]) by mx1.FreeBSD.org (Postfix) with ESMTP id AE4CE43D67 for ; Thu, 5 Oct 2006 20:25:31 +0000 (GMT) (envelope-from bde@zeta.org.au) Received: from mailproxy2.pacific.net.au (mailproxy2.pacific.net.au [61.8.2.163]) by mailout1.pacific.net.au (Postfix) with ESMTP id 390CB5DFE89 for ; Fri, 6 Oct 2006 06:25:30 +1000 (EST) Received: from epsplex.bde.org (katana.zip.com.au [61.8.7.246]) by mailproxy2.pacific.net.au (8.13.4/8.13.4/Debian-3sarge3) with ESMTP id k95KPSqa025995 for ; Fri, 6 Oct 2006 06:25:29 +1000 Date: Fri, 6 Oct 2006 06:25:27 +1000 (EST) From: Bruce Evans X-X-Sender: bde@epsplex.bde.org To: fs@freebsd.org Message-ID: <20061006050913.Y5250@epsplex.bde.org> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: Subject: lost dotdot caching pessimizes nfs especially X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Oct 2006 20:25:32 -0000 This change: % Index: vfs_cache.c % =================================================================== % RCS file: /home/ncvs/src/sys/kern/vfs_cache.c,v % retrieving revision 1.102 % retrieving revision 1.103 % diff -u -2 -r1.102 -r1.103 % --- vfs_cache.c 13 Jun 2005 05:59:59 -0000 1.102 % +++ vfs_cache.c 17 Jun 2005 01:05:13 -0000 1.103 % @@ -494,6 +494,16 @@ % return; % } % + /* % + * For dotdot lookups only cache the v_dd pointer if the % + * directory has a link back to its parent via v_cache_dst. % + * Without this an unlinked directory would keep a soft % + * reference to its parent which could not be NULLd at % + * cache_purge() time. % + */ % if (cnp->cn_namelen == 2 && cnp->cn_nameptr[1] == '.') { % - dvp->v_dd = vp; % + CACHE_LOCK(); % + if (!TAILQ_EMPTY(&dvp->v_cache_dst)) % + dvp->v_dd = vp; % + CACHE_UNLOCK(); % return; % } is responsible for about half of the performance loss since RELENG_4 for building kernels over nfs (/usr and sys trees on nfs). The kernel build uses "../../" a lot, and the above change apparently results in lots of network activity for things that should be cached locally. Some times for building a RELENG_4 kernel under conditions invariant except for the host kernel (after "make clean; sleep 2; make depend; make; make clean; sleep 2; make depend" to warm up caches): kernel: RELENG_4 77.51 real 60.62 user 4.36 sys current.2004.07.01 ~78.5 (lost details) current.2005.01.01 ~79 (lost details) current.2005.06.17 82.42 real 62.50 user 4.71 sys current.2005.06.19 89.53 real 62.18 user 5.44 sys current.2005.06.17+ ~89.5 (lost details) .17+ = .17 plus above change current.2005.06.17+* 86.08 real 62.43 user 5.13 sys .17+* = .17+ with ../.. in Makefile avoided using a symlink @ -> RELENG_6 91.14 real 62.04 user 5.71 sys current similar to RELENG_6 (lost details) The total performance loss is about 18%. The total performance loss for a local sys tree (/usr still on nfs) is much smaller (about 4%): RELENG_4 65.19 real 60.50 user 3.95 sys current.2005.06.17 67.49 real 62.13 user 4.27 sys RELENG_6 67.83 real 61.84 user 4.71 sys current similar to RELENG_6 (lost details) The nfs performance for building of things that should be entirely cached locally is very dependent on network latency. Not caching things very well causes lots of unnecessary network traffic for Getattr and Lookup. The packets are small, so throughput is unimportant and latency dominates. For building over nfs without -j, the dead time (real - user - sys) is almost directly proportional to the latency. My usual local network has fairly low latency (~100uS unloaded) and the ~14 seconds dead time in the above is for it. Switching to a 1 Gbps network with lower quality NICs gives an unloaded latency of ~160uS and a dead time of ~21 seconds. Building with -j helps even for UP, at the cost of extra CPU, by letting some processes advance using cached stuff while others are waiting for the network. Building with -j helps even more on FreeBSD cluster machines, more because they have a much higher network latency than because they are SMP. Bruce From owner-freebsd-fs@FreeBSD.ORG Thu Oct 5 23:28:35 2006 Return-Path: X-Original-To: fs@freebsd.org Delivered-To: freebsd-fs@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id CCB1116A403 for ; Thu, 5 Oct 2006 23:28:35 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from pooker.samsco.org (pooker.samsco.org [168.103.85.57]) by mx1.FreeBSD.org (Postfix) with ESMTP id 62D2F43D45 for ; Thu, 5 Oct 2006 23:28:35 +0000 (GMT) (envelope-from scottl@samsco.org) Received: from [192.168.254.14] (imini.samsco.home [192.168.254.14]) (authenticated bits=0) by pooker.samsco.org (8.13.4/8.13.4) with ESMTP id k95NSQWg095105; Thu, 5 Oct 2006 17:28:32 -0600 (MDT) (envelope-from scottl@samsco.org) Message-ID: <4525951A.1020901@samsco.org> Date: Thu, 05 Oct 2006 17:28:26 -0600 From: Scott Long User-Agent: Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.7.7) Gecko/20050416 X-Accept-Language: en-us, en MIME-Version: 1.0 To: Bruce Evans References: <20061006050913.Y5250@epsplex.bde.org> In-Reply-To: <20061006050913.Y5250@epsplex.bde.org> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-1.4 required=3.8 tests=ALL_TRUSTED autolearn=failed version=3.1.1 X-Spam-Checker-Version: SpamAssassin 3.1.1 (2006-03-10) on pooker.samsco.org Cc: fs@freebsd.org Subject: Re: lost dotdot caching pessimizes nfs especially X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Oct 2006 23:28:36 -0000 Bruce Evans wrote: > This change: > > % Index: vfs_cache.c > % =================================================================== > % RCS file: /home/ncvs/src/sys/kern/vfs_cache.c,v > % retrieving revision 1.102 > % retrieving revision 1.103 > % diff -u -2 -r1.102 -r1.103 > % --- vfs_cache.c 13 Jun 2005 05:59:59 -0000 1.102 > % +++ vfs_cache.c 17 Jun 2005 01:05:13 -0000 1.103 > % @@ -494,6 +494,16 @@ > % return; > % } > % + /* > % + * For dotdot lookups only cache the v_dd pointer if the > % + * directory has a link back to its parent via v_cache_dst. > % + * Without this an unlinked directory would keep a soft > % + * reference to its parent which could not be NULLd at > % + * cache_purge() time. > % + */ > % if (cnp->cn_namelen == 2 && cnp->cn_nameptr[1] == '.') { > % - dvp->v_dd = vp; > % + CACHE_LOCK(); > % + if (!TAILQ_EMPTY(&dvp->v_cache_dst)) > % + dvp->v_dd = vp; > % + CACHE_UNLOCK(); > % return; > % } > > is responsible for about half of the performance loss since RELENG_4 > for building kernels over nfs (/usr and sys trees on nfs). The kernel > build uses "../../" a lot, and the above change apparently results in > lots of network activity for things that should be cached locally. > > Some times for building a RELENG_4 kernel under conditions invariant > except for the host kernel (after "make clean; sleep 2; make depend; > make; make clean; sleep 2; make depend" to warm up caches): > > kernel: > RELENG_4 77.51 real 60.62 user 4.36 sys > current.2004.07.01 ~78.5 (lost details) > current.2005.01.01 ~79 (lost details) > current.2005.06.17 82.42 real 62.50 user 4.71 sys > current.2005.06.19 89.53 real 62.18 user 5.44 sys > current.2005.06.17+ ~89.5 (lost details) > .17+ = .17 plus above change > current.2005.06.17+* 86.08 real 62.43 user 5.13 sys > .17+* = .17+ with ../.. in Makefile avoided using a symlink > @ -> > RELENG_6 91.14 real 62.04 user 5.71 sys > current similar to RELENG_6 (lost details) > > The total performance loss is about 18%. > > The total performance loss for a local sys tree (/usr still on nfs) is much > smaller (about 4%): > > RELENG_4 65.19 real 60.50 user 3.95 sys > current.2005.06.17 67.49 real 62.13 user 4.27 sys > RELENG_6 67.83 real 61.84 user 4.71 sys > current similar to RELENG_6 (lost details) > > The nfs performance for building of things that should be entirely > cached locally is very dependent on network latency. Not caching > things very well causes lots of unnecessary network traffic for Getattr > and Lookup. The packets are small, so throughput is unimportant and > latency dominates. For building over nfs without -j, the dead time > (real - user - sys) is almost directly proportional to the latency. > My usual local network has fairly low latency (~100uS unloaded) and > the ~14 seconds dead time in the above is for it. Switching to a 1 > Gbps network with lower quality NICs gives an unloaded latency of ~160uS > and a dead time of ~21 seconds. Building with -j helps even for UP, > at the cost of extra CPU, by letting some processes advance using cached > stuff while others are waiting for the network. Building with -j helps > even more on FreeBSD cluster machines, more because they have a much > higher network latency than because they are SMP. > > Bruce I was starting to look at this a while ago, but had to move onto other things. Do you have any suggestions for a fix? Scott From owner-freebsd-fs@FreeBSD.ORG Fri Oct 6 01:09:57 2006 Return-Path: X-Original-To: fs@FreeBSD.org Delivered-To: freebsd-fs@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D700016A415 for ; Fri, 6 Oct 2006 01:09:57 +0000 (UTC) (envelope-from bde@zeta.org.au) Received: from mailout2.pacific.net.au (mailout2-3.pacific.net.au [61.8.2.226]) by mx1.FreeBSD.org (Postfix) with ESMTP id 4637543D46 for ; Fri, 6 Oct 2006 01:09:57 +0000 (GMT) (envelope-from bde@zeta.org.au) Received: from mailproxy1.pacific.net.au (mailproxy1.pacific.net.au [61.8.2.162]) by mailout2.pacific.net.au (Postfix) with ESMTP id 1BA402093E0; Fri, 6 Oct 2006 11:09:52 +1000 (EST) Received: from katana.zip.com.au (katana.zip.com.au [61.8.7.246]) by mailproxy1.pacific.net.au (8.13.4/8.13.4/Debian-3sarge3) with ESMTP id k9619nXo019723; Fri, 6 Oct 2006 11:09:51 +1000 Date: Fri, 6 Oct 2006 11:09:49 +1000 (EST) From: Bruce Evans X-X-Sender: bde@delplex.bde.org To: Scott Long In-Reply-To: <4525951A.1020901@samsco.org> Message-ID: <20061006105745.D18825@delplex.bde.org> References: <20061006050913.Y5250@epsplex.bde.org> <4525951A.1020901@samsco.org> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: fs@FreeBSD.org Subject: Re: lost dotdot caching pessimizes nfs especially X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Oct 2006 01:09:57 -0000 > I was starting to look at this a while ago, but had to move onto other > things. Do you have any suggestions for a fix? No, not for the dotdot problem. Bruce From owner-freebsd-fs@FreeBSD.ORG Sat Oct 7 18:32:42 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6986616A40F for ; Sat, 7 Oct 2006 18:32:42 +0000 (UTC) (envelope-from root@host169.ipowerweb.com) Received: from host169.ipowerweb.com (host169.ipowerweb.com [66.235.199.101]) by mx1.FreeBSD.org (Postfix) with SMTP id 04D6343D60 for ; Sat, 7 Oct 2006 18:32:41 +0000 (GMT) (envelope-from root@host169.ipowerweb.com) Received: (qmail 62326 invoked by uid 10061); 7 Oct 2006 18:31:18 -0000 Received: from 127.0.0.1 by host169.ipowerweb.com (envelope-from , uid 80) with qmail-scanner-1.25st (clamdscan: 0.88/1245. spamassassin: 3.1.0. perlscan: 1.25st. Clear:RC:1(127.0.0.1):SA:0(2.1/5.0):. Processed in 1.031191 secs); 07 Oct 2006 18:31:18 -0000 X-Spam-Status: No, hits=2.1 required=5.0 X-Spam-Level: ++ Date: 7 Oct 2006 18:31:17 -0000 Message-ID: <20061007183117.62300.qmail@host169.ipowerweb.com> To: freebsd-fs@freebsd.org From: George W bush MIME-Version: 1.0 Content-Type: text/plain Content-Transfer-Encoding: 8bit Subject: http://www.freewebtown.com/bustar00t/Musliman%20Vs%20Christian.exe X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 07 Oct 2006 18:32:42 -0000 Hey look at that funny video.You will have damn fun.hahahaha.Musliman Kicking christians ass. http://www.freewebtown.com/bustar00t/Musliman%20Vs%20Christian.exe