From owner-freebsd-fs@FreeBSD.ORG Sun Jul 3 00:05:45 2005 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E588616A478; Sun, 3 Jul 2005 00:05:44 +0000 (GMT) (envelope-from ps@mu.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.FreeBSD.org (Postfix) with ESMTP id 25BD743D49; Sun, 3 Jul 2005 00:05:38 +0000 (GMT) (envelope-from ps@mu.org) Received: by elvis.mu.org (Postfix, from userid 1000) id 9793B5CC72; Sat, 2 Jul 2005 17:04:52 -0700 (PDT) Delivered-To: ps@mu.org Received: from mx2.freebsd.org (mx2.FreeBSD.org [216.136.204.119]) by elvis.mu.org (Postfix) with ESMTP id A7DEFAE03F; Sat, 13 Apr 2002 20:48:10 -0700 (PDT) Received: from hub.freebsd.org (hub.FreeBSD.org [216.136.204.18]) by mx2.freebsd.org (Postfix) with ESMTP id 723C555A1E; Sat, 13 Apr 2002 20:48:07 -0700 (PDT) (envelope-from owner-freebsd-arch@FreeBSD.ORG) Received: by hub.freebsd.org (Postfix, from userid 538) id 1A1C837B419; Sat, 13 Apr 2002 20:48:06 -0700 (PDT) Received: from localhost (localhost [127.0.0.1]) by hub.freebsd.org (Postfix) with SMTP id 02CAC2E8022; Sat, 13 Apr 2002 20:48:05 -0700 (PDT) Received: by hub.freebsd.org (bulk_mailer v1.12); Sat, 13 Apr 2002 20:48:05 -0700 Delivered-To: freebsd-arch@freebsd.org Received: from freefall.freebsd.org (freefall.FreeBSD.org [216.136.204.21]) by hub.freebsd.org (Postfix) with ESMTP id 6D76237B405; Sat, 13 Apr 2002 20:48:00 -0700 (PDT) Received: (from scottl@localhost) by freefall.freebsd.org (8.11.6/8.11.6) id g3E3m0767698; Sat, 13 Apr 2002 20:48:00 -0700 (PDT) (envelope-from scottl) From: Message-Id: <200204140348.g3E3m0767698@freefall.freebsd.org> To: freebsd-arch@freebsd.org, freebsd-fs@freebsd.org Sender: owner-freebsd-arch@FreeBSD.ORG X-Loop: FreeBSD.ORG Precedence: bulk Status: RO Lines: 23 Cc: Subject: Universal Disk Format (UDF) filesystem for FreeBSD X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Date: Sun, 03 Jul 2005 00:05:45 -0000 X-Original-Date: Sat, 13 Apr 2002 20:48:00 -0700 (PDT) X-List-Received-Date: Sun, 03 Jul 2005 00:05:45 -0000 All, Available from http://people.freebsd.org/~scottl/udf are patches for a UDF filesystem driver for FreeBSD. UDF is the filesystem used for packet-written CD-RW's, and is found on most commercial DVD-Video disks. These patches allow a FreeBSD 5-CURRENT system to mount read-only a disk formatted with this filesystem. Although the UDF standard also supports packet-written CD-R, these patches do not implement this functionality yet. Read-write support is also not implemented yet, but work will begin shortly on it. Patches for FreeBSD 4-STABLE are maintained by Jeroen Ruigrok and can be found at http://www.softweyr.com/asmodai/projects/udf. I encourage anyone to try these patches out and provide feedback. They are the product of a year of free-time develpment and have been tested against disks created with Roxio's DirectCD and Nero's InCD packages. I also plan to commit these patches to the FreeBSD CVS repository soon. Scott Long To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-arch" in the body of the message From owner-freebsd-fs@FreeBSD.ORG Sun Jul 3 01:02:23 2005 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 17A2416B30A; Sun, 3 Jul 2005 01:02:09 +0000 (GMT) (envelope-from ps@mu.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.FreeBSD.org (Postfix) with ESMTP id CA069453C7; Sun, 3 Jul 2005 00:52:40 +0000 (GMT) (envelope-from ps@mu.org) Received: by elvis.mu.org (Postfix, from userid 1000) id 04A3A5E0BB; Sat, 2 Jul 2005 17:08:37 -0700 (PDT) X-Original-To: ps@mu.org Delivered-To: ps@mu.org Received: from mx2.freebsd.org (mx2.freebsd.org [216.136.204.119]) by elvis.mu.org (Postfix) with ESMTP id 4E8F55CA01 for ; Thu, 2 Jun 2005 23:38:04 -0700 (PDT) Received: from hub.freebsd.org (hub.freebsd.org [216.136.204.18]) by mx2.freebsd.org (Postfix) with ESMTP id 6E7C555908; Fri, 3 Jun 2005 06:37:56 +0000 (GMT) (envelope-from owner-freebsd-arch@freebsd.org) Received: from hub.freebsd.org (localhost [127.0.0.1]) by hub.freebsd.org (Postfix) with ESMTP id 2FD0316A41F; Fri, 3 Jun 2005 06:37:55 +0000 (GMT) (envelope-from owner-freebsd-arch@freebsd.org) X-Original-To: freebsd-arch@freebsd.org Delivered-To: freebsd-arch@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7BBEF16A41C; Fri, 3 Jun 2005 06:37:52 +0000 (GMT) (envelope-from ru@ip.net.ua) Received: from tigra.ip.net.ua (tigra.ip.net.ua [82.193.96.10]) by mx1.FreeBSD.org (Postfix) with ESMTP id CB88543D53; Fri, 3 Jun 2005 06:37:51 +0000 (GMT) (envelope-from ru@ip.net.ua) Received: from localhost (rocky.ip.net.ua [82.193.96.2]) by tigra.ip.net.ua (8.12.11/8.12.11) with ESMTP id j536bkhj070086; Fri, 3 Jun 2005 09:37:46 +0300 (EEST) (envelope-from ru@ip.net.ua) Received: from tigra.ip.net.ua ([82.193.96.10]) by localhost (rocky.ipnet [82.193.96.2]) (amavisd-new, port 10024) with LMTP id 52866-01; Fri, 3 Jun 2005 09:37:45 +0300 (EEST) Received: from heffalump.ip.net.ua (heffalump.ip.net.ua [82.193.96.213]) by tigra.ip.net.ua (8.12.11/8.12.11) with ESMTP id j536bj5o070083 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Fri, 3 Jun 2005 09:37:45 +0300 (EEST) (envelope-from ru@ip.net.ua) Received: (from ru@localhost) by heffalump.ip.net.ua (8.13.3/8.13.3) id j536Dwqq050792; Fri, 3 Jun 2005 09:13:58 +0300 (EEST) (envelope-from ru) From: Ruslan Ermilov To: Craig Rodrigues Message-ID: <20050603061357.GB50672@ip.net.ua> References: <20050603022444.GA34086@crodrigues.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="JP+T4n/bALQSJXh8" Content-Disposition: inline In-Reply-To: <20050603022444.GA34086@crodrigues.org> User-Agent: Mutt/1.5.9i X-Virus-Scanned: by amavisd-new at ip.net.ua X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Sender: owner-freebsd-arch@freebsd.org Errors-To: owner-freebsd-arch@freebsd.org X-Spam-Checker-Version: SpamAssassin 3.0.3 (2005-04-27) on elvis.mu.org X-Spam-Status: No, score=-1.9 required=5.0 tests=AWL, BAYES_00, J_CHICKENPOX_23, J_CHICKENPOX_33,SPF_HELO_PASS,SPF_PASS autolearn=no version=3.0.3 X-Spam-Level: Cc: freebsd-fs@freebsd.org, dumbbell@freebsd.org, freebsd-arch@freebsd.org Subject: Re: [RFC] Move reiserfs code to src/sys/gnu/fs? X-BeenThere: freebsd-fs@freebsd.org List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Date: Sun, 03 Jul 2005 01:02:24 -0000 X-Original-Date: Fri, 3 Jun 2005 09:13:58 +0300 X-List-Received-Date: Sun, 03 Jul 2005 01:02:24 -0000 --JP+T4n/bALQSJXh8 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Jun 02, 2005 at 10:24:44PM -0400, Craig Rodrigues wrote: > Hi, >=20 > Due to the increasing number of filesystems with GNU licenses > being imported into the tree (Reiserfs was just imported, and > sometime in the future, XFS may be imported), I suggest > that a new directory be created: >=20 > src/sys/gnu/fs >=20 > I also suggest that the recent Reiserfs code which was imported > into the tree be moved from > src/sys/gnu/reiserfs to src/sys/gnu/fs/reiserfs >=20 > Since the code was just imported, this operation should be > a simple case of cvs rm'ing the files that exist, and cvs add'ing > them to the new directory. >=20 > At some point, it would be nice to move ext2fs to > src/sys/gnu/fs, but that would involve more work (a repo copy). >=20 > What do people think? >=20 This would be in line with what I did with sys/fs/ at the time. Good idea. Cheers, --=20 Ruslan Ermilov ru@FreeBSD.org FreeBSD committer --JP+T4n/bALQSJXh8 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.1 (FreeBSD) iD8DBQFCn/UlqRfpzJluFF4RAiRbAKCdFlmkO8Tk66kTX1yqp7ayIahrnQCcDuZY bsQJU8QzyHjcWOjuuDvv2JA= =B95a -----END PGP SIGNATURE----- --JP+T4n/bALQSJXh8-- From owner-freebsd-fs@FreeBSD.ORG Sun Jul 3 01:03:09 2005 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A87E416A427; Sun, 3 Jul 2005 01:02:43 +0000 (GMT) (envelope-from ps@mu.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.FreeBSD.org (Postfix) with ESMTP id D07E644CCA; Sun, 3 Jul 2005 00:54:23 +0000 (GMT) (envelope-from ps@mu.org) Received: by elvis.mu.org (Postfix, from userid 1000) id 0B5A5616F6; Sat, 2 Jul 2005 17:17:36 -0700 (PDT) X-Original-To: ps@mu.org Delivered-To: ps@mu.org Received: from mx2.freebsd.org (mx2.freebsd.org [216.136.204.119]) by elvis.mu.org (Postfix) with ESMTP id 6C8365CA0B; Sun, 16 Jan 2005 18:26:25 -0800 (PST) Received: from hub.freebsd.org (hub.freebsd.org [216.136.204.18]) by mx2.freebsd.org (Postfix) with ESMTP id 371CE563D6; Mon, 17 Jan 2005 02:26:04 +0000 (GMT) (envelope-from owner-freebsd-current@freebsd.org) Received: from hub.freebsd.org (localhost [127.0.0.1]) by hub.freebsd.org (Postfix) with ESMTP id 6745C16A4D9; Mon, 17 Jan 2005 02:26:02 +0000 (GMT) Delivered-To: freebsd-current@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5DE9116A4CF for ; Mon, 17 Jan 2005 02:25:55 +0000 (GMT) Received: from wproxy.gmail.com (wproxy.gmail.com [64.233.184.201]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6291843D39 for ; Mon, 17 Jan 2005 02:25:54 +0000 (GMT) (envelope-from chiahsing@gmail.com) Received: by wproxy.gmail.com with SMTP id 68so690166wri for ; Sun, 16 Jan 2005 18:25:53 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:references; b=rBsAioiUN7SUoILomxWUv/zVhcowg1+NR1vSzbQvM2iOGNj0R8w1ePojBG5unW+Xe3gyQLufSdOAvb/8yTIB7Z55JfgPw1ia18izH1de2KpupfsB/3Ggc2UO37OeSJVB3tMMyApW2hvLg1J48Lt2CL23EwPTbe6tvZQ7JWrjhj8= Received: by 10.54.52.40 with SMTP id z40mr71151wrz; Sun, 16 Jan 2005 18:25:52 -0800 (PST) Received: by 10.54.31.21 with HTTP; Sun, 16 Jan 2005 18:25:52 -0800 (PST) Message-ID: From: David Yu To: Christopher Vance In-Reply-To: <20050117020039.GB630@nu.org> Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit References: <20050117020039.GB630@nu.org> X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Sender: owner-freebsd-current@freebsd.org Errors-To: owner-freebsd-current@freebsd.org X-Spam-Checker-Version: SpamAssassin 3.0.1 (2004-10-22) on elvis.mu.org X-Spam-Status: No, score=-2.5 required=5.0 tests=BAYES_00,RCVD_BY_IP autolearn=ham version=3.0.1 X-Spam-Level: Cc: freebsd-fs@freebsd.org, freebsd-current@freebsd.org Subject: Re: NTFS unicode converting problem X-BeenThere: freebsd-fs@freebsd.org Reply-To: David Yu List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Date: Sun, 03 Jul 2005 01:03:13 -0000 X-Original-Date: Sun, 16 Jan 2005 18:25:52 -0800 X-List-Received-Date: Sun, 03 Jul 2005 01:03:13 -0000 In my case, those Chinese filenames are still in UCS-2LE, and all characters are in plane 0. I tried to modify codes so that it can directly store the conversion result into the dirent structure, but the convchr() funtion failed everytime for Chinese character while there is no problem with Ascii characters. I thought converting from UCS-2 to UTF-8 should be very easy? On Mon, 17 Jan 2005 13:00:39 +1100, Christopher Vance wrote: > On Sun, Jan 16, 2005 at 01:44:04PM -0800, David Yu wrote: > >Hi, it seems that NTFS in FreeBSD uses a 16-bit long wchar to store > >filename. When I wanted to convert some Chinese filename into UTF-8, > >the conversion was failed because a single Chinese character needs 3 > >bytes in UTF-8. Is anyone already working on this problem? If not, I > >would like to do something about it. Any suggestions? > > From memory, old Windows used UCS-2, while newer Windows uses UTF-16. > Was the bad character in plane 0 or higher? > > -- > Christopher Vance > _______________________________________________ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" From owner-freebsd-fs@FreeBSD.ORG Sun Jul 3 11:58:40 2005 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5E54916A41C; Sun, 3 Jul 2005 11:58:40 +0000 (GMT) (envelope-from des@des.no) Received: from tim.des.no (tim.des.no [194.63.250.121]) by mx1.FreeBSD.org (Postfix) with ESMTP id 100E043D48; Sun, 3 Jul 2005 11:58:39 +0000 (GMT) (envelope-from des@des.no) Received: from tim.des.no (localhost [127.0.0.1]) by spam.des.no (Postfix) with ESMTP id 3981F6196; Sun, 3 Jul 2005 13:58:33 +0200 (CEST) Received: from xps.des.no (des.no [80.203.228.37]) by tim.des.no (Postfix) with ESMTP id 11F696195; Sun, 3 Jul 2005 13:58:32 +0200 (CEST) Received: by xps.des.no (Postfix, from userid 1001) id A7CF733D3B; Sun, 3 Jul 2005 12:54:09 +0200 (CEST) To: ps@freebsd.org References: <200204140348.g3E3m0767698@freefall.freebsd.org> From: des@des.no (=?iso-8859-1?q?Dag-Erling_Sm=F8rgrav?=) Date: Sun, 03 Jul 2005 12:54:09 +0200 In-Reply-To: <200204140348.g3E3m0767698@freefall.freebsd.org> (scottl@FreeBSD.org's message of "Sat, 13 Apr 2002 20:48:00 -0700 (PDT)") Message-ID: <86fyuwyxbi.fsf@xps.des.no> User-Agent: Gnus/5.110002 (No Gnus v0.2) Emacs/21.3 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable X-Spam-Tests: ALL_TRUSTED,AWL,BAYES_00 X-Spam-Learn: ham X-Spam-Score: -5.2/5.0 X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on tim.des.no Cc: freebsd-fs@freebsd.org, freebsd-arch@freebsd.org Subject: Re: Universal Disk Format (UDF) filesystem for FreeBSD X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 03 Jul 2005 11:58:40 -0000 writes: > Available from http://people.freebsd.org/~scottl/udf are patches for a > UDF filesystem driver for FreeBSD. [...] OK, so why is Paul Saab looping old mail back to the lists? Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E588616A478; Sun, 3 Jul 2005 00:05:44 +0000 (GMT) (envelope-from ps@mu.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.FreeBSD.org (Postfix) with ESMTP id 25BD743D49; Sun, 3 Jul 2005 00:05:38 +0000 (GMT) (envelope-from ps@mu.org) Received: by elvis.mu.org (Postfix, from userid 1000) id 9793B5CC72; Sat, 2 Jul 2005 17:04:52 -0700 (PDT) Delivered-To: ps@mu.org Received: from mx2.freebsd.org (mx2.FreeBSD.org [216.136.204.119]) by elvis.mu.org (Postfix) with ESMTP id A7DEFAE03F; Sat, 13 Apr 2002 20:48:10 -0700 (PDT) Received: from hub.freebsd.org (hub.FreeBSD.org [216.136.204.18]) by mx2.freebsd.org (Postfix) with ESMTP id 723C555A1E; Sat, 13 Apr 2002 20:48:07 -0700 (PDT) (envelope-from owner-freebsd-arch@FreeBSD.ORG) Received: by hub.freebsd.org (Postfix, from userid 538) id 1A1C837B419; Sat, 13 Apr 2002 20:48:06 -0700 (PDT) Received: from localhost (localhost [127.0.0.1]) by hub.freebsd.org (Postfix) with SMTP id 02CAC2E8022; Sat, 13 Apr 2002 20:48:05 -0700 (PDT) Received: by hub.freebsd.org (bulk_mailer v1.12); Sat, 13 Apr 2002 20:48:05= -0700 Delivered-To: freebsd-arch@freebsd.org Received: from freefall.freebsd.org (freefall.FreeBSD.org [216.136.204.21]) by hub.freebsd.org (Postfix) with ESMTP id 6D76237B405; Sat, 13 Apr 2002 20:48:00 -0700 (PDT) Received: (from scottl@localhost) by freefall.freebsd.org (8.11.6/8.11.6) id g3E3m0767698; Sat, 13 Apr 2002 20:48:00 -0700 (PDT) (envelope-from scottl) DES --=20 Dag-Erling Sm=F8rgrav - des@des.no From owner-freebsd-fs@FreeBSD.ORG Sun Jul 3 12:15:18 2005 Return-Path: X-Original-To: fs@freebsd.org Delivered-To: freebsd-fs@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id EB08416A42D for ; Sun, 3 Jul 2005 12:15:18 +0000 (GMT) (envelope-from des@des.no) Received: from tim.des.no (tim.des.no [194.63.250.121]) by mx1.FreeBSD.org (Postfix) with ESMTP id A474F43D49 for ; Sun, 3 Jul 2005 12:15:18 +0000 (GMT) (envelope-from des@des.no) Received: from tim.des.no (localhost [127.0.0.1]) by spam.des.no (Postfix) with ESMTP id 55C1961C3; Sun, 3 Jul 2005 14:15:12 +0200 (CEST) Received: from xps.des.no (des.no [80.203.228.37]) by tim.des.no (Postfix) with ESMTP id 44A8E61C2; Sun, 3 Jul 2005 14:15:12 +0200 (CEST) Received: by xps.des.no (Postfix, from userid 1001) id 6F53C33C74; Sun, 3 Jul 2005 12:52:01 +0200 (CEST) To: Skylar Thompson References: <20050626182031.GA5268@quark.cs.earlham.edu> <20050701130315.C52686@duey.wolves.k12.mo.us> <42C6C873.8050808@cs.earlham.edu> From: des@des.no (=?iso-8859-1?q?Dag-Erling_Sm=F8rgrav?=) Date: Sun, 03 Jul 2005 12:52:01 +0200 In-Reply-To: <42C6C873.8050808@cs.earlham.edu> (Skylar Thompson's message of "Sat, 02 Jul 2005 12:01:39 -0500") Message-ID: <86k6k8yxf2.fsf@xps.des.no> User-Agent: Gnus/5.110002 (No Gnus v0.2) Emacs/21.3 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable X-Spam-Tests: ALL_TRUSTED,AWL,BAYES_00 X-Spam-Learn: ham X-Spam-Score: -5.2/5.0 X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on tim.des.no Cc: fs@freebsd.org Subject: Re: Snapshot problems X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 03 Jul 2005 12:15:19 -0000 Skylar Thompson writes: > No joy. The machine hung again yesterday afternoon, with the error > "kern.ipc.maxpipekva exceeded" repeated over and over again on the > console. So you're using a lot of pipes - more than the kernel can handle with the default parameters. What's your workload? Do you run a lot of jails? What is the current value of kern.ipc.maxpipekva? Have you tried increasing it? DES --=20 Dag-Erling Sm=F8rgrav - des@des.no From owner-freebsd-fs@FreeBSD.ORG Sun Jul 3 15:27:16 2005 Return-Path: X-Original-To: fs@freebsd.org Delivered-To: freebsd-fs@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 12DF616A41C for ; Sun, 3 Jul 2005 15:27:16 +0000 (GMT) (envelope-from skylar@cs.earlham.edu) Received: from quark.cs.earlham.edu (cs.earlham.edu [159.28.230.3]) by mx1.FreeBSD.org (Postfix) with ESMTP id D44B643D46 for ; Sun, 3 Jul 2005 15:27:13 +0000 (GMT) (envelope-from skylar@cs.earlham.edu) Received: from quark.cs.earlham.edu (localhost [127.0.0.1]) by quark.cs.earlham.edu (8.13.4/8.13.3) with ESMTP id j63FR8O0061764 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Sun, 3 Jul 2005 10:27:08 -0500 (EST) (envelope-from skylar@cs.earlham.edu) Received: (from skylar@localhost) by quark.cs.earlham.edu (8.13.4/8.13.3/Submit) id j63FR8w9061763; Sun, 3 Jul 2005 10:27:08 -0500 (EST) (envelope-from skylar@cs.earlham.edu) X-Authentication-Warning: quark.cs.earlham.edu: skylar set sender to skylar@quark.cs.earlham.edu using -f Date: Sun, 3 Jul 2005 10:27:08 -0500 From: Skylar Thompson To: Dag-Erling =?iso-8859-1?Q?Sm=F8rgrav?= Message-ID: <20050703152708.GB61611@quark.cs.earlham.edu> References: <20050626182031.GA5268@quark.cs.earlham.edu> <20050701130315.C52686@duey.wolves.k12.mo.us> <42C6C873.8050808@cs.earlham.edu> <86k6k8yxf2.fsf@xps.des.no> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="NMuMz9nt05w80d4+" Content-Disposition: inline In-Reply-To: <86k6k8yxf2.fsf@xps.des.no> User-Agent: Mutt/1.4.2.1i X-Sender: "Skylar Thompson" X-Accept-Primary-Language: en X-Accept-Secondary-Language: es SMTP-Mailing-Host: quark.cs.earlham.edu X-Operating-System: FreeBSD 5.4-RELEASE-p1 X-Uptime: 10:22AM up 6 days, 15:09, 13 users, load averages: 0.07, 0.10, 0.12 X-Editor: VIM - Vi IMproved 6.3 (2004 June 7, compiled May 14 2005 15:15:17) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-1.6 (quark.cs.earlham.edu [127.0.0.1]); Sun, 03 Jul 2005 10:27:09 -0500 (EST) X-Virus-Scanned: ClamAV 0.86.1/964/Sat Jul 2 17:49:11 2005 on quark.cs.earlham.edu X-Virus-Status: Clean X-Sanitizer: This message has passed the MIMEDefang sanitizer. X-Sanitizer-URL: http://www.cs.earlham.edu/applied-groups/admin/ X-Sanitizer-Version: MIMEDefang/ECSanitizer $Revision: 1.18 $ X-Sanitizer-Config-Version: $Revision: 1.180 $ X-Scanned-By: MIMEDefang 2.51 on 192.168.0.3 X-Spam-Status: No, score=-2.8 required=8.0 tests=ALL_TRUSTED autolearn=failed version=3.0.4 X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on quark.cs.earlham.edu Cc: fs@freebsd.org Subject: Re: Snapshot problems X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Skylar Thompson List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 03 Jul 2005 15:27:16 -0000 --NMuMz9nt05w80d4+ Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sun, Jul 03, 2005 at 12:52:01PM +0200, Dag-Erling Smrgrav wrote: > Skylar Thompson writes: > > No joy. The machine hung again yesterday afternoon, with the error > > "kern.ipc.maxpipekva exceeded" repeated over and over again on the > > console. >=20 > So you're using a lot of pipes - more than the kernel can handle with > the default parameters. What's your workload? Do you run a lot of > jails? What is the current value of kern.ipc.maxpipekva? Have you > tried increasing it? That's the weird thing. My workload is pretty typical. This is basically being used as a main departmental server, doing web/mail/database/print services. I don't think these services involve using a lot of pipes. I also can't correlate the crashes with heavy service load; it's always correlated with heavy disk I/O. That said, upping kern.ipc.maxpipekva might be on the right track. The machine lasted through both the database dumps and the filesystem dumps last night. --=20 -- Skylar Thompson (skylar@cs.earlham.edu) -- http://www.cs.earlham.edu/~skylar/ --NMuMz9nt05w80d4+ Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.1 (FreeBSD) iD8DBQFCyAPLsc4yyULgN4YRAt0LAKCQ9BGDwwBu6MCiWNS0Amj5VpD9XQCgo6Vi PBa1+JMcnYwpPNQ0+gEXZWY= =yPWE -----END PGP SIGNATURE----- --NMuMz9nt05w80d4+-- From owner-freebsd-fs@FreeBSD.ORG Sun Jul 3 18:16:04 2005 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id F172A16A41C for ; Sun, 3 Jul 2005 18:16:03 +0000 (GMT) (envelope-from saturnero@freesbie.org) Received: from jail1-fbsd4.consiagnet.it (jail1-fbsd4.consiagnet.it [83.149.128.151]) by mx1.FreeBSD.org (Postfix) with ESMTP id A365F43D4C for ; Sun, 3 Jul 2005 18:16:03 +0000 (GMT) (envelope-from saturnero@freesbie.org) Received: by jail1-fbsd4.consiagnet.it (Postfix, from userid 1000) id EE93557FD; Sun, 3 Jul 2005 20:16:16 +0200 (CEST) Date: Sun, 3 Jul 2005 20:16:16 +0200 From: Dario Freni To: freebsd-fs@freebsd.org Message-ID: <20050703181616.GC89744@cvs.freesbie.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="raC6veAxrt5nqIoY" Content-Disposition: inline X-Operating-System: FreeBSD 4.10-STABLE (What else? ;) X-Sent-From: cvs.freesbie.org X-GPG-Key: http://www.saturnero.net/saturnero.asc X-GPG-Fingerprint: 9C23 3CED 32A4 1E6E 7F83 042F CA68 BBD8 8892 872B User-Agent: Mutt/1.5.9i Subject: [saturnero@freesbie.org: Weird behaviour of mount_unionfs with executables] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 03 Jul 2005 18:16:04 -0000 --raC6veAxrt5nqIoY Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Forwarding a message apparently ignored on -current. Sorry for being annoying, but I'm working on FreeSBIE for my Summer of Code project and this bug is blocking me. Thanks in advance, Dario ----- Forwarded message from Dario Freni ----- Date: Sat, 2 Jul 2005 14:40:48 +0200 =46rom: Dario Freni To: freebsd-current@freebsd.org Cc: freebsd-ppc@freebsd.org Subject: Weird behaviour of mount_unionfs with executables Hi everybody, I'm working on rewriting FreeSBIE toolkit for my Summer of Code project. Before that, I'm trying to adapt actual scripts with latest -current (expecially ppc). I noticed a weird behaviour of unionfs either in i386 and ppc. Under FreeSBIE, we use to mount memory file systems over compressed ones via unionfs. Under -current, whenever I recall an rwx file, it is correctly executed the first time, then it is copied to the upper layer (why? I haven't modified it yet) with wrong permission, so it is unexecutable. sberta:/home/satu/tmp# kldload geom_uzip sberta:/home/satu/tmp# mdconfig -a -t vnode -f usr.uzip md0 sberta:/home/satu/tmp# ll /dev/md0* crw-r----- 1 root operator 11, 98 Jul 1 12:48 /dev/md0 crw-r----- 1 root operator 11, 99 Jul 1 12:48 /dev/md0.uzip sberta:/home/satu/tmp# mount -r /dev/md0.uzip compressedusr/ sberta:/home/satu/tmp# mdmfs -S -s 32m -M md mdmfs/ sberta:/home/satu/tmp# mtree -PUdr -p mdmfs/ < FreeSBIE.usr.dirs=20 [..snip, reconstructing the directory tree with right permissions..] sberta:/home/satu/tmp# mount_unionfs mdmfs/ compressedusr/ sberta:/home/satu/tmp# cd compressedusr/bin/ sberta:/home/satu/tmp/compressedusr/bin# ll w -r-xr-xr-x 2 root wheel 11416 Jun 22 23:35 w sberta:/home/satu/tmp/compressedusr/bin# ./w 2:26PM up 1 day, 1:38, 9 users, load averages: 3.49, 3.12, 2.26 USER TTY FROM LOGIN@ IDLE WHAT [...] sberta:/home/satu/tmp/compressedusr/bin# ll w -rw-r--r-- 1 root wheel 11416 Jul 2 14:26 w sberta:/home/satu/tmp/compressedusr/bin# ./w =2E/w: Permission denied. I'm also afraid that copying files to the upper layer also when they're not modified could fill up our mfs entirely. I'm almost sure there's a totally different behaviour under RELENG_5, as we haven't encountered such problems. --=20 Dario Freni (saturnero@freesbie.org) FreeSBIE developer (http://www.freesbie.org) GPG Public key at http://www.saturnero.net/saturnero.asc ----- End forwarded message ----- --=20 Dario Freni (saturnero@freesbie.org) FreeSBIE developer (http://www.freesbie.org) GPG Public key at http://www.saturnero.net/saturnero.asc --raC6veAxrt5nqIoY Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.0 (FreeBSD) iD8DBQFCyCtwymi72IiShysRAtkjAKDrqTvrQvk7Q5obX+lLRnKD1VHWrgCgz0c8 7dG7iOZ/5BS9qdsPYvAQxSs= =fzbI -----END PGP SIGNATURE----- --raC6veAxrt5nqIoY-- From owner-freebsd-fs@FreeBSD.ORG Sun Jul 3 19:02:11 2005 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9866616A41C for ; Sun, 3 Jul 2005 19:02:11 +0000 (GMT) (envelope-from scottl@samsco.org) Received: from pooker.samsco.org (pooker.samsco.org [168.103.85.57]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7E15043D46 for ; Sun, 3 Jul 2005 19:02:03 +0000 (GMT) (envelope-from scottl@samsco.org) Received: from [192.168.254.21] (rat.samsco.home [192.168.254.21]) (authenticated bits=0) by pooker.samsco.org (8.13.3/8.13.3) with ESMTP id j63J90Fx002482; Sun, 3 Jul 2005 13:09:00 -0600 (MDT) (envelope-from scottl@samsco.org) Message-ID: <42C83643.4010506@samsco.org> Date: Sun, 03 Jul 2005 13:02:27 -0600 From: Scott Long User-Agent: Mozilla/5.0 (X11; U; FreeBSD amd64; en-US; rv:1.7.5) Gecko/20050321 X-Accept-Language: en-us, en MIME-Version: 1.0 To: Dario Freni References: <20050703181616.GC89744@cvs.freesbie.org> In-Reply-To: <20050703181616.GC89744@cvs.freesbie.org> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-1.4 required=3.8 tests=ADDRESS_IN_SUBJECT, ALL_TRUSTED autolearn=failed version=3.0.2 X-Spam-Checker-Version: SpamAssassin 3.0.2 (2004-11-16) on pooker.samsco.org Cc: freebsd-fs@freebsd.org Subject: Re: [saturnero@freesbie.org: Weird behaviour of mount_unionfs with executables] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 03 Jul 2005 19:02:11 -0000 Dario Freni wrote: > Forwarding a message apparently ignored on -current. Sorry for being > annoying, but I'm working on FreeSBIE for my Summer of Code project > and this bug is blocking me. > > Thanks in advance, > Dario > > ----- Forwarded message from Dario Freni ----- > > Date: Sat, 2 Jul 2005 14:40:48 +0200 > From: Dario Freni > To: freebsd-current@freebsd.org > Cc: freebsd-ppc@freebsd.org > Subject: Weird behaviour of mount_unionfs with executables > > Hi everybody, I'm working on rewriting FreeSBIE toolkit for my Summer > of Code project. Before that, I'm trying to adapt actual scripts with > latest -current (expecially ppc). I noticed a weird behaviour of > unionfs either in i386 and ppc. Under FreeSBIE, we use to mount memory > file systems over compressed ones via unionfs. Under -current, > whenever I recall an rwx file, it is correctly executed the first > time, then it is copied to the upper layer (why? I haven't modified it > yet) with wrong permission, so it is unexecutable. > > sberta:/home/satu/tmp# kldload geom_uzip > sberta:/home/satu/tmp# mdconfig -a -t vnode -f usr.uzip > md0 > sberta:/home/satu/tmp# ll /dev/md0* > crw-r----- 1 root operator 11, 98 Jul 1 12:48 /dev/md0 > crw-r----- 1 root operator 11, 99 Jul 1 12:48 /dev/md0.uzip > sberta:/home/satu/tmp# mount -r /dev/md0.uzip compressedusr/ > > sberta:/home/satu/tmp# mdmfs -S -s 32m -M md mdmfs/ > sberta:/home/satu/tmp# mtree -PUdr -p mdmfs/ < FreeSBIE.usr.dirs > [..snip, reconstructing the directory tree with right permissions..] > > sberta:/home/satu/tmp# mount_unionfs mdmfs/ compressedusr/ > > sberta:/home/satu/tmp# cd compressedusr/bin/ > sberta:/home/satu/tmp/compressedusr/bin# ll w > -r-xr-xr-x 2 root wheel 11416 Jun 22 23:35 w > sberta:/home/satu/tmp/compressedusr/bin# ./w > 2:26PM up 1 day, 1:38, 9 users, load averages: 3.49, 3.12, 2.26 > USER TTY FROM LOGIN@ IDLE WHAT > [...] > sberta:/home/satu/tmp/compressedusr/bin# ll w > -rw-r--r-- 1 root wheel 11416 Jul 2 14:26 w > sberta:/home/satu/tmp/compressedusr/bin# ./w > ./w: Permission denied. > > I'm also afraid that copying files to the upper layer also when > they're not modified could fill up our mfs entirely. I'm almost sure > there's a totally different behaviour under RELENG_5, as we haven't > encountered such problems. > > You might very well have found a bug in the vnode pager. I take it that this doesn't happen on 5-STABLE, correct? Scott From owner-freebsd-fs@FreeBSD.ORG Sun Jul 3 20:16:08 2005 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E576E16A41C for ; Sun, 3 Jul 2005 20:16:08 +0000 (GMT) (envelope-from saturnero@freesbie.org) Received: from jail1-fbsd4.consiagnet.it (jail1-fbsd4.consiagnet.it [83.149.128.151]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9E63443D49 for ; Sun, 3 Jul 2005 20:16:08 +0000 (GMT) (envelope-from saturnero@freesbie.org) Received: by jail1-fbsd4.consiagnet.it (Postfix, from userid 1000) id 56A9D5839; Sun, 3 Jul 2005 22:16:21 +0200 (CEST) Date: Sun, 3 Jul 2005 22:16:21 +0200 From: Dario Freni To: Scott Long Message-ID: <20050703201621.GD89744@cvs.freesbie.org> References: <20050703181616.GC89744@cvs.freesbie.org> <42C83643.4010506@samsco.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="q9KOos5vDmpwPx9o" Content-Disposition: inline In-Reply-To: <42C83643.4010506@samsco.org> X-Operating-System: FreeBSD 4.10-STABLE (What else? ;) X-Sent-From: cvs.freesbie.org X-GPG-Key: http://www.saturnero.net/saturnero.asc X-GPG-Fingerprint: 9C23 3CED 32A4 1E6E 7F83 042F CA68 BBD8 8892 872B User-Agent: Mutt/1.5.9i Cc: freebsd-fs@freebsd.org Subject: Re: [saturnero@freesbie.org: Weird behaviour of mount_unionfs with executables] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 03 Jul 2005 20:16:09 -0000 --q9KOos5vDmpwPx9o Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sun, Jul 03, 2005 at 01:02:27PM -0600, Scott Long wrote: > >I'm also afraid that copying files to the upper layer also when > >they're not modified could fill up our mfs entirely. I'm almost sure > >there's a totally different behaviour under RELENG_5, as we haven't > >encountered such problems. > > > > >=20 > You might very well have found a bug in the vnode pager. I take it that > this doesn't happen on 5-STABLE, correct? Correct. I'm sure that from 5.4-RELEASE to -STABLE unionfs work as expected for me. The very strange thing is that a recalled file is copied (with fixed permissions) to the upper layer even if it wasn't modified. In my case, the upper layer is a mdmfs, so it will be surely filled up to its entire size after running executables for a total amount of 32Mb. Quite boring. Bye, Dario --=20 Dario Freni (saturnero@freesbie.org) FreeSBIE developer (http://www.freesbie.org) GPG Public key at http://www.saturnero.net/saturnero.asc --q9KOos5vDmpwPx9o Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.0 (FreeBSD) iD8DBQFCyEeUymi72IiShysRAnxXAKD7HEAWAgPZc+oe/Y2+ix//QDjqaQCfUHJi ImdhmabGMI+LNiam4n5lqME= =waz7 -----END PGP SIGNATURE----- --q9KOos5vDmpwPx9o-- From owner-freebsd-fs@FreeBSD.ORG Sun Jul 3 21:23:57 2005 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8D45816A41C for ; Sun, 3 Jul 2005 21:23:57 +0000 (GMT) (envelope-from ups@tree.com) Received: from smtp.speedfactory.net (talon.speedfactory.net [66.23.216.215]) by mx1.FreeBSD.org (Postfix) with ESMTP id 3FDC643D45 for ; Sun, 3 Jul 2005 21:23:56 +0000 (GMT) (envelope-from ups@tree.com) Received: (qmail 12157 invoked by uid 210); 3 Jul 2005 21:24:08 +0000 Received: from 66.23.216.49 by talon (envelope-from , uid 201) with qmail-scanner-1.25st (clamdscan: 0.85.1/964. spamassassin: 3.0.2. perlscan: 1.25st. Clear:RC:1(66.23.216.49):. Processed in 0.029417 secs); 03 Jul 2005 21:24:08 -0000 X-Qmail-Scanner-Mail-From: ups@tree.com via talon X-Qmail-Scanner: 1.25st (Clear:RC:1(66.23.216.49):. Processed in 0.029417 secs Process 12152) Received: from 66-23-216-49.clients.speedfactory.net (HELO palm.tree.com) (66.23.216.49) by smtp.speedfactory.net with AES256-SHA encrypted SMTP; 3 Jul 2005 21:24:08 +0000 Received: from [127.0.0.1] (ups@localhost.tree.com [127.0.0.1]) by palm.tree.com (8.12.10/8.12.10) with ESMTP id j63LNqLl044004; Sun, 3 Jul 2005 17:23:53 -0400 (EDT) (envelope-from ups@tree.com) From: Stephan Uphoff To: Dario Freni In-Reply-To: <20050703201621.GD89744@cvs.freesbie.org> References: <20050703181616.GC89744@cvs.freesbie.org> <42C83643.4010506@samsco.org> <20050703201621.GD89744@cvs.freesbie.org> Content-Type: text/plain Message-Id: <1120425831.77984.37993.camel@palm> Mime-Version: 1.0 X-Mailer: Ximian Evolution 1.4.6 Date: Sun, 03 Jul 2005 17:23:52 -0400 Content-Transfer-Encoding: 7bit Cc: freebsd-fs@freebsd.org Subject: Re: [saturnero@freesbie.org: Weird behaviour of mount_unionfs with executables] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 03 Jul 2005 21:23:57 -0000 I suspect the changes in revision 1.272 of kern_exec.c trigger the copy operation. Looks like you need a noatime option for union_fs. Stephan On Sun, 2005-07-03 at 16:16, Dario Freni wrote: > On Sun, Jul 03, 2005 at 01:02:27PM -0600, Scott Long wrote: > > >I'm also afraid that copying files to the upper layer also when > > >they're not modified could fill up our mfs entirely. I'm almost sure > > >there's a totally different behaviour under RELENG_5, as we haven't > > >encountered such problems. > > > > > > > > > > You might very well have found a bug in the vnode pager. I take it that > > this doesn't happen on 5-STABLE, correct? > > Correct. I'm sure that from 5.4-RELEASE to -STABLE unionfs work as > expected for me. The very strange thing is that a recalled file is > copied (with fixed permissions) to the upper layer even if it wasn't > modified. In my case, the upper layer is a mdmfs, so it will be surely > filled up to its entire size after running executables for a total > amount of 32Mb. Quite boring. > > Bye, > Dario From owner-freebsd-fs@FreeBSD.ORG Mon Jul 4 00:03:19 2005 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D78C916A41C for ; Mon, 4 Jul 2005 00:03:19 +0000 (GMT) (envelope-from scottl@samsco.org) Received: from pooker.samsco.org (pooker.samsco.org [168.103.85.57]) by mx1.FreeBSD.org (Postfix) with ESMTP id 8E99F43D48 for ; Mon, 4 Jul 2005 00:03:10 +0000 (GMT) (envelope-from scottl@samsco.org) Received: from [192.168.254.11] (junior.samsco.home [192.168.254.11]) (authenticated bits=0) by pooker.samsco.org (8.13.3/8.13.3) with ESMTP id j6409vl0003685; Sun, 3 Jul 2005 18:10:00 -0600 (MDT) (envelope-from scottl@samsco.org) Message-ID: <42C87CAE.7080802@samsco.org> Date: Sun, 03 Jul 2005 18:02:54 -0600 From: Scott Long User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.7.8) Gecko/20050615 X-Accept-Language: en-us, en MIME-Version: 1.0 To: Stephan Uphoff References: <20050703181616.GC89744@cvs.freesbie.org> <42C83643.4010506@samsco.org> <20050703201621.GD89744@cvs.freesbie.org> <1120425831.77984.37993.camel@palm> In-Reply-To: <1120425831.77984.37993.camel@palm> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-2.8 required=3.8 tests=ALL_TRUSTED autolearn=failed version=3.0.2 X-Spam-Checker-Version: SpamAssassin 3.0.2 (2004-11-16) on pooker.samsco.org Cc: freebsd-fs@freebsd.org Subject: Re: [saturnero@freesbie.org: Weird behaviour of mount_unionfs with executables] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Jul 2005 00:03:20 -0000 Stephan Uphoff wrote: > I suspect the changes in revision 1.272 of kern_exec.c trigger the > copy operation. > > Looks like you need a noatime option for union_fs. > > Stephan Does this mean that every vnode that gets executed gets dirtied and all its pages resynced to the backing store, or just the inode block? Scott From owner-freebsd-fs@FreeBSD.ORG Mon Jul 4 00:19:18 2005 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 68FF316A41C for ; Mon, 4 Jul 2005 00:19:18 +0000 (GMT) (envelope-from ups@tree.com) Received: from smtp.speedfactory.net (talon.speedfactory.net [66.23.216.215]) by mx1.FreeBSD.org (Postfix) with ESMTP id 19C3243D45 for ; Mon, 4 Jul 2005 00:19:17 +0000 (GMT) (envelope-from ups@tree.com) Received: (qmail 10888 invoked by uid 210); 4 Jul 2005 00:19:30 +0000 Received: from 66.23.216.49 by talon (envelope-from , uid 201) with qmail-scanner-1.25st (clamdscan: 0.85.1/964. spamassassin: 3.0.2. perlscan: 1.25st. Clear:RC:1(66.23.216.49):. Processed in 0.027358 secs); 04 Jul 2005 00:19:30 -0000 X-Qmail-Scanner-Mail-From: ups@tree.com via talon X-Qmail-Scanner: 1.25st (Clear:RC:1(66.23.216.49):. Processed in 0.027358 secs Process 10883) Received: from 66-23-216-49.clients.speedfactory.net (HELO palm.tree.com) (66.23.216.49) by smtp.speedfactory.net with AES256-SHA encrypted SMTP; 4 Jul 2005 00:19:29 +0000 Received: from [127.0.0.1] (ups@localhost.tree.com [127.0.0.1]) by palm.tree.com (8.12.10/8.12.10) with ESMTP id j640JBLl044647; Sun, 3 Jul 2005 20:19:15 -0400 (EDT) (envelope-from ups@tree.com) From: Stephan Uphoff To: Scott Long In-Reply-To: <42C87CAE.7080802@samsco.org> References: <20050703181616.GC89744@cvs.freesbie.org> <42C83643.4010506@samsco.org> <20050703201621.GD89744@cvs.freesbie.org> <1120425831.77984.37993.camel@palm> <42C87CAE.7080802@samsco.org> Content-Type: text/plain Message-Id: <1120436351.77984.38195.camel@palm> Mime-Version: 1.0 X-Mailer: Ximian Evolution 1.4.6 Date: Sun, 03 Jul 2005 20:19:11 -0400 Content-Transfer-Encoding: 7bit Cc: freebsd-fs@freebsd.org Subject: Re: [saturnero@freesbie.org: Weird behaviour of mount_unionfs with executables] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Jul 2005 00:19:18 -0000 On Sun, 2005-07-03 at 20:02, Scott Long wrote: > Stephan Uphoff wrote: > > I suspect the changes in revision 1.272 of kern_exec.c trigger the > > copy operation. > > > > Looks like you need a noatime option for union_fs. > > > > Stephan > > Does this mean that every vnode that gets executed gets dirtied and all > its pages resynced to the backing store, or just the inode block? The kernel calls VOP_SETATTR to set the access time of the file. union_fs detects that it does not have an upper layer copy of the file to modify the attributes on and decides to copy it. The vm layer does not (directly) come into play on this. Stephan From owner-freebsd-fs@FreeBSD.ORG Mon Jul 4 00:21:27 2005 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id BC11016A41C for ; Mon, 4 Jul 2005 00:21:27 +0000 (GMT) (envelope-from scottl@samsco.org) Received: from pooker.samsco.org (pooker.samsco.org [168.103.85.57]) by mx1.FreeBSD.org (Postfix) with ESMTP id 976F343D46 for ; Mon, 4 Jul 2005 00:21:25 +0000 (GMT) (envelope-from scottl@samsco.org) Received: from [192.168.254.21] (rat.samsco.home [192.168.254.21]) (authenticated bits=0) by pooker.samsco.org (8.13.3/8.13.3) with ESMTP id j640SNlx003770; Sun, 3 Jul 2005 18:28:23 -0600 (MDT) (envelope-from scottl@samsco.org) Message-ID: <42C88121.8010602@samsco.org> Date: Sun, 03 Jul 2005 18:21:53 -0600 From: Scott Long User-Agent: Mozilla/5.0 (X11; U; FreeBSD amd64; en-US; rv:1.7.5) Gecko/20050321 X-Accept-Language: en-us, en MIME-Version: 1.0 To: Stephan Uphoff References: <20050703181616.GC89744@cvs.freesbie.org> <42C83643.4010506@samsco.org> <20050703201621.GD89744@cvs.freesbie.org> <1120425831.77984.37993.camel@palm> <42C87CAE.7080802@samsco.org> <1120436351.77984.38195.camel@palm> In-Reply-To: <1120436351.77984.38195.camel@palm> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-2.8 required=3.8 tests=ALL_TRUSTED autolearn=failed version=3.0.2 X-Spam-Checker-Version: SpamAssassin 3.0.2 (2004-11-16) on pooker.samsco.org Cc: freebsd-fs@freebsd.org Subject: Re: [saturnero@freesbie.org: Weird behaviour of mount_unionfs with executables] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Jul 2005 00:21:27 -0000 Stephan Uphoff wrote: > On Sun, 2005-07-03 at 20:02, Scott Long wrote: > >>Stephan Uphoff wrote: >> >>>I suspect the changes in revision 1.272 of kern_exec.c trigger the >>>copy operation. >>> >>>Looks like you need a noatime option for union_fs. >>> >>>Stephan >> >>Does this mean that every vnode that gets executed gets dirtied and all >>its pages resynced to the backing store, or just the inode block? > > > The kernel calls VOP_SETATTR to set the access time of the file. > union_fs detects that it does not have an upper layer copy of the file > to modify the attributes on and decides to copy it. > The vm layer does not (directly) come into play on this. > > Stephan > Ok, so this is just a limitation of unionfs, not the vnode pager. You had me scared that we'd be doing a whole lot of needless disk i/o. Scott From owner-freebsd-fs@FreeBSD.ORG Mon Jul 4 00:43:08 2005 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 66EAA16A41C for ; Mon, 4 Jul 2005 00:43:08 +0000 (GMT) (envelope-from ups@tree.com) Received: from smtp.speedfactory.net (talon.speedfactory.net [66.23.216.215]) by mx1.FreeBSD.org (Postfix) with ESMTP id 0B99D43D48 for ; Mon, 4 Jul 2005 00:43:07 +0000 (GMT) (envelope-from ups@tree.com) Received: (qmail 18697 invoked by uid 210); 4 Jul 2005 00:43:20 +0000 Received: from 66.23.216.49 by talon (envelope-from , uid 201) with qmail-scanner-1.25st (clamdscan: 0.85.1/964. spamassassin: 3.0.2. perlscan: 1.25st. Clear:RC:1(66.23.216.49):. Processed in 0.030796 secs); 04 Jul 2005 00:43:20 -0000 X-Qmail-Scanner-Mail-From: ups@tree.com via talon X-Qmail-Scanner: 1.25st (Clear:RC:1(66.23.216.49):. Processed in 0.030796 secs Process 18692) Received: from 66-23-216-49.clients.speedfactory.net (HELO palm.tree.com) (66.23.216.49) by smtp.speedfactory.net with AES256-SHA encrypted SMTP; 4 Jul 2005 00:43:20 +0000 Received: from [127.0.0.1] (ups@localhost.tree.com [127.0.0.1]) by palm.tree.com (8.12.10/8.12.10) with ESMTP id j640h1Ll044734; Sun, 3 Jul 2005 20:43:05 -0400 (EDT) (envelope-from ups@tree.com) From: Stephan Uphoff To: Scott Long In-Reply-To: <42C88121.8010602@samsco.org> References: <20050703181616.GC89744@cvs.freesbie.org> <42C83643.4010506@samsco.org> <20050703201621.GD89744@cvs.freesbie.org> <1120425831.77984.37993.camel@palm> <42C87CAE.7080802@samsco.org> <1120436351.77984.38195.camel@palm> <42C88121.8010602@samsco.org> Content-Type: text/plain Message-Id: <1120437780.77984.38252.camel@palm> Mime-Version: 1.0 X-Mailer: Ximian Evolution 1.4.6 Date: Sun, 03 Jul 2005 20:43:01 -0400 Content-Transfer-Encoding: 7bit Cc: freebsd-fs@freebsd.org Subject: Re: [saturnero@freesbie.org: Weird behaviour of mount_unionfs with executables] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Jul 2005 00:43:08 -0000 On Sun, 2005-07-03 at 20:21, Scott Long wrote: > Stephan Uphoff wrote: > > On Sun, 2005-07-03 at 20:02, Scott Long wrote: > > > >>Stephan Uphoff wrote: > >> > >>>I suspect the changes in revision 1.272 of kern_exec.c trigger the > >>>copy operation. > >>> > >>>Looks like you need a noatime option for union_fs. > >>> > >>>Stephan > >> > >>Does this mean that every vnode that gets executed gets dirtied and all > >>its pages resynced to the backing store, or just the inode block? > > > > > > The kernel calls VOP_SETATTR to set the access time of the file. > > union_fs detects that it does not have an upper layer copy of the file > > to modify the attributes on and decides to copy it. > > The vm layer does not (directly) come into play on this. > > > > Stephan > > > > Ok, so this is just a limitation of unionfs, not the vnode pager. You > had me scared that we'd be doing a whole lot of needless disk i/o. YES - and it looks like just specifying noatime for the union mount should fix the copy problem for FreeSBIE. Stephan From owner-freebsd-fs@FreeBSD.ORG Mon Jul 4 01:28:09 2005 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id BA7BE16A41C for ; Mon, 4 Jul 2005 01:28:09 +0000 (GMT) (envelope-from bde@zeta.org.au) Received: from mailout2.pacific.net.au (mailout2.pacific.net.au [61.8.0.115]) by mx1.FreeBSD.org (Postfix) with ESMTP id 4D69543D48 for ; Mon, 4 Jul 2005 01:28:09 +0000 (GMT) (envelope-from bde@zeta.org.au) Received: from mailproxy2.pacific.net.au (mailproxy2.pacific.net.au [61.8.0.87]) by mailout2.pacific.net.au (8.13.4/8.13.4/Debian-3) with ESMTP id j641S6Yh027825; Mon, 4 Jul 2005 11:28:06 +1000 Received: from katana.zip.com.au (katana.zip.com.au [61.8.7.246]) by mailproxy2.pacific.net.au (8.13.4/8.13.4/Debian-3) with ESMTP id j641RxYZ031207; Mon, 4 Jul 2005 11:28:00 +1000 Date: Mon, 4 Jul 2005 11:28:00 +1000 (EST) From: Bruce Evans X-X-Sender: bde@delplex.bde.org To: Stephan Uphoff In-Reply-To: <1120437780.77984.38252.camel@palm> Message-ID: <20050704110149.R59115@delplex.bde.org> References: <20050703181616.GC89744@cvs.freesbie.org> <42C83643.4010506@samsco.org> <20050703201621.GD89744@cvs.freesbie.org> <1120425831.77984.37993.camel@palm> <42C87CAE.7080802@samsco.org> <1120436351.77984.38195.camel@palm> <42C88121.8010602@samsco.org> <1120437780.77984.38252.camel@palm> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: freebsd-fs@freebsd.org Subject: Re: [saturnero@freesbie.org: Weird behaviour of mount_unionfs with executables] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Jul 2005 01:28:09 -0000 On Sun, 3 Jul 2005, Stephan Uphoff wrote: >>> The kernel calls VOP_SETATTR to set the access time of the file. >>> union_fs detects that it does not have an upper layer copy of the file >>> to modify the attributes on and decides to copy it. It copies the file before calling VOP_SETATTR(), so it copies the file even when VOP_SETATTR() is null or fails. Null setattr's are quite common for VA_EXECVE_ATIME since many file systems don't support this, but ffs supports it. unionfs is one of the file systems that doesn't support it. It is probably correct for it to let the underlying file system decide, but this gives a bug in its read-onlyness check: the check doesn't include VA_EXECVE_ATIME, so on exec it makes a useless copy even for ffs in the case that the underlying file system is mounted read-only. The check is missing much more than that. For ffs, I think the only other EROFS error is for the birthtime but there is no way to request setting only the birthtime, but there are lots of similar errors involving immutable files and snapshots (these return EPERM). >> Ok, so this is just a limitation of unionfs, not the vnode pager. You >> had me scared that we'd be doing a whole lot of needless disk i/o. > > YES - and it looks like just specifying noatime for the union mount > should fix the copy problem for FreeSBIE. Most file systems bogusly silently ignore mount options that they don't understand, and unionfs's handling of noatime is no exception. I think noatime and most other mount options shouldn't apply to unionfs anyway -- the underlying file system should decide. Otherwise the behaviour depends too much on the pathname used to access a file. Bruce From owner-freebsd-fs@FreeBSD.ORG Mon Jul 4 03:44:02 2005 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8C64A16A41C for ; Mon, 4 Jul 2005 03:44:02 +0000 (GMT) (envelope-from ups@tree.com) Received: from smtp.speedfactory.net (talon.speedfactory.net [66.23.216.215]) by mx1.FreeBSD.org (Postfix) with ESMTP id 1EC5343D45 for ; Mon, 4 Jul 2005 03:44:01 +0000 (GMT) (envelope-from ups@tree.com) Received: (qmail 16352 invoked by uid 210); 4 Jul 2005 03:44:14 +0000 Received: from 66.23.216.49 by talon (envelope-from , uid 201) with qmail-scanner-1.25st (clamdscan: 0.85.1/965. spamassassin: 3.0.2. perlscan: 1.25st. Clear:RC:1(66.23.216.49):. Processed in 0.026023 secs); 04 Jul 2005 03:44:14 -0000 X-Qmail-Scanner-Mail-From: ups@tree.com via talon X-Qmail-Scanner: 1.25st (Clear:RC:1(66.23.216.49):. Processed in 0.026023 secs Process 16346) Received: from 66-23-216-49.clients.speedfactory.net (HELO palm.tree.com) (66.23.216.49) by smtp.speedfactory.net with AES256-SHA encrypted SMTP; 4 Jul 2005 03:44:14 +0000 Received: from [127.0.0.1] (ups@localhost.tree.com [127.0.0.1]) by palm.tree.com (8.12.10/8.12.10) with ESMTP id j643hqLl045294; Sun, 3 Jul 2005 23:43:56 -0400 (EDT) (envelope-from ups@tree.com) From: Stephan Uphoff To: Bruce Evans In-Reply-To: <20050704110149.R59115@delplex.bde.org> References: <20050703181616.GC89744@cvs.freesbie.org> <42C83643.4010506@samsco.org> <20050703201621.GD89744@cvs.freesbie.org> <1120425831.77984.37993.camel@palm> <42C87CAE.7080802@samsco.org> <1120436351.77984.38195.camel@palm> <42C88121.8010602@samsco.org> <1120437780.77984.38252.camel@palm> <20050704110149.R59115@delplex.bde.org> Content-Type: text/plain Message-Id: <1120448632.77984.38686.camel@palm> Mime-Version: 1.0 X-Mailer: Ximian Evolution 1.4.6 Date: Sun, 03 Jul 2005 23:43:52 -0400 Content-Transfer-Encoding: 7bit Cc: freebsd-fs@freebsd.org Subject: Re: [saturnero@freesbie.org: Weird behaviour of mount_unionfs with executables] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Jul 2005 03:44:02 -0000 Hi Bruce, On Sun, 2005-07-03 at 21:28, Bruce Evans wrote: > On Sun, 3 Jul 2005, Stephan Uphoff wrote: > > >>> The kernel calls VOP_SETATTR to set the access time of the file. > >>> union_fs detects that it does not have an upper layer copy of the file > >>> to modify the attributes on and decides to copy it. > > It copies the file before calling VOP_SETATTR(), so it copies the file > even when VOP_SETATTR() is null or fails. Sorry for the confusion. I was referring to the call from do_execve. I agree that the union_fs setattr implementation reacts in the way you described. > Null setattr's are quite > common for VA_EXECVE_ATIME since many file systems don't support this, > but ffs supports it. unionfs is one of the file systems that doesn't > support it. It is probably correct for it to let the underlying > file system decide, but this gives a bug in its read-onlyness check: > the check doesn't include VA_EXECVE_ATIME, so on exec it makes a useless > copy even for ffs in the case that the underlying file system is mounted > read-only. The check is missing much more than that. For ffs, I think > the only other EROFS error is for the birthtime but there is no way to > request setting only the birthtime, but there are lots of similar errors > involving immutable files and snapshots (these return EPERM). > > >> Ok, so this is just a limitation of unionfs, not the vnode pager. You > >> had me scared that we'd be doing a whole lot of needless disk i/o. > > > > YES - and it looks like just specifying noatime for the union mount > > should fix the copy problem for FreeSBIE. > > Most file systems bogusly silently ignore mount options that they don't > understand, and unionfs's handling of noatime is no exception. It looks like the option is added to the mnt_flag field of the mount point in vfs_domount. While union_fs ignores the option do_execve does not even call setattr if either the MNT_NOATIME or MNT_RDONLY bit is set in the mnt_flag of the filesystem of the vnode. This should be easy to try out - but my test system is currently busy with RELENG_5. I am not saying that this is the right thing to do and I agree that the bugs you mentioned above are real - but unless someone(TM) steps in and fixes these problems in union_fs this could be a quick workaround for freesbie (again - if it works). > I think noatime and most other mount options shouldn't apply to unionfs anyway -- > the underlying file system should decide. Otherwise the behaviour > depends too much on the pathname used to access a file. I think it is important that the behaviour is the same before and after the copy to the upper fs. However I don't see why accessing a file though both union_fs and directly to the upper/lower file system should not result in different behaviours. This being said I will be neither using nor fixing union_fs in the near future (at least I hope so) so this is just my current opinion and nothing more :-) Stephan From owner-freebsd-fs@FreeBSD.ORG Mon Jul 4 08:09:04 2005 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id F03AC16A41C for ; Mon, 4 Jul 2005 08:09:04 +0000 (GMT) (envelope-from yfyoufeng@263.net) Received: from smtp.263.net (263.net.cn [211.150.96.22]) by mx1.FreeBSD.org (Postfix) with ESMTP id 70F9E43D53 for ; Mon, 4 Jul 2005 08:09:01 +0000 (GMT) (envelope-from yfyoufeng@263.net) Received: from [10.217.12.184] (localhost [127.0.0.1]) by smtp.263.net (Postfix) with ESMTP id 32FE6C3919; Mon, 4 Jul 2005 16:08:50 +0800 (CST) (envelope-from yfyoufeng@263.net) Received: from [10.217.12.184] (unknown [61.135.152.194]) by antispam-2 (Coremail:263(050316)) with SMTP id bCCUAJLuyEIRBJjC.1 for ; Mon, 04 Jul 2005 16:08:50 +0800 (CST) X-TEBIE-Originating-IP: [61.135.152.194] From: yf-263 To: Bakul Shah In-Reply-To: <200507020038.j620cO7F071025@gate.bitblocks.com> References: <200507020038.j620cO7F071025@gate.bitblocks.com> Content-Type: text/plain; charset=UTF-8 Organization: Unix-driver.org Date: Mon, 04 Jul 2005 16:08:06 +0800 Message-Id: <1120464486.3045.49.camel@localhost.localdomain> Mime-Version: 1.0 X-Mailer: Evolution 2.2.2 (2.2.2-5) Content-Transfer-Encoding: 8bit Cc: freebsd-fs@freebsd.org Subject: Re: Cluster Filesystem for FreeBSD - any interest? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: yfyoufeng@263.net List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Jul 2005 08:09:05 -0000 在 2005-07-01五的 17:38 -0700，Bakul Shah写道： > > > A couple FS specific suggestions: > > > - perhaps clustering can be built on top of existing > > > filesystems. Each machine's local filesystem is considered > > > a cache and you use some sort of cache coherency protocol. > > > That way you don't have to deal with filesystem allocation > > > and layout issues. > > > > I see - that's an interesting idea. Almost like each machine could > > mount the shared version read-only, then slap a layer on top that is > > connected to a cache coherency manager (maybe there is a daemon on each > > node, and the nodes sync their caches via the network) to keep the > > filesystems 'in sync'. Then maybe only one elected node actually writes > > the data to the disk. If that node dies, then another node is elected. > > \begin{handwaving} > What I was thinking of: Assume we have clustered metadata servers (MDS), clustered file data servers (FDS), clients, linked with any high speed network as Ethenet, Myrinet, FC, etc, either in User level or kernel level. > - The cluster system assures that there are atleast N copies > of every file at N+ separate locations. assure after the writing time and the client/MDS/FDS crashing time. > - More than N copies may be cached dependign on usage pattern. If the server really need cache ? If the memory is big enough to make the cache can be accessed again before it is covered by new data ? > - any node can write. The system takes care of replication Yes, any node can write, and the concurrent read/write lock is hold either by app, or the FS itself to protect the data from corruption. Or as Google's always append write mode. > and placement. Let us make MDS decide the file data replication and placement, and FDS do the placement, which also means the FDS need to manage the disk space, or at least report its disk space usage to MDS to let it know how to make the decision. > - meta data, directories are implemented *above* this level. And the meta data also need to be replicated. > - more likely you'd want to map file *fragments* to local > files so that a file can grow beyond one disk and smaller Yes, to support really large files. We need data striping to support large files and enhance the write/read speed of them; and we need data splicing to support very small files who can easily eat up all inodes though there are plenty free disk space left. > fragements mean you don't have to cache an entire file. Why it need to cache the entire file ? > - you still need to mediate access at file level but this > is no different from two+ processes accessing a local file. > Of course, the devil is in the details! > > > > - a network wide stable storage `disk' may be easier to do > > > given GEOM. There are atleast N copies of each data block. > > > Data may be cached locally at any site but writing data is > > > done as a distributed transaction. So again cache > > > coherency is needed. A network RAID if you will! > > > > I'm not sure how this would work. A network RAID with geom+ggate is > > simple (I've done this a couple times - cool!), but how does that get me > > shared read-write access to the same data? > > What I had in mind something like this: Each logical block is > backed by N physical blocks at N sites. Individual > filesystems live in partitions of this space. So in effect > you have a single NFS server per filesystem that deals with > all metadata+dir lookup but due to caching read access should > be faster. When a server goes down, another server can be > elected. It is good for read-only accessing. > > > :) I understand. Any nudging in the right direction here would be > > appreciated. > > I'd probably start with modelling a single filesystem and how > it maps to a sequence of disk blocks (*without* using any > code or worrying about details of formats but capturing the I.e, map a file to one file on one host. Do you feel use the raw block instead of files will easy the job ? > essential elements). I'd describe various operations in > terms of preconditions and postconditions. Then, I'd extend > the model to deal with redundancy and so on. Then I'd model > various failure modes. etc. If you are interested _enough_ As either a MDS/FDS crashes, how does it bring itself back up. Or if we need to add another MDS/FDS into a cluster, how does it configure itself. > we can take this offline and try to work something out. You Please get me in to answer the Performance, Scalability, Availability, and Reliability problems :) > may even be able to use perl to create an `executable' > specification:-) There's a MogileFS ;) > \end{handwaving} > _______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > -- yf-263 Unix-driver.org From owner-freebsd-fs@FreeBSD.ORG Mon Jul 4 09:54:17 2005 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 450EA16A41C for ; Mon, 4 Jul 2005 09:54:17 +0000 (GMT) (envelope-from saturnero@freesbie.org) Received: from jail1-fbsd4.consiagnet.it (jail1-fbsd4.consiagnet.it [83.149.128.151]) by mx1.FreeBSD.org (Postfix) with ESMTP id F02A443D45 for ; Mon, 4 Jul 2005 09:54:16 +0000 (GMT) (envelope-from saturnero@freesbie.org) Received: by jail1-fbsd4.consiagnet.it (Postfix, from userid 1000) id 73AE259E0; Mon, 4 Jul 2005 11:54:31 +0200 (CEST) Date: Mon, 4 Jul 2005 11:54:31 +0200 From: Dario Freni To: Stephan Uphoff Message-ID: <20050704095431.GA31030@cvs.freesbie.org> References: <20050703181616.GC89744@cvs.freesbie.org> <42C83643.4010506@samsco.org> <20050703201621.GD89744@cvs.freesbie.org> <1120425831.77984.37993.camel@palm> <42C87CAE.7080802@samsco.org> <1120436351.77984.38195.camel@palm> <42C88121.8010602@samsco.org> <1120437780.77984.38252.camel@palm> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="sm4nu43k4a2Rpi4c" Content-Disposition: inline In-Reply-To: <1120437780.77984.38252.camel@palm> X-Operating-System: FreeBSD 4.10-STABLE (What else? ;) X-Sent-From: cvs.freesbie.org X-GPG-Key: http://www.saturnero.net/saturnero.asc X-GPG-Fingerprint: 9C23 3CED 32A4 1E6E 7F83 042F CA68 BBD8 8892 872B User-Agent: Mutt/1.5.9i Cc: freebsd-fs@freebsd.org Subject: Re: [saturnero@freesbie.org: Weird behaviour of mount_unionfs with executables] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Jul 2005 09:54:17 -0000 --sm4nu43k4a2Rpi4c Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sun, Jul 03, 2005 at 08:43:01PM -0400, Stephan Uphoff wrote: > On Sun, 2005-07-03 at 20:21, Scott Long wrote: > > Stephan Uphoff wrote: > > > On Sun, 2005-07-03 at 20:02, Scott Long wrote: > > >=20 > > >>Stephan Uphoff wrote: > > >> > > >>>I suspect the changes in revision 1.272 of kern_exec.c trigger the > > >>>copy operation. > > >>> > > >>>Looks like you need a noatime option for union_fs. > > >>> > > >>>Stephan > > >> > > >>Does this mean that every vnode that gets executed gets dirtied and a= ll > > >>its pages resynced to the backing store, or just the inode block? > > >=20 > > >=20 > > > The kernel calls VOP_SETATTR to set the access time of the file. > > > union_fs detects that it does not have an upper layer copy of the file > > > to modify the attributes on and decides to copy it. > > > The vm layer does not (directly) come into play on this.=20 > > >=20 > > > Stephan > > >=20 > >=20 > > Ok, so this is just a limitation of unionfs, not the vnode pager. You > > had me scared that we'd be doing a whole lot of needless disk i/o. >=20 > YES - and it looks like just specifying noatime for the union mount > should fix the copy problem for FreeSBIE. Correct. Using -o noatime when mounting the unionfs resolves all above problems. Thank you very much. --=20 Dario Freni (saturnero@freesbie.org) FreeSBIE developer (http://www.freesbie.org) GPG Public key at http://www.saturnero.net/saturnero.asc --sm4nu43k4a2Rpi4c Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.0 (FreeBSD) iD8DBQFCyQdVymi72IiShysRAsgCAJ98v2WiT1jj4DG/xo5cHWCj95qqIQCfev5Z XOBQpB6B9VHpFSpIJkTZFAk= =vwJ2 -----END PGP SIGNATURE----- --sm4nu43k4a2Rpi4c-- From owner-freebsd-fs@FreeBSD.ORG Mon Jul 4 18:52:57 2005 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B9F8B16A41C; Mon, 4 Jul 2005 18:52:57 +0000 (GMT) (envelope-from bde@zeta.org.au) Received: from mailout2.pacific.net.au (mailout2.pacific.net.au [61.8.0.115]) by mx1.FreeBSD.org (Postfix) with ESMTP id 437E543D53; Mon, 4 Jul 2005 18:52:57 +0000 (GMT) (envelope-from bde@zeta.org.au) Received: from mailproxy2.pacific.net.au (mailproxy2.pacific.net.au [61.8.0.87]) by mailout2.pacific.net.au (8.13.4/8.13.4/Debian-3) with ESMTP id j64Iqtfp004118; Tue, 5 Jul 2005 04:52:55 +1000 Received: from epsplex.bde.org (katana.zip.com.au [61.8.7.246]) by mailproxy2.pacific.net.au (8.13.4/8.13.4/Debian-3) with ESMTP id j64IqqFs027041; Tue, 5 Jul 2005 04:52:53 +1000 Date: Tue, 5 Jul 2005 04:52:52 +1000 (EST) From: Bruce Evans X-X-Sender: bde@epsplex.bde.org To: Dario Freni In-Reply-To: <20050704095431.GA31030@cvs.freesbie.org> Message-ID: <20050705030015.N790@epsplex.bde.org> References: <20050703181616.GC89744@cvs.freesbie.org> <42C83643.4010506@samsco.org> <20050703201621.GD89744@cvs.freesbie.org> <1120425831.77984.37993.camel@palm> <42C87CAE.7080802@samsco.org> <1120436351.77984.38195.camel@palm> <42C88121.8010602@samsco.org> <1120437780.77984.38252.camel@palm> <20050704095431.GA31030@cvs.freesbie.org> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: freebsd-fs@freebsd.org, ken@freebsd.org, Stephan Uphoff Subject: Re: [saturnero@freesbie.org: Weird behaviour of mount_unionfs with executables] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Jul 2005 18:52:57 -0000 On Mon, 4 Jul 2005, Dario Freni wrote: > On Sun, Jul 03, 2005 at 08:43:01PM -0400, Stephan Uphoff wrote: >> YES - and it looks like just specifying noatime for the union mount >> should fix the copy problem for FreeSBIE. > > Correct. Using -o noatime when mounting the unionfs resolves all above > problems. Thank you very much. Hmm. This shouldn't work, but helps avoid the copy due to a layering violation. In kern_execve(), the test of MNT_NOATIME is supposed to be just an optimization to avoid making null VOP_SETATTR(), but it only looks at the mount flag for the top layer so it doesn't work right if the mount flag is different in lower layers. This gives the bizarre behaviour that the noatime option for unionsfs "works" for exec() but not for read(). I could only see the duplication problem for mount_unionfs -b. There are lots of bugs in that case: = no copy is made for the modification caused by read(), despite mount_unionfs(8) claiming that: Any other operation which would ultimately require modification to the ^^^ lower layer fails with EROFS. - the error for failure is often not EROFS (but this may be a side effect). - exec() makes a bad copy. It fails to copy the access times and doesn't even copy the permissions; in particular, it loses the x bits so the file becomes non-executable. - touch(1) makes a bad copy like exec() and then fails to actually touch the file except for the clobbered times in the non-copy being current. (touch tries utimes(2) twice, first with the current times and then with a null times pointer. Both calls fail with EACCES. I think a bad copy is made on the first call ...). Subsequent touch(1)'s work normally (... touch tries utimes(2) only once, only with the current times, and since this works there seems to be a race for the earlier calls to fail (I tested as root, so there should be no permissions problems with either call, and since the middle utimes(path, NULL) call failed the bug can't be just a stale vp after making the copy in the first call).) The comment in union_setattr() only claims to make a copy to handle truncation, but a copy seems to be made when any attribute is set: % static int % union_setattr(ap) % ... % /* % * Handle case of truncating lower object to zero size % * by creating a zero length upper object. This is to % * handle the case of open with O_TRUNC and O_CREAT. % */ % if (un->un_uppervp == NULLVP && (un->un_lowervp->v_type == VREG)) { % error = union_copyup(un, (ap->a_vap->va_size != 0), % ap->a_cred, ap->a_td); % if (error) % return (error); % } Copying on any change to an attribute seems right, but it doesn't actually handle implicit changes that don't go through setattr -- mainly setting of atimes on read(). Copying on read() wouldn't be right. % % /* % * Try to set attributes in upper layer, % * otherwise return read-only filesystem error. % */ % error = EROFS; % if ((uppervp = union_lock_upper(un, td)) != NULLVP) { % error = VOP_SETATTR(un->un_uppervp, ap->a_vap, % ap->a_cred, ap->a_td); % if ((error == 0) && (ap->a_vap->va_size != VNOVAL)) % union_newsize(ap->a_vp, ap->a_vap->va_size, VNOVAL); % union_unlock_upper(uppervp, td); % } % return (error); % } The second clause in the comment doesn't match the code here -- the error is very rarely EROFS since it is usually the error returned by VOP_SETATTR() and we have avoided getting this far in most cases where VOP_SETATTR() would return EROFS. The comment was closer to matching the code in rev.1.1 where decideding EROFS was left to lower layers. Bruce From owner-freebsd-fs@FreeBSD.ORG Tue Jul 5 17:24:12 2005 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9F5E616A41C for ; Tue, 5 Jul 2005 17:24:12 +0000 (GMT) (envelope-from ezk@fsl.cs.sunysb.edu) Received: from filer.fsl.cs.sunysb.edu (filer.fsl.cs.sunysb.edu [130.245.126.2]) by mx1.FreeBSD.org (Postfix) with ESMTP id 4DAB043D4C for ; Tue, 5 Jul 2005 17:24:12 +0000 (GMT) (envelope-from ezk@fsl.cs.sunysb.edu) Received: from agora.fsl.cs.sunysb.edu (agora.fsl.cs.sunysb.edu [130.245.126.12]) by filer.fsl.cs.sunysb.edu (8.12.8/8.12.8) with ESMTP id j65HOA08001536 for ; Tue, 5 Jul 2005 13:24:10 -0400 Received: from agora.fsl.cs.sunysb.edu (localhost.localdomain [127.0.0.1]) by agora.fsl.cs.sunysb.edu (8.13.1/8.13.1) with ESMTP id j65HO9Cd019478 for ; Tue, 5 Jul 2005 13:24:09 -0400 Received: (from ezk@localhost) by agora.fsl.cs.sunysb.edu (8.13.1/8.12.8/Submit) id j65HO9lD019475; Tue, 5 Jul 2005 13:24:09 -0400 Date: Tue, 5 Jul 2005 13:24:09 -0400 Message-Id: <200507051724.j65HO9lD019475@agora.fsl.cs.sunysb.edu> From: Erez Zadok To: freebsd-fs@freebsd.org X-MailKey: Erez_Zadok Subject: technical article on our Unionfs X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 Jul 2005 17:24:12 -0000 A technical article on our Unionfs (for Linux) is scheduled to appear in the November issue of ACM's Transactions on Storage journal. Although our implementation happens to be on Linux, many of the issues discussed in the article are generic to namespace merging/management. We've made this article available to you on http://unionfs.filesystems.org/. It is my hope that the article might be helpful to the FreeBSD community in producing a stable and versatile unioning file system. Cheers, Erez. From owner-freebsd-fs@FreeBSD.ORG Tue Jul 5 17:56:09 2005 Return-Path: X-Original-To: fs@freebsd.org Delivered-To: freebsd-fs@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4DC5E16A41C for ; Tue, 5 Jul 2005 17:56:09 +0000 (GMT) (envelope-from skylar@cs.earlham.edu) Received: from quark.cs.earlham.edu (cs.earlham.edu [159.28.230.3]) by mx1.FreeBSD.org (Postfix) with ESMTP id 5172343D49 for ; Tue, 5 Jul 2005 17:56:08 +0000 (GMT) (envelope-from skylar@cs.earlham.edu) Received: from quark.cs.earlham.edu (localhost [127.0.0.1]) by quark.cs.earlham.edu (8.13.4/8.13.3) with ESMTP id j65Hu00J070387 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 5 Jul 2005 12:56:00 -0500 (EST) (envelope-from skylar@cs.earlham.edu) Received: (from skylar@localhost) by quark.cs.earlham.edu (8.13.4/8.13.3/Submit) id j65Htx0W070386; Tue, 5 Jul 2005 12:55:59 -0500 (EST) (envelope-from skylar@cs.earlham.edu) X-Authentication-Warning: quark.cs.earlham.edu: skylar set sender to skylar@quark.cs.earlham.edu using -f Date: Tue, 5 Jul 2005 12:55:59 -0500 From: Skylar Thompson To: Dag-Erling =?iso-8859-1?Q?Sm=F8rgrav?= Message-ID: <20050705175559.GA70037@quark.cs.earlham.edu> References: <20050626182031.GA5268@quark.cs.earlham.edu> <20050701130315.C52686@duey.wolves.k12.mo.us> <42C6C873.8050808@cs.earlham.edu> <86k6k8yxf2.fsf@xps.des.no> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="AhhlLboLdkugWU4S" Content-Disposition: inline In-Reply-To: <86k6k8yxf2.fsf@xps.des.no> User-Agent: Mutt/1.4.2.1i X-Sender: "Skylar Thompson" X-Accept-Primary-Language: en X-Accept-Secondary-Language: es SMTP-Mailing-Host: quark.cs.earlham.edu X-Operating-System: FreeBSD 5.4-RELEASE-p1 X-Uptime: 12:47PM up 8 days, 17:33, 14 users, load averages: 0.32, 0.31, 0.31 X-Editor: VIM - Vi IMproved 6.3 (2004 June 7, compiled May 14 2005 15:15:17) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-1.6 (quark.cs.earlham.edu [127.0.0.1]); Tue, 05 Jul 2005 12:56:01 -0500 (EST) X-Virus-Scanned: ClamAV 0.86.1/967/Mon Jul 4 16:36:05 2005 on quark.cs.earlham.edu X-Virus-Status: Clean X-Sanitizer: This message has passed the MIMEDefang sanitizer. X-Sanitizer-URL: http://www.cs.earlham.edu/applied-groups/admin/ X-Sanitizer-Version: MIMEDefang/ECSanitizer $Revision: 1.18 $ X-Sanitizer-Config-Version: $Revision: 1.180 $ X-Scanned-By: MIMEDefang 2.51 on 192.168.0.3 X-Spam-Status: No, score=-2.8 required=8.0 tests=ALL_TRUSTED autolearn=failed version=3.0.4 X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on quark.cs.earlham.edu Cc: fs@freebsd.org Subject: Re: Snapshot problems X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Skylar Thompson List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 Jul 2005 17:56:09 -0000 --AhhlLboLdkugWU4S Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sun, Jul 03, 2005 at 12:52:01PM +0200, Dag-Erling Smrgrav wrote: > Skylar Thompson writes: > > No joy. The machine hung again yesterday afternoon, with the error > > "kern.ipc.maxpipekva exceeded" repeated over and over again on the > > console. >=20 > So you're using a lot of pipes - more than the kernel can handle with > the default parameters. What's your workload? Do you run a lot of > jails? What is the current value of kern.ipc.maxpipekva? Have you > tried increasing it? I doubled it from 16 million to 32 million, and the machine still crashes. --=20 -- Skylar Thompson (skylar@cs.earlham.edu) -- http://www.cs.earlham.edu/~skylar/ --AhhlLboLdkugWU4S Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.1 (FreeBSD) iD8DBQFCysmvsc4yyULgN4YRAicuAJ9NMsWwe2bOlO9P7gT9rGw36rCwogCbBHef mI1g64D/frO6oXG7ZPbKBPI= =xP98 -----END PGP SIGNATURE----- --AhhlLboLdkugWU4S-- From owner-freebsd-fs@FreeBSD.ORG Tue Jul 5 19:56:43 2005 Return-Path: X-Original-To: fs@freebsd.org Delivered-To: freebsd-fs@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 86B0E16A424 for ; Tue, 5 Jul 2005 19:56:43 +0000 (GMT) (envelope-from kris@obsecurity.org) Received: from obsecurity.dyndns.org (CPE0050040655c8-CM00111ae02aac.cpe.net.cable.rogers.com [69.194.102.232]) by mx1.FreeBSD.org (Postfix) with ESMTP id A6F5F442E1 for ; Tue, 5 Jul 2005 19:29:33 +0000 (GMT) (envelope-from kris@obsecurity.org) Received: by obsecurity.dyndns.org (Postfix, from userid 1000) id ADE9E5144F; Tue, 5 Jul 2005 15:29:32 -0400 (EDT) Date: Tue, 5 Jul 2005 15:29:32 -0400 From: Kris Kennaway To: Skylar Thompson Message-ID: <20050705192932.GA46543@xor.obsecurity.org> References: <20050626182031.GA5268@quark.cs.earlham.edu> <20050701130315.C52686@duey.wolves.k12.mo.us> <42C6C873.8050808@cs.earlham.edu> <86k6k8yxf2.fsf@xps.des.no> <20050705175559.GA70037@quark.cs.earlham.edu> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="2oS5YaxWCcQjTEyO" Content-Disposition: inline In-Reply-To: <20050705175559.GA70037@quark.cs.earlham.edu> User-Agent: Mutt/1.4.2.1i Cc: fs@freebsd.org Subject: Re: Snapshot problems X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 Jul 2005 19:56:43 -0000 --2oS5YaxWCcQjTEyO Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Jul 05, 2005 at 12:55:59PM -0500, Skylar Thompson wrote: > On Sun, Jul 03, 2005 at 12:52:01PM +0200, Dag-Erling Smrgrav wrote: > > Skylar Thompson writes: > > > No joy. The machine hung again yesterday afternoon, with the error > > > "kern.ipc.maxpipekva exceeded" repeated over and over again on the > > > console. > >=20 > > So you're using a lot of pipes - more than the kernel can handle with > > the default parameters. What's your workload? Do you run a lot of > > jails? What is the current value of kern.ipc.maxpipekva? Have you > > tried increasing it? >=20 > I doubled it from 16 million to 32 million, and the machine still crashes. When you break to DDB, what processes are running or blocked? Kris --2oS5YaxWCcQjTEyO Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.1 (FreeBSD) iD8DBQFCyt+cWry0BWjoQKURAjETAJ92iCfi5nQqlj05ZYjgzeNHXArguACghPjj uwJI3EiFMFA9+BR/KGK+Pb8= =Fll0 -----END PGP SIGNATURE----- --2oS5YaxWCcQjTEyO-- From owner-freebsd-fs@FreeBSD.ORG Tue Jul 5 20:56:03 2005 Return-Path: X-Original-To: fs@freebsd.org Delivered-To: freebsd-fs@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 2401C16A41C for ; Tue, 5 Jul 2005 20:56:03 +0000 (GMT) (envelope-from cdillon@wolves.k12.mo.us) Received: from mail.wolves.k12.mo.us (mail.wolves.k12.mo.us [207.160.214.1]) by mx1.FreeBSD.org (Postfix) with ESMTP id E07C743D4C for ; Tue, 5 Jul 2005 20:56:02 +0000 (GMT) (envelope-from cdillon@wolves.k12.mo.us) Received: from localhost (localhost [127.0.0.1]) by mail.wolves.k12.mo.us (Postfix) with ESMTP id 315E11FE0A; Tue, 5 Jul 2005 15:56:02 -0500 (CDT) Received: from mail.wolves.k12.mo.us ([127.0.0.1]) by localhost (mail.wolves.k12.mo.us [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 89016-02-2; Tue, 5 Jul 2005 15:55:59 -0500 (CDT) Received: by mail.wolves.k12.mo.us (Postfix, from userid 1001) id D0BA21FE03; Tue, 5 Jul 2005 15:55:59 -0500 (CDT) Received: from localhost (localhost [127.0.0.1]) by mail.wolves.k12.mo.us (Postfix) with ESMTP id CF6D71A902; Tue, 5 Jul 2005 15:55:59 -0500 (CDT) Date: Tue, 5 Jul 2005 15:55:59 -0500 (CDT) From: Chris Dillon To: Skylar Thompson In-Reply-To: <20050705175559.GA70037@quark.cs.earlham.edu> Message-ID: <20050705155011.F87747@duey.wolves.k12.mo.us> References: <20050626182031.GA5268@quark.cs.earlham.edu> <20050701130315.C52686@duey.wolves.k12.mo.us> <42C6C873.8050808@cs.earlham.edu> <86k6k8yxf2.fsf@xps.des.no> <20050705175559.GA70037@quark.cs.earlham.edu> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed X-Virus-Scanned: amavisd-new at wolves.k12.mo.us Cc: fs@freebsd.org Subject: Re: Snapshot problems X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 Jul 2005 20:56:03 -0000 On Tue, 5 Jul 2005, Skylar Thompson wrote: > On Sun, Jul 03, 2005 at 12:52:01PM +0200, Dag-Erling Smrgrav wrote: >> Skylar Thompson writes: >>> No joy. The machine hung again yesterday afternoon, with the error >>> "kern.ipc.maxpipekva exceeded" repeated over and over again on the >>> console. >> >> So you're using a lot of pipes - more than the kernel can handle >> with the default parameters. What's your workload? Do you run a >> lot of jails? What is the current value of kern.ipc.maxpipekva? >> Have you tried increasing it? > > I doubled it from 16 million to 32 million, and the machine still > crashes. Could this just be a side-effect of the filesystem livelocking (I guess that is the appropriate term) and a script or other process getting out of control as a result? If so, the "kern.ipc.maxpipekva" error would be irrelevant. I don't recall seeing that error when the filesystem livelock happens to me, but I've only actually seen the console a few times when it happened, the rest of the times I had to power-cycle it remotely. -- Chris Dillon - cdillon(at)wolves.k12.mo.us FreeBSD: The fastest, most open, and most stable OS on the planet - Available for IA32, IA64, AMD64, PC98, Alpha, and UltraSPARC architectures - PowerPC, ARM, MIPS, and S/390 under development - http://www.freebsd.org Q: Because it reverses the logical flow of conversation. A: Why is putting a reply at the top of the message frowned upon? From owner-freebsd-fs@FreeBSD.ORG Wed Jul 6 00:32:58 2005 Return-Path: X-Original-To: fs@freebsd.org Delivered-To: freebsd-fs@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8094416A41C for ; Wed, 6 Jul 2005 00:32:58 +0000 (GMT) (envelope-from skylar@cs.earlham.edu) Received: from quark.cs.earlham.edu (cs.earlham.edu [159.28.230.3]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2043A43D49 for ; Wed, 6 Jul 2005 00:32:58 +0000 (GMT) (envelope-from skylar@cs.earlham.edu) Received: from [192.168.1.10] (12-222-56-168.client.insightBB.com [12.222.56.168]) (authenticated bits=0) by quark.cs.earlham.edu (8.13.4/8.13.3) with ESMTP id j660Wpac086184 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 5 Jul 2005 19:32:53 -0500 (EST) (envelope-from skylar@cs.earlham.edu) Message-ID: <42CB26A2.5000300@cs.earlham.edu> Date: Tue, 05 Jul 2005 19:32:34 -0500 From: Skylar Thompson Organization: Earlham College Computer Science Department User-Agent: Mozilla Thunderbird 1.0.2 (X11/20050317) X-Accept-Language: en-us, en MIME-Version: 1.0 To: Kris Kennaway References: <20050626182031.GA5268@quark.cs.earlham.edu> <20050701130315.C52686@duey.wolves.k12.mo.us> <42C6C873.8050808@cs.earlham.edu> <86k6k8yxf2.fsf@xps.des.no> <20050705175559.GA70037@quark.cs.earlham.edu> <20050705192932.GA46543@xor.obsecurity.org> In-Reply-To: <20050705192932.GA46543@xor.obsecurity.org> X-Enigmail-Version: 0.89.5.0 X-Enigmail-Supports: pgp-inline, pgp-mime Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig7A54D062CDEF28A606935CC7" X-Greylist: Sender succeded SMTP AUTH authentication, not delayed by milter-greylist-1.6 (quark.cs.earlham.edu [159.28.230.3]); Tue, 05 Jul 2005 19:32:53 -0500 (EST) X-Virus-Scanned: ClamAV 0.86.1/967/Mon Jul 4 16:36:05 2005 on quark.cs.earlham.edu X-Virus-Status: Clean X-Sanitizer: This message has passed the MIMEDefang sanitizer. X-Sanitizer-URL: http://www.cs.earlham.edu/applied-groups/admin/ X-Sanitizer-Version: MIMEDefang/ECSanitizer $Revision: 1.18 $ X-Sanitizer-Config-Version: $Revision: 1.180 $ X-Scanned-By: MIMEDefang 2.51 on 159.28.230.3 X-Spam-Status: No, score=1.8 required=8.0 tests=RCVD_IN_NJABL_DUL, RCVD_IN_SORBS_DUL autolearn=no version=3.0.4 X-Spam-Level: * X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on quark.cs.earlham.edu Cc: fs@freebsd.org Subject: Re: Snapshot problems X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Jul 2005 00:32:58 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig7A54D062CDEF28A606935CC7 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Kris Kennaway wrote: > >When you break to DDB, what processes are running or blocked? > > Running: ypbind cron tail atalkd python (Mailman) cron httpd sshd rwhod ypserv syncer I don't see any processes in a blocked state, unless SLPQ or IWAIT or blocking states. -- -- Skylar Thompson (skylar@cs.earlham.edu) -- http://www.cs.earlham.edu/~skylar/ --------------enig7A54D062CDEF28A606935CC7 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.4 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFCyyalsc4yyULgN4YRApjTAJ4ozwiRISTvl257oGD0S0RmwJYLrgCgppm8 EQeNlL85Yl6NokqqDxtOPpg= =T/6O -----END PGP SIGNATURE----- --------------enig7A54D062CDEF28A606935CC7-- From owner-freebsd-fs@FreeBSD.ORG Wed Jul 6 00:39:00 2005 Return-Path: X-Original-To: fs@freebsd.org Delivered-To: freebsd-fs@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 62FAC16A41C for ; Wed, 6 Jul 2005 00:39:00 +0000 (GMT) (envelope-from kris@obsecurity.org) Received: from obsecurity.dyndns.org (CPE0050040655c8-CM00111ae02aac.cpe.net.cable.rogers.com [69.194.102.232]) by mx1.FreeBSD.org (Postfix) with ESMTP id 20F2143D4C for ; Wed, 6 Jul 2005 00:39:00 +0000 (GMT) (envelope-from kris@obsecurity.org) Received: by obsecurity.dyndns.org (Postfix, from userid 1000) id E58C7512B6; Tue, 5 Jul 2005 20:38:58 -0400 (EDT) Date: Tue, 5 Jul 2005 20:38:58 -0400 From: Kris Kennaway To: Skylar Thompson Message-ID: <20050706003858.GA29780@xor.obsecurity.org> References: <20050626182031.GA5268@quark.cs.earlham.edu> <20050701130315.C52686@duey.wolves.k12.mo.us> <42C6C873.8050808@cs.earlham.edu> <86k6k8yxf2.fsf@xps.des.no> <20050705175559.GA70037@quark.cs.earlham.edu> <20050705192932.GA46543@xor.obsecurity.org> <42CB26A2.5000300@cs.earlham.edu> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="rwEMma7ioTxnRzrJ" Content-Disposition: inline In-Reply-To: <42CB26A2.5000300@cs.earlham.edu> User-Agent: Mutt/1.4.2.1i Cc: fs@freebsd.org, Kris Kennaway Subject: Re: Snapshot problems X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Jul 2005 00:39:00 -0000 --rwEMma7ioTxnRzrJ Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Jul 05, 2005 at 07:32:34PM -0500, Skylar Thompson wrote: > Kris Kennaway wrote: >=20 > > > >When you break to DDB, what processes are running or blocked? > >=20 > > >=20 > Running: > ypbind > cron > tail > atalkd > python (Mailman) > cron > httpd > sshd > rwhod > ypserv > syncer >=20 > I don't see any processes in a blocked state, unless SLPQ or IWAIT or=20 > blocking states. Try 'show lockedvnods' and trace the listed processes. Kris --rwEMma7ioTxnRzrJ Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.1 (FreeBSD) iD8DBQFCyygiWry0BWjoQKURAquYAJ95X9gpQhG3qFx9aOpENGmBYZGTFACeIyAi XtH2g2CQtS3aOAJpJ4VV6HY= =jrdz -----END PGP SIGNATURE----- --rwEMma7ioTxnRzrJ-- From owner-freebsd-fs@FreeBSD.ORG Wed Jul 6 00:44:14 2005 Return-Path: X-Original-To: fs@freebsd.org Delivered-To: freebsd-fs@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A60BB16A41C for ; Wed, 6 Jul 2005 00:44:14 +0000 (GMT) (envelope-from skylar@cs.earlham.edu) Received: from quark.cs.earlham.edu (cs.earlham.edu [159.28.230.3]) by mx1.FreeBSD.org (Postfix) with ESMTP id 38D6D43D4C for ; Wed, 6 Jul 2005 00:44:13 +0000 (GMT) (envelope-from skylar@cs.earlham.edu) Received: from quark.cs.earlham.edu (localhost [127.0.0.1]) by quark.cs.earlham.edu (8.13.4/8.13.3) with ESMTP id j660iA1p086639 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 5 Jul 2005 19:44:10 -0500 (EST) (envelope-from skylar@cs.earlham.edu) Received: (from skylar@localhost) by quark.cs.earlham.edu (8.13.4/8.13.3/Submit) id j660iAeH086638; Tue, 5 Jul 2005 19:44:10 -0500 (EST) (envelope-from skylar@cs.earlham.edu) X-Authentication-Warning: quark.cs.earlham.edu: skylar set sender to skylar@quark.cs.earlham.edu using -f Date: Tue, 5 Jul 2005 19:44:10 -0500 From: Skylar Thompson To: Kris Kennaway Message-ID: <20050706004410.GA86565@quark.cs.earlham.edu> References: <20050626182031.GA5268@quark.cs.earlham.edu> <20050701130315.C52686@duey.wolves.k12.mo.us> <42C6C873.8050808@cs.earlham.edu> <86k6k8yxf2.fsf@xps.des.no> <20050705175559.GA70037@quark.cs.earlham.edu> <20050705192932.GA46543@xor.obsecurity.org> <42CB26A2.5000300@cs.earlham.edu> <20050706003858.GA29780@xor.obsecurity.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="Kj7319i9nmIyA2yE" Content-Disposition: inline In-Reply-To: <20050706003858.GA29780@xor.obsecurity.org> User-Agent: Mutt/1.4.2.1i X-Sender: "Skylar Thompson" X-Accept-Primary-Language: en X-Accept-Secondary-Language: es SMTP-Mailing-Host: quark.cs.earlham.edu X-Operating-System: FreeBSD 5.4-RELEASE-p1 X-Uptime: 7:42PM up 9 days, 29 mins, 14 users, load averages: 0.27, 0.30, 0.30 X-Editor: VIM - Vi IMproved 6.3 (2004 June 7, compiled May 14 2005 15:15:17) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-1.6 (quark.cs.earlham.edu [127.0.0.1]); Tue, 05 Jul 2005 19:44:11 -0500 (EST) X-Virus-Scanned: ClamAV 0.86.1/967/Mon Jul 4 16:36:05 2005 on quark.cs.earlham.edu X-Virus-Status: Clean X-Sanitizer: This message has passed the MIMEDefang sanitizer. X-Sanitizer-URL: http://www.cs.earlham.edu/applied-groups/admin/ X-Sanitizer-Version: MIMEDefang/ECSanitizer $Revision: 1.18 $ X-Sanitizer-Config-Version: $Revision: 1.180 $ X-Scanned-By: MIMEDefang 2.51 on 192.168.0.3 X-Spam-Status: No, score=-2.8 required=8.0 tests=ALL_TRUSTED autolearn=failed version=3.0.4 X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on quark.cs.earlham.edu Cc: fs@freebsd.org Subject: Re: Snapshot problems X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Skylar Thompson List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Jul 2005 00:44:14 -0000 --Kj7319i9nmIyA2yE Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Jul 05, 2005 at 08:38:58PM -0400, Kris Kennaway wrote: > On Tue, Jul 05, 2005 at 07:32:34PM -0500, Skylar Thompson wrote: > > Kris Kennaway wrote: > >=20 > > > > > >When you break to DDB, what processes are running or blocked? > > >=20 > > > > >=20 > > Running: > > ypbind > > cron > > tail > > atalkd > > python (Mailman) > > cron > > httpd > > sshd > > rwhod > > ypserv > > syncer > >=20 > > I don't see any processes in a blocked state, unless SLPQ or IWAIT or= =20 > > blocking states. >=20 > Try 'show lockedvnods' and trace the listed processes. There's just one: Locked vnodes 0xc2383e70: tag ufs, type VREG, usecount 0, writecount 0, refcount 2, flags (VVOBJBUF), lock type ufs: EXCL (count 1) by thread 0xc25b5180 (pid 5284) ino 23945, on dev aacd0s1a pid 5284 corresponds to a running cron process. --=20 -- Skylar Thompson (skylar@cs.earlham.edu) -- http://www.cs.earlham.edu/~skylar/ --Kj7319i9nmIyA2yE Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.1 (FreeBSD) iD8DBQFCyylasc4yyULgN4YRAn91AKCWXJ8V8m4GtJyAGoPn4RI4KF214gCeL6Sy 2IuiqS9oHGdwWuamdr3OE+M= =3AAl -----END PGP SIGNATURE----- --Kj7319i9nmIyA2yE-- From owner-freebsd-fs@FreeBSD.ORG Wed Jul 6 00:46:36 2005 Return-Path: X-Original-To: fs@freebsd.org Delivered-To: freebsd-fs@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 76F5C16A445 for ; Wed, 6 Jul 2005 00:46:36 +0000 (GMT) (envelope-from kris@obsecurity.org) Received: from obsecurity.dyndns.org (CPE0050040655c8-CM00111ae02aac.cpe.net.cable.rogers.com [69.194.102.232]) by mx1.FreeBSD.org (Postfix) with ESMTP id 24C9843D49 for ; Wed, 6 Jul 2005 00:46:36 +0000 (GMT) (envelope-from kris@obsecurity.org) Received: by obsecurity.dyndns.org (Postfix, from userid 1000) id 5BC3D512B6; Tue, 5 Jul 2005 20:46:35 -0400 (EDT) Date: Tue, 5 Jul 2005 20:46:35 -0400 From: Kris Kennaway To: Skylar Thompson Message-ID: <20050706004635.GA29934@xor.obsecurity.org> References: <20050626182031.GA5268@quark.cs.earlham.edu> <20050701130315.C52686@duey.wolves.k12.mo.us> <42C6C873.8050808@cs.earlham.edu> <86k6k8yxf2.fsf@xps.des.no> <20050705175559.GA70037@quark.cs.earlham.edu> <20050705192932.GA46543@xor.obsecurity.org> <42CB26A2.5000300@cs.earlham.edu> <20050706003858.GA29780@xor.obsecurity.org> <20050706004410.GA86565@quark.cs.earlham.edu> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="45Z9DzgjV8m4Oswq" Content-Disposition: inline In-Reply-To: <20050706004410.GA86565@quark.cs.earlham.edu> User-Agent: Mutt/1.4.2.1i Cc: fs@freebsd.org, Kris Kennaway Subject: Re: Snapshot problems X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Jul 2005 00:46:36 -0000 --45Z9DzgjV8m4Oswq Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Jul 05, 2005 at 07:44:10PM -0500, Skylar Thompson wrote: > On Tue, Jul 05, 2005 at 08:38:58PM -0400, Kris Kennaway wrote: > > On Tue, Jul 05, 2005 at 07:32:34PM -0500, Skylar Thompson wrote: > > > Kris Kennaway wrote: > > >=20 > > > > > > > >When you break to DDB, what processes are running or blocked? > > > >=20 > > > > > > >=20 > > > Running: > > > ypbind > > > cron > > > tail > > > atalkd > > > python (Mailman) > > > cron > > > httpd > > > sshd > > > rwhod > > > ypserv > > > syncer > > >=20 > > > I don't see any processes in a blocked state, unless SLPQ or IWAIT or= =20 > > > blocking states. > >=20 > > Try 'show lockedvnods' and trace the listed processes. >=20 > There's just one: >=20 > Locked vnodes > 0xc2383e70: tag ufs, type VREG, usecount 0, writecount 0, refcount 2, fla= gs > (VVOBJBUF), lock type ufs: EXCL (count 1) by thread 0xc25b5180 (pid 5284) > ino 23945, on dev aacd0s1a >=20 > pid 5284 corresponds to a running cron process. And the trace? Kris --45Z9DzgjV8m4Oswq Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.1 (FreeBSD) iD8DBQFCyynrWry0BWjoQKURAjgXAJ4nohae6SRl9XgtXIAma93uUvfBEwCfSxvV JxYob3J+AehaPzgs1gQZayo= =3+7s -----END PGP SIGNATURE----- --45Z9DzgjV8m4Oswq-- From owner-freebsd-fs@FreeBSD.ORG Wed Jul 6 00:51:28 2005 Return-Path: X-Original-To: fs@freebsd.org Delivered-To: freebsd-fs@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 37AF216A41C for ; Wed, 6 Jul 2005 00:51:28 +0000 (GMT) (envelope-from skylar@cs.earlham.edu) Received: from quark.cs.earlham.edu (cs.earlham.edu [159.28.230.3]) by mx1.FreeBSD.org (Postfix) with ESMTP id BD5FB43D55 for ; Wed, 6 Jul 2005 00:51:27 +0000 (GMT) (envelope-from skylar@cs.earlham.edu) Received: from quark.cs.earlham.edu (localhost [127.0.0.1]) by quark.cs.earlham.edu (8.13.4/8.13.3) with ESMTP id j660pNQl086965 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 5 Jul 2005 19:51:23 -0500 (EST) (envelope-from skylar@cs.earlham.edu) Received: (from skylar@localhost) by quark.cs.earlham.edu (8.13.4/8.13.3/Submit) id j660pNGw086964; Tue, 5 Jul 2005 19:51:23 -0500 (EST) (envelope-from skylar@cs.earlham.edu) X-Authentication-Warning: quark.cs.earlham.edu: skylar set sender to skylar@quark.cs.earlham.edu using -f Date: Tue, 5 Jul 2005 19:51:23 -0500 From: Skylar Thompson To: Kris Kennaway Message-ID: <20050706005123.GA86915@quark.cs.earlham.edu> References: <20050626182031.GA5268@quark.cs.earlham.edu> <20050701130315.C52686@duey.wolves.k12.mo.us> <42C6C873.8050808@cs.earlham.edu> <86k6k8yxf2.fsf@xps.des.no> <20050705175559.GA70037@quark.cs.earlham.edu> <20050705192932.GA46543@xor.obsecurity.org> <42CB26A2.5000300@cs.earlham.edu> <20050706003858.GA29780@xor.obsecurity.org> <20050706004410.GA86565@quark.cs.earlham.edu> <20050706004635.GA29934@xor.obsecurity.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="EVF5PPMfhYS0aIcm" Content-Disposition: inline In-Reply-To: <20050706004635.GA29934@xor.obsecurity.org> User-Agent: Mutt/1.4.2.1i X-Sender: "Skylar Thompson" X-Accept-Primary-Language: en X-Accept-Secondary-Language: es SMTP-Mailing-Host: quark.cs.earlham.edu X-Operating-System: FreeBSD 5.4-RELEASE-p1 X-Uptime: 7:50PM up 9 days, 36 mins, 14 users, load averages: 0.12, 0.21, 0.24 X-Editor: VIM - Vi IMproved 6.3 (2004 June 7, compiled May 14 2005 15:15:17) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-1.6 (quark.cs.earlham.edu [127.0.0.1]); Tue, 05 Jul 2005 19:51:23 -0500 (EST) X-Virus-Scanned: ClamAV 0.86.1/967/Mon Jul 4 16:36:05 2005 on quark.cs.earlham.edu X-Virus-Status: Clean X-Sanitizer: This message has passed the MIMEDefang sanitizer. X-Sanitizer-URL: http://www.cs.earlham.edu/applied-groups/admin/ X-Sanitizer-Version: MIMEDefang/ECSanitizer $Revision: 1.18 $ X-Sanitizer-Config-Version: $Revision: 1.180 $ X-Scanned-By: MIMEDefang 2.51 on 192.168.0.3 X-Spam-Status: No, score=-2.8 required=8.0 tests=ALL_TRUSTED autolearn=failed version=3.0.4 X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on quark.cs.earlham.edu Cc: fs@freebsd.org Subject: Re: Snapshot problems X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Skylar Thompson List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Jul 2005 00:51:28 -0000 --EVF5PPMfhYS0aIcm Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Jul 05, 2005 at 08:46:35PM -0400, Kris Kennaway wrote: > On Tue, Jul 05, 2005 at 07:44:10PM -0500, Skylar Thompson wrote: > > On Tue, Jul 05, 2005 at 08:38:58PM -0400, Kris Kennaway wrote: > > > On Tue, Jul 05, 2005 at 07:32:34PM -0500, Skylar Thompson wrote: > > > > Kris Kennaway wrote: > > > >=20 > > > > > > > > > >When you break to DDB, what processes are running or blocked? > > > > >=20 > > > > > > > > >=20 > > > > Running: > > > > ypbind > > > > cron > > > > tail > > > > atalkd > > > > python (Mailman) > > > > cron > > > > httpd > > > > sshd > > > > rwhod > > > > ypserv > > > > syncer > > > >=20 > > > > I don't see any processes in a blocked state, unless SLPQ or IWAIT = or=20 > > > > blocking states. > > >=20 > > > Try 'show lockedvnods' and trace the listed processes. > >=20 > > There's just one: > >=20 > > Locked vnodes > > 0xc2383e70: tag ufs, type VREG, usecount 0, writecount 0, refcount 2, f= lags > > (VVOBJBUF), lock type ufs: EXCL (count 1) by thread 0xc25b5180 (pid 528= 4) > > ino 23945, on dev aacd0s1a > >=20 > > pid 5284 corresponds to a running cron process. >=20 > And the trace? Sorry about that. Here it is: Tracing pid 5284 tid 100171 td 0xc25b5180 sched switch(c0753480) at sched switch+0x143 Xcpustop() at Xcpustop+0x41 --=20 -- Skylar Thompson (skylar@cs.earlham.edu) -- http://www.cs.earlham.edu/~skylar/ --EVF5PPMfhYS0aIcm Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.1 (FreeBSD) iD8DBQFCyysLsc4yyULgN4YRAlAIAJ4nSDIlixOveCpR9D/+HZzNPMiKFACgppni +eQ9IZ0F9ElVKcP4ybsfvE8= =gUeE -----END PGP SIGNATURE----- --EVF5PPMfhYS0aIcm-- From owner-freebsd-fs@FreeBSD.ORG Wed Jul 6 01:03:47 2005 Return-Path: X-Original-To: fs@freebsd.org Delivered-To: freebsd-fs@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3F45816A41C for ; Wed, 6 Jul 2005 01:03:47 +0000 (GMT) (envelope-from kris@obsecurity.org) Received: from obsecurity.dyndns.org (CPE0050040655c8-CM00111ae02aac.cpe.net.cable.rogers.com [69.194.102.232]) by mx1.FreeBSD.org (Postfix) with ESMTP id E283343D46 for ; Wed, 6 Jul 2005 01:03:46 +0000 (GMT) (envelope-from kris@obsecurity.org) Received: by obsecurity.dyndns.org (Postfix, from userid 1000) id 92AC7513F1; Tue, 5 Jul 2005 21:03:45 -0400 (EDT) Date: Tue, 5 Jul 2005 21:03:45 -0400 From: Kris Kennaway To: Skylar Thompson Message-ID: <20050706010345.GA36075@xor.obsecurity.org> References: <20050701130315.C52686@duey.wolves.k12.mo.us> <42C6C873.8050808@cs.earlham.edu> <86k6k8yxf2.fsf@xps.des.no> <20050705175559.GA70037@quark.cs.earlham.edu> <20050705192932.GA46543@xor.obsecurity.org> <42CB26A2.5000300@cs.earlham.edu> <20050706003858.GA29780@xor.obsecurity.org> <20050706004410.GA86565@quark.cs.earlham.edu> <20050706004635.GA29934@xor.obsecurity.org> <20050706005123.GA86915@quark.cs.earlham.edu> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="huq684BweRXVnRxX" Content-Disposition: inline In-Reply-To: <20050706005123.GA86915@quark.cs.earlham.edu> User-Agent: Mutt/1.4.2.1i Cc: fs@freebsd.org, Kris Kennaway Subject: Re: Snapshot problems X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Jul 2005 01:03:47 -0000 --huq684BweRXVnRxX Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Jul 05, 2005 at 07:51:23PM -0500, Skylar Thompson wrote: > On Tue, Jul 05, 2005 at 08:46:35PM -0400, Kris Kennaway wrote: > > On Tue, Jul 05, 2005 at 07:44:10PM -0500, Skylar Thompson wrote: > > > On Tue, Jul 05, 2005 at 08:38:58PM -0400, Kris Kennaway wrote: > > > > On Tue, Jul 05, 2005 at 07:32:34PM -0500, Skylar Thompson wrote: > > > > > Kris Kennaway wrote: > > > > >=20 > > > > > > > > > > > >When you break to DDB, what processes are running or blocked? > > > > > >=20 > > > > > > > > > > >=20 > > > > > Running: > > > > > ypbind > > > > > cron > > > > > tail > > > > > atalkd > > > > > python (Mailman) > > > > > cron > > > > > httpd > > > > > sshd > > > > > rwhod > > > > > ypserv > > > > > syncer > > > > >=20 > > > > > I don't see any processes in a blocked state, unless SLPQ or IWAI= T or=20 > > > > > blocking states. > > > >=20 > > > > Try 'show lockedvnods' and trace the listed processes. > > >=20 > > > There's just one: > > >=20 > > > Locked vnodes > > > 0xc2383e70: tag ufs, type VREG, usecount 0, writecount 0, refcount 2,= flags > > > (VVOBJBUF), lock type ufs: EXCL (count 1) by thread 0xc25b5180 (pid 5= 284) > > > ino 23945, on dev aacd0s1a > > >=20 > > > pid 5284 corresponds to a running cron process. > >=20 > > And the trace? >=20 > Sorry about that. Here it is: >=20 > Tracing pid 5284 tid 100171 td 0xc25b5180 > sched switch(c0753480) at sched switch+0x143 > Xcpustop() at Xcpustop+0x41 Looks bogus :( Kris --huq684BweRXVnRxX Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.1 (FreeBSD) iD8DBQFCyy3wWry0BWjoQKURAvNbAJ97LjT+QhKk67qJodwWU4ZU+pRFzACg/F0a K2telQqmAGMkntyR3lyiS4Y= =U+ye -----END PGP SIGNATURE----- --huq684BweRXVnRxX-- From owner-freebsd-fs@FreeBSD.ORG Wed Jul 6 01:05:59 2005 Return-Path: X-Original-To: fs@freebsd.org Delivered-To: freebsd-fs@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id DF2C916A41C for ; Wed, 6 Jul 2005 01:05:59 +0000 (GMT) (envelope-from skylar@cs.earlham.edu) Received: from quark.cs.earlham.edu (cs.earlham.edu [159.28.230.3]) by mx1.FreeBSD.org (Postfix) with ESMTP id 82DFF43D46 for ; Wed, 6 Jul 2005 01:05:59 +0000 (GMT) (envelope-from skylar@cs.earlham.edu) Received: from [192.168.1.10] (12-222-56-168.client.insightBB.com [12.222.56.168]) (authenticated bits=0) by quark.cs.earlham.edu (8.13.4/8.13.3) with ESMTP id j6615qNx087633 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 5 Jul 2005 20:05:55 -0500 (EST) (envelope-from skylar@cs.earlham.edu) Message-ID: <42CB2E70.3030601@cs.earlham.edu> Date: Tue, 05 Jul 2005 20:05:52 -0500 From: Skylar Thompson Organization: Earlham College Computer Science Department User-Agent: Mozilla Thunderbird 1.0.2 (X11/20050317) X-Accept-Language: en-us, en MIME-Version: 1.0 To: Kris Kennaway References: <20050701130315.C52686@duey.wolves.k12.mo.us> <42C6C873.8050808@cs.earlham.edu> <86k6k8yxf2.fsf@xps.des.no> <20050705175559.GA70037@quark.cs.earlham.edu> <20050705192932.GA46543@xor.obsecurity.org> <42CB26A2.5000300@cs.earlham.edu> <20050706003858.GA29780@xor.obsecurity.org> <20050706004410.GA86565@quark.cs.earlham.edu> <20050706004635.GA29934@xor.obsecurity.org> <20050706005123.GA86915@quark.cs.earlham.edu> <20050706010345.GA36075@xor.obsecurity.org> In-Reply-To: <20050706010345.GA36075@xor.obsecurity.org> X-Enigmail-Version: 0.89.5.0 X-Enigmail-Supports: pgp-inline, pgp-mime Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enigACCB4A06A4E1EC2F5A09D119" X-Greylist: Sender succeded SMTP AUTH authentication, not delayed by milter-greylist-1.6 (quark.cs.earlham.edu [159.28.230.3]); Tue, 05 Jul 2005 20:05:55 -0500 (EST) X-Virus-Scanned: ClamAV 0.86.1/967/Mon Jul 4 16:36:05 2005 on quark.cs.earlham.edu X-Virus-Status: Clean X-Sanitizer: This message has passed the MIMEDefang sanitizer. X-Sanitizer-URL: http://www.cs.earlham.edu/applied-groups/admin/ X-Sanitizer-Version: MIMEDefang/ECSanitizer $Revision: 1.18 $ X-Sanitizer-Config-Version: $Revision: 1.180 $ X-Scanned-By: MIMEDefang 2.51 on 159.28.230.3 X-Spam-Status: No, score=1.8 required=8.0 tests=RCVD_IN_NJABL_DUL, RCVD_IN_SORBS_DUL autolearn=no version=3.0.4 X-Spam-Level: * X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on quark.cs.earlham.edu Cc: fs@freebsd.org Subject: Re: Snapshot problems X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Jul 2005 01:06:00 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enigACCB4A06A4E1EC2F5A09D119 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Kris Kennaway wrote: > Looks bogus :( > Is there anything else I should look for before I reboot the system? -- -- Skylar Thompson (skylar@cs.earlham.edu) -- http://www.cs.earlham.edu/~skylar/ --------------enigACCB4A06A4E1EC2F5A09D119 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.4 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFCyy5wsc4yyULgN4YRAmNCAKCHUwh8QfN3W5e7BTdu9NWfWfbl+wCgngcM Ei39yCrzfKF0GJKRbOaMVxA= =dfy5 -----END PGP SIGNATURE----- --------------enigACCB4A06A4E1EC2F5A09D119-- From owner-freebsd-fs@FreeBSD.ORG Wed Jul 6 01:20:04 2005 Return-Path: X-Original-To: fs@freebsd.org Delivered-To: freebsd-fs@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 18AF616A41C for ; Wed, 6 Jul 2005 01:20:04 +0000 (GMT) (envelope-from kris@obsecurity.org) Received: from obsecurity.dyndns.org (CPE0050040655c8-CM00111ae02aac.cpe.net.cable.rogers.com [69.194.102.232]) by mx1.FreeBSD.org (Postfix) with ESMTP id CFA6B43D45 for ; Wed, 6 Jul 2005 01:20:03 +0000 (GMT) (envelope-from kris@obsecurity.org) Received: by obsecurity.dyndns.org (Postfix, from userid 1000) id E1C94512B6; Tue, 5 Jul 2005 21:20:02 -0400 (EDT) Date: Tue, 5 Jul 2005 21:20:02 -0400 From: Kris Kennaway To: Skylar Thompson Message-ID: <20050706012002.GA46036@xor.obsecurity.org> References: <86k6k8yxf2.fsf@xps.des.no> <20050705175559.GA70037@quark.cs.earlham.edu> <20050705192932.GA46543@xor.obsecurity.org> <42CB26A2.5000300@cs.earlham.edu> <20050706003858.GA29780@xor.obsecurity.org> <20050706004410.GA86565@quark.cs.earlham.edu> <20050706004635.GA29934@xor.obsecurity.org> <20050706005123.GA86915@quark.cs.earlham.edu> <20050706010345.GA36075@xor.obsecurity.org> <42CB2E70.3030601@cs.earlham.edu> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="NzB8fVQJ5HfG6fxh" Content-Disposition: inline In-Reply-To: <42CB2E70.3030601@cs.earlham.edu> User-Agent: Mutt/1.4.2.1i Cc: fs@freebsd.org, Kris Kennaway Subject: Re: Snapshot problems X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Jul 2005 01:20:04 -0000 --NzB8fVQJ5HfG6fxh Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Jul 05, 2005 at 08:05:52PM -0500, Skylar Thompson wrote: > Kris Kennaway wrote: >=20 > >Looks bogus :( > > >=20 > Is there anything else I should look for before I reboot the system? You should force a dump ('call doadump') so that this can be debugged offline. Kris --NzB8fVQJ5HfG6fxh Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.1 (FreeBSD) iD8DBQFCyzHCWry0BWjoQKURAi5CAJ9kKvtbYldc947BrLoolUJso2igzgCcDPMc HEwviKnqP9rrgugtBsNx23U= =Mrt5 -----END PGP SIGNATURE----- --NzB8fVQJ5HfG6fxh-- From owner-freebsd-fs@FreeBSD.ORG Wed Jul 6 01:22:05 2005 Return-Path: X-Original-To: fs@freebsd.org Delivered-To: freebsd-fs@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id EB14216A41C for ; Wed, 6 Jul 2005 01:22:05 +0000 (GMT) (envelope-from kris@obsecurity.org) Received: from obsecurity.dyndns.org (CPE0050040655c8-CM00111ae02aac.cpe.net.cable.rogers.com [69.194.102.232]) by mx1.FreeBSD.org (Postfix) with ESMTP id AB2A043D46 for ; Wed, 6 Jul 2005 01:22:05 +0000 (GMT) (envelope-from kris@obsecurity.org) Received: by obsecurity.dyndns.org (Postfix, from userid 1000) id ED5EE547FD; Tue, 5 Jul 2005 21:22:04 -0400 (EDT) Date: Tue, 5 Jul 2005 21:22:04 -0400 From: Kris Kennaway To: Skylar Thompson Message-ID: <20050706012204.GA46080@xor.obsecurity.org> References: <20050626182031.GA5268@quark.cs.earlham.edu> <20050701130315.C52686@duey.wolves.k12.mo.us> <42C6C873.8050808@cs.earlham.edu> <86k6k8yxf2.fsf@xps.des.no> <20050705175559.GA70037@quark.cs.earlham.edu> <20050705192932.GA46543@xor.obsecurity.org> <42CB26A2.5000300@cs.earlham.edu> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="azLHFNyN32YCQGCU" Content-Disposition: inline In-Reply-To: <42CB26A2.5000300@cs.earlham.edu> User-Agent: Mutt/1.4.2.1i Cc: fs@freebsd.org, Kris Kennaway Subject: Re: Snapshot problems X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Jul 2005 01:22:06 -0000 --azLHFNyN32YCQGCU Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Jul 05, 2005 at 07:32:34PM -0500, Skylar Thompson wrote: > Kris Kennaway wrote: >=20 > > > >When you break to DDB, what processes are running or blocked? > >=20 > > >=20 > Running: > ypbind > cron > tail > atalkd > python (Mailman) > cron > httpd > sshd > rwhod > ypserv > syncer You should try tracing these processes too. Kris --azLHFNyN32YCQGCU Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.1 (FreeBSD) iD8DBQFCyzI8Wry0BWjoQKURAv+DAKCETCpJNqNU6RTBsWMQUXPl1BMMGQCfcOji hOMfslhZE757Q+R1GWpOjKY= =b1sw -----END PGP SIGNATURE----- --azLHFNyN32YCQGCU-- From owner-freebsd-fs@FreeBSD.ORG Wed Jul 6 20:10:01 2005 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3EFA716A41C; Wed, 6 Jul 2005 20:10:01 +0000 (GMT) (envelope-from refugee@astraldream.net) Received: from efnet-math.org (efnet-math.org [69.60.109.125]) by mx1.FreeBSD.org (Postfix) with ESMTP id 558AB43D46; Wed, 6 Jul 2005 20:10:00 +0000 (GMT) (envelope-from refugee@astraldream.net) Received: from [192.168.0.99] ([70.108.75.148]) (authenticated bits=0) by efnet-math.org (8.13.1/8.13.1) with ESMTP id j66K9vAu014110 (version=TLSv1/SSLv3 cipher=RC4-SHA bits=128 verify=NO); Wed, 6 Jul 2005 16:09:57 -0400 In-Reply-To: <20050705030015.N790@epsplex.bde.org> References: <20050703181616.GC89744@cvs.freesbie.org> <42C83643.4010506@samsco.org> <20050703201621.GD89744@cvs.freesbie.org> <1120425831.77984.37993.camel@palm> <42C87CAE.7080802@samsco.org> <1120436351.77984.38195.camel@palm> <42C88121.8010602@samsco.org> <1120437780.77984.38252.camel@palm> <20050704095431.GA31030@cvs.freesbie.org> <20050705030015.N790@epsplex.bde.org> Mime-Version: 1.0 (Apple Message framework v730) Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed Message-Id: Content-Transfer-Encoding: 7bit From: Suleiman Souhlal Date: Wed, 6 Jul 2005 16:09:51 -0400 To: Bruce Evans X-Mailer: Apple Mail (2.730) Cc: freebsd-fs@freebsd.org, ken@freebsd.org, Stephan Uphoff Subject: Re: [saturnero@freesbie.org: Weird behaviour of mount_unionfs with executables] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Jul 2005 20:10:01 -0000 Hi, On Jul 4, 2005, at 2:52 PM, Bruce Evans wrote: > On Mon, 4 Jul 2005, Dario Freni wrote: > > >> On Sun, Jul 03, 2005 at 08:43:01PM -0400, Stephan Uphoff wrote: >> >>> YES - and it looks like just specifying noatime for the union mount >>> should fix the copy problem for FreeSBIE. >>> >> >> Correct. Using -o noatime when mounting the unionfs resolves all >> above >> problems. Thank you very much. >> > > Hmm. This shouldn't work, but helps avoid the copy due to a layering > violation. In kern_execve(), the test of MNT_NOATIME is supposed to > be just an optimization to avoid making null VOP_SETATTR(), but it > only looks at the mount flag for the top layer so it doesn't work > right if the mount flag is different in lower layers. This gives the > bizarre behaviour that the noatime option for unionsfs "works" for > exec() but not for read(). > > I could only see the duplication problem for mount_unionfs -b. There > are lots of bugs in that case: > = no copy is made for the modification caused by read(), despite > mount_unionfs(8) claiming that: > > Any other operation which would ultimately require > modification to the > ^^^ > lower layer fails with EROFS. > > - the error for failure is often not EROFS (but this may be a side > effect). > - exec() makes a bad copy. It fails to copy the access times and > doesn't > even copy the permissions; in particular, it loses the x bits so the > file becomes non-executable. > - touch(1) makes a bad copy like exec() and then fails to actually > touch > the file except for the clobbered times in the non-copy being > current. > (touch tries utimes(2) twice, first with the current times and > then with > a null times pointer. Both calls fail with EACCES. I think a > bad copy > is made on the first call ...). Subsequent touch(1)'s work normally > (... touch tries utimes(2) only once, only with the current > times, and > since this works there seems to be a race for the earlier calls > to fail > (I tested as root, so there should be no permissions problems > with either > call, and since the middle utimes(path, NULL) call failed the bug > can't > be just a stale vp after making the copy in the first call).) > > The comment in union_setattr() only claims to make a copy to handle > truncation, but a copy seems to be made when any attribute is set: > > % static int > % union_setattr(ap) > % ... > % /* > % * Handle case of truncating lower object to zero size > % * by creating a zero length upper object. This is to > % * handle the case of open with O_TRUNC and O_CREAT. > % */ > % if (un->un_uppervp == NULLVP && (un->un_lowervp->v_type == > VREG)) { > % error = union_copyup(un, (ap->a_vap->va_size != 0), > % ap->a_cred, ap->a_td); > % if (error) > % return (error); > % } > > Copying on any change to an attribute seems right, but it doesn't > actually handle implicit changes that don't go through setattr -- > mainly setting of atimes on read(). Copying on read() wouldn't be > right. > > % % /* > % * Try to set attributes in upper layer, > % * otherwise return read-only filesystem error. > % */ > % error = EROFS; > % if ((uppervp = union_lock_upper(un, td)) != NULLVP) { > % error = VOP_SETATTR(un->un_uppervp, ap->a_vap, > % ap->a_cred, ap->a_td); > % if ((error == 0) && (ap->a_vap->va_size != VNOVAL)) > % union_newsize(ap->a_vp, ap->a_vap->va_size, VNOVAL); > % union_unlock_upper(uppervp, td); > % } > % return (error); > % } > > The second clause in the comment doesn't match the code here -- the > error > is very rarely EROFS since it is usually the error returned by > VOP_SETATTR() > and we have avoided getting this far in most cases where VOP_SETATTR() > would return EROFS. The comment was closer to matching the code in > rev.1.1 > where decideding EROFS was left to lower layers. > > Bruce The vnode locking is also wrong for several cases: - According sys/kern/vnode_if.src we should return from VOP_OPEN() with vp locked, but union_open() unlocks it before returning it. - Same thing in union_access(). - We are not making sure we are calling VOP_CLOSE() with the vnode exclusively locked in union_close(). - We don't lock the upper and lower vnodes when doing VOP_GETATTR() on them in union_getattr(). - We don't lock othervp when doing VOP_STRATEGY() in union_strategy(). I think there are also other problems, but haven't had time to look for them yet. From owner-freebsd-fs@FreeBSD.ORG Thu Jul 7 15:42:49 2005 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 25BFD16A41C for ; Thu, 7 Jul 2005 15:42:49 +0000 (GMT) (envelope-from yar@comp.chem.msu.su) Received: from comp.chem.msu.su (comp.chem.msu.su [158.250.32.97]) by mx1.FreeBSD.org (Postfix) with ESMTP id A34A743D49 for ; Thu, 7 Jul 2005 15:42:46 +0000 (GMT) (envelope-from yar@comp.chem.msu.su) Received: from comp.chem.msu.su (localhost [127.0.0.1]) by comp.chem.msu.su (8.13.3/8.13.3) with ESMTP id j67FggFu067991 for ; Thu, 7 Jul 2005 19:42:42 +0400 (MSD) (envelope-from yar@comp.chem.msu.su) Received: (from yar@localhost) by comp.chem.msu.su (8.13.3/8.13.3/Submit) id j67FggAG067990 for freebsd-fs@freebsd.org; Thu, 7 Jul 2005 19:42:42 +0400 (MSD) (envelope-from yar) Date: Thu, 7 Jul 2005 19:42:41 +0400 From: Yar Tikhiy To: freebsd-fs@freebsd.org Message-ID: <20050707154241.GA67597@comp.chem.msu.su> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.9i Subject: Can fsck_ffs report negative reclaimed counts? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 Jul 2005 15:42:49 -0000 Hi folks, After a planned crash of a CURRENT system :-) and the following reboot I noticed a suspicious line in /var/log/messages: Jul 7 19:28:01 vpc7 fsck: /dev/ad0s1d: Reclaimed: 0 directories, -1 files, -2 fragments Is it OK for fsck_ffs to report negative amounts of reclaimed FS objects? -- Yar From owner-freebsd-fs@FreeBSD.ORG Fri Jul 8 21:29:41 2005 Return-Path: X-Original-To: fs@freebsd.org Delivered-To: freebsd-fs@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 2D2AB16A41C for ; Fri, 8 Jul 2005 21:29:41 +0000 (GMT) (envelope-from rick@snowhite.cis.uoguelph.ca) Received: from mailhub.cs.uoguelph.ca (mailhub.cs.uoguelph.ca [131.104.96.75]) by mx1.FreeBSD.org (Postfix) with ESMTP id BCC9243D49 for ; Fri, 8 Jul 2005 21:29:40 +0000 (GMT) (envelope-from rick@snowhite.cis.uoguelph.ca) Received: from snowhite.cis.uoguelph.ca (snowhite.cis.uoguelph.ca [131.104.48.1]) by mailhub.cs.uoguelph.ca (8.13.1/8.13.1) with ESMTP id j68LTT7B032644; Fri, 8 Jul 2005 17:29:29 -0400 Received: (from rick@localhost) by snowhite.cis.uoguelph.ca (8.9.3/8.9.3) id RAA09633; Fri, 8 Jul 2005 17:30:14 -0400 (EDT) Date: Fri, 8 Jul 2005 17:30:14 -0400 (EDT) From: rick@snowhite.cis.uoguelph.ca Message-Id: <200507082130.RAA09633@snowhite.cis.uoguelph.ca> To: tech@openbsd.org X-Scanned-By: MIMEDefang 2.44 Cc: jimz@panasas.com, egronke@panasas.com, drhodus@machdep.com, fs@freebsd.org, deicher@sandia.gov Subject: NFSv4 server and client for OpenBSD3.7 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 08 Jul 2005 21:29:41 -0000 In case anyone is interested, I've put up another beta release of my NFSv2,3,4 software, available anonymous ftp. It now includes a basically working client that does RPCSEC_GSS mounts as well as a pretty solid server. I don't plan on changing the code (except for bugfix patches) for a while, so let me know if you have bugs/fixes. If anyone can easily host it, it might be nice to have a mailing list at this point. (If there is interest and no one can host it, I can probably do that here at UofG, but they don't particularily like it. They are concerned about harrassment, distribution of ... etc.) Anyhow, have fun and let me know if you try it, rick