From owner-freebsd-fs@FreeBSD.ORG Sun Apr 22 03:06:18 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 84D6D16A402 for ; Sun, 22 Apr 2007 03:06:18 +0000 (UTC) (envelope-from morganw@chemikals.org) Received: from smtp2.sccoast.net (smtp2.sccoast.net [66.153.203.174]) by mx1.freebsd.org (Postfix) with ESMTP id 6081713C4AD for ; Sun, 22 Apr 2007 03:06:18 +0000 (UTC) (envelope-from morganw@chemikals.org) Received: from 132.155-pool-avail-mi.sccoast.net ([66.153.155.132]:62515 helo=volatile.chemikals.org) by smtp2.sccoast.net with esmtp (Exim 4.60) (envelope-from ) id 1HfSAR-0001wV-AQ for freebsd-fs@freebsd.org; Sat, 21 Apr 2007 22:51:11 -0400 Received: from localhost (morganw@localhost [127.0.0.1]) by volatile.chemikals.org (8.13.8/8.13.8) with ESMTP id l3M2pAlI001096 for ; Sat, 21 Apr 2007 22:51:10 -0400 (EDT) (envelope-from morganw@chemikals.org) Date: Sat, 21 Apr 2007 22:51:10 -0400 (EDT) From: Wes Morgan To: freebsd-fs@freebsd.org Message-ID: <20070421223552.F969@volatile.chemikals.org> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Subject: apparent filesystem-related hangs X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Apr 2007 03:06:18 -0000 I have several filesystems built on top of a gconcat volume consisting of 2 300gb and 1 500gb drive. The /usr partition constitutes the bulk of it. The volume is sitting around 95% full, and twice I've had the system become "hung" in what I believe are filesystem operations. It seems to crop up when rtorrent tries to create files that would fill up the system, but of course it doesn't actually reserve it until it is used. Any running process remains responsive until it needs to access the disk. The system was running a fairly recent 6.2-stable, March 29, but I've since updated to the most recent -stable. If anyone can give me some pointers as to how to tell exactly where these processes are hanging, I can try to reproduce it... But it takes a while to fsck the volume so I don't want to have to try too many things. If it's not a known problem I can then submit a PR. Thanks! -- This .signature sanitized for your protection From owner-freebsd-fs@FreeBSD.ORG Sun Apr 22 03:39:09 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 9121C16A401 for ; Sun, 22 Apr 2007 03:39:09 +0000 (UTC) (envelope-from anderson@freebsd.org) Received: from mh2.centtech.com (moat3.centtech.com [64.129.166.50]) by mx1.freebsd.org (Postfix) with ESMTP id 6585A13C465 for ; Sun, 22 Apr 2007 03:39:09 +0000 (UTC) (envelope-from anderson@freebsd.org) Received: from neutrino.centtech.com (andersonbox1.centtech.com [192.168.42.21]) by mh2.centtech.com (8.13.8/8.13.8) with ESMTP id l3M3d3lD018231; Sat, 21 Apr 2007 22:39:05 -0500 (CDT) (envelope-from anderson@freebsd.org) Message-ID: <462AD8D7.3040009@freebsd.org> Date: Sat, 21 Apr 2007 22:39:03 -0500 From: Eric Anderson User-Agent: Thunderbird 2.0.0.0 (X11/20070420) MIME-Version: 1.0 To: Wes Morgan References: <20070421223552.F969@volatile.chemikals.org> In-Reply-To: <20070421223552.F969@volatile.chemikals.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV 0.88.4/3146/Sat Apr 21 14:39:19 2007 on mh2.centtech.com X-Virus-Status: Clean X-Spam-Status: No, score=-1.3 required=8.0 tests=AWL,BAYES_05 autolearn=ham version=3.1.6 X-Spam-Checker-Version: SpamAssassin 3.1.6 (2006-10-03) on mh2.centtech.com Cc: freebsd-fs@freebsd.org Subject: Re: apparent filesystem-related hangs X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Apr 2007 03:39:09 -0000 On 04/21/07 21:51, Wes Morgan wrote: > I have several filesystems built on top of a gconcat volume consisting of > 2 300gb and 1 500gb drive. The /usr partition constitutes the bulk of it. > The volume is sitting around 95% full, and twice I've had the system > become "hung" in what I believe are filesystem operations. It seems to > crop up when rtorrent tries to create files that would fill up the system, > but of course it doesn't actually reserve it until it is used. Any running > process remains responsive until it needs to access the disk. > > The system was running a fairly recent 6.2-stable, March 29, but I've > since updated to the most recent -stable. > > If anyone can give me some pointers as to how to tell exactly where these > processes are hanging, I can try to reproduce it... But it takes a while > to fsck the volume so I don't want to have to try too many things. If it's > not a known problem I can then submit a PR. Output of a 'ps -auxl' would help a lot, since it will tell you what each process is doing. Also, if it's really hung (does a 'df' or 'mount' return?), then having DDB in your kernel config, and a valid dump device set up would allow you to get a dump (at the debugger prompt, do 'call doadump'). Once you have that, you can debug it much better while your system is back up doing other things. I have a similar issue on one of my file servers, however I know it was caused by file system damage that fsck cannot fix. My choice is to live with it, or dump/restore to a newly newfs'ed file system. That's no fault of UFS of course (this was caused by disk issues). Eric From owner-freebsd-fs@FreeBSD.ORG Sun Apr 22 03:42:54 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id E7A3716A401 for ; Sun, 22 Apr 2007 03:42:54 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id D725F13C44C for ; Sun, 22 Apr 2007 03:42:54 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from obsecurity.dyndns.org (elvis.mu.org [192.203.228.196]) by elvis.mu.org (Postfix) with ESMTP id 18B821A4D89; Sat, 21 Apr 2007 20:43:15 -0700 (PDT) Received: by obsecurity.dyndns.org (Postfix, from userid 1000) id 253B151428; Sat, 21 Apr 2007 23:42:54 -0400 (EDT) Date: Sat, 21 Apr 2007 23:42:53 -0400 From: Kris Kennaway To: Wes Morgan Message-ID: <20070422034253.GA88705@xor.obsecurity.org> References: <20070421223552.F969@volatile.chemikals.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20070421223552.F969@volatile.chemikals.org> User-Agent: Mutt/1.4.2.2i Cc: freebsd-fs@freebsd.org Subject: Re: apparent filesystem-related hangs X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Apr 2007 03:42:55 -0000 On Sat, Apr 21, 2007 at 10:51:10PM -0400, Wes Morgan wrote: > I have several filesystems built on top of a gconcat volume consisting of > 2 300gb and 1 500gb drive. The /usr partition constitutes the bulk of it. > The volume is sitting around 95% full, and twice I've had the system > become "hung" in what I believe are filesystem operations. It seems to > crop up when rtorrent tries to create files that would fill up the system, > but of course it doesn't actually reserve it until it is used. Any running > process remains responsive until it needs to access the disk. > > The system was running a fairly recent 6.2-stable, March 29, but I've > since updated to the most recent -stable. > > If anyone can give me some pointers as to how to tell exactly where these > processes are hanging, I can try to reproduce it... But it takes a while > to fsck the volume so I don't want to have to try too many things. If it's > not a known problem I can then submit a PR. DEBUG_LOCKS, DEBUG_VFS_LOCKS, INVARIANTS, INVARIANT_SUPPORT, then 'show lockedvnods' and 'alltrace' from ddb via the serial console when it hangs. Kris From owner-freebsd-fs@FreeBSD.ORG Sun Apr 22 03:44:08 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 8C83B16A403 for ; Sun, 22 Apr 2007 03:44:08 +0000 (UTC) (envelope-from anderson@freebsd.org) Received: from mh2.centtech.com (moat3.centtech.com [64.129.166.50]) by mx1.freebsd.org (Postfix) with ESMTP id 5E07913C43E for ; Sun, 22 Apr 2007 03:44:08 +0000 (UTC) (envelope-from anderson@freebsd.org) Received: from neutrino.centtech.com (andersonbox1.centtech.com [192.168.42.21]) by mh2.centtech.com (8.13.8/8.13.8) with ESMTP id l3M3i32H019075; Sat, 21 Apr 2007 22:44:04 -0500 (CDT) (envelope-from anderson@freebsd.org) Message-ID: <462ADA03.6090406@freebsd.org> Date: Sat, 21 Apr 2007 22:44:03 -0500 From: Eric Anderson User-Agent: Thunderbird 2.0.0.0 (X11/20070420) MIME-Version: 1.0 To: ticso@cicely.de References: <20070420232209.G4559@nux.eros.office> <20070421000029.N4559@nux.eros.office> <20070421000805.GA64413@cicely12.cicely.de> <20070421011716.B4559@nux.eros.office> <20070421010734.GD64413@cicely12.cicely.de> <20070421021529.R16230@nux.eros.office> <4629711B.9070902@freebsd.org> <20070421100233.GE64413@cicely12.cicely.de> In-Reply-To: <20070421100233.GE64413@cicely12.cicely.de> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV 0.88.4/3146/Sat Apr 21 14:39:19 2007 on mh2.centtech.com X-Virus-Status: Clean X-Spam-Status: No, score=-1.9 required=8.0 tests=AWL,BAYES_00 autolearn=ham version=3.1.6 X-Spam-Checker-Version: SpamAssassin 3.1.6 (2006-10-03) on mh2.centtech.com Cc: freebsd-fs@freebsd.org, Mike Wolman Subject: Re: lazy mirror / live backup X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Apr 2007 03:44:08 -0000 On 04/21/07 05:02, Bernd Walter wrote: > On Fri, Apr 20, 2007 at 09:04:11PM -0500, Eric Anderson wrote: >> On 04/20/07 20:25, Mike Wolman wrote: >>> On Sat, 21 Apr 2007, Bernd Walter wrote: >>> >>>> On Sat, Apr 21, 2007 at 01:38:31AM +0100, Mike Wolman wrote: >>> Yea i use rsync and snapshots quite a bit, but unfortunately rsync works >>> at the filesystem level so you cant really get a bootable image of the >>> whole device. It would be nice if this could be done without user >>> interaction, ie if the ggatec component of a mirror disappears and >>> reappears gmirror justs gets to work syncing things up. >> rsync and it's like are great tools, but traversing the tree every time >> is not only slow and heavy handed, but it takes an enormous amount of >> memory (akin to fsck) for large file systems. rsync isn't the right >> tool for lazy syncing. > > Thich file tree? > I was talking about a snapshot, which is a single file. > Oh, I didn't realize you were recommending rsync'ing the snapshot file itself. Wow. That seems pretty brutal of a solution to me. The only gain is the reduced data transferred over the net, and not the quicker sync time, less load on your source disks, etc. I think everyone knows that there are some solutions to the problem. The problem is they are not good or elegant solutions. What Mike is proposing is an elegant solution, that is slick and smooth, and simple. Eric From owner-freebsd-fs@FreeBSD.ORG Sun Apr 22 10:28:39 2007 Return-Path: X-Original-To: freebsd-fs@FreeBSD.org Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id EC9E516A400; Sun, 22 Apr 2007 10:28:39 +0000 (UTC) (envelope-from roberto@keltia.freenix.fr) Received: from keltia.freenix.fr (keltia.freenix.org [82.230.37.243]) by mx1.freebsd.org (Postfix) with ESMTP id CC5EC13C43E; Sun, 22 Apr 2007 10:28:38 +0000 (UTC) (envelope-from roberto@keltia.freenix.fr) Received: from localhost (localhost [127.0.0.1]) by keltia.freenix.fr (Postfix/TLS) with ESMTP id B429E3CA41; Sun, 22 Apr 2007 12:28:36 +0200 (CEST) Received: from keltia.freenix.fr ([127.0.0.1]) by localhost (keltia.freenix.fr [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 38924-13; Sun, 22 Apr 2007 12:28:34 +0200 (CEST) Received: by keltia.freenix.fr (Postfix/TLS, from userid 101) id D541C3952C; Sun, 22 Apr 2007 12:28:34 +0200 (CEST) Date: Sun, 22 Apr 2007 12:28:34 +0200 From: Ollivier Robert To: FreeBSD Current Users' list Message-ID: <20070422102834.GA39121@keltia.freenix.fr> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Operating-System: MacOS X / Macbook Pro - FreeBSD 6.2 / Dell D820 SMP User-Agent: Mutt/1.5.14 (2007-02-12) X-Virus-Scanned: amavisd-new at keltia.freenix.fr Cc: freebsd-fs@FreeBSD.org, pjd@FreeBSD.org Subject: ZFS/UMA panic under Parallels X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Apr 2007 10:28:40 -0000 Hello, I'm running CURRENT inside a Parallels VM and I am getting regular panic when writing to a ZFS raidz pool. UMA is complaining and panic(). It is rather easy to reproduce (cvs update, rsync all generates such panics). Another interesing point is that it always occurs after FLUSHCACHE TIMEOUT messages. The pool is made of 3 slices ad0s2 ad0s3 from the first virtual disk and ad2s1 from a second virtual disk (to get 3 "disks" for raidz). Filesystem 1024-blocks Used Avail Capacity Mounted on /dev/ad0s1a 9647558 2708134 6167620 31% / devfs 1 1 0 100% /dev tank/home 19787392 128 19787264 0% /home tank 19787264 0 19787264 0% /tank tank/usr 19902336 115072 19787264 1% /tank/usr tank/usr/obj 19787264 0 19787264 0% /tank/usr/obj tank/usr/ports 19796224 8960 19787264 0% /tank/usr/ports tank/usr/ports/distfiles 19787264 0 19787264 0% /tank/usr/ports/distfiles tank/usr/src 19983360 196096 19787264 1% /tank/usr/src ----- GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i386-marcel-freebsd". Unread portion of the kernel message buffer: ad0: FAILURE - FLUSHCACHE timed out ad2: FAILURE - FLUSHCACHE timed out Slab at 0xc2b90f70, freei 18 = 0. panic: Duplicate free of item 0xc2b90948 from zone 0xc1061780(g_bio) cpuid = 0 KDB: enter: panic panic: from debugger cpuid = 0 Uptime: 7m28s Physical memory: 503 MB Dumping 172 MB: 157 141 125 109 93 77 61 45 29 13 #0 doadump () at pcpu.h:172 172 __asm __volatile("movl %%fs:0,%0" : "=r" (td)); (kgdb) where #0 doadump () at pcpu.h:172 #1 0xc0525a40 in boot (howto=260) at ../../../kern/kern_shutdown.c:409 #2 0xc0525d4a in panic (fmt=0xc0680204 "from debugger") at ../../../kern/kern_shutdown.c:563 #3 0xc044a13e in db_panic (addr=-1068219313, have_addr=0, count=-1, modif=0xdceb09e0 "") at ../../../ddb/db_command.c:433 #4 0xc044a0d7 in db_command (last_cmdp=0xc0705f64, cmd_table=0x0) at ../../../ddb/db_command.c:401 #5 0xc044a192 in db_command_loop () at ../../../ddb/db_command.c:453 #6 0xc044bddd in db_trap (type=3, code=0) at ../../../ddb/db_main.c:222 #7 0xc0544728 in kdb_trap (type=3, code=0, tf=0xdceb0b78) at ../../../kern/subr_kdb.c:502 #8 0xc0658871 in trap (frame=0xdceb0b78) at ../../../i386/i386/trap.c:621 #9 0xc064319b in calltrap () at ../../../i386/i386/exception.s:139 #10 0xc054444f in kdb_enter (msg=0x12
) at cpufunc.h:60 #11 0xc0525cfc in panic ( fmt=0xc06ac621 "Duplicate free of item %p from zone %p(%s)\n") at ../../../kern/kern_shutdown.c:547 #12 0xc06118f4 in uma_dbg_free (zone=0xc1061780, slab=0xc2b90f70, item=0xc2b90948) at ../../../vm/uma_dbg.c:302 #13 0xc06100f3 in uma_zfree_arg (zone=0xc1061780, item=0xc2b90948, udata=0x0) at ../../../vm/uma_core.c:2261 #14 0xc04f207b in g_destroy_bio (bp=0xc2b90948) at uma.h:305 #15 0xc04f090a in g_disk_done (bp=0xc2b90948) at ../../../geom/geom_disk.c:209 #16 0xc05736e0 in biodone (bp=0xc2b90948) at ../../../kern/vfs_bio.c:3006 #17 0xc045f8c2 in ad_done (request=0xc2b7b480) at ../../../dev/ata/ata-disk.c:304 #18 0xc0464f50 in ata_completed (context=0xc2b7b480, dummy=0) at ../../../dev/ata/ata-queue.c:479 #19 0xc054bd0c in taskqueue_run (queue=0xc2a0a080) at ../../../kern/subr_taskqueue.c:255 #20 0xc054bea2 in taskqueue_swi_run (dummy=0x0) at ../../../kern/subr_taskqueue.c:297 #21 0xc0510f19 in ithread_execute_handlers (p=0xc299e240, ie=0xc2a0a000) at ../../../kern/kern_intr.c:682 #22 0xc0511047 in ithread_loop (arg=0xc2a12010) at ../../../kern/kern_intr.c:766 #23 0xc0510018 in fork_exit (callout=0xc0510fe0 , arg=0xc2a12010, frame=0xdceb0d38) at ../../../kern/kern_fork.c:814 #24 0xc0643210 in fork_trampoline () at ../../../i386/i386/exception.s:205 ----- dmesg ----- Copyright (c) 1992-2007 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 7.0-CURRENT #0: Sun Apr 22 11:05:32 CEST 2007 roberto@vm1.keltia.net:/usr/osrc/sys/i386/compile/VM7 Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Core(TM)2 CPU T7600 @ 2.33GHz (1524.50-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0x6f6 Stepping = 6 Features=0xf80b9b9 Features2=0x1 real memory = 536870912 (512 MB) avail memory = 515600384 (491 MB) kbd1 at kbdmux0 cpu0 on motherboard pcib0: pcibus 0 on motherboard pir0: on motherboard pci0: on pcib0 vgapci0: port 0x4000-0x40ff,0x4400-0x441f mem 0xc0000000-0xc0ffffff at device 2.0 on pci0 pci0: at device 3.0 (no driver attached) ed0: port 0x4c00-0x4c1f irq 10 at device 5.0 on pci0 ed0: [ITHREAD] ed0: using obsoleted if_watchdog interface ed0: Ethernet address: 00:ee:42:8a:ed:eb uhci0: port 0x5000-0x501f irq 11 at device 29.0 on pci0 uhci0: [GIANT-LOCKED] uhci0: [ITHREAD] usb0: on uhci0 usb0: USB revision 1.0 uhub0: on usb0 uhub0: 2 ports with 2 removable, self powered ehci0: mem 0xc1000000-0xc10003ff irq 9 at device 29.7 on pci0 ehci0: [GIANT-LOCKED] ehci0: [ITHREAD] usb1: EHCI version 1.0 usb1: wrong number of companions (0 != 1) usb1: on ehci0 usb1: USB revision 2.0 uhub1: on usb1 uhub1: 8 ports with 8 removable, self powered agp0: on hostb0 isab0: at device 31.0 on pci0 isa0: on isab0 atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x6c00-0x6c0f at device 31.1 on pci0 ata0: on atapci0 ata0: [ITHREAD] ata1: on atapci0 ata1: [ITHREAD] pci0: at device 31.5 (no driver attached) pmtimer0 on isa0 orm0: at iomem 0xc0000-0xc9fff pnpid ORM0000 on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 atkbdc0: at port 0x60,0x64 on isa0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] atkbd0: [ITHREAD] psm0: irq 12 on atkbdc0 psm0: [GIANT-LOCKED] psm0: [ITHREAD] psm0: model IntelliMouse Explorer, device ID 4 sio0: configured irq 4 not in bitmap of probed irqs 0 sio0: port may not be enabled sio0: configured irq 4 not in bitmap of probed irqs 0 sio0: port may not be enabled sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0 sio0: type 8250 or not responding sio0: [FILTER] sio1: configured irq 3 not in bitmap of probed irqs 0 sio1: port may not be enabled Timecounter "TSC" frequency 1524502532 Hz quality 800 Timecounters tick every 1.000 msec ad0: 32000MB at ata0-master UDMA100 acd0: CDROM at ata0-slave PIO4 ad2: 10000MB at ata1-master UDMA100 WARNING: ZFS is considered to be an experimental feature in FreeBSD. Trying to mount root from ufs:/dev/ad0s1a ZFS filesystem version 6 ZFS storage pool version 6 ----- VM7 ----- # # VM7 -- Generic kernel configuration file for FreeBSD/i386 # # $FreeBSD: src/sys/i386/conf/GENERIC,v 1.460 2006/12/13 03:41:47 yongari Exp $ cpu I686_CPU ident VM7 makeoptions DEBUG=-g # Build kernel with gdb(1) debug symbols options SCHED_4BSD # 4BSD scheduler options PREEMPTION # Enable kernel thread preemption options INET # InterNETworking options INET6 # IPv6 communications protocols options FFS # Berkeley Fast Filesystem options SOFTUPDATES # Enable FFS soft updates support options UFS_ACL # Support for access control lists options UFS_DIRHASH # Improve performance on big directories options COMPAT_43TTY # BSD 4.3 TTY compat [KEEP THIS!] options COMPAT_FREEBSD4 # Compatible with FreeBSD4 options COMPAT_FREEBSD5 # Compatible with FreeBSD5 options COMPAT_FREEBSD6 # Compatible with FreeBSD6 options KTRACE # ktrace(1) support options _KPOSIX_PRIORITY_SCHEDULING # POSIX P1003_1B real-time extensions options KBD_INSTALL_CDEV # install a CDEV entry in /dev options ADAPTIVE_GIANT # Giant mutex is adaptive. options STOP_NMI # Stop CPUS using NMI instead of IPI # Debugging for use in -current options KDB # Enable kernel debugger support. options DDB # Support DDB. options INVARIANTS # Enable calls of extra sanity checking options INVARIANT_SUPPORT # Extra sanity checks of internal structures, required by INVARIANTS # To make an SMP kernel, the next two lines are needed options SMP # Symmetric MultiProcessor Kernel device apic # I/O APIC # Bus support. device pci # Floppy drives device fdc # ATA and ATAPI devices device ata device atadisk # ATA disk drives device ataraid # ATA RAID drives device atapicd # ATAPI CDROM drives options ATA_STATIC_ID # Static device numbering # SCSI peripherals device scbus # SCSI bus (required for SCSI) device da # Direct Access (disks) device cd # CD device pass # Passthrough device (direct SCSI access) # atkbdc0 controls both the keyboard and the PS/2 mouse device atkbdc # AT keyboard controller device atkbd # AT keyboard device psm # PS/2 mouse device kbdmux # keyboard multiplexer device vga # VGA video card driver device splash # Splash screen and screen saver support # syscons is the default console driver, resembling an SCO console device sc device agp # support several AGP chipsets # Power management support (see NOTES for more options) #device apm # Add suspend/resume support for the i8254. device pmtimer # Serial (COM) ports device sio # 8250, 16[45]50 based serial ports device uart # Generic UART driver # PCI Ethernet NICs. device de # DEC/Intel DC21x4x (``Tulip'') device em # Intel PRO/1000 adapter Gigabit Ethernet Card device ixgb # Intel PRO/10GbE Ethernet Card device le # AMD Am7900 LANCE and Am79C9xx PCnet device txp # 3Com 3cR990 (``Typhoon'') device vx # 3Com 3c590, 3c595 (``Vortex'') # PCI Ethernet NICs that use the common MII bus controller code. # NOTE: Be sure to keep the 'device miibus' line in order to use these NICs! device miibus # MII bus support device ed # NE[12]000, SMC Ultra, 3c503, DS8390 cards device loop # Network loopback device random # Entropy device device ether # Ethernet support device tun # Packet tunnel. device pty # Pseudo-ttys (telnet etc) # The `bpf' device enables the Berkeley Packet Filter. # Be aware of the administrative consequences of enabling this! # Note that 'bpf' is required for DHCP. device bpf # Berkeley packet filter # USB support device uhci # UHCI PCI->USB interface device ohci # OHCI PCI->USB interface device ehci # EHCI PCI->USB interface (USB 2.0) device usb # USB Bus (required) device ugen # Generic device ukbd # Keyboard device umass # Disks/Mass storage - Requires scbus and da device ums # Mouse # FireWire support device firewire # FireWire bus code device sbp # SCSI over FireWire (Requires scbus and da) device fwe # Ethernet over FireWire (non-standard!) ----- -- Ollivier ROBERT -=- FreeBSD: The Power to Serve! -=- roberto@keltia.freenix.fr Darwin sidhe.keltia.net Kernel Version 8.8.2: Thu Sep 28 20:43:26 PDT 2006 i386 From owner-freebsd-fs@FreeBSD.ORG Sun Apr 22 11:16:35 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id BD1DA16A400 for ; Sun, 22 Apr 2007 11:16:35 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from pooker.samsco.org (pooker.samsco.org [168.103.85.57]) by mx1.freebsd.org (Postfix) with ESMTP id 065F813C45B for ; Sun, 22 Apr 2007 11:16:34 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from phobos.samsco.home (phobos.samsco.home [192.168.254.11]) (authenticated bits=0) by pooker.samsco.org (8.13.8/8.13.8) with ESMTP id l3MAp0oo074663; Sun, 22 Apr 2007 04:51:01 -0600 (MDT) (envelope-from scottl@samsco.org) Message-ID: <462B3E00.1070001@samsco.org> Date: Sun, 22 Apr 2007 04:50:40 -0600 From: Scott Long User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.2pre) Gecko/20070111 SeaMonkey/1.1 MIME-Version: 1.0 To: Ollivier Robert References: <20070422102834.GA39121@keltia.freenix.fr> In-Reply-To: <20070422102834.GA39121@keltia.freenix.fr> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Greylist: Sender succeeded SMTP AUTH authentication, not delayed by milter-greylist-2.0.2 (pooker.samsco.org [168.103.85.57]); Sun, 22 Apr 2007 04:51:01 -0600 (MDT) X-Spam-Status: No, score=-1.4 required=5.5 tests=ALL_TRUSTED autolearn=failed version=3.1.8 X-Spam-Checker-Version: SpamAssassin 3.1.8 (2007-02-13) on pooker.samsco.org Cc: freebsd-fs@freebsd.org, FreeBSD Current Users' list , pjd@freebsd.org Subject: Re: ZFS/UMA panic under Parallels X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Apr 2007 11:16:35 -0000 This is actually a problem with the ATA driver, not ZFS. I think people are also seeing it under VMWare. The ATA driver is misusing semaphores in a way that isn't reliable in the emulated environment. Scott Ollivier Robert wrote: > Hello, > > I'm running CURRENT inside a Parallels VM and I am getting regular panic > when writing to a ZFS raidz pool. UMA is complaining and panic(). > > It is rather easy to reproduce (cvs update, rsync all generates such > panics). Another interesing point is that it always occurs after > FLUSHCACHE TIMEOUT messages. > > The pool is made of 3 slices ad0s2 ad0s3 from the first virtual disk and > ad2s1 from a second virtual disk (to get 3 "disks" for raidz). > > Filesystem 1024-blocks Used Avail Capacity Mounted on > /dev/ad0s1a 9647558 2708134 6167620 31% / > devfs 1 1 0 100% /dev > tank/home 19787392 128 19787264 0% /home > tank 19787264 0 19787264 0% /tank > tank/usr 19902336 115072 19787264 1% /tank/usr > tank/usr/obj 19787264 0 19787264 0% /tank/usr/obj > tank/usr/ports 19796224 8960 19787264 0% /tank/usr/ports > tank/usr/ports/distfiles 19787264 0 19787264 0% /tank/usr/ports/distfiles > tank/usr/src 19983360 196096 19787264 1% /tank/usr/src > > ----- > GNU gdb 6.1.1 [FreeBSD] > Copyright 2004 Free Software Foundation, Inc. > GDB is free software, covered by the GNU General Public License, and you are > welcome to change it and/or distribute copies of it under certain conditions. > Type "show copying" to see the conditions. > There is absolutely no warranty for GDB. Type "show warranty" for details. > This GDB was configured as "i386-marcel-freebsd". > > Unread portion of the kernel message buffer: > ad0: FAILURE - FLUSHCACHE timed out > ad2: FAILURE - FLUSHCACHE timed out > Slab at 0xc2b90f70, freei 18 = 0. > panic: Duplicate free of item 0xc2b90948 from zone 0xc1061780(g_bio) > > cpuid = 0 > KDB: enter: panic > panic: from debugger > cpuid = 0 > Uptime: 7m28s > Physical memory: 503 MB > Dumping 172 MB: 157 141 125 109 93 77 61 45 29 13 > > #0 doadump () at pcpu.h:172 > 172 __asm __volatile("movl %%fs:0,%0" : "=r" (td)); > (kgdb) where > #0 doadump () at pcpu.h:172 > #1 0xc0525a40 in boot (howto=260) at ../../../kern/kern_shutdown.c:409 > #2 0xc0525d4a in panic (fmt=0xc0680204 "from debugger") > at ../../../kern/kern_shutdown.c:563 > #3 0xc044a13e in db_panic (addr=-1068219313, have_addr=0, count=-1, > modif=0xdceb09e0 "") at ../../../ddb/db_command.c:433 > #4 0xc044a0d7 in db_command (last_cmdp=0xc0705f64, cmd_table=0x0) > at ../../../ddb/db_command.c:401 > #5 0xc044a192 in db_command_loop () at ../../../ddb/db_command.c:453 > #6 0xc044bddd in db_trap (type=3, code=0) at ../../../ddb/db_main.c:222 > #7 0xc0544728 in kdb_trap (type=3, code=0, tf=0xdceb0b78) > at ../../../kern/subr_kdb.c:502 > #8 0xc0658871 in trap (frame=0xdceb0b78) at ../../../i386/i386/trap.c:621 > #9 0xc064319b in calltrap () at ../../../i386/i386/exception.s:139 > #10 0xc054444f in kdb_enter (msg=0x12
) > at cpufunc.h:60 > #11 0xc0525cfc in panic ( > fmt=0xc06ac621 "Duplicate free of item %p from zone %p(%s)\n") > at ../../../kern/kern_shutdown.c:547 > #12 0xc06118f4 in uma_dbg_free (zone=0xc1061780, slab=0xc2b90f70, > item=0xc2b90948) at ../../../vm/uma_dbg.c:302 > #13 0xc06100f3 in uma_zfree_arg (zone=0xc1061780, item=0xc2b90948, udata=0x0) > at ../../../vm/uma_core.c:2261 > #14 0xc04f207b in g_destroy_bio (bp=0xc2b90948) at uma.h:305 > #15 0xc04f090a in g_disk_done (bp=0xc2b90948) at ../../../geom/geom_disk.c:209 > #16 0xc05736e0 in biodone (bp=0xc2b90948) at ../../../kern/vfs_bio.c:3006 > #17 0xc045f8c2 in ad_done (request=0xc2b7b480) > at ../../../dev/ata/ata-disk.c:304 > #18 0xc0464f50 in ata_completed (context=0xc2b7b480, dummy=0) > at ../../../dev/ata/ata-queue.c:479 > #19 0xc054bd0c in taskqueue_run (queue=0xc2a0a080) > at ../../../kern/subr_taskqueue.c:255 > #20 0xc054bea2 in taskqueue_swi_run (dummy=0x0) > at ../../../kern/subr_taskqueue.c:297 > #21 0xc0510f19 in ithread_execute_handlers (p=0xc299e240, ie=0xc2a0a000) > at ../../../kern/kern_intr.c:682 > #22 0xc0511047 in ithread_loop (arg=0xc2a12010) > at ../../../kern/kern_intr.c:766 > #23 0xc0510018 in fork_exit (callout=0xc0510fe0 , > arg=0xc2a12010, frame=0xdceb0d38) at ../../../kern/kern_fork.c:814 > #24 0xc0643210 in fork_trampoline () at ../../../i386/i386/exception.s:205 > ----- > > dmesg > ----- > Copyright (c) 1992-2007 The FreeBSD Project. > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 > The Regents of the University of California. All rights reserved. > FreeBSD is a registered trademark of The FreeBSD Foundation. > FreeBSD 7.0-CURRENT #0: Sun Apr 22 11:05:32 CEST 2007 > roberto@vm1.keltia.net:/usr/osrc/sys/i386/compile/VM7 > Timecounter "i8254" frequency 1193182 Hz quality 0 > CPU: Intel(R) Core(TM)2 CPU T7600 @ 2.33GHz (1524.50-MHz 686-class CPU) > Origin = "GenuineIntel" Id = 0x6f6 Stepping = 6 > Features=0xf80b9b9 > Features2=0x1 > real memory = 536870912 (512 MB) > avail memory = 515600384 (491 MB) > kbd1 at kbdmux0 > cpu0 on motherboard > pcib0: pcibus 0 on motherboard > pir0: on motherboard > pci0: on pcib0 > vgapci0: port 0x4000-0x40ff,0x4400-0x441f mem 0xc0000000-0xc0ffffff at device 2.0 on pci0 > pci0: at device 3.0 (no driver attached) > ed0: port 0x4c00-0x4c1f irq 10 at device 5.0 on pci0 > ed0: [ITHREAD] > ed0: using obsoleted if_watchdog interface > ed0: Ethernet address: 00:ee:42:8a:ed:eb > uhci0: port 0x5000-0x501f irq 11 at device 29.0 on pci0 > uhci0: [GIANT-LOCKED] > uhci0: [ITHREAD] > usb0: on uhci0 > usb0: USB revision 1.0 > uhub0: on usb0 > uhub0: 2 ports with 2 removable, self powered > ehci0: mem 0xc1000000-0xc10003ff irq 9 at device 29.7 on pci0 > ehci0: [GIANT-LOCKED] > ehci0: [ITHREAD] > usb1: EHCI version 1.0 > usb1: wrong number of companions (0 != 1) > usb1: on ehci0 > usb1: USB revision 2.0 > uhub1: on usb1 > uhub1: 8 ports with 8 removable, self powered > agp0: on hostb0 > isab0: at device 31.0 on pci0 > isa0: on isab0 > atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x6c00-0x6c0f at device 31.1 on pci0 > ata0: on atapci0 > ata0: [ITHREAD] > ata1: on atapci0 > ata1: [ITHREAD] > pci0: at device 31.5 (no driver attached) > pmtimer0 on isa0 > orm0: at iomem 0xc0000-0xc9fff pnpid ORM0000 on isa0 > sc0: at flags 0x100 on isa0 > sc0: VGA <16 virtual consoles, flags=0x300> > vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 > atkbdc0: at port 0x60,0x64 on isa0 > atkbd0: irq 1 on atkbdc0 > kbd0 at atkbd0 > atkbd0: [GIANT-LOCKED] > atkbd0: [ITHREAD] > psm0: irq 12 on atkbdc0 > psm0: [GIANT-LOCKED] > psm0: [ITHREAD] > psm0: model IntelliMouse Explorer, device ID 4 > sio0: configured irq 4 not in bitmap of probed irqs 0 > sio0: port may not be enabled > sio0: configured irq 4 not in bitmap of probed irqs 0 > sio0: port may not be enabled > sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0 > sio0: type 8250 or not responding > sio0: [FILTER] > sio1: configured irq 3 not in bitmap of probed irqs 0 > sio1: port may not be enabled > Timecounter "TSC" frequency 1524502532 Hz quality 800 > Timecounters tick every 1.000 msec > ad0: 32000MB at ata0-master UDMA100 > acd0: CDROM at ata0-slave PIO4 > ad2: 10000MB at ata1-master UDMA100 > WARNING: ZFS is considered to be an experimental feature in FreeBSD. > Trying to mount root from ufs:/dev/ad0s1a > ZFS filesystem version 6 > ZFS storage pool version 6 > ----- > > VM7 > ----- > # > # VM7 -- Generic kernel configuration file for FreeBSD/i386 > # > # $FreeBSD: src/sys/i386/conf/GENERIC,v 1.460 2006/12/13 03:41:47 yongari Exp $ > > cpu I686_CPU > ident VM7 > > > makeoptions DEBUG=-g # Build kernel with gdb(1) debug symbols > > options SCHED_4BSD # 4BSD scheduler > options PREEMPTION # Enable kernel thread preemption > options INET # InterNETworking > options INET6 # IPv6 communications protocols > options FFS # Berkeley Fast Filesystem > options SOFTUPDATES # Enable FFS soft updates support > options UFS_ACL # Support for access control lists > options UFS_DIRHASH # Improve performance on big directories > options COMPAT_43TTY # BSD 4.3 TTY compat [KEEP THIS!] > options COMPAT_FREEBSD4 # Compatible with FreeBSD4 > options COMPAT_FREEBSD5 # Compatible with FreeBSD5 > options COMPAT_FREEBSD6 # Compatible with FreeBSD6 > options KTRACE # ktrace(1) support > options _KPOSIX_PRIORITY_SCHEDULING # POSIX P1003_1B real-time extensions > options KBD_INSTALL_CDEV # install a CDEV entry in /dev > options ADAPTIVE_GIANT # Giant mutex is adaptive. > options STOP_NMI # Stop CPUS using NMI instead of IPI > > # Debugging for use in -current > options KDB # Enable kernel debugger support. > options DDB # Support DDB. > options INVARIANTS # Enable calls of extra sanity checking > options INVARIANT_SUPPORT # Extra sanity checks of internal structures, required by INVARIANTS > > # To make an SMP kernel, the next two lines are needed > options SMP # Symmetric MultiProcessor Kernel > device apic # I/O APIC > > # Bus support. > device pci > > # Floppy drives > device fdc > > # ATA and ATAPI devices > device ata > device atadisk # ATA disk drives > device ataraid # ATA RAID drives > device atapicd # ATAPI CDROM drives > options ATA_STATIC_ID # Static device numbering > > # SCSI peripherals > device scbus # SCSI bus (required for SCSI) > device da # Direct Access (disks) > device cd # CD > device pass # Passthrough device (direct SCSI access) > > # atkbdc0 controls both the keyboard and the PS/2 mouse > device atkbdc # AT keyboard controller > device atkbd # AT keyboard > device psm # PS/2 mouse > > device kbdmux # keyboard multiplexer > > device vga # VGA video card driver > > device splash # Splash screen and screen saver support > > # syscons is the default console driver, resembling an SCO console > device sc > > device agp # support several AGP chipsets > > # Power management support (see NOTES for more options) > #device apm > # Add suspend/resume support for the i8254. > device pmtimer > > # Serial (COM) ports > device sio # 8250, 16[45]50 based serial ports > device uart # Generic UART driver > > # PCI Ethernet NICs. > device de # DEC/Intel DC21x4x (``Tulip'') > device em # Intel PRO/1000 adapter Gigabit Ethernet Card > device ixgb # Intel PRO/10GbE Ethernet Card > device le # AMD Am7900 LANCE and Am79C9xx PCnet > device txp # 3Com 3cR990 (``Typhoon'') > device vx # 3Com 3c590, 3c595 (``Vortex'') > > # PCI Ethernet NICs that use the common MII bus controller code. > # NOTE: Be sure to keep the 'device miibus' line in order to use these NICs! > device miibus # MII bus support > device ed # NE[12]000, SMC Ultra, 3c503, DS8390 cards > > device loop # Network loopback > device random # Entropy device > device ether # Ethernet support > device tun # Packet tunnel. > device pty # Pseudo-ttys (telnet etc) > > # The `bpf' device enables the Berkeley Packet Filter. > # Be aware of the administrative consequences of enabling this! > # Note that 'bpf' is required for DHCP. > device bpf # Berkeley packet filter > > # USB support > device uhci # UHCI PCI->USB interface > device ohci # OHCI PCI->USB interface > device ehci # EHCI PCI->USB interface (USB 2.0) > device usb # USB Bus (required) > device ugen # Generic > device ukbd # Keyboard > device umass # Disks/Mass storage - Requires scbus and da > device ums # Mouse > > # FireWire support > device firewire # FireWire bus code > device sbp # SCSI over FireWire (Requires scbus and da) > device fwe # Ethernet over FireWire (non-standard!) > ----- From owner-freebsd-fs@FreeBSD.ORG Sun Apr 22 12:26:47 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id E014316A403; Sun, 22 Apr 2007 12:26:46 +0000 (UTC) (envelope-from rwatson@FreeBSD.org) Received: from cyrus.watson.org (cyrus.watson.org [209.31.154.42]) by mx1.freebsd.org (Postfix) with ESMTP id 5F4F713C4B8; Sun, 22 Apr 2007 12:26:46 +0000 (UTC) (envelope-from rwatson@FreeBSD.org) Received: from fledge.watson.org (fledge.watson.org [209.31.154.41]) by cyrus.watson.org (Postfix) with ESMTP id 0E5924770C; Sun, 22 Apr 2007 08:26:46 -0400 (EDT) Date: Sun, 22 Apr 2007 13:26:45 +0100 (BST) From: Robert Watson X-X-Sender: robert@fledge.watson.org To: Scott Long In-Reply-To: <462B3E00.1070001@samsco.org> Message-ID: <20070422132607.T9911@fledge.watson.org> References: <20070422102834.GA39121@keltia.freenix.fr> <462B3E00.1070001@samsco.org> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: freebsd-fs@freebsd.org, FreeBSD Current Users' list , pjd@freebsd.org Subject: Re: ZFS/UMA panic under Parallels X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Apr 2007 12:26:47 -0000 On Sun, 22 Apr 2007, Scott Long wrote: > This is actually a problem with the ATA driver, not ZFS. I think people are > also seeing it under VMWare. The ATA driver is misusing semaphores in a way > that isn't reliable in the emulated environment. I saw what sounds like an identical panic in Parallels last week, and sent a screenshot off to Soren. He asked me to follow up with more specific version information but I've not yet been able to do that. Robert N M Watson Computer Laboratory University of Cambridge > > Scott > > > Ollivier Robert wrote: >> Hello, >> >> I'm running CURRENT inside a Parallels VM and I am getting regular panic >> when writing to a ZFS raidz pool. UMA is complaining and panic(). >> >> It is rather easy to reproduce (cvs update, rsync all generates such >> panics). Another interesing point is that it always occurs after >> FLUSHCACHE TIMEOUT messages. >> >> The pool is made of 3 slices ad0s2 ad0s3 from the first virtual disk and >> ad2s1 from a second virtual disk (to get 3 "disks" for raidz). >> >> Filesystem 1024-blocks Used Avail Capacity Mounted on >> /dev/ad0s1a 9647558 2708134 6167620 31% / >> devfs 1 1 0 100% /dev >> tank/home 19787392 128 19787264 0% /home >> tank 19787264 0 19787264 0% /tank >> tank/usr 19902336 115072 19787264 1% /tank/usr >> tank/usr/obj 19787264 0 19787264 0% >> /tank/usr/obj >> tank/usr/ports 19796224 8960 19787264 0% >> /tank/usr/ports >> tank/usr/ports/distfiles 19787264 0 19787264 0% >> /tank/usr/ports/distfiles >> tank/usr/src 19983360 196096 19787264 1% >> /tank/usr/src >> >> ----- >> GNU gdb 6.1.1 [FreeBSD] >> Copyright 2004 Free Software Foundation, Inc. >> GDB is free software, covered by the GNU General Public License, and you >> are >> welcome to change it and/or distribute copies of it under certain >> conditions. >> Type "show copying" to see the conditions. >> There is absolutely no warranty for GDB. Type "show warranty" for details. >> This GDB was configured as "i386-marcel-freebsd". >> >> Unread portion of the kernel message buffer: >> ad0: FAILURE - FLUSHCACHE timed out >> ad2: FAILURE - FLUSHCACHE timed out >> Slab at 0xc2b90f70, freei 18 = 0. >> panic: Duplicate free of item 0xc2b90948 from zone 0xc1061780(g_bio) >> >> cpuid = 0 >> KDB: enter: panic >> panic: from debugger >> cpuid = 0 >> Uptime: 7m28s >> Physical memory: 503 MB >> Dumping 172 MB: 157 141 125 109 93 77 61 45 29 13 >> >> #0 doadump () at pcpu.h:172 >> 172 __asm __volatile("movl %%fs:0,%0" : "=r" (td)); >> (kgdb) where >> #0 doadump () at pcpu.h:172 >> #1 0xc0525a40 in boot (howto=260) at ../../../kern/kern_shutdown.c:409 >> #2 0xc0525d4a in panic (fmt=0xc0680204 "from debugger") >> at ../../../kern/kern_shutdown.c:563 >> #3 0xc044a13e in db_panic (addr=-1068219313, have_addr=0, count=-1, >> modif=0xdceb09e0 "") at ../../../ddb/db_command.c:433 >> #4 0xc044a0d7 in db_command (last_cmdp=0xc0705f64, cmd_table=0x0) >> at ../../../ddb/db_command.c:401 >> #5 0xc044a192 in db_command_loop () at ../../../ddb/db_command.c:453 >> #6 0xc044bddd in db_trap (type=3, code=0) at ../../../ddb/db_main.c:222 >> #7 0xc0544728 in kdb_trap (type=3, code=0, tf=0xdceb0b78) >> at ../../../kern/subr_kdb.c:502 >> #8 0xc0658871 in trap (frame=0xdceb0b78) at ../../../i386/i386/trap.c:621 >> #9 0xc064319b in calltrap () at ../../../i386/i386/exception.s:139 >> #10 0xc054444f in kdb_enter (msg=0x12
) >> at cpufunc.h:60 >> #11 0xc0525cfc in panic ( >> fmt=0xc06ac621 "Duplicate free of item %p from zone %p(%s)\n") >> at ../../../kern/kern_shutdown.c:547 >> #12 0xc06118f4 in uma_dbg_free (zone=0xc1061780, slab=0xc2b90f70, >> item=0xc2b90948) at ../../../vm/uma_dbg.c:302 >> #13 0xc06100f3 in uma_zfree_arg (zone=0xc1061780, item=0xc2b90948, >> udata=0x0) >> at ../../../vm/uma_core.c:2261 >> #14 0xc04f207b in g_destroy_bio (bp=0xc2b90948) at uma.h:305 >> #15 0xc04f090a in g_disk_done (bp=0xc2b90948) at >> ../../../geom/geom_disk.c:209 >> #16 0xc05736e0 in biodone (bp=0xc2b90948) at ../../../kern/vfs_bio.c:3006 >> #17 0xc045f8c2 in ad_done (request=0xc2b7b480) >> at ../../../dev/ata/ata-disk.c:304 >> #18 0xc0464f50 in ata_completed (context=0xc2b7b480, dummy=0) >> at ../../../dev/ata/ata-queue.c:479 >> #19 0xc054bd0c in taskqueue_run (queue=0xc2a0a080) >> at ../../../kern/subr_taskqueue.c:255 >> #20 0xc054bea2 in taskqueue_swi_run (dummy=0x0) >> at ../../../kern/subr_taskqueue.c:297 >> #21 0xc0510f19 in ithread_execute_handlers (p=0xc299e240, ie=0xc2a0a000) >> at ../../../kern/kern_intr.c:682 >> #22 0xc0511047 in ithread_loop (arg=0xc2a12010) >> at ../../../kern/kern_intr.c:766 >> #23 0xc0510018 in fork_exit (callout=0xc0510fe0 , >> arg=0xc2a12010, frame=0xdceb0d38) at ../../../kern/kern_fork.c:814 >> #24 0xc0643210 in fork_trampoline () at ../../../i386/i386/exception.s:205 >> ----- >> >> dmesg >> ----- >> Copyright (c) 1992-2007 The FreeBSD Project. >> Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 >> The Regents of the University of California. All rights reserved. >> FreeBSD is a registered trademark of The FreeBSD Foundation. >> FreeBSD 7.0-CURRENT #0: Sun Apr 22 11:05:32 CEST 2007 >> roberto@vm1.keltia.net:/usr/osrc/sys/i386/compile/VM7 >> Timecounter "i8254" frequency 1193182 Hz quality 0 >> CPU: Intel(R) Core(TM)2 CPU T7600 @ 2.33GHz (1524.50-MHz 686-class >> CPU) >> Origin = "GenuineIntel" Id = 0x6f6 Stepping = 6 >> Features=0xf80b9b9 >> Features2=0x1 >> real memory = 536870912 (512 MB) >> avail memory = 515600384 (491 MB) >> kbd1 at kbdmux0 >> cpu0 on motherboard >> pcib0: pcibus 0 on motherboard >> pir0: on motherboard >> pci0: on pcib0 >> vgapci0: port 0x4000-0x40ff,0x4400-0x441f mem >> 0xc0000000-0xc0ffffff at device 2.0 on pci0 >> pci0: at device 3.0 (no driver attached) >> ed0: port 0x4c00-0x4c1f irq 10 at device 5.0 on pci0 >> ed0: [ITHREAD] >> ed0: using obsoleted if_watchdog interface >> ed0: Ethernet address: 00:ee:42:8a:ed:eb >> uhci0: port >> 0x5000-0x501f irq 11 at device 29.0 on pci0 >> uhci0: [GIANT-LOCKED] >> uhci0: [ITHREAD] >> usb0: on uhci0 >> usb0: USB revision 1.0 >> uhub0: on usb0 >> uhub0: 2 ports with 2 removable, self powered >> ehci0: mem 0xc1000000-0xc10003ff >> irq 9 at device 29.7 on pci0 >> ehci0: [GIANT-LOCKED] >> ehci0: [ITHREAD] >> usb1: EHCI version 1.0 >> usb1: wrong number of companions (0 != 1) >> usb1: on ehci0 >> usb1: USB revision 2.0 >> uhub1: on usb1 >> uhub1: 8 ports with 8 removable, self powered >> agp0: on hostb0 >> isab0: at device 31.0 on pci0 >> isa0: on isab0 >> atapci0: port >> 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x6c00-0x6c0f at device 31.1 on pci0 >> ata0: on atapci0 >> ata0: [ITHREAD] >> ata1: on atapci0 >> ata1: [ITHREAD] >> pci0: at device 31.5 (no driver attached) >> pmtimer0 on isa0 >> orm0: at iomem 0xc0000-0xc9fff pnpid ORM0000 on isa0 >> sc0: at flags 0x100 on isa0 >> sc0: VGA <16 virtual consoles, flags=0x300> >> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 >> atkbdc0: at port 0x60,0x64 on isa0 >> atkbd0: irq 1 on atkbdc0 >> kbd0 at atkbd0 >> atkbd0: [GIANT-LOCKED] >> atkbd0: [ITHREAD] >> psm0: irq 12 on atkbdc0 >> psm0: [GIANT-LOCKED] >> psm0: [ITHREAD] >> psm0: model IntelliMouse Explorer, device ID 4 >> sio0: configured irq 4 not in bitmap of probed irqs 0 >> sio0: port may not be enabled >> sio0: configured irq 4 not in bitmap of probed irqs 0 >> sio0: port may not be enabled >> sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0 >> sio0: type 8250 or not responding >> sio0: [FILTER] >> sio1: configured irq 3 not in bitmap of probed irqs 0 >> sio1: port may not be enabled >> Timecounter "TSC" frequency 1524502532 Hz quality 800 >> Timecounters tick every 1.000 msec >> ad0: 32000MB at ata0-master UDMA100 >> acd0: CDROM at ata0-slave PIO4 >> ad2: 10000MB at ata1-master UDMA100 >> WARNING: ZFS is considered to be an experimental feature in FreeBSD. >> Trying to mount root from ufs:/dev/ad0s1a >> ZFS filesystem version 6 >> ZFS storage pool version 6 >> ----- >> >> VM7 >> ----- >> # >> # VM7 -- Generic kernel configuration file for FreeBSD/i386 >> # >> # $FreeBSD: src/sys/i386/conf/GENERIC,v 1.460 2006/12/13 03:41:47 yongari >> Exp $ >> >> cpu I686_CPU >> ident VM7 >> >> >> makeoptions DEBUG=-g # Build kernel with gdb(1) debug >> symbols >> >> options SCHED_4BSD # 4BSD scheduler >> options PREEMPTION # Enable kernel thread preemption >> options INET # InterNETworking >> options INET6 # IPv6 communications protocols >> options FFS # Berkeley Fast Filesystem >> options SOFTUPDATES # Enable FFS soft updates support >> options UFS_ACL # Support for access control lists >> options UFS_DIRHASH # Improve performance on big >> directories >> options COMPAT_43TTY # BSD 4.3 TTY compat [KEEP THIS!] >> options COMPAT_FREEBSD4 # Compatible with FreeBSD4 >> options COMPAT_FREEBSD5 # Compatible with FreeBSD5 >> options COMPAT_FREEBSD6 # Compatible with FreeBSD6 >> options KTRACE # ktrace(1) support >> options _KPOSIX_PRIORITY_SCHEDULING # POSIX P1003_1B real-time >> extensions >> options KBD_INSTALL_CDEV # install a CDEV entry in /dev >> options ADAPTIVE_GIANT # Giant mutex is adaptive. >> options STOP_NMI # Stop CPUS using NMI instead of IPI >> >> # Debugging for use in -current >> options KDB # Enable kernel debugger support. >> options DDB # Support DDB. >> options INVARIANTS # Enable calls of extra sanity >> checking >> options INVARIANT_SUPPORT # Extra sanity checks of internal >> structures, required by INVARIANTS >> >> # To make an SMP kernel, the next two lines are needed >> options SMP # Symmetric MultiProcessor Kernel >> device apic # I/O APIC >> >> # Bus support. >> device pci >> >> # Floppy drives >> device fdc >> >> # ATA and ATAPI devices >> device ata >> device atadisk # ATA disk drives >> device ataraid # ATA RAID drives >> device atapicd # ATAPI CDROM drives >> options ATA_STATIC_ID # Static device numbering >> >> # SCSI peripherals >> device scbus # SCSI bus (required for SCSI) >> device da # Direct Access (disks) >> device cd # CD >> device pass # Passthrough device (direct SCSI >> access) >> >> # atkbdc0 controls both the keyboard and the PS/2 mouse >> device atkbdc # AT keyboard controller >> device atkbd # AT keyboard >> device psm # PS/2 mouse >> >> device kbdmux # keyboard multiplexer >> >> device vga # VGA video card driver >> >> device splash # Splash screen and screen saver >> support >> >> # syscons is the default console driver, resembling an SCO console >> device sc >> >> device agp # support several AGP chipsets >> >> # Power management support (see NOTES for more options) >> #device apm >> # Add suspend/resume support for the i8254. >> device pmtimer >> >> # Serial (COM) ports >> device sio # 8250, 16[45]50 based serial ports >> device uart # Generic UART driver >> >> # PCI Ethernet NICs. >> device de # DEC/Intel DC21x4x (``Tulip'') >> device em # Intel PRO/1000 adapter Gigabit >> Ethernet Card >> device ixgb # Intel PRO/10GbE Ethernet Card >> device le # AMD Am7900 LANCE and Am79C9xx PCnet >> device txp # 3Com 3cR990 (``Typhoon'') >> device vx # 3Com 3c590, 3c595 (``Vortex'') >> >> # PCI Ethernet NICs that use the common MII bus controller code. >> # NOTE: Be sure to keep the 'device miibus' line in order to use these >> NICs! >> device miibus # MII bus support >> device ed # NE[12]000, SMC Ultra, 3c503, DS8390 >> cards >> >> device loop # Network loopback >> device random # Entropy device >> device ether # Ethernet support >> device tun # Packet tunnel. >> device pty # Pseudo-ttys (telnet etc) >> >> # The `bpf' device enables the Berkeley Packet Filter. >> # Be aware of the administrative consequences of enabling this! >> # Note that 'bpf' is required for DHCP. >> device bpf # Berkeley packet filter >> >> # USB support >> device uhci # UHCI PCI->USB interface >> device ohci # OHCI PCI->USB interface >> device ehci # EHCI PCI->USB interface (USB 2.0) >> device usb # USB Bus (required) >> device ugen # Generic >> device ukbd # Keyboard >> device umass # Disks/Mass storage - Requires scbus >> and da >> device ums # Mouse >> >> # FireWire support >> device firewire # FireWire bus code >> device sbp # SCSI over FireWire (Requires scbus >> and da) >> device fwe # Ethernet over FireWire >> (non-standard!) >> ----- > > _______________________________________________ > freebsd-current@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" > From owner-freebsd-fs@FreeBSD.ORG Sun Apr 22 13:16:56 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id BE99B16A403 for ; Sun, 22 Apr 2007 13:16:56 +0000 (UTC) (envelope-from gergely.czuczy@harmless.hu) Received: from marvin.harmless.hu (marvin.harmless.hu [195.56.55.204]) by mx1.freebsd.org (Postfix) with ESMTP id 7DC0D13C44C for ; Sun, 22 Apr 2007 13:16:56 +0000 (UTC) (envelope-from gergely.czuczy@harmless.hu) Received: from localhost (marvin-mail [192.168.0.2]) by marvin.harmless.hu (Postfix) with ESMTP id A1AC67C0CEC for ; Sun, 22 Apr 2007 14:47:32 +0200 (CEST) X-Virus-Scanned: by amavisd-new-2.4.2 (20060627) (Debian) at harmless.hu Received: from marvin.harmless.hu ([192.168.0.2]) by localhost (marvin.harmless.hu [192.168.0.2]) (amavisd-new, port 10024) with ESMTP id iZP9bpmzBFK3 for ; Sun, 22 Apr 2007 14:47:32 +0200 (CEST) Received: from marvin.harmless.hu (localhost [127.0.0.1]) by marvin.harmless.hu (Postfix) with ESMTP id 678817C0CEB for ; Sun, 22 Apr 2007 14:47:32 +0200 (CEST) Date: Sun, 22 Apr 2007 14:47:32 +0200 From: Gergely CZUCZY To: freebsd-fs@freebsd.org Message-ID: <20070422124731.GA20548@harmless.hu> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=x-unknown; protocol="application/pgp-signature"; boundary="/04w6evG8XlLl3ft" Content-Disposition: inline User-Agent: mutt-ng/devel-r804 (FreeBSD) Subject: distributed filesystems X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Apr 2007 13:16:56 -0000 --/04w6evG8XlLl3ft Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hello I'd like ask for a list of distributed filesystems which are capable of working on a FreeBSD system. So far i had only found OpenAFS, an AndrewFS implementation, but probably a lot more exists out there. So, what distributed filesystems are known to work on FreeBSD? Bye, Gergely Czuczy mailto: gergely.czuczy@harmless.hu --=20 Weenies test. Geniuses solve problems that arise. --/04w6evG8XlLl3ft Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.5 (FreeBSD) owF1ks9rE0EUx2OKRQY89OrpgWAOycRsmkKN1Jr+SIwXhRREPMhk9212yOzMOjOb dAtCPSgKCuJVKF48CiK9iH+BF8GD/gX6Xwj6NrXePA3f9+v7ebx5eX6pUl358v74 Xv35q9dn3lVr43qae68nPBV2JjUPWq2At1trnXW+yjsxxsFq0Fm70o6iThT063fD baM9as/3igy74HHfX86UkPoqhImwDv1G7mO+zk7rdqTLjJNeGt0FqZXU+C+3Z4V2 MVq+q0MTST3pwoPceIx4ZqX2YqyQsRuolGFsWItAySmCcFOIjQVB0nkwMUT0WjnO qRFiqdAVzmPqYJ7IMAFhEUKRLYZR8dzYKTmB0TShbxG3Rjtw0tGEkYFYWJCQiIgq VEFOuY7gVoa61x81QGjW05HFeX8EMs0UprSHKJdrAAFAZs2YnIqSznhIDZnjPvE5 MJT2CVpsMjYyDaIT/r/oJfRUm7kGbxbIJe9f2k3GtgpsMDZAO0Hy2j7Iw4OCpUIq b7owOQk3w0X4Ol0lpcGumeSMcb7RbrE7iFqio+s534QBidyRdEbNcLGCKhl8CSis dET8dHPpbKU8/+nfWakWHytH8LDy+dezn8Pl2/bi46PZ/dr3+qfKmyeHNx8NL127 8OPc4PeH4xdve9+Wv/4B =Ytuj -----END PGP SIGNATURE----- --/04w6evG8XlLl3ft-- From owner-freebsd-fs@FreeBSD.ORG Sun Apr 22 18:53:23 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 11CEB16A401 for ; Sun, 22 Apr 2007 18:53:23 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id F238313C46E for ; Sun, 22 Apr 2007 18:53:22 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from obsecurity.dyndns.org (elvis.mu.org [192.203.228.196]) by elvis.mu.org (Postfix) with ESMTP id D87DD1A4DA9; Sun, 22 Apr 2007 11:53:43 -0700 (PDT) Received: by obsecurity.dyndns.org (Postfix, from userid 1000) id A1BF651464; Sun, 22 Apr 2007 14:53:20 -0400 (EDT) Date: Sun, 22 Apr 2007 14:53:20 -0400 From: Kris Kennaway To: Gergely CZUCZY Message-ID: <20070422185320.GA59168@xor.obsecurity.org> References: <20070422124731.GA20548@harmless.hu> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="GvXjxJ+pjyke8COw" Content-Disposition: inline In-Reply-To: <20070422124731.GA20548@harmless.hu> User-Agent: Mutt/1.4.2.2i Cc: freebsd-fs@freebsd.org Subject: Re: distributed filesystems X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Apr 2007 18:53:23 -0000 --GvXjxJ+pjyke8COw Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sun, Apr 22, 2007 at 02:47:32PM +0200, Gergely CZUCZY wrote: > Hello >=20 > I'd like ask for a list of distributed filesystems which are capable > of working on a FreeBSD system. So far i had only found OpenAFS, an > AndrewFS implementation, but probably a lot more exists out there. >=20 > So, what distributed filesystems are known to work on FreeBSD? Please do some research first :) It was discussed here as recently as last week. Kris --GvXjxJ+pjyke8COw Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.7 (FreeBSD) iD8DBQFGK68gWry0BWjoQKURArvnAJ9/67NhVGXeDDrT+q2gOXbuA7rjwwCgrKZD GVxm8OqJEBXm9AJZLQLfv6c= =MH1A -----END PGP SIGNATURE----- --GvXjxJ+pjyke8COw-- From owner-freebsd-fs@FreeBSD.ORG Sun Apr 22 19:46:02 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id B04FD16A401; Sun, 22 Apr 2007 19:46:02 +0000 (UTC) (envelope-from peter.schuller@infidyne.com) Received: from mxfep01.bredband.com (mxfep01.bredband.com [195.54.107.70]) by mx1.freebsd.org (Postfix) with ESMTP id 96DBD13C465; Sun, 22 Apr 2007 19:46:01 +0000 (UTC) (envelope-from peter.schuller@infidyne.com) Received: from ironport2.bredband.com ([195.54.107.84] [195.54.107.84]) by mxfep01.bredband.com with ESMTP id <20070422191039.YVZS28445.mxfep01.bredband.com@ironport2.bredband.com>; Sun, 22 Apr 2007 21:10:39 +0200 Received: from c-5416e555.03-51-73746f3.cust.bredbandsbolaget.se (HELO scode.mine.nu) ([85.229.22.84]) by ironport2.bredband.com with ESMTP; 22 Apr 2007 21:10:39 +0200 Received: from [127.0.0.1] (localhost [127.0.0.1]) by scode.mine.nu (Postfix) with ESMTP id 752A8192; Sun, 22 Apr 2007 23:10:38 +0200 (CEST) Message-ID: <462BCF46.6030704@infidyne.com> Date: Sun, 22 Apr 2007 23:10:30 +0200 From: Peter Schuller User-Agent: Thunderbird 1.5.0.10 (X11/20070417) MIME-Version: 1.0 To: Pawel Jakub Dawidek References: <20070409011723.GB74547@garage.freebsd.pl> <20070409094319.GB76673@garage.freebsd.pl> <46209D21.2010704@FreeBSD.org> <20070414102313.GC10527@garage.freebsd.pl> In-Reply-To: <20070414102313.GC10527@garage.freebsd.pl> X-Enigmail-Version: 0.94.3.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="------------enig69D91C5C4686F069537DB143" Cc: freebsd-fs@FreeBSD.org, freebsd-current@FreeBSD.org, Stefan Esser Subject: Re: ZFS: amd64, devd, root file system. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Apr 2007 19:46:02 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig69D91C5C4686F069537DB143 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable > This is not the first report that it doesn't work as it should. FWIW, I had some trouble converting my root to ZFS too. I had load_zfs=3D"YES" and the appropriate vfs.root.mountfrom option in loader.conf, but the kernel did not know of any available zfs:* devices that were candidates for root mounts (according to the output of "?"). It may just have been a matter of zpool.cache not being up to date with the volume I was trying to use for root; I do not remember whether the version on /boot was recent enough for that. In general it feels a bit unclear what will happen with zpool.cache when having root on ZFS. Is it guaranteed that only userland tools modify or read this file? In my case the devices in the ZFS pool were glabel:ed, so the issue of drives moving about and such should not have affected me (plus at the point where I had this problem I had not yet started shuffling drives). glabel has successfully loaded and tasted all relevant devices prior to ZFS loading, judging by the kernel output (glabel label detection prior to the ZFS pool version output). In this case I ended up just putting /usr on zfs, leaving / on UFS. Doing so was no problem; the only snag was that putting /usr in /etc/fstab would cause some rc script to try to run fsck_zfs. I ended up not even putting in in /etc/fstab, and having /usr be a symlink to the ZFS managed mountpoint (in this case, /zpromusr). > One was > that /boot/defaults/loader.conf wasn't fresh enough, and there were no:= >=20 > zpool_cache_load=3D"YES" > zpool_cache_type=3D"/boot/zfs/zpool.cache" > zpool_cache_name=3D"/boot/zfs/zpool.cache" >=20 > lines at the end. Can you verify you have them? This is confirmed to not be the issue in my case. --=20 / Peter Schuller PGP userID: 0xE9758B7D or 'Peter Schuller ' Key retrieval: Send an E-Mail to getpgpkey@scode.org E-Mail: peter.schuller@infidyne.com Web: http://www.scode.org --------------enig69D91C5C4686F069537DB143 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.7 (FreeBSD) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFGK89ODNor2+l1i30RCMM6AKCC2BWS56NADSVYJedSEAlVtW2//gCgmv27 ZzvGkDgnHjZC0pFZQ7BzpXU= =Ft18 -----END PGP SIGNATURE----- --------------enig69D91C5C4686F069537DB143-- From owner-freebsd-fs@FreeBSD.ORG Sun Apr 22 20:00:16 2007 Return-Path: X-Original-To: freebsd-fs@FreeBSD.org Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 94F8C16A404; Sun, 22 Apr 2007 20:00:16 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.freebsd.org (Postfix) with ESMTP id 3793113C48A; Sun, 22 Apr 2007 20:00:15 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 61FEC45696; Sun, 22 Apr 2007 22:00:13 +0200 (CEST) Received: from localhost (public-gprs38729.centertel.pl [91.94.23.121]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 9674645683; Sun, 22 Apr 2007 21:59:16 +0200 (CEST) Date: Sun, 22 Apr 2007 21:58:18 +0200 From: Pawel Jakub Dawidek To: Peter Schuller Message-ID: <20070422195818.GH52622@garage.freebsd.pl> References: <20070409011723.GB74547@garage.freebsd.pl> <20070409094319.GB76673@garage.freebsd.pl> <46209D21.2010704@FreeBSD.org> <20070414102313.GC10527@garage.freebsd.pl> <462BCF46.6030704@infidyne.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="EemXnrF2ob+xzFeB" Content-Disposition: inline In-Reply-To: <462BCF46.6030704@infidyne.com> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r804 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-2.5 required=3.0 tests=BAYES_00,RCVD_IN_NJABL_DUL autolearn=no version=3.0.4 Cc: freebsd-fs@FreeBSD.org, freebsd-current@FreeBSD.org, Stefan Esser Subject: Re: ZFS: amd64, devd, root file system. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Apr 2007 20:00:16 -0000 --EemXnrF2ob+xzFeB Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sun, Apr 22, 2007 at 11:10:30PM +0200, Peter Schuller wrote: > > This is not the first report that it doesn't work as it should. >=20 > FWIW, I had some trouble converting my root to ZFS too. >=20 > I had load_zfs=3D"YES" and the appropriate vfs.root.mountfrom option in > loader.conf, but the kernel did not know of any available zfs:* devices > that were candidates for root mounts (according to the output of "?"). Try zfs_load=3D"YES". If this is what you had, send me full dmesg. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --EemXnrF2ob+xzFeB Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (FreeBSD) iD8DBQFGK75aForvXbEpPzQRAoWQAKCC9cLwTk3KF4c38/nIfeBgFBFLMQCgtUOW TXk5+EeE+KLitKIYClKES4U= =0r8j -----END PGP SIGNATURE----- --EemXnrF2ob+xzFeB-- From owner-freebsd-fs@FreeBSD.ORG Sun Apr 22 20:05:46 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id AE2BB16A406 for ; Sun, 22 Apr 2007 20:05:46 +0000 (UTC) (envelope-from gergely.czuczy@harmless.hu) Received: from marvin.harmless.hu (marvin.harmless.hu [195.56.55.204]) by mx1.freebsd.org (Postfix) with ESMTP id 69D5A13C4AD for ; Sun, 22 Apr 2007 20:05:46 +0000 (UTC) (envelope-from gergely.czuczy@harmless.hu) Received: from localhost (marvin-mail [192.168.0.2]) by marvin.harmless.hu (Postfix) with ESMTP id 8C1B27C0C9A for ; Sun, 22 Apr 2007 22:05:45 +0200 (CEST) X-Virus-Scanned: by amavisd-new-2.4.2 (20060627) (Debian) at harmless.hu Received: from marvin.harmless.hu ([192.168.0.2]) by localhost (marvin.harmless.hu [192.168.0.2]) (amavisd-new, port 10024) with ESMTP id 9A3Iix7HD2ff for ; Sun, 22 Apr 2007 22:05:45 +0200 (CEST) Received: from marvin.harmless.hu (localhost [127.0.0.1]) by marvin.harmless.hu (Postfix) with ESMTP id 4002B7C0C8A for ; Sun, 22 Apr 2007 22:05:44 +0200 (CEST) Date: Sun, 22 Apr 2007 22:05:44 +0200 From: Gergely CZUCZY To: freebsd-fs@freebsd.org Message-ID: <20070422200544.GA29719@harmless.hu> References: <20070422124731.GA20548@harmless.hu> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=x-unknown; protocol="application/pgp-signature"; boundary="/9DWx/yDrRhgMJTb" Content-Disposition: inline In-Reply-To: <20070422124731.GA20548@harmless.hu> User-Agent: mutt-ng/devel-r804 (FreeBSD) Subject: Re: distributed filesystems X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Apr 2007 20:05:46 -0000 --/9DWx/yDrRhgMJTb Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Thanks for your reply. The most recent mail on distributed filesystems was this: http://lists.freebsd.org/mailman/htdig/freebsd-fs/2006-June/001902.html On the recent archives I have only found ZFS-related stuff, some other things, but absolutely nothing on distributed filesystems on fs@ =46rom a bit of googling, i've figured out that ZFS and AFS are my possible choices, so far. Important to note, that i've only taken a very brief lookaround in this topic yet. Bye, Gergely Czuczy mailto: gergely.czuczy@harmless.hu --=20 Weenies test. Geniuses solve problems that arise. --/9DWx/yDrRhgMJTb Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.5 (FreeBSD) owF9kr9rFUEQx58JNitCgoIiKNMJ5t2P94z5cRKMRhNiY+ETIVZ79+bultztXnbn Xrw0WomFhWghYiD2olj4B4ggdsHKylr/g9TOvRhLq2VmdmY/3+/O85OTnYnp/Y+f Hsw8e/Hm2PuJ3/FMWRPpzCulHSnt9cKw5/UX53uL3qw3O5ThwuUr4Vwac172Vmc+ n10xmlCTN2gqjIDwIQVVIZW+CkkurUNaqin1FsTRvZvKVcYpUkZHoHShNP6rDazU LkXr3dKJGSqdRbBVG8KhV1mlScYFCjHIpd50kBoLjaktWKyKxodBjlAaRxwnPAtK qQowGobKkVVxzVMgVQW6xhGWTmxLB5QrF4mcqIqCoOCLzk8tYuyGvrFZ0I4opQ5y Gqos+FvxUhf0w3DOu11rDNidxbDv51QWQtzRPBGPAKRNcjVCB+uQyxEyS9Ewda2H sLF617NYyJbJUZ2mXXCmRGG43bZUOnNdYGaQsTMFs3OrNuPC/zRxKXXLQizNzllT goRYEZgUMmMyNjrrgrrIJKnKasuthh+gXFLLA5K5rrenRVE2wH/kFPvNv2hUgq4l hFRaH9bLyliSrJBMC4XdwyHj0a1IQXITNb8+QttAbBWmUBizKe1YvNJj37m7Ugk0 SL4QNxrsCrGGNmuVruzUyU4jWvvJRJAdpv1knF7mrSpZsvPzWgjPW+qH4j6iVuw0 oSMf1jioHYdsHSNV1rCO0h1SSqsc+uLptcnjnXZ9j3Z/euKL7bx9XX5/9XLryZlz 0dTXE9uP7+1/m/rR2aN35e6F85c25MHeo+jDwa+fp3dP/QE= =BmON -----END PGP SIGNATURE----- --/9DWx/yDrRhgMJTb-- From owner-freebsd-fs@FreeBSD.ORG Sun Apr 22 20:26:33 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id DC2BC16A402; Sun, 22 Apr 2007 20:26:33 +0000 (UTC) (envelope-from peter.schuller@infidyne.com) Received: from mxfep03.bredband.com (mxfep03.bredband.com [195.54.107.76]) by mx1.freebsd.org (Postfix) with ESMTP id 9D71313C487; Sun, 22 Apr 2007 20:26:32 +0000 (UTC) (envelope-from peter.schuller@infidyne.com) Received: from ironport.bredband.com ([195.54.107.82] [195.54.107.82]) by mxfep03.bredband.com with ESMTP id <20070422202631.ZKDG23113.mxfep03.bredband.com@ironport.bredband.com>; Sun, 22 Apr 2007 22:26:31 +0200 Received: from c-5416e555.03-51-73746f3.cust.bredbandsbolaget.se (HELO scode.mine.nu) ([85.229.22.84]) by ironport.bredband.com with ESMTP; 22 Apr 2007 22:26:31 +0200 Received: from [127.0.0.1] (localhost [127.0.0.1]) by scode.mine.nu (Postfix) with ESMTP id 35047B62; Sun, 22 Apr 2007 22:26:31 +0200 (CEST) Message-ID: <462BC4ED.1050003@infidyne.com> Date: Sun, 22 Apr 2007 22:26:21 +0200 From: Peter Schuller User-Agent: Thunderbird 1.5.0.10 (X11/20070417) MIME-Version: 1.0 To: Pawel Jakub Dawidek References: <20070409011723.GB74547@garage.freebsd.pl> <20070409094319.GB76673@garage.freebsd.pl> <46209D21.2010704@FreeBSD.org> <20070414102313.GC10527@garage.freebsd.pl> <462BCF46.6030704@infidyne.com> <20070422195818.GH52622@garage.freebsd.pl> In-Reply-To: <20070422195818.GH52622@garage.freebsd.pl> X-Enigmail-Version: 0.94.3.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="------------enigF9175E5A8471B5B709A1FA47" Cc: freebsd-fs@FreeBSD.org, Stefan Esser , freebsd-current@FreeBSD.org Subject: Re: ZFS: amd64, devd, root file system. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Apr 2007 20:26:34 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enigF9175E5A8471B5B709A1FA47 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable > Try zfs_load=3D"YES". If this is what you had, send me full dmesg. Sorry, I had zfs_load=3D"YES". Typo on my part. No typo in loader.conf. Do you have any suggestion on how to best grab the dmesg, given that when triggering this the root fs cannot be mounted? Or do you just want a dmesg from my system in general, with a matching loader.conf minus the vfs.root.mountfromt? If the latter, it is available here: http://distfiles.scode.org/mlref/freebsd-dmesg-zfs-glabel-7current.txt In this dmesg the ZFS pool version output preceeds the glabel tasting. I was so sure this was not the case. Either I was misstaken or this was different then for some reason. --=20 / Peter Schuller PGP userID: 0xE9758B7D or 'Peter Schuller ' Key retrieval: Send an E-Mail to getpgpkey@scode.org E-Mail: peter.schuller@infidyne.com Web: http://www.scode.org --------------enigF9175E5A8471B5B709A1FA47 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.7 (FreeBSD) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFGK8T2DNor2+l1i30RCJ6LAJsEJxPCPuN7aTPHLdYB/BJHgyatbACggy3+ dRCQbzqHwv7jBlctHbnmRqk= =cFVm -----END PGP SIGNATURE----- --------------enigF9175E5A8471B5B709A1FA47-- From owner-freebsd-fs@FreeBSD.ORG Sun Apr 22 20:37:00 2007 Return-Path: X-Original-To: freebsd-fs@FreeBSD.org Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 96A7316A401; Sun, 22 Apr 2007 20:37:00 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.freebsd.org (Postfix) with ESMTP id E42B813C468; Sun, 22 Apr 2007 20:36:59 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 5AEC045B26; Sun, 22 Apr 2007 22:36:57 +0200 (CEST) Received: from localhost (public-gprs38729.centertel.pl [91.94.23.121]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id B6E1C45696; Sun, 22 Apr 2007 22:36:37 +0200 (CEST) Date: Sun, 22 Apr 2007 22:35:56 +0200 From: Pawel Jakub Dawidek To: Peter Schuller Message-ID: <20070422203556.GI52622@garage.freebsd.pl> References: <20070409011723.GB74547@garage.freebsd.pl> <20070409094319.GB76673@garage.freebsd.pl> <46209D21.2010704@FreeBSD.org> <20070414102313.GC10527@garage.freebsd.pl> <462BCF46.6030704@infidyne.com> <20070422195818.GH52622@garage.freebsd.pl> <462BC4ED.1050003@infidyne.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="v2/QI0iRXglpx0hK" Content-Disposition: inline In-Reply-To: <462BC4ED.1050003@infidyne.com> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r804 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-2.5 required=3.0 tests=BAYES_00,RCVD_IN_NJABL_DUL autolearn=no version=3.0.4 Cc: freebsd-fs@FreeBSD.org, freebsd-current@FreeBSD.org, Stefan Esser Subject: Re: ZFS: amd64, devd, root file system. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Apr 2007 20:37:00 -0000 --v2/QI0iRXglpx0hK Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sun, Apr 22, 2007 at 10:26:21PM +0200, Peter Schuller wrote: > > Try zfs_load=3D"YES". If this is what you had, send me full dmesg. >=20 > Sorry, I had zfs_load=3D"YES". Typo on my part. No typo in loader.conf. >=20 > Do you have any suggestion on how to best grab the dmesg, given that > when triggering this the root fs cannot be mounted? >=20 > Or do you just want a dmesg from my system in general, with a matching > loader.conf minus the vfs.root.mountfromt? >=20 > If the latter, it is available here: >=20 > http://distfiles.scode.org/mlref/freebsd-dmesg-zfs-glabel-7current.txt >=20 > In this dmesg the ZFS pool version output preceeds the glabel tasting. I > was so sure this was not the case. Either I was misstaken or this was > different then for some reason. And this is the problem... ZFS tries only ones. I'll think it over and see what can be done. Unfortunately ZFS doesn't use GEOM tasting mechanism and I'd prefer not to modify it to do so, because the changes may be huge. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --v2/QI0iRXglpx0hK Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (FreeBSD) iD8DBQFGK8csForvXbEpPzQRAvhTAJ9uNrhniEd8a9VwnlR47ajNGUPtxQCgoqew ZEgi7ef1wMeyh2eAlwOd2Dg= =YA0q -----END PGP SIGNATURE----- --v2/QI0iRXglpx0hK-- From owner-freebsd-fs@FreeBSD.ORG Sun Apr 22 21:20:44 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 34E4016A406 for ; Sun, 22 Apr 2007 21:20:44 +0000 (UTC) (envelope-from SRS0=f5CLJ7=JZ=vvelox.net=v.velox@yourhostingaccount.com) Received: from mailout20.yourhostingaccount.com (mailout20.yourhostingaccount.com [65.254.253.166]) by mx1.freebsd.org (Postfix) with ESMTP id 08F2013C4C2 for ; Sun, 22 Apr 2007 21:20:43 +0000 (UTC) (envelope-from SRS0=f5CLJ7=JZ=vvelox.net=v.velox@yourhostingaccount.com) Received: from mailscan48.yourhostingaccount.com ([10.1.15.48] helo=mailscan48.yourhostingaccount.com) by mailout20.yourhostingaccount.com with esmtp (Exim) id 1HfjF3-0008NU-DF for freebsd-fs@freebsd.org; Sun, 22 Apr 2007 17:05:05 -0400 Received: from authsmtp11.yourhostingaccount.com ([10.1.18.11] ident=exim) by mailscan48.yourhostingaccount.com with spamscanlookuphost (Exim) id 1HfjF3-0005AT-9N for freebsd-fs@freebsd.org; Sun, 22 Apr 2007 17:05:05 -0400 Received: from authsmtp11.yourhostingaccount.com ([10.1.18.11] helo=authsmtp11.yourhostingaccount.com) by mailscan48.yourhostingaccount.com with esmtp (Exim) id 1HfjF2-00059d-40; Sun, 22 Apr 2007 17:05:04 -0400 Received: from cpe-65-185-51-114.columbus.res.rr.com ([65.185.51.114] helo=vixen42) by authsmtp11.yourhostingaccount.com with esmtpa (Exim) id 1HfjF0-00028z-N9; Sun, 22 Apr 2007 17:05:02 -0400 Date: Sun, 22 Apr 2007 17:09:42 -0400 From: Vulpes Velox To: Gergely CZUCZY Message-ID: <20070422170942.4dedf41a@vixen42> In-Reply-To: <20070422124731.GA20548@harmless.hu> References: <20070422124731.GA20548@harmless.hu> X-Mailer: Claws Mail 2.9.0 (GTK+ 2.10.11; i386-portbld-freebsd6.2) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-EN-UserInfo: 0d1ca1697cdb7a831d4877828571b7ab:1570f0de6936c69fef9e164fffc541bc X-EN-AuthUser: vvelox2 Sender: Vulpes Velox X-EN-OrigIP: 65.185.51.114 X-EN-OrigHost: cpe-65-185-51-114.columbus.res.rr.com Cc: freebsd-fs@freebsd.org Subject: Re: distributed filesystems X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Apr 2007 21:20:44 -0000 On Sun, 22 Apr 2007 14:47:32 +0200 Gergely CZUCZY wrote: > Hello > > I'd like ask for a list of distributed filesystems which are capable > of working on a FreeBSD system. So far i had only found OpenAFS, an > AndrewFS implementation, but probably a lot more exists out there. > > So, what distributed filesystems are known to work on FreeBSD? You may find Coda interesting. I am not sure what it's status is currently. From owner-freebsd-fs@FreeBSD.ORG Sun Apr 22 21:21:18 2007 Return-Path: X-Original-To: freebsd-fs@FreeBSD.org Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 794DE16A401 for ; Sun, 22 Apr 2007 21:21:18 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.freebsd.org (Postfix) with ESMTP id 16A0713C483 for ; Sun, 22 Apr 2007 21:21:17 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 76C3E487F4; Sun, 22 Apr 2007 23:21:16 +0200 (CEST) Received: from localhost (public-gprs38729.centertel.pl [91.94.23.121]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 747CC45CD9; Sun, 22 Apr 2007 23:20:58 +0200 (CEST) Date: Sun, 22 Apr 2007 23:20:19 +0200 From: Pawel Jakub Dawidek To: Barry Pederson Message-ID: <20070422212019.GJ52622@garage.freebsd.pl> References: <46205338.3090803@barryp.org> <20070415111955.GB16971@garage.freebsd.pl> <46224706.4010704@barryp.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="JsihDCElWRmQcbOr" Content-Disposition: inline In-Reply-To: <46224706.4010704@barryp.org> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r804 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-2.5 required=3.0 tests=BAYES_00,RCVD_IN_NJABL_DUL autolearn=no version=3.0.4 Cc: freebsd-fs@FreeBSD.org Subject: Re: ZFS raidz device replacement problem X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Apr 2007 21:21:18 -0000 --JsihDCElWRmQcbOr Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sun, Apr 15, 2007 at 10:38:46AM -0500, Barry Pederson wrote: > But the thing that got me going on this was that if you *don't* do the sc= rub after the replace but instead do some other destructive things to one o= f the non-replaced=20 > devices, like: >=20 > dd if=3D/dev/random bs=3D1m count=3D64 oseek=3D1 conv=3Dnotrunc of=3D/tm= p/foo1 >=20 > and *then* do a scrub and then "zpool status -v mypool", you get this rea= lly alarming message mentioning data corruption. >=20 > --------------------- > zpool status -v mypool > pool: mypool > state: ONLINE > status: One or more devices has experienced an error resulting in data > corruption. Applications may be affected. > action: Restore the file in question if possible. Otherwise restore the > entire pool from backup. > see: http://www.sun.com/msg/ZFS-8000-8A > scrub: scrub completed with 184 errors on Sun Apr 15 09:55:43 2007 > config: >=20 > NAME STATE READ WRITE CKSUM > mypool ONLINE 0 0 761 > raidz1 ONLINE 0 0 761 > md0 ONLINE 0 0 0 > md1 ONLINE 0 0 521 > md3 ONLINE 0 0 25 >=20 > errors: Permanent errors have been detected in the following files: >=20 > mypool:<0x100> > mypool:<0x104> > mypool:<0x105> > . > . > --------------------- >=20 > I suppose you have to actually have some files in /mypool for this to sho= w up. >=20 > (are there supposed to be real filenames in the message instead of things= like "<0x100>" ?) I just committed a fix for 'zpool status -v'. It should now show actually file names if corruption is related to file's data. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --JsihDCElWRmQcbOr Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (FreeBSD) iD8DBQFGK9GTForvXbEpPzQRAqbtAJwPywSt9x2fQ4YzCgNoND85ROXRUwCdFtT7 CkdXyprC8PA+aQO/oqE9LRk= =ZxHn -----END PGP SIGNATURE----- --JsihDCElWRmQcbOr-- From owner-freebsd-fs@FreeBSD.ORG Sun Apr 22 22:11:51 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 6D14416A408; Sun, 22 Apr 2007 22:11:51 +0000 (UTC) (envelope-from peter.schuller@infidyne.com) Received: from mxfep04.bredband.com (mxfep04.bredband.com [195.54.107.79]) by mx1.freebsd.org (Postfix) with ESMTP id 4473213C457; Sun, 22 Apr 2007 22:11:49 +0000 (UTC) (envelope-from peter.schuller@infidyne.com) Received: from ironport2.bredband.com ([195.54.107.84] [195.54.107.84]) by mxfep04.bredband.com with ESMTP id <20070422221148.KDE24095.mxfep04.bredband.com@ironport2.bredband.com>; Mon, 23 Apr 2007 00:11:48 +0200 Received: from c-5416e555.03-51-73746f3.cust.bredbandsbolaget.se (HELO scode.mine.nu) ([85.229.22.84]) by ironport2.bredband.com with ESMTP; 23 Apr 2007 00:11:48 +0200 Received: from [127.0.0.1] (localhost [127.0.0.1]) by scode.mine.nu (Postfix) with ESMTP id 17CB2B85; Sun, 22 Apr 2007 23:07:17 +0200 (CEST) Message-ID: <462BCE7D.9060007@infidyne.com> Date: Sun, 22 Apr 2007 23:07:09 +0200 From: Peter Schuller User-Agent: Thunderbird 1.5.0.10 (X11/20070417) MIME-Version: 1.0 To: Pawel Jakub Dawidek References: <20070409011723.GB74547@garage.freebsd.pl> <20070409094319.GB76673@garage.freebsd.pl> <46209D21.2010704@FreeBSD.org> <20070414102313.GC10527@garage.freebsd.pl> <462BCF46.6030704@infidyne.com> <20070422195818.GH52622@garage.freebsd.pl> <462BC4ED.1050003@infidyne.com> <20070422203556.GI52622@garage.freebsd.pl> In-Reply-To: <20070422203556.GI52622@garage.freebsd.pl> X-Enigmail-Version: 0.94.3.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="------------enigE7ECB553BA55985F1496BF82" Cc: freebsd-fs@FreeBSD.org, freebsd-current@FreeBSD.org, Stefan Esser Subject: Re: ZFS: amd64, devd, root file system. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Apr 2007 22:11:51 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enigE7ECB553BA55985F1496BF82 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable > And this is the problem... ZFS tries only ones. I'll think it over and > see what can be done. Unfortunately ZFS doesn't use GEOM tasting > mechanism and I'd prefer not to modify it to do so, because the changes= > may be huge. Ok. Thanks for clarifying. Perhaps not relevant, but FYI I did see zfs "noticing" a new label once, instantly transitioning the device to ONLINE and the pool to state HEALTHY (see PR kern/111967). --=20 / Peter Schuller PGP userID: 0xE9758B7D or 'Peter Schuller ' Key retrieval: Send an E-Mail to getpgpkey@scode.org E-Mail: peter.schuller@infidyne.com Web: http://www.scode.org --------------enigE7ECB553BA55985F1496BF82 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.7 (FreeBSD) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFGK86EDNor2+l1i30RCPr3AJ4u3cC2BJGoA7bnNtpeyFF0uuW2+ACdEppg YQtCBJWF8XL5UhoVbIEyJx8= =8KGc -----END PGP SIGNATURE----- --------------enigE7ECB553BA55985F1496BF82-- From owner-freebsd-fs@FreeBSD.ORG Sun Apr 22 23:26:02 2007 Return-Path: X-Original-To: freebsd-fs@FreeBSD.org Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 9316116A400; Sun, 22 Apr 2007 23:26:02 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.freebsd.org (Postfix) with ESMTP id 3EFF113C44C; Sun, 22 Apr 2007 23:26:01 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 2DFEE487F7; Mon, 23 Apr 2007 01:26:00 +0200 (CEST) Received: from localhost (public-gprs38729.centertel.pl [91.94.23.121]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 60D76456AB; Mon, 23 Apr 2007 01:25:51 +0200 (CEST) Date: Mon, 23 Apr 2007 01:25:14 +0200 From: Pawel Jakub Dawidek To: freebsd-fs@FreeBSD.org Message-ID: <20070422232514.GP52622@garage.freebsd.pl> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="zxEKvxCKojqA/Afl" Content-Disposition: inline X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r804 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-2.5 required=3.0 tests=BAYES_00,RCVD_IN_NJABL_DUL autolearn=no version=3.0.4 Cc: freebsd-current@FreeBSD.org Subject: Wondering what you can do for FreeBSD/ZFS? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Apr 2007 23:26:02 -0000 --zxEKvxCKojqA/Afl Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable You'll find the answer here: http://wiki.freebsd.org/ZFS There is a list of things that we need to work on. Yes, _we_ :) --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --zxEKvxCKojqA/Afl Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (FreeBSD) iD8DBQFGK+7aForvXbEpPzQRAsjWAKD2XHT6LlOrEfgSaz6dFgcSd2EeXwCcDgPS Vx0x/HmWbcV94M6PfjHHhXk= =/0W8 -----END PGP SIGNATURE----- --zxEKvxCKojqA/Afl-- From owner-freebsd-fs@FreeBSD.ORG Sun Apr 22 23:28:23 2007 Return-Path: X-Original-To: fs@freebsd.org Delivered-To: freebsd-fs@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 61B4116A401; Sun, 22 Apr 2007 23:28:23 +0000 (UTC) (envelope-from david.cecil@nokia.com) Received: from mgw-ext12.nokia.com (smtp.nokia.com [131.228.20.171]) by mx1.freebsd.org (Postfix) with ESMTP id A591313C4AD; Sun, 22 Apr 2007 23:28:22 +0000 (UTC) (envelope-from david.cecil@nokia.com) Received: from esebh108.NOE.Nokia.com (esebh108.ntc.nokia.com [172.21.143.145]) by mgw-ext12.nokia.com (Switch-3.2.5/Switch-3.2.5) with ESMTP id l3MNSJrc031951; Mon, 23 Apr 2007 02:28:20 +0300 Received: from siebh102.NOE.Nokia.com ([172.30.195.29]) by esebh108.NOE.Nokia.com with Microsoft SMTPSVC(6.0.3790.1830); Mon, 23 Apr 2007 02:28:19 +0300 Received: from syebe101.NOE.Nokia.com ([172.30.128.65]) by siebh102.NOE.Nokia.com with Microsoft SMTPSVC(6.0.3790.1830); Mon, 23 Apr 2007 07:28:16 +0800 Received: from [172.30.67.89] ([172.30.67.89]) by syebe101.NOE.Nokia.com with Microsoft SMTPSVC(6.0.3790.1830); Mon, 23 Apr 2007 09:28:15 +1000 Message-ID: <462BEF8E.90108@nokia.com> Date: Mon, 23 Apr 2007 09:28:14 +1000 From: David Cecil User-Agent: Thunderbird 1.5.0.9 (Windows/20061207) MIME-Version: 1.0 To: fs@freebsd.org References: <86hcrdlqak.fsf@dwp.des.no> <20070418144103.GB31727@eschew.pusen.org> <20070418155156.GB20441@keira.kiwi-computer.com> <20070418180200.GA32061@eschew.pusen.org> <86odlku5xg.fsf@dwp.des.no> <20070419173316.GA57227@keira.kiwi-computer.com> <4627EC02.8070103@nokia.com> <4627F7BE.5090606@mawer.org> <20070420004131.GA65715@keira.kiwi-computer.com> <46284701.8080107@nokia.com> <20070420151353.GA88152@keira.kiwi-computer.com> In-Reply-To: <20070420151353.GA88152@keira.kiwi-computer.com> X-OriginalArrivalTime: 22 Apr 2007 23:28:15.0189 (UTC) FILETIME=[E698E850:01C78535] X-Nokia-AV: Clean Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: piso@freebsd.org Subject: Re: ZFS + replacing failing hard-drive. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Apr 2007 23:28:23 -0000 Sorry, resending as I forgot to copy the list. Hi Rick, ServerWorks CSB5 and Intel 6300ESB. Those are two that I'm pretty sure I've seen the problem on. There might be others. Thanks, Dave ext Rick C. Petty wrote: > On Fri, Apr 20, 2007 at 02:52:17PM +1000, David Cecil wrote: > >> Just to be clear, I've seen these errors for SATA and PATA drives. >> > > Which controller chipsets? > > -- Rick C. Petty > From owner-freebsd-fs@FreeBSD.ORG Mon Apr 23 10:03:45 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 846F616A402 for ; Mon, 23 Apr 2007 10:03:45 +0000 (UTC) (envelope-from freebsd-fs@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id 3EC4413C459 for ; Mon, 23 Apr 2007 10:03:44 +0000 (UTC) (envelope-from freebsd-fs@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1HfvEs-0002EE-Ns for freebsd-fs@freebsd.org; Mon, 23 Apr 2007 11:53:42 +0200 Received: from lara.cc.fer.hr ([161.53.72.113]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Mon, 23 Apr 2007 11:53:42 +0200 Received: from ivoras by lara.cc.fer.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Mon, 23 Apr 2007 11:53:42 +0200 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-fs@freebsd.org From: Ivan Voras Date: Mon, 23 Apr 2007 11:33:47 +0200 Lines: 43 Message-ID: References: <20070422124731.GA20548@harmless.hu> <20070422200544.GA29719@harmless.hu> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig14823A9E511FF17AEED4C5FA" X-Complaints-To: usenet@sea.gmane.org X-Gmane-NNTP-Posting-Host: lara.cc.fer.hr User-Agent: Thunderbird 1.5.0.10 (X11/20060911) In-Reply-To: <20070422200544.GA29719@harmless.hu> X-Enigmail-Version: 0.94.2.0 Sender: news Subject: Re: distributed filesystems X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 10:03:45 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig14823A9E511FF17AEED4C5FA Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable Gergely CZUCZY wrote: > Thanks for your reply. The most recent mail on distributed filesystems > was this: > http://lists.freebsd.org/mailman/htdig/freebsd-fs/2006-June/001902.html= >=20 > On the recent archives I have only found ZFS-related stuff, some > other things, but absolutely nothing on distributed filesystems > on fs@ >=20 > From a bit of googling, i've figured out that ZFS and AFS are > my possible choices, so far. Important to note, that i've only > taken a very brief lookaround in this topic yet. Googling http://www.google.com/search?q=3Dzfs+distributed+file+system=20 shows that zFS you mention is not the same ZFS the FreeBSD has :) As far as I can tell, Sun's ZFS can not act as a distributed file system = (in concurrent updates scenario). --------------enig14823A9E511FF17AEED4C5FA Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.5 (GNU/Linux) Comment: Using GnuPG with SUSE - http://enigmail.mozdev.org iD8DBQFGLH2CldnAQVacBcgRAkqaAKDLxhmn1iPyIEzMubNksEjNsuSbuwCg4xI7 qdBbSaHWr15eNgh/g/eWi4g= =G8iS -----END PGP SIGNATURE----- --------------enig14823A9E511FF17AEED4C5FA-- From owner-freebsd-fs@FreeBSD.ORG Mon Apr 23 10:07:07 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id F08E616A400 for ; Mon, 23 Apr 2007 10:07:07 +0000 (UTC) (envelope-from gergely.czuczy@harmless.hu) Received: from marvin.harmless.hu (marvin.harmless.hu [195.56.55.204]) by mx1.freebsd.org (Postfix) with ESMTP id 7DB4213C44B for ; Mon, 23 Apr 2007 10:07:07 +0000 (UTC) (envelope-from gergely.czuczy@harmless.hu) Received: from localhost (marvin-mail [192.168.0.2]) by marvin.harmless.hu (Postfix) with ESMTP id 682387C0D13; Mon, 23 Apr 2007 12:07:06 +0200 (CEST) X-Virus-Scanned: by amavisd-new-2.4.2 (20060627) (Debian) at harmless.hu Received: from marvin.harmless.hu ([192.168.0.2]) by localhost (marvin.harmless.hu [192.168.0.2]) (amavisd-new, port 10024) with ESMTP id fxM+IpcbhWpD; Mon, 23 Apr 2007 12:07:06 +0200 (CEST) Received: from marvin.harmless.hu (localhost [127.0.0.1]) by marvin.harmless.hu (Postfix) with ESMTP id 0E2967C0CDF; Mon, 23 Apr 2007 12:07:05 +0200 (CEST) Date: Mon, 23 Apr 2007 12:07:05 +0200 From: Gergely CZUCZY To: Ivan Voras Message-ID: <20070423100705.GA47374@harmless.hu> References: <20070422124731.GA20548@harmless.hu> <20070422200544.GA29719@harmless.hu> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=x-unknown; protocol="application/pgp-signature"; boundary="45Z9DzgjV8m4Oswq" Content-Disposition: inline In-Reply-To: User-Agent: mutt-ng/devel-r804 (FreeBSD) Cc: freebsd-fs@freebsd.org Subject: Re: distributed filesystems X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 10:07:08 -0000 --45Z9DzgjV8m4Oswq Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Apr 23, 2007 at 11:33:47AM +0200, Ivan Voras wrote: > Gergely CZUCZY wrote: > >Thanks for your reply. The most recent mail on distributed filesystems > >was this: > >http://lists.freebsd.org/mailman/htdig/freebsd-fs/2006-June/001902.html > >On the recent archives I have only found ZFS-related stuff, some > >other things, but absolutely nothing on distributed filesystems > >on fs@ > >From a bit of googling, i've figured out that ZFS and AFS are > >my possible choices, so far. Important to note, that i've only > >taken a very brief lookaround in this topic yet. >=20 > Googling http://www.google.com/search?q=3Dzfs+distributed+file+system sho= ws that zFS you mention is not the same ZFS the FreeBSD has :) >=20 > As far as I can tell, Sun's ZFS can not act as a distributed file system = (in concurrent updates scenario). sorry, it was a typo, I was a bit tired. probably because i've only seen ZF= S-related entries in the recent fs@ archives. I wanted to say CODA and AFS. since then i've seen that AFS's (openafs and arla) has only support for fbsd 5.5, which is bit distressing since 7 is gettin seriously closed to it's release. Bye, Gergely Czuczy mailto: gergely.czuczy@harmless.hu --=20 Weenies test. Geniuses solve problems that arise. --45Z9DzgjV8m4Oswq Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.5 (FreeBSD) owGFVL1vHEUUNw6RYFGKlHSvInG8u3e+c3zkonPiD4yMCEayIWBo5vZmd0fendnM m71j3VBFokAiICgQQvRISBQUERIdBRUVJYh/AYFEzW/2zhckCqq7nY/3fl9vHl25 tLJ69edvv3tn/cNPvnjqm8sfj2+UtXM6i0php0pHG93uRrQ56A82o1tRLxEDkUwG va2tSb+7eRA+PNwz2kntopOmkkNy8j3XqQqh9G1KcmFZulHt0ujF4OLcvuLKsHLK 6CEpXSgtl3snVmhOpY1e0omZKJ0N6UFtnJxElVXaiXEhg+BI0z2jQ9qpLPX6IfW6 3QEJRxsbw35/uDnYuUfrXSyGdDgVmt40VjDNLMoMg216WdpMFg3tnb6xd/r2k/Xt k1zoM6bUWGpMbcnKqmhiOskllYYdvhNApFKogoymiWJn1bgGOEpVIblhJ0v2lWbo 53LFbdncuWrY6RQ4znFqpRzzJDY26/hCpdCd3E1U1lnsRCl3AH0reqXWsgPlb3V7 ce7KwpcCcQc0CyDCJrmaSqZDysVUAhNYpabWEzo9OI6sLITHxq5O05DYlNLXMKhg PTqdcUiAT2LMpgAN3Nam3fgfethN+a7/d2BNSYLGypFJKTMmg5tZSOoa8KQqqy1u G/RwOfwBKhJAt+N/bYumbAhZYAVfkRajEskeKqXCxnRYVsY6AarOeGgynNdpq3u2 voITZ1IDw1TahsZWyZQKY86EbYVQujUCBSqVUCNdHGyPel0fgwVYWvgzm83iloCM E1N2WHp57zwY9ffPU17/lxrrXo31uRzEuRkFM57jOgcvJIdKuINwE/oCdWsZi1K2 /P3HAazePd6Ha0zDtQtAO+xZk/B+JogtDClCOq71NW5v+jVfTiTOHxL/cYgWmEbB ddBOjE5qa31Q6mqCJDAxYiOsMmtxwMbaBj45mrW1XFMZjMviy/vpFLyLqbJmjKmD tDIRNcsn4hNLCH96MAqWWQvQDQ7wXPZlUBGWZVjjIPBdtAcNV1lgEI/2dy5ygW1W OpH+up73atu0+mIfWlw3FWik3F4RthBrrZBzSHXlI+NnOEgxTXQzvhnSLFdJ7t3w vFrVJCIH6+etBn4rk84BNUvoUzNKJYVhMAJG5dAVDKVgCXzBbiPDIFg+I+d1ct4E fpidGaJOuxwn7fJdPIAlZofjvA6CKPJO3wcfrxEccTFeI60gK8wxBch6uQuM2Zww zPItP7hz6fKKf2kvXumrq19/tvLl8z/c/+i33399a/Xh36++/uO7P7323JXzla/e f+HzR88+/uso+eXPp5/Z/fTxtPvH9/8A =ldT9 -----END PGP SIGNATURE----- --45Z9DzgjV8m4Oswq-- From owner-freebsd-fs@FreeBSD.ORG Mon Apr 23 10:56:17 2007 Return-Path: X-Original-To: freebsd-fs@FreeBSD.org Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 5B16816A403 for ; Mon, 23 Apr 2007 10:56:17 +0000 (UTC) (envelope-from staalebk@ifi.uio.no) Received: from smtp.bluecom.no (smtp.bluecom.no [193.75.75.28]) by mx1.freebsd.org (Postfix) with ESMTP id 1C6DD13C46A for ; Mon, 23 Apr 2007 10:56:17 +0000 (UTC) (envelope-from staalebk@ifi.uio.no) Received: from eschew.pusen.org (unknown [193.69.145.10]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (No client certificate requested) by smtp.bluecom.no (Postfix) with ESMTP id CEABB16FC18 for ; Mon, 23 Apr 2007 12:56:15 +0200 (CEST) Received: from chiller by eschew.pusen.org with local (Exim 4.50) id 1HfwDT-00045W-MG for freebsd-fs@FreeBSD.org; Mon, 23 Apr 2007 12:56:19 +0200 Date: Mon, 23 Apr 2007 12:56:19 +0200 From: =?iso-8859-1?Q?St=E5le?= Kristoffersen To: freebsd-fs@FreeBSD.org Message-ID: <20070423105619.GA14400@eschew.pusen.org> References: <46205338.3090803@barryp.org> <20070415111955.GB16971@garage.freebsd.pl> <46224706.4010704@barryp.org> <20070422212019.GJ52622@garage.freebsd.pl> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20070422212019.GJ52622@garage.freebsd.pl> User-Agent: Mutt/1.5.13 (2006-08-11) Cc: Subject: Re: ZFS raidz device replacement problem X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 10:56:17 -0000 On 2007-04-22 at 23:20, Pawel Jakub Dawidek wrote: > I just committed a fix for 'zpool status -v'. It should now show > actually file names if corruption is related to file's data. I tried the fix and it did work. However, when I deleted the file and restored it from backup it still showed that the pool had one error. (Showing only 0x62b as filename again). Shouldn't ZFS automatically clear the error when deleting the file? I tried exporting and importing the pool, didn't change anything, I then ran a scrub and it fixed it: scrub: scrub completed with 0 errors on Mon Apr 23 09:45:36 2007 errors: No known data errors I would have preferred if I didn't have to scrub the pool, would it be hard to fix it on delete? thanks! -- Ståle Kristoffersen staalebk@ifi.uio.no From owner-freebsd-fs@FreeBSD.ORG Mon Apr 23 11:58:35 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id E049016A401 for ; Mon, 23 Apr 2007 11:58:35 +0000 (UTC) (envelope-from gdt@ir.bbn.com) Received: from fnord.ir.bbn.com (fnord.ir.bbn.com [192.1.100.210]) by mx1.freebsd.org (Postfix) with ESMTP id B9ECA13C45A for ; Mon, 23 Apr 2007 11:58:35 +0000 (UTC) (envelope-from gdt@ir.bbn.com) Received: by fnord.ir.bbn.com (Postfix, from userid 10853) id E728252A6; Mon, 23 Apr 2007 07:58:34 -0400 (EDT) From: Greg Troxel To: Gergely CZUCZY References: <20070422124731.GA20548@harmless.hu> X-Hashcash: 1:20:070423:freebsd-fs@freebsd.org::7jTxsP9eG2N6UdBC:0000000000000000000000000000000000000007hjV X-Hashcash: 1:20:070423:phoemix@harmless.hu::7jTxsP9eG2N6UdBC:0000000000000000000000000000000000000000006aty Date: Mon, 23 Apr 2007 07:58:34 -0400 In-Reply-To: <20070422124731.GA20548@harmless.hu> (Gergely CZUCZY's message of "Sun\, 22 Apr 2007 14\:47\:32 +0200") Message-ID: User-Agent: Gnus/5.110006 (No Gnus v0.6) Emacs/21.4 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Cc: freebsd-fs@freebsd.org Subject: Re: distributed filesystems X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 11:58:36 -0000 Coda (http://www.coda.cs.cmu.edu/) works well on NetBSD-current, in which I just fixed the kernel module to conform to updated/simplified vnode locking rules. The nice thing about coda is disconnected operation. Coda used to work fine on FreeBSD (as well as it worked anywhere). So making it work on FreeBSD again may be easy, or it may involved fixing the Freebsd kernel bits. If it needs fixing, it requires minor coda clue, significant vnode clue, and I'll guess 16 hours. There's also arla (afs working client, and server that I'm not sure of the status). From owner-freebsd-fs@FreeBSD.ORG Mon Apr 23 14:02:49 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id CFB5A16A401 for ; Mon, 23 Apr 2007 14:02:49 +0000 (UTC) (envelope-from freebsd-fs@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id 8C30E13C4AD for ; Mon, 23 Apr 2007 14:02:49 +0000 (UTC) (envelope-from freebsd-fs@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1Hfz7a-0007OK-6d for freebsd-fs@freebsd.org; Mon, 23 Apr 2007 16:02:26 +0200 Received: from lara.cc.fer.hr ([161.53.72.113]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Mon, 23 Apr 2007 16:02:26 +0200 Received: from ivoras by lara.cc.fer.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Mon, 23 Apr 2007 16:02:26 +0200 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-fs@freebsd.org From: Ivan Voras Date: Mon, 23 Apr 2007 16:02:04 +0200 Lines: 26 Message-ID: Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig17300EEF5923A8A72EE03D95" X-Complaints-To: usenet@sea.gmane.org X-Gmane-NNTP-Posting-Host: lara.cc.fer.hr User-Agent: Thunderbird 1.5.0.10 (X11/20060911) X-Enigmail-Version: 0.94.2.0 Sender: news Subject: The root file system? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 14:02:49 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig17300EEF5923A8A72EE03D95 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable Since SoftUpdates were introduced, the default file system variation for = the root file system has been the "default" UFS (noasync). My question=20 is: is this still valid? How about using SoftUpdates or Gjournal on /? --------------enig17300EEF5923A8A72EE03D95 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.5 (GNU/Linux) Comment: Using GnuPG with SUSE - http://enigmail.mozdev.org iD8DBQFGLLxmldnAQVacBcgRArveAKCCu8d5BYCKDZ/Y5Z0ffycR0fUCQwCgwkaV 8RG0zze4ijazCATE6ruGn64= =xJFc -----END PGP SIGNATURE----- --------------enig17300EEF5923A8A72EE03D95-- From owner-freebsd-fs@FreeBSD.ORG Mon Apr 23 14:05:50 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id C4C2616A401 for ; Mon, 23 Apr 2007 14:05:50 +0000 (UTC) (envelope-from gdt@ir.bbn.com) Received: from fnord.ir.bbn.com (fnord.ir.bbn.com [192.1.100.210]) by mx1.freebsd.org (Postfix) with ESMTP id 7095313C45D for ; Mon, 23 Apr 2007 14:05:50 +0000 (UTC) (envelope-from gdt@ir.bbn.com) Received: by fnord.ir.bbn.com (Postfix, from userid 10853) id B41BB52A6; Mon, 23 Apr 2007 10:05:49 -0400 (EDT) X-Hashcash: 1:20:070423:freebsd-fs@freebsd.org::fXGqZlVS0uAtiopt:00000000000000000000000000000000000000017RE From: Greg Troxel To: Eric Anderson References: <20070422124731.GA20548@harmless.hu> <462CAE66.3050001@freebsd.org> X-Hashcash: 1:20:070423:anderson@freebsd.org::NVtB9VvwpJ7/m1AU:000000000000000000000000000000000000000001D2B Date: Mon, 23 Apr 2007 10:05:49 -0400 In-Reply-To: <462CAE66.3050001@freebsd.org> (Eric Anderson's message of "Mon\, 23 Apr 2007 08\:02\:30 -0500") Message-ID: User-Agent: Gnus/5.110006 (No Gnus v0.6) Emacs/21.4 (berkeley-unix) MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="=-=-=" Cc: freebsd-fs@freebsd.org Subject: Re: distributed filesystems X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 14:05:50 -0000 --=-=-= [question about how to proceed] I'm answering on-list because I suspect this may be of broader interest. There is the kernel portion, and the userland code. You should build userland coda from coda's cvs (see attached scripts for NetBSD). This is lwp, rpc2, and rvm, and then coda itself (to get venus, the userland client-side cache manager). You'll want to join the coda mailing list and look at the web site and wiki. You just need a machine to run the client on. The server doesn't need kernel support and will be easier to re-port if necessary, but it's harder to set up from a coda point of view. There is a test server at CMU you can use your client with. In debugging the kernel code you are going to have crashes, so it's best if you can have a separate box (doesn't need to be fast) and even better if you can run kgdb. The NetBSD version is also old, with some recent updates. I think that NetBSD and FreeBSD have diverged in terms of vnode protocol, especially in foo_lookup, which is one of the harder routines. There is also the "realms support" issue. Coda uses a new venus/kernel protocol (version 3) that supports muliple coda realms (administrative domains). FreeBSD should be updated to that if it isn't already; the version 2 pre-realms version is now crufty and all coda people are using realms-capable venii. Big issues that I think you'll run into when porting the NetBSD version to FreeBSD are: vnode locking rules are different. NetBSD's rules have been regularized, with lookup taking a locked dvp and returning a locked vpp, leaving dvp locked, and fairly consistent vput for leaf operations. NetBSD has UVM, and so the interface to getpages/putpages is probably different. Coda passes a file by dev/ino into the kernel and then vnode ops on the coda vnode get forwarded to the (ffs) container file. This is tricky for handling page faults for executing a program, as the vnode isn't open. I am on the verge of doing a KNF reformat of the NetBSD code; it's quite clear that there's no upstream to merge from. I'm not aware of anyone in OpenBSD or Dragonfly hacking on coda either. So if you want to start from the NetSBD version I should probably do that. I suspect it would be ok to have things ifdef'd for FreeBSD so we could have one source file - if you want to try that path I can inquire within NetBSD about how that's handled. My guess is that aside from locking rule differences and getpages/putpages that the code will be very similar. Plus, we've gotten rid of some vnodeops, but I suspect they are unimplemented in coda anyway. I don't mean to putting down FreeBSD to be talking more about NetBSD - that's what I've been using lately and working on, and I'm therefore not clear on the current details for FreeBSD, having last run 4.x. I think there's enough common heritage still that my experience can be helpful, and I'd be thrilled if the fixed-up NetBSD bits can be snarfed into FreeBSD - a lot of code goes back and forth and that's a good thing. --=-=-= Content-Type: application/octet-stream Content-Disposition: attachment; filename=coda-build.tgz Content-Transfer-Encoding: base64 H4sIACi6LEYAA+2X227TMBiAe7s8xU9BHbvIwW2TShsbDAbTpAoqtl4xkFLHaa0mcXCcbrw9tntY CozuIuvG8HeT2L9Pjfv5MCppEtkF5jQXReN+8Lyu1/N9+Wz7qKuenuf3Ovq5oIFkmaAd+H4QyHyE /AA1/HsazxplIUIO0BhH4q/lKN/GaLbOqDr/Lp4QPGWlsMMkqa8PD3m/zT/qdlfz30FoNf/dnqfm vxuoeH1DuJ27zn9ZEH5fgjwgz5+5I5q5xcSKGQcKNIPkKgee4zbwWQqYReEBRMwCCY3hC9gRvKDw 9QDEhGTWDsETBs3h4OT44uzjqQw1odWCl1iXkm94VoD9HcpcVbQHe7ohkhTE2tGhCPZz+WlnhO+H Gct+pKws3qheHVw4OC0dEpX7rsqwC47leGS7uo2YWhHLiEWuqQDPeugP+Y+y7r9O1eq+YpP/Unrp P/J7XqB2Cu2/p9aBeofxZ4z/d/V/bvrb4Vn/pGL6pYzc2K5SjjtiTBSCh7lTTJa5PAU7ls1lMR07 OJQ7zTLSP/nQPz49P2zafbcsuJtPx25CR2B/riab8G4wWBY8W0VohpMyIk3Z67ztkhOw7ZyTmF4f 6mIJw2GiV5Blj+M0nMpSU8AJCTOVW81stVYpmsl/R5LszVca9TOXzVSaoCQT9qIkzJcye1Xxsa9O 6/5HrMyjUJB6+9jkP/LlWbCHup1Ou+N7aOG/2f+3wY3/UlUbw66gKVEyVU6CcAR6f3/v9D+dQvuo hZQBjkuuc1YQe/6XgVfVQqsa5xfHF8NzaO1aj9eB/5lf/dfpmvvY5L8X9Cr+6/N/RyaN/1vgNv+X J0Fpst7xtdUL943LT4d1/9dW9Nr62OR/G6nzv4eCtvQ/0Pu/7/nI+L8FpP/qjKzXACIv6LFlPQdO UjYjkNCMFBBzlqq7Piz2+YSNZTIUcEXkvSDblS9hJkAwGWFTCIVlud8uX4Mbyae64i9u9zBU9Wk2 XgXmDa4FHvpzGAwGg8FgMBgMBoPBYDAYDE+KnylvWNoAKAAA --=-=-=-- From owner-freebsd-fs@FreeBSD.ORG Mon Apr 23 14:23:50 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 64E5016A400 for ; Mon, 23 Apr 2007 14:23:50 +0000 (UTC) (envelope-from rees@citi.umich.edu) Received: from citi.umich.edu (citi.umich.edu [141.211.133.111]) by mx1.freebsd.org (Postfix) with ESMTP id 4900613C457 for ; Mon, 23 Apr 2007 14:23:50 +0000 (UTC) (envelope-from rees@citi.umich.edu) Received: from citi.umich.edu (dumaguete.citi.umich.edu [141.211.133.51]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by citi.umich.edu (Postfix) with ESMTP id 54E1C39793 for ; Mon, 23 Apr 2007 10:23:49 -0400 (EDT) Date: Mon, 23 Apr 2007 09:23:49 -0500 From: Jim Rees To: freebsd-fs@freebsd.org Message-ID: <20070423142349.GA24458@citi.umich.edu> References: <20070422124731.GA20548@harmless.hu> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: Subject: Re: distributed filesystems X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 14:23:50 -0000 Greg Troxel wrote: There's also arla (afs working client, and server that I'm not sure of the status). There are two implementations of afs; arla and openafs. For an afs server you are probably better off with openafs. For client I don't think either one works well on 6.x, although arla is probably closer to working than openafs. If anyone wants to work on the openafs client I will be happy to point you in the right direction, and take care of merging the result in to the openafs cvs. From owner-freebsd-fs@FreeBSD.ORG Mon Apr 23 14:34:45 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 7E3C716A403; Mon, 23 Apr 2007 14:34:45 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from gnome.kiev.sovam.com (gnome.kiev.sovam.com [212.109.32.24]) by mx1.freebsd.org (Postfix) with ESMTP id 121C113C448; Mon, 23 Apr 2007 14:34:44 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from relay02.kiev.sovam.com ([62.64.120.197]) by gnome.kiev.sovam.com with esmtp (Exim 4.60) (envelope-from ) id 1Hfzcp-000BTZ-MD; Mon, 23 Apr 2007 17:34:43 +0300 Received: from [212.82.216.227] (helo=fw.zoral.com.ua) by relay02.kiev.sovam.com with esmtps (TLSv1:AES256-SHA:256) (Exim 4.60) (envelope-from ) id 1Hfydl-0000Qn-P7; Mon, 23 Apr 2007 16:31:40 +0300 Received: from deviant.kiev.zoral.com.ua (root@deviant.kiev.zoral.com.ua [10.1.1.148]) by fw.zoral.com.ua (8.13.4/8.13.4) with ESMTP id l3NDVWDS030224 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Mon, 23 Apr 2007 16:31:32 +0300 (EEST) (envelope-from kostikbel@gmail.com) Received: from deviant.kiev.zoral.com.ua (kostik@localhost [127.0.0.1]) by deviant.kiev.zoral.com.ua (8.14.1/8.14.1) with ESMTP id l3NDVVf2032755; Mon, 23 Apr 2007 16:31:31 +0300 (EEST) (envelope-from kostikbel@gmail.com) Received: (from kostik@localhost) by deviant.kiev.zoral.com.ua (8.14.1/8.14.1/Submit) id l3NDVVFp032754; Mon, 23 Apr 2007 16:31:31 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: deviant.kiev.zoral.com.ua: kostik set sender to kostikbel@gmail.com using -f Date: Mon, 23 Apr 2007 16:31:31 +0300 From: Kostik Belousov To: Maxim Sobolev Message-ID: <20070423133131.GA32370@deviant.kiev.zoral.com.ua> References: <46296E0F.2070202@FreeBSD.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="ew6BAiZeqk4r7MaW" Content-Disposition: inline In-Reply-To: <46296E0F.2070202@FreeBSD.org> User-Agent: Mutt/1.4.2.2i X-Virus-Scanned: ClamAV version 0.88.7, clamav-milter version 0.88.7 on fw.zoral.com.ua X-Virus-Status: Clean X-Spam-Status: No, score=-0.1 required=5.0 tests=ALL_TRUSTED,SPF_NEUTRAL autolearn=failed version=3.1.8 X-Spam-Checker-Version: SpamAssassin 3.1.8 (2007-02-13) on fw.zoral.com.ua X-Scanner-Signature: efe3bc1504fa577d936f03857ce6b673 X-DrWeb-checked: yes X-SpamTest-Envelope-From: kostikbel@gmail.com X-SpamTest-Group-ID: 00000000 X-SpamTest-Info: Profiles 972 [Apr 23 2007] X-SpamTest-Info: helo_type=3 X-SpamTest-Info: {received from trusted relay: not dialup} X-SpamTest-Method: none X-SpamTest-Method: Local Lists X-SpamTest-Rate: 0 X-SpamTest-Status: Not detected X-SpamTest-Status-Extended: not_detected X-SpamTest-Version: SMTP-Filter Version 3.0.0 [0255], KAS30/Release X-Delayed: more then 1h on relay02.kiev.sovam.com Cc: freebsd-fs@freebsd.org, "current@freebsd.org" Subject: Re: Bug in the unmounting code X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 14:34:45 -0000 --ew6BAiZeqk4r7MaW Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Apr 20, 2007 at 06:51:11PM -0700, Maxim Sobolev wrote: > Hi, >=20 > I have noticed that there is a bug in unmounting code which could make > filesystem unmountable when its parent filesystem has been forcefully > unmounted. Following is quick way to reproduce the problem: >=20 > [sobomax@pioneer ~]$ sudo mkdir -p /tmp/1/2 > [sobomax@pioneer ~]$ sudo mkdir /tmp/3 > [sobomax@pioneer ~]$ sudo mount_nullfs /tmp/1 /tmp/3 > [sobomax@pioneer ~]$ sudo mount_nullfs /tmp/1 /tmp/3/2 > [sobomax@pioneer ~]$ sudo umount -f /tmp/3 > [sobomax@pioneer ~]$ sudo mount -v > /tmp/1 on /tmp/3/2 (nullfs, local, fsid 03ff000202000000) > [sobomax@pioneer ~]$ sudo umount 03ff000202000000 > umount: unmount of /tmp/3/2 failed: No such file or directory > umount: retrying using path instead of file system ID > umount: unmount of /tmp/3/2 failed: No such file or directory >=20 > Investigation has revealed that in this case vn_lock() call fails with > ENOENT due to the following piece of code: >=20 > vn_lock() > [...] > if (error =3D=3D 0 && vp->v_iflag & VI_DOOMED && > (flags & LK_RETRY) =3D=3D 0) { > VOP_UNLOCK(vp, 0, td); > error =3D ENOENT; > break; > } > [...] >=20 > Addition of LK_RETRY flag fixed the problem, but my knowledge of VFS is > quite limited so that I would appreciate if somebody could verify that > the fix below won't have any undesirable effects. >=20 > -Maxim >=20 > --- vfs_mount.c 2007/04/21 01:40:53 1.1 > +++ vfs_mount.c 2007/04/21 01:41:09 > @@ -1155,7 +1155,7 @@ > mnt_gen_r =3D mp->mnt_gen; > VI_LOCK(coveredvp); > vholdl(coveredvp); > - error =3D vn_lock(coveredvp, LK_EXCLUSIVE | LK_INTERLOCK,= td); > + error =3D vn_lock(coveredvp, LK_EXCLUSIVE | LK_INTERLOCK | > LK_RETRY, td); > vdrop(coveredvp); > /* > * Check for mp being unmounted while waiting for the Thank you for tracking this. The regression was introduced by me in rev. 1.= 232. There is no need to check for error after vn_lock(LK_RETRY). --ew6BAiZeqk4r7MaW Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.7 (FreeBSD) iD8DBQFGLLUyC3+MBN1Mb4gRAigiAJ4ovfbYuVXBz7wvEbaSxukjE+NT8wCeIqsn 51dI3qp7BJEh29npBaD9ih0= =825B -----END PGP SIGNATURE----- --ew6BAiZeqk4r7MaW-- From owner-freebsd-fs@FreeBSD.ORG Mon Apr 23 18:18:50 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 4512116A400 for ; Mon, 23 Apr 2007 18:18:50 +0000 (UTC) (envelope-from morganw@chemikals.org) Received: from smtp2.sccoast.net (smtp2.sccoast.net [66.153.203.174]) by mx1.freebsd.org (Postfix) with ESMTP id 230A613C45B for ; Mon, 23 Apr 2007 18:18:49 +0000 (UTC) (envelope-from morganw@chemikals.org) Received: from 31.64-150-133-net.sccoast.net ([64.150.133.31]:62561 helo=volatile.chemikals.org) by smtp2.sccoast.net with esmtp (Exim 4.60) (envelope-from ) id 1Hg37h-0006nn-F2; Mon, 23 Apr 2007 14:18:49 -0400 Received: from localhost (morganw@localhost [127.0.0.1]) by volatile.chemikals.org (8.13.8/8.13.8) with ESMTP id l3NIIk6e001334; Mon, 23 Apr 2007 14:18:47 -0400 (EDT) (envelope-from morganw@chemikals.org) Date: Mon, 23 Apr 2007 14:18:46 -0400 (EDT) From: Wes Morgan To: Kris Kennaway In-Reply-To: <20070422034253.GA88705@xor.obsecurity.org> Message-ID: <20070423141440.I997@volatile.chemikals.org> References: <20070421223552.F969@volatile.chemikals.org> <20070422034253.GA88705@xor.obsecurity.org> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: freebsd-fs@freebsd.org Subject: Re: apparent filesystem-related hangs X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 18:18:50 -0000 On Sat, 21 Apr 2007, Kris Kennaway wrote: > On Sat, Apr 21, 2007 at 10:51:10PM -0400, Wes Morgan wrote: >> I have several filesystems built on top of a gconcat volume consisting of >> 2 300gb and 1 500gb drive. The /usr partition constitutes the bulk of it. >> The volume is sitting around 95% full, and twice I've had the system >> become "hung" in what I believe are filesystem operations. It seems to >> crop up when rtorrent tries to create files that would fill up the system, >> but of course it doesn't actually reserve it until it is used. Any running >> process remains responsive until it needs to access the disk. >> >> The system was running a fairly recent 6.2-stable, March 29, but I've >> since updated to the most recent -stable. >> >> If anyone can give me some pointers as to how to tell exactly where these >> processes are hanging, I can try to reproduce it... But it takes a while >> to fsck the volume so I don't want to have to try too many things. If it's >> not a known problem I can then submit a PR. > > > DEBUG_LOCKS, DEBUG_VFS_LOCKS, INVARIANTS, INVARIANT_SUPPORT, then > 'show lockedvnods' and 'alltrace' from ddb via the serial console when > it hangs. Ok, I was easily able to duplicate this twice. The second time was by accident, and rtorrent held the only locked vnode. Leaving top running in a terminal, I was able to lock up rtorrent and then purposely lock another process that was visible. Both locked in "nbufkv": 1011 morganw 1 -4 0 73440K 20272K nbufkv 0:04 0.20% rtorrent 996 morganw 1 -4 0 7592K 5084K nbufkv 0:00 0.00% pine The full dumps from ddb can be found at http://volatile.chemikals.org/ddb.txt.gz. If there is no additional information that would be useful for a PR, I can go ahead and create one. -- This .signature sanitized for your protection From owner-freebsd-fs@FreeBSD.ORG Mon Apr 23 19:10:03 2007 Return-Path: X-Original-To: freebsd-fs@FreeBSD.org Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 5D05916A402; Mon, 23 Apr 2007 19:10:03 +0000 (UTC) (envelope-from sobomax@FreeBSD.org) Received: from sippysoft.com (gk.360sip.com [72.236.70.226]) by mx1.freebsd.org (Postfix) with ESMTP id 0A37613C458; Mon, 23 Apr 2007 19:10:02 +0000 (UTC) (envelope-from sobomax@FreeBSD.org) Received: from [192.168.1.47] ([204.244.149.125]) (authenticated bits=0) by sippysoft.com (8.13.8/8.13.8) with ESMTP id l3NJ9xfb080910 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Mon, 23 Apr 2007 12:10:00 -0700 (PDT) (envelope-from sobomax@FreeBSD.org) Message-ID: <462D0437.2060902@FreeBSD.org> Date: Mon, 23 Apr 2007 12:08:39 -0700 From: Maxim Sobolev Organization: Sippy Software, Inc. User-Agent: Thunderbird 1.5.0.10 (Windows/20070221) MIME-Version: 1.0 To: Kostik Belousov References: <46296E0F.2070202@FreeBSD.org> <20070423133131.GA32370@deviant.kiev.zoral.com.ua> In-Reply-To: <20070423133131.GA32370@deviant.kiev.zoral.com.ua> Content-Type: text/plain; charset=KOI8-U; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-fs@FreeBSD.org, "current@freebsd.org" Subject: Re: Bug in the unmounting code X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 19:10:03 -0000 Kostik Belousov wrote: > Thank you for tracking this. The regression was introduced by me in rev. 1.232. > There is no need to check for error after vn_lock(LK_RETRY). Could you fix it? -Maxim From owner-freebsd-fs@FreeBSD.ORG Mon Apr 23 19:25:39 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 2C10516A400; Mon, 23 Apr 2007 19:25:39 +0000 (UTC) (envelope-from roberto@keltia.freenix.fr) Received: from keltia.freenix.fr (keltia.freenix.org [82.230.37.243]) by mx1.freebsd.org (Postfix) with ESMTP id D4DC713C459; Mon, 23 Apr 2007 19:25:38 +0000 (UTC) (envelope-from roberto@keltia.freenix.fr) Received: from localhost (localhost [127.0.0.1]) by keltia.freenix.fr (Postfix/TLS) with ESMTP id 968B33B070; Mon, 23 Apr 2007 21:25:37 +0200 (CEST) Received: from keltia.freenix.fr ([127.0.0.1]) by localhost (keltia.freenix.fr [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 79201-20; Mon, 23 Apr 2007 21:25:37 +0200 (CEST) Received: by keltia.freenix.fr (Postfix/TLS, from userid 101) id 1FFC43A95E; Mon, 23 Apr 2007 21:25:37 +0200 (CEST) Date: Mon, 23 Apr 2007 21:25:37 +0200 From: Ollivier Robert To: Robert Watson Message-ID: <20070423192536.GA79784@keltia.freenix.fr> References: <20070422102834.GA39121@keltia.freenix.fr> <462B3E00.1070001@samsco.org> <20070422132607.T9911@fledge.watson.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20070422132607.T9911@fledge.watson.org> X-Operating-System: MacOS X / Macbook Pro - FreeBSD 6.2 / Dell D820 SMP User-Agent: Mutt/1.5.14 (2007-02-12) X-Virus-Scanned: amavisd-new at keltia.freenix.fr Cc: freebsd-fs@freebsd.org, FreeBSD Current Users' list , sos@freebsd.org Subject: Re: ZFS/UMA panic under Parallels X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 19:25:39 -0000 According to Robert Watson: > I saw what sounds like an identical panic in Parallels last week, and sent > a screenshot off to Soren. He asked me to follow up with more specific > version information but I've not yet been able to do that. Note the panic only occurs when two "disks" are involved. I get a few FLUSHCACHE timeouts but only when both disks get the same errors the system panics. (another thing pointing at semaphores I guess). Dunno whether it is specific to VMs, maybe only something that gets triggered more easily there...? -- Ollivier ROBERT -=- FreeBSD: The Power to Serve! -=- roberto@keltia.freenix.fr Darwin sidhe.keltia.net Kernel Version 8.8.2: Thu Sep 28 20:43:26 PDT 2006 i386 From owner-freebsd-fs@FreeBSD.ORG Tue Apr 24 11:42:49 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 93DA516A47E for ; Tue, 24 Apr 2007 11:42:49 +0000 (UTC) (envelope-from des@des.no) Received: from tim.des.no (tim.des.no [194.63.250.121]) by mx1.freebsd.org (Postfix) with ESMTP id 565AE13C455 for ; Tue, 24 Apr 2007 11:42:49 +0000 (UTC) (envelope-from des@des.no) Received: from tim.des.no (localhost [127.0.0.1]) by spam.des.no (Postfix) with ESMTP id 60977209A; Tue, 24 Apr 2007 13:42:44 +0200 (CEST) X-Spam-Tests: AWL X-Spam-Learn: disabled X-Spam-Score: 0.0/3.0 X-Spam-Checker-Version: SpamAssassin 3.1.7 (2006-10-05) on tim.des.no Received: from dwp.des.no (des.no [80.203.243.180]) by smtp.des.no (Postfix) with ESMTP id EB4F5208E; Tue, 24 Apr 2007 13:42:43 +0200 (CEST) Received: by dwp.des.no (Postfix, from userid 1001) id C002F5442; Tue, 24 Apr 2007 13:42:43 +0200 (CEST) From: des@des.no (Dag-Erling =?iso-8859-1?Q?Sm=F8rgrav?=) To: Ivan Voras References: Date: Tue, 24 Apr 2007 13:42:43 +0200 In-Reply-To: (Ivan Voras's message of "Mon, 23 Apr 2007 16:02:04 +0200") Message-ID: <867is2577w.fsf@dwp.des.no> User-Agent: Gnus/5.110006 (No Gnus v0.6) Emacs/21.3 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable Cc: freebsd-fs@freebsd.org Subject: Re: The root file system? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Apr 2007 11:42:49 -0000 Ivan Voras writes: > Since SoftUpdates were introduced, the default file system variation > for the root file system has been the "default" UFS (noasync). The reason for this was that if you the root file system was low on space, the delay between VOP_UNLINK and actual space being reclaimed when running with soft- updates could cause 'make installworld' or 'make installkernel' to fail. When softupdates were first introduced, the default size for the root file system in sysinstall was 32 MB. I don't know if the delete / create race has been fixed, but the default size for the root file system is now 256 MB, and a default installation uses less than a quarter of it. DES --=20 Dag-Erling Sm=F8rgrav - des@des.no From owner-freebsd-fs@FreeBSD.ORG Tue Apr 24 13:28:55 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 615A716A402 for ; Tue, 24 Apr 2007 13:28:55 +0000 (UTC) (envelope-from roberto@keltia.freenix.fr) Received: from keltia.freenix.fr (keltia.freenix.org [82.230.37.243]) by mx1.freebsd.org (Postfix) with ESMTP id 1D8EB13C448 for ; Tue, 24 Apr 2007 13:28:54 +0000 (UTC) (envelope-from roberto@keltia.freenix.fr) Received: from localhost (localhost [127.0.0.1]) by keltia.freenix.fr (Postfix/TLS) with ESMTP id 9005C393BC for ; Tue, 24 Apr 2007 15:28:53 +0200 (CEST) Received: from keltia.freenix.fr ([127.0.0.1]) by localhost (keltia.freenix.fr [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 03576-16 for ; Tue, 24 Apr 2007 15:28:53 +0200 (CEST) Received: by keltia.freenix.fr (Postfix/TLS, from userid 101) id 3BB36393B4; Tue, 24 Apr 2007 15:28:53 +0200 (CEST) Date: Tue, 24 Apr 2007 15:28:53 +0200 From: Ollivier Robert To: freebsd-fs@freebsd.org Message-ID: <20070424132853.GA67612@keltia.freenix.fr> References: <867is2577w.fsf@dwp.des.no> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-15 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <867is2577w.fsf@dwp.des.no> X-Operating-System: MacOS X / Macbook Pro - FreeBSD 6.2 / Dell D820 SMP User-Agent: Mutt/1.5.14 (2007-02-12) X-Virus-Scanned: amavisd-new at keltia.freenix.fr Subject: Re: The root file system? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Apr 2007 13:28:55 -0000 According to Dag-Erling Smørgrav: > I don't know if the delete / create race has been fixed, but the IIRC yes, it has been fixed a while ago when CURENT was 6.x. -- Ollivier ROBERT -=- FreeBSD: The Power to Serve! -=- roberto@keltia.freenix.fr Darwin sidhe.keltia.net Kernel Version 8.8.2: Thu Sep 28 20:43:26 PDT 2006 i386 From owner-freebsd-fs@FreeBSD.ORG Tue Apr 24 17:33:42 2007 Return-Path: X-Original-To: freebsd-fs@FreeBSD.org Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 7EBA316A404; Tue, 24 Apr 2007 17:33:42 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.freebsd.org (Postfix) with ESMTP id C7A7513C4BB; Tue, 24 Apr 2007 17:33:39 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 9F3EA45CD9; Tue, 24 Apr 2007 19:33:35 +0200 (CEST) Received: from localhost (pjd.wheel.pl [10.0.1.1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id BCE9D45685; Tue, 24 Apr 2007 19:33:22 +0200 (CEST) Date: Tue, 24 Apr 2007 19:33:03 +0200 From: Pawel Jakub Dawidek To: freebsd-fs@FreeBSD.org Message-ID: <20070424173302.GI28017@garage.freebsd.pl> References: <20070422232514.GP52622@garage.freebsd.pl> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="h22Fi9ANawrtbNPX" Content-Disposition: inline In-Reply-To: <20070422232514.GP52622@garage.freebsd.pl> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r804 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-5.9 required=3.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-current@FreeBSD.org Subject: Re: Wondering what you can do for FreeBSD/ZFS? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Apr 2007 17:33:42 -0000 --h22Fi9ANawrtbNPX Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Apr 23, 2007 at 01:25:14AM +0200, Pawel Jakub Dawidek wrote: > You'll find the answer here: >=20 > http://wiki.freebsd.org/ZFS >=20 > There is a list of things that we need to work on. Yes, _we_ :) I just committed fixed for 'slow mmap' and 'FreeBSD namecache' tasks. These were very important ones, but there are other waiting for takers! If you are testing ZFS, please update and report all problems you find. Those changes worked fine for me, but they weren't trivial and they might be some negative consequences. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --h22Fi9ANawrtbNPX Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (FreeBSD) iD8DBQFGLj9OForvXbEpPzQRAilnAKDvEleehUHxu9oQ5OL3oNmZmJJvfwCg6/NA x49ZcztZZk2OHfOgPvTmUNE= =Ad8x -----END PGP SIGNATURE----- --h22Fi9ANawrtbNPX-- From owner-freebsd-fs@FreeBSD.ORG Tue Apr 24 22:14:57 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id A3F0116A401 for ; Tue, 24 Apr 2007 22:14:57 +0000 (UTC) (envelope-from Thomas.Sparrevohn@btinternet.com) Received: from smtp806.mail.ird.yahoo.com (smtp806.mail.ird.yahoo.com [217.146.188.66]) by mx1.freebsd.org (Postfix) with SMTP id 18E5B13C45E for ; Tue, 24 Apr 2007 22:14:56 +0000 (UTC) (envelope-from Thomas.Sparrevohn@btinternet.com) Received: (qmail 11106 invoked from network); 24 Apr 2007 21:48:15 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=btinternet.com; h=Received:X-YMail-OSG:From:To:Subject:Date:User-Agent:Cc:References:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding:Content-Disposition:Message-Id; b=Z7h7Vf1b5W/sKoDRMG4kdMyadcr7Mqt95EMCJixrtgqeZwD5fwlXQ3GQmNu5D/h2zfRpIv/CABmndEx1aQal61kb5CfqLblizYJV9KZiTkS+gUxNqn4+seZe8iXLwVQFpsmEEj742xENA4NB6NpSkez0cQ7d7i+yTQxEVTcZNKI= ; Received: from unknown (HELO w2fzz0vc03.aah-go-on.com) (thomas.sparrevohn@btinternet.com@86.134.25.153 with login) by smtp806.mail.ird.yahoo.com with SMTP; 24 Apr 2007 21:48:15 -0000 X-YMail-OSG: zU.O0coVM1lm8Z92bX4MEKm2wX0EcV2d8xRhwKSAt4TfttWOVLE9RTo.Aha35faOB.39I.vc.G69wIe4OElLjHs3TbTzeSTSaX3oM5DKn6jkk83J.ykhheBy6eppHVTDjymgXcTFyMc8cg-- From: Thomas Sparrevohn To: freebsd-current@freebsd.org Date: Tue, 24 Apr 2007 22:48:14 +0100 User-Agent: KMail/1.9.6 References: <20070422232514.GP52622@garage.freebsd.pl> <20070424173302.GI28017@garage.freebsd.pl> In-Reply-To: <20070424173302.GI28017@garage.freebsd.pl> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200704242248.14636.Thomas.Sparrevohn@btinternet.com> Cc: freebsd-fs@freebsd.org, Pawel Jakub Dawidek Subject: Re: Wondering what you can do for FreeBSD/ZFS? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Apr 2007 22:14:57 -0000 On Tuesday 24 April 2007 18:33:03 Pawel Jakub Dawidek wrote: > On Mon, Apr 23, 2007 at 01:25:14AM +0200, Pawel Jakub Dawidek wrote: > > You'll find the answer here: > > > > http://wiki.freebsd.org/ZFS > > > > There is a list of things that we need to work on. Yes, _we_ :) > > I just committed fixed for 'slow mmap' and 'FreeBSD namecache' tasks. > These were very important ones, but there are other waiting for takers! > > If you are testing ZFS, please update and report all problems you find. > Those changes worked fine for me, but they weren't trivial and they > might be some negative consequences. > I don't know that its related to the recent changes but there is a corruption to the geom label - I don't know that it is related to the ZFS recont changes just seems likely ;-) - The detach happend automatically hub2: at uhub1 port 2 (addr 2) disconnected umass0: at uhub2 port 6 (addr 3) disconnected (pass0:umass-sim0:0:0:0): lost device (pass0:umass-sim0:0:0:0): removing device entry (da0:umasGsE-OsMi_mL0A:B0E:L0:: 0L)a:b ello stm sddeovsifcse/U SB( dDaO0N:GuLmEa srse-msoivme0d:.0: 0:0): removing device entry umass0: detached uhub2: detached umass0: on uhub0 umass0:0:0:-1: Attached to scbus0 pass0 at umass-sim0 bus 0 target 0 lun 0 pass0: Removable Direct Access SCSI-2 device pass0: Serial Number [ pass0: 1.000MB/s transfers GEOM: new disk da0 da0 at umass-sim0 bus 0 target 0 lun 0 da0: Removable Direct Access SCSI-2 device da0: Serial Number [ da0: 1.000MB/s transfers da0: 61MB (125952 512 byte sectors: 64H 32S/T 61C) GEOM_LABEL: Label for provider da0s1 is msdosfs/USB DONGLE. GEOM_LABEL: Label msdosfs/USB DONGLE removed. From owner-freebsd-fs@FreeBSD.ORG Wed Apr 25 04:05:47 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 4B95B16A407 for ; Wed, 25 Apr 2007 04:05:47 +0000 (UTC) (envelope-from info@rsync.net) Received: from mail.rsync.net (mail.rsync.net [69.43.165.11]) by mx1.freebsd.org (Postfix) with ESMTP id 3015613C4AE for ; Wed, 25 Apr 2007 04:05:47 +0000 (UTC) (envelope-from info@rsync.net) Received: from mail.rsync.net (mail.rsync.net [69.43.165.11]) by mail.rsync.net (8.12.11/8.12.11) with ESMTP id l3P3sD8G080052; Tue, 24 Apr 2007 20:54:13 -0700 (PDT) (envelope-from info@rsync.net) Received: from localhost (info@localhost) by mail.rsync.net (8.12.11/8.12.11/Submit) with ESMTP id l3P3sDvq080049; Tue, 24 Apr 2007 20:54:13 -0700 (PDT) (envelope-from info@rsync.net) X-Authentication-Warning: mail.rsync.net: info owned process doing -bs Date: Tue, 24 Apr 2007 20:54:13 -0700 (PDT) From: "rsync.net" To: freebsd-fs@freebsd.org Message-ID: <20070424204202.I92308@mail.rsync.net> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Cc: freebsd-announce@freebsd.org Subject: FreeBSD UFS2 Problems: Bounty sponsored and formalized by rsync.net X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Apr 2007 04:05:47 -0000 rsync.net is pleased to announce Code Bounties for 2007: http://www.rsync.net/resources/notices/2007cb.html Two of the five bounties are for FreeBSD related projects. Please take note of the "FreeBSD UFS2 problem resolution and standardized UFS2 stress testing" bounty - we encourage you to contribute. We have a nice list of tested and confirmed PRs that we will be submitting in the next few weeks - things related to snapshots, quotas, full disks, and large filesystems. We are excited to put forth funds toward their resolution. In addition, we would like very much for there to be a standardized filesystem stress test that can be run on FreeBSD builds prior to release. This will help the stability of the filesystem greatly, as many of the problems we have found in quotas and snapshots (for instance) have appeared and disappeared several times in both 5.x and 6.x. As always, many thanks to the entire FreeBSD community for all of their work. --rsync.net From owner-freebsd-fs@FreeBSD.ORG Wed Apr 25 08:12:43 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 8DABD16A400 for ; Wed, 25 Apr 2007 08:12:43 +0000 (UTC) (envelope-from kometen@gmail.com) Received: from nz-out-0506.google.com (nz-out-0506.google.com [64.233.162.236]) by mx1.freebsd.org (Postfix) with ESMTP id EEE6713C469 for ; Wed, 25 Apr 2007 08:12:42 +0000 (UTC) (envelope-from kometen@gmail.com) Received: by nz-out-0506.google.com with SMTP id r28so198020nza for ; Wed, 25 Apr 2007 01:12:42 -0700 (PDT) DKIM-Signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=f/WcSTOtn4y4n9pNKB9BGVzPQtsDRkgdjF/z1ecKw/ubfZFslAOPpupzyb8AFIQs62N26x8q5KzIQVdZgY8bIqMmzhLF7R6ol66m0DT2ei327YI6crVcJSZQwieBE5iiA1CJlVZsitDyZTdUAe7VnHJn6hO7upoVbAqklvn+6BE= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=ojsgxzX4rZLMZCNqWl3MEeXPsmJm/UISCX/0NFSpYka6heMugs6ZbPfkTQeNsqkDFZ01VuX3bpWMAMQA8YIEO7ozSDmrdmUD8aM8ioZSiH6plARsJCqY10e6CGpWai5qYeU42gYEjy63OPh8PXbnSr7fLuRSeXqBI33ldAFNB+A= Received: by 10.114.240.1 with SMTP id n1mr125129wah.1177487294979; Wed, 25 Apr 2007 00:48:14 -0700 (PDT) Received: by 10.114.194.12 with HTTP; Wed, 25 Apr 2007 00:48:14 -0700 (PDT) Message-ID: Date: Wed, 25 Apr 2007 09:48:14 +0200 From: "Claus Guttesen" To: "Pawel Jakub Dawidek" In-Reply-To: <20070424173302.GI28017@garage.freebsd.pl> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <20070422232514.GP52622@garage.freebsd.pl> <20070424173302.GI28017@garage.freebsd.pl> Cc: freebsd-fs@freebsd.org, freebsd-current@freebsd.org Subject: Re: Wondering what you can do for FreeBSD/ZFS? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Apr 2007 08:12:43 -0000 > > You'll find the answer here: > > > > http://wiki.freebsd.org/ZFS > > > > There is a list of things that we need to work on. Yes, _we_ :) > > I just committed fixed for 'slow mmap' and 'FreeBSD namecache' tasks. > These were very important ones, but there are other waiting for takers! > > If you are testing ZFS, please update and report all problems you find. > Those changes worked fine for me, but they weren't trivial and they > might be some negative consequences. Hi Pawel. I updated last night and the changes you comitted tripled the performance. Yesterday a rsync of a folder with 22.468 files and folders weighing 22 GB would copy at approx. 11 MB/s. Now it's 31 MB. Nice work :-) regards Claus From owner-freebsd-fs@FreeBSD.ORG Wed Apr 25 08:21:01 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id ABB3D16A403 for ; Wed, 25 Apr 2007 08:21:01 +0000 (UTC) (envelope-from rwatson@FreeBSD.org) Received: from cyrus.watson.org (cyrus.watson.org [209.31.154.42]) by mx1.freebsd.org (Postfix) with ESMTP id 8270113C480 for ; Wed, 25 Apr 2007 08:21:01 +0000 (UTC) (envelope-from rwatson@FreeBSD.org) Received: from fledge.watson.org (fledge.watson.org [209.31.154.41]) by cyrus.watson.org (Postfix) with ESMTP id D465E46FFB; Wed, 25 Apr 2007 04:21:00 -0400 (EDT) Date: Wed, 25 Apr 2007 09:21:00 +0100 (BST) From: Robert Watson X-X-Sender: robert@fledge.watson.org To: Gergely CZUCZY In-Reply-To: <20070423100705.GA47374@harmless.hu> Message-ID: <20070425091900.R37507@fledge.watson.org> References: <20070422124731.GA20548@harmless.hu> <20070422200544.GA29719@harmless.hu> <20070423100705.GA47374@harmless.hu> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: freebsd-fs@freebsd.org, Ivan Voras Subject: Re: distributed filesystems X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Apr 2007 08:21:01 -0000 On Mon, 23 Apr 2007, Gergely CZUCZY wrote: > On Mon, Apr 23, 2007 at 11:33:47AM +0200, Ivan Voras wrote: >> Gergely CZUCZY wrote: >>> Thanks for your reply. The most recent mail on distributed filesystems was >>> this: >>> http://lists.freebsd.org/mailman/htdig/freebsd-fs/2006-June/001902.html On >>> the recent archives I have only found ZFS-related stuff, some other >>> things, but absolutely nothing on distributed filesystems on fs@ From a >>> bit of googling, i've figured out that ZFS and AFS are my possible >>> choices, so far. Important to note, that i've only taken a very brief >>> lookaround in this topic yet. 5B>> >> Googling http://www.google.com/search?q=zfs+distributed+file+system shows >> that zFS you mention is not the same ZFS the FreeBSD has :) >> >> As far as I can tell, Sun's ZFS can not act as a distributed file system >> (in concurrent updates scenario). > sorry, it was a typo, I was a bit tired. probably because i've only seen > ZFS-related entries in the recent fs@ archives. > > I wanted to say CODA and AFS. > > since then i've seen that AFS's (openafs and arla) has only support for fbsd > 5.5, which is bit distressing since 7 is gettin seriously closed to it's > release. Arla support is being actively worked out for 7; I hope very much that we will be able to merge the kernel module by the release so that the port can work out of the box, which would also address long-term maintenance issues that have caused Arla to lag significantly behind FreeBSD releases. There's quite a bit more work to do, though. In the list of distributed file systems posted so far, NFS (v2, v3) and CIFS (smbfs + Samba) have both been ignored. FreeBSD also supports the Netware distributed file system (nwfs and Mars). Netware support is currently without a maintainer, so it's not clear to me how well-tested it is in recent releases. Robert N M Watson Computer Laboratory University of Cambridge From owner-freebsd-fs@FreeBSD.ORG Wed Apr 25 08:35:20 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 659D316A400 for ; Wed, 25 Apr 2007 08:35:20 +0000 (UTC) (envelope-from rwatson@FreeBSD.org) Received: from cyrus.watson.org (cyrus.watson.org [209.31.154.42]) by mx1.freebsd.org (Postfix) with ESMTP id 34B0D13C448 for ; Wed, 25 Apr 2007 08:35:20 +0000 (UTC) (envelope-from rwatson@FreeBSD.org) Received: from fledge.watson.org (fledge.watson.org [209.31.154.41]) by cyrus.watson.org (Postfix) with ESMTP id 8A97746EBE; Wed, 25 Apr 2007 04:35:19 -0400 (EDT) Date: Wed, 25 Apr 2007 09:35:19 +0100 (BST) From: Robert Watson X-X-Sender: robert@fledge.watson.org To: Greg Troxel In-Reply-To: Message-ID: <20070425093131.F37507@fledge.watson.org> References: <20070422124731.GA20548@harmless.hu> <462CAE66.3050001@freebsd.org> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: freebsd-fs@freebsd.org Subject: Re: distributed filesystems X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Apr 2007 08:35:20 -0000 On Mon, 23 Apr 2007, Greg Troxel wrote: > Big issues that I think you'll run into when porting the NetBSD version to > FreeBSD are: > > vnode locking rules are different. NetBSD's rules have been > regularized, with lookup taking a locked dvp and returning a locked > vpp, leaving dvp locked, and fairly consistent vput for leaf > operations. > > NetBSD has UVM, and so the interface to getpages/putpages > is probably different. Coda passes a file by dev/ino into the kernel > and then vnode ops on the coda vnode get forwarded to the (ffs) > container file. This is tricky for handling page faults for executing > a program, as the vnode isn't open. And issue three, which can't be ignored: FreeBSD now runs its VFS and some file systems without the Giant lock (MPSAFE). Any significant new file system work for a file system must be done without the Giant lock in order to achieve necessary scalability. Removing the Giant lock from Coda shouldn't be all that hard, since the set of internal data structures is relatively small, but it will need to happen if Coda support is going to remain in the FreeBSD kernel in the long term. Certainly, we wouldn't accept it as a new file system at this point if it required the Giant lock. The Coda module in FreeBSD has been essentially unmaintained for about six to eight years; tjr did some minor maintenance and fixing along the way to keep it working, but it needs a dedicated maintainer to perform code updates, handle locking issues, etc. Robert N M Watson Computer Laboratory University of Cambridge From owner-freebsd-fs@FreeBSD.ORG Wed Apr 25 09:38:13 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 998B816A401; Wed, 25 Apr 2007 09:38:13 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.freebsd.org (Postfix) with ESMTP id 010B113C44C; Wed, 25 Apr 2007 09:38:12 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 5B05C45B26; Wed, 25 Apr 2007 11:38:11 +0200 (CEST) Received: from localhost (pjd.wheel.pl [10.0.1.1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 4918D45683; Wed, 25 Apr 2007 11:38:06 +0200 (CEST) Date: Wed, 25 Apr 2007 11:37:47 +0200 From: Pawel Jakub Dawidek To: Thomas Sparrevohn Message-ID: <20070425093747.GA34663@garage.freebsd.pl> References: <20070422232514.GP52622@garage.freebsd.pl> <20070424173302.GI28017@garage.freebsd.pl> <200704242248.14636.Thomas.Sparrevohn@btinternet.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="KsGdsel6WgEHnImy" Content-Disposition: inline In-Reply-To: <200704242248.14636.Thomas.Sparrevohn@btinternet.com> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r804 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-5.9 required=3.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-fs@freebsd.org, freebsd-current@freebsd.org Subject: Re: Wondering what you can do for FreeBSD/ZFS? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Apr 2007 09:38:13 -0000 --KsGdsel6WgEHnImy Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Apr 24, 2007 at 10:48:14PM +0100, Thomas Sparrevohn wrote: > On Tuesday 24 April 2007 18:33:03 Pawel Jakub Dawidek wrote: > > On Mon, Apr 23, 2007 at 01:25:14AM +0200, Pawel Jakub Dawidek wrote: > > > You'll find the answer here: > > >=20 > > > http://wiki.freebsd.org/ZFS > > >=20 > > > There is a list of things that we need to work on. Yes, _we_ :) > >=20 > > I just committed fixed for 'slow mmap' and 'FreeBSD namecache' tasks. > > These were very important ones, but there are other waiting for takers! > >=20 > > If you are testing ZFS, please update and report all problems you find. > > Those changes worked fine for me, but they weren't trivial and they > > might be some negative consequences. > >=20 >=20 > I don't know that its related to the recent changes but there is a corrup= tion > to the geom label - I don't know that it is related to the ZFS recont cha= nges=20 > just seems likely ;-) - The detach happend automatically =20 >=20 > hub2: at uhub1 port 2 (addr 2) disconnected > umass0: at uhub2 port 6 (addr 3) disconnected > (pass0:umass-sim0:0:0:0): lost device > (pass0:umass-sim0:0:0:0): removing device entry > (da0:umasGsE-OsMi_mL0A:B0E:L0:: 0L)a:b ello stm sddeovsifcse/U > SB( dDaO0N:GuLmEa srse-msoivme0d:.0: > 0:0): removing device entry > umass0: detached > uhub2: detached >=20 > umass0: on uhub0 > umass0:0:0:-1: Attached to scbus0 > pass0 at umass-sim0 bus 0 target 0 lun 0 > pass0: Removable Direct Access SCSI-2 device > pass0: Serial Number [ > pass0: 1.000MB/s transfers > GEOM: new disk da0 > da0 at umass-sim0 bus 0 target 0 lun 0 > da0: Removable Direct Access SCSI-2 device > da0: Serial Number [ > da0: 1.000MB/s transfers > da0: 61MB (125952 512 byte sectors: 64H 32S/T 61C) > GEOM_LABEL: Label for provider da0s1 is msdosfs/USB DONGLE. > GEOM_LABEL: Label msdosfs/USB DONGLE removed. Where exactly do you see this corruption? --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --KsGdsel6WgEHnImy Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (FreeBSD) iD8DBQFGLyFrForvXbEpPzQRAiL+AJwOY1VIRldJ0vdk/wpL/Nb+PLKz8ACg5afD SvrRDHUYUNG+RjxiRgSBy1w= =wumL -----END PGP SIGNATURE----- --KsGdsel6WgEHnImy-- From owner-freebsd-fs@FreeBSD.ORG Wed Apr 25 10:20:58 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 93A9516A401 for ; Wed, 25 Apr 2007 10:20:58 +0000 (UTC) (envelope-from garyj@jennejohn.org) Received: from mail08b.verio.de (mail08b.verio.de [213.198.55.74]) by mx1.freebsd.org (Postfix) with SMTP id ECE9413C44C for ; Wed, 25 Apr 2007 10:20:57 +0000 (UTC) (envelope-from garyj@jennejohn.org) Received: from mx112.stngva01.us.mxservers.net (198.173.112.18) by mail08b.verio.de (RS ver 1.0.95vs) with SMTP id 0-0706646455 for ; Wed, 25 Apr 2007 12:20:56 +0200 (CEST) Received: from mmm808.verio.de [213.198.55.120] (EHLO mmm808.verio.de) by mx112.stngva01.us.mxservers.net (mxl_mta-1.3.8-10p4) with ESMTP id d5a2f264.1553.018.mx112.stngva01.us.mxservers.net; Wed, 25 Apr 2007 06:15:57 -0400 (EDT) Received: (qmail 44918 invoked from network); 25 Apr 2007 10:20:54 -0000 Received: from unknown (HELO peedub.jennejohn.org) (89.59.23.134) by with SMTP; 25 Apr 2007 10:20:54 -0000 Received: from jennejohn.org (localhost [127.0.0.1]) by peedub.jennejohn.org (8.14.1/8.14.1) with ESMTP id l3PAKqsE001445; Wed, 25 Apr 2007 12:20:53 +0200 (CEST) (envelope-from garyj@jennejohn.org) Message-Id: <200704251020.l3PAKqsE001445@peedub.jennejohn.org> X-Mailer: exmh version 2.7.2 01/07/2005 with nmh-1.0.4 To: freebsd-current@FreeBSD.org In-Reply-To: Message from Gary Jennejohn of "Wed, 25 Apr 2007 11:39:29 +0200." Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Wed, 25 Apr 2007 12:20:52 +0200 From: Gary Jennejohn X-Spam: [F=0.5113024962; heur=0.500(-19800); stat=0.501; spamtraq-heur=0.510(2007022501)] X-MAIL-FROM: X-SOURCE-IP: [213.198.55.120] X-SF-Loop: 1 Cc: freebsd-fs@FreeBSD.org, Pawel Jakub Dawidek , Claus Guttesen Subject: Re: Wondering what you can do for FreeBSD/ZFS? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Apr 2007 10:20:58 -0000 Gary Jennejohn writes: > > "Claus Guttesen" writes: > > > > You'll find the answer here: > > > > > > > > http://wiki.freebsd.org/ZFS > > > > > > > > There is a list of things that we need to work on. Yes, _we_ :) > > > > > > I just committed fixed for 'slow mmap' and 'FreeBSD namecache' tasks. > > > These were very important ones, but there are other waiting for takers! > > > > > > If you are testing ZFS, please update and report all problems you find. > > > Those changes worked fine for me, but they weren't trivial and they > > > might be some negative consequences. > > > > Hi Pawel. I updated last night and the changes you comitted tripled > > the performance. Yesterday a rsync of a folder with 22.468 files and > > folders weighing 22 GB would copy at approx. 11 MB/s. Now it's 31 MB. > > > > Nice work :-) > > > > I suddenly see a "kern memmap too small" panic with vfs.zfs.zil_disable="1" > in loader.conf. Haven't tried it yet with the new code and without that > setting. > Looks like my sources weren't quite up-to-date. With sources cvsup'd about an hour ago I see absolutely no problems with zil_disable set to 1. --- Gary Jennejohn / garyjATjennejohnDOTorg gjATfreebsdDOTorg garyjATdenxDOTde From owner-freebsd-fs@FreeBSD.ORG Wed Apr 25 11:33:55 2007 Return-Path: X-Original-To: freebsd-fs@FreeBSD.org Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 3214F16A401 for ; Wed, 25 Apr 2007 11:33:55 +0000 (UTC) (envelope-from oschonef@techfak.uni-bielefeld.de) Received: from smarthost.TechFak.Uni-Bielefeld.DE (smarthost.piip.TechFak.Uni-Bielefeld.DE [129.70.137.17]) by mx1.freebsd.org (Postfix) with ESMTP id EC9C613C45D for ; Wed, 25 Apr 2007 11:33:54 +0000 (UTC) (envelope-from oschonef@techfak.uni-bielefeld.de) Received: from mime.TechFak.Uni-Bielefeld.DE (mime.TechFak.Uni-Bielefeld.DE [129.70.128.67]) by smarthost.TechFak.Uni-Bielefeld.DE (Postfix) with ESMTP id BCCD6484D2; Wed, 25 Apr 2007 13:05:58 +0200 (CEST) Received: (from oschonef@localhost) by mime.TechFak.Uni-Bielefeld.DE (8.11.7+Sun/8.9.1) id l3PB5wx28624; Wed, 25 Apr 2007 13:05:58 +0200 (MEST) From: Date: Wed, 25 Apr 2007 13:05:58 +0200 To: freebsd-fs@FreeBSD.org Message-ID: <20070425110558.GA28614@mime.TechFak.Uni-Bielefeld.DE> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.2i X-Zen: Oooommmmmmmmmmmmmmmmmmmmmmm Cc: oschonef@techfak.uni-bielefeld.de Subject: NanoBSD with ZFS X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Apr 2007 11:33:55 -0000 Hello Pawel, Hello List, first of all kudos to Pawel for Portinmg ZFS to FreeBSD. Thanks a lot :) I'm currently experimenting with NanoBSD and want to integrate ZFS. Unfortunatly ZFS maintains the zpool.cache in /boot/zfs, but the filesystem is mounted read-only and this file cannot be written or changed. Would it be possible to add a tunable or sysctl to ZFS, which allows to specify the location of the zpool.cache file? I could, for example, tell ZFS, it should maintain the file in /etc/zfs (which is writeable in NanoBSD). Surly I have to safe the zpool.cache file to a safe location during shutdown, but this is out of ZFS's scope and can be archived using customized shutdown scripts in NanoBSD. Best Regards, Oliver -- -------------------------------------------------------- And remember: "To Infinity And Far Beyond ... Somehow?!" Hi! I'm a .signature virus! Copy me in your ~/.signature to help me spread! <- Save this lifeform ;-) From owner-freebsd-fs@FreeBSD.ORG Wed Apr 25 12:06:38 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 412C516A414 for ; Wed, 25 Apr 2007 12:06:38 +0000 (UTC) (envelope-from Thomas.Sparrevohn@btinternet.com) Received: from smtp803.mail.ird.yahoo.com (smtp803.mail.ird.yahoo.com [217.146.188.63]) by mx1.freebsd.org (Postfix) with SMTP id 8679313C44C for ; Wed, 25 Apr 2007 12:06:37 +0000 (UTC) (envelope-from Thomas.Sparrevohn@btinternet.com) Received: (qmail 83834 invoked from network); 25 Apr 2007 12:06:35 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=btinternet.com; h=Received:X-YMail-OSG:From:To:Subject:Date:User-Agent:Cc:References:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding:Content-Disposition:Message-Id; b=nBdcvruYVrOsAsClAU8KDlWWdQdAvQqFqlhFGsJNjtOPXAQft3cXrX3f+tNbp0hZYH7E4qkTMs9fnZk4wXwzgupLfEVG/wzZ5kOySK39k1DUnTtf86RKJPqjBM6AkJ7F7xN+SbhHIAGl53zTzFEk600icrklSCy9US97QI+5ZlM= ; Received: from unknown (HELO w2fzz0vc03.aah-go-on.com) (thomas.sparrevohn@btinternet.com@86.134.25.153 with login) by smtp803.mail.ird.yahoo.com with SMTP; 25 Apr 2007 12:06:35 -0000 X-YMail-OSG: yzvW_nEVM1k9MU8jFXcLYveUJckQZr7l.eeOtkSfE3U0q6za From: Thomas Sparrevohn To: Pawel Jakub Dawidek Date: Wed, 25 Apr 2007 13:06:33 +0100 User-Agent: KMail/1.9.6 References: <20070422232514.GP52622@garage.freebsd.pl> <200704242248.14636.Thomas.Sparrevohn@btinternet.com> <20070425093747.GA34663@garage.freebsd.pl> In-Reply-To: <20070425093747.GA34663@garage.freebsd.pl> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200704251306.33497.Thomas.Sparrevohn@btinternet.com> Cc: freebsd-fs@freebsd.org, freebsd-current@freebsd.org Subject: Re: Wondering what you can do for FreeBSD/ZFS? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Apr 2007 12:06:38 -0000 On Wednesday 25 April 2007 10:37:47 Pawel Jakub Dawidek wrote: > (da0:umasGsE-OsMi_mL0A:B0E:L0:: 0L)a:b ello stm sddeovsifcse/U In the label name - After this the only way to fix it is to unplug the device - > (da0:umasGsE-OsMi_mL0A:B0E:L0:: 0L)a:b ello stm sddeovsifcse/U > SB( dDaO0N:GuLmEa srse-msoivme0d:.0: > 0:0): removing device entry Should have read (pass4:umass-sim1:1:0:0): lost device (pass4:umass-sim1:1:0:0): removing device entry (da4:umass-sim1:1:0:0): lost device (da4:umass-sim1:1:0:0): removing device entry GEOM_LABEL: Label msdosfs/USB DONGLE removed. From owner-freebsd-fs@FreeBSD.ORG Wed Apr 25 12:09:53 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 44E1D16A401; Wed, 25 Apr 2007 12:09:53 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.freebsd.org (Postfix) with ESMTP id DAC8213C459; Wed, 25 Apr 2007 12:09:52 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 5CFAE48A27; Wed, 25 Apr 2007 14:09:51 +0200 (CEST) Received: from localhost (pjd.wheel.pl [10.0.1.1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id B622A45B26; Wed, 25 Apr 2007 14:09:42 +0200 (CEST) Date: Wed, 25 Apr 2007 14:09:23 +0200 From: Pawel Jakub Dawidek To: Thomas Sparrevohn Message-ID: <20070425120923.GE34663@garage.freebsd.pl> References: <20070422232514.GP52622@garage.freebsd.pl> <200704242248.14636.Thomas.Sparrevohn@btinternet.com> <20070425093747.GA34663@garage.freebsd.pl> <200704251306.33497.Thomas.Sparrevohn@btinternet.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="pyE8wggRBhVBcj8z" Content-Disposition: inline In-Reply-To: <200704251306.33497.Thomas.Sparrevohn@btinternet.com> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r804 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-5.9 required=3.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-fs@freebsd.org, freebsd-current@freebsd.org Subject: Re: Wondering what you can do for FreeBSD/ZFS? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Apr 2007 12:09:53 -0000 --pyE8wggRBhVBcj8z Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Apr 25, 2007 at 01:06:33PM +0100, Thomas Sparrevohn wrote: > On Wednesday 25 April 2007 10:37:47 Pawel Jakub Dawidek wrote: > > (da0:umasGsE-OsMi_mL0A:B0E:L0:: 0L)a:b ello stm sddeovsifcse/U >=20 > In the label name - After this the only way to fix it is to unplug the de= vice -=20 >=20 > > (da0:umasGsE-OsMi_mL0A:B0E:L0:: 0L)a:b ello stm sddeovsifcse/U > > SB( dDaO0N:GuLmEa srse-msoivme0d:.0: > > 0:0): removing device entry >=20 > Should have read=20 >=20 > (pass4:umass-sim1:1:0:0): lost device > (pass4:umass-sim1:1:0:0): removing device entry > (da4:umass-sim1:1:0:0): lost device > (da4:umass-sim1:1:0:0): removing device entry > GEOM_LABEL: Label msdosfs/USB DONGLE removed. Ok, I still see nothing unusual. What exactly doesn't work? I know two printfs are racing, but from a functional point of view (forget about those printfs), what is corrupted? --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --pyE8wggRBhVBcj8z Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (FreeBSD) iD8DBQFGL0TzForvXbEpPzQRAhOwAKC1X+KwBFk69ulYJXYTnS+L7WnasQCeOYTP PILlWvt2ww5TVOXTv0QFk1A= =wx7r -----END PGP SIGNATURE----- --pyE8wggRBhVBcj8z-- From owner-freebsd-fs@FreeBSD.ORG Wed Apr 25 12:59:33 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 44D7816A402 for ; Wed, 25 Apr 2007 12:59:33 +0000 (UTC) (envelope-from Thomas.Sparrevohn@btinternet.com) Received: from smtp810.mail.ird.yahoo.com (smtp810.mail.ird.yahoo.com [217.146.188.70]) by mx1.freebsd.org (Postfix) with SMTP id A797813C487 for ; Wed, 25 Apr 2007 12:59:32 +0000 (UTC) (envelope-from Thomas.Sparrevohn@btinternet.com) Received: (qmail 74393 invoked from network); 25 Apr 2007 12:59:31 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=btinternet.com; h=Received:X-YMail-OSG:From:To:Subject:Date:User-Agent:Cc:References:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding:Content-Disposition:Message-Id; b=5GB/U5bMGEp2hsXM957t08TGIp1XzhhP4wJLaISj0PFJHzJbQB9o1/JH610csYlB6QJzQvMV+F4QQdpC14sIhfUh11QAcAAFEpgmQSana/2Lvd/b2onaHiOY9g/GtJ8oFt4zgAhhvdojMiVM1G0fgcTmRZQ2m24Xfu6tfQ0zmo0= ; Received: from unknown (HELO w2fzz0vc03.aah-go-on.com) (thomas.sparrevohn@btinternet.com@86.134.25.153 with login) by smtp810.mail.ird.yahoo.com with SMTP; 25 Apr 2007 12:59:31 -0000 X-YMail-OSG: 6zegZx0VM1kUuIoYP_8x7361k0ZsP0Q93nqCmAs0LR1thrZ9u0ErMWB7Ph1qWrkicF6dk8BUiw-- From: Thomas Sparrevohn To: Pawel Jakub Dawidek Date: Wed, 25 Apr 2007 13:59:29 +0100 User-Agent: KMail/1.9.6 References: <20070422232514.GP52622@garage.freebsd.pl> <200704251306.33497.Thomas.Sparrevohn@btinternet.com> <20070425120923.GE34663@garage.freebsd.pl> In-Reply-To: <20070425120923.GE34663@garage.freebsd.pl> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200704251359.29315.Thomas.Sparrevohn@btinternet.com> Cc: freebsd-fs@freebsd.org, freebsd-current@freebsd.org Subject: Re: Wondering what you can do for FreeBSD/ZFS? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Apr 2007 12:59:33 -0000 On Wednesday 25 April 2007 13:09:23 Pawel Jakub Dawidek wrote: > On Wed, Apr 25, 2007 at 01:06:33PM +0100, Thomas Sparrevohn wrote: > > On Wednesday 25 April 2007 10:37:47 Pawel Jakub Dawidek wrote: > > > (da0:umasGsE-OsMi_mL0A:B0E:L0:: 0L)a:b ello stm sddeovsifcse/U > > > > In the label name - After this the only way to fix it is to unplug the device - > > > > > (da0:umasGsE-OsMi_mL0A:B0E:L0:: 0L)a:b ello stm sddeovsifcse/U > > > SB( dDaO0N:GuLmEa srse-msoivme0d:.0: > > > 0:0): removing device entry > > > > Should have read > > > > (pass4:umass-sim1:1:0:0): lost device > > (pass4:umass-sim1:1:0:0): removing device entry > > (da4:umass-sim1:1:0:0): lost device > > (da4:umass-sim1:1:0:0): removing device entry > > GEOM_LABEL: Label msdosfs/USB DONGLE removed. > > Ok, I still see nothing unusual. What exactly doesn't work? I know two > printfs are racing, but from a functional point of view (forget about > those printfs), what is corrupted? > The dongle was still attached and I could no longer mount it - e.g. visible in /dev etc but got a mount error From owner-freebsd-fs@FreeBSD.ORG Wed Apr 25 14:29:50 2007 Return-Path: X-Original-To: freebsd-fs@FreeBSD.org Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id AF0FA16A400 for ; Wed, 25 Apr 2007 14:29:50 +0000 (UTC) (envelope-from bp@barryp.org) Received: from eden.barryp.org (host-42-60-230-24.midco.net [24.230.60.42]) by mx1.freebsd.org (Postfix) with ESMTP id 8D87213C45B for ; Wed, 25 Apr 2007 14:29:50 +0000 (UTC) (envelope-from bp@barryp.org) Received: from geo.med.und.nodak.edu ([134.129.166.11]) by eden.barryp.org with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.63 (FreeBSD)) (envelope-from ) id 1HgiVB-0007kF-MJ for freebsd-fs@FreeBSD.org; Wed, 25 Apr 2007 09:29:49 -0500 Message-ID: <462F65DB.5010305@barryp.org> Date: Wed, 25 Apr 2007 09:29:47 -0500 From: Barry Pederson User-Agent: Thunderbird 1.5.0.10 (X11/20070221) MIME-Version: 1.0 To: freebsd-fs@FreeBSD.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: Subject: ZFS: inherited mountpoints with root filesystem X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Apr 2007 14:29:50 -0000 I've been fooling with using ZFS for the root filesystem, and a CompactFlash device to hold a UFS /boot - It seems to work very well, CF devices are big enough that you can put a pretty full install of FreeBSD on it which is nice for recovery/maintenance work on the real disk. One problem I've noticed though is that there's a difference between the mountpoint of a pool's root filesystem that FreeBSD sees and what ZFS sees. For example, the "mount" command shows" tank on / (zfs, local) but "zfs list" shows: NAME USED AVAIL REFER MOUNTPOINT tank 1.98G 16.4G 16.7M /tank I'm finding that having the "tank" filesystem be "/" and "/tank" simultaneously makes it awkward when creating sub-filesystems, say for example "tank/usr" and "tank/var". Currently, they inherit the "/tank" mountpoint, and show up as "/tank/usr" and "/tank/var" - where I'd like them to inherit "/" and end up as "/usr" and "/var". For now, I've worked around this with symlinks in the "tank" filesystem like: usr -> tank/usr , but the problem is that when mounting the CompactFlash as root and importing "tank", it complains that it can't mount "tank/usr" (because the symlink is in the way). I've also tried explicity setting the mountpoint for "tank/usr" to "/usr", which is fine except again for when the CF is used as root, which would then conflict with the CF filesystem's "/usr" Is this double-mountpoint setup the way things should be? If so, is/can there be an option to have the ZFS-mountpoint for a root-mounted filesystem also be "/", so that inherited mountpoints for sub-filesystems are under "/" instead of "/"? Barry From owner-freebsd-fs@FreeBSD.ORG Wed Apr 25 17:45:40 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 3239016A407 for ; Wed, 25 Apr 2007 17:45:40 +0000 (UTC) (envelope-from garrisot@otc.edu) Received: from mx1.otc.edu (mx1.otc.edu [198.209.160.201]) by mx1.freebsd.org (Postfix) with ESMTP id 0928413C469 for ; Wed, 25 Apr 2007 17:45:39 +0000 (UTC) (envelope-from garrisot@otc.edu) X-ASG-Debug-ID: 1177522368-1f55013f0000-3nHGF7 X-Barracuda-URL: http://198.209.160.201:8000/cgi-bin/mark.cgi X-ASG-Whitelist: Sender Received: from EXM1.otc.edu (exn1.otc.edu [172.16.2.131]) by mx1.otc.edu (Spam Firewall) with ESMTP id EE8D025D6E for ; Wed, 25 Apr 2007 12:32:48 -0500 (CDT) Received: from EXM1.otc.edu (exn1.otc.edu [172.16.2.131]) by mx1.otc.edu with ESMTP id BBlOedaJHErK3XfD for ; Wed, 25 Apr 2007 12:32:48 -0500 (CDT) X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-ASG-Orig-Subj: Single Instance Service Date: Wed, 25 Apr 2007 12:32:48 -0500 Message-ID: <06D1B6D4926222458F803D0D3EDCCB7E01D0A315@EXM1.otc.edu> X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: Single Instance Service Thread-Index: AceG5mZGHQUq9TCmQBG6MFZzlANBJwAeURIg From: "GARRISON, TRAVIS J." To: X-Barracuda-Connect: exn1.otc.edu[172.16.2.131] X-Barracuda-Start-Time: 1177522368 X-Barracuda-Virus-Scanned: by OTC E-Mail System at otc.edu Subject: Single Instance Service X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Apr 2007 17:45:40 -0000 I am looking for software that will run on FreeBSD that is similar to Microsoft Single Instance Service. The Single Instance Storage Filter is a file system filter that manages the duplicate copies of files on hard-disk volumes. This filter copies one instance of the duplicate file into a central folder, and the duplicates are replaced with a link to the central copy to improve disk usage. From owner-freebsd-fs@FreeBSD.ORG Wed Apr 25 21:02:21 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 9A2B916A407; Wed, 25 Apr 2007 21:02:21 +0000 (UTC) (envelope-from gdt@ir.bbn.com) Received: from fnord.ir.bbn.com (fnord.ir.bbn.com [192.1.100.210]) by mx1.freebsd.org (Postfix) with ESMTP id 69B7213C484; Wed, 25 Apr 2007 21:02:21 +0000 (UTC) (envelope-from gdt@ir.bbn.com) Received: by fnord.ir.bbn.com (Postfix, from userid 10853) id 631475289; Wed, 25 Apr 2007 17:02:20 -0400 (EDT) From: Greg Troxel To: Robert Watson References: <20070422124731.GA20548@harmless.hu> <462CAE66.3050001@freebsd.org> <20070425093131.F37507@fledge.watson.org> X-Hashcash: 1:20:070425:freebsd-fs@freebsd.org::4dXYjK6yQ69jY5Zl:0000000000000000000000000000000000000001y6p X-Hashcash: 1:20:070425:anderson@freebsd.org::9mfUlVzeR3Mmq+64:000000000000000000000000000000000000000003PNH X-Hashcash: 1:20:070425:rwatson@freebsd.org::4dXYjK6yQ69jY5Zl:0000000000000000000000000000000000000000008Pgi Date: Wed, 25 Apr 2007 17:02:20 -0400 In-Reply-To: <20070425093131.F37507@fledge.watson.org> (Robert Watson's message of "Wed\, 25 Apr 2007 09\:35\:19 +0100 \(BST\)") Message-ID: User-Agent: Gnus/5.110006 (No Gnus v0.6) Emacs/21.4 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Cc: freebsd-fs@freebsd.org Subject: Re: distributed filesystems X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Apr 2007 21:02:21 -0000 Good point, and I suspect it isn't that hard. NetBSD is also (finally) moving to fine-grained locking. I supsect one could either create a coda lock and always grab that, or to make locks for each data object (the name cache is probably what's needed - everything else is per-vnode and the vnode lock protects most vnode changes). -- Greg Troxel From owner-freebsd-fs@FreeBSD.ORG Wed Apr 25 21:30:49 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 5D4A916A404 for ; Wed, 25 Apr 2007 21:30:49 +0000 (UTC) (envelope-from gwk.rko@googlemail.com) Received: from wr-out-0506.google.com (wr-out-0506.google.com [64.233.184.224]) by mx1.freebsd.org (Postfix) with ESMTP id 1BB6413C45B for ; Wed, 25 Apr 2007 21:30:48 +0000 (UTC) (envelope-from gwk.rko@googlemail.com) Received: by wr-out-0506.google.com with SMTP id 70so365752wra for ; Wed, 25 Apr 2007 14:30:48 -0700 (PDT) DKIM-Signature: a=rsa-sha1; c=relaxed/relaxed; d=googlemail.com; s=beta; h=domainkey-signature:received:received:subject:to:content-type:date:message-id:mime-version:x-mailer:from; b=jmczve4gUHTaJwXxRfwFCU6+Qjxo6T6DUj/JesD47fVBsyMdZbp79aED+25eEwzoiEcrDXhquFeKjJ6u1N/xDEQR510IAnNhC6jGkKf5YnvCXPSsmzSoKwRD9yH8tsDI5V77nLuwziefihxD2z4ks7eAunfnbr7bPULXY4BkUk4= DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=beta; h=received:subject:to:content-type:date:message-id:mime-version:x-mailer:from; b=Y0THGaKIkanIRv7tlRr6pnFNklFmk5iX7+snQfnnATKEnhvw4KOhgAF2s/ns8XpJuq7wp2KxD/CuhtDINvEmbfP2tzvojj7hg2gGORl5xo53JbBR1GFxHnU64hGyVZmCqJgxOdM2rYTNptnjYyMXMg+thtQRNH0zifEI5m1KK4U= Received: by 10.78.48.16 with SMTP id v16mr308196huv.1177534921006; Wed, 25 Apr 2007 14:02:01 -0700 (PDT) Received: from ?192.168.1.100? ( [82.135.80.80]) by mx.google.com with ESMTP id j2sm18901990mue.2007.04.25.14.01.58; Wed, 25 Apr 2007 14:01:59 -0700 (PDT) To: freebsd-fs@freebsd.org Content-Type: multipart/signed; micalg=sha1; protocol="application/x-pkcs7-signature"; boundary="=-K8RFRD7KPmJDTGLIL1Hx" Date: Wed, 25 Apr 2007 23:01:56 +0200 Message-Id: <1177534917.11669.11.camel@localhost> Mime-Version: 1.0 X-Mailer: Evolution 2.10.1 From: "Georg-W. Koltermann" Subject: panic "bundirty" in FreeBSD 7 April snapshot X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Apr 2007 21:30:49 -0000 --=-K8RFRD7KPmJDTGLIL1Hx Content-Type: text/plain Content-Transfer-Encoding: quoted-printable Hi, I recently saw a FreeBSD panic 'bundirty' when playing with zfs. I was using the April FBSD7 ZFS snapshot. pjd@ thinks this is a UFS related panic. Just FYI. -- Regards, Georg. -------- Weitergeleitete Nachricht -------- > Von: Pawel Jakub Dawidek > An: Georg-W. Koltermann > Betreff: Re: [zfs-discuss] Re: zfs performance on fuse (Linux) > compared to other fs > Datum: Tue, 24 Apr 2007 21:46:17 +0200 >=20 > On Tue, Apr 24, 2007 at 09:10:10PM +0200, Georg-W. Koltermann wrote: > > Am Dienstag, den 24.04.2007, 12:03 +0200 schrieb Pawel Jakub Dawidek: > > > On Mon, Apr 23, 2007 at 11:42:41PM -0700, Georg-W. Koltermann wrote: > > > > > > So, at this point in time that seems pretty > > > > > discouraging for an everyday user, on Linux. > > > > >=20 > > > > > nobody told, that zfs-fuse is ready for an everyday > > > > > user at it`s current state ! ;) > > > >=20 > > > > That's what I found out, wanted to share and get other's opinion on= . > > > >=20 > > > > I did not complain. I thought it might work, it might not, so I tr= ied. > > > >=20 > > > > BTW last night I tried ZFS on FreeBSD 7. I got a panic when trying= to make it > > > > import my existing pool at first. [...] > > >=20 > > > Can I see the panic message and backtrace? > >=20 > > Hi Pawel, > >=20 > > I did not get a panic during 'zpool import' any more today, but 'zpool > > export' paniced at me: > >=20 > > g_vfs_done(): da0s5d [WRITE(offset=3D963559124,length=3D16384)]= error=3D5 > > panic: bundirty: buffer 0xd919a39c still on queue 1 > > cpuid 0 > > KDB: enter: panic > > [thread pid 3 tid 100001] > > stopped at kdb_enter+0x2b: nop > > =20 > > bt > > =20 > > tracing pid 3 tid 100001 td 0xc5105d80 > > kdb_enter(c09494ad) at kdb_enter +0x2b > > panic(c0952b99,d919a39c,1,d919a39c,e3ca1c48) > > bundirty(d919a39c) at brelse +0x82f > > bufdone_finish(d919a39c) at bufdone_finish +0x34c > > bufdone > > ffs_backgroundwritedone > > bufdone > > g_vfs_done(c56abe70) at g_vfs_done +0x8a > > biodone > > g_io_schedule_up > > =20 > > (copied by hand, may contain errors). da0s5d is /var. > >=20 > > Some log files are attached. They contain USB disk errors and some > > LORs. >=20 > This panic has nothing to do with ZFS, actually, but with UFS. You may > want to send it to freebsd-fs@ >=20 > BTW. ZFS is now integrated with FreeBSD's namecache, so you may want to > repeat your find(1) test:) >=20 --=-K8RFRD7KPmJDTGLIL1Hx Content-Type: application/x-pkcs7-signature; name=smime.p7s Content-Disposition: attachment; filename=smime.p7s Content-Transfer-Encoding: base64 MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIKADCCBPww ggLkoAMCAQICAwMjmTANBgkqhkiG9w0BAQUFADB5MRAwDgYDVQQKEwdSb290IENBMR4wHAYDVQQL ExVodHRwOi8vd3d3LmNhY2VydC5vcmcxIjAgBgNVBAMTGUNBIENlcnQgU2lnbmluZyBBdXRob3Jp dHkxITAfBgkqhkiG9w0BCQEWEnN1cHBvcnRAY2FjZXJ0Lm9yZzAeFw0wNzAxMjIxOTQ1MjBaFw0w ODAxMjIxOTQ1MjBaMEUxHDAaBgNVBAMTE0dlb3JnLVcuIEtvbHRlcm1hbm4xJTAjBgkqhkiG9w0B CQEWFmd3ay5ya29AZ29vZ2xlbWFpbC5jb20wggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIB AQC4FpYBJkZIHQ2Z4yn/BuyIjrNb6U2TJPUrB3UTnTEVdj0iQ9jbESGuibOmhCIk0cEFs/w1mk6j WrL+Fl4FwafPmtN768J6mREUF2qhuEJ0H82FTwZ85kq10OnsbpWD3puNApJPW5KDtqosTxvR+IBP jzOpXdtL/CPRS0IJt1thwo7Cz+WfbVV0R6yehNTR1WnMcq0r6n3E7x5wNEHB4TKxIGqNYOmiGl8S vQE95WTG2mWWCxhrSAtIbETJZlutxnR1JSBzg3JvjsqS6QMsH6gksqYOq7/EDuMx428v1bI4zWu8 dNrw67Cr65ys0Y/U0WJOryutvuTKWUq2BxaCkSelAgMBAAGjgcAwgb0wDAYDVR0TAQH/BAIwADBW BglghkgBhvhCAQ0ESRZHVG8gZ2V0IHlvdXIgb3duIGNlcnRpZmljYXRlIGZvciBGUkVFIGhlYWQg b3ZlciB0byBodHRwOi8vd3d3LkNBY2VydC5vcmcwMgYIKwYBBQUHAQEEJjAkMCIGCCsGAQUFBzAB hhZodHRwOi8vb2NzcC5jYWNlcnQub3JnMCEGA1UdEQQaMBiBFmd3ay5ya29AZ29vZ2xlbWFpbC5j b20wDQYJKoZIhvcNAQEFBQADggIBAIy54zJeEaqEo+RtDc8NmmlBGvdH3Ah5ddWD8gIZPFkkhjZ0 u1JIpW4sdpYIOG4gbuUUCt1eOrp6AUbVvh4Zw0iTdh6OBfBCAznTeobtOqrO6TL2il1rZFiK6lDh RWIKB7j77uw2Q3W+1xV/tSJZeEbmpjxl46dLOn5k5FV0ZRUPYMicAHD2+K8y3bt7JOaD47On7xrG FYPtgLGlgpjn6bW+W0/Fa3LEWeUBegxAd40kCPQuGg4QOAjzp7SR2GrA7ITN9T/YZhRdbgE7PR7e jfVCLAr5iEc2UOa2m4ZmXF7xepLbGxGjtkfXBoarhJo5FQjuE5as0QogbiUnZrfYqy4xaY6xZztQ swHQKXf0ObJ+FTCB8IO+oWKq0/dNST+yYgXUzzz03tAgVhJ3y8DQ5q1+rysKMhx5xXjON5600CXb y7yvJi0V5kAj8dWd0mQf0TCP4+M1Ns5efsVkwEkRjVJ5uo3HeqEPQyJZPAiJha/unAkg4S+4LW4V nmaqo8/ZJWtbh/Qsnr8kwO93tyQO1EDbHG35xoxQIIb9OUG4tZy5wVGBt6izCYCXDcyq0BHv5nMc D4Gm16MNXN4QK3dsR3kDeIyr0VGKrO/yFh408s+V2/M6GfibMsy/NGZIgGPaLjYHiz3xLp5qro/r G65JXM8VEgNy9q9T10HUsGYIhfuYMIIE/DCCAuSgAwIBAgIDAyOZMA0GCSqGSIb3DQEBBQUAMHkx EDAOBgNVBAoTB1Jvb3QgQ0ExHjAcBgNVBAsTFWh0dHA6Ly93d3cuY2FjZXJ0Lm9yZzEiMCAGA1UE AxMZQ0EgQ2VydCBTaWduaW5nIEF1dGhvcml0eTEhMB8GCSqGSIb3DQEJARYSc3VwcG9ydEBjYWNl cnQub3JnMB4XDTA3MDEyMjE5NDUyMFoXDTA4MDEyMjE5NDUyMFowRTEcMBoGA1UEAxMTR2Vvcmct Vy4gS29sdGVybWFubjElMCMGCSqGSIb3DQEJARYWZ3drLnJrb0Bnb29nbGVtYWlsLmNvbTCCASIw DQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBALgWlgEmRkgdDZnjKf8G7IiOs1vpTZMk9SsHdROd MRV2PSJD2NsRIa6Js6aEIiTRwQWz/DWaTqNasv4WXgXBp8+a03vrwnqZERQXaqG4QnQfzYVPBnzm SrXQ6exulYPem40Ckk9bkoO2qixPG9H4gE+PM6ld20v8I9FLQgm3W2HCjsLP5Z9tVXRHrJ6E1NHV acxyrSvqfcTvHnA0QcHhMrEgao1g6aIaXxK9AT3lZMbaZZYLGGtIC0hsRMlmW63GdHUlIHODcm+O ypLpAywfqCSypg6rv8QO4zHjby/VsjjNa7x02vDrsKvrnKzRj9TRYk6vK62+5MpZSrYHFoKRJ6UC AwEAAaOBwDCBvTAMBgNVHRMBAf8EAjAAMFYGCWCGSAGG+EIBDQRJFkdUbyBnZXQgeW91ciBvd24g Y2VydGlmaWNhdGUgZm9yIEZSRUUgaGVhZCBvdmVyIHRvIGh0dHA6Ly93d3cuQ0FjZXJ0Lm9yZzAy BggrBgEFBQcBAQQmMCQwIgYIKwYBBQUHMAGGFmh0dHA6Ly9vY3NwLmNhY2VydC5vcmcwIQYDVR0R BBowGIEWZ3drLnJrb0Bnb29nbGVtYWlsLmNvbTANBgkqhkiG9w0BAQUFAAOCAgEAjLnjMl4RqoSj 5G0Nzw2aaUEa90fcCHl11YPyAhk8WSSGNnS7Ukilbix2lgg4biBu5RQK3V46unoBRtW+HhnDSJN2 Ho4F8EIDOdN6hu06qs7pMvaKXWtkWIrqUOFFYgoHuPvu7DZDdb7XFX+1Ill4RuamPGXjp0s6fmTk VXRlFQ9gyJwAcPb4rzLdu3sk5oPjs6fvGsYVg+2AsaWCmOfptb5bT8VrcsRZ5QF6DEB3jSQI9C4a DhA4CPOntJHYasDshM31P9hmFF1uATs9Ht6N9UIsCvmIRzZQ5rabhmZcXvF6ktsbEaO2R9cGhquE mjkVCO4TlqzRCiBuJSdmt9irLjFpjrFnO1CzAdApd/Q5sn4VMIHwg76hYqrT901JP7JiBdTPPPTe 0CBWEnfLwNDmrX6vKwoyHHnFeM43nrTQJdvLvK8mLRXmQCPx1Z3SZB/RMI/j4zU2zl5+xWTASRGN Unm6jcd6oQ9DIlk8CImFr+6cCSDhL7gtbhWeZqqjz9kla1uH9CyevyTA73e3JA7UQNscbfnGjFAg hv05Qbi1nLnBUYG3qLMJgJcNzKrQEe/mcxwPgabXow1c3hArd2xHeQN4jKvRUYqs7/IWHjTyz5Xb 8zoZ+JsyzL80ZkiAY9ouNgeLPfEunmquj+sbrklczxUSA3L2r1PXQdSwZgiF+5gxggMzMIIDLwIB ATCBgDB5MRAwDgYDVQQKEwdSb290IENBMR4wHAYDVQQLExVodHRwOi8vd3d3LmNhY2VydC5vcmcx IjAgBgNVBAMTGUNBIENlcnQgU2lnbmluZyBBdXRob3JpdHkxITAfBgkqhkiG9w0BCQEWEnN1cHBv cnRAY2FjZXJ0Lm9yZwIDAyOZMAkGBSsOAwIaBQCgggGHMBgGCSqGSIb3DQEJAzELBgkqhkiG9w0B BwEwHAYJKoZIhvcNAQkFMQ8XDTA3MDQyNTIxMDE1NFowIwYJKoZIhvcNAQkEMRYEFAbpZdxLVNFj 8sT7gtwsbs/07qUXMIGRBgkrBgEEAYI3EAQxgYMwgYAweTEQMA4GA1UEChMHUm9vdCBDQTEeMBwG A1UECxMVaHR0cDovL3d3dy5jYWNlcnQub3JnMSIwIAYDVQQDExlDQSBDZXJ0IFNpZ25pbmcgQXV0 aG9yaXR5MSEwHwYJKoZIhvcNAQkBFhJzdXBwb3J0QGNhY2VydC5vcmcCAwMjmTCBkwYLKoZIhvcN AQkQAgsxgYOggYAweTEQMA4GA1UEChMHUm9vdCBDQTEeMBwGA1UECxMVaHR0cDovL3d3dy5jYWNl cnQub3JnMSIwIAYDVQQDExlDQSBDZXJ0IFNpZ25pbmcgQXV0aG9yaXR5MSEwHwYJKoZIhvcNAQkB FhJzdXBwb3J0QGNhY2VydC5vcmcCAwMjmTANBgkqhkiG9w0BAQEFAASCAQAZKWEWedb31SaLvqcQ 2Pk6ntImuY1bcMc9gPhsmU4PltWG/sB8Uz49dH77hiYrXdixKfEB0eTYL1zXf2OgVO/zDhBMrcgF 05VlZ2lXAWq8vAyJyxxSv0dRlHpl9wpxmaSKalNp0TQ7/jiyIp/E1OtsZiZlkdvl+5psqZ7+8ROJ liKULJLxedDhBz1L0d9czMrH8xKWf4qJwgfWHCVximLTr3deNQu7EJ09rZnmOp84koOftrBdl8IV E+3wf41kb3Vkn9Bc9ogaoW5GghfnhfwmPxzRngqr/OhLzuCTEqsZjdjwKm5lMKW9Ukh46uhVZnId TuYHaA/UbWt/i6rHR3J7AAAAAAAA --=-K8RFRD7KPmJDTGLIL1Hx-- From owner-freebsd-fs@FreeBSD.ORG Thu Apr 26 07:35:10 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 0B09916A403; Thu, 26 Apr 2007 07:35:10 +0000 (UTC) (envelope-from bakul@bitblocks.com) Received: from mail.bitblocks.com (ns1.bitblocks.com [64.142.15.60]) by mx1.freebsd.org (Postfix) with ESMTP id E392413C44B; Thu, 26 Apr 2007 07:35:09 +0000 (UTC) (envelope-from bakul@bitblocks.com) Received: from bitblocks.com (localhost.bitblocks.com [127.0.0.1]) by mail.bitblocks.com (Postfix) with ESMTP id 804E05B29; Thu, 26 Apr 2007 00:35:09 -0700 (PDT) To: Pawel Jakub Dawidek Date: Thu, 26 Apr 2007 00:35:09 -0700 From: Bakul Shah Message-Id: <20070426073509.804E05B29@mail.bitblocks.com> Cc: freebsd-fs@freebsd.org Subject: ZFS: kmem_map too small panic again X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 26 Apr 2007 07:35:10 -0000 The system first paniced during a restore operation to zfs. Now I get this kmem_map too small panic by doing a couple of du in the partially restored dir. This bug seems to have come back as of yesterday (about the time freebsd namecache started to be used?) -- prior to that I restored many more files and did several make buildworlds on the same filesystem with no problems. Sources were cvsupped about two hours back (as of approx 10:30pm PDT Apr 25). I did a sysctl -a on a freshly booted machine and after one du and diffed them. The most glaring diffs seem to be the one shown below (I can supply both sysctl outputs). vmstat shows the solaris pool is using about 127MB. -debug.numcachehv: 267 -debug.numcache: 2166 +debug.numcachehv: 14517 +debug.numcache: 86100 -kstat.zfs.misc.arcstats.deleted: 16 -kstat.zfs.misc.arcstats.recycle_miss: 0 -kstat.zfs.misc.arcstats.mutex_miss: 0 -kstat.zfs.misc.arcstats.evict_skip: 0 -kstat.zfs.misc.arcstats.hash_elements: 92 -kstat.zfs.misc.arcstats.hash_elements_max: 94 -kstat.zfs.misc.arcstats.hash_collisions: 1 -kstat.zfs.misc.arcstats.hash_chains: 0 -kstat.zfs.misc.arcstats.hash_chain_max: 1 -kstat.zfs.misc.arcstats.p: 83886080 -kstat.zfs.misc.arcstats.c: 167772160 +kstat.zfs.misc.arcstats.deleted: 50263 +kstat.zfs.misc.arcstats.recycle_miss: 7242 +kstat.zfs.misc.arcstats.mutex_miss: 6701 +kstat.zfs.misc.arcstats.evict_skip: 9294733 +kstat.zfs.misc.arcstats.hash_elements: 3514 +kstat.zfs.misc.arcstats.hash_elements_max: 18588 +kstat.zfs.misc.arcstats.hash_collisions: 9805 +kstat.zfs.misc.arcstats.hash_chains: 160 +kstat.zfs.misc.arcstats.hash_chain_max: 4 +kstat.zfs.misc.arcstats.p: 15810418 +kstat.zfs.misc.arcstats.c: 16777216 -kstat.zfs.misc.arcstats.size: 963072 +kstat.zfs.misc.arcstats.size: 57576448 From owner-freebsd-fs@FreeBSD.ORG Thu Apr 26 09:36:03 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 311AC16A402; Thu, 26 Apr 2007 09:36:03 +0000 (UTC) (envelope-from rwatson@FreeBSD.org) Received: from cyrus.watson.org (cyrus.watson.org [209.31.154.42]) by mx1.freebsd.org (Postfix) with ESMTP id 05EAA13C468; Thu, 26 Apr 2007 09:36:02 +0000 (UTC) (envelope-from rwatson@FreeBSD.org) Received: from fledge.watson.org (fledge.watson.org [209.31.154.41]) by cyrus.watson.org (Postfix) with ESMTP id 96FA34760D; Thu, 26 Apr 2007 05:36:02 -0400 (EDT) Date: Thu, 26 Apr 2007 10:36:02 +0100 (BST) From: Robert Watson X-X-Sender: robert@fledge.watson.org To: Greg Troxel In-Reply-To: Message-ID: <20070426103214.X37507@fledge.watson.org> References: <20070422124731.GA20548@harmless.hu> <462CAE66.3050001@freebsd.org> <20070425093131.F37507@fledge.watson.org> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: freebsd-fs@freebsd.org Subject: Re: distributed filesystems X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 26 Apr 2007 09:36:03 -0000 On Wed, 25 Apr 2007, Greg Troxel wrote: > Good point, and I suspect it isn't that hard. NetBSD is also (finally) > moving to fine-grained locking. Given what a long, hard haul that proved for every other operating system thas has approached the project, I would expect to see results from that project in the longer, rather than shorter, term. > I supsect one could either create a coda lock and always grab that, or to > make locks for each data object (the name cache is probably what's needed - > everything else is per-vnode and the vnode lock protects most vnode > changes). Up-front, I think a global Coda lock protecting things like message queueing and waiting structures would be fine. Since most vnode operations pass straight through to the container vnode (or did, when I last worked on Coda), it could be that no additional locking is required on things like read/write paths beyond the existing vnode locking. Any chance you'd have interest in working on this project? :-) While the time is not yet here, there will come a point where we will be interested in kicking out file systems that cannot operate without Giant, in the same way we're now doing that for network stack components. There's a significant complexity overhead to all the conditional per-filesystem giant acquisition logic, but it means all file systems will need to be updated. Robert N M Watson Computer Laboratory University of Cambridge From owner-freebsd-fs@FreeBSD.ORG Thu Apr 26 17:08:53 2007 Return-Path: X-Original-To: freebsd-fs@FreeBSD.org Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 6C9AB16A408 for ; Thu, 26 Apr 2007 17:08:53 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.freebsd.org (Postfix) with ESMTP id EF66F13C44C for ; Thu, 26 Apr 2007 17:08:52 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 7F9CA45CD9; Thu, 26 Apr 2007 19:08:51 +0200 (CEST) Received: from localhost (pjd.wheel.pl [10.0.1.1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 2007245696; Thu, 26 Apr 2007 19:08:47 +0200 (CEST) Date: Thu, 26 Apr 2007 19:08:24 +0200 From: Pawel Jakub Dawidek To: Barry Pederson Message-ID: <20070426170824.GO41670@garage.freebsd.pl> References: <462F65DB.5010305@barryp.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="xSu31lw3TgkWXnjh" Content-Disposition: inline In-Reply-To: <462F65DB.5010305@barryp.org> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r804 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-5.9 required=3.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-fs@FreeBSD.org Subject: Re: ZFS: inherited mountpoints with root filesystem X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 26 Apr 2007 17:08:53 -0000 --xSu31lw3TgkWXnjh Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Apr 25, 2007 at 09:29:47AM -0500, Barry Pederson wrote: > I've been fooling with using ZFS for the root filesystem, and a CompactFl= ash device to hold a UFS /boot - It seems to work very well, CF devices a= re big enough that you=20 > can put a pretty full install of FreeBSD on it which is nice for recovery= /maintenance work on the real disk. >=20 > One problem I've noticed though is that there's a difference between the = mountpoint of a pool's root filesystem that FreeBSD sees and what ZFS sees.= For example, the=20 > "mount" command shows" >=20 > tank on / (zfs, local) >=20 > but "zfs list" shows: >=20 > NAME USED AVAIL REFER MOUNTPOINT > tank 1.98G 16.4G 16.7M /tank >=20 > I'm finding that having the "tank" filesystem be "/" and "/tank" simultan= eously makes it awkward when creating sub-filesystems, say for example "tan= k/usr" and "tank/var". >=20 > Currently, they inherit the "/tank" mountpoint, and show up as "/tank/usr= " and "/tank/var" - where I'd like them to inherit "/" and end up as "/usr"= and "/var". >=20 > For now, I've worked around this with symlinks in the "tank" filesystem l= ike: usr -> tank/usr , but the problem is that when mounting the CompactFla= sh as root and importing=20 > "tank", it complains that it can't mount "tank/usr" (because the symlink = is in the way). >=20 > I've also tried explicity setting the mountpoint for "tank/usr" to "/usr"= , which is fine except again for when the CF is used as root, which would t= hen conflict with the CF=20 > filesystem's "/usr" >=20 > Is this double-mountpoint setup the way things should be? If so, is/can = there be an option to have the ZFS-mountpoint for a root-mounted filesystem= also be "/", so that=20 > inherited mountpoints for sub-filesystems are under "/" instead of "/"? For file systems that are mounted not via 'zfs mount -a' (eg. they are mounted by hand or via /etc/fstab), you should set mountpoint property to 'legacy'. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --xSu31lw3TgkWXnjh Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (FreeBSD) iD8DBQFGMNyIForvXbEpPzQRAlwyAJwMS5XA/8pU1V3X49YO8KHsSsu+rgCgtQT6 YIZJsl5WtuCSnoEOSbH3GYI= =Rm7V -----END PGP SIGNATURE----- --xSu31lw3TgkWXnjh-- From owner-freebsd-fs@FreeBSD.ORG Thu Apr 26 20:52:11 2007 Return-Path: X-Original-To: freebsd-fs@FreeBSD.org Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 0CD8716A401; Thu, 26 Apr 2007 20:52:11 +0000 (UTC) (envelope-from bp@barryp.org) Received: from eden.barryp.org (host-42-60-230-24.midco.net [24.230.60.42]) by mx1.freebsd.org (Postfix) with ESMTP id D62BE13C459; Thu, 26 Apr 2007 20:52:10 +0000 (UTC) (envelope-from bp@barryp.org) Received: from geo.med.und.nodak.edu ([134.129.166.11]) by eden.barryp.org with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.63 (FreeBSD)) (envelope-from ) id 1HhAwk-000CNQ-3m; Thu, 26 Apr 2007 15:52:10 -0500 Message-ID: <463110F5.1090102@barryp.org> Date: Thu, 26 Apr 2007 15:52:05 -0500 From: Barry Pederson User-Agent: Thunderbird 1.5.0.10 (X11/20070221) MIME-Version: 1.0 To: Pawel Jakub Dawidek References: <462F65DB.5010305@barryp.org> <20070426170824.GO41670@garage.freebsd.pl> In-Reply-To: <20070426170824.GO41670@garage.freebsd.pl> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-fs@FreeBSD.org Subject: Re: ZFS: inherited mountpoints with root filesystem X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 26 Apr 2007 20:52:11 -0000 Pawel Jakub Dawidek wrote: > On Wed, Apr 25, 2007 at 09:29:47AM -0500, Barry Pederson wrote: >> Is this double-mountpoint setup the way things should be? If so, is/can there be an option to have the ZFS-mountpoint for a root-mounted filesystem also be "/", so that >> inherited mountpoints for sub-filesystems are under "/" instead of "/"? > > For file systems that are mounted not via 'zfs mount -a' (eg. they are > mounted by hand or via /etc/fstab), you should set mountpoint property > to 'legacy'. So you're saying that if you're doing vfs.root.mountfrom="zfs:tank" in loader.conf, then tank's mountpoint should be "legacy"? I'm trying that now, but the drawback there is that the sub-filesystems like "tank/home" also inherit that "legacy" mountpoint, so they have to be manually listed in /etc/fstab. That seems to carry on down to sub-sub filesystems like "tank/home/bob" and so on. So you lose out on the nice auto-mounting feature in ZFS. I was hoping that booting with vfs.root.mountfrom="zfs:tank" would be equivalent to something like: zpool import -R / I wonder now if it wouldn't have been better to have created the pool as an Alternate Root Pool in the first place. Is there a way to change an existing pool's mountpoint to '/' like an Alternate Root pool? A simple "zfs set mountpoint=/" doesn't fly because it wants to unmount root to do it. I'd kind of need to change it, but not have it take effect immediately. Barry From owner-freebsd-fs@FreeBSD.ORG Thu Apr 26 20:56:57 2007 Return-Path: X-Original-To: freebsd-fs@FreeBSD.org Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 2B83F16A401 for ; Thu, 26 Apr 2007 20:56:57 +0000 (UTC) (envelope-from bp@barryp.org) Received: from eden.barryp.org (host-42-60-230-24.midco.net [24.230.60.42]) by mx1.freebsd.org (Postfix) with ESMTP id 0868C13C480 for ; Thu, 26 Apr 2007 20:56:57 +0000 (UTC) (envelope-from bp@barryp.org) Received: from geo.med.und.nodak.edu ([134.129.166.11]) by eden.barryp.org with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.63 (FreeBSD)) (envelope-from ) id 1HhB1M-000CSa-Dv for freebsd-fs@FreeBSD.org; Thu, 26 Apr 2007 15:56:56 -0500 Message-ID: <46311215.3030503@barryp.org> Date: Thu, 26 Apr 2007 15:56:53 -0500 From: Barry Pederson User-Agent: Thunderbird 1.5.0.10 (X11/20070221) MIME-Version: 1.0 To: freebsd-fs@FreeBSD.org References: <462F65DB.5010305@barryp.org> <20070426170824.GO41670@garage.freebsd.pl> <463110F5.1090102@barryp.org> In-Reply-To: <463110F5.1090102@barryp.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: Subject: Re: ZFS: inherited mountpoints with root filesystem X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 26 Apr 2007 20:56:57 -0000 Barry Pederson wrote: > I was hoping that booting with vfs.root.mountfrom="zfs:tank" would be > equivalent to something like: > > zpool import -R / Oops, that should have been: zpool import -R / tank Barry From owner-freebsd-fs@FreeBSD.ORG Thu Apr 26 21:33:48 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 17A4316A402; Thu, 26 Apr 2007 21:33:48 +0000 (UTC) (envelope-from bakul@bitblocks.com) Received: from mail.bitblocks.com (mail.bitblocks.com [64.142.15.60]) by mx1.freebsd.org (Postfix) with ESMTP id EE61513C44C; Thu, 26 Apr 2007 21:33:47 +0000 (UTC) (envelope-from bakul@bitblocks.com) Received: from bitblocks.com (localhost.bitblocks.com [127.0.0.1]) by mail.bitblocks.com (Postfix) with ESMTP id C3A7C5B58; Thu, 26 Apr 2007 14:33:47 -0700 (PDT) To: Pawel Jakub Dawidek In-reply-to: Your message of "Thu, 26 Apr 2007 00:35:09 PDT." Date: Thu, 26 Apr 2007 14:33:47 -0700 From: Bakul Shah Message-Id: <20070426213347.C3A7C5B58@mail.bitblocks.com> Cc: freebsd-fs@freebsd.org Subject: Re: ZFS: kmem_map too small panic again X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 26 Apr 2007 21:33:48 -0000 An update: I reverted sources to to Apr 24 16:49 UTC and rebuilt the kernel and the bug goes away -- I was able to restore 53GB (840K+ inodes) and do a bunch of du with no problems. But the bug remains on a kernel with the latest zfs changes. All I have to do run du a couple of times in the restored tree to crash the system. There is no crash with multiple du on a similarly sized UFS2, only on ZFS. This is on a Athlon64 X2 Dual Core Processor 3800+ running in 32 bit mode. The exact message is: panic: kmem_malloc(98304): kmem_map too small: 335478784 total allocated Am I the only one seeing this problem? I will attempt to grab a core dump -- so far it seems to hang during dump after panic. > The system first paniced during a restore operation to zfs. > Now I get this kmem_map too small panic by doing a couple of > du in the partially restored dir. This bug seems to have > come back as of yesterday (about the time freebsd namecache > started to be used?) -- prior to that I restored many more > files and did several make buildworlds on the same filesystem > with no problems. > > Sources were cvsupped about two hours back (as of approx > 10:30pm PDT Apr 25). I did a sysctl -a on a freshly booted > machine and after one du and diffed them. The most glaring > diffs seem to be the one shown below (I can supply both > sysctl outputs). vmstat shows the solaris pool is using > about 127MB. > > -debug.numcachehv: 267 > -debug.numcache: 2166 > +debug.numcachehv: 14517 > +debug.numcache: 86100 > > -kstat.zfs.misc.arcstats.deleted: 16 > -kstat.zfs.misc.arcstats.recycle_miss: 0 > -kstat.zfs.misc.arcstats.mutex_miss: 0 > -kstat.zfs.misc.arcstats.evict_skip: 0 > -kstat.zfs.misc.arcstats.hash_elements: 92 > -kstat.zfs.misc.arcstats.hash_elements_max: 94 -kstat.zfs.misc.arcstats.hash_collisions: 1 > -kstat.zfs.misc.arcstats.hash_chains: 0 > -kstat.zfs.misc.arcstats.hash_chain_max: 1 > -kstat.zfs.misc.arcstats.p: 83886080 > -kstat.zfs.misc.arcstats.c: 167772160 > +kstat.zfs.misc.arcstats.deleted: 50263 > +kstat.zfs.misc.arcstats.recycle_miss: 7242 > +kstat.zfs.misc.arcstats.mutex_miss: 6701 > +kstat.zfs.misc.arcstats.evict_skip: 9294733 > +kstat.zfs.misc.arcstats.hash_elements: 3514 > +kstat.zfs.misc.arcstats.hash_elements_max: 18588 > +kstat.zfs.misc.arcstats.hash_collisions: 9805 > +kstat.zfs.misc.arcstats.hash_chains: 160 > +kstat.zfs.misc.arcstats.hash_chain_max: 4 > +kstat.zfs.misc.arcstats.p: 15810418 > +kstat.zfs.misc.arcstats.c: 16777216 > > -kstat.zfs.misc.arcstats.size: 963072 > +kstat.zfs.misc.arcstats.size: 57576448 > From owner-freebsd-fs@FreeBSD.ORG Thu Apr 26 22:36:25 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 9A15F16A401 for ; Thu, 26 Apr 2007 22:36:25 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.freebsd.org (Postfix) with ESMTP id 636B313C4B7 for ; Thu, 26 Apr 2007 22:36:23 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 090DB48800; Fri, 27 Apr 2007 00:36:18 +0200 (CEST) Received: from localhost (154.81.datacomsa.pl [195.34.81.154]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 7261845CD9; Fri, 27 Apr 2007 00:36:03 +0200 (CEST) Date: Fri, 27 Apr 2007 00:35:35 +0200 From: Pawel Jakub Dawidek To: Bakul Shah Message-ID: <20070426223535.GC45366@garage.freebsd.pl> References: <20070426213347.C3A7C5B58@mail.bitblocks.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="hOcCNbCCxyk/YU74" Content-Disposition: inline In-Reply-To: <20070426213347.C3A7C5B58@mail.bitblocks.com> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r804 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-2.6 required=3.0 tests=BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-fs@freebsd.org Subject: Re: ZFS: kmem_map too small panic again X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 26 Apr 2007 22:36:25 -0000 --hOcCNbCCxyk/YU74 Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Apr 26, 2007 at 02:33:47PM -0700, Bakul Shah wrote: > An update: >=20 > I reverted sources to to Apr 24 16:49 UTC and rebuilt the > kernel and the bug goes away -- I was able to restore 53GB > (840K+ inodes) and do a bunch of du with no problems. >=20 > But the bug remains on a kernel with the latest zfs changes. > All I have to do run du a couple of times in the restored > tree to crash the system. There is no crash with multiple du > on a similarly sized UFS2, only on ZFS. This is on a > Athlon64 X2 Dual Core Processor 3800+ running in 32 bit mode. > The exact message is: >=20 > panic: kmem_malloc(98304): kmem_map too small: 335478784 total allocated I can reproduce it and I'm working on it. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --hOcCNbCCxyk/YU74 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (FreeBSD) iD8DBQFGMSk3ForvXbEpPzQRAulEAKCFHRM56NpECI7qkGusPbUhW/GtXgCfbYW2 mg0sKDRHV7gpC17jUBMfIm0= =RAF4 -----END PGP SIGNATURE----- --hOcCNbCCxyk/YU74-- From owner-freebsd-fs@FreeBSD.ORG Fri Apr 27 09:04:53 2007 Return-Path: X-Original-To: freebsd-fs@FreeBSD.org Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 02E0816A408 for ; Fri, 27 Apr 2007 09:04:53 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.freebsd.org (Postfix) with ESMTP id D674213C458 for ; Fri, 27 Apr 2007 09:04:51 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id B323F45685; Fri, 27 Apr 2007 11:04:48 +0200 (CEST) Received: from localhost (154.81.datacomsa.pl [195.34.81.154]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id E67F0456AB; Fri, 27 Apr 2007 11:04:35 +0200 (CEST) Date: Fri, 27 Apr 2007 11:04:09 +0200 From: Pawel Jakub Dawidek To: Barry Pederson Message-ID: <20070427090409.GA48798@garage.freebsd.pl> References: <462F65DB.5010305@barryp.org> <20070426170824.GO41670@garage.freebsd.pl> <463110F5.1090102@barryp.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="1yeeQ81UyVL57Vl7" Content-Disposition: inline In-Reply-To: <463110F5.1090102@barryp.org> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r804 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-2.6 required=3.0 tests=BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-fs@FreeBSD.org Subject: Re: ZFS: inherited mountpoints with root filesystem X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 27 Apr 2007 09:04:53 -0000 --1yeeQ81UyVL57Vl7 Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Apr 26, 2007 at 03:52:05PM -0500, Barry Pederson wrote: > Pawel Jakub Dawidek wrote: > >On Wed, Apr 25, 2007 at 09:29:47AM -0500, Barry Pederson wrote: > >>Is this double-mountpoint setup the way things should be? If so, is/ca= n there be an option to have the ZFS-mountpoint for a root-mounted filesyst= em also be "/", so that=20 > >>inherited mountpoints for sub-filesystems are under "/" instead of "/"? > >For file systems that are mounted not via 'zfs mount -a' (eg. they are > >mounted by hand or via /etc/fstab), you should set mountpoint property > >to 'legacy'. >=20 > So you're saying that if you're doing vfs.root.mountfrom=3D"zfs:tank" in = loader.conf, then tank's mountpoint should be "legacy"? >=20 > I'm trying that now, but the drawback there is that the sub-filesystems l= ike "tank/home" also inherit that "legacy" mountpoint, so they have to be m= anually listed in=20 > /etc/fstab. That seems to carry on down to sub-sub filesystems like "tan= k/home/bob" and so on. So you lose out on the nice auto-mounting feature i= n ZFS. >=20 > I was hoping that booting with vfs.root.mountfrom=3D"zfs:tank" would be e= quivalent to something like: >=20 > zpool import -R / >=20 > I wonder now if it wouldn't have been better to have created the pool as = an Alternate Root Pool in the first place. >=20 > Is there a way to change an existing pool's mountpoint to '/' like an Alt= ernate Root pool? A simple "zfs set mountpoint=3D/" doesn't fly because it= wants to unmount root to=20 > do it. I'd kind of need to change it, but not have it take effect immedi= ately. But the thing is that root file system is mounted by the kernel automatically and such file systems should define mountpoint as 'legacy'. You can still set mountpoint for tank/home to /usr/home/ and then all children of tank/home will inherit it. You could also try setting tank mountpoint to /, but after setting canmount property to 'off'. This may not work, because ZFS may want to unmount tank automatically. What I prefer the most, is to don't touch root dataset at all, just keep it around unmounted as a head for others datasets, eg. # zpool create tank da0 # zfs set canmount=3Doff tank # zfs set mountpoint=3Dlegacy tank # zfs create tank/root # this will be mounted as / by the kernel # zfs create tank/usr # zfs set mountpoint=3D/usr tank/usr etc. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --1yeeQ81UyVL57Vl7 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (FreeBSD) iD8DBQFGMbyJForvXbEpPzQRAjs0AJ4+4+YKxX3jJ/E0gvAVbOn18Gq4OwCfU1Yp fdSEAwQQDiQZOkwLdKuvC/Q= =MDcH -----END PGP SIGNATURE----- --1yeeQ81UyVL57Vl7-- From owner-freebsd-fs@FreeBSD.ORG Fri Apr 27 14:26:35 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 3568516A401 for ; Fri, 27 Apr 2007 14:26:35 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.freebsd.org (Postfix) with ESMTP id CF0A313C455 for ; Fri, 27 Apr 2007 14:26:34 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 50E7448800; Fri, 27 Apr 2007 16:26:33 +0200 (CEST) Received: from localhost (pjd.wheel.pl [10.0.1.1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 7E313487F3; Fri, 27 Apr 2007 16:26:27 +0200 (CEST) Date: Fri, 27 Apr 2007 16:26:06 +0200 From: Pawel Jakub Dawidek To: Bakul Shah Message-ID: <20070427142606.GK49413@garage.freebsd.pl> References: <20070426213347.C3A7C5B58@mail.bitblocks.com> <20070426223535.GC45366@garage.freebsd.pl> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="GU3/x65mZ6MFE8p3" Content-Disposition: inline In-Reply-To: <20070426223535.GC45366@garage.freebsd.pl> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r804 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-5.9 required=3.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-fs@freebsd.org Subject: Re: ZFS: kmem_map too small panic again X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 27 Apr 2007 14:26:35 -0000 --GU3/x65mZ6MFE8p3 Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Apr 27, 2007 at 12:35:35AM +0200, Pawel Jakub Dawidek wrote: > On Thu, Apr 26, 2007 at 02:33:47PM -0700, Bakul Shah wrote: > > An update: > >=20 > > I reverted sources to to Apr 24 16:49 UTC and rebuilt the > > kernel and the bug goes away -- I was able to restore 53GB > > (840K+ inodes) and do a bunch of du with no problems. > >=20 > > But the bug remains on a kernel with the latest zfs changes. > > All I have to do run du a couple of times in the restored > > tree to crash the system. There is no crash with multiple du > > on a similarly sized UFS2, only on ZFS. This is on a > > Athlon64 X2 Dual Core Processor 3800+ running in 32 bit mode. > > The exact message is: > >=20 > > panic: kmem_malloc(98304): kmem_map too small: 335478784 total allocated >=20 > I can reproduce it and I'm working on it. The problem is that kern.maxvnodes are tuned based on vnode+UFS_inode size. In case of ZFS, the size of vnode+ZFS_znode_dnode+dmu_buf is larger. As a work-around just decrease kern.maxvnodes to something like 3/4 of the current value. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --GU3/x65mZ6MFE8p3 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (FreeBSD) iD8DBQFGMgf+ForvXbEpPzQRAlQyAKDWu+xBxhb90u8ZEFHgNRoVmBX8QQCgh0Qi qn5odWRwjoRJo5B1vZS/494= =ZWMr -----END PGP SIGNATURE----- --GU3/x65mZ6MFE8p3-- From owner-freebsd-fs@FreeBSD.ORG Fri Apr 27 14:27:33 2007 Return-Path: X-Original-To: freebsd-fs@FreeBSD.org Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id EA80616A401 for ; Fri, 27 Apr 2007 14:27:33 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.freebsd.org (Postfix) with ESMTP id 9240413C48C for ; Fri, 27 Apr 2007 14:27:33 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 7A65848A2D; Fri, 27 Apr 2007 16:27:32 +0200 (CEST) Received: from localhost (pjd.wheel.pl [10.0.1.1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id EC87F48800; Fri, 27 Apr 2007 16:27:27 +0200 (CEST) Date: Fri, 27 Apr 2007 16:27:07 +0200 From: Pawel Jakub Dawidek To: oschonef@techfak.uni-bielefeld.de Message-ID: <20070427142706.GL49413@garage.freebsd.pl> References: <20070425110558.GA28614@mime.TechFak.Uni-Bielefeld.DE> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="VB1oQhYtJt8uuzk+" Content-Disposition: inline In-Reply-To: <20070425110558.GA28614@mime.TechFak.Uni-Bielefeld.DE> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r804 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-5.9 required=3.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-fs@FreeBSD.org Subject: Re: NanoBSD with ZFS X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 27 Apr 2007 14:27:34 -0000 --VB1oQhYtJt8uuzk+ Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Apr 25, 2007 at 01:05:58PM +0200, oschonef@techfak.uni-bielefeld.de= wrote: > Hello Pawel, Hello List, >=20 > first of all kudos to Pawel for Portinmg ZFS to FreeBSD. Thanks a lot :) >=20 > I'm currently experimenting with NanoBSD and want to integrate ZFS. > Unfortunatly ZFS maintains the zpool.cache in /boot/zfs, but the filesyst= em > is mounted read-only and this file cannot be written or changed. > Would it be possible to add a tunable or sysctl to ZFS, which allows > to specify the location of the zpool.cache file? > I could, for example, tell ZFS, it should maintain the file in /etc/zfs > (which is writeable in NanoBSD). Surly I have to safe the zpool.cache fil= e to > a safe location during shutdown, but this is out of ZFS's scope and can be > archived using customized shutdown scripts in NanoBSD. Creating a symlink /boot/zfs/zpool.cache -> /etc/zfs/zpool.cache doesn't help? --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --VB1oQhYtJt8uuzk+ Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (FreeBSD) iD8DBQFGMgg6ForvXbEpPzQRAiWOAKCg7xPUDL0YFgucR21/MiLZPbytJQCguy+d YfbZCNLh5Oi5VB9qWn+R2wQ= =0ruR -----END PGP SIGNATURE----- --VB1oQhYtJt8uuzk+-- From owner-freebsd-fs@FreeBSD.ORG Fri Apr 27 17:02:02 2007 Return-Path: X-Original-To: freebsd-fs@FreeBSD.org Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 3756E16A402 for ; Fri, 27 Apr 2007 17:02:02 +0000 (UTC) (envelope-from oschonef@techfak.uni-bielefeld.de) Received: from smarthost.TechFak.Uni-Bielefeld.DE (smarthost.piip.TechFak.Uni-Bielefeld.DE [129.70.137.17]) by mx1.freebsd.org (Postfix) with ESMTP id DF0AD13C45D for ; Fri, 27 Apr 2007 17:02:01 +0000 (UTC) (envelope-from oschonef@techfak.uni-bielefeld.de) Received: from mime.TechFak.Uni-Bielefeld.DE (mime.TechFak.Uni-Bielefeld.DE [129.70.128.67]) by smarthost.TechFak.Uni-Bielefeld.DE (Postfix) with ESMTP id C92D648511; Fri, 27 Apr 2007 19:01:59 +0200 (CEST) Received: (from oschonef@localhost) by mime.TechFak.Uni-Bielefeld.DE (8.11.7+Sun/8.9.1) id l3RH1xb00471; Fri, 27 Apr 2007 19:01:59 +0200 (MEST) From: Date: Fri, 27 Apr 2007 19:01:59 +0200 To: Pawel Jakub Dawidek Message-ID: <20070427170159.GA458@mime.TechFak.Uni-Bielefeld.DE> References: <20070425110558.GA28614@mime.TechFak.Uni-Bielefeld.DE> <20070427142706.GL49413@garage.freebsd.pl> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20070427142706.GL49413@garage.freebsd.pl> User-Agent: Mutt/1.4.2i X-Zen: Oooommmmmmmmmmmmmmmmmmmmmmm Cc: freebsd-fs@FreeBSD.org Subject: Re: NanoBSD with ZFS X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 27 Apr 2007 17:02:02 -0000 Hello Pawel, Eines schoenen Tages schrieb Pawel Jakub Dawidek: > On Wed, Apr 25, 2007 at 01:05:58PM +0200, oschonef@techfak.uni-bielefeld.de wrote: > > I'm currently experimenting with NanoBSD and want to integrate ZFS. > > Unfortunatly ZFS maintains the zpool.cache in /boot/zfs, but the filesystem > > is mounted read-only and this file cannot be written or changed. > > Would it be possible to add a tunable or sysctl to ZFS, which allows > > to specify the location of the zpool.cache file? [..] > > Creating a symlink /boot/zfs/zpool.cache -> /etc/zfs/zpool.cache doesn't > help? Unfortunatly not! "zpool create" tries to write to /boot/zfs/.zpool.cache (possibly a temporary) which cannot be written. If I symlink /boot/zfs/.zpool.cache -> /etc/zfs/.zpool.cache, I end up with the cache being written to /etc/zfs/.zpool.cache. This file however is then not copied or moved to /etc/zfs/zpool.cache, but of the symlinks. If I link /boot/zfs/.zpool.cache to /etc/zfs/zpool.cache, the file is populated. After a reboot however the file, which was copied there by the rc.initdiskless, seems not to containt, what zfs expects, since the filesystems are not mounted and I need to import the pool by hand. Best Regards, Oliver -- -------------------------------------------------------- And remember: "To Infinity And Far Beyond ... Somehow?!" Hi! I'm a .signature virus! Copy me in your ~/.signature to help me spread! <- Save this lifeform ;-) From owner-freebsd-fs@FreeBSD.ORG Fri Apr 27 17:37:30 2007 Return-Path: X-Original-To: freebsd-fs@FreeBSD.org Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 34F4516A400 for ; Fri, 27 Apr 2007 17:37:30 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.freebsd.org (Postfix) with ESMTP id 30FAB13C44C for ; Fri, 27 Apr 2007 17:37:28 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id A325D487F3; Fri, 27 Apr 2007 19:37:25 +0200 (CEST) Received: from localhost (154.81.datacomsa.pl [195.34.81.154]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id BC2FE45683; Fri, 27 Apr 2007 19:37:07 +0200 (CEST) Date: Fri, 27 Apr 2007 19:36:41 +0200 From: Pawel Jakub Dawidek To: oschonef@techfak.uni-bielefeld.de Message-ID: <20070427173641.GB51688@garage.freebsd.pl> References: <20070425110558.GA28614@mime.TechFak.Uni-Bielefeld.DE> <20070427142706.GL49413@garage.freebsd.pl> <20070427170159.GA458@mime.TechFak.Uni-Bielefeld.DE> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="K8nIJk4ghYZn606h" Content-Disposition: inline In-Reply-To: <20070427170159.GA458@mime.TechFak.Uni-Bielefeld.DE> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r804 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-2.6 required=3.0 tests=BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-fs@FreeBSD.org Subject: Re: NanoBSD with ZFS X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 27 Apr 2007 17:37:30 -0000 --K8nIJk4ghYZn606h Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Apr 27, 2007 at 07:01:59PM +0200, oschonef@techfak.uni-bielefeld.de= wrote: > Hello Pawel, >=20 > Eines schoenen Tages schrieb Pawel Jakub Dawidek: > > On Wed, Apr 25, 2007 at 01:05:58PM +0200, oschonef@techfak.uni-bielefel= d.de wrote: > > > I'm currently experimenting with NanoBSD and want to integrate ZFS. > > > Unfortunatly ZFS maintains the zpool.cache in /boot/zfs, but the file= system > > > is mounted read-only and this file cannot be written or changed. > > > Would it be possible to add a tunable or sysctl to ZFS, which allows > > > to specify the location of the zpool.cache file? > [..] > > > > Creating a symlink /boot/zfs/zpool.cache -> /etc/zfs/zpool.cache doesn't > > help? >=20 > Unfortunatly not! "zpool create" tries to write to /boot/zfs/.zpool.cache > (possibly a temporary) which cannot be written. If I symlink > /boot/zfs/.zpool.cache -> /etc/zfs/.zpool.cache, I end up with the > cache being written to /etc/zfs/.zpool.cache. This file however is then n= ot > copied or moved to /etc/zfs/zpool.cache, but of the symlinks. > If I link /boot/zfs/.zpool.cache to /etc/zfs/zpool.cache, the file is > populated. > After a reboot however the file, which was copied there by the rc.initdis= kless, > seems not to containt, what zfs expects, since the filesystems are not > mounted and I need to import the pool by hand. And /boot/zfs -> /etc/zfs symlink? --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --K8nIJk4ghYZn606h Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (FreeBSD) iD8DBQFGMjSpForvXbEpPzQRApn4AJ9L+V2R3zLs2tQ8p6M9m6nRNOIqBACfc2d7 Cz44yprWL7w5TpDgW9Vjgik= =1COA -----END PGP SIGNATURE----- --K8nIJk4ghYZn606h-- From owner-freebsd-fs@FreeBSD.ORG Fri Apr 27 18:27:19 2007 Return-Path: X-Original-To: freebsd-fs@FreeBSD.org Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 553C016A401; Fri, 27 Apr 2007 18:27:19 +0000 (UTC) (envelope-from oschonef@techfak.uni-bielefeld.de) Received: from smarthost.TechFak.Uni-Bielefeld.DE (smarthost.piip.TechFak.Uni-Bielefeld.DE [129.70.137.17]) by mx1.freebsd.org (Postfix) with ESMTP id 168CD13C484; Fri, 27 Apr 2007 18:27:18 +0000 (UTC) (envelope-from oschonef@techfak.uni-bielefeld.de) Received: from mime.TechFak.Uni-Bielefeld.DE (mime.TechFak.Uni-Bielefeld.DE [129.70.128.67]) by smarthost.TechFak.Uni-Bielefeld.DE (Postfix) with ESMTP id ED96C48518; Fri, 27 Apr 2007 20:27:17 +0200 (CEST) Received: (from oschonef@localhost) by mime.TechFak.Uni-Bielefeld.DE (8.11.7+Sun/8.9.1) id l3RIRHf00514; Fri, 27 Apr 2007 20:27:17 +0200 (MEST) From: Date: Fri, 27 Apr 2007 20:27:17 +0200 To: Pawel Jakub Dawidek Message-ID: <20070427182717.GA504@mime.TechFak.Uni-Bielefeld.DE> References: <20070425110558.GA28614@mime.TechFak.Uni-Bielefeld.DE> <20070427142706.GL49413@garage.freebsd.pl> <20070427170159.GA458@mime.TechFak.Uni-Bielefeld.DE> <20070427173641.GB51688@garage.freebsd.pl> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20070427173641.GB51688@garage.freebsd.pl> User-Agent: Mutt/1.4.2i X-Zen: Oooommmmmmmmmmmmmmmmmmmmmmm Cc: freebsd-fs@FreeBSD.org Subject: Re: NanoBSD with ZFS X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 27 Apr 2007 18:27:19 -0000 Hello Pawel, Eines schoenen Tages schrieb Pawel Jakub Dawidek: [..] > > Unfortunatly not! "zpool create" tries to write to /boot/zfs/.zpool.cache > > (possibly a temporary) which cannot be written. If I symlink > > /boot/zfs/.zpool.cache -> /etc/zfs/.zpool.cache, I end up with the > > cache being written to /etc/zfs/.zpool.cache. This file however is then not > > copied or moved to /etc/zfs/zpool.cache, but of the symlinks. > > If I link /boot/zfs/.zpool.cache to /etc/zfs/zpool.cache, the file is > > populated. > > After a reboot however the file, which was copied there by the rc.initdiskless, > > seems not to containt, what zfs expects, since the filesystems are not > > mounted and I need to import the pool by hand. > > And /boot/zfs -> /etc/zfs symlink? Ok, this solved the problem with the temporary file. I should have tried that by myself. ;) The filesystems are still not mounted after reboot. This is, because I preloaded the zfs.ko module. ZFS seems to try to load the cache, but rc.initdiskless has not been run and therefore there is no zpool.cache file. If I load the the module from a rc.d script, which needs to be run before rc.d/zfs, it works as expected. If the loader could preload files from a different partition (ffs, w/o bsdlabel), it would be possibe to preload the module. My first experiments however failed. But since it works the way I described above this feature would be nice to have, but is not mandatory ;) Thanks, Oliver -- -------------------------------------------------------- And remember: "To Infinity And Far Beyond ... Somehow?!" Hi! I'm a .signature virus! Copy me in your ~/.signature to help me spread! <- Save this lifeform ;-) From owner-freebsd-fs@FreeBSD.ORG Fri Apr 27 20:22:18 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id CA52A16A400 for ; Fri, 27 Apr 2007 20:22:18 +0000 (UTC) (envelope-from staalebk@ifi.uio.no) Received: from smtp.bluecom.no (smtp.bluecom.no [193.75.75.28]) by mx1.freebsd.org (Postfix) with ESMTP id 8D58513C448 for ; Fri, 27 Apr 2007 20:22:16 +0000 (UTC) (envelope-from staalebk@ifi.uio.no) Received: from eschew.pusen.org (unknown [193.69.145.10]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (No client certificate requested) by smtp.bluecom.no (Postfix) with ESMTP id E876512C7DA for ; Fri, 27 Apr 2007 22:22:14 +0200 (CEST) Received: from chiller by eschew.pusen.org with local (Exim 4.50) id 1HhWxS-0004gb-I8 for freebsd-fs@freebsd.org; Fri, 27 Apr 2007 22:22:22 +0200 Date: Fri, 27 Apr 2007 22:22:22 +0200 From: =?iso-8859-1?Q?St=E5le?= Kristoffersen To: freebsd-fs@freebsd.org Message-ID: <20070427202222.GA26824@eschew.pusen.org> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit User-Agent: Mutt/1.5.13 (2006-08-11) Subject: ZFS performance X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 27 Apr 2007 20:22:18 -0000 I'm having trouble with performance using ZFS as the filesystem. I earlier ran UFS and had no problems pushing 50MB/s trough the network. Now with ZFS i even have problems reading 15MB/s locally. From the output of iostat and zpool iostat it looks like it reads about 2 times as much data from the disc compared to how much the program receive. (using dd, ftp or samba) Is there anything I could check? I've tried some sysctl settings: kern.ipc.shm_use_phys=1 vfs.vmiodirenable=1 vfs.hirunningspace=10485760 vfs.lorunningspace=10485760 net.inet.tcp.sendspace=65536 net.inet.tcp.recvspace=65536 net.inet.tcp.delayed_ack=0 but that did not do much difference. -- Ståle Kristoffersen staalebk@ifi.uio.no From owner-freebsd-fs@FreeBSD.ORG Sat Apr 28 00:31:09 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 8593D16A400 for ; Sat, 28 Apr 2007 00:31:09 +0000 (UTC) (envelope-from staalebk@ifi.uio.no) Received: from smtp.bluecom.no (smtp.bluecom.no [193.75.75.28]) by mx1.freebsd.org (Postfix) with ESMTP id 462CB13C45B for ; Sat, 28 Apr 2007 00:31:08 +0000 (UTC) (envelope-from staalebk@ifi.uio.no) Received: from eschew.pusen.org (unknown [193.69.145.10]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (No client certificate requested) by smtp.bluecom.no (Postfix) with ESMTP id 80C0016F574 for ; Sat, 28 Apr 2007 02:31:07 +0200 (CEST) Received: from chiller by eschew.pusen.org with local (Exim 4.50) id 1HhaqJ-0000Vj-LZ for freebsd-fs@freebsd.org; Sat, 28 Apr 2007 02:31:15 +0200 Date: Sat, 28 Apr 2007 02:31:15 +0200 From: =?iso-8859-1?Q?St=E5le?= Kristoffersen To: freebsd-fs@freebsd.org Message-ID: <20070428003115.GA1003@eschew.pusen.org> References: <20070427202222.GA26824@eschew.pusen.org> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20070427202222.GA26824@eschew.pusen.org> User-Agent: Mutt/1.5.13 (2006-08-11) Subject: Re: ZFS performance X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 28 Apr 2007 00:31:09 -0000 On 2007-04-27 at 22:22, Ståle Kristoffersen wrote: > I'm having trouble with performance using ZFS as the filesystem. > I earlier ran UFS and had no problems pushing 50MB/s trough the network. > Now with ZFS i even have problems reading 15MB/s locally. From the output > of iostat and zpool iostat it looks like it reads about 2 times as much > data from the disc compared to how much the program receive. (using dd, ftp > or samba) cvsup'ed, and buildt a new kernel and now the problem is gone, sorry about the noise. -- Ståle Kristoffersen staalebk@ifi.uio.no From owner-freebsd-fs@FreeBSD.ORG Sat Apr 28 23:39:39 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 5427716A407 for ; Sat, 28 Apr 2007 23:39:39 +0000 (UTC) (envelope-from cristi@net.utcluj.ro) Received: from bavaria.utcluj.ro (bavaria.utcluj.ro [193.226.5.35]) by mx1.freebsd.org (Postfix) with ESMTP id 0B04D13C45B for ; Sat, 28 Apr 2007 23:39:38 +0000 (UTC) (envelope-from cristi@net.utcluj.ro) Received: from localhost (localhost [127.0.0.1]) by bavaria.utcluj.ro (Postfix) with ESMTP id BF80150894 for ; Sun, 29 Apr 2007 02:19:06 +0300 (EEST) X-Virus-Scanned: by the daemon playing with your mail on bavaria.utcluj.ro Received: from bavaria.utcluj.ro ([127.0.0.1]) by localhost (bavaria.utcluj.ro [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id NLzsO9XQWUZx for ; Sun, 29 Apr 2007 02:19:02 +0300 (EEST) Received: from intranet.utcluj.ro (localhost [IPv6:::1]) by bavaria.utcluj.ro (Postfix) with ESMTP id 569AF50893 for ; Sun, 29 Apr 2007 02:19:02 +0300 (EEST) Received: from cl-86-125-188-48.cablelink.mures.rdsnet.ro ([86.125.188.48]) (SquirrelMail authenticated user cristiklein) by intranet.utcluj.ro with HTTP; Sun, 29 Apr 2007 02:19:02 +0300 (EEST) Message-ID: <59558.86.125.188.48.1177802342.squirrel@intranet.utcluj.ro> Date: Sun, 29 Apr 2007 02:19:02 +0300 (EEST) From: "Cristian KLEIN" To: freebsd-fs@freebsd.org User-Agent: SquirrelMail/1.5.1 MIME-Version: 1.0 Content-Type: text/plain;charset=iso-8859-2 Content-Transfer-Encoding: 8bit Subject: panic: softdep_setup_inomapdep: found inode already exists in 6.2 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 28 Apr 2007 23:39:39 -0000 Hi everybody, I am running a FreeBSD 6.2-p3, on which I am experiencing exactly the same simtoms as one item of the TODO list of 6.0: http://www.freebsd.org/releases/6.0R/todo.html panic: softdep_setup_inomapdep: found inode Needs testing Tor Egge Found by stress tests at http://www.holm.cc/stress/log/cons138.html Does anybody know whether this bug should have been solved in 6.2? Should I file a PR? Thanks.