From owner-freebsd-stable Sun Mar 14 10:45: 8 1999 Delivered-To: freebsd-stable@freebsd.org Received: from solaris.matti.ee (solaris.matti.ee [194.126.98.135]) by hub.freebsd.org (Postfix) with ESMTP id 9A8091503E for ; Sun, 14 Mar 1999 10:45:04 -0800 (PST) (envelope-from vallo@matti.ee) Received: from myhakas.matti.ee (postfix@myhakas.matti.ee [194.126.114.87]) by solaris.matti.ee (8.8.8/8.8.8.s) with ESMTP id UAA17999; Sun, 14 Mar 1999 20:44:44 +0200 (EET) Received: by myhakas.matti.ee (Postfix, from userid 1000) id A5492D3; Sun, 14 Mar 1999 20:44:44 +0200 (EET) Message-ID: <19990314204444.A67104@matti.ee> Date: Sun, 14 Mar 1999 20:44:44 +0200 From: Vallo Kallaste To: freebsd-stable@freebsd.org Cc: grog@lemis.com Subject: 3.1-stable crash: is it Vinum or what..? Reply-To: vallo@matti.ee Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Mailer: Mutt 0.93.2i Organization: =?iso-8859-1?Q?AS_Matti_B=FCrootehnika?= Sender: owner-freebsd-stable@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.ORG Hello ! We plan to move some machines to 3.1-STABLE soon and use now-in-beta status Vinum for striping. The first shot was to install test machine and try the Vinum. Well, I can crash the test machine within 15 minutes doing make -j6 -DCLOBBER -DNOGAMES -DNOAOUT buildworld with MAKEOBJDIRPREFIX pointing to striped volume. I hooked up another machine for serial console and got traceback from DDB and dump also. Here's results using guidelines from man 4 vinum: BIOS basemem: 639K, extmem: 48128K (from 0xe801 call) Copyright (c) 1992-1999 FreeBSD Inc. Copyright (c) 1982, 1986, 1989, 1991, 1993 The Regents of the University of California. All rights reserved. FreeBSD 3.1-STABLE #0: Sun Mar 14 18:28:33 EET 1999 root@vokk.matti.ee:/usr/src/sys/compile/Vokk Timecounter "i8254" frequency 1193300 Hz Timecounter "TSC" frequency 300711627 Hz CPU: Pentium II/Xeon/Celeron (300.71-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0x651 Stepping=1 Features=0x183f9ff> real memory = 50331648 (49152K bytes) avail memory = 46186496 (45104K bytes) Preloaded elf kernel "kernel" at 0xf02a0000. Probing for devices on PCI bus 0: chip0: rev 0x03 on pci0.0.0 chip1: rev 0x03 on pci0.1.0 chip2: rev 0x02 on pci0.2.0 ide_pci0: rev 0x01 on pci0.2.1 chip3: rev 0x02 on pci0.2.3 fxp0: rev 0x05 int a irq 11 on pci0.14.0 fxp0: Ethernet address 00:90:27:1c:f1:6d Probing for devices on PCI bus 1: vga0: rev 0x3a on pci1.0.0 Probing for PnP devices: Probing for devices on the ISA bus: sc0 on isa sc0: VGA color <8 virtual consoles, flags=0x0> atkbdc0 at 0x60-0x6f on motherboard atkbd0 irq 1 on isa psm0 irq 12 on isa psm0: model Generic PS/2 mouse, device ID 0 sio0 at 0x3f8-0x3ff irq 4 flags 0x10 on isa sio0: type 16550A, console sio1 at 0x2f8-0x2ff irq 3 on isa sio1: type 16550A pcm0 not found ppc0 at 0x378 irq 7 on isa ppc0: Generic chipset (EPP/NIBBLE) in COMPATIBLE mode nlpt0: on ppbus 0 nlpt0: Interrupt-driven port ppi0: on ppbus 0 plip0: on ppbus 0 wdc0 at 0x1f0-0x1f7 irq 14 flags 0xa0ffa0ff on isa wdc0: unit 0 (wd0): , DMA, 32-bit, multi-block-16 wd0: 3079MB (6306048 sectors), 6256 cyls, 16 heads, 63 S/T, 512 B/S wdc0: unit 1 (wd1): , DMA, 32-bit, multi-block-16 wd1: 2445MB (5008500 sectors), 5300 cyls, 15 heads, 63 S/T, 512 B/S wdc1 at 0x170-0x177 irq 15 flags 0xa0ffa0ff on isa wdc1: unit 0 (wd2): , DMA, 32-bit, multi-block-16 wd2: 2445MB (5008500 sectors), 5300 cyls, 15 heads, 63 S/T, 512 B/S fdc0 at 0x3f0-0x3f7 irq 6 drq 2 on isa fdc0: FIFO enabled, 8 bytes threshold fd0: 1.44MB 3.5in vga0 at 0x3b0-0x3df maddr 0xa0000 msize 131072 on isa npx0 on motherboard npx0: INT 16 interface changing root device to wd0s1a vinum: loaded vinum: reading configuration from /dev/wd2s1h vinum: updating configuration from /dev/wd1s1h rm: /dev/vinum/drive/drive1: Read-only file system rm: /dev/vinum/drive/drive2: Read-only file system rm: /dev/vinum/drive: Read-only file system rm: /dev/vinum/plex/svol.p0: Read-only file system rm: /dev/vinum/plex: Read-only file system rm: /dev/vinum/sd/svol.p0.s0: Read-only file system rm: /dev/vinum/sd/svol.p0.s1: Read-only file system rm: /dev/vinum/sd: Read-only file system rm: /dev/vinum/rsd/svol.p0.s0: Read-only file system rm: /dev/vinum/rsd/svol.p0.s1: Read-only file system rm: /dev/vinum/rsd: Read-only file system rm: /dev/vinum/vol/svol: Read-only file system rm: /dev/vinum/vol/svol.plex/svol.p0: Read-only file system rm: /dev/vinum/vol/svol.plex/svol.p0.sd/svol.p0.s0: Read-only file system rm: /dev/vinum/vol/svol.plex/svol.p0.sd/svol.p0.s1: Read-only file system rm: /dev/vinum/vol/svol.plex/svol.p0.sd: Read-only file system rm: /dev/vinum/vol/svol.plex: Read-only file system rm: /dev/vinum/vol: Read-only file system rm: /dev/vinum/rvol/svol: Read-only file system rm: /dev/vinum/rvol: Read-only file system rm: /dev/vinum/control: Read-only file system rm: /dev/vinum/svol: Read-only file system rm: /dev/vinum/rsvol: Read-only file system rm: /dev/vinum: Read-only file system rm: /dev/rvinum/svol: Read-only file system rm: /dev/rvinum: Read-only file system Can't create /dev/vinum/control: File exists Can't create /dev/vinum/svol: File exists Can't create /dev/rvinum/svol: File exists Can't create /dev/vinum/rsvol: File exists Can't create /dev/vinum/vol/svol: File exists Can't create /dev/vinum/rvol/svol: File exists Can't create /dev/vinum/vol/svol.plex: File exists Can't create /dev/vinum/vol/svol.plex/svol.p0: File exists Can't create /dev/vinfum/plex/svol.p0:f File exists Casn't create /dev/_vinum/vol/svol.pmlex/svol.p0.sd: oFile exists Canu't create /dev/vninum/vol/svol.pltex/svol.p0.sd/svfol.p0.s0: File esxists Can't cre:ate /dev/vinum/s d/svol.p0.s0: Fisle exists Can'tu create /dev/vinpum/rsd/svol.p0.se0: File exists rCan't create /debv/vinum/vol/svoll.plex/svol.p0.sdo/svol.p0.s1: Filce exists Can't kcreate /dev/vinu m/sd/svol.p0.s1:u File exists Capn't create /dev/dvinum/rsd/svol.pa0.s1: File existts ln: /dev/vinuem/drive/drive1: dFile exists ln: /dev/vinum/drivfe/drive2: File eoxists swapon: ardding /dev/wd0s1 b as swap devices swapon: addingo /dev/wd1s1b as fswap device swatpon: adding /dev /wd2s1b as swap udevice Automatipc reboot in progdress... /dev/rwad0s1a: FILESYSTEtM CLEAN; SKIPPINeG CHECKS 07613 free (229 lean, 1 frags, 13423 blocks, 0.2% fragmentation) /dev/rwd0s1e: FILESYSTEM CLEAN; SKIPPING CHECKS /dev/rwd0s1e: clean, 118525 free (69 frags, 14807 blocks, 0.1% fragmentation) /dev/rwd0s1f: FILESYSTEM CLEAN; SKIPPING CHECKS /dev/rwd0s1f: clean, 2418736 free (50240 frags, 296062 blocks, 1.8% fragmentation) ffs_mountfs: superblock updated for soft updates Doing initial network setup: hostname. lo0: flags=8049 mtu 16384 inet 127.0.0.1 netmask 0xff000000 fxp0: flags=8843 mtu 1500 inet 194.126.114.89 netmask 0xfffffff0 broadcast 194.126.114.95 ether 00:90:27:1c:f1:6d media: autoselect (100baseTX ) status: active supported media: autoselect 100baseTX 100baseTX 10baseT/UTP 10baseT/UTP add net default: gateway 194.126.114.81 Additional routing options:. routing daemons:. Mounting NFS file systems. clearing /tmp additional daemons: syslogd. checking for core dump...savecore: no core dump Doing additional network setup:. Starting final network daemons:. setting ELF ldconfig path: /usr/lib /usr/lib/compat /usr/local/lib setting a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout starting standard daemons: inetd cron. Initial rc.i386 initialization:. rc.i386 configuring syscons: keymap keyrate cursor font8x16 font8x14 font8x8 blank_time screensaver moused allscreens. Local package initialization:. Sun Mar 14 18:52:37 EET 1999 Fatal trap 12: page fault while in kernel mode fault virtual address = 0xdeadc0e6 fault code = supervisor read, page not present instruction pointer = 0x8:0xf0a1b380 stack pointer = 0x10:0xf4623bfc frame pointer = 0x10:0xf4623c0c code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, def32 1, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 13402 (mkdir) interrupt mask = kernel: type 12 trap, code=0 Stopped at 0xf0a1b380: movw 0x8(%edi),%ax db> trace _end(f0cdde40,0,f19353c8,f19353c8,f0cccc00) at 0xf0a1b380 _end(f19353c8,0,f19353c8,f4623c54,f0163832) at 0xf0a1b235 _end(f19353c8,f19353c8,f4623c60,f0162fb1,f4623c88) at 0xf0a1b00a spec_strategy(f4623c88,f4623c6c,f01c8ff5,f4623c88,f4623ca4) at spec_strategy+0x3e spec_vnoperate(f4623c88,f4623ca4,f01c89af,f4623c88,10010) at spec_vnoperate+0x15 ufs_vnoperatespec(f4623c88,10010,f19353c8,80000000,f0cccc00) at ufs_vnoperatespec+0x15 ufs_strategy(f4623cc8,f4623cd4,f0150547,f4623cc8,0) at ufs_strategy+0xd3 ufs_vnoperate(f4623cc8) at ufs_vnoperate+0x15 bwrite(f19353c8,f4623cec,f0154a89,f4623d20,f4623cf8) at bwrite+0xaf vop_stdbwrite(f4623d20,f4623cf8,f01c8fc5,f4623d20,f4623e68) at vop_stdbwrite+0xe vop_defaultop(f4623d20,f4623e68,f01c81f1,f4623d20,f4623e8c) at vop_defaultop+0x15 ufs_vnoperate(f4623d20,f4623e8c,f4623ef4,f4623f54,f0cdb800) at ufs_vnoperate+0x15 ufs_mkdir(f4623e8c,f4623f54,f015c71e,f4623e8c,f461ba40) at ufs_mkdir+0x385 ufs_vnoperate(f4623e8c,f461ba40,f022eac8,2,f022d640) at ufs_vnoperate+0x15 mkdir(f461ba40,f4623f84) at mkdir+0x192 syscall(27,27,12,1,efbfd934) at syscall+0x127 Xint0x80_syscall() at Xint0x80_syscall+0x2c db> panic panic: from debugger Debugger("panic") Stopped at 0xf0a1b380: movw 0x8(%edi),%ax db> c Fatal trap 12: page fault while in kernel mode fault virtual address = 0xdeadc0e6 fault code = supervisor read, page not present instruction pointer = 0x8:0xf0a1b380 stack pointer = 0x10:0xf4623bfc frame pointer = 0x10:0xf4623c0c code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, def32 1, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 13402 (mkdir) interrupt mask = kernel: type 12 trap, code=0 Stopped at 0xf0a1b380: movw 0x8(%edi),%ax db> c Fatal trap 12: page fault while in kernel mode fault virtual address = 0xdeadc0e6 fault code = supervisor read, page not present instruction pointer = 0x8:0xf0a1b380 stack pointer = 0x10:0xf4623bfc frame pointer = 0x10:0xf4623c0c code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, def32 1, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 13402 (mkdir) interrupt mask = kernel: type 12 trap, code=0 Stopped at 0xf0a1b380: movw 0x8(%edi),%ax db> panic panic: from debugger dumping to dev 20001, offset 32768 dump 47 46 45 44 43 42 41 40 39 38 37 36 35 34 33 32 31 30 29 28 27 26 25 24 23 22 21 20 19 18 17 16 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 0 succeeded Automatic reboot in 30 seconds - press a key on the console to abort Rebooting... sh-2.02# gdb -k kernel.gdb vmcore.0 GDB is free software and you are welcome to distribute copies of it under certain conditions; type "show copying" to see the conditions. There is absolutely no warranty for GDB; type "show warranty" for details. GDB 4.16 (i386-unknown-freebsd), Copyright 1996 Free Software Foundation, Inc... IdlePTD 2793472 initial pcb at 241304 panicstr: from debugger panic messages: --- Fatal trap 12: page fault while in kernel mode fault virtual address = 0xdeadc0e6 fault code = supervisor read, page not present instruction pointer = 0x8:0xf0a1b380 stack pointer = 0x10:0xf4623bfc frame pointer = 0x10:0xf4623c0c code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, def32 1, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 13402 (mkdir) interrupt mask = panic: from debugger Fatal trap 12: page fault while in kernel mode fault virtual address = 0xdeadc0e6 fault code = supervisor read, page not present instruction pointer = 0x8:0xf0a1b380 stack pointer = 0x10:0xf4623bfc frame pointer = 0x10:0xf4623c0c code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, def32 1, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 13402 (mkdir) interrupt mask = Fatal trap 12: page fault while in kernel mode fault virtual address = 0xdeadc0e6 fault code = supervisor read, page not present instruction pointer = 0x8:0xf0a1b380 stack pointer = 0x10:0xf4623bfc frame pointer = 0x10:0xf4623c0c code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, def32 1, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 13402 (mkdir) interrupt mask = panic: from debugger dumping to dev 20001, offset 32768 dump 47 46 45 44 43 42 41 40 39 38 37 36 35 34 33 32 31 30 29 28 27 26 25 24 23 22 21 20 19 18 17 16 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 --- #0 boot (howto=260) at ../../kern/kern_shutdown.c:285 285 dumppcb.pcb_cr3 = rcr3(); (kgdb) add-symbol-file /modules/vinum.ko 0x000059c0+0xf0a0f000 add symbol table from file "/modules/vinum.ko" at text_addr = 0xf0a149c0? (y or n) y (kgdb) bt #0 boot (howto=260) at ../../kern/kern_shutdown.c:285 #1 0xf0132879 in panic (fmt=0xf02130f0 "from debugger") at ../../kern/kern_shutdown.c:446 #2 0xf0118c5d in db_panic (addr=-257838208, have_addr=0, count=-1, modif=0xf4623a80 "") at ../../ddb/db_command.c:432 #3 0xf0118bfd in db_command (last_cmdp=0xf022dc9c, cmd_table=0xf022dafc, aux_cmd_tablep=0xf023eff0) at ../../ddb/db_command.c:332 #4 0xf0118cc2 in db_command_loop () at ../../ddb/db_command.c:454 #5 0xf011b013 in db_trap (type=12, code=0) at ../../ddb/db_trap.c:71 #6 0xf01e6096 in kdb_trap (type=12, code=0, regs=0xf4623bc0) at ../../i386/i386/db_interface.c:157 #7 0xf01f04cc in trap_fatal (frame=0xf4623bc0, eva=3735929062) at ../../i386/i386/trap.c:937 #8 0xf01f01ab in trap_pfault (frame=0xf4623bc0, usermode=0, eva=3735929062) at ../../i386/i386/trap.c:835 #9 0xf01efe0a in trap (frame={tf_es = 16, tf_ds = 16, tf_edi = -559038242, tf_esi = -2147483648, tf_ebp = -194888692, tf_isp = -194888728, tf_ebx = -255801832, tf_edx = 0, tf_ecx = 0, tf_eax = -16162, tf_trapno = 12, tf_err = 0, tf_eip = -257838208, tf_cs = 8, tf_eflags = 66182, tf_esp = -257904640, tf_ss = -242003000}) at ../../i386/i386/trap.c:437 #10 0xf0a1b380 in launch_requests (rq=0xf0cdde40, reviveok=0) at /usr/src/sys/modules/vinum/../../dev/vinum/vinumrequest.c:368 #11 0xf0a1b235 in vinumstart (bp=0xf19353c8, reviveok=0) ---Type to continue, or q to quit--- at /usr/src/sys/modules/vinum/../../dev/vinum/vinumrequest.c:300 #12 0xf0a1b00a in vinumstrategy (bp=0xf19353c8) at /usr/src/sys/modules/vinum/../../dev/vinum/vinumrequest.c:151 #13 0xf0163832 in spec_strategy (ap=0xf4623c88) at ../../miscfs/specfs/spec_vnops.c:540 #14 0xf0162fb1 in spec_vnoperate (ap=0xf4623c88) at ../../miscfs/specfs/spec_vnops.c:129 #15 0xf01c8ff5 in ufs_vnoperatespec (ap=0xf4623c88) at ../../ufs/ufs/ufs_vnops.c:2317 #16 0xf01c89af in ufs_strategy (ap=0xf4623cc8) at vnode_if.h:891 #17 0xf01c8fc5 in ufs_vnoperate (ap=0xf4623cc8) at ../../ufs/ufs/ufs_vnops.c:2299 #18 0xf0150547 in bwrite (bp=0xf19353c8) at vnode_if.h:891 #19 0xf0154c3e in vop_stdbwrite (ap=0xf4623d20) at ../../kern/vfs_default.c:296 #20 0xf0154a89 in vop_defaultop (ap=0xf4623d20) at ../../kern/vfs_default.c:130 #21 0xf01c8fc5 in ufs_vnoperate (ap=0xf4623d20) at ../../ufs/ufs/ufs_vnops.c:2299 #22 0xf01c81f1 in ufs_mkdir (ap=0xf4623e8c) at vnode_if.h:1145 #23 0xf01c8fc5 in ufs_vnoperate (ap=0xf4623e8c) at ../../ufs/ufs/ufs_vnops.c:2299 #24 0xf015c71e in mkdir (p=0xf461ba40, uap=0xf4623f84) at vnode_if.h:611 #25 0xf01f06db in syscall (frame={tf_es = 39, tf_ds = 39, tf_edi = 18, tf_esi = 1, tf_ebp = -272639692, tf_isp = -194887724, tf_ebx = -272639302, tf_edx = -1, tf_ecx = 2, tf_eax = 136, ---Type to continue, or q to quit--- tf_trapno = 7, tf_err = 2, tf_eip = 134516284, tf_cs = 31, tf_eflags = 514, tf_esp = -272639824, tf_ss = 39}) at ../../i386/i386/trap.c:1100 #26 0xf01e69ec in Xint0x80_syscall () #27 0x804823b in ?? () #28 0x80480e9 in ?? () (kgdb) f 1 #1 0xf0132879 in panic (fmt=0xf02130f0 "from debugger") at ../../kern/kern_shutdown.c:446 446 boot(bootopt); (kgdb) quit sh-2.02# exit Here's kernel config: # Vokk machine "i386" ident Vokk maxusers 80 options PQ_NOOPT # color for 512k/16k cache config kernel root on wd0 cpu "I686_CPU" # aka Pentium Pro(tm) options "NO_F00F_HACK" options "COMPAT_43" options SYSVSHM options SYSVSEM options SYSVMSG options "MD5" options "VM86" options DDB options INVARIANTS options INVARIANT_SUPPORT options UCONSOLE options INET #Internet communications protocols pseudo-device ether #Generic Ethernet pseudo-device loop #Network loopback device pseudo-device bpfilter 4 #Berkeley packet filter options "ICMP_BANDLIM" options FFS #Fast filesystem options NFS #Network File System options "CD9660" #ISO 9660 filesystem options MSDOSFS #MS DOS File System options PROCFS #Process filesystem options FFS_ROOT #FFS usable as root device options SOFTUPDATES options "P1003_1B" options "_KPOSIX_PRIORITY_SCHEDULING" options "_KPOSIX_VERSION=199309L" pseudo-device pty 32 #Pseudo ttys - can go as high as 256 pseudo-device vn 2 #Vnode driver (turns a file into a device) pseudo-device snp 3 #Snoop device - to look at pty/vty/etc.. options "MSGBUF_SIZE=40960" controller isa0 controller pnp0 device atkbdc0 at isa? port IO_KBD tty device atkbd0 at isa? tty irq 1 device psm0 at isa? tty irq 12 device vga0 at isa? port ? conflicts pseudo-device splash device sc0 at isa? tty options MAXCONS=8 # number of virtual consoles options SC_HISTORY_SIZE=600 # number of history buffer lines options VESA # needs VM86 defined too!! device npx0 at isa? port IO_NPX iosiz 0x0 flags 0x0 irq 13 controller wdc0 at isa? port "IO_WD1" bio irq 14 flags 0xa0ffa0ff disk wd0 at wdc0 drive 0 disk wd1 at wdc0 drive 1 controller wdc1 at isa? port "IO_WD2" bio irq 15 flags 0xa0ffa0ff disk wd2 at wdc1 drive 0 disk wd3 at wdc1 drive 1 options ATAPI #Enable ATAPI support for IDE bus options ATAPI_STATIC #Don't do it as an LKM options IDE_DELAY=2000 # Be optimistic about Joe IDE device device acd0 controller fdc0 at isa? port "IO_FD1" bio irq 6 drq 2 disk fd0 at fdc0 drive 0 device sio0 at isa? port "IO_COM1" tty flags 0x10 irq 4 device sio1 at isa? port "IO_COM2" tty irq 3 device pcm0 at isa? port ? tty irq ? drq ? controller pci0 device fxp0 controller ppbus0 device nlpt0 at ppbus? device plip0 at ppbus? device ppi0 at ppbus? controller ppc0 at isa? port ? tty irq 7 options CLK_CALIBRATION_LOOP options "CLK_USE_I8254_CALIBRATION" options CLK_USE_TSC_CALIBRATION #options COMPAT_LINUX options PANIC_REBOOT_WAIT_TIME=30 Vinum config: # mingi konf vinumile # Kettad drive drive1 device /dev/wd1s1h drive drive2 device /dev/wd2s1h # Volume u"he stripitud plexiga volume svol plex org striped 128k sd length 2379m drive drive1 sd length 2379m drive drive2 All filesystems except the vinum volume are mounted with softupdates. The filesystem on the volume is async mounted, no softupdates. Swap is spread over the three disks, 64MB each. I'm not clever enough to analyse this situation, is it caused by Vinum or something else? In fact the machine doesn't crash with inactive volume. Yet another note, after crashing the filesystem which resides on the vinum volume never get fixed by fsck. it complains: fsck: cannot find inode XXXXXX Thanks -- Vallo Kallaste vallo@matti.ee To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-stable" in the body of the message