Date: Mon, 24 Mar 2008 16:50:09 -0700 From: Bert JW Regeer <xistence@0x58.com> Cc: FreeBSD Hackers <freebsd-hackers@freebsd.org> Subject: Re: zpool scrub tank && high file system activity caused crash Message-ID: <A456AD91-1B23-4A37-BA62-5711A44C4C92@0x58.com> In-Reply-To: <CB3FE976-9726-4F15-8F30-05E1E54A1610@0x58.com> References: <CB3FE976-9726-4F15-8F30-05E1E54A1610@0x58.com>
next in thread | previous in thread | raw e-mail | index | archive | help
On Mar 24, 2008, at 16:23 , Bert JW Regeer wrote:
> Hey guys,
>
> I am running FreeBSD 7.0-RELEASE with GENERIC on a AMD XP Athlon
> 3500+ with 1267 MB of ram, and a GigBit NIC. I am testing out ZFS
> just for the hell of it, I know, 32 bit is not suggested and runs
> badly, but it does what it needs to do.
>
> I was copying large amounts of data for backup purposes from my
> MacBook Pro to the machine over FTP. At the time I was looking
> around the man page for zpool, and figured I'd run a zpool scrub
> just to see how badly it affects performance. It affects it in that
> it takes down the machine with a dump.
>
> [...]
>
> Please let me know if you need any additional information from the
> dump file. Give me commands and I shall be your terminal :P
>
> keyhole# zpool list
> NAME SIZE USED AVAIL CAP HEALTH
> ALTROOT
> tank 374G 180G 194G 48% ONLINE -
> keyhole# zpool status
> pool: tank
> state: ONLINE
> scrub: none requested
> config:
>
> NAME STATE READ WRITE CKSUM
> tank ONLINE 0 0 0
> ad2 ONLINE 0 0 0
> ad3 ONLINE 0 0 0
> ad4 ONLINE 0 0 0
> ad6 ONLINE 0 0 0
>
> errors: No known data errors
> keyhole# zfs list
> NAME USED AVAIL REFER MOUNTPOINT
> tank 180G 188G 18K /tank
> tank/archive 33.3G 188G 33.3G /usr/archive
> tank/media 146G 188G 146G /usr/media
>
>
> Bert JW Regeer
It crashed again, this time while vsftpd was running, which is the
FTPD I am using to drop the files on the server. I am going to be
going back to gconcat and friends for now.
I will keep the dumps around if anyone needs me to run any commands on
it, and find out more information!
keyhole# kgdb kernel.debug /var/crash/vmcore.1
[GDB will not be able to debug user-mode threads: /usr/lib/
libthread_db.so: Undefined symbol "ps_pglobal_lookup"]
GNU gdb 6.1.1 [FreeBSD]
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and
you are
welcome to change it and/or distribute copies of it under certain
conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for
details.
This GDB was configured as "i386-marcel-freebsd".
Unread portion of the kernel message buffer:
Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address = 0x2000020
fault code = supervisor read, page not present
instruction pointer = 0x20:0xc097b5f9
stack pointer = 0x28:0xe769e6c4
frame pointer = 0x28:0xe769e71c
code segment = base 0x0, limit 0xfffff, type 0x1b
= DPL 0, pres 1, def32 1, gran 1
processor eflags = interrupt enabled, resume, IOPL = 0
current process = 1281 (vsftpd)
trap number = 12
panic: page fault
cpuid = 0
Uptime: 39m11s
Physical memory: 1267 MB
Dumping 348 MB: 333 317 301 285 269 253 237 221 205 189 173 157 141
125 109 93 77 61 45 29 13
#0 doadump () at pcpu.h:195
195 __asm __volatile("movl %%fs:0,%0" : "=r" (td));
(kgdb) bt
#0 doadump () at pcpu.h:195
#1 0xc0754457 in boot (howto=260) at /usr/src/sys/kern/
kern_shutdown.c:409
#2 0xc0754719 in panic (fmt=Variable "fmt" is not available.
) at /usr/src/sys/kern/kern_shutdown.c:563
#3 0xc0a4905c in trap_fatal (frame=0xe769e684, eva=33554464) at /usr/
src/sys/i386/i386/trap.c:899
#4 0xc0a492e0 in trap_pfault (frame=0xe769e684, usermode=0,
eva=33554464) at /usr/src/sys/i386/i386/trap.c:812
#5 0xc0a49c8c in trap (frame=0xe769e684) at /usr/src/sys/i386/i386/
trap.c:490
#6 0xc0a2fc0b in calltrap () at /usr/src/sys/i386/i386/exception.s:139
#7 0xc097b5f9 in vm_page_splay (pindex=Unhandled dwarf expression
opcode 0x93
) at /usr/src/sys/vm/vm_page.c:590
#8 0xc097bb96 in vm_page_remove (m=0xc1ce2e30) at /usr/src/sys/vm/
vm_page.c:722
#9 0xc097bdb1 in vm_page_free_toq (m=0xc1ce2e30) at /usr/src/sys/vm/
vm_page.c:1291
#10 0xc097bf86 in vm_page_free (m=0xc1ce2e30) at /usr/src/sys/vm/
vm_page.c:498
#11 0xc0978860 in vm_object_page_remove (object=0xc0bed860,
start=53402, end=53434, clean_only=0) at /usr/src/sys/vm/vm_object.c:
1848
#12 0xc0973072 in vm_map_delete (map=Variable "map" is not available.
) at /usr/src/sys/vm/vm_map.c:2307
#13 0xc0973191 in vm_map_remove (map=0xc147108c, start=3438907392,
end=3439038464) at /usr/src/sys/vm/vm_map.c:2423
#14 0xc09707d0 in kmem_free (map=0xc147108c, addr=3438907392,
size=131072) at /usr/src/sys/vm/vm_kern.c:210
#15 0xc0967579 in page_free (mem=0xccf99000, size=131072, flags=34
'"') at /usr/src/sys/vm/uma_core.c:1042
#16 0xc096a8b7 in uma_large_free (slab=0xc5988980) at /usr/src/sys/vm/
uma_core.c:2727
#17 0xc074542b in free (addr=0xccf99000, mtp=0xc0da0440) at /usr/src/
sys/kern/kern_malloc.c:444
#18 0xc0d2d597 in ?? ()
#19 0xccf99000 in ?? ()
#20 0xc0da0440 in ?? ()
#21 0x00000000 in ?? ()
#22 0x00000001 in ?? ()
#23 0x00000000 in ?? ()
#24 0xc0da31c0 in ?? ()
#25 0x00000001 in ?? ()
#26 0xc59fa5f0 in ?? ()
#27 0xd06e4000 in ?? ()
#28 0x00000000 in ?? ()
#29 0xe769e8b4 in ?? ()
#30 0xc0d2d77e in ?? ()
#31 0x00000010 in ?? ()
#32 0xd06e4000 in ?? ()
#33 0xc59fa5f0 in ?? ()
#34 0xd06e4000 in ?? ()
#35 0xd06e4000 in ?? ()
#36 0x00007fff in ?? ()
#37 0xe769e8e4 in ?? ()
#38 0xc0d2eb43 in ?? ()
#39 0xc59fa5f0 in ?? ()
#40 0xc8ceac08 in ?? ()
#41 0x00000000 in ?? ()
#42 0xe769e8e4 in ?? ()
#43 0x0451b1fc in ?? ()
#44 0x165ec0e8 in ?? ()
#45 0x00000001 in ?? ()
#46 0xc59fa5f0 in ?? ()
#47 0x00000000 in ?? ()
#48 0x00000000 in ?? ()
#49 0xe769e914 in ?? ()
#50 0xc0d336a3 in ?? ()
#51 0xc59fa5f0 in ?? ()
#52 0xc8ceac08 in ?? ()
#53 0xffffffff in ?? ()
#54 0x00000691 in ?? ()
#55 0xc59fa5f0 in ?? ()
#56 0xc8ceac44 in ?? ()
#57 0xc8ceac08 in ?? ()
#58 0xc8ceac08 in ?? ()
#59 0x00000000 in ?? ()
#60 0xc4a45678 in ?? ()
#61 0xe769e93c in ?? ()
#62 0xc0d414e1 in ?? ()
#63 0xc8ceac08 in ?? ()
#64 0xc0d9723c in ?? ()
---Type <return> to continue, or q <return> to quit---
#65 0x00000002 in ?? ()
#66 0x00000000 in ?? ()
#67 0xc0d9723c in ?? ()
#68 0x0000097f in ?? ()
#69 0x00000000 in ?? ()
#70 0xc5150000 in ?? ()
#71 0xe769e9c4 in ?? ()
#72 0xc0d41914 in ?? ()
#73 0x0000097f in ?? ()
#74 0x00000000 in ?? ()
#75 0x00000000 in ?? ()
#76 0x00000001 in ?? ()
#77 0x00000011 in ?? ()
#78 0x00000000 in ?? ()
#79 0x00000002 in ?? ()
#80 0xc560d440 in ?? ()
#81 0x00000102 in ?? ()
#82 0xe769e988 in ?? ()
#83 0x12fde7e8 in ?? ()
#84 0x00000000 in ?? ()
#85 0xc560d440 in ?? ()
#86 0x00020000 in ?? ()
#87 0x0000097e in ?? ()
#88 0x00000000 in ?? ()
#89 0x00000000 in ?? ()
#90 0xe769e99c in ?? ()
#91 0xc4a45678 in ?? ()
#92 0x00000028 in ?? ()
#93 0x12fe0430 in ?? ()
#94 0x00000000 in ?? ()
#95 0xe769e9c4 in ?? ()
#96 0xc0d411e7 in ?? ()
#97 0xc588c700 in ?? ()
#98 0xc560d440 in ?? ()
#99 0x00000000 in ?? ()
#100 0xc588c700 in ?? ()
#101 0xe769e9b8 in ?? ()
#102 0xc560d440 in ?? ()
#103 0x00001c48 in ?? ()
#104 0x00000000 in ?? ()
#105 0xe769e9fc in ?? ()
#106 0xc0d41c03 in ?? ()
#107 0x00001c48 in ?? ()
#108 0x00000000 in ?? ()
#109 0x00000001 in ?? ()
#110 0x12fde7e8 in ?? ()
#111 0x00000000 in ?? ()
#112 0x00001c48 in ?? ()
#113 0x00000000 in ?? ()
#114 0x12fde7e8 in ?? ()
#115 0x00000000 in ?? ()
#116 0x12fe0430 in ?? ()
#117 0x00000000 in ?? ()
#118 0xc5bc984c in ?? ()
#119 0xe769eafc in ?? ()
#120 0xc0d900cc in ?? ()
#121 0xc588c700 in ?? ()
#122 0x000000b8 in ?? ()
#123 0x00000000 in ?? ()
#124 0x12fde7e8 in ?? ()
#125 0x00000000 in ?? ()
#126 0x00001c48 in ?? ()
#127 0x00000000 in ?? ()
#128 0xc56d8910 in ?? ()
#129 0xc4703e00 in ?? ()
---Type <return> to continue, or q <return> to quit---
#130 0xe769ea44 in ?? ()
#131 0xc0893664 in tcp_timer_activate (tp=0x10, timer_type=-798081024,
delta=3315574256) at /usr/src/sys/netinet/tcp_timer.c:599
Previous frame inner to this frame (corrupt stack?)
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?A456AD91-1B23-4A37-BA62-5711A44C4C92>