Date: Thu, 12 Mar 2009 11:40:53 +0000 From: Thomas Sparrevohn <Thomas.Sparrevohn@btinternet.com> To: freebsd-current@freebsd.org Subject: Re: IGMPv3 hot interface detach panics? Message-ID: <200903121140.53652.Thomas.Sparrevohn@btinternet.com> In-Reply-To: <49B89C70.4020504@incunabulum.net> References: <49B885A1.9000907@incunabulum.net> <20090312043239.GE25538@weongyo.cdnetworks.kr> <49B89C70.4020504@incunabulum.net>
next in thread | previous in thread | raw e-mail | index | archive | help
--Boundary-00=_FTPuJCsafTNphZf Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline On Thursday 12 March 2009 05:24:00 Bruce Simpson wrote: > Weongyo Jeong wrote: > > ... > > This is one I have got from "Paul B. Mahol" <onemda_at_gmail.com> > > yesterday and I think he might help you to get full backtrace: > > > Thanks for this. I really do need a full backtrace to work out what to > go on, however, > as it looks like the compiler is inlining static functions here. > I am getting a panic as well - but I am not sure its related --Boundary-00=_FTPuJCsafTNphZf Content-Type: text/x-diff; charset="iso 8859-15"; name="core.txt.55" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="core.txt.55" w2fzz0vc03.aah-go-on.com dumped core - see /var/crash/vmcore.55 Thu Mar 12 11:30:50 GMT 2009 FreeBSD w2fzz0vc03.aah-go-on.com 8.0-CURRENT FreeBSD 8.0-CURRENT #5 r189731: Thu Mar 12 11:03:16 GMT 2009 root@w2fzz0vc03.aah-go-on.com:/usr/obj/usr/src/sys/GENERIC amd64 panic: GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... Unread portion of the kernel message buffer: rum0: need multicast update callback Kernel page fault with the following non-sleepable locks held: exclusive sleep mutex if_addr_mtx (if_addr_mtx) r = 0 (0xffffff0002f8ac38) locked @ /usr/src/sys/netinet/igmp.c:1701 exclusive sleep mutex igmp_mtx (igmp_mtx) r = 0 (0xffffffff80d3f080) locked @ /usr/src/sys/netinet/igmp.c:1653 exclusive sleep mutex in_multi_mtx (in_multi_mtx) r = 0 (0xffffffff80d3f160) locked @ /usr/src/sys/netinet/igmp.c:1652 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a _witness_debugger() at _witness_debugger+0x49 witness_warn() at witness_warn+0x2ba trap() at trap+0x398 calltrap() at calltrap+0x8 --- trap 0xc, rip = 0xffffffff80603e2d, rsp = 0xfffffffe4003fa30, rbp = 0xfffffffe4003fb10 --- igmp_fasttimo() at igmp_fasttimo+0x2e5 pffasttimo() at pffasttimo+0x2a softclock() at softclock+0x2aa intr_event_execute_handlers() at intr_event_execute_handlers+0x68 ithread_loop() at ithread_loop+0xae fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xfffffffe4003fd30, rbp = 0 --- Fatal trap 12: page fault while in kernel mode cpuid = 2; apic id = 02 fault virtual address = 0x28 fault code = supervisor read data, page not present instruction pointer = 0x8:0xffffffff80603e2d stack pointer = 0x10:0xfffffffe4003fa30 frame pointer = 0x10:0xfffffffe4003fb10 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 12 (swi4: clock) Physical memory: 4077 MB Dumping 316 MB: 301 285 269 253 237 221 205 189 173 157 141 125 109 93 77 61 45 29 13 Reading symbols from /boot/kernel/zfs.ko...Reading symbols from /bootdir/boot/kernel/zfs.ko.symbols...done. done. Loaded symbols for /boot/kernel/zfs.ko Reading symbols from /boot/kernel/opensolaris.ko...Reading symbols from /bootdir/boot/kernel/opensolaris.ko.symbols...done. done. Loaded symbols for /boot/kernel/opensolaris.ko Reading symbols from /boot/kernel/linux.ko...Reading symbols from /bootdir/boot/kernel/linux.ko.symbols...done. done. Loaded symbols for /boot/kernel/linux.ko #0 doadump () at pcpu.h:215 215 pcpu.h: No such file or directory. in pcpu.h (kgdb) #0 doadump () at pcpu.h:215 #1 0xffffffff801c4d4c in db_fncall (dummy1=Variable "dummy1" is not available. ) at /usr/src/sys/ddb/db_command.c:548 #2 0xffffffff801c5081 in db_command (last_cmdp=0xffffffff80b46e20, cmd_table=Variable "cmd_table" is not available. ) at /usr/src/sys/ddb/db_command.c:445 #3 0xffffffff801c52c9 in db_command_loop () at /usr/src/sys/ddb/db_command.c:498 #4 0xffffffff801c7127 in db_trap (type=Variable "type" is not available. ) at /usr/src/sys/ddb/db_main.c:229 #5 0xffffffff805515f2 in kdb_trap (type=12, code=0, tf=0xfffffffe4003f980) at /usr/src/sys/kern/subr_kdb.c:534 #6 0xffffffff807d8fbd in trap_fatal (frame=0xfffffffe4003f980, eva=Variable "eva" is not available. ) at /usr/src/sys/amd64/amd64/trap.c:745 #7 0xffffffff807d9d10 in trap (frame=0xfffffffe4003f980) at /usr/src/sys/amd64/amd64/trap.c:289 #8 0xffffffff807b741e in calltrap () at /usr/src/sys/amd64/amd64/exception.S:217 #9 0xffffffff80603e2d in igmp_fasttimo () at /usr/src/sys/netinet/igmp.c:1806 #10 0xffffffff8057b268 in pffasttimo (arg=0xffffffff80d3f080) at /usr/src/sys/kern/uipc_domain.c:498 #11 0xffffffff805357fc in softclock (arg=Variable "arg" is not available. ) at /usr/src/sys/kern/kern_timeout.c:411 #12 0xffffffff805056a5 in intr_event_execute_handlers (p=Variable "p" is not available. ) at /usr/src/sys/kern/kern_intr.c:1134 #13 0xffffffff80506299 in ithread_loop (arg=0xffffff00024e2740) at /usr/src/sys/kern/kern_intr.c:1147 #14 0xffffffff805036aa in fork_exit ( callout=0xffffffff805061eb <ithread_loop>, arg=0xffffff00024e2740, frame=0xfffffffe4003fc80) at /usr/src/sys/kern/kern_fork.c:821 #15 0xffffffff807b786e in fork_trampoline () at /usr/src/sys/amd64/amd64/exception.S:553 #16 0x0000000000000000 in ?? () #17 0x0000000000000000 in ?? () #18 0x0000000000000001 in ?? () #19 0x0000000000000000 in ?? () #20 0x0000000000000000 in ?? () #21 0x0000000000000000 in ?? () #22 0x0000000000000000 in ?? () #23 0x0000000000000000 in ?? () #24 0x0000000000000000 in ?? () #25 0x0000000000000000 in ?? () #26 0x0000000000000000 in ?? () #27 0x0000000000000000 in ?? () #28 0x0000000000000000 in ?? () #29 0x0000000000000000 in ?? () #30 0x0000000000000000 in ?? () #31 0x0000000000000000 in ?? () #32 0x0000000000000000 in ?? () #33 0x0000000000000000 in ?? () #34 0x0000000000000000 in ?? () #35 0x0000000000000000 in ?? () #36 0x0000000000000000 in ?? () #37 0x0000000000000000 in ?? () #38 0x0000000000000000 in ?? () #39 0x0000000000000000 in ?? () #40 0x00000000010fb000 in ?? () #41 0x0000000000000000 in ?? () #42 0xffffffff80b84200 in tdq_cpu () #43 0xffffffff80b84200 in tdq_cpu () #44 0xffffff00024e7380 in ?? () #45 0xfffffffe4003fb80 in ?? () #46 0xfffffffe4003fb38 in ?? () #47 0xffffff00024f2380 in ?? () #48 0xffffffff805457f4 in sched_switch (td=0xffffff00024e2740, newtd=0xffffffff805061eb, flags=Variable "flags" is not available. ) at /usr/src/sys/kern/sched_ule.c:1867 Previous frame inner to this frame (corrupt stack?) (kgdb) ------------------------------------------------------------------------ ps -axl UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 0 0 0 0 -68 0 0 0 - DLs ?? 559927:24.00 [kernel] 0 1 0 0 52 0 2176 0 wait DLs ?? 2634574:00.00 [init] 0 2 0 0 -8 0 0 0 - DL ?? 961435:48.00 [g_event] 0 3 0 0 -8 0 0 0 - DL ?? 5012912:48.00 [g_up] 0 4 0 0 -8 0 0 0 - DL ?? 3852056:36.00 [g_down] 0 5 0 0 -16 0 0 0 tq->tq DL ?? 0:00.00 [system_tas 0 6 0 0 -16 0 0 0 tq->tq DL ?? 0:00.00 [system_tas 0 7 0 0 -16 0 0 0 tq->tq DL ?? 0:00.00 [system_tas 0 8 0 0 -16 0 0 0 tq->tq DL ?? 0:00.00 [system_tas 0 9 0 0 -16 0 0 0 ccb_sc DL ?? 0:00.00 [xpt_thrd] 0 10 0 0 -16 0 0 0 audit_ DL ?? 5215:24.00 [audit] 0 11 0 0 171 0 0 0 - RL ?? 4893199779:00.00 [idle] 0 12 0 0 -48 0 0 0 - WL ?? 112667074:48.00 [intr] 0 13 0 0 -16 0 0 0 - DL ?? 245109:24.00 [yarrow] 0 14 0 0 -16 0 0 0 - DL ?? 0:00.00 [fw0_probe] 0 15 0 0 -16 0 0 0 waitin DL ?? 449:00.00 [sctp_itera 0 16 0 0 -64 0 0 0 wmsg DL ?? 2806:00.00 [usbus0] 0 17 0 0 -68 0 0 0 wmsg DL ?? 77383:48.00 [usbus0] 0 18 0 0 -68 0 0 0 wmsg DL ?? 37286:24.00 [usbus0] 0 19 0 0 -64 0 0 0 wmsg DL ?? 317496:36.00 [usbus0] 0 20 0 0 -64 0 0 0 wmsg DL ?? 2935:36.00 [usbus1] 0 21 0 0 -68 0 0 0 wmsg DL ?? 1602929:36.00 [usbus1] 0 22 0 0 -68 0 0 0 wmsg DL ?? 44261:36.00 [usbus1] 0 23 0 0 -64 0 0 0 wmsg DL ?? 1826589:12.00 [usbus1] 0 24 0 0 -16 0 0 0 d DL ?? 6396:24.00 [arc_reclai 0 25 0 0 -16 0 0 0 ffffffff8102a720 DL ?? 5937:36.00 [l2arc_feed 0 26 0 0 76 0 0 0 psleep DL ?? 8277:24.00 [pagedaemon 0 27 0 0 76 0 0 0 psleep DL ?? 482:36.00 [vmdaemon] 0 28 0 0 76 0 0 0 pgzero DL ?? 231:12.00 [pagezero] 0 29 0 0 76 0 0 0 psleep DL ?? 9495:24.00 [bufdaemon] 0 30 0 0 76 0 0 0 vlruwt DL ?? 9923:36.00 [vnlru] 0 31 0 0 76 0 0 0 syncer DL ?? 22525:00.00 [syncer] 0 32 0 0 76 0 0 0 sdflus DL ?? 10223:48.00 [softdepflu 0 33 0 0 -64 0 0 0 wmsg DL ?? 626931:00.00 [rum0] 0 64 0 0 45 0 0 0 tq->tq DL ?? 37997:12.00 [spa_zio] 0 65 0 0 45 0 0 0 tq->tq DL ?? 227450:48.00 [spa_zio] 0 66 0 0 45 0 0 0 tq->tq DL ?? 128487:24.00 [spa_zio] 0 67 0 0 45 0 0 0 tq->tq DL ?? 620372:36.00 [spa_zio] 0 68 0 0 45 0 0 0 tq->tq DL ?? 650567:48.00 [spa_zio] 0 69 0 0 45 0 0 0 tq->tq DL ?? 583181:12.00 [spa_zio] 0 70 0 0 45 0 0 0 tq->tq DL ?? 647436:00.00 [spa_zio] 0 71 0 0 45 0 0 0 tq->tq DL ?? 931702:00.00 [spa_zio] 0 72 0 0 45 0 0 0 tq->tq DL ?? 518516:24.00 [spa_zio] 0 73 0 0 45 0 0 0 tq->tq DL ?? 575244:12.00 [spa_zio] 0 74 0 0 45 0 0 0 tq->tq DL ?? 734955:12.00 [spa_zio] 0 75 0 0 45 0 0 0 tq->tq DL ?? 144581:36.00 [spa_zio] 0 76 0 0 45 0 0 0 tq->tq DL ?? 115149:00.00 [spa_zio] 0 77 0 0 45 0 0 0 tq->tq DL ?? 171418:12.00 [spa_zio] 0 78 0 0 45 0 0 0 tq->tq DL ?? 177878:00.00 [spa_zio] 0 79 0 0 44 0 0 0 tq->tq DL ?? 237197:00.00 [spa_zio] 0 80 0 0 45 0 0 0 tq->tq DL ?? 89828:00.00 [spa_zio] 0 81 0 0 44 0 0 0 tq->tq DL ?? 262244:24.00 [spa_zio] 0 82 0 0 45 0 0 0 tq->tq DL ?? 599110:24.00 [spa_zio] 0 83 0 0 44 0 0 0 tq->tq DL ?? 1398903:48.00 [spa_zio] 0 84 0 0 45 0 0 0 tq->tq DL ?? 174:12.00 [spa_zio] 0 85 0 0 45 0 0 0 tq->tq DL ?? 175:36.00 [spa_zio] 0 86 0 0 45 0 0 0 tq->tq DL ?? 180:36.00 [spa_zio] 0 87 0 0 45 0 0 0 tq->tq DL ?? 180:48.00 [spa_zio] 0 88 0 0 45 0 0 0 tq->tq DL ?? 186:48.00 [spa_zio] 0 89 0 0 45 0 0 0 tq->tq DL ?? 21073:24.00 [spa_zio] 0 90 0 0 45 0 0 0 d DL ?? 332534:00.00 [vdev:worke 0 91 0 0 45 0 0 0 d DL ?? 315895:12.00 [vdev:worke 0 92 0 0 45 0 0 0 1 DL ?? 437547:00.00 [vdev:worke 0 93 0 0 45 0 0 0 1 DL ?? 384387:00.00 [vdev:worke 0 94 0 0 45 0 0 0 tx->tx DL ?? 1423:24.00 [txg_thread 0 95 0 0 45 0 0 0 tx->tx DL ?? 447566:36.00 [txg_thread 0 96 0 0 45 0 0 0 tq->tq DL ?? 464:36.00 [zil_clean] 0 97 1 0 76 0 7132 0 wait Ds+ ?? 3108902:36.00 [sh] 0 160 0 0 45 0 0 0 tq->tq DL ?? 478:00.00 [zil_clean] 0 161 0 0 45 0 0 0 tq->tq DL ?? 299:24.00 [zil_clean] 0 162 0 0 45 0 0 0 tq->tq DL ?? 304:36.00 [zil_clean] 0 163 0 0 45 0 0 0 tq->tq DL ?? 1645:24.00 [zil_clean] 0 164 0 0 45 0 0 0 tq->tq DL ?? 841:12.00 [zil_clean] 0 165 0 0 45 0 0 0 tq->tq DL ?? 378:24.00 [zil_clean] 0 166 0 0 45 0 0 0 tq->tq DL ?? 253:24.00 [zil_clean] 0 167 0 0 45 0 0 0 tq->tq DL ?? 267:36.00 [zil_clean] 0 168 0 0 45 0 0 0 tq->tq DL ?? 377:12.00 [zil_clean] 0 169 0 0 45 0 0 0 tq->tq DL ?? 263:36.00 [zil_clean] 0 170 0 0 45 0 0 0 tq->tq DL ?? 377:24.00 [zil_clean] 0 171 0 0 45 0 0 0 tq->tq DL ?? 275:00.00 [zil_clean] 0 172 0 0 45 0 0 0 tq->tq DL ?? 434:24.00 [zil_clean] 0 173 0 0 45 0 0 0 tq->tq DL ?? 343:48.00 [zil_clean] 0 174 0 0 45 0 0 0 tq->tq DL ?? 377:12.00 [zil_clean] 0 175 0 0 45 0 0 0 tq->tq DL ?? 315:48.00 [zil_clean] 0 176 0 0 45 0 0 0 tq->tq DL ?? 394:00.00 [zil_clean] 0 177 0 0 45 0 0 0 tq->tq DL ?? 311:12.00 [zil_clean] 0 178 0 0 45 0 0 0 tq->tq DL ?? 347:24.00 [zil_clean] 0 179 0 0 45 0 0 0 tq->tq DL ?? 347:24.00 [zil_clean] 0 180 0 0 45 0 0 0 tq->tq DL ?? 259:12.00 [zil_clean] 0 181 0 0 45 0 0 0 tq->tq DL ?? 288:48.00 [zil_clean] 0 182 0 0 45 0 0 0 tq->tq DL ?? 464:48.00 [zil_clean] 0 183 0 0 45 0 0 0 tq->tq DL ?? 399:24.00 [zil_clean] 0 184 0 0 45 0 0 0 tq->tq DL ?? 291:48.00 [zil_clean] 0 185 0 0 45 0 0 0 tq->tq DL ?? 343:48.00 [zil_clean] 0 186 0 0 45 0 0 0 tq->tq DL ?? 420:36.00 [zil_clean] 0 187 0 0 45 0 0 0 tq->tq DL ?? 375:24.00 [zil_clean] 0 188 0 0 45 0 0 0 tq->tq DL ?? 404:12.00 [zil_clean] 0 189 0 0 45 0 0 0 tq->tq DL ?? 388:36.00 [zil_clean] 0 190 0 0 45 0 0 0 tq->tq DL ?? 14321:48.00 [zil_clean] 0 276 1 0 76 0 2608 0 pause Ds ?? 16812:48.00 [adjkerntz] 0 789 1 0 76 0 2180 0 select Ds ?? 32568:24.00 [devd] 0 942 0 0 43 0 0 0 - DL ?? 595:48.00 [accounting 0 964 1 0 47 0 5732 0 select Ds ?? 1651060:00.00 [syslogd] 0 995 1 0 76 0 6788 0 select Ds ?? 566406:36.00 [rpcbind] 0 1021 1 0 76 0 6816 0 auditd Ds ?? 394050:36.00 [auditd] 0 1078 1 0 76 0 5732 0 select Ds ?? 150500:36.00 [mountd] 0 1080 1 0 76 0 4648 0 select Ds ?? 1223069:36.00 [nfsd] 0 1081 1080 0 76 0 4648 0 rpcsvc D ?? 36452:48.00 [nfsd] 0 1090 1 0 76 0 267844 0 select Ds ?? 46313:24.00 [rpc.statd] 0 1096 1 0 76 0 6788 0 rpcsvc Ds ?? 156760:00.00 [rpc.lockd] 1 1127 1 0 76 0 7240 0 select Ds ?? 37601:00.00 [slpd] 0 1138 97 0 76 0 7132 0 piperd D+ ?? 119004:24.00 [sh] 0 1140 1138 0 76 0 7132 0 wait D+ ?? 55232:00.00 [sh] 0 1141 1140 0 96 0 8928 0 - RE+ ?? 98638:12.00 [ps] 0 1142 1140 0 76 0 7132 0 piperd D+ ?? 12965:48.00 [sh] ------------------------------------------------------------------------ vmstat -s 0 cpu context switches 0 device interrupts 0 software interrupts 0 traps 0 system calls 0 kernel threads created 0 fork() calls 0 vfork() calls 0 rfork() calls 0 swap pager pageins 0 swap pager pages paged in 0 swap pager pageouts 0 swap pager pages paged out 0 vnode pager pageins 0 vnode pager pages paged in 0 vnode pager pageouts 0 vnode pager pages paged out 0 page daemon wakeups 0 pages examined by the page daemon 495 pages reactivated 0 copy-on-write faults 0 copy-on-write optimized faults 0 zero fill pages zeroed 0 zero fill pages prezeroed 0 intransit blocking page faults 0 total VM faults taken 0 pages affected by kernel thread creation 0 pages affected by fork() 0 pages affected by vfork() 0 pages affected by rfork() 566 pages cached 0 pages freed 0 pages freed by daemon 38051 pages freed by exiting processes 1936 pages active 307 pages inactive 64 pages in VM cache 35738 pages wired down 966101 pages free 4096 bytes per page 16115 total name lookups cache hits (88% pos + 3% neg) system 0% per-directory deletions 0%, falsehits 0%, toolong 0% ------------------------------------------------------------------------ vmstat -m Type InUse MemUse HighUse Requests Size(s) ddb_capture -1 -47K - 0 GEOM 1403056 -1467K - 1404160 32,64,128,256,512,1024,2048,8192 isadev -8 0K - 0 sbp -96 -12K - 0 cdev -11 -1K - 0 CAM dev queue -4 0K - 0 sigio -1 0K - 0 filedesc 525192 -571K - 526336 16,32,64,128,256,512,2048,4096,8192 kenv 41 -9K - 128 16,32,64 kqueue 27624 -26K - 27648 128,256 proc-args 17765 -17K - 18080 16,32,64,128,256,512,1024,2048 ithread -78 -11K - 0 acpica 5841406 -5946K - 5898816 128,1024,32768,65536,262144,524288 KTRACE -100 -11K - 0 linker 1164 -146K - 1344 16,32,128,512 lockf 1324 -1K - 1344 64,128 acpitask 63 0K - 64 16 ip6ndp -6 0K - 0 temp 17441466 -17053K - 17446288 32,64,128,256,512,1024,2048,8192,16384,32768 devbuf 396494 -13754K - 403728 16,32,64,128,256,512,1024,2048 module -410 -50K - 0 kbdmux -6 -7K - 0 mtx_pool -1 -7K - 0 osd 12 0K - 16 16 subproc 4209857 -4671K - 4211200 16,32,64,128,256,512,1024,4096,8192 proc -2 -15K - 0 session -12 0K - 0 pgrp -12 0K - 0 cred 412041 -412K - 413696 32,64,128,256,512,1024,2048,4096,8192 uidinfo -3 -1K - 0 plimit 51253 -49K - 51456 16,32,64,128,256,1024 sysctltmp 5642 -4K - 5840 32,64,128,256,512,2048 sysctloid 2357 -225K - 7056 16,64,128,256,1024,2048 sysctl 7935 -7K - 8336 16,32,64,128,256,512,1024,2048 callout -3 -1535K - 0 umtx -260 -31K - 0 vimage -1 0K - 0 p1003.1b -1 0K - 0 SWAP -8 -8751K - 0 bus-sc 25819883 -25370K - 25824032 16,32,64,128,256,512,2048,4096,8192,16384,32768 bus 1339306 -1409K - 1346640 16,32,64,128,256,1024,2048,4096,8192,16384,65536 clist -4 0K - 0 devstat -16 -31K - 0 eventhandler -65 -4K - 0 CAM queue 2445 -1K - 2560 16,32,64,128,256,1024 kobj 298656 -1407K - 299008 16,32,64,1024 CAM SIM -4 0K - 0 acpisem -15 0K - 0 rman 54940 -74K - 55552 32,256,512,2048,4096 sbuf 1018768 -994K - 1019232 32,64,128,256,2048,4096 scsi_da 330 0K - 352 16,32,256 CAM periph 3377 -5K - 3408 16,32,256 stack 510 0K - 512 32 taskqueue -13 0K - 0 Unitno 53 0K - 64 32 ata_generic -6 -5K - 0 ad_driver -4 0K - 0 Witness -1 -127K - 0 iov 183440 -178K - 184224 16,32,64,128,256,512,1024,8192 select -11 0K - 0 ioctlops 1972127 -1925K - 1973200 16,32,64,128,256,512,1024,2048,4096,8192 msg -4 -29K - 0 sem -4 -319K - 0 shm -1 -67K - 0 tty -21 -20K - 0 mbuf_tag 665 0K - 672 16,32,64 shmfd -1 -7K - 0 ar_driver 71656 -69K - 71680 128,256 pcb 589 -156K - 640 16,32,256 soname 57946 -56K - 58592 16,32,64,128,256,512,2048,4096 vfscache -1 -1023K - 0 export_host -5 -1K - 0 vfs_hash -1 -511K - 0 vnodes -2 0K - 0 acd_driver -2 -3K - 0 vnodemarker 18396 -17K - 18432 64,256 mount 98828 -150K - 101888 16,128,256,512,1024,8192,16384 BPF -6 0K - 0 ether_multi 300 0K - 336 16,64 ifaddr 3649 -21K - 3968 64,128,256,512,1024 ifnet -6 -9K - 0 clone -5 -19K - 0 arpcom -2 0K - 0 fw_com -1 0K - 0 lltable -14 -5K - 0 CAM XPT 40167 -58K - 40320 32,64,128,256,1024 acpidev -69 -3K - 0 routetbl 14067 -18K - 14144 128,256,512 80211vap -1 -3K - 0 80211crypto -4 0K - 0 80211com -1 -7K - 0 80211nodeie -2 0K - 0 80211node 12286 -23K - 12288 16 80211scan -3 -5K - 0 igmp -5 0K - 0 ip_moptions -4 0K - 0 in_multi -3 0K - 0 in_mfilter -2 -1K - 0 sctp_iter 255 0K - 256 16 sctp_ifn -2 0K - 0 sctp_ifa -4 0K - 0 sctp_vrf -1 0K - 0 sctp_a_it 15 0K - 16 16 hostcache -1 -27K - 0 syncache -1 -91K - 0 in6_multi -19 0K - 0 ip6_moptions -1 0K - 0 NFS FHA -1 -1K - 0 NLM 31 0K - 32 16 rpc 36206 -50K - 36400 16,32,64,128,256,512,1024 audit_data 63 0K - 64 16 audit_evclass 5962 -24K - 6784 16,32,64,128,512,2048 newblk -1 0K - 0 inodedep -1 -511K - 0 pagedep -1 -127K - 0 ufs_dirhash -3 0K - 0 ufs_mount -3 -5K - 0 entropy -1024 -63K - 0 vm_pgdata -5 -127K - 0 fw_xfer 255 0K - 256 16 firewire 2036 -35K - 2048 16 io_apic -1 -1K - 0 memdesc -1 -3K - 0 UART -3 0K - 0 nexusdev -3 0K - 0 USBdev 2018 -6K - 2048 16 USB 106451 -267K - 106496 16,32,64,128 DEVFS1 -146 -72K - 0 DEVFS3 92 -40K - 256 16 atkbddev -2 0K - 0 DEVFS -10 0K - 16 16 pfs_nodes -20 -4K - 0 pfs_vncache -1 0K - 0 pci_link -68 -4K - 0 solaris 101557936 -171583K - 101739424 16,32,64,128,256,512,1024,2048,4096,8192,16384,32768,65536,131072,262144,524288,1048576 kstat_data -2 0K - 0 linux -12 0K - 0 ------------------------------------------------------------------------ vmstat -z ITEM SIZE LIMIT USED FREE REQUESTS FAILURES UMA Kegs: 208, 0, 93, 9, 93, 0 UMA Zones: 320, 0, 93, 3, 93, 0 UMA Slabs: 568, 0, 2946, 1, 5668, 0 UMA RCntSlabs: 568, 0, 279, 1, 279, 0 UMA Hash: 256, 0, 3, 12, 3, 0 16 Bucket: 152, 0, 122, 3, 122, 0 32 Bucket: 280, 0, 92, 6, 92, 0 64 Bucket: 536, 0, 95, 3, 95, 61 128 Bucket: 1048, 0, 132, 0, 132, 0 VM OBJECT: 200, 0, 813, 175, 15774, 0 MAP: 224, 0, 7, 27, 7, 0 KMAP ENTRY: 112, 150183, 50, 148, 10963, 0 MAP ENTRY: 112, 0, 318, 210, 32296, 0 DP fakepg: 112, 0, 0, 0, 0, 0 mt_zone: 2056, 0, 257, 6, 257, 0 16: 16, 0, 3399, 465, 53016, 0 32: 32, 0, 3815, 629, 12057, 0 64: 64, 0, 7674, 3358, 93980, 0 128: 128, 0, 10069, 342, 38308, 0 256: 256, 0, 1151, 709, 27955, 0 512: 512, 0, 1676, 158, 33534, 0 1024: 1024, 0, 291, 1681, 11341, 0 2048: 2048, 0, 270, 88, 1127, 0 4096: 4096, 0, 565, 201, 6852, 0 Files: 80, 0, 76, 239, 4242, 0 TURNSTILE: 136, 0, 261, 59, 261, 0 umtx pi: 96, 0, 0, 0, 0, 0 PROC: 1088, 0, 114, 84, 1142, 0 THREAD: 896, 0, 229, 31, 229, 0 SLEEPQUEUE: 80, 0, 261, 87, 261, 0 VMSPACE: 384, 0, 17, 73, 1015, 0 cpuset: 72, 0, 2, 98, 2, 0 audit_record: 984, 0, 0, 8, 1, 0 mbuf_packet: 256, 0, 1, 522, 161, 0 mbuf: 256, 0, 3, 520, 444, 0 mbuf_cluster: 2048, 25600, 512, 46, 546, 0 mbuf_jumbo_page: 4096, 12800, 0, 0, 0, 0 mbuf_jumbo_9k: 9216, 19200, 0, 0, 0, 0 mbuf_jumbo_16k: 16384, 12800, 0, 0, 0, 0 mbuf_ext_refcnt: 4, 0, 0, 0, 0, 0 ACL UMA zone: 388, 0, 0, 30, 107, 0 g_bio: 216, 0, 0, 432, 15733, 0 ttyinq: 160, 0, 15, 33, 15, 0 ttyoutq: 256, 0, 8, 22, 8, 0 ata_request: 312, 0, 1, 143, 11320, 0 ata_composite: 336, 0, 0, 0, 0, 0 taskq_ent_cache: 64, 0, 668, 228, 1268, 0 taskq_cache: 288, 0, 45, 33, 57, 0 VNODE: 472, 0, 608, 88, 633, 0 VNODEPOLL: 104, 0, 0, 0, 0, 0 S VFS Cache: 104, 0, 504, 108, 1298, 0 L VFS Cache: 327, 0, 0, 0, 0, 0 NAMEI: 1024, 0, 0, 56, 6809, 0 DIRHASH: 1024, 0, 13, 7, 13, 0 NFSMOUNT: 744, 0, 0, 0, 0, 0 NFSNODE: 648, 0, 0, 0, 0, 0 pipe: 712, 0, 2, 63, 659, 0 ksiginfo: 112, 0, 182, 874, 182, 0 itimer: 344, 0, 0, 22, 1, 0 KNOTE: 120, 0, 0, 62, 24, 0 socket: 640, 25602, 39, 45, 403, 0 unpcb: 240, 25600, 7, 73, 135, 0 ipq: 56, 819, 0, 0, 0, 0 udpcb: 288, 25610, 20, 45, 253, 0 inpcb: 288, 25610, 12, 53, 14, 0 tcpcb: 736, 25600, 12, 18, 14, 0 tcptw: 88, 5124, 0, 0, 0, 0 syncache: 136, 15372, 0, 0, 0, 0 hostcache: 136, 15372, 0, 0, 0, 0 tcpreass: 40, 1680, 0, 0, 0, 0 sackhole: 32, 0, 0, 0, 0, 0 sctp_ep: 1184, 25602, 0, 0, 0, 0 sctp_asoc: 2176, 40000, 0, 0, 0, 0 sctp_laddr: 48, 80064, 0, 144, 1, 0 sctp_raddr: 584, 80003, 0, 0, 0, 0 sctp_chunk: 144, 400010, 0, 0, 0, 0 sctp_readq: 104, 400032, 0, 0, 0, 0 sctp_stream_msg_out: 96, 400026, 0, 0, 0, 0 sctp_asconf: 40, 400008, 0, 0, 0, 0 sctp_asconf_ack: 48, 400032, 0, 0, 0, 0 ripcb: 288, 25610, 0, 0, 0, 0 rtentry: 192, 0, 7, 53, 7, 0 zio_cache: 720, 0, 0, 1675, 30872, 0 dmu_buf_impl_t: 224, 0, 1931, 126, 2017, 0 dnode_t: 768, 0, 1038, 32, 1386, 0 arc_buf_hdr_t: 208, 0, 1238, 58, 1430, 0 arc_buf_t: 72, 0, 1238, 162, 1430, 0 zil_lwb_cache: 200, 0, 9, 48, 9, 0 zfs_znode_cache: 376, 0, 518, 52, 542, 0 selfd: 56, 0, 40, 275, 1902, 0 SWAPMETA: 288, 116519, 0, 0, 0, 0 Mountpoints: 752, 0, 35, 5, 35, 0 FFS inode: 176, 0, 6, 36, 6, 0 FFS1 dinode: 128, 0, 0, 0, 0, 0 FFS2 dinode: 256, 0, 6, 24, 6, 0 ------------------------------------------------------------------------ vmstat -i interrupt total rate irq1: atkbd0 6 0 irq18: fwohci0 1 0 irq20: atapci2 73 0 irq21: ohci0+ 2152 1 irq22: ehci0 2160 1 irq23: atapci1 1782 1 cpu0: timer 57965 42 cpu1: timer 47949 34 cpu3: timer 46890 33 cpu2: timer 46885 33 Total 205863 149 ------------------------------------------------------------------------ pstat -T 76/12328 files 0M/65535M swap space ------------------------------------------------------------------------ pstat -s Device 1K-blocks Used Avail Capacity /dev/ad4s1b 16777088 0 16777088 0% /dev/ad6s1b 16777088 0 16777088 0% /dev/ad12s1b 16777088 0 16777088 0% /dev/ad14s1b 16777088 0 16777088 0% Total 67108352 0 67108352 0% ------------------------------------------------------------------------ iostat iostat: kvm_read(_tk_nin): invalid address (0x0) iostat: disabling TTY statistics iostat: kvm_getcptime: invalid address (0x0) iostat: disabling CPU time statistics ad4 ad6 ad12 KB/t tps MB/s KB/t tps MB/s KB/t tps MB/s 20.47 1 0.01 23.13 1 0.01 24.11 1 0.02 ------------------------------------------------------------------------ ipcs -a Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME ------------------------------------------------------------------------ ipcs -T msginfo: msgmax: 16384 (max characters in a message) msgmni: 40 (# of message queues) msgmnb: 2048 (max characters in a message queue) msgtql: 40 (max # of messages in system) msgssz: 8 (size of a message segment) msgseg: 2048 (# of message segments in system) shminfo: shmmax: 536870912 (max shared memory segment size) shmmin: 1 (min shared memory segment size) shmmni: 768 (max number of shared memory identifiers) shmseg: 512 (max shared memory segments per process) shmall: 131072 (max amount of shared memory in pages) seminfo: semmap: 1024 (# of entries in semaphore map) semmni: 1024 (# of semaphore identifiers) semmns: 2048 (# of semaphores in system) semmnu: 1024 (# of undo structures in system) semmsl: 60 (max # of semaphores per id) semopm: 100 (max # of operations per semop call) semume: 10 (max # of undo entries per process) semusz: 152 (size in bytes of undo structure) semvmx: 32767 (semaphore maximum value) semaem: 16384 (adjust on exit max value) ------------------------------------------------------------------------ nfsstat Client Info: Rpc Counts: Getattr Setattr Lookup Readlink Read Write Create Remove 0 0 0 0 0 0 0 0 Rename Link Symlink Mkdir Rmdir Readdir RdirPlus Access 0 0 0 0 0 0 0 0 Mknod Fsstat Fsinfo PathConf Commit 0 0 0 0 0 Rpc Info: TimedOut Invalid X Replies Retries Requests 0 0 0 0 0 Cache Info: Attr Hits Misses Lkup Hits Misses BioR Hits Misses BioW Hits Misses 0 0 0 0 0 0 0 0 BioRLHits Misses BioD Hits Misses DirE Hits Misses 0 0 0 0 0 0 Server Info: Getattr Setattr Lookup Readlink Read Write Create Remove 0 0 0 0 0 0 0 0 Rename Link Symlink Mkdir Rmdir Readdir RdirPlus Access 0 0 0 0 0 0 0 0 Mknod Fsstat Fsinfo PathConf Commit 0 0 0 0 0 Server Ret-Failed 0 Server Faults 0 Server Cache Stats: Inprog Idem Non-idem Misses 0 0 0 0 Server Write Gathering: WriteOps WriteRPC Opsaved 0 0 0 ------------------------------------------------------------------------ netstat -s netstat: /usr/obj/usr/src/sys/GENERIC/kernel: no namelist ------------------------------------------------------------------------ netstat -m netstat: /usr/obj/usr/src/sys/GENERIC/kernel: no namelist ------------------------------------------------------------------------ netstat -id netstat: /usr/obj/usr/src/sys/GENERIC/kernel: no namelist ------------------------------------------------------------------------ netstat -anr netstat: /usr/obj/usr/src/sys/GENERIC/kernel: no namelist ------------------------------------------------------------------------ netstat -anA netstat: /usr/obj/usr/src/sys/GENERIC/kernel: no namelist ------------------------------------------------------------------------ netstat -aL netstat: /usr/obj/usr/src/sys/GENERIC/kernel: no namelist ------------------------------------------------------------------------ fstat USER CMD PID FD MOUNT INUM MODE SZ|DV R/W root sh 1142 root - - error - root sh 1142 wd - - error - root sh 1142 text - - error - root sh 1142 0* pipe ffffff000b10c858 <-> ffffff000b10c9a8 0 rw root sh 1142 1* pipe ffffff000b126150 <-> ffffff000b126000 0 rw root sh 1142 2 /dev 5 crw------- console rw root ps 1141 root - - error - root ps 1141 wd - - error - root ps 1141 text - - error - root ps 1141 0 /dev 5 crw------- console rw root ps 1141 1* pipe ffffff000b10c9a8 <-> ffffff000b10c858 0 rw root ps 1141 2 /dev 27 crw-rw-rw- null w root ps 1141 3 /dev 27 crw-rw-rw- null r root ps 1141 4 /dev 27 crw-rw-rw- null r root sh 1140 root - - error - root sh 1140 wd - - error - root sh 1140 text - - error - root sh 1140 0 /dev 5 crw------- console rw root sh 1140 1* pipe ffffff000b126150 <-> ffffff000b126000 0 rw root sh 1140 2 /dev 5 crw------- console rw root sh 1138 root - - error - root sh 1138 wd - - error - root sh 1138 text - - error - root sh 1138 0 /dev 5 crw------- console rw root sh 1138 1 /dev 5 crw------- console rw root sh 1138 2 /dev 5 crw------- console rw root sh 1138 3* pipe ffffff000b126000 <-> ffffff000b126150 0 rw root sh 1138 10 - - error - daemon slpd 1127 root - - error - daemon slpd 1127 wd - - error - daemon slpd 1127 text - - error - daemon slpd 1127 3 - - error - daemon slpd 1127 4* internet stream tcp ffffff000b2a25c0 daemon slpd 1127 5* internet stream tcp ffffff000b2a22e0 daemon slpd 1127 6* internet dgram udp ffffff0004ed7240 daemon slpd 1127 7* internet dgram udp ffffff0004ed7120 daemon slpd 1127 8* internet dgram udp ffffff0004ed7900 root rpc.lockd 1096 root - - error - root rpc.lockd 1096 wd - - error - root rpc.lockd 1096 text - - error - root rpc.lockd 1096 0 /dev 27 crw-rw-rw- null rw root rpc.lockd 1096 1 /dev 27 crw-rw-rw- null rw root rpc.lockd 1096 2 /dev 27 crw-rw-rw- null rw root rpc.lockd 1096 3* local dgram ffffff0004fc8c30 <-> ffffff0004fc9690 root rpc.statd 1090 root - - error - root rpc.statd 1090 wd - - error - root rpc.statd 1090 text - - error - root rpc.statd 1090 0 /dev 27 crw-rw-rw- null rw root rpc.statd 1090 1 /dev 27 crw-rw-rw- null rw root rpc.statd 1090 2 /dev 27 crw-rw-rw- null rw root rpc.statd 1090 3 - - error - root rpc.statd 1090 4* internet6 dgram udp ffffff0004ecc240 root rpc.statd 1090 5* internet6 stream tcp ffffff000b2a3000 root rpc.statd 1090 6* internet dgram udp ffffff0004ed7c60 root rpc.statd 1090 7* internet stream tcp ffffff000b2a2b80 root rpc.statd 1090 8* local dgram ffffff0004fc84b0 <-> ffffff0004fc9690 root nfsd 1081 root - - error - root nfsd 1081 wd - - error - root nfsd 1081 text - - error - root nfsd 1081 0 /dev 27 crw-rw-rw- null rw root nfsd 1081 1 /dev 27 crw-rw-rw- null rw root nfsd 1081 2 /dev 27 crw-rw-rw- null rw root nfsd 1080 root - - error - root nfsd 1080 wd - - error - root nfsd 1080 text - - error - root nfsd 1080 0 /dev 27 crw-rw-rw- null rw root nfsd 1080 1 /dev 27 crw-rw-rw- null rw root nfsd 1080 2 /dev 27 crw-rw-rw- null rw root nfsd 1080 3* internet stream tcp ffffff000b2b95c0 root nfsd 1080 4* internet6 stream tcp ffffff000b2b92e0 root mountd 1078 root - - error - root mountd 1078 wd - - error - root mountd 1078 text - - error - root mountd 1078 0 /dev 27 crw-rw-rw- null rw root mountd 1078 1 /dev 27 crw-rw-rw- null rw root mountd 1078 2 /dev 27 crw-rw-rw- null rw root mountd 1078 3 - - error - root mountd 1078 5* internet6 dgram udp ffffff0004ed6000 root mountd 1078 6* internet6 stream tcp ffffff000b1f52e0 root mountd 1078 7* internet dgram udp ffffff0004ed6360 root mountd 1078 8* internet stream tcp ffffff000b1f5000 root auditd 1021 root - - error - root auditd 1021 wd - - error - root auditd 1021 text - - error - root auditd 1021 0 /dev 27 crw-rw-rw- null rw root auditd 1021 1 /dev 27 crw-rw-rw- null rw root auditd 1021 2 /dev 27 crw-rw-rw- null rw root auditd 1021 3* local dgram ffffff0004fc8d20 <-> ffffff0004fc9690 root auditd 1021 4 - - error - root auditd 1021 5 /dev 22 crw------- audit r root auditd 1021 6 - - error - root auditd 1021 8 - - error - root rpcbind 995 root - - error - root rpcbind 995 wd - - error - root rpcbind 995 text - - error - root rpcbind 995 0 /dev 27 crw-rw-rw- null rw root rpcbind 995 1 /dev 27 crw-rw-rw- null rw root rpcbind 995 2 /dev 27 crw-rw-rw- null rw root rpcbind 995 3 - - error - root rpcbind 995 4* internet6 dgram udp ffffff0004ed7b40 root rpcbind 995 5* local stream ffffff0004fc8e10 root rpcbind 995 6* internet6 dgram udp ffffff0004ed7000 root rpcbind 995 7* internet6 dgram udp ffffff0004ed6a20 root rpcbind 995 8* internet6 stream tcp ffffff000b1f58a0 root rpcbind 995 9* internet dgram udp ffffff0004ed67e0 root rpcbind 995 10* internet dgram udp ffffff0004ed65a0 root rpcbind 995 11* internet stream tcp ffffff000b1f55c0 root syslogd 964 root - - error - root syslogd 964 wd - - error - root syslogd 964 text - - error - root syslogd 964 0 /dev 27 crw-rw-rw- null rw root syslogd 964 1 /dev 27 crw-rw-rw- null rw root syslogd 964 2 /dev 27 crw-rw-rw- null rw root syslogd 964 3 - - error - root syslogd 964 4* local dgram ffffff0004fc9780 root syslogd 964 5* local dgram ffffff0004fc9690 root syslogd 964 6* internet6 dgram udp ffffff0004ed6c60 root syslogd 964 7* internet dgram udp ffffff0004ed6d80 root syslogd 964 8 /dev 30 crw------- klog r root syslogd 964 10 /dev 5 crw------- console w root syslogd 964 11 - - error - root syslogd 964 12 - - error - root syslogd 964 13 - - error - root syslogd 964 14 - - error - root syslogd 964 15 - - error - root syslogd 964 16 - - error - root syslogd 964 17 - - error - root syslogd 964 18 - - error - root syslogd 964 19 - - error - root syslogd 964 20 - - error - root syslogd 964 21 - - error - root syslogd 964 22 - - error - root accounting 942 root - - error - root accounting 942 wd - - error - root devd 789 root - - error - root devd 789 wd - - error - root devd 789 text - - error - root devd 789 0 /dev 27 crw-rw-rw- null rw root devd 789 1 /dev 27 crw-rw-rw- null rw root devd 789 2 /dev 27 crw-rw-rw- null rw root devd 789 3 - - error - root devd 789 4 /dev 6 crw------- devctl r root devd 789 5* local stream ffffff0004fc9000 root devd 789 6 - - error - root adjkerntz 276 root - - error - root adjkerntz 276 wd - - error - root adjkerntz 276 text - - error - root adjkerntz 276 0 /dev 27 crw-rw-rw- null rw root adjkerntz 276 1 /dev 27 crw-rw-rw- null rw root adjkerntz 276 2 /dev 27 crw-rw-rw- null rw root zil_clean 190 root - - error - root zil_clean 190 wd - - error - root zil_clean 189 root - - error - root zil_clean 189 wd - - error - root zil_clean 188 root - - error - root zil_clean 188 wd - - error - root zil_clean 187 root - - error - root zil_clean 187 wd - - error - root zil_clean 186 root - - error - root zil_clean 186 wd - - error - root zil_clean 185 root - - error - root zil_clean 185 wd - - error - root zil_clean 184 root - - error - root zil_clean 184 wd - - error - root zil_clean 183 root - - error - root zil_clean 183 wd - - error - root zil_clean 182 root - - error - root zil_clean 182 wd - - error - root zil_clean 181 root - - error - root zil_clean 181 wd - - error - root zil_clean 180 root - - error - root zil_clean 180 wd - - error - root zil_clean 179 root - - error - root zil_clean 179 wd - - error - root zil_clean 178 root - - error - root zil_clean 178 wd - - error - root zil_clean 177 root - - error - root zil_clean 177 wd - - error - root zil_clean 176 root - - error - root zil_clean 176 wd - - error - root zil_clean 175 root - - error - root zil_clean 175 wd - - error - root zil_clean 174 root - - error - root zil_clean 174 wd - - error - root zil_clean 173 root - - error - root zil_clean 173 wd - - error - root zil_clean 172 root - - error - root zil_clean 172 wd - - error - root zil_clean 171 root - - error - root zil_clean 171 wd - - error - root zil_clean 170 root - - error - root zil_clean 170 wd - - error - root zil_clean 169 root - - error - root zil_clean 169 wd - - error - root zil_clean 168 root - - error - root zil_clean 168 wd - - error - root zil_clean 167 root - - error - root zil_clean 167 wd - - error - root zil_clean 166 root - - error - root zil_clean 166 wd - - error - root zil_clean 165 root - - error - root zil_clean 165 wd - - error - root zil_clean 164 root - - error - root zil_clean 164 wd - - error - root zil_clean 163 root - - error - root zil_clean 163 wd - - error - root zil_clean 162 root - - error - root zil_clean 162 wd - - error - root zil_clean 161 root - - error - root zil_clean 161 wd - - error - root zil_clean 160 root - - error - root zil_clean 160 wd - - error - root sh 97 root - - error - root sh 97 wd - - error - root sh 97 text - - error - root sh 97 0 /dev 5 crw------- console rw root sh 97 1 /dev 5 crw------- console rw root sh 97 2 /dev 5 crw------- console rw root sh 97 10 - - error - root zil_clean 96 root - - error - root zil_clean 96 wd - - error - root txg_thread_enter 95 root - - error - root txg_thread_enter 95 wd - - error - root txg_thread_enter 94 root - - error - root txg_thread_enter 94 wd - - error - root vdev:worker ad14s1 93 root - - error - root vdev:worker ad14s1 93 wd - - error - root vdev:worker ad12s1 92 root - - error - root vdev:worker ad12s1 92 wd - - error - root vdev:worker ad6s1d 91 root - - error - root vdev:worker ad6s1d 91 wd - - error - root vdev:worker ad4s1d 90 root - - error - root vdev:worker ad4s1d 90 wd - - error - root spa_zio 89 root - - error - root spa_zio 89 wd - - error - root spa_zio 88 root - - error - root spa_zio 88 wd - - error - root spa_zio 87 root - - error - root spa_zio 87 wd - - error - root spa_zio 86 root - - error - root spa_zio 86 wd - - error - root spa_zio 85 root - - error - root spa_zio 85 wd - - error - root spa_zio 84 root - - error - root spa_zio 84 wd - - error - root spa_zio 83 root - - error - root spa_zio 83 wd - - error - root spa_zio 82 root - - error - root spa_zio 82 wd - - error - root spa_zio 81 root - - error - root spa_zio 81 wd - - error - root spa_zio 80 root - - error - root spa_zio 80 wd - - error - root spa_zio 79 root - - error - root spa_zio 79 wd - - error - root spa_zio 78 root - - error - root spa_zio 78 wd - - error - root spa_zio 77 root - - error - root spa_zio 77 wd - - error - root spa_zio 76 root - - error - root spa_zio 76 wd - - error - root spa_zio 75 root - - error - root spa_zio 75 wd - - error - root spa_zio 74 root - - error - root spa_zio 74 wd - - error - root spa_zio 73 root - - error - root spa_zio 73 wd - - error - root spa_zio 72 root - - error - root spa_zio 72 wd - - error - root spa_zio 71 root - - error - root spa_zio 71 wd - - error - root spa_zio 70 root - - error - root spa_zio 70 wd - - error - root spa_zio 69 root - - error - root spa_zio 69 wd - - error - root spa_zio 68 root - - error - root spa_zio 68 wd - - error - root spa_zio 67 root - - error - root spa_zio 67 wd - - error - root spa_zio 66 root - - error - root spa_zio 66 wd - - error - root spa_zio 65 root - - error - root spa_zio 65 wd - - error - root spa_zio 64 root - - error - root spa_zio 64 wd - - error - root init 1 root - - error - root init 1 wd - - error - root init 1 text - - error - root kernel 0 root - - error - root kernel 0 wd - - error - ------------------------------------------------------------------------ dmesg Copyright (c) 1992-2009 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 8.0-CURRENT #5 r189731: Thu Mar 12 11:03:16 GMT 2009 root@w2fzz0vc03.aah-go-on.com:/usr/obj/usr/src/sys/GENERIC WARNING: WITNESS option enabled, expect reduced performance. Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Core(TM)2 Quad CPU @ 2.66GHz (3192.05-MHz K8-class CPU) Origin = "GenuineIntel" Id = 0x6f7 Stepping = 7 Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> Features2=0xe3bd<SSE3,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM> AMD Features=0x20100800<SYSCALL,NX,LM> AMD Features2=0x1<LAHF> TSC: P-state invariant Cores per package: 4 usable memory = 4275380224 (4077 MB) avail memory = 4090159104 (3900 MB) ACPI APIC Table: <DELL B8K > FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 2 cpu3 (AP): APIC ID: 3 This module (opensolaris) contains code covered by the Common Development and Distribution License (CDDL) see http://opensolaris.org/os/licensing/opensolaris_license/ ioapic0: Changing APIC ID to 8 ioapic0 <Version 1.1> irqs 0-23 on motherboard lapic0: Forcing LINT1 to edge trigger kbd1 at kbdmux0 acpi0: <DELL B8K > on motherboard acpi0: [ITHREAD] acpi0: Power Button (fixed) acpi0: reservation of 0, a0000 (3) failed acpi0: reservation of 100000, f00000 (3) failed acpi0: reservation of 1000000, 9edbcc00 (3) failed Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x4008-0x400b on acpi0 acpi_hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 25000000 Hz quality 900 acpi_button0: <Power Button> on acpi0 pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0 pci0: <ACPI PCI bus> on pcib0 pci0: <memory, RAM> at device 0.1 (no driver attached) pci0: <memory, RAM> at device 0.2 (no driver attached) pci0: <memory, RAM> at device 0.3 (no driver attached) pci0: <memory, RAM> at device 0.4 (no driver attached) pci0: <memory, RAM> at device 1.0 (no driver attached) pci0: <memory, RAM> at device 1.1 (no driver attached) pci0: <memory, RAM> at device 1.2 (no driver attached) pci0: <memory, RAM> at device 1.3 (no driver attached) pci0: <memory, RAM> at device 1.4 (no driver attached) pci0: <memory, RAM> at device 1.5 (no driver attached) pci0: <memory, RAM> at device 1.6 (no driver attached) pcib1: <ACPI PCI-PCI bridge> at device 2.0 on pci0 pci1: <ACPI PCI bus> on pcib1 vgapci0: <VGA-compatible display> port 0xdc80-0xdcff mem 0xde000000-0xdeffffff,0xa0000000-0xafffffff,0xdc000000-0xddffffff irq 16 at device 0.0 on pci1 pcib2: <ACPI PCI-PCI bridge> at device 4.0 on pci0 pci2: <ACPI PCI bus> on pcib2 pcib3: <ACPI PCI-PCI bridge> at device 5.0 on pci0 pci3: <ACPI PCI bus> on pcib3 pci0: <memory, RAM> at device 9.0 (no driver attached) isab0: <PCI-ISA bridge> port 0x4f00-0x4fff at device 10.0 on pci0 isa0: <ISA bus> on isab0 pci0: <serial bus, SMBus> at device 10.1 (no driver attached) ohci0: <OHCI (generic) USB controller> mem 0xdfffc000-0xdfffcfff irq 21 at device 11.0 on pci0 ohci0: [ITHREAD] usbus0: <OHCI (generic) USB controller> on ohci0 ehci0: <EHCI (generic) USB 2.0 controller> mem 0xdfffbf00-0xdfffbfff irq 22 at device 11.1 on pci0 ehci0: [ITHREAD] usbus1: waiting for BIOS to give up control usbus1: EHCI version 1.0 usbus1: <EHCI (generic) USB 2.0 controller> on ehci0 atapci0: <nVidia nForce MCP55 UDMA133 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xecf0-0xecff at device 13.0 on pci0 ata0: <ATA channel 0> on atapci0 ata0: [ITHREAD] ata1: <ATA channel 1> on atapci0 ata1: [ITHREAD] atapci1: <nVidia nForce MCP55 SATA300 controller> port 0xfe00-0xfe07,0xfe10-0xfe13,0xfe20-0xfe27,0xfe30-0xfe33,0xfec0-0xfecf mem 0xdfffd000-0xdfffdfff irq 23 at device 14.0 on pci0 atapci1: [ITHREAD] ata2: <ATA channel 0> on atapci1 ata2: [ITHREAD] ata3: <ATA channel 1> on atapci1 ata3: [ITHREAD] atapci2: <nVidia nForce MCP55 SATA300 controller> port 0xfe40-0xfe47,0xfe50-0xfe53,0xfe60-0xfe67,0xfe70-0xfe73,0xfed0-0xfedf mem 0xdfffe000-0xdfffefff irq 20 at device 14.1 on pci0 atapci2: [ITHREAD] ata4: <ATA channel 0> on atapci2 ata4: [ITHREAD] ata5: <ATA channel 1> on atapci2 ata5: [ITHREAD] atapci3: <nVidia nForce MCP55 SATA300 controller> port 0xfe80-0xfe87,0xfe90-0xfe93,0xfea0-0xfea7,0xfeb0-0xfeb3,0xfef0-0xfeff mem 0xdffff000-0xdfffffff irq 21 at device 14.2 on pci0 atapci3: [ITHREAD] ata6: <ATA channel 0> on atapci3 ata6: [ITHREAD] ata7: <ATA channel 1> on atapci3 ata7: [ITHREAD] pcib4: <ACPI PCI-PCI bridge> at device 15.0 on pci0 pci4: <ACPI PCI bus> on pcib4 pci4: <unknown> at device 4.0 (no driver attached) pci4: <multimedia, audio> at device 5.0 (no driver attached) fwohci0: <Texas Instruments TSB43AB22/A> mem 0xdadfb800-0xdadfbfff,0xdadfc000-0xdadfffff irq 18 at device 10.0 on pci4 fwohci0: [ITHREAD] fwohci0: OHCI version 1.10 (ROM=0) fwohci0: No. of Isochronous channels is 4. fwohci0: EUI64 80:00:00:00:00:00:00:00 fwohci0: Phy 1394a available S400, 2 ports. fwohci0: Link S400, max_rec 128 bytes. fwohci0: max_rec 128 -> 2048 firewire0: <IEEE1394(FireWire) bus> on fwohci0 dcons_crom0: <dcons configuration ROM> on firewire0 dcons_crom0: bus_addr 0x1124000 fwe0: <Ethernet over FireWire> on firewire0 if_fwe0: Fake Ethernet address: 82:00:00:00:00:00 fwe0: Ethernet address: 82:00:00:00:00:00 fwip0: <IP over FireWire> on firewire0 fwip0: Firewire address: 80:00:00:00:00:00:00:00 @ 0xfffe00000000, S400, maxrec 2048 sbp0: <SBP-2/SCSI over FireWire> on firewire0 fwohci0: Initiate bus reset fwohci0: fwohci_intr_core: BUS reset fwohci0: fwohci_intr_core: node_id=0x00000000, SelfID Count=1, CYCLEMASTER mode pcib5: <ACPI PCI-PCI bridge> at device 19.0 on pci0 pci5: <ACPI PCI bus> on pcib5 pcib6: <ACPI PCI-PCI bridge> at device 24.0 on pci0 pci6: <ACPI PCI bus> on pcib6 vgapci1: <VGA-compatible display> port 0xbc80-0xbcff mem 0xd1000000-0xd1ffffff,0xc0000000-0xcfffffff,0xd2000000-0xd3ffffff irq 16 at device 0.0 on pci6 atrtc0: <AT realtime clock> port 0x70-0x7f irq 8 on acpi0 atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0 atkbd0: <AT Keyboard> irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] atkbd0: [ITHREAD] psm0: <PS/2 Mouse> irq 12 on atkbdc0 psm0: [GIANT-LOCKED] psm0: [ITHREAD] psm0: model MouseMan+, device ID 0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart0: [FILTER] cpu0: <ACPI CPU> on acpi0 est0: <Enhanced SpeedStep Frequency Control> on cpu0 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr c380c3886000c38 device_attach: est0 attach returned 6 p4tcc0: <CPU Frequency Thermal Control> on cpu0 cpu1: <ACPI CPU> on acpi0 est1: <Enhanced SpeedStep Frequency Control> on cpu1 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr c380c3886000c38 device_attach: est1 attach returned 6 p4tcc1: <CPU Frequency Thermal Control> on cpu1 cpu2: <ACPI CPU> on acpi0 est2: <Enhanced SpeedStep Frequency Control> on cpu2 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr c380c3886000c38 device_attach: est2 attach returned 6 p4tcc2: <CPU Frequency Thermal Control> on cpu2 cpu3: <ACPI CPU> on acpi0 est3: <Enhanced SpeedStep Frequency Control> on cpu3 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr c380c3886000c38 device_attach: est3 attach returned 6 p4tcc3: <CPU Frequency Thermal Control> on cpu3 orm0: <ISA Option ROMs> at iomem 0xc0000-0xcc7ff,0xcc800-0xce7ff,0xce800-0xcffff on isa0 sc0: <System console> at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 ppc0: cannot reserve I/O port range WARNING: ZFS is considered to be an experimental feature in FreeBSD. Timecounters tick every 1.000 msec firewire0: 1 nodes, maxhop <= 0 cable IRM irm(0) (me) firewire0: bus manager 0 usbus0: 12Mbps Full Speed USB v1.0 usbus1: 480Mbps High Speed USB v2.0 ZFS filesystem version 13 ZFS storage pool version 13 ugen0.1: <nVidia> at usbus0 uhub0: <nVidia OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0 ugen1.1: <nVidia> at usbus1 uhub1: <nVidia EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1 ad4: 305245MB <Hitachi HDP725032GLA360 GM3OA52A> at ata2-master SATA300 GEOM: ad4s1: geometry does not match label (255h,63s != 16h,63s). ad6: 305245MB <Hitachi HDP725032GLA360 GM3OA52A> at ata3-master SATA300 acd0: CDRW <TSSTcorp CD-RW/DVD-ROM TS-H493A/D200> at ata4-master SATA150 acd1: DVDR <TSSTcorp DVD+/-RW TS-H653A/D500> at ata5-master SATA150 GEOM_LABEL: Label for provider ad4s2 is ntfs/System. ad12: 305245MB <Hitachi HDT725032VLA360 V54OA7EA> at ata6-master SATA300 ad14: 305245MB <Hitachi HDP725032GLA360 GM3OA5CA> at ata7-master SATA300 uhub0: 10 ports with 10 removable, self powered uhub1: 10 ports with 10 removable, self powered lapic1: Forcing LINT1 to edge trigger SMP: AP CPU #1 Launched! lapic3: Forcing LINT1 to edge trigger SMP: AP CPU #3 Launched! lapic2: Forcing LINT1 to edge trigger SMP: AP CPU #2 Launched! WARNING: WITNESS option enabled, expect reduced performance. Root mount waiting for: usbus1 ugen1.2: <MARVELL> at usbus1 Root mount waiting for: usbus1 ugen1.3: <Belkin Components> at usbus1 uhub2: <Belkin Components F5U237 USB 2.0 7-Port Hub, class 9/0, rev 2.00/1.00, addr 3> on usbus1 uhub2: 7 ports with 7 removable, self powered Root mount waiting for: usbus1 ugen1.4: <Seagate> at usbus1 umass0: <Interface0> on usbus1 umass0: SCSI over Bulk-Only; quirks = 0x0000 Root mount waiting for: usbus1 umass0:1:0:-1: Attached to scbus1 da0 at umass-sim0 bus 0 target 0 lun 0 da0: <Seagate FreeAgentDesktop 100D> Fixed Direct Access SCSI-4 device da0: 40.000MB/s transfers da0: 476940MB (976773168 512 byte sectors: 255H 63S/T 60801C) GEOM: da0: partition 1 does not start on a track boundary. GEOM: da0: partition 1 does not end on a track boundary. GEOM_LABEL: Label for provider da0s1 is ntfs/Backup. Root mount waiting for: usbus1 ugen0.2: <LEGO Group> at usbus0 Root mount waiting for: usbus1 ugen1.5: <Belkin> at usbus1 rum0: <Belkin Belkin 54g USB Network Adapter, class 0/0, rev 2.00/0.01, addr 5> on usbus1 rum0: MAC/BBP RT2573 (rev 0x2573a), RF RT2528 Root mount waiting for: usbus1 ugen1.6: <TEAC> at usbus1 umass1: <TEAC CA-200, class 0/0, rev 2.00/4.00, addr 6> on usbus1 umass1: SCSI over Bulk-Only; quirks = 0x0000 Root mount waiting for: usbus1 umass1:2:1:-1: Attached to scbus2 Trying to mount root from zfs:pool (probe0:umass-sim1:1:0:0): TEST UNIT READY. CDB: 0 0 0 0 0 0 (probe0:umass-sim1:1:0:0): CAM Status: SCSI Status Error (probe0:umass-sim1:1:0:0): SCSI Status: Check Condition (probe0:umass-sim1:1:0:0): NOT READY asc:3a,0 (probe0:umass-sim1:1:0:0): Medium not present (probe0:umass-sim1:1:0:0): Unretryable error da1 at umass-sim1 bus 1 target 0 lun 0 da1: <TEAC USB HS-CF Card 4.00> Removable Direct Access SCSI-0 device da1: 40.000MB/s transfers da1: Attempt to query device size failed: NOT READY, Medium not present (probe0:umass-sim1:1:0:1): TEST UNIT READY. CDB: 0 20 0 0 0 0 (probe0:umass-sim1:1:0:1): CAM Status: SCSI Status Error (probe0:umass-sim1:1:0:1): SCSI Status: Check Condition (probe0:umass-sim1:1:0:1): NOT READY asc:3a,0 (probe0:umass-sim1:1:0:1): Medium not present (probe0:umass-sim1:1:0:1): Unretryable error da2 at umass-sim1 bus 1 target 0 lun 1 da2: <TEAC USB HS-xD/SM 4.00> Removable Direct Access SCSI-0 device da2: 40.000MB/s transfers da2: Attempt to query device size failed: NOT READY, Medium not present (probe0:umass-sim1:1:0:2): TEST UNIT READY. CDB: 0 40 0 0 0 0 (probe0:umass-sim1:1:0:2): CAM Status: SCSI Status Error (probe0:umass-sim1:1:0:2): SCSI Status: Check Condition (probe0:umass-sim1:1:0:2): NOT READY asc:3a,0 (probe0:umass-sim1:1:0:2): Medium not present (probe0:umass-sim1:1:0:2): Unretryable error da3 at umass-sim1 bus 1 target 0 lun 2 da3: <TEAC USB HS-MS Card 4.00> Removable Direct Access SCSI-0 device da3: 40.000MB/s transfers da3: Attempt to query device size failed: NOT READY, Medium not present (probe0:umass-sim1:1:0:3): TEST UNIT READY. CDB: 0 60 0 0 0 0 (probe0:umass-sim1:1:0:3): CAM Status: SCSI Status Error (probe0:umass-sim1:1:0:3): SCSI Status: Check Condition (probe0:umass-sim1:1:0:3): NOT READY asc:3a,0 (probe0:umass-sim1:1:0:3): Medium not present (probe0:umass-sim1:1:0:3): Unretryable error da4 at umass-sim1 bus 1 target 0 lun 3 da4: <TEAC USB HS-SD Card 4.00> Removable Direct Access SCSI-0 device da4: 40.000MB/s transfers da4: Attempt to query device size failed: NOT READY, Medium not present Entropy harvesting: interrupts ethernet point_to_point kickstart . /dev/ad4s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1a: clean, 436073 free (2177 frags, 54237 blocks, 0.2% fragmentation) wlan0: Ethernet address: 00:17:3f:72:40:90 rum0: need multicast update callback Starting Network: lo0. add net default: gateway 192.168.0.1 Additional TCP/IP options: tcp extensions=NO . Turning on accounting. wlan0: link state changed to UP Additional ABI support: linux . Setting date via ntp. 12 Mar 11:06:55 ntpdate[988]: step time server 158.43.192.66 offset 0.923327 sec Setting NIS domain: aah-go-on.com. Starting mountd. rum0: need multicast update callback Kernel page fault with the following non-sleepable locks held: exclusive sleep mutex if_addr_mtx (if_addr_mtx) r = 0 (0xffffff0002f8ac38) locked @ /usr/src/sys/netinet/igmp.c:1701 exclusive sleep mutex igmp_mtx (igmp_mtx) r = 0 (0xffffffff80d3f080) locked @ /usr/src/sys/netinet/igmp.c:1653 exclusive sleep mutex in_multi_mtx (in_multi_mtx) r = 0 (0xffffffff80d3f160) locked @ /usr/src/sys/netinet/igmp.c:1652 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a _witness_debugger() at _witness_debugger+0x49 witness_warn() at witness_warn+0x2ba trap() at trap+0x398 calltrap() at calltrap+0x8 --- trap 0xc, rip = 0xffffffff80603e2d, rsp = 0xfffffffe4003fa30, rbp = 0xfffffffe4003fb10 --- igmp_fasttimo() at igmp_fasttimo+0x2e5 pffasttimo() at pffasttimo+0x2a softclock() at softclock+0x2aa intr_event_execute_handlers() at intr_event_execute_handlers+0x68 ithread_loop() at ithread_loop+0xae fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xfffffffe4003fd30, rbp = 0 --- Fatal trap 12: page fault while in kernel mode cpuid = 2; apic id = 02 fault virtual address = 0x28 fault code = supervisor read data, page not present instruction pointer = 0x8:0xffffffff80603e2d stack pointer = 0x10:0xfffffffe4003fa30 frame pointer = 0x10:0xfffffffe4003fb10 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 12 (swi4: clock) Physical memory: 4077 MB Dumping 316 MB: 301 285 269 253 237 221 205 189 173 157 141 125 109 93 77 61 45 29 13 ------------------------------------------------------------------------ kernel config config: File /usr/obj/usr/src/sys/GENERIC/kernel doesn't contain configuration file. Either unsupported, or not compiled with INCLUDE_CONFIG_FILE --Boundary-00=_FTPuJCsafTNphZf--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?200903121140.53652.Thomas.Sparrevohn>