From owner-freebsd-stable@FreeBSD.ORG Mon Jan 5 22:23:51 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A43CB9FE for ; Mon, 5 Jan 2015 22:23:51 +0000 (UTC) Received: from bizet.nethelp.no (bizet.nethelp.no [195.1.209.33]) by mx1.freebsd.org (Postfix) with SMTP id B0FF53AC0 for ; Mon, 5 Jan 2015 22:23:47 +0000 (UTC) Received: (qmail 21061 invoked from network); 5 Jan 2015 22:23:39 -0000 Received: from bizet.nethelp.no (HELO localhost) (195.1.209.33) by bizet.nethelp.no with SMTP; 5 Jan 2015 22:23:39 -0000 Date: Mon, 05 Jan 2015 23:23:39 +0100 (CET) Message-Id: <20150105.232339.74735411.sthaug@nethelp.no> To: rodrigc@FreeBSD.org Subject: Re: 10.1-STABLE/i386 GENERIC + VIMAGE: Panic when going multiuser From: sthaug@nethelp.no In-Reply-To: References: <20150103.215108.41660163.sthaug@nethelp.no> X-Mailer: Mew version 3.3 on Emacs 21.3 / Mule 5.0 (SAKAKI) Mime-Version: 1.0 Content-Type: Text/Plain; charset=us-ascii Content-Transfer-Encoding: 7bit Cc: freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Jan 2015 22:23:51 -0000 > Thanks for providing the detailed logs. It looks like there is something > IPv6 related in your setup that is triggering this > problem. I don't have IPv6 configured on any of my boxes. > Can you provide your /etc/rc.conf, and any other relevant configs which > trigger usage of IPv6? Unfortunately, there is *no* IPv6 config on the box (aside from what might be done by default). rc.conf: hostname="verdi.nethelp.no" keymap="norwegian.iso.kbd" ifconfig_bge1="inet 10.0.0.2 netmask 255.255.255.252" sshd_enable="YES" dumpdev="AUTO" ddb_enable="YES" background_fsck="NO" I updated the box to a newer 10.1-STABLE today, on the suggestion of Nikos Vassiliadis - got r276691. Did a full buildworld and installworld, full kernel build and install. However, the behavior is still the same - instant panic when doing "sysctl -a" on a GENERIC kernel with the addition of options VIMAGE and options DDB. Below is the result of the generated files in /var/crash (I unpacked the textdump.tar.5 file). Steinar Haug, Nethelp consulting, sthaug@nethelp.no ---------------------------------------------------------------------- info.5 Dump header from device /dev/ada0s1b Architecture: i386 Architecture Version: 1 Dump Length: 71168B (0 MB) Blocksize: 512 Dumptime: Mon Jan 5 22:15:14 2015 Hostname: verdi.nethelp.no Magic: FreeBSD Text Dump Version String: FreeBSD 10.1-STABLE #0 r276691: Mon Jan 5 19:16:13 CET 2015 sthaug@verdi.nethelp.no:/usr/src/sys/i386/compile/GENERICV Panic String: vm_fault: fault on nofault entry, addr: cc0e3000 Dump Parity: 3635326332 Bounds: 5 Dump Status: good ---------------------------------------------------------------------- ddb.txt db:0:kdb.enter.panic> run lockinfo db:1:lockinfo> show locks No such command db:1:locks> show alllocks No such command db:1:alllocks> show lockedvnods Locked vnodes db:0:kdb.enter.panic> show pcpu cpuid = 1 dynamic pcpu = 0x20766f00 curthread = 0xc7594000: pid 979 "sysctl" curpcb = 0xf0948d40 fpcurthread = none idlethread = 0xc6ac2c40: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 curvnet = 0xc69713c0 db:0:kdb.enter.panic> bt Tracing pid 979 tid 100106 td 0xc7594000 kdb_enter(c11b4359,c11b4359,c11e23dd,f09486ec,0,...) at kdb_enter+0x3d/frame 0xf09486a0 panic(c11e23dd,cc0e3000,1,f0948804,f09487f4,...) at panic+0x13f/frame 0xf09486e0 vm_fault_hold(c1a6d000,cc0e3000,1,0,0,...) at vm_fault_hold+0x2076/frame 0xf0948840 vm_fault(c1a6d000,cc0e3000,1,0,f0948912,...) at vm_fault+0x81/frame 0xf0948868 trap_pfault(cc0e34b8,f0948910,c6baf200,f09489a0,c0934ed8,...) at trap_pfault+0x1bb/frame 0xf09488e8 trap(f0948a34) at trap+0x674/frame 0xf0948a28 calltrap() at calltrap+0x6/frame 0xf0948a28 --- trap 0xc, eip = 0xc104ab83, esp = 0xf0948a74, ebp = 0xf0948a9c --- copyout(f0948b28,cc0e34b8,4,f0948acc,c142f238,...) at copyout+0x37/frame 0xf0948a9c sysctl_ip6_temppltime(c142f238,c6a9e3a8,0,f0948b28,f0948b28,...) at sysctl_ip6_temppltime+0x3a/frame 0xf0948ac0 sysctl_root(f0948b28,8,2,c0a05797,c7034038,...) at sysctl_root+0x2b1/frame 0xf0948b00 userland_sysctl(c7594000,f0948bac,4,28803030,bfbfdb70,...) at userland_sysctl+0x1fa/frame 0xf0948b70 sys___sysctl(c7594000,f0948ca8,0,1,c1524380,...) at sys___sysctl+0x98/frame 0xf0948c18 syscall(f0948ce8) at syscall+0x4a6/frame 0xf0948cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf0948cdc --- syscall (202, FreeBSD ELF32, sys___sysctl), eip = 0x281a28b7, esp = 0xbfbfdb00, ebp = 0xbfbfdb28 --- db:0:kdb.enter.panic> ps pid ppid pgrp uid state wmesg wchan cmd 979 970 979 0 R+ CPU 1 sysctl 970 962 970 0 S+ pause 0xc6f64c74 csh 969 1 969 0 Ss+ ttyin 0xc6d4a870 getty 968 1 968 0 Ss+ ttyin 0xc6d4aa70 getty 967 1 967 0 Ss+ ttyin 0xc6d4ac70 getty 966 1 966 0 Ss+ ttyin 0xc6d4ae70 getty 965 1 965 0 Ss+ ttyin 0xc6d4c070 getty 964 1 964 0 Ss+ ttyin 0xc6d4c270 getty 963 1 963 0 Ss+ ttyin 0xc6baf070 getty 962 1 962 0 Ss+ wait 0xc6f63608 login 921 1 921 0 Ss nanslp 0xc1518149 cron 917 1 917 25 Ss pause 0xc72c566c sendmail 914 1 914 0 Ss select 0xc6f9e964 sendmail 911 1 911 0 Ss select 0xc6f9ebe4 sshd 718 1 718 0 Ss select 0xc6d2f9a4 syslogd 642 1 642 0 Ss select 0xc6f9f1a4 devd 16 0 0 0 DL vlruwt 0xc6f6390c [vnlru] 9 0 0 0 DL syncer 0xc15374c4 [syncer] 8 0 0 0 DL (threaded) [bufdaemon] 100080 D sdflush 0xc6fb3884 [/var worker] 100079 D sdflush 0xc6fb3684 [/usr worker] 100066 D psleep 0xc1536c04 [bufdaemon] 7 0 0 0 DL pgzero 0xc153be20 [pagezero] 6 0 0 0 DL psleep 0xc153bb44 [vmdaemon] 5 0 0 0 DL psleep 0xc1597104 [pagedaemon] 4 0 0 0 DL waiting_ 0xc1595374 [sctp_iterator] 3 0 0 0 DL - 0xc6baf83c [fdc0] 15 0 0 0 DL (threaded) [usb] 100053 D - 0xc6d09d34 [usbus4] 100052 D - 0xc6d09d04 [usbus4] 100051 D - 0xc6d09cd4 [usbus4] 100050 D - 0xc6d09ca4 [usbus4] 100049 D - 0xc6cf2dac [usbus3] 100048 D - 0xc6cf2d7c [usbus3] 100047 D - 0xc6cf2d4c [usbus3] 100046 D - 0xc6cf2d1c [usbus3] 100044 D - 0xc6cdbdac [usbus2] 100043 D - 0xc6cdbd7c [usbus2] 100042 D - 0xc6cdbd4c [usbus2] 100041 D - 0xc6cdbd1c [usbus2] 100039 D - 0xc6cc6dac [usbus1] 100038 D - 0xc6cc6d7c [usbus1] 100037 D - 0xc6cc6d4c [usbus1] 100036 D - 0xc6cc6d1c [usbus1] 100034 D - 0xc6ca9dac [usbus0] 100033 D - 0xc6ca9d7c [usbus0] 100032 D - 0xc6ca9d4c [usbus0] 100031 D - 0xc6ca9d1c [usbus0] 2 0 0 0 DL (threaded) [cam] 100062 D - 0xc1459428 [scanner] 100014 D - 0xc1459580 [doneq0] 14 0 0 0 DL - 0xc14742e0 [rand_harvestq] 13 0 0 0 DL (threaded) [geom] 100011 D - 0xc1591760 [g_down] 100010 D - 0xc159175c [g_up] 100009 D - 0xc1591758 [g_event] 12 0 0 0 WL (threaded) [intr] 100058 I [irq1: atkbd0] 100057 I [swi0: uart] 100055 I [irq20: hpet0+] 100054 I [irq14: ata0] 100045 I [irq23: uhci3] 100040 I [irq18: uhci2] 100035 I [irq22: uhci1] 100030 I [irq21: uhci0 ehci0] 100029 I [irq17: bge1] 100028 I [irq16: bge0] 100018 I [swi5: fast taskq] 100016 I [swi6: Giant taskq] 100015 I [swi6: task queue] 100008 I [swi4: clock] 100007 I [swi4: clock] 100006 I [swi3: vm] 100005 I [swi1: netisr 0] 11 0 0 0 RL (threaded) [idle] 100004 CanRun [idle: cpu1] 100003 Run CPU 0 [idle: cpu0] 1 0 1 0 SLs wait 0xc6ac0304 [init] 10 0 0 0 DL audit_wo 0xc1595a14 [audit] 0 0 0 0 DLs (threaded) [kernel] 100061 D - 0xc6ac5380 [CAM taskq] 100059 D - 0xc6d46200 [mca taskq] 100027 D - 0xc6c28e00 [em1 txq] 100026 D - 0xc6c28e80 [em1 que] 100025 D - 0xc6c29200 [em0 txq] 100024 D - 0xc6c29280 [em0 que] 100023 D - 0xc6ac4480 [acpi_task_2] 100022 D - 0xc6ac4480 [acpi_task_1] 100021 D - 0xc6ac4480 [acpi_task_0] 100020 D - 0xc6ac4500 [ffs_trim taskq] 100019 D - 0xc6ac4580 [kqueue taskq] 100017 D - 0xc6ac4700 [thread taskq] 100012 D - 0xc6ac5a80 [firmware taskq] 100000 D swapin 0xc15917e4 [swapper] db:0:kdb.enter.panic> alltrace Tracing command sysctl pid 979 tid 100106 td 0xc7594000 kdb_enter(c11b4359,c11b4359,c11e23dd,f09486ec,0,...) at kdb_enter+0x3d/frame 0xf09486a0 panic(c11e23dd,cc0e3000,1,f0948804,f09487f4,...) at panic+0x13f/frame 0xf09486e0 vm_fault_hold(c1a6d000,cc0e3000,1,0,0,...) at vm_fault_hold+0x2076/frame 0xf0948840 vm_fault(c1a6d000,cc0e3000,1,0,f0948912,...) at vm_fault+0x81/frame 0xf0948868 trap_pfault(cc0e34b8,f0948910,c6baf200,f09489a0,c0934ed8,...) at trap_pfault+0x1bb/frame 0xf09488e8 trap(f0948a34) at trap+0x674/frame 0xf0948a28 calltrap() at calltrap+0x6/frame 0xf0948a28 --- trap 0xc, eip = 0xc104ab83, esp = 0xf0948a74, ebp = 0xf0948a9c --- copyout(f0948b28,cc0e34b8,4,f0948acc,c142f238,...) at copyout+0x37/frame 0xf0948a9c sysctl_ip6_temppltime(c142f238,c6a9e3a8,0,f0948b28,f0948b28,...) at sysctl_ip6_temppltime+0x3a/frame 0xf0948ac0 sysctl_root(f0948b28,8,2,c0a05797,c7034038,...) at sysctl_root+0x2b1/frame 0xf0948b00 userland_sysctl(c7594000,f0948bac,4,28803030,bfbfdb70,...) at userland_sysctl+0x1fa/frame 0xf0948b70 sys___sysctl(c7594000,f0948ca8,0,1,c1524380,...) at sys___sysctl+0x98/frame 0xf0948c18 syscall(f0948ce8) at syscall+0x4a6/frame 0xf0948cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf0948cdc --- syscall (202, FreeBSD ELF32, sys___sysctl), eip = 0x281a28b7, esp = 0xbfbfdb00, ebp = 0xbfbfdb28 --- Tracing command csh pid 970 tid 100103 td 0xc6f67c40 sched_switch(c6f67c40,0,104,c0b0f4dd,0,...) at sched_switch+0x2d2/frame 0xf0922a7c mi_switch(104,0,c0b13bd4,c0b0f4dd,c1a69000,c6f67c40) at mi_switch+0x122/frame 0xf0922ab4 sleepq_switch(c6f67c40,0,c11b871a,1a8,0,...) at sleepq_switch+0x15b/frame 0xf0922adc sleepq_catch_signals(0,c11b871a,154,c6f67c40,f0922ba4,...) at sleepq_catch_signals+0x5be/frame 0xf0922b30 sleepq_wait_sig(c6f64c74,74,c10a7474,100,0,...) at sleepq_wait_sig+0x14/frame 0xf0922b5c _sleep(c6f64c74,c6f64ca8,174,c10a7474,0,...) at _sleep+0x29b/frame 0xf0922ba4 kern_sigsuspend(c6f67c40,0,0,0,0,...) at kern_sigsuspend+0x137/frame 0xf0922be8 sys_sigsuspend(c6f67c40,f0922ca8,fffffed8,0,0,...) at sys_sigsuspend+0x58/frame 0xf0922c18 syscall(f0922ce8) at syscall+0x4a6/frame 0xf0922cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf0922cdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x28176fbb, esp = 0xbfbfe374, ebp = 0xbfbfe3dc --- Tracing command getty pid 969 tid 100076 td 0xc6f65620 sched_switch(c6f65620,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xee3cd984 mi_switch(104,0,c0b13bd4,ee3cda08,72460a0d,c6f65620) at mi_switch+0x122/frame 0xee3cd9bc sleepq_switch(c6f65620,0,c11b871a,1a8,c6d48c00,...) at sleepq_switch+0x15b/frame 0xee3cd9e4 sleepq_catch_signals(0,c11b871a,154,c6d48c00,c1551260,...) at sleepq_catch_signals+0x5be/frame 0xee3cda38 sleepq_wait_sig(c6d4a870,0,c11bae0b,101,0,...) at sleepq_wait_sig+0x14/frame 0xee3cda64 _cv_wait_sig(c6d4a870,c1592120,1,1,ee3cdaec,...) at _cv_wait_sig+0x17c/frame 0xee3cda94 tty_wait(c6d4a800,c6d4a870,ee3cdbe8,1,0,...) at tty_wait+0x1f/frame 0xee3cdaac ttydisc_read(c6d4a800,ee3cdbe8,0,c0be9410,c701d188,...) at ttydisc_read+0x31c/frame 0xee3cdaec ttydev_read(c6d19700,ee3cdbe8,0,ee3cdb40,c6f65620,...) at ttydev_read+0x8f/frame 0xee3cdb10 devfs_read_f(c701d188,ee3cdbe8,c72e3d80,0,c6f65620,...) at devfs_read_f+0xb4/frame 0xee3cdb48 dofileread(c701d188,ee3cdbe8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xee3cdb80 kern_readv(c6f65620,0,ee3cdbe8,0,bfbfedf7,...) at kern_readv+0x96/frame 0xee3cdbc8 sys_read(c6f65620,ee3cdca8,c6f62000,ee3cdc64,c0b347c2,...) at sys_read+0x5c/frame 0xee3cdc18 syscall(ee3cdce8) at syscall+0x4a6/frame 0xee3cdcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3cdcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b52b7, esp = 0xbfbfeddc, ebp = 0xbfbfee08 --- Tracing command getty pid 968 tid 100084 td 0xc72dc930 sched_switch(c72dc930,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xee3f8984 mi_switch(104,0,c0b13bd4,ee3f8a08,72460a0d,c72dc930) at mi_switch+0x122/frame 0xee3f89bc sleepq_switch(c72dc930,0,c11b871a,1a8,c6bafe00,...) at sleepq_switch+0x15b/frame 0xee3f89e4 sleepq_catch_signals(0,c11b871a,154,c6bafe00,c1551260,...) at sleepq_catch_signals+0x5be/frame 0xee3f8a38 sleepq_wait_sig(c6d4aa70,0,c11bae0b,101,0,...) at sleepq_wait_sig+0x14/frame 0xee3f8a64 _cv_wait_sig(c6d4aa70,c1592120,1,1,ee3f8aec,...) at _cv_wait_sig+0x17c/frame 0xee3f8a94 tty_wait(c6d4aa00,c6d4aa70,ee3f8be8,1,0,...) at tty_wait+0x1f/frame 0xee3f8aac ttydisc_read(c6d4aa00,ee3f8be8,0,c0be9410,c701e7e0,...) at ttydisc_read+0x31c/frame 0xee3f8aec ttydev_read(c6d19800,ee3f8be8,0,ee3f8b40,c72dc930,...) at ttydev_read+0x8f/frame 0xee3f8b10 devfs_read_f(c701e7e0,ee3f8be8,c6fd5c00,0,c72dc930,...) at devfs_read_f+0xb4/frame 0xee3f8b48 dofileread(c701e7e0,ee3f8be8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xee3f8b80 kern_readv(c72dc930,0,ee3f8be8,0,bfbfedf7,...) at kern_readv+0x96/frame 0xee3f8bc8 sys_read(c72dc930,ee3f8ca8,c72cf304,ee3f8c64,c0b347c2,...) at sys_read+0x5c/frame 0xee3f8c18 syscall(ee3f8ce8) at syscall+0x4a6/frame 0xee3f8cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3f8cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b52b7, esp = 0xbfbfeddc, ebp = 0xbfbfee08 --- Tracing command getty pid 967 tid 100083 td 0xc71c5310 sched_switch(c71c5310,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xee3f0984 mi_switch(104,0,c0b13bd4,ee3f0a08,72460a0d,c71c5310) at mi_switch+0x122/frame 0xee3f09bc sleepq_switch(c71c5310,0,c11b871a,1a8,c6bafc00,...) at sleepq_switch+0x15b/frame 0xee3f09e4 sleepq_catch_signals(0,c11b871a,154,c6bafc00,c1551260,...) at sleepq_catch_signals+0x5be/frame 0xee3f0a38 sleepq_wait_sig(c6d4ac70,0,c11bae0b,101,0,...) at sleepq_wait_sig+0x14/frame 0xee3f0a64 _cv_wait_sig(c6d4ac70,c1592120,1,1,ee3f0aec,...) at _cv_wait_sig+0x17c/frame 0xee3f0a94 tty_wait(c6d4ac00,c6d4ac70,ee3f0be8,1,0,...) at tty_wait+0x1f/frame 0xee3f0aac ttydisc_read(c6d4ac00,ee3f0be8,0,c0be9410,c701d1f8,...) at ttydisc_read+0x31c/frame 0xee3f0aec ttydev_read(c6d19900,ee3f0be8,0,ee3f0b40,c71c5310,...) at ttydev_read+0x8f/frame 0xee3f0b10 devfs_read_f(c701d1f8,ee3f0be8,c72e3e80,0,c71c5310,...) at devfs_read_f+0xb4/frame 0xee3f0b48 dofileread(c701d1f8,ee3f0be8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xee3f0b80 kern_readv(c71c5310,0,ee3f0be8,0,bfbfedf7,...) at kern_readv+0x96/frame 0xee3f0bc8 sys_read(c71c5310,ee3f0ca8,c72c6304,c71c5310,c6ac1000,...) at sys_read+0x5c/frame 0xee3f0c18 syscall(ee3f0ce8) at syscall+0x4a6/frame 0xee3f0cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3f0cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b52b7, esp = 0xbfbfeddc, ebp = 0xbfbfee08 --- Tracing command getty pid 966 tid 100074 td 0xc6f65c40 sched_switch(c6f65c40,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xee3bc984 mi_switch(104,0,c0b13bd4,ee3bca08,72460a0d,c6f65c40) at mi_switch+0x122/frame 0xee3bc9bc sleepq_switch(c6f65c40,0,c11b871a,1a8,c6bafa00,...) at sleepq_switch+0x15b/frame 0xee3bc9e4 sleepq_catch_signals(0,c11b871a,154,c6bafa00,c1551260,...) at sleepq_catch_signals+0x5be/frame 0xee3bca38 sleepq_wait_sig(c6d4ae70,0,c11bae0b,101,0,...) at sleepq_wait_sig+0x14/frame 0xee3bca64 _cv_wait_sig(c6d4ae70,c1592120,1,1,ee3bcaec,...) at _cv_wait_sig+0x17c/frame 0xee3bca94 tty_wait(c6d4ae00,c6d4ae70,ee3bcbe8,1,0,...) at tty_wait+0x1f/frame 0xee3bcaac ttydisc_read(c6d4ae00,ee3bcbe8,0,c0be9410,c7033b60,...) at ttydisc_read+0x31c/frame 0xee3bcaec ttydev_read(c6d19a00,ee3bcbe8,0,ee3bcb40,c6f65c40,...) at ttydev_read+0x8f/frame 0xee3bcb10 devfs_read_f(c7033b60,ee3bcbe8,c72e3f00,0,c6f65c40,...) at devfs_read_f+0xb4/frame 0xee3bcb48 dofileread(c7033b60,ee3bcbe8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xee3bcb80 kern_readv(c6f65c40,0,ee3bcbe8,0,bfbfedf7,...) at kern_readv+0x96/frame 0xee3bcbc8 sys_read(c6f65c40,ee3bcca8,c6f62608,ee3bcc64,c0b347c2,...) at sys_read+0x5c/frame 0xee3bcc18 syscall(ee3bcce8) at syscall+0x4a6/frame 0xee3bccdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3bccdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b52b7, esp = 0xbfbfeddc, ebp = 0xbfbfee08 --- Tracing command getty pid 965 tid 100104 td 0xc6f67930 sched_switch(c6f67930,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xf092e984 mi_switch(104,0,c0b13bd4,f092ea08,72460a0d,c6f67930) at mi_switch+0x122/frame 0xf092e9bc sleepq_switch(c6f67930,0,c11b871a,1a8,c6fb4c00,...) at sleepq_switch+0x15b/frame 0xf092e9e4 sleepq_catch_signals(0,c11b871a,154,c6fb4c00,c1551260,...) at sleepq_catch_signals+0x5be/frame 0xf092ea38 sleepq_wait_sig(c6d4c070,0,c11bae0b,101,0,...) at sleepq_wait_sig+0x14/frame 0xf092ea64 _cv_wait_sig(c6d4c070,c1592120,1,1,f092eaec,...) at _cv_wait_sig+0x17c/frame 0xf092ea94 tty_wait(c6d4c000,c6d4c070,f092ebe8,1,0,...) at tty_wait+0x1f/frame 0xf092eaac ttydisc_read(c6d4c000,f092ebe8,0,c0be9410,c7033ab8,...) at ttydisc_read+0x31c/frame 0xf092eaec ttydev_read(c6d19b00,f092ebe8,0,f092eb40,c6f67930,...) at ttydev_read+0x8f/frame 0xf092eb10 devfs_read_f(c7033ab8,f092ebe8,c6fd5c80,0,c6f67930,...) at devfs_read_f+0xb4/frame 0xf092eb48 dofileread(c7033ab8,f092ebe8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xf092eb80 kern_readv(c6f67930,0,f092ebe8,0,bfbfedf7,...) at kern_readv+0x96/frame 0xf092ebc8 sys_read(c6f67930,f092eca8,c6f6490c,c6f67930,c72dc930,...) at sys_read+0x5c/frame 0xf092ec18 syscall(f092ece8) at syscall+0x4a6/frame 0xf092ecdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf092ecdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b52b7, esp = 0xbfbfeddc, ebp = 0xbfbfee08 --- Tracing command getty pid 964 tid 100098 td 0xc71c4c40 sched_switch(c71c4c40,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xf090f984 mi_switch(104,0,c0b13bd4,f090fa08,72460a0d,c71c4c40) at mi_switch+0x122/frame 0xf090f9bc sleepq_switch(c71c4c40,0,c11b871a,1a8,c6fb4a00,...) at sleepq_switch+0x15b/frame 0xf090f9e4 sleepq_catch_signals(0,c11b871a,154,c6fb4a00,c1551260,...) at sleepq_catch_signals+0x5be/frame 0xf090fa38 sleepq_wait_sig(c6d4c270,0,c11bae0b,101,0,...) at sleepq_wait_sig+0x14/frame 0xf090fa64 _cv_wait_sig(c6d4c270,c1592120,1,1,f090faec,...) at _cv_wait_sig+0x17c/frame 0xf090fa94 tty_wait(c6d4c200,c6d4c270,f090fbe8,1,0,...) at tty_wait+0x1f/frame 0xf090faac ttydisc_read(c6d4c200,f090fbe8,0,c0be9410,c701d1c0,...) at ttydisc_read+0x31c/frame 0xf090faec ttydev_read(c6d19c00,f090fbe8,0,f090fb40,c71c4c40,...) at ttydev_read+0x8f/frame 0xf090fb10 devfs_read_f(c701d1c0,f090fbe8,c72e3e00,0,c71c4c40,...) at devfs_read_f+0xb4/frame 0xf090fb48 dofileread(c701d1c0,f090fbe8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xf090fb80 kern_readv(c71c4c40,0,f090fbe8,0,bfbfedf7,...) at kern_readv+0x96/frame 0xf090fbc8 sys_read(c71c4c40,f090fca8,c72c5c10,f090fc64,c0b347c2,...) at sys_read+0x5c/frame 0xf090fc18 syscall(f090fce8) at syscall+0x4a6/frame 0xf090fcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf090fcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b52b7, esp = 0xbfbfeddc, ebp = 0xbfbfee08 --- Tracing command getty pid 963 tid 100101 td 0xc71c4310 sched_switch(c71c4310,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xf0919984 mi_switch(104,0,c0b13bd4,f0919a08,72460a0d,c71c4310) at mi_switch+0x122/frame 0xf09199bc sleepq_switch(c71c4310,0,c11b871a,1a8,c6fb4800,...) at sleepq_switch+0x15b/frame 0xf09199e4 sleepq_catch_signals(0,c11b871a,154,c6fb4800,c1551260,...) at sleepq_catch_signals+0x5be/frame 0xf0919a38 sleepq_wait_sig(c6baf070,0,c11bae0b,101,0,...) at sleepq_wait_sig+0x14/frame 0xf0919a64 _cv_wait_sig(c6baf070,c1592120,1,1,f0919aec,...) at _cv_wait_sig+0x17c/frame 0xf0919a94 tty_wait(c6baf000,c6baf070,f0919be8,1,0,...) at tty_wait+0x1f/frame 0xf0919aac ttydisc_read(c6baf000,f0919be8,0,c0be9410,c701d268,...) at ttydisc_read+0x31c/frame 0xf0919aec ttydev_read(c6d19d00,f0919be8,0,f0919b40,c71c4310,...) at ttydev_read+0x8f/frame 0xf0919b10 devfs_read_f(c701d268,f0919be8,c6ffab00,0,c71c4310,...) at devfs_read_f+0xb4/frame 0xf0919b48 dofileread(c701d268,f0919be8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xf0919b80 kern_readv(c71c4310,0,f0919be8,0,bfbfedf7,...) at kern_readv+0x96/frame 0xf0919bc8 sys_read(c71c4310,f0919ca8,c72c5304,f0919c64,c0b347c2,...) at sys_read+0x5c/frame 0xf0919c18 syscall(f0919ce8) at syscall+0x4a6/frame 0xf0919cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf0919cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b52b7, esp = 0xbfbfeddc, ebp = 0xbfbfee08 --- Tracing command login pid 962 tid 100069 td 0xc6f66c40 sched_switch(c6f66c40,0,104,c0deb97c,0,...) at sched_switch+0x2d2/frame 0xee3aa960 mi_switch(104,0,c2ca33e8,3,2,c6f66c40) at mi_switch+0x122/frame 0xee3aa998 sleepq_switch(c6f66c40,0,c11b871a,1a8,0,...) at sleepq_switch+0x15b/frame 0xee3aa9c0 sleepq_catch_signals(0,c11b871a,154,c6f66c40,ee3aaa44,...) at sleepq_catch_signals+0x5be/frame 0xee3aaa14 sleepq_wait_sig(c6f63608,6c,c11b9586,100,0,...) at sleepq_wait_sig+0x14/frame 0xee3aaa40 _sleep(c6f63608,c6f636a0,16c,c11b9586,0,...) at _sleep+0x29b/frame 0xee3aaa88 kern_wait6(c6f66c40,0,3ca,0,ee3aab24,...) at kern_wait6+0x725/frame 0xee3aaaf8 sys_wait4(c6f66c40,ee3aaca8,c6f63608,4,c0886f8e,...) at sys_wait4+0x94/frame 0xee3aac18 syscall(ee3aace8) at syscall+0x4a6/frame 0xee3aacdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3aacdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2811c143, esp = 0xbfbfed20, ebp = 0xbfbfed38 --- Tracing command cron pid 921 tid 100102 td 0xc71c4000 sched_switch(c71c4000,0,104,c0b42f6a,0,...) at sched_switch+0x2d2/frame 0xf091da4c mi_switch(104,0,c0b42567,1,0,c71c4000) at mi_switch+0x122/frame 0xf091da84 sleepq_switch(c71c4000,0,c11b871a,1a8,62,...) at sleepq_switch+0x15b/frame 0xf091daac sleepq_catch_signals(bf50ab8a,3,c0b745a0,c71c4000,1,...) at sleepq_catch_signals+0x5be/frame 0xf091db00 sleepq_timedwait_sig(c1518149,6c,62,bf50ab8a,3,...) at sleepq_timedwait_sig+0x14/frame 0xf091db30 _sleep(c1518149,0,16c,c11b5054,3e22221d,...) at _sleep+0x26b/frame 0xf091db78 kern_nanosleep(bfbfee28,f091dbf0,f091dbf8,f091dce8,3b,...) at kern_nanosleep+0x14b/frame 0xf091dbd8 sys_nanosleep(c71c4000,f091dca8,c72c5000,c74c5000,0,...) at sys_nanosleep+0x69/frame 0xf091dc18 syscall(f091dce8) at syscall+0x4a6/frame 0xf091dcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf091dcdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2819f203, esp = 0xbfbfecb4, ebp = 0xbfbfee44 --- Tracing command sendmail pid 917 tid 100100 td 0xc71c4620 sched_switch(c71c4620,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xf0916a7c mi_switch(104,0,c0b13bd4,0,0,c71c4620) at mi_switch+0x122/frame 0xf0916ab4 sleepq_switch(c71c4620,0,c11b871a,1a8,0,...) at sleepq_switch+0x15b/frame 0xf0916adc sleepq_catch_signals(0,c11b871a,154,c71c4620,f0916ba4,...) at sleepq_catch_signals+0x5be/frame 0xf0916b30 sleepq_wait_sig(c72c566c,74,c10a7474,100,0,...) at sleepq_wait_sig+0x14/frame 0xf0916b5c _sleep(c72c566c,c72c56a0,174,c10a7474,0,...) at _sleep+0x29b/frame 0xf0916ba4 kern_sigsuspend(c71c4620,0,0,0,0,...) at kern_sigsuspend+0x137/frame 0xf0916be8 sys_sigsuspend(c71c4620,f0916ca8,c72c5608,1,c71c5930,...) at sys_sigsuspend+0x58/frame 0xf0916c18 syscall(f0916ce8) at syscall+0x4a6/frame 0xf0916cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf0916cdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2836bfbb, esp = 0xbfbfd9cc, ebp = 0xbfbfd9f8 --- Tracing command sendmail pid 914 tid 100099 td 0xc71c4930 sched_switch(c71c4930,0,104,3ecab0,0,...) at sched_switch+0x2d2/frame 0xf09138d8 mi_switch(104,0,f091398c,c0b13bd4,f0913970,c71c4930) at mi_switch+0x122/frame 0xf0913910 sleepq_switch(c71c4930,0,c11b871a,1a8,d9fc90b0,...) at sleepq_switch+0x15b/frame 0xf0913938 sleepq_catch_signals(50000000,0,c0b745a0,c71c4930,0,...) at sleepq_catch_signals+0x5be/frame 0xf091398c sleepq_timedwait_sig(c6f9e964,0,35,50000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf09139bc _cv_timedwait_sig_sbt(c6f9e964,c6f9e950,d9fc90b0,35,50000000,...) at _cv_timedwait_sig_sbt+0x1a7/frame 0xf09139f0 seltdwait(35,50000000,0,c71c4930,f0913ba0,...) at seltdwait+0xc1/frame 0xf0913a28 kern_select(c71c4930,4,bfbfcfb8,0,0,...) at kern_select+0x8c2/frame 0xf0913bd0 sys_select(c71c4930,f0913ca8,c72c590c,c0b13bf5,c1524380,...) at sys_select+0x69/frame 0xf0913c18 syscall(f0913ce8) at syscall+0x4a6/frame 0xf0913cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf0913cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28444277, esp = 0xbfbfcf1c, ebp = 0xbfbfd9d8 --- Tracing command sshd pid 911 tid 100090 td 0xc72d0620 sched_switch(c72d0620,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xf08bf8e0 mi_switch(104,0,0,0,40a,c72d0620) at mi_switch+0x122/frame 0xf08bf918 sleepq_switch(c72d0620,0,c11b871a,1a8,0,...) at sleepq_switch+0x15b/frame 0xf08bf940 sleepq_catch_signals(0,c11b871a,154,f08bfba8,f08bf9d4,...) at sleepq_catch_signals+0x5be/frame 0xf08bf994 sleepq_wait_sig(c6f9ebe4,0,c11ee8e2,101,0,...) at sleepq_wait_sig+0x14/frame 0xf08bf9c0 _cv_wait_sig(c6f9ebe4,c6f9ebd0,c7033bd0,c72d0620,f08bfa28,...) at _cv_wait_sig+0x17c/frame 0xf08bf9f0 seltdwait(ffffffff,0,0,c72d0620,f08bfba0,...) at seltdwait+0xcf/frame 0xf08bfa28 kern_select(c72d0620,5,28c0c158,0,0,...) at kern_select+0x8c2/frame 0xf08bfbd0 sys_select(c72d0620,f08bfca8,c72ce000,c72d0620,c71c5930,...) at sys_select+0x69/frame 0xf08bfc18 syscall(f08bfce8) at syscall+0x4a6/frame 0xf08bfcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf08bfcdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28636277, esp = 0xbfbfe43c, ebp = 0xbfbfe460 --- Tracing command syslogd pid 718 tid 100081 td 0xc71c5930 sched_switch(c71c5930,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee3ea8e0 mi_switch(104,0,0,0,0,c71c5930) at mi_switch+0x122/frame 0xee3ea918 sleepq_switch(c71c5930,0,c11b871a,1a8,0,...) at sleepq_switch+0x15b/frame 0xee3ea940 sleepq_catch_signals(0,c11b871a,154,ee3eaba8,2,...) at sleepq_catch_signals+0x5be/frame 0xee3ea994 sleepq_wait_sig(c6d2f9a4,0,c11ee8e2,101,0,...) at sleepq_wait_sig+0x14/frame 0xee3ea9c0 _cv_wait_sig(c6d2f9a4,c6d2f990,c0a05b8b,c69a4000,0,...) at _cv_wait_sig+0x17c/frame 0xee3ea9f0 seltdwait(ffffffff,0,0,c71c5930,ee3eaba0,...) at seltdwait+0xcf/frame 0xee3eaa28 kern_select(c71c5930,9,28834118,0,0,...) at kern_select+0x8c2/frame 0xee3eabd0 sys_select(c71c5930,ee3eaca8,804c210,c74c2000,0,...) at sys_select+0x69/frame 0xee3eac18 syscall(ee3eace8) at syscall+0x4a6/frame 0xee3eacdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3eacdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281b8277, esp = 0xbfbfdea4, ebp = 0xbfbfee34 --- Tracing command devd pid 642 tid 100082 td 0xc71c5620 sched_switch(c71c5620,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee3ed8d8 mi_switch(104,0,0,c0b13bd4,c1a3c870,c71c5620) at mi_switch+0x122/frame 0xee3ed910 sleepq_switch(c71c5620,0,c11b871a,1a8,2b65696c,...) at sleepq_switch+0x15b/frame 0xee3ed938 sleepq_catch_signals(c0000000,3,c0b745a0,c71c5620,0,...) at sleepq_catch_signals+0x5be/frame 0xee3ed98c sleepq_timedwait_sig(c6f9f1a4,0,5a,c0000000,3,...) at sleepq_timedwait_sig+0x14/frame 0xee3ed9bc _cv_timedwait_sig_sbt(c6f9f1a4,c6f9f190,2b65696c,5a,c0000000,...) at _cv_timedwait_sig_sbt+0x1a7/frame 0xee3ed9f0 seltdwait(5a,c0000000,3,c71c5620,ee3edba0,...) at seltdwait+0xc1/frame 0xee3eda28 kern_select(c71c5620,6,bfbfcda0,0,0,...) at kern_select+0x8c2/frame 0xee3edbd0 sys_select(c71c5620,ee3edca8,c72c6608,c152441c,c71c5620,...) at sys_select+0x69/frame 0xee3edc18 syscall(ee3edce8) at syscall+0x4a6/frame 0xee3edcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3edcdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x8097703, esp = 0xbfbfcd3c, ebp = 0xbfbfee54 --- Tracing command vnlru pid 16 tid 100068 td 0xc6f67000 sched_switch(c6f67000,0,104,0,4a5ea08e,...) at sched_switch+0x2d2/frame 0xee3a6b5c mi_switch(104,0,101,c6f67000,ee3a6be8,c6f6390c) at mi_switch+0x122/frame 0xee3a6b94 sleepq_switch(c6f67000,0,c11b871a,28b,101,...) at sleepq_switch+0x15b/frame 0xee3a6bbc sleepq_timedwait(c6f6390c,60,0,0,0,...) at sleepq_timedwait+0x3f/frame 0xee3a6be8 _sleep(c6f6390c,c1537480,260,c11bf70c,fffffed8,...) at _sleep+0x282/frame 0xee3a6c30 vnlru_proc(0,ee3a6ce8,0,0,0,...) at vnlru_proc+0xcf/frame 0xee3a6ca4 fork_exit(c0bdd050,0,ee3a6ce8) at fork_exit+0xa3/frame 0xee3a6cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee3a6cd4 --- trap 0, eip = 0, esp = 0xee3a6d20, ebp = 0 --- Tracing command syncer pid 9 tid 100067 td 0xc6f67310 sched_switch(c6f67310,0,104,4a5ea08e,0,...) at sched_switch+0x2d2/frame 0xee3a3b68 mi_switch(104,0,101,c6f67310,ee3a3bf4,c15374c4) at mi_switch+0x122/frame 0xee3a3ba0 sleepq_switch(c6f67310,0,c11b871a,28b,101,...) at sleepq_switch+0x15b/frame 0xee3a3bc8 sleepq_timedwait(c15374c4,0,0,0,0,...) at sleepq_timedwait+0x3f/frame 0xee3a3bf4 _cv_timedwait_sbt(c15374c4,c15374a4,fffffed8,0,0,...) at _cv_timedwait_sbt+0x1a7/frame 0xee3a3c28 sched_sync(0,ee3a3ce8,0,0,0,...) at sched_sync+0x7a1/frame 0xee3a3ca4 fork_exit(c0bdc710,0,ee3a3ce8) at fork_exit+0xa3/frame 0xee3a3cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee3a3cd4 --- trap 0, eip = 0, esp = 0xee3a3d20, ebp = 0 --- Tracing command bufdaemon pid 8 tid 100080 td 0xc71c5c40 sched_switch(c71c5c40,0,104,0,4439c366,...) at sched_switch+0x2d2/frame 0xee3dbb8c mi_switch(104,0,101,c71c5c40,ee3dbc18,c6fb3884) at mi_switch+0x122/frame 0xee3dbbc4 sleepq_switch(c71c5c40,0,c11b871a,28b,101,...) at sleepq_switch+0x15b/frame 0xee3dbbec sleepq_timedwait(c6fb3884,54,0,0,0,...) at sleepq_timedwait+0x3f/frame 0xee3dbc18 _sleep(c6fb3884,c6fb3800,54,c11dff6e,7fffff6c,...) at _sleep+0x282/frame 0xee3dbc60 softdep_flush(c7103000,ee3dbce8,c0daa8f0,0,ee3dbcd0,...) at softdep_flush+0x16a/frame 0xee3dbca4 fork_exit(c0daa8f0,c7103000,ee3dbce8) at fork_exit+0xa3/frame 0xee3dbcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee3dbcd4 --- trap 0, eip = 0, esp = 0xee3dbd20, ebp = 0 --- Tracing command bufdaemon pid 8 tid 100079 td 0xc71c6000 sched_switch(c71c6000,0,104,0,426f02e5,...) at sched_switch+0x2d2/frame 0xee3d8b8c mi_switch(104,0,101,c71c6000,ee3d8c18,c6fb3684) at mi_switch+0x122/frame 0xee3d8bc4 sleepq_switch(c71c6000,0,c11b871a,28b,101,...) at sleepq_switch+0x15b/frame 0xee3d8bec sleepq_timedwait(c6fb3684,54,0,0,0,...) at sleepq_timedwait+0x3f/frame 0xee3d8c18 _sleep(c6fb3684,c6fb3600,54,c11dff6e,7fffff6c,...) at _sleep+0x282/frame 0xee3d8c60 softdep_flush(c71032a0,ee3d8ce8,c0daa8f0,0,ee3d8cd0,...) at softdep_flush+0x16a/frame 0xee3d8ca4 fork_exit(c0daa8f0,c71032a0,ee3d8ce8) at fork_exit+0xa3/frame 0xee3d8cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee3d8cd4 --- trap 0, eip = 0, esp = 0xee3d8d20, ebp = 0 --- Tracing command bufdaemon pid 8 tid 100066 td 0xc6f67620 sched_switch(c6f67620,0,104,4a5ea08e,0,...) at sched_switch+0x2d2/frame 0xee3a0b98 mi_switch(104,0,101,c6f67620,ee3a0c24,c1536c04) at mi_switch+0x122/frame 0xee3a0bd0 sleepq_switch(c6f67620,0,c11b871a,28b,101,...) at sleepq_switch+0x15b/frame 0xee3a0bf8 sleepq_timedwait(c1536c04,54,0,0,0,...) at sleepq_timedwait+0x3f/frame 0xee3a0c24 _sleep(c1536c04,c1536b80,54,c11bd177,fffffed8,...) at _sleep+0x282/frame 0xee3a0c6c buf_daemon(0,ee3a0ce8,0,0,0,...) at buf_daemon+0xac/frame 0xee3a0ca4 fork_exit(c0bc02e0,0,ee3a0ce8) at fork_exit+0xa3/frame 0xee3a0cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee3a0cd4 --- trap 0, eip = 0, esp = 0xee3a0d20, ebp = 0 --- Tracing command pagezero pid 7 tid 100065 td 0xc6cee620 sched_switch(c6cee620,0,104,7dd23bad,0,...) at sched_switch+0x2d2/frame 0xee39dba0 mi_switch(104,0,101,c6cee620,ee39dc2c,c153be20) at mi_switch+0x122/frame 0xee39dbd8 sleepq_switch(c6cee620,0,c11b871a,28b,101,...) at sleepq_switch+0x15b/frame 0xee39dc00 sleepq_timedwait(c153be20,0,12b,0,0,...) at sleepq_timedwait+0x3f/frame 0xee39dc2c _sleep(c153be20,c1597080,0,c11e41f3,fffea520,...) at _sleep+0x282/frame 0xee39dc74 vm_pagezero(0,ee39dce8,0,0,0,...) at vm_pagezero+0xd2/frame 0xee39dca4 fork_exit(c0e0b8f0,0,ee39dce8) at fork_exit+0xa3/frame 0xee39dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee39dcd4 --- trap 0, eip = 0, esp = 0xee39dd20, ebp = 0 --- Tracing command vmdaemon pid 6 tid 100064 td 0xc6cee930 sched_switch(c6cee930,0,104,0,c6cee930,...) at sched_switch+0x2d2/frame 0xee39ab64 mi_switch(104,0,0,0,c6cee930,c153bb44) at mi_switch+0x122/frame 0xee39ab9c sleepq_switch(c6cee930,0,c11b871a,268,0,...) at sleepq_switch+0x15b/frame 0xee39abc4 sleepq_wait(c153bb44,74,c11bd177,0,0,...) at sleepq_wait+0x3f/frame 0xee39abf0 _sleep(c153bb44,c153bb2c,74,c11bd177,0,...) at _sleep+0x2ae/frame 0xee39ac38 vm_daemon(0,ee39ace8,0,0,0,...) at vm_daemon+0x116/frame 0xee39aca4 fork_exit(c0e042c0,0,ee39ace8) at fork_exit+0xa3/frame 0xee39acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee39acd4 --- trap 0, eip = 0, esp = 0xee39ad20, ebp = 0 --- Tracing command pagedaemon pid 5 tid 100063 td 0xc6ceec40 sched_switch(c6ceec40,0,104,0,4a5ea08e,...) at sched_switch+0x2d2/frame 0xee397b64 mi_switch(104,0,101,c6ceec40,ee397bf0,c1597104) at mi_switch+0x122/frame 0xee397b9c sleepq_switch(c6ceec40,0,c11b871a,28b,101,...) at sleepq_switch+0x15b/frame 0xee397bc4 sleepq_timedwait(c1597104,54,0,0,0,...) at sleepq_timedwait+0x3f/frame 0xee397bf0 _sleep(c1597104,c1597080,54,c11bd177,fffffed8,...) at _sleep+0x282/frame 0xee397c38 vm_pageout(0,ee397ce8,0,0,0,...) at vm_pageout+0x1fb/frame 0xee397ca4 fork_exit(c0e04d30,0,ee397ce8) at fork_exit+0xa3/frame 0xee397cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee397cd4 --- trap 0, eip = 0, esp = 0xee397d20, ebp = 0 --- Tracing command sctp_iterator pid 4 tid 100060 td 0xc6d22620 sched_switch(c6d22620,0,104,0,c6d22620,...) at sched_switch+0x2d2/frame 0xee38eba4 mi_switch(104,0,d6fe7fc8,c0b0f60f,c6d22620,c1595374) at mi_switch+0x122/frame 0xee38ebdc sleepq_switch(c6d22620,0,c11b871a,268,c6fe7fc8,...) at sleepq_switch+0x15b/frame 0xee38ec04 sleepq_wait(c1595374,0,c11cffbb,0,0,...) at sleepq_wait+0x3f/frame 0xee38ec30 _sleep(c1595374,c159533c,0,c11cffbb,0,...) at _sleep+0x2ae/frame 0xee38ec78 sctp_iterator_thread(0,ee38ece8,0,0,0,...) at sctp_iterator_thread+0x9c/frame 0xee38eca4 fork_exit(c0c85190,0,ee38ece8) at fork_exit+0xa3/frame 0xee38ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee38ecd4 --- trap 0, eip = 0, esp = 0xee38ed20, ebp = 0 --- Tracing command fdc0 pid 3 tid 100056 td 0xc6d23310 sched_switch(c6d23310,0,104,0,4a5ea08e,...) at sched_switch+0x2d2/frame 0xee381b34 mi_switch(104,0,101,c6d23310,ee381bc0,c6baf83c) at mi_switch+0x122/frame 0xee381b6c sleepq_switch(c6d23310,0,c11b871a,28b,101,...) at sleepq_switch+0x15b/frame 0xee381b94 sleepq_timedwait(c6baf83c,5c,0,0,0,...) at sleepq_timedwait+0x3f/frame 0xee381bc0 _sleep(c6baf83c,c6baf8f0,5c,c11a40d4,fffffed8,...) at _sleep+0x282/frame 0xee381c08 fdc_thread(c6baf800,ee381ce8,0,0,0,...) at fdc_thread+0x877/frame 0xee381ca4 fork_exit(c0fc4820,c6baf800,ee381ce8) at fork_exit+0xa3/frame 0xee381cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee381cd4 --- trap 0, eip = 0, esp = 0xee381d20, ebp = 0 --- Tracing command usb pid 15 tid 100053 td 0xc6d23c40 sched_switch(c6d23c40,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee304bb8 mi_switch(104,0,0,80246,c6d23c40,c6d09d34) at mi_switch+0x122/frame 0xee304bf0 sleepq_switch(c6d23c40,0,c11b871a,268,0,...) at sleepq_switch+0x15b/frame 0xee304c18 sleepq_wait(c6d09d34,0,c11a40d4,1,0,...) at sleepq_wait+0x3f/frame 0xee304c44 _cv_wait(c6d09d34,c6d09e74,c118fd9e,73,0,...) at _cv_wait+0x182/frame 0xee304c74 usb_process(c6d09d2c,ee304ce8,0,0,0,...) at usb_process+0xf6/frame 0xee304ca4 fork_exit(c09a4c40,c6d09d2c,ee304ce8) at fork_exit+0xa3/frame 0xee304cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee304cd4 --- trap 0, eip = 0, esp = 0xee304d20, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xc6c85c40 sched_switch(c6c85c40,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee301bb8 mi_switch(104,0,c6c99fc8,c0b3463d,c6c85c40,c6d09d04) at mi_switch+0x122/frame 0xee301bf0 sleepq_switch(c6c85c40,0,c11b871a,268,c6d57640,...) at sleepq_switch+0x15b/frame 0xee301c18 sleepq_wait(c6d09d04,0,c11a40d4,1,0,...) at sleepq_wait+0x3f/frame 0xee301c44 _cv_wait(c6d09d04,c6d09e74,c118fd9e,73,0,...) at _cv_wait+0x182/frame 0xee301c74 usb_process(c6d09cfc,ee301ce8,0,0,0,...) at usb_process+0xf6/frame 0xee301ca4 fork_exit(c09a4c40,c6d09cfc,ee301ce8) at fork_exit+0xa3/frame 0xee301cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee301cd4 --- trap 0, eip = 0, esp = 0xee301d20, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xc6cec000 sched_switch(c6cec000,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2febb8 mi_switch(104,0,0,80246,c6cec000,c6d09cd4) at mi_switch+0x122/frame 0xee2febf0 sleepq_switch(c6cec000,0,c11b871a,268,0,...) at sleepq_switch+0x15b/frame 0xee2fec18 sleepq_wait(c6d09cd4,0,c11a40d4,1,0,...) at sleepq_wait+0x3f/frame 0xee2fec44 _cv_wait(c6d09cd4,c6d09e74,c118fd9e,73,0,...) at _cv_wait+0x182/frame 0xee2fec74 usb_process(c6d09ccc,ee2fece8,0,0,0,...) at usb_process+0xf6/frame 0xee2feca4 fork_exit(c09a4c40,c6d09ccc,ee2fece8) at fork_exit+0xa3/frame 0xee2fecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2fecd4 --- trap 0, eip = 0, esp = 0xee2fed20, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xc6cec310 sched_switch(c6cec310,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2fbbb8 mi_switch(104,0,0,80246,c6cec310,c6d09ca4) at mi_switch+0x122/frame 0xee2fbbf0 sleepq_switch(c6cec310,0,c11b871a,268,0,...) at sleepq_switch+0x15b/frame 0xee2fbc18 sleepq_wait(c6d09ca4,0,c11a40d4,1,0,...) at sleepq_wait+0x3f/frame 0xee2fbc44 _cv_wait(c6d09ca4,c6d09e74,c118fd9e,73,0,...) at _cv_wait+0x182/frame 0xee2fbc74 usb_process(c6d09c9c,ee2fbce8,0,0,0,...) at usb_process+0xf6/frame 0xee2fbca4 fork_exit(c09a4c40,c6d09c9c,ee2fbce8) at fork_exit+0xa3/frame 0xee2fbcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2fbcd4 --- trap 0, eip = 0, esp = 0xee2fbd20, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xc6cec620 sched_switch(c6cec620,0,104,c09a5229,0,...) at sched_switch+0x2d2/frame 0xee2f5bb8 mi_switch(104,0,0,80246,c6cec620,c6cf2dac) at mi_switch+0x122/frame 0xee2f5bf0 sleepq_switch(c6cec620,0,c11b871a,268,4,...) at sleepq_switch+0x15b/frame 0xee2f5c18 sleepq_wait(c6cf2dac,0,c11a40d4,1,0,...) at sleepq_wait+0x3f/frame 0xee2f5c44 _cv_wait(c6cf2dac,c6cf2eec,c118fd9e,73,0,...) at _cv_wait+0x182/frame 0xee2f5c74 usb_process(c6cf2da4,ee2f5ce8,0,0,0,...) at usb_process+0xf6/frame 0xee2f5ca4 fork_exit(c09a4c40,c6cf2da4,ee2f5ce8) at fork_exit+0xa3/frame 0xee2f5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2f5cd4 --- trap 0, eip = 0, esp = 0xee2f5d20, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xc6cec930 sched_switch(c6cec930,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2f2bb8 mi_switch(104,0,c09955f2,c1592130,c6cec930,c6cf2d7c) at mi_switch+0x122/frame 0xee2f2bf0 sleepq_switch(c6cec930,0,c11b871a,268,c6d57380,...) at sleepq_switch+0x15b/frame 0xee2f2c18 sleepq_wait(c6cf2d7c,0,c11a40d4,1,0,...) at sleepq_wait+0x3f/frame 0xee2f2c44 _cv_wait(c6cf2d7c,c6cf2eec,c118fd9e,73,0,...) at _cv_wait+0x182/frame 0xee2f2c74 usb_process(c6cf2d74,ee2f2ce8,0,0,0,...) at usb_process+0xf6/frame 0xee2f2ca4 fork_exit(c09a4c40,c6cf2d74,ee2f2ce8) at fork_exit+0xa3/frame 0xee2f2cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2f2cd4 --- trap 0, eip = 0, esp = 0xee2f2d20, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xc6cecc40 sched_switch(c6cecc40,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2efbb8 mi_switch(104,0,0,80246,c6cecc40,c6cf2d4c) at mi_switch+0x122/frame 0xee2efbf0 sleepq_switch(c6cecc40,0,c11b871a,268,0,...) at sleepq_switch+0x15b/frame 0xee2efc18 sleepq_wait(c6cf2d4c,0,c11a40d4,1,0,...) at sleepq_wait+0x3f/frame 0xee2efc44 _cv_wait(c6cf2d4c,c6cf2eec,c118fd9e,73,0,...) at _cv_wait+0x182/frame 0xee2efc74 usb_process(c6cf2d44,ee2efce8,0,0,0,...) at usb_process+0xf6/frame 0xee2efca4 fork_exit(c09a4c40,c6cf2d44,ee2efce8) at fork_exit+0xa3/frame 0xee2efcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2efcd4 --- trap 0, eip = 0, esp = 0xee2efd20, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xc6ced000 sched_switch(c6ced000,0,104,8,0,...) at sched_switch+0x2d2/frame 0xee2ecbb8 mi_switch(104,0,0,0,c6ced000,c6cf2d1c) at mi_switch+0x122/frame 0xee2ecbf0 sleepq_switch(c6ced000,0,c11b871a,268,4,...) at sleepq_switch+0x15b/frame 0xee2ecc18 sleepq_wait(c6cf2d1c,0,c11a40d4,1,0,...) at sleepq_wait+0x3f/frame 0xee2ecc44 _cv_wait(c6cf2d1c,c6cf2eec,c118fd9e,73,0,...) at _cv_wait+0x182/frame 0xee2ecc74 usb_process(c6cf2d14,ee2ecce8,0,0,0,...) at usb_process+0xf6/frame 0xee2ecca4 fork_exit(c09a4c40,c6cf2d14,ee2ecce8) at fork_exit+0xa3/frame 0xee2eccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2eccd4 --- trap 0, eip = 0, esp = 0xee2ecd20, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xc6ced620 sched_switch(c6ced620,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2e5bb8 mi_switch(104,0,0,80246,c6ced620,c6cdbdac) at mi_switch+0x122/frame 0xee2e5bf0 sleepq_switch(c6ced620,0,c11b871a,268,0,...) at sleepq_switch+0x15b/frame 0xee2e5c18 sleepq_wait(c6cdbdac,0,c11a40d4,1,0,...) at sleepq_wait+0x3f/frame 0xee2e5c44 _cv_wait(c6cdbdac,c6cdbeec,c118fd9e,73,0,...) at _cv_wait+0x182/frame 0xee2e5c74 usb_process(c6cdbda4,ee2e5ce8,0,0,0,...) at usb_process+0xf6/frame 0xee2e5ca4 fork_exit(c09a4c40,c6cdbda4,ee2e5ce8) at fork_exit+0xa3/frame 0xee2e5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2e5cd4 --- trap 0, eip = 0, esp = 0xee2e5d20, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xc6ced930 sched_switch(c6ced930,0,104,c1a6c5d0,0,...) at sched_switch+0x2d2/frame 0xee2e2bb8 mi_switch(104,0,c09955f2,c1592130,c6ced930,c6cdbd7c) at mi_switch+0x122/frame 0xee2e2bf0 sleepq_switch(c6ced930,0,c11b871a,268,c6d57140,...) at sleepq_switch+0x15b/frame 0xee2e2c18 sleepq_wait(c6cdbd7c,0,c11a40d4,1,0,...) at sleepq_wait+0x3f/frame 0xee2e2c44 _cv_wait(c6cdbd7c,c6cdbeec,c118fd9e,73,0,...) at _cv_wait+0x182/frame 0xee2e2c74 usb_process(c6cdbd74,ee2e2ce8,0,0,0,...) at usb_process+0xf6/frame 0xee2e2ca4 fork_exit(c09a4c40,c6cdbd74,ee2e2ce8) at fork_exit+0xa3/frame 0xee2e2cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2e2cd4 --- trap 0, eip = 0, esp = 0xee2e2d20, ebp = 0 --- Tracing command usb pid 15 tid 100042 td 0xc6cedc40 sched_switch(c6cedc40,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2dfbb8 mi_switch(104,0,0,80246,c6cedc40,c6cdbd4c) at mi_switch+0x122/frame 0xee2dfbf0 sleepq_switch(c6cedc40,0,c11b871a,268,0,...) at sleepq_switch+0x15b/frame 0xee2dfc18 sleepq_wait(c6cdbd4c,0,c11a40d4,1,0,...) at sleepq_wait+0x3f/frame 0xee2dfc44 _cv_wait(c6cdbd4c,c6cdbeec,c118fd9e,73,0,...) at _cv_wait+0x182/frame 0xee2dfc74 usb_process(c6cdbd44,ee2dfce8,0,0,0,...) at usb_process+0xf6/frame 0xee2dfca4 fork_exit(c09a4c40,c6cdbd44,ee2dfce8) at fork_exit+0xa3/frame 0xee2dfcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2dfcd4 --- trap 0, eip = 0, esp = 0xee2dfd20, ebp = 0 --- Tracing command usb pid 15 tid 100041 td 0xc6cee000 sched_switch(c6cee000,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2dcbb8 mi_switch(104,0,0,80246,c6cee000,c6cdbd1c) at mi_switch+0x122/frame 0xee2dcbf0 sleepq_switch(c6cee000,0,c11b871a,268,0,...) at sleepq_switch+0x15b/frame 0xee2dcc18 sleepq_wait(c6cdbd1c,0,c11a40d4,1,0,...) at sleepq_wait+0x3f/frame 0xee2dcc44 _cv_wait(c6cdbd1c,c6cdbeec,c118fd9e,73,0,...) at _cv_wait+0x182/frame 0xee2dcc74 usb_process(c6cdbd14,ee2dcce8,0,0,0,...) at usb_process+0xf6/frame 0xee2dcca4 fork_exit(c09a4c40,c6cdbd14,ee2dcce8) at fork_exit+0xa3/frame 0xee2dccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2dccd4 --- trap 0, eip = 0, esp = 0xee2dcd20, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xc6c0d310 sched_switch(c6c0d310,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2d5bb8 mi_switch(104,0,0,80246,c6c0d310,c6cc6dac) at mi_switch+0x122/frame 0xee2d5bf0 sleepq_switch(c6c0d310,0,c11b871a,268,0,...) at sleepq_switch+0x15b/frame 0xee2d5c18 sleepq_wait(c6cc6dac,0,c11a40d4,1,0,...) at sleepq_wait+0x3f/frame 0xee2d5c44 _cv_wait(c6cc6dac,c6cc6eec,c118fd9e,73,0,...) at _cv_wait+0x182/frame 0xee2d5c74 usb_process(c6cc6da4,ee2d5ce8,0,0,0,...) at usb_process+0xf6/frame 0xee2d5ca4 fork_exit(c09a4c40,c6cc6da4,ee2d5ce8) at fork_exit+0xa3/frame 0xee2d5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2d5cd4 --- trap 0, eip = 0, esp = 0xee2d5d20, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xc6c0d620 sched_switch(c6c0d620,0,104,c1a6c5d0,0,...) at sched_switch+0x2d2/frame 0xee2d2bb8 mi_switch(104,0,0,0,c6c0d620,c6cc6d7c) at mi_switch+0x122/frame 0xee2d2bf0 sleepq_switch(c6c0d620,0,c11b871a,268,c6d57900,...) at sleepq_switch+0x15b/frame 0xee2d2c18 sleepq_wait(c6cc6d7c,0,c11a40d4,1,0,...) at sleepq_wait+0x3f/frame 0xee2d2c44 _cv_wait(c6cc6d7c,c6cc6eec,c118fd9e,73,0,...) at _cv_wait+0x182/frame 0xee2d2c74 usb_process(c6cc6d74,ee2d2ce8,0,0,0,...) at usb_process+0xf6/frame 0xee2d2ca4 fork_exit(c09a4c40,c6cc6d74,ee2d2ce8) at fork_exit+0xa3/frame 0xee2d2cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2d2cd4 --- trap 0, eip = 0, esp = 0xee2d2d20, ebp = 0 --- Tracing command usb pid 15 tid 100037 td 0xc6c0d930 sched_switch(c6c0d930,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2cfbb8 mi_switch(104,0,0,80246,c6c0d930,c6cc6d4c) at mi_switch+0x122/frame 0xee2cfbf0 sleepq_switch(c6c0d930,0,c11b871a,268,0,...) at sleepq_switch+0x15b/frame 0xee2cfc18 sleepq_wait(c6cc6d4c,0,c11a40d4,1,0,...) at sleepq_wait+0x3f/frame 0xee2cfc44 _cv_wait(c6cc6d4c,c6cc6eec,c118fd9e,73,0,...) at _cv_wait+0x182/frame 0xee2cfc74 usb_process(c6cc6d44,ee2cfce8,0,0,0,...) at usb_process+0xf6/frame 0xee2cfca4 fork_exit(c09a4c40,c6cc6d44,ee2cfce8) at fork_exit+0xa3/frame 0xee2cfcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2cfcd4 --- trap 0, eip = 0, esp = 0xee2cfd20, ebp = 0 --- Tracing command usb pid 15 tid 100036 td 0xc6c0dc40 sched_switch(c6c0dc40,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2ccbb8 mi_switch(104,0,0,80246,c6c0dc40,c6cc6d1c) at mi_switch+0x122/frame 0xee2ccbf0 sleepq_switch(c6c0dc40,0,c11b871a,268,0,...) at sleepq_switch+0x15b/frame 0xee2ccc18 sleepq_wait(c6cc6d1c,0,c11a40d4,1,0,...) at sleepq_wait+0x3f/frame 0xee2ccc44 _cv_wait(c6cc6d1c,c6cc6eec,c118fd9e,73,0,...) at _cv_wait+0x182/frame 0xee2ccc74 usb_process(c6cc6d14,ee2ccce8,0,0,0,...) at usb_process+0xf6/frame 0xee2ccca4 fork_exit(c09a4c40,c6cc6d14,ee2ccce8) at fork_exit+0xa3/frame 0xee2cccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2cccd4 --- trap 0, eip = 0, esp = 0xee2ccd20, ebp = 0 --- Tracing command usb pid 15 tid 100034 td 0xc6c84310 sched_switch(c6c84310,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2c5bb8 mi_switch(104,0,0,80246,c6c84310,c6ca9dac) at mi_switch+0x122/frame 0xee2c5bf0 sleepq_switch(c6c84310,0,c11b871a,268,0,...) at sleepq_switch+0x15b/frame 0xee2c5c18 sleepq_wait(c6ca9dac,0,c11a40d4,1,0,...) at sleepq_wait+0x3f/frame 0xee2c5c44 _cv_wait(c6ca9dac,c6ca9eec,c118fd9e,73,0,...) at _cv_wait+0x182/frame 0xee2c5c74 usb_process(c6ca9da4,ee2c5ce8,0,0,0,...) at usb_process+0xf6/frame 0xee2c5ca4 fork_exit(c09a4c40,c6ca9da4,ee2c5ce8) at fork_exit+0xa3/frame 0xee2c5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2c5cd4 --- trap 0, eip = 0, esp = 0xee2c5d20, ebp = 0 --- Tracing command usb pid 15 tid 100033 td 0xc6c84620 sched_switch(c6c84620,0,104,c1a6c5d0,0,...) at sched_switch+0x2d2/frame 0xee2c2bb8 mi_switch(104,0,c09955f2,c1592130,c6c84620,c6ca9d7c) at mi_switch+0x122/frame 0xee2c2bf0 sleepq_switch(c6c84620,0,c11b871a,268,c6d57cc0,...) at sleepq_switch+0x15b/frame 0xee2c2c18 sleepq_wait(c6ca9d7c,0,c11a40d4,1,0,...) at sleepq_wait+0x3f/frame 0xee2c2c44 _cv_wait(c6ca9d7c,c6ca9eec,c118fd9e,73,0,...) at _cv_wait+0x182/frame 0xee2c2c74 usb_process(c6ca9d74,ee2c2ce8,0,0,0,...) at usb_process+0xf6/frame 0xee2c2ca4 fork_exit(c09a4c40,c6ca9d74,ee2c2ce8) at fork_exit+0xa3/frame 0xee2c2cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2c2cd4 --- trap 0, eip = 0, esp = 0xee2c2d20, ebp = 0 --- Tracing command usb pid 15 tid 100032 td 0xc6c84930 sched_switch(c6c84930,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2bfbb8 mi_switch(104,0,0,80246,c6c84930,c6ca9d4c) at mi_switch+0x122/frame 0xee2bfbf0 sleepq_switch(c6c84930,0,c11b871a,268,0,...) at sleepq_switch+0x15b/frame 0xee2bfc18 sleepq_wait(c6ca9d4c,0,c11a40d4,1,0,...) at sleepq_wait+0x3f/frame 0xee2bfc44 _cv_wait(c6ca9d4c,c6ca9eec,c118fd9e,73,0,...) at _cv_wait+0x182/frame 0xee2bfc74 usb_process(c6ca9d44,ee2bfce8,0,0,0,...) at usb_process+0xf6/frame 0xee2bfca4 fork_exit(c09a4c40,c6ca9d44,ee2bfce8) at fork_exit+0xa3/frame 0xee2bfcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2bfcd4 --- trap 0, eip = 0, esp = 0xee2bfd20, ebp = 0 --- Tracing command usb pid 15 tid 100031 td 0xc6c84c40 sched_switch(c6c84c40,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2bcbb8 mi_switch(104,0,0,80246,c6c84c40,c6ca9d1c) at mi_switch+0x122/frame 0xee2bcbf0 sleepq_switch(c6c84c40,0,c11b871a,268,0,...) at sleepq_switch+0x15b/frame 0xee2bcc18 sleepq_wait(c6ca9d1c,0,c11a40d4,1,0,...) at sleepq_wait+0x3f/frame 0xee2bcc44 _cv_wait(c6ca9d1c,c6ca9eec,c118fd9e,73,0,...) at _cv_wait+0x182/frame 0xee2bcc74 usb_process(c6ca9d14,ee2bcce8,0,0,0,...) at usb_process+0xf6/frame 0xee2bcca4 fork_exit(c09a4c40,c6ca9d14,ee2bcce8) at fork_exit+0xa3/frame 0xee2bccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xee2bccd4 --- trap 0, eip = 0, esp = 0xee2bcd20, ebp = 0 --- Tracing command cam pid 2 tid 100062 td 0xc6d22000 sched_switch(c6d ---------------------------------------------------------------------- config.txt options CONFIG_AUTOGENERATED ident GENERIC machine i386 cpu I686_CPU cpu I586_CPU cpu I486_CPU makeoptions WITH_CTF=1 makeoptions DEBUG=-g options XENHVM options USB_DEBUG options ATH_ENABLE_11N options AH_AR5416_INTERRUPT_MITIGATION options AH_SUPPORT_AR5416 options IEEE80211_SUPPORT_MESH options IEEE80211_AMPDU_AGE options IEEE80211_DEBUG options SC_PIXEL_MODE options VESA options AHD_REG_PRETTY_PRINT options AHC_REG_PRETTY_PRINT options ATA_STATIC_ID options SMP options KDB_TRACE options KDB options DDB options VIMAGE options INCLUDE_CONFIG_FILE options DDB_CTF options KDTRACE_HOOKS options MAC options PROCDESC options CAPABILITIES options CAPABILITY_MODE options AUDIT options HWPMC_HOOKS options KBD_INSTALL_CDEV options PRINTF_BUFR_SIZE=128 options _KPOSIX_PRIORITY_SCHEDULING options SYSVSEM options SYSVMSG options SYSVSHM options STACK options KTRACE options SCSI_DELAY=5000 options COMPAT_FREEBSD7 options COMPAT_FREEBSD6 options COMPAT_FREEBSD5 options COMPAT_FREEBSD4 options GEOM_LABEL options GEOM_RAID options GEOM_PART_GPT options PSEUDOFS options PROCFS options CD9660 options MSDOSFS options NFS_ROOT options NFSLOCKD options NFSD options NFSCL options MD_ROOT options QUOTA options UFS_GJOURNAL options UFS_DIRHASH options UFS_ACL options SOFTUPDATES options FFS options SCTP options TCP_OFFLOAD options INET6 options INET options PREEMPTION options SCHED_ULE options NEW_PCIB options NATIVE options GEOM_PART_MBR options GEOM_PART_EBR_COMPAT options GEOM_PART_EBR options GEOM_PART_BSD options ISAPNP device isa device npx device mem device io device uart_ns8250 device atpic device apic device cpufreq device acpi device eisa device pci device fdc device ahci device ata device mvs device siis device ahb device ahc device ahd device esp device hptiop device isp device mpt device mps device mpr device sym device trm device adv device adw device aha device aic device bt device ncv device nsp device stg device isci device scbus device ch device da device sa device cd device pass device ses device amr device arcmsr device asr device ciss device dpt device hptmv device hptnr device hptrr device hpt27xx device iir device ips device mly device twa device tws device aac device aacp device aacraid device ida device mfi device mlx device mrsas device pst device twe device atkbdc device atkbd device psm device kbdmux device vga device splash device sc device vt device vt_vga device agp device pmtimer device cbb device pccard device cardbus device uart device ppc device ppbus device lpt device ppi device puc device bxe device de device em device igb device ixgb device le device ti device txp device vx device miibus device ae device age device alc device ale device bce device bfe device bge device cas device dc device et device fxp device gem device hme device jme device lge device msk device nfe device nge device pcn device re device rl device sf device sge device sis device sk device ste device stge device tl device tx device vge device vr device vte device wb device xl device cs device ed device ex device ep device fe device ie device sn device xe device wlan device wlan_wep device wlan_ccmp device wlan_tkip device wlan_amrr device an device ath device ath_pci device ath_hal device ath_rate_sample device ipw device iwi device iwn device malo device mwl device ral device wi device wpi device loop device random device padlock_rng device rdrand_rng device ether device vlan device tun device md device gif device faith device firmware device bpf device uhci device ohci device ehci device xhci device usb device ukbd device umass device sound device snd_cmi device snd_csa device snd_emu10kx device snd_es137x device snd_hda device snd_ich device snd_via8233 device mmc device mmcsd device sdhci device virtio device virtio_pci device vtnet device virtio_blk device virtio_scsi device virtio_balloon device hyperv device xenpci device vmx ---------------------------------------------------------------------- msgbuf.txt Copyright (c) 1992-2015 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.1-STABLE #0 r276691: Mon Jan 5 19:16:13 CET 2015 sthaug@verdi.nethelp.no:/usr/src/sys/i386/compile/GENERICV i386 FreeBSD clang version 3.4.1 (tags/RELEASE_34/dot1-final 208032) 20140512 CPU: Intel(R) Pentium(R) D CPU 2.80GHz (2793.05-MHz 686-class CPU) Origin="GenuineIntel" Id=0xf47 Family=0xf Model=0x4 Stepping=7 Features=0xbfebfbff Features2=0x641d AMD Features=0x20100000 AMD Features2=0x1 TSC: P-state invariant real memory = 2147483648 (2048 MB) avail memory = 2083926016 (1987 MB) Event timer "LAPIC" quality 400 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs FreeBSD/SMP: 1 package(s) x 2 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 WARNING: VIMAGE (virtualized network stack) is a highly experimental feature. ioapic0: Changing APIC ID to 8 ioapic0 irqs 0-23 on motherboard lapic0: Forcing LINT1 to edge trigger random: initialized kbd1 at kbdmux0 acpi0: on motherboard acpi0: Power Button (fixed) acpi0: reservation of 0, a0000 (3) failed acpi0: reservation of 100000, f00000 (3) failed acpi0: reservation of 1000000, 7ee8cc00 (3) failed cpu0: on acpi0 cpu1: on acpi0 atrtc0: port 0x70-0x7f irq 8 on acpi0 Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x5f irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 450 Event timer "HPET1" frequency 14318180 Hz quality 440 Event timer "HPET2" frequency 14318180 Hz quality 440 acpi_button0: on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib1: irq 16 at device 1.0 on pci0 pci1: on pcib1 pcib2: irq 16 at device 28.0 on pci0 pci2: on pcib2 em0: port 0xdcc0-0xdcdf mem 0xfe880000-0xfe89ffff,0xfe8a0000-0xfe8bffff irq 16 at device 0.0 on pci2 em0: Using an MSI interrupt em0: Ethernet address: 00:15:17:36:bc:e8 em1: port 0xdce0-0xdcff mem 0xfe8c0000-0xfe8dffff,0xfe8e0000-0xfe8fffff irq 17 at device 0.1 on pci2 em1: Using an MSI interrupt em1: Ethernet address: 00:15:17:36:bc:e9 pcib3: irq 16 at device 28.4 on pci0 pci3: on pcib3 bge0: mem 0xfe7f0000-0xfe7fffff irq 16 at device 0.0 on pci3 bge0: CHIP ID 0x00004101; ASIC REV 0x04; CHIP REV 0x41; PCI-E miibus0: on bge0 brgphy0: PHY 1 on miibus0 brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow bge0: Ethernet address: 00:10:18:1c:60:ce pcib4: irq 17 at device 28.5 on pci0 pci4: on pcib4 bge1: mem 0xfe6f0000-0xfe6fffff irq 17 at device 0.0 on pci4 bge1: CHIP ID 0x00004001; ASIC REV 0x04; CHIP REV 0x40; PCI-E miibus1: on bge1 brgphy1: PHY 1 on miibus1 brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow bge1: Ethernet address: 00:13:72:20:b4:6f uhci0: port 0xff80-0xff9f irq 21 at device 29.0 on pci0 usbus0 on uhci0 uhci1: port 0xff60-0xff7f irq 22 at device 29.1 on pci0 usbus1 on uhci1 uhci2: port 0xff40-0xff5f irq 18 at device 29.2 on pci0 usbus2 on uhci2 uhci3: port 0xff20-0xff3f irq 23 at device 29.3 on pci0 usbus3 on uhci3 ehci0: mem 0xffa80800-0xffa80bff irq 21 at device 29.7 on pci0 usbus4: EHCI version 1.0 usbus4 on ehci0 pcib5: at device 30.0 on pci0 pci5: on pcib5 vgapci0: port 0xcc80-0xccff mem 0xfc000000-0xfdffffff,0xfe4c0000-0xfe4fffff at device 7.0 on pci5 vgapci0: Boot video device isab0: at device 31.0 on pci0 isa0: on isab0 atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xffa0-0xffaf irq 16 at device 31.1 on pci0 ata0: at channel 0 on atapci0 atapci1: port 0xfe00-0xfe07,0xfe10-0xfe13,0xfe20-0xfe27,0xfe30-0xfe33,0xfea0-0xfeaf irq 20 at device 31.2 on pci0 ata2: at channel 0 on atapci1 ata3: at channel 1 on atapci1 fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 fd0: <1440-KB 3.5" drive> on fdc0 drive 0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 pmtimer0 on isa0 orm0: at iomem 0xc0000-0xc7fff,0xc8000-0xc8fff,0xc9000-0xcafff,0xcb000-0xcbfff pnpid ORM0000 on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 atkbdc0: at port 0x60,0x64 on isa0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] ppc0: parallel port not found. p4tcc0: on cpu0 p4tcc1: on cpu1 Timecounters tick every 1.000 msec random: unblocking device. usbus0: 12Mbps Full Speed USB v1.0 usbus1: 12Mbps Full Speed USB v1.0 usbus2: 12Mbps Full Speed USB v1.0 usbus3: 12Mbps Full Speed USB v1.0 usbus4: 480Mbps High Speed USB v2.0 ugen0.1: at usbus0 uhub0: on usbus0 ugen2.1: at usbus2 ugen1.1: at usbus1 uhub1: on usbus1 ugen4.1: at usbus4 uhub2: on usbus4 ugen3.1: at usbus3 uhub3: on usbus3 uhub4: on usbus2 ada0 at ata2 bus 0 scbus1 target 0 lun 0 ada0: ATA-8 SATA 2.x device ada0: Serial Number 9QM098KE ada0: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes) ada0: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C) ada0: Previously was known as ad4 ada1 at ata3 bus 0 scbus2 target 0 lun 0 ada1: ATA-8 SATA 2.x device ada1: Serial Number 9QM0D4DL ada1: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes) ada1: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C) ada1: Previously was known as ad6 cd0 at ata0 bus 0 scbus0 target 0 lun 0 cd0: Removable CD-ROM SCSI-0 device cd0: 33.300MB/s transfers (UDMA2, ATAPI 12bytes, PIO 65534bytes) cd0: Attempt to query device size failed: NOT READY, Medium not present uhub1: 2 ports with 2 removable, self powered uhub0: 2 ports with 2 removable, self powered uhub3: 2 ports with 2 removable, self powered uhub4: 2 ports with 2 removable, self powered lapic1: Forcing LINT1 to edge trigger SMP: AP CPU #1 Launched! Timecounter "TSC-low" frequency 1396527289 Hz quality 1000 Root mount waiting for: usbus4 Root mount waiting for: usbus4 uhub2: 8 ports with 8 removable, self powered Trying to mount root from ufs:/dev/ada0s1a [rw]... <118>Setting hostuuid: 44454c4c-4400-104a-8054-b8c04f43324a. <118>Setting hostid: 0xde1f5676. <118>Starting ddb. <118>Entropy harvesting: interrupts ethernet point_to_point swi. <118>Starting file system checks: <118>/dev/ada0s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS <118>/dev/ada0s1a: clean, 4326943 free (2271 frags, 540584 blocks, 0.0% fragmentation) <118>/dev/ada0s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS <118>/dev/ada0s1d: clean, 2647084 free (7788 frags, 329912 blocks, 0.2% fragmentation) <118>/dev/ada0s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS <118>/dev/ada0s1e: clean, 2461983 free (175 frags, 307726 blocks, 0.0% fragmentation) <118>Mounting local file systems:. <118>Writing entropy file:. <118>Setting hostname: verdi.nethelp.no. ugen3.2: at usbus3 ukbd0: on usbus3 kbd2 at ukbd0 <118>Starting Network: lo0 em0 em1 bge0 bge1. <118>lo0: flags=8049 metric 0 mtu 16384 <118> options=600003 <118> inet6 ::1 prefixlen 128 <118> inet6 fe80::1%lo0 prefixlen 64 scopeid 0x5 <118> inet 127.0.0.1 netmask 0xff000000 <118> nd6 options=21 <118>em0: flags=8c02 metric 0 mtu 1500 <118> options=4219b <118> ether 00:15:17:36:bc:e8 <118> nd6 options=29 <118> media: Ethernet autoselect <118> status: no carrier <118>em1: flags=8c02 metric 0 mtu 1500 <118> options=4019b <118> ether 00:15:17:36:bc:e9 <118> nd6 options=29 <118> media: Ethernet autoselect <118> status: no carrier <118>bge0: flags=8802 metric 0 mtu 1500 <118> options=8009b <118> ether 00:10:18:1c:60:ce <118> nd6 options=29 <118> media: Ethernet autoselect <118>bge1: flags=8843 metric 0 mtu 1500 <118> options=8009b <118> ether 00:13:72:20:b4:6f <118> inet 10.0.0.2 netmask 0xfffffffc broadcast 10.0.0.3 <118> nd6 options=29 <118> media: Ethernet autoselect (none) <118> status: no carrier <118>Starting devd. <118>Starting Network: em0. <118>em0: flags=8c02 metric 0 mtu 1500 <118> options=4219b <118> ether 00:15:17:36:bc:e8 <118> nd6 options=29 <118> media: Ethernet autoselect <118> status: no carrier <118>Starting Network: em1. <118>em1: flags=8c02 metric 0 mtu 1500 <118> options=4019b <118> ether 00:15:17:36:bc:e9 <118> nd6 options=29 <118> media: Ethernet autoselect <118> status: no carrier <118>Starting Network: bge0. <118>bge0: flags=8802 metric 0 mtu 1500 <118> options=8009b <118> ether 00:10:18:1c:60:ce <118> nd6 options=29 <118> media: Ethernet autoselect <118>Configuring syscons: keymap. <118>Starting pflogd: <118>add net fe80::: gateway ::1 <118>add net ff02::: gateway ::1 <118>add net ::ffff:0.0.0.0: gateway ::1 <118>add net ::0.0.0.0: gateway ::1 <118>Creating and/or trimming log files. <118>Starting syslogd. <118>No core dumps found. <118>ELF ldconfig path: /lib /usr/lib /usr/lib/compat <118>a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout <118>Clearing /tmp (X related). <118>Updating motd:. <118>Mounting late file systems:. <118>Configuring syscons: keymap blanktime. <118>Performing sanity check on sshd configuration. <118>Starting sshd. <118>Starting sendmail_submit. <118>Starting sendmail_msp_queue. <118>Starting cron. <118> <118>Mon Jan 5 22:14:35 CET 2015 <118>Jan 5 22:14:40 verdi login: ROOT LOGIN (root) ON ttyv0 <5>bge1: link state changed to UP panic: vm_fault: fault on nofault entry, addr: cc0e3000 cpuid = 1 KDB: stack backtrace: db_trace_self_wrapper(c11b7381,fc,0,10000000,1,...) at db_trace_self_wrapper+0x2d/frame 0xf0948638 kdb_backtrace(c1363a24,1,c11e23dd,f09486ec,0,...) at kdb_backtrace+0x30/frame 0xf09486a0 panic(c11e23dd,cc0e3000,1,f0948804,f09487f4,...) at panic+0x11f/frame 0xf09486e0 vm_fault_hold(c1a6d000,cc0e3000,1,0,0,...) at vm_fault_hold+0x2076/frame 0xf0948840 vm_fault(c1a6d000,cc0e3000,1,0,f0948912,...) at vm_fault+0x81/frame 0xf0948868 trap_pfault(cc0e34b8,f0948910,c6baf200,f09489a0,c0934ed8,...) at trap_pfault+0x1bb/frame 0xf09488e8 trap(f0948a34) at trap+0x674/frame 0xf0948a28 calltrap() at calltrap+0x6/frame 0xf0948a28 --- trap 0xc, eip = 0xc104ab83, esp = 0xf0948a74, ebp = 0xf0948a9c --- copyout(f0948b28,cc0e34b8,4,f0948acc,c142f238,...) at copyout+0x37/frame 0xf0948a9c sysctl_ip6_temppltime(c142f238,c6a9e3a8,0,f0948b28,f0948b28,...) at sysctl_ip6_temppltime+0x3a/frame 0xf0948ac0 sysctl_root(f0948b28,8,2,c0a05797,c7034038,...) at sysctl_root+0x2b1/frame 0xf0948b00 userland_sysctl(c7594000,f0948bac,4,28803030,bfbfdb70,...) at userland_sysctl+0x1fa/frame 0xf0948b70 sys___sysctl(c7594000,f0948ca8,0,1,c1524380,...) at sys___sysctl+0x98/frame 0xf0948c18 syscall(f0948ce8) at syscall+0x4a6/frame 0xf0948cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf0948cdc --- syscall (202, FreeBSD ELF32, sys___sysctl), eip = 0x281a28b7, esp = 0xbfbfdb00, ebp = 0xbfbfdb28 --- KDB: enter: panic ---------------------------------------------------------------------- panic.txt vm_fault: fault on nofault entry, addr: cc0e3000 ---------------------------------------------------------------------- version.txt FreeBSD 10.1-STABLE #0 r276691: Mon Jan 5 19:16:13 CET 2015 sthaug@verdi.nethelp.no:/usr/src/sys/i386/compile/GENERICV