Date: Sat, 8 Jan 2011 21:44:57 +0300 From: Lev Serebryakov <lev@FreeBSD.org> To: freebsd-stable@freebsd.org Subject: 8.2-PRERELEASE: live deadlock, almost all processes in "pfault" state Message-ID: <204344488.20110108214457@serebryakov.spb.ru>
next in thread | raw e-mail | index | archive | help
[-- Attachment #1 --]
Hello, Freebsd-stable.
I've added `transmission' BitTorrent client to my home server and now
it deadlocks easily (after about 1 hour of intensive download and
seeding). This server is upgraded from 7.x and last time I've run
transmission on 7.x system without any problems.
I have home partition on geom_raid5 device, so I can not exclude this
third-party module from experiments.
My home filsystem has 32KiB block and all other filesystems (/, /var,
/tmp, /usr) has standard 16KiB block sizes. I know, that 7.x system
had (has?) deadlock when 16KiB and 64KiB file systems are mixed up on
one system, but I never experienced deadlocks with 16KiB and 32KiB
mixture.
All filesystems (Except root) is SU, but no gjournal so SU_J patch
are in use.
Same BitTorrent client on same filesystem, but accessed via NFS (from
other host), doesn't cause deadlock and works rock-stable for days.
I've built kernel with all debug options, waited for deadlock and
collect all information, mentioned in Developer's Handbook / Debugging
Deadlocks.
Capture from debug session is attached, together with kernel config
and dmesg from rebooting.
As I can easily reproduce this deadlock, I could provide any
additional information from kernel debugger, if needed.
System: FreeBSD 8.2-PRERELEASE
cvsup: 2011-01-08 00:41:24 MSK (GTM+3) time
Platform: amd64
--
// Black Lion AKA Lev Serebryakov <lev@FreeBSD.org>
[-- Attachment #2 --]
login: KDB: enter: Line break on console
[thread pid 11 tid 100003 ]
Stopped at kdb_enter+0x3d: movq $0,0x3d7a90(%rip)
db> ps
pid ppid pgrp uid state wmesg wchan cmd
1209 1207 1209 0 S+ ttyin 0xffffff0004992ca8 csh
1207 1159 1207 1001 S+ wait 0xffffff0004c1a000 su
1200 804 804 0 SL pfault 0xffffffff8087225c smbd
1191 1 1191 1002 SLs (threaded) transmission-daemon
100151 D getblk 0xffffff807bc4d048 transmission-daemon
100149 S select 0xffffff00110bc9c0 transmission-daemon
100148 D biord 0xffffff807b905970 transmission-daemon
100096 D pfault 0xffffffff8087225c transmission-daemon
1159 1158 1159 1001 Ss+ pause 0xffffff0004b760a0 tcsh
1158 1156 1156 1001 SL pfault 0xffffffff8087225c sshd
1156 1033 1156 0 Ss sbwait 0xffffff001112bbe4 sshd
1153 1 1153 0 SLs+ pfault 0xffffffff8087225c getty
1152 1 1152 0 SLs+ pfault 0xffffffff8087225c getty
1052 1 1052 0 ?s cron
1045 1 1045 25 ?s sendmail
1041 1 1041 0 SLs pfault 0xffffffff8087225c sendmail
1033 1 1033 0 Ss select 0xffffff0004f27a40 sshd
962 1 962 600 Ss select 0xffffff0004f27140 cvsupd
872 1 872 0 SLs pfault 0xffffffff8087225c ntpd
856 804 804 0 S select 0xffffff0004f27ac0 smbd
804 1 804 0 SLs pfault 0xffffffff8087225c smbd
800 1 800 0 SLs pfault 0xffffffff8087225c nmbd
743 742 742 0 S (threaded) nfsd
100122 S rpcsvc 0xffffff00110bc520 nfsd: service
100121 S rpcsvc 0xffffff00110bc5a0 nfsd: service
100120 S rpcsvc 0xffffff0004befba0 nfsd: service
100087 S rpcsvc 0xffffff0004ad12a0 nfsd: master
742 1 742 0 Ss accept 0xffffff0004ca3066 nfsd
733 1 733 0 Ss select 0xffffff0004a68640 mountd
638 1 638 0 SLs pfault 0xffffffff8087225c rpcbind
612 1 612 0 SLs pfault 0xffffffff8087225c syslogd
488 1 488 0 Ss select 0xffffff0004bef540 devd
474 1 474 65 Ss select 0xffffff0004ad08c0 dhclient
458 1 458 0 Ss select 0xffffff0004ad0140 dhclient
122 1 122 0 Ss pause 0xffffff0004c1b960 adjkerntz
20 0 0 0 SL (threaded) g_raid5
100079 D gr5do 0xffffff0004a9bc68 [g_raid5/done storag]
100078 D vmwait 0xffffffff8087225c [g_raid5/main storag]
19 0 0 0 SL sdflush 0xffffffff808717f8 [softdepflush]
18 0 0 0 SL vlruwt 0xffffff0004a98460 [vnlru]
17 0 0 0 SL wswbuf0 0xffffffff80666f60 [syncer]
16 0 0 0 SL psleep 0xffffffff80865d48 [bufdaemon]
15 0 0 0 SL pgzero 0xffffffff808732ac [pagezero]
9 0 0 0 SL pollid 0xffffffff806a3d28 [idlepoll]
8 0 0 0 SL psleep 0xffffffff80872648 [vmdaemon]
7 0 0 0 SL psleep 0xffffffff8087260c [pagedaemon]
6 0 0 0 SL ccb_scan 0xffffffff806894e0 [xpt_thrd]
5 0 0 0 SL - 0xffffff8000330000 [fw0_probe]
14 0 0 0 SL (threaded) usb
100061 D - 0xffffff800032de18 [usbus7]
100060 D - 0xffffff800032ddc0 [usbus7]
100059 D - 0xffffff800032dd68 [usbus7]
100058 D - 0xffffff800032dd10 [usbus7]
100057 D - 0xffffff8000324ef0 [usbus6]
100056 D - 0xffffff8000324e98 [usbus6]
100055 D - 0xffffff8000324e40 [usbus6]
100054 D - 0xffffff8000324de8 [usbus6]
100053 D - 0xffffff800031bef0 [usbus5]
100052 D - 0xffffff800031be98 [usbus5]
100051 D - 0xffffff800031be40 [usbus5]
100050 D - 0xffffff800031bde8 [usbus5]
100048 D - 0xffffff8000312ef0 [usbus4]
100047 D - 0xffffff8000312e98 [usbus4]
100046 D - 0xffffff8000312e40 [usbus4]
100045 D - 0xffffff8000312de8 [usbus4]
100043 D - 0xffffff8000309e18 [usbus3]
100042 D - 0xffffff8000309dc0 [usbus3]
100041 D - 0xffffff8000309d68 [usbus3]
100040 D - 0xffffff8000309d10 [usbus3]
100039 D - 0xffffff8000300ef0 [usbus2]
100038 D - 0xffffff8000300e98 [usbus2]
100037 D - 0xffffff8000300e40 [usbus2]
100036 D - 0xffffff8000300de8 [usbus2]
100034 D - 0xffffff80002f7ef0 [usbus1]
100033 D - 0xffffff80002f7e98 [usbus1]
100032 D - 0xffffff80002f7e40 [usbus1]
100031 D - 0xffffff80002f7de8 [usbus1]
100029 D - 0xffffff80002eeef0 [usbus0]
100028 D - 0xffffff80002eee98 [usbus0]
100027 D - 0xffffff80002eee40 [usbus0]
100026 D - 0xffffff80002eede8 [usbus0]
13 0 0 0 SL - 0xffffffff806a4c24 [yarrow]
4 0 0 0 SL - 0xffffffff806a0a08 [g_down]
3 0 0 0 SL - 0xffffffff806a0a00 [g_up]
2 0 0 0 SL - 0xffffffff806a09f0 [g_event]
12 0 0 0 WL (threaded) intr
100068 I [irq1: atkbd0]
100067 I [swi0: uart]
100066 I [irq7: ppc0]
100065 I [irq22: ahci0]
100062 I [irq20: em0 fwohci0]
100049 I [irq19: uhci4]
100044 I [irq23: uhci3 ehci1]
100035 I [irq18: uhci2 ehci0*]
100030 I [irq21: uhci1]
100025 I [irq16: uhci0]
100023 I [irq9: acpi0]
100022 I [swi6: Giant taskq]
100020 I [swi5: +]
100019 I [swi2: cambio]
100014 I [swi6: task queue]
100008 I [swi1: netisr 0]
100007 I [swi3: vm]
100006 I [swi4: clock]
100005 I [swi4: clock]
11 0 0 0 RL (threaded) idle
100004 Run CPU 0 [idle: cpu0]
100003 Run CPU 1 [idle: cpu1]
1 0 1 0 SLs wait 0xffffff000158e8c0 [init]
10 0 0 0 SL audit_wo 0xffffffff80870c50 [audit]
0 0 0 0 SLs (threaded) kernel
100063 D - 0xffffff0001793100 [fw0_taskq]
100024 D - 0xffffff00016c1200 [em0 taskq]
100021 D - 0xffffff00015e6500 [thread taskq]
100018 D - 0xffffff00015e6d80 [acpi_task_2]
100017 D - 0xffffff00015e6d80 [acpi_task_1]
100016 D - 0xffffff00015e6d80 [acpi_task_0]
100015 D - 0xffffff00015e6e00 [kqueue taskq]
100012 D - 0xffffff00015a4a00 [firmware taskq]
100000 D vmwait 0xffffffff8087225c [swapper]
db> show pcpu
cpuid = 1
dynamic pcpu = 0xffffff807f984980
curthread = 0xffffff0001591460: pid 11 "idle: cpu1"
curpcb = 0xffffff800002bd00
fpcurthread = none
idlethread = 0xffffff0001591460: tid 100003 "idle: cpu1"
curpmap = 0xffffffff806a14f0
tssp = 0xffffffff808ab4e8
commontssp = 0xffffffff808ab4e8
rsp0 = 0xffffff800002bd00
gs32p = 0xffffffff808aa320
ldt = 0xffffffff808aa360
tss = 0xffffffff808aa350
spin locks held:
db> show allpcpu
Current CPU: 1
cpuid = 0
dynamic pcpu = 0x357980
curthread = 0xffffff0001591000: pid 11 "idle: cpu0"
curpcb = 0xffffff8000030d00
fpcurthread = none
idlethread = 0xffffff0001591000: tid 100004 "idle: cpu0"
curpmap = 0xffffffff806a14f0
tssp = 0xffffffff808ab480
commontssp = 0xffffffff808ab480
rsp0 = 0xffffff8000030d00
gs32p = 0xffffffff808aa2b8
ldt = 0xffffffff808aa2f8
tss = 0xffffffff808aa2e8
spin locks held:
cpuid = 1
dynamic pcpu = 0xffffff807f984980
curthread = 0xffffff0001591460: pid 11 "idle: cpu1"
curpcb = 0xffffff800002bd00
fpcurthread = none
idlethread = 0xffffff0001591460: tid 100003 "idle: cpu1"
curpmap = 0xffffffff806a14f0
tssp = 0xffffffff808ab4e8
commontssp = 0xffffffff808ab4e8
rsp0 = 0xffffff800002bd00
gs32p = 0xffffffff808aa320
ldt = 0xffffffff808aa360
tss = 0xffffffff808aa350
spin locks held:
db> show locks
db> show alllocks
Process 1191 (transmission-daemon) thread 0xffffff0004aff8c0 (100151)
shared lockmgr ufs (ufs) r = 0 (0xffffff00553d47e8) locked @ /usr/src/sys/kern/vfs_vnops.c:539
Process 1191 (transmission-daemon) thread 0xffffff0011225460 (100148)
exclusive lockmgr bufwait (bufwait) r = 0 (0xffffff807b905a08) locked @ /usr/src/sys/kern/vfs_bio.c:1891
shared lockmgr ufs (ufs) r = 0 (0xffffff006f631578) locked @ /usr/src/sys/kern/vfs_vnops.c:539
Process 1156 (sshd) thread 0xffffff0004be9460 (100108)
exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xffffff001112bb98) locked @ /usr/src/sys/kern/uipc_sockbuf.c:148
Process 17 (syncer) thread 0xffffff0004a95460 (100075)
exclusive lockmgr bufwait (bufwait) r = 0 (0xffffff807b8aa618) locked @ /usr/src/sys/kern/vfs_cluster.c:773
exclusive lockmgr ufs (ufs) r = 0 (0xffffff006f3f7cc8) locked @ /usr/src/sys/kern/vfs_subr.c:2120
exclusive lockmgr syncer (syncer) r = 0 (0xffffff0004bd7308) locked @ /usr/src/sys/kern/vfs_subr.c:1730
db> show lockedvnods
Locked vnodes
0xffffff0004bd7270: tag syncer, type VNON
usecount 1, writecount 0, refcount 2 mountedhere 0
flags ()
lock type syncer: EXCL by thread 0xffffff0004a95460 (pid 17)
#0 0xffffffff802a4ac4 at __lockmgr_args+0x794
#1 0xffffffff8033e519 at vop_stdlock+0x39
#2 0xffffffff8049923b at VOP_LOCK1_APV+0x9b
#3 0xffffffff8035ac77 at _vn_lock+0x57
#4 0xffffffff8034fad0 at sync_vnode+0x130
#5 0xffffffff8034fd62 at sched_sync+0x1d2
#6 0xffffffff80293c9a at fork_exit+0x12a
#7 0xffffffff8044953e at fork_trampoline+0xe
0xffffff006f6314e0: tag ufs, type VREG
usecount 1, writecount 0, refcount 4 mountedhere 0
flags ()
v_object 0xffffff000e03a000 ref 0 pages 16
lock type ufs: SHARED (count 1)
#0 0xffffffff802a4861 at __lockmgr_args+0x531
#1 0xffffffff8040bdec at ffs_lock+0x9c
#2 0xffffffff8049923b at VOP_LOCK1_APV+0x9b
#3 0xffffffff8035ac77 at _vn_lock+0x57
#4 0xffffffff8035c221 at vn_read+0x91
#5 0xffffffff80303f21 at dofileread+0xa1
#6 0xffffffff80304003 at kern_preadv+0x63
#7 0xffffffff80304129 at pread+0x59
#8 0xffffffff802fa5f0 at syscallenter+0xf0
#9 0xffffffff80461450 at syscall+0x60
#10 0xffffffff804493c2 at Xfast_syscall+0xe2
ino 178328835, on dev ufs/storage
0xffffff006f3f7c30: tag ufs, type VREG
usecount 2, writecount 1, refcount 2001 mountedhere 0
flags ()
v_object 0xffffff006f991510 ref 0 pages 15984
lock type ufs: EXCL by thread 0xffffff0004a95460 (pid 17)
#0 0xffffffff802a4ac4 at __lockmgr_args+0x794
#1 0xffffffff8040bdec at ffs_lock+0x9c
#2 0xffffffff8049923b at VOP_LOCK1_APV+0x9b
#3 0xffffffff8035ac77 at _vn_lock+0x57
#4 0xffffffff8034f62b at vget+0x7b
#5 0xffffffff80407dfc at ffs_sync+0x15c
#6 0xffffffff803516fa at sync_fsync+0x13a
#7 0xffffffff80497535 at VOP_FSYNC_APV+0xb5
#8 0xffffffff8034faf7 at sync_vnode+0x157
#9 0xffffffff8034fd62 at sched_sync+0x1d2
#10 0xffffffff80293c9a at fork_exit+0x12a
#11 0xffffffff8044953e at fork_trampoline+0xe
ino 171587328, on dev ufs/storage
0xffffff00553d4750: tag ufs, type VREG
usecount 1, writecount 0, refcount 4001 mountedhere 0
flags ()
v_object 0xffffff0011da8360 ref 0 pages 31992
lock type ufs: SHARED (count 1)
#0 0xffffffff802a4861 at __lockmgr_args+0x531
#1 0xffffffff8040bdec at ffs_lock+0x9c
#2 0xffffffff8049923b at VOP_LOCK1_APV+0x9b
#3 0xffffffff8035ac77 at _vn_lock+0x57
#4 0xffffffff8035c221 at vn_read+0x91
#5 0xffffffff80303f21 at dofileread+0xa1
#6 0xffffffff80304003 at kern_preadv+0x63
#7 0xffffffff80304129 at pread+0x59
#8 0xffffffff802fa5f0 at syscallenter+0xf0
#9 0xffffffff80461450 at syscall+0x60
#10 0xffffffff804493c2 at Xfast_syscall+0xe2
ino 173914781, on dev ufs/storage
db> sh alltrace
Tracing command csh pid 1209 tid 100081 td 0xffffff0004a94000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_catch_signals() at sleepq_catch_signals+0x2a6
sleepq_wait_sig() at sleepq_wait_sig+0x16
_cv_wait_sig() at _cv_wait_sig+0x17e
tty_wait() at tty_wait+0x48
ttydisc_read() at ttydisc_read+0x2f1
ttydev_read() at ttydev_read+0xab
devfs_read_f() at devfs_read_f+0x88
dofileread() at dofileread+0xa1
kern_readv() at kern_readv+0x60
read() at read+0x55
syscallenter() at syscallenter+0xf0
syscall() at syscall+0x60
Xfast_syscall() at Xfast_syscall+0xe2
--- syscall (3, FreeBSD ELF64, read), rip = 0x8009effec, rsp = 0x7fffffffe538, rbp = 0x1 ---
Tracing command su pid 1207 tid 100105 td 0xffffff0004bec460
Tracing command smbd pid 1200 tid 100113 td 0xffffff0004f75000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x369
vm_fault() at vm_fault+0x15bc
trap_pfault() at trap_pfault+0x128
trap() at trap+0x36c
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff8045f5bb, rsp = 0xffffff8096c7b850, rbp = 0xffffff8096c7ba90 ---
copyout() at copyout+0x3b
select() at select+0x5d
syscallenter() at syscallenter+0xf0
syscall() at syscall+0x60
Xfast_syscall() at Xfast_syscall+0xe2
--- syscall (93, FreeBSD ELF64, select), rip = 0x802676f6c, rsp = 0x7fffffffe418, rbp = 0x8 ---
Tracing command transmission-daemon pid 1191 tid 100151 td 0xffffff0004aff8c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
__lockmgr_args() at __lockmgr_args+0x7ae
getblk() at getblk+0x101
cluster_read() at cluster_read+0xc5
ffs_read() at ffs_read+0x388
VOP_READ_APV() at VOP_READ_APV+0xaf
vn_read() at vn_read+0xd0
dofileread() at dofileread+0xa1
kern_preadv() at kern_preadv+0x63
pread() at pread+0x59
syscallenter() at syscallenter+0xf0
syscall() at syscall+0x60
Xfast_syscall() at Xfast_syscall+0xe2
--- syscall (475, FreeBSD ELF64, pread), rip = 0x80113af6c, rsp = 0x7fffff5fbe78, rbp = 0x73db73d ---
Tracing command transmission-daemon pid 1191 tid 100149 td 0xffffff0011225000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_catch_signals() at sleepq_catch_signals+0x2a6
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19
_cv_timedwait_sig() at _cv_timedwait_sig+0x18c
seltdwait() at seltdwait+0x56
kern_select() at kern_select+0x640
select() at select+0x5d
syscallenter() at syscallenter+0xf0
syscall() at syscall+0x60
Xfast_syscall() at Xfast_syscall+0xe2
--- syscall (93, FreeBSD ELF64, select), rip = 0x80113cf6c, rsp = 0x7fffff9fdd58, rbp = 0 ---
Tracing command transmission-daemon pid 1191 tid 100148 td 0xffffff0011225460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x369
bwait() at bwait+0x64
bufwait() at bufwait+0x56
cluster_read() at cluster_read+0x609
ffs_read() at ffs_read+0x388
VOP_READ_APV() at VOP_READ_APV+0xaf
vn_read() at vn_read+0xd0
dofileread() at dofileread+0xa1
kern_preadv() at kern_preadv+0x63
pread() at pread+0x59
syscallenter() at syscallenter+0xf0
syscall() at syscall+0x60
Xfast_syscall() at Xfast_syscall+0xe2
--- syscall (475, FreeBSD ELF64, pread), rip = 0x80113af6c, rsp = 0x7fffffbfec58, rbp = 0x80263f708 ---
Tracing command transmission-daemon pid 1191 tid 100096 td 0xffffff0004b038c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x369
vm_fault() at vm_fault+0x15bc
trap_pfault() at trap_pfault+0x128
trap() at trap+0x36c
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff8045f990, rsp = 0xffffff8096c26800, rbp = 0xffffff8096c268c0 ---
copyinstr() at copyinstr+0x40
kern_statat_vnhook() at kern_statat_vnhook+0x8f
kern_statat() at kern_statat+0x15
stat() at stat+0x2a
syscallenter() at syscallenter+0xf0
syscall() at syscall+0x60
Xfast_syscall() at Xfast_syscall+0xe2
--- syscall (188, FreeBSD ELF64, stat), rip = 0x80112dd0c, rsp = 0x7fffffffe728, rbp = 0x8014ab370 ---
Tracing command tcsh pid 1159 tid 100090 td 0xffffff0004bf38c0
Tracing command sshd pid 1158 tid 100110 td 0xffffff0004f77000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x369
vm_fault() at vm_fault+0x15bc
trap_pfault() at trap_pfault+0x128
trap() at trap+0x36c
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff8045f5bb, rsp = 0xffffff8096c6c850, rbp = 0xffffff8096c6ca90 ---
copyout() at copyout+0x3b
select() at select+0x5d
syscallenter() at syscallenter+0xf0
syscall() at syscall+0x60
Xfast_syscall() at Xfast_syscall+0xe2
--- syscall (93, FreeBSD ELF64, select), rip = 0x8016dcf6c, rsp = 0x7fffffffe028, rbp = 0x7fffffffe0b0 ---
Tracing command sshd pid 1156 tid 100108 td 0xffffff0004be9460
Tracing command getty pid 1153 tid 100124 td 0xffffff0004f40460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x369
vm_fault() at vm_fault+0x15bc
trap_pfault() at trap_pfault+0x128
trap() at trap+0x36c
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff8045f5c3, rsp = 0xffffff8096cb2750, rbp = 0xffffff8096cb27d0 ---
copyout() at copyout+0x43
ttyinq_read_uio() at ttyinq_read_uio+0x25d
ttydisc_read() at ttydisc_read+0x2ac
ttydev_read() at ttydev_read+0xab
devfs_read_f() at devfs_read_f+0x88
dofileread() at dofileread+0xa1
kern_readv() at kern_readv+0x60
read() at read+0x55
syscallenter() at syscallenter+0xf0
syscall() at syscall+0x60
Xfast_syscall() at Xfast_syscall+0xe2
--- syscall (3, FreeBSD ELF64, read), rip = 0x80084ffec, rsp = 0x7fffffffecc8, rbp = 0 ---
Tracing command getty pid 1152 tid 100134 td 0xffffff00111168c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x369
vm_fault() at vm_fault+0x15bc
trap_pfault() at trap_pfault+0x128
trap() at trap+0x36c
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff8045f5c3, rsp = 0xffffff8096ce4750, rbp = 0xffffff8096ce47d0 ---
copyout() at copyout+0x43
ttyinq_read_uio() at ttyinq_read_uio+0x25d
ttydisc_read() at ttydisc_read+0x2ac
ttydev_read() at ttydev_read+0xab
devfs_read_f() at devfs_read_f+0x88
dofileread() at dofileread+0xa1
kern_readv() at kern_readv+0x60
read() at read+0x55
syscallenter() at syscallenter+0xf0
syscall() at syscall+0x60
Xfast_syscall() at Xfast_syscall+0xe2
--- syscall (3, FreeBSD ELF64, read), rip = 0x80084ffec, rsp = 0x7fffffffecc8, rbp = 0 ---
Tracing command cron pid 1052 tid 100104 td 0xffffff0004bec8c0
Tracing command sendmail pid 1045 tid 100145 td 0xffffff0011226460
Tracing command sendmail pid 1041 tid 100123 td 0xffffff0004f408c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x369
vm_fault() at vm_fault+0x15bc
trap_pfault() at trap_pfault+0x128
trap() at trap+0x36c
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff8045f5bb, rsp = 0xffffff8096cad850, rbp = 0xffffff8096cada90 ---
copyout() at copyout+0x3b
select() at select+0x5d
syscallenter() at syscallenter+0xf0
syscall() at syscall+0x60
Xfast_syscall() at Xfast_syscall+0xe2
--- syscall (93, FreeBSD ELF64, select), rip = 0x800de5f6c, rsp = 0x7fffffffc1e8, rbp = 0x7fffffffc280 ---
Tracing command sshd pid 1033 tid 100139 td 0xffffff001116f8c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_catch_signals() at sleepq_catch_signals+0x2a6
sleepq_wait_sig() at sleepq_wait_sig+0x16
_cv_wait_sig() at _cv_wait_sig+0x17e
seltdwait() at seltdwait+0xac
kern_select() at kern_select+0x640
select() at select+0x5d
syscallenter() at syscallenter+0xf0
syscall() at syscall+0x60
Xfast_syscall() at Xfast_syscall+0xe2
--- syscall (93, FreeBSD ELF64, select), rip = 0x8016dcf6c, rsp = 0x7fffffffe148, rbp = 0xa ---
Tracing command cvsupd pid 962 tid 100098 td 0xffffff0004b03000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_catch_signals() at sleepq_catch_signals+0x2a6
sleepq_wait_sig() at sleepq_wait_sig+0x16
_cv_wait_sig() at _cv_wait_sig+0x17e
seltdwait() at seltdwait+0xac
kern_select() at kern_select+0x640
select() at select+0x5d
syscallenter() at syscallenter+0xf0
syscall() at syscall+0x60
Xfast_syscall() at Xfast_syscall+0xe2
--- syscall (93, FreeBSD ELF64, select), rip = 0x800a2ff6c, rsp = 0x6b28b0, rbp = 0x6b2938 ---
Tracing command ntpd pid 872 tid 100127 td 0xffffff0011121000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x369
vm_fault() at vm_fault+0x15bc
trap_pfault() at trap_pfault+0x128
trap() at trap+0x501
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x4372e0, rsp = 0x7fffffffeae8, rbp = 0 ---
Tracing command smbd pid 856 tid 100095 td 0xffffff0004b04000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_catch_signals() at sleepq_catch_signals+0x2a6
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19
_cv_timedwait_sig() at _cv_timedwait_sig+0x18c
seltdwait() at seltdwait+0x56
kern_select() at kern_select+0x640
select() at select+0x5d
syscallenter() at syscallenter+0xf0
syscall() at syscall+0x60
Xfast_syscall() at Xfast_syscall+0xe2
--- syscall (93, FreeBSD ELF64, select), rip = 0x802676f6c, rsp = 0x7fffffffe6c8, rbp = 0x18 ---
Tracing command smbd pid 804 tid 100086 td 0xffffff0004b05000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x369
vm_fault() at vm_fault+0x15bc
trap_pfault() at trap_pfault+0x128
trap() at trap+0x36c
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff8045f5bb, rsp = 0xffffff8096bf4850, rbp = 0xffffff8096bf4a90 ---
copyout() at copyout+0x3b
select() at select+0x5d
syscallenter() at syscallenter+0xf0
syscall() at syscall+0x60
Xfast_syscall() at Xfast_syscall+0xe2
--- syscall (93, FreeBSD ELF64, select), rip = 0x802676f6c, rsp = 0x7fffffffe728, rbp = 0x1b ---
Tracing command nmbd pid 800 tid 100094 td 0xffffff0004b04460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x369
vm_fault() at vm_fault+0x15bc
trap_pfault() at trap_pfault+0x128
trap() at trap+0x36c
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff8045f5bb, rsp = 0xffffff8096c1c850, rbp = 0xffffff8096c1ca90 ---
copyout() at copyout+0x3b
select() at select+0x5d
syscallenter() at syscallenter+0xf0
syscall() at syscall+0x60
Xfast_syscall() at Xfast_syscall+0xe2
--- syscall (93, FreeBSD ELF64, select), rip = 0x801e7af6c, rsp = 0x7fffffffe7d8, rbp = 0x10 ---
Tracing command nfsd pid 743 tid 100122 td 0xffffff0004f6a000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_catch_signals() at sleepq_catch_signals+0x2a6
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19
_cv_timedwait_sig() at _cv_timedwait_sig+0x18c
svc_run_internal() at svc_run_internal+0x81a
svc_thread_start() at svc_thread_start+0xb
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0xc, rip = 0x8006a045c, rsp = 0x7fffffffe6d8, rbp = 0x5 ---
Tracing command nfsd pid 743 tid 100121 td 0xffffff0004f6a460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_catch_signals() at sleepq_catch_signals+0x2a6
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19
_cv_timedwait_sig() at _cv_timedwait_sig+0x18c
svc_run_internal() at svc_run_internal+0x81a
svc_thread_start() at svc_thread_start+0xb
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0xc, rip = 0x8006a045c, rsp = 0x7fffffffe6d8, rbp = 0x5 ---
Tracing command nfsd pid 743 tid 100120 td 0xffffff0004f6a8c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_catch_signals() at sleepq_catch_signals+0x2a6
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19
_cv_timedwait_sig() at _cv_timedwait_sig+0x18c
svc_run_internal() at svc_run_internal+0x81a
svc_thread_start() at svc_thread_start+0xb
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0xc, rip = 0x8006a045c, rsp = 0x7fffffffe6d8, rbp = 0x5 ---
Tracing command nfsd pid 743 tid 100087 td 0xffffff0004a90460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_catch_signals() at sleepq_catch_signals+0x2a6
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19
_cv_timedwait_sig() at _cv_timedwait_sig+0x18c
svc_run_internal() at svc_run_internal+0x81a
svc_run() at svc_run+0x8f
nfssvc_nfsd() at nfssvc_nfsd+0xa2
nfssvc_nfsserver() at nfssvc_nfsserver+0x5b
nfssvc() at nfssvc+0x73
syscallenter() at syscallenter+0xf0
syscall() at syscall+0x60
Xfast_syscall() at Xfast_syscall+0xe2
--- syscall (155, FreeBSD ELF64, nfssvc), rip = 0x8006a045c, rsp = 0x7fffffffe6d8, rbp = 0x5 ---
Tracing command nfsd pid 742 tid 100109 td 0xffffff0004be9000
Tracing command mountd pid 733 tid 100092 td 0xffffff0004bf3000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_catch_signals() at sleepq_catch_signals+0x2a6
sleepq_wait_sig() at sleepq_wait_sig+0x16
_cv_wait_sig() at _cv_wait_sig+0x17e
seltdwait() at seltdwait+0xac
kern_select() at kern_select+0x640
select() at select+0x5d
syscallenter() at syscallenter+0xf0
syscall() at syscall+0x60
Xfast_syscall() at Xfast_syscall+0xe2
--- syscall (93, FreeBSD ELF64, select), rip = 0x800853f6c, rsp = 0x7fffffffec78, rbp = 0x7fffffffed70 ---
Tracing command rpcbind pid 638 tid 100089 td 0xffffff0004b048c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x369
vm_fault() at vm_fault+0x15bc
trap_pfault() at trap_pfault+0x128
trap() at trap+0x36c
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff8045f5c3, rsp = 0xffffff8096c03910, rbp = 0xffffff8096c03ae0 ---
copyout() at copyout+0x43
syscallenter() at syscallenter+0xf0
syscall() at syscall+0x60
Xfast_syscall() at Xfast_syscall+0xe2
--- syscall (209, FreeBSD ELF64, poll), rip = 0x8008ff06c, rsp = 0x7fffffffca88, rbp = 0x800c150c0 ---
Tracing command syslogd pid 612 tid 100083 td 0xffffff0004a93460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x369
vm_fault() at vm_fault+0x15bc
trap_pfault() at trap_pfault+0x128
trap() at trap+0x36c
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff8045f5bb, rsp = 0xffffff8096be56b0, rbp = 0xffffff8096be5b00 ---
copyout() at copyout+0x3b
postsig() at postsig+0x27f
ast() at ast+0x199
doreti_ast() at doreti_ast+0x1f
Tracing command devd pid 488 tid 100111 td 0xffffff0004f758c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_catch_signals() at sleepq_catch_signals+0x2a6
sleepq_wait_sig() at sleepq_wait_sig+0x16
_cv_wait_sig() at _cv_wait_sig+0x17e
seltdwait() at seltdwait+0xac
kern_select() at kern_select+0x640
select() at select+0x5d
syscallenter() at syscallenter+0xf0
syscall() at syscall+0x60
Xfast_syscall() at Xfast_syscall+0xe2
--- syscall (93, FreeBSD ELF64, select), rip = 0x440f9c, rsp = 0x7fffffffe898, rbp = 0x7fffffffe8b0 ---
Tracing command dhclient pid 474 tid 100112 td 0xffffff0004f75460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_catch_signals() at sleepq_catch_signals+0x2a6
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19
_cv_timedwait_sig() at _cv_timedwait_sig+0x18c
seltdwait() at seltdwait+0x56
poll() at poll+0x421
syscallenter() at syscallenter+0xf0
syscall() at syscall+0x60
Xfast_syscall() at Xfast_syscall+0xe2
--- syscall (209, FreeBSD ELF64, poll), rip = 0x8006ee06c, rsp = 0x7fffffffece8, rbp = 0x1481c18 ---
Tracing command dhclient pid 458 tid 100119 td 0xffffff0004f6b000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_catch_signals() at sleepq_catch_signals+0x2a6
sleepq_wait_sig() at sleepq_wait_sig+0x16
_cv_wait_sig() at _cv_wait_sig+0x17e
seltdwait() at seltdwait+0xac
poll() at poll+0x421
syscallenter() at syscallenter+0xf0
syscall() at syscall+0x60
Xfast_syscall() at Xfast_syscall+0xe2
--- syscall (209, FreeBSD ELF64, poll), rip = 0x8006ee06c, rsp = 0x7fffffffece8, rbp = 0x6 ---
Tracing command adjkerntz pid 122 tid 100100 td 0xffffff0004bf2000
Tracing command g_raid5 pid 20 tid 100079 td 0xffffff0004b05460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_timedwait() at sleepq_timedwait+0x4d
_sleep() at _sleep+0x352
g_raid5_workerD() at g_raid5_workerD+0x174
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8096bd1cf0, rbp = 0 ---
Tracing command g_raid5 pid 20 tid 100078 td 0xffffff0004b058c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x369
kmem_back() at kmem_back+0x11e
kmem_malloc() at kmem_malloc+0x1f8
uma_large_malloc() at uma_large_malloc+0x4a
malloc() at malloc+0x159
g_raid5_malloc() at g_raid5_malloc+0x143
g_raid5_mallocx() at g_raid5_mallocx+0xc0
g_raid5_issue_check() at g_raid5_issue_check+0x102
g_raid5_write() at g_raid5_write+0x39f
g_raid5_flush_sq() at g_raid5_flush_sq+0x1af
g_raid5_worker() at g_raid5_worker+0x5be
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8096bcccf0, rbp = 0 ---
Tracing command softdepflush pid 19 tid 100077 td 0xffffff0004a948c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_timedwait() at sleepq_timedwait+0x4d
_sleep() at _sleep+0x352
softdep_flush() at softdep_flush+0x259
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff80948c4cf0, rbp = 0 ---
Tracing command vnlru pid 18 tid 100076 td 0xffffff0004a95000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_timedwait() at sleepq_timedwait+0x4d
_sleep() at _sleep+0x352
vnlru_proc() at vnlru_proc+0x4df
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff80948bfcf0, rbp = 0 ---
Tracing command syncer pid 17 tid 100075 td 0xffffff0004a95460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x369
getpbuf() at getpbuf+0x4e
cluster_wbuild() at cluster_wbuild+0x1ee
ffs_syncvnode() at ffs_syncvnode+0x1a6
ffs_sync() at ffs_sync+0x216
sync_fsync() at sync_fsync+0x13a
VOP_FSYNC_APV() at VOP_FSYNC_APV+0xb5
sync_vnode() at sync_vnode+0x157
sched_sync() at sched_sync+0x1d2
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff80948bacf0, rbp = 0 ---
Tracing command bufdaemon pid 16 tid 100074 td 0xffffff0004a958c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_timedwait() at sleepq_timedwait+0x4d
_sleep() at _sleep+0x352
buf_daemon() at buf_daemon+0x14a
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff80948b5cf0, rbp = 0 ---
Tracing command pagezero pid 15 tid 100073 td 0xffffff0004a96000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_timedwait() at sleepq_timedwait+0x4d
_sleep() at _sleep+0x352
vm_pagezero() at vm_pagezero+0x73
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff80948b0cf0, rbp = 0 ---
Tracing command idlepoll pid 9 tid 100072 td 0xffffff0001778000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_timedwait() at sleepq_timedwait+0x4d
_sleep() at _sleep+0x352
poll_idle() at poll_idle+0x94
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff80948abcf0, rbp = 0 ---
Tracing command vmdaemon pid 8 tid 100071 td 0xffffff0001778460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x369
vm_daemon() at vm_daemon+0x4d
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff80948a6cf0, rbp = 0 ---
Tracing command pagedaemon pid 7 tid 100070 td 0xffffff00017788c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_timedwait() at sleepq_timedwait+0x4d
_sleep() at _sleep+0x352
vm_pageout() at vm_pageout+0x27c
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff80948a1cf0, rbp = 0 ---
Tracing command xpt_thrd pid 6 tid 100069 td 0xffffff000177a000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x369
xpt_scanner_thread() at xpt_scanner_thread+0xd5
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff809489ccf0, rbp = 0 ---
Tracing command fw0_probe pid 5 tid 100064 td 0xffffff000177c8c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_catch_signals() at sleepq_catch_signals+0x2a6
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x31a
fw_bus_probe_thread() at fw_bus_probe_thread+0xbc
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8000172cf0, rbp = 0 ---
Tracing command usb pid 14 tid 100061 td 0xffffff000177d8c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff800015fcf0, rbp = 0 ---
Tracing command usb pid 14 tid 100060 td 0xffffff0001725460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff800015acf0, rbp = 0 ---
Tracing command usb pid 14 tid 100059 td 0xffffff00017258c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8000155cf0, rbp = 0 ---
Tracing command usb pid 14 tid 100058 td 0xffffff0001749000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8000150cf0, rbp = 0 ---
Tracing command usb pid 14 tid 100057 td 0xffffff0001749460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8000149cf0, rbp = 0 ---
Tracing command usb pid 14 tid 100056 td 0xffffff00017498c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8000144cf0, rbp = 0 ---
Tracing command usb pid 14 tid 100055 td 0xffffff000174a000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff800013fcf0, rbp = 0 ---
Tracing command usb pid 14 tid 100054 td 0xffffff000174a460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff800013acf0, rbp = 0 ---
Tracing command usb pid 14 tid 100053 td 0xffffff000174a8c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8000134cf0, rbp = 0 ---
Tracing command usb pid 14 tid 100052 td 0xffffff000174b000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff800012fcf0, rbp = 0 ---
Tracing command usb pid 14 tid 100051 td 0xffffff000174b460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff800012acf0, rbp = 0 ---
Tracing command usb pid 14 tid 100050 td 0xffffff000174b8c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8000125cf0, rbp = 0 ---
Tracing command usb pid 14 tid 100048 td 0xffffff0001721460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff800011acf0, rbp = 0 ---
Tracing command usb pid 14 tid 100047 td 0xffffff00017218c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8000115cf0, rbp = 0 ---
Tracing command usb pid 14 tid 100046 td 0xffffff0001722000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8000110cf0, rbp = 0 ---
Tracing command usb pid 14 tid 100045 td 0xffffff0001722460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff800010bcf0, rbp = 0 ---
Tracing command usb pid 14 tid 100043 td 0xffffff0001724000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8000100cf0, rbp = 0 ---
Tracing command usb pid 14 tid 100042 td 0xffffff0001724460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff80000fbcf0, rbp = 0 ---
Tracing command usb pid 14 tid 100041 td 0xffffff00017248c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff80000f6cf0, rbp = 0 ---
Tracing command usb pid 14 tid 100040 td 0xffffff0001725000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff80000f1cf0, rbp = 0 ---
Tracing command usb pid 14 tid 100039 td 0xffffff00016f5000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff80000eacf0, rbp = 0 ---
Tracing command usb pid 14 tid 100038 td 0xffffff00016f5460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff80000e5cf0, rbp = 0 ---
Tracing command usb pid 14 tid 100037 td 0xffffff00016f58c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff80000e0cf0, rbp = 0 ---
Tracing command usb pid 14 tid 100036 td 0xffffff00016f6000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff80000dbcf0, rbp = 0 ---
Tracing command usb pid 14 tid 100034 td 0xffffff00016f68c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff80000d0cf0, rbp = 0 ---
Tracing command usb pid 14 tid 100033 td 0xffffff00016f7000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff80000cbcf0, rbp = 0 ---
Tracing command usb pid 14 tid 100032 td 0xffffff00016f7460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff80000c6cf0, rbp = 0 ---
Tracing command usb pid 14 tid 100031 td 0xffffff00016f78c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff80000c1cf0, rbp = 0 ---
Tracing command usb pid 14 tid 100029 td 0xffffff00016298c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff80000b6cf0, rbp = 0 ---
Tracing command usb pid 14 tid 100028 td 0xffffff0001670000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff80000b1cf0, rbp = 0 ---
Tracing command usb pid 14 tid 100027 td 0xffffff0001670460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff80000accf0, rbp = 0 ---
Tracing command usb pid 14 tid 100026 td 0xffffff00016708c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
usb_process() at usb_process+0x14e
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff80000a7cf0, rbp = 0 ---
Tracing command yarrow pid 13 tid 100013 td 0xffffff00015a38c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_timedwait() at sleepq_timedwait+0x4d
_sleep() at _sleep+0x352
random_kthread() at random_kthread+0x1ad
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff800005dcf0, rbp = 0 ---
Tracing command g_down pid 4 tid 100011 td 0xffffff00015a5460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x369
g_io_schedule_down() at g_io_schedule_down+0x228
g_down_procbody() at g_down_procbody+0x6f
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8000053cf0, rbp = 0 ---
Tracing command g_up pid 3 tid 100010 td 0xffffff00015a58c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x369
g_io_schedule_up() at g_io_schedule_up+0x10a
g_up_procbody() at g_up_procbody+0x6f
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff800004ecf0, rbp = 0 ---
Tracing command g_event pid 2 tid 100009 td 0xffffff0001592460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_timedwait() at sleepq_timedwait+0x4d
_sleep() at _sleep+0x352
g_event_procbody() at g_event_procbody+0xa1
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8000049cf0, rbp = 0 ---
Tracing command intr pid 12 tid 100068 td 0xffffff000177a460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
ithread_loop() at ithread_loop+0x23c
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8094893cf0, rbp = 0 ---
Tracing command intr pid 12 tid 100067 td 0xffffff000177a8c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
ithread_loop() at ithread_loop+0x23c
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff809488ecf0, rbp = 0 ---
Tracing command intr pid 12 tid 100066 td 0xffffff000177c000
fork_trampoline() at fork_trampoline
Tracing command intr pid 12 tid 100065 td 0xffffff000177c460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
ithread_loop() at ithread_loop+0x23c
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8000177cf0, rbp = 0 ---
Tracing command intr pid 12 tid 100062 td 0xffffff000177d460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
ithread_loop() at ithread_loop+0x23c
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8000164cf0, rbp = 0 ---
Tracing command intr pid 12 tid 100049 td 0xffffff0001721000
fork_trampoline() at fork_trampoline
Tracing command intr pid 12 tid 100044 td 0xffffff00017228c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
ithread_loop() at ithread_loop+0x23c
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8000106cf0, rbp = 0 ---
Tracing command intr pid 12 tid 100035 td 0xffffff00016f6460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
ithread_loop() at ithread_loop+0x23c
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff80000d6cf0, rbp = 0 ---
Tracing command intr pid 12 tid 100030 td 0xffffff0001629460
fork_trampoline() at fork_trampoline
Tracing command intr pid 12 tid 100025 td 0xffffff0001671000
fork_trampoline() at fork_trampoline
Tracing command intr pid 12 tid 100023 td 0xffffff00016718c0
fork_trampoline() at fork_trampoline
Tracing command intr pid 12 tid 100022 td 0xffffff0001626000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
ithread_loop() at ithread_loop+0x23c
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff800008acf0, rbp = 0 ---
Tracing command intr pid 12 tid 100020 td 0xffffff00016268c0
fork_trampoline() at fork_trampoline
Tracing command intr pid 12 tid 100019 td 0xffffff0001627000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
ithread_loop() at ithread_loop+0x23c
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff800007bcf0, rbp = 0 ---
Tracing command intr pid 12 tid 100014 td 0xffffff00015a3460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
ithread_loop() at ithread_loop+0x23c
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8000062cf0, rbp = 0 ---
Tracing command intr pid 12 tid 100008 td 0xffffff00015928c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
ithread_loop() at ithread_loop+0x23c
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8000044cf0, rbp = 0 ---
Tracing command intr pid 12 tid 100007 td 0xffffff00015a0000
fork_trampoline() at fork_trampoline
Tracing command intr pid 12 tid 100006 td 0xffffff00015a0460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
ithread_loop() at ithread_loop+0x23c
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff800003acf0, rbp = 0 ---
Tracing command intr pid 12 tid 100005 td 0xffffff00015a08c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
ithread_loop() at ithread_loop+0x23c
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8000035cf0, rbp = 0 ---
Tracing command idle pid 11 tid 100004 td 0xffffff0001591000
cpustop_handler() at cpustop_handler+0x3b
ipi_nmi_handler() at ipi_nmi_handler+0x30
trap() at trap+0x175
nmi_calltrap() at nmi_calltrap+0x8
--- trap 0x13, rip = 0xffffffff80440ec6, rsp = 0xffffffff808b3240, rbp = 0xffffff8000030b20 ---
acpi_cpu_c1() at acpi_cpu_c1+0x6
acpi_cpu_idle() at acpi_cpu_idle+0x214
sched_idletd() at sched_idletd+0x128
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8000030cf0, rbp = 0 ---
Tracing command idle pid 11 tid 100003 td 0xffffff0001591460
kdb_enter() at kdb_enter+0x3d
uart_intr() at uart_intr+0x2be
intr_event_handle() at intr_event_handle+0x68
intr_execute_handlers() at intr_execute_handlers+0x5f
lapic_handle_intr() at lapic_handle_intr+0x37
Xapic_isr1() at Xapic_isr1+0xa5
--- interrupt, rip = 0xffffffff80440ec6, rsp = 0xffffff800002bb10, rbp = 0xffffff800002bb20 ---
acpi_cpu_c1() at acpi_cpu_c1+0x6
acpi_cpu_idle() at acpi_cpu_idle+0x214
sched_idletd() at sched_idletd+0x128
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff800002bcf0, rbp = 0 ---
Tracing command init pid 1 tid 100002 td 0xffffff00015918c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_catch_signals() at sleepq_catch_signals+0x2a6
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x31a
kern_wait() at kern_wait+0x3e9
wait4() at wait4+0x35
syscallenter() at syscallenter+0xf0
syscall() at syscall+0x60
Xfast_syscall() at Xfast_syscall+0xe2
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x40c71c, rsp = 0x7fffffffe808, rbp = 0x401d40 ---
Tracing command audit pid 10 tid 100001 td 0xffffff0001592000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_cv_wait() at _cv_wait+0x17a
audit_worker() at audit_worker+0x77
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8000021cf0, rbp = 0 ---
Tracing command kernel pid 0 tid 100063 td 0xffffff000177d000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
msleep_spin() at msleep_spin+0x209
taskqueue_thread_loop() at taskqueue_thread_loop+0x62
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff800016dcf0, rbp = 0 ---
Tracing command kernel pid 0 tid 100024 td 0xffffff0001671460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
msleep_spin() at msleep_spin+0x209
taskqueue_thread_loop() at taskqueue_thread_loop+0x62
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff800009ccf0, rbp = 0 ---
Tracing command kernel pid 0 tid 100021 td 0xffffff0001626460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x369
taskqueue_thread_loop() at taskqueue_thread_loop+0xb7
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8000085cf0, rbp = 0 ---
Tracing command kernel pid 0 tid 100018 td 0xffffff0001627460
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
msleep_spin() at msleep_spin+0x209
taskqueue_thread_loop() at taskqueue_thread_loop+0x62
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8000076cf0, rbp = 0 ---
Tracing command kernel pid 0 tid 100017 td 0xffffff00016278c0
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
msleep_spin() at msleep_spin+0x209
taskqueue_thread_loop() at taskqueue_thread_loop+0x62
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8000071cf0, rbp = 0 ---
Tracing command kernel pid 0 tid 100016 td 0xffffff0001629000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
msleep_spin() at msleep_spin+0x209
taskqueue_thread_loop() at taskqueue_thread_loop+0x62
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff800006ccf0, rbp = 0 ---
Tracing command kernel pid 0 tid 100015 td 0xffffff00015a3000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x369
taskqueue_thread_loop() at taskqueue_thread_loop+0xb7
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8000067cf0, rbp = 0 ---
Tracing command kernel pid 0 tid 100012 td 0xffffff00015a5000
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x369
taskqueue_thread_loop() at taskqueue_thread_loop+0xb7
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8000058cf0, rbp = 0 ---
Tracing command kernel pid 0 tid 100000 td 0xffffffff806a0f80
sched_switch() at sched_switch+0x138
mi_switch() at mi_switch+0x21b
sleepq_switch() at sleepq_switch+0x123
sleepq_wait() at sleepq_wait+0x4d
_sleep() at _sleep+0x369
scheduler() at scheduler+0x229
mi_startup() at mi_startup+0x77
btext() at btext+0x2c
db> reboot
[-- Attachment #3 --]
KDB: debugger backends: ddb
KDB: current backend: ddb
Copyright (c) 1992-2011 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 8.2-PRERELEASE #0: Sat Jan 8 14:49:23 MSK 2011
lev@blob.home.serebryakov.spb.ru:/usr/obj/usr/src/sys/BLOBDIAG amd64
WARNING: WITNESS option enabled, expect reduced performance.
WARNING: DIAGNOSTIC option enabled, expect reduced performance.
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Core(TM)2 Duo CPU E4500 @ 2.20GHz (2200.09-MHz K8-class CPU)
Origin = "GenuineIntel" Id = 0x6fd Family = 6 Model = f Stepping = 13
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Features2=0xe39d<SSE3,DTES64,MON,DS_CPL,EST,TM2,SSSE3,CX16,xTPR,PDCM>
AMD Features=0x20100800<SYSCALL,NX,LM>
AMD Features2=0x1<LAHF>
TSC: P-state invariant
real memory = 2147483648 (2048 MB)
avail memory = 2049417216 (1954 MB)
ACPI APIC Table: <A_M_I_ OEMAPIC >
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
FreeBSD/SMP: 1 package(s) x 2 core(s)
cpu0 (BSP): APIC ID: 0
cpu1 (AP): APIC ID: 1
ioapic0 <Version 2.0> irqs 0-23 on motherboard
kbd1 at kbdmux0
acpi0: <A_M_I_ OEMXSDT> on motherboard
acpi0: [ITHREAD]
acpi0: Power Button (fixed)
acpi0: reservation of 0, a0000 (3) failed
acpi0: reservation of 100000, 7fc00000 (3) failed
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
cpu0: <ACPI CPU> on acpi0
ACPI Warning: Incorrect checksum in table [OEMB] - 0xCB, should be 0xC6 (20101013/tbutils-354)
cpu1: <ACPI CPU> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
vgapci0: <VGA-compatible display> port 0xec00-0xec07 mem 0xfea80000-0xfeafffff,0xd0000000-0xdfffffff,0xfe900000-0xfe9fffff irq 16 at device 2.0 on pci0
pci0: <simple comms> at device 3.0 (no driver attached)
pci0: <mass storage, ATA> at device 3.2 (no driver attached)
pci0: <simple comms, UART> at device 3.3 (no driver attached)
em0: <Intel(R) PRO/1000 Network Connection 7.1.8> port 0xdc00-0xdc1f mem 0xfea40000-0xfea5ffff,0xfea79000-0xfea79fff irq 20 at device 25.0 on pci0
em0: No MSI/MSIX using a Legacy IRQ
em0: [FILTER]
em0: Ethernet address: 00:1e:8c:75:03:0d
uhci0: <Intel 82801I (ICH9) USB controller> port 0xd480-0xd49f irq 16 at device 26.0 on pci0
uhci0: [ITHREAD]
usbus0: <Intel 82801I (ICH9) USB controller> on uhci0
uhci1: <Intel 82801I (ICH9) USB controller> port 0xd800-0xd81f irq 21 at device 26.1 on pci0
uhci1: [ITHREAD]
usbus1: <Intel 82801I (ICH9) USB controller> on uhci1
uhci2: <Intel 82801I (ICH9) USB controller> port 0xd880-0xd89f irq 18 at device 26.2 on pci0
uhci2: [ITHREAD]
usbus2: <Intel 82801I (ICH9) USB controller> on uhci2
ehci0: <Intel 82801I (ICH9) USB 2.0 controller> mem 0xfea7a800-0xfea7abff irq 18 at device 26.7 on pci0
ehci0: [ITHREAD]
usbus3: EHCI version 1.0
usbus3: <Intel 82801I (ICH9) USB 2.0 controller> on ehci0
uhci3: <Intel 82801I (ICH9) USB controller> port 0xd000-0xd01f irq 23 at device 29.0 on pci0
uhci3: [ITHREAD]
usbus4: <Intel 82801I (ICH9) USB controller> on uhci3
uhci4: <Intel 82801I (ICH9) USB controller> port 0xd080-0xd09f irq 19 at device 29.1 on pci0
uhci4: [ITHREAD]
usbus5: <Intel 82801I (ICH9) USB controller> on uhci4
uhci5: <Intel 82801I (ICH9) USB controller> port 0xd400-0xd41f irq 18 at device 29.2 on pci0
uhci5: [ITHREAD]
usbus6: <Intel 82801I (ICH9) USB controller> on uhci5
ehci1: <Intel 82801I (ICH9) USB 2.0 controller> mem 0xfea7a400-0xfea7a7ff irq 23 at device 29.7 on pci0
ehci1: [ITHREAD]
usbus7: EHCI version 1.0
usbus7: <Intel 82801I (ICH9) USB 2.0 controller> on ehci1
pcib1: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci1: <ACPI PCI bus> on pcib1
fwohci0: <Lucent FW322/323> mem 0xfebff000-0xfebfffff irq 20 at device 2.0 on pci1
fwohci0: [ITHREAD]
fwohci0: OHCI version 1.0 (ROM=1)
fwohci0: No. of Isochronous channels is 8.
fwohci0: EUI64 00:1e:8c:00:00:1a:5f:da
fwohci0: Phy 1394a available S400, 2 ports.
fwohci0: Link S400, max_rec 2048 bytes.
firewire0: <IEEE1394(FireWire) bus> on fwohci0
fwohci0: Initiate bus reset
fwohci0: fwohci_intr_core: BUS reset
fwohci0: fwohci_intr_core: node_id=0x00000000, SelfID Count=1, CYCLEMASTER mode
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
ahci0: <Intel ICH9 AHCI SATA controller> port 0xc880-0xc887,0xc800-0xc803,0xc480-0xc487,0xc400-0xc403,0xc080-0xc09f mem 0xfea78800-0xfea78fff irq 22 at device 31.2 on pci0
ahci0: [ITHREAD]
ahci0: AHCI v1.20 with 6 3Gbps ports, Port Multiplier supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich0: [ITHREAD]
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich1: [ITHREAD]
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich2: [ITHREAD]
ahcich3: <AHCI channel> at channel 3 on ahci0
ahcich3: [ITHREAD]
ahcich4: <AHCI channel> at channel 4 on ahci0
ahcich4: [ITHREAD]
ahcich5: <AHCI channel> at channel 5 on ahci0
ahcich5: [ITHREAD]
ichsmb0: <Intel 82801I (ICH9) SMBus controller> port 0x400-0x41f mem 0xfea7a000-0xfea7a0ff irq 18 at device 31.3 on pci0
ichsmb0: [ITHREAD]
smbus0: <System Management Bus> on ichsmb0
smb0: <SMBus generic I/O> on smbus0
pci0: <dasp> at device 31.6 (no driver attached)
acpi_button0: <Power Button> on acpi0
atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
ppc0: <Parallel port> port 0x378-0x37f,0x778-0x77f irq 7 drq 3 on acpi0
ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode
ppc0: FIFO with 16/16/9 bytes threshold
ppc0: [ITHREAD]
ppbus0: <Parallel port bus> on ppc0
acpi_hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 900
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart0: [FILTER]
uart0: console (115200,n,8,1)
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
atkbd0: [ITHREAD]
orm0: <ISA Option ROM> at iomem 0xcb800-0xcc7ff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
coretemp0: <CPU On-Die Thermal Sensors> on cpu0
est0: <Enhanced SpeedStep Frequency Control> on cpu0
p4tcc0: <CPU Frequency Thermal Control> on cpu0
coretemp1: <CPU On-Die Thermal Sensors> on cpu1
est1: <Enhanced SpeedStep Frequency Control> on cpu1
p4tcc1: <CPU Frequency Thermal Control> on cpu1
Timecounters tick every 1.000 msec
firewire0: 1 nodes, maxhop <= 0 cable IRM irm(0) (me)
firewire0: bus manager 0
usbus0: 12Mbps Full Speed USB v1.0
usbus1: 12Mbps Full Speed USB v1.0
usbus2: 12Mbps Full Speed USB v1.0
usbus3: 480Mbps High Speed USB v2.0
usbus4: 12Mbps Full Speed USB v1.0
usbus5: 12Mbps Full Speed USB v1.0
usbus6: 12Mbps Full Speed USB v1.0
usbus7: 480Mbps High Speed USB v2.0
GEOM_RAID5: Module loaded, version 1.0.20110107.34 (rev 0631eacdb575)
ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
ada0: <SAMSUNG HD321KJ CP100-10> ATA-8ugen0.1: <Intel> at usbus0
uhub0: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
Expensive timeout(9) function: 0xffffffff802f74f0(0xffffff0001670000) 0.011560407 s
ugen1.1: <Intel> at usbus1
uhub1: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1
ugen2.1: <Intel> at usbus2
uhub2: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus2
ugen3.1: <Intel> at usbus3
uhub3: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus3
ugen4.1: <Intel> at usbus4
uhub4: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus4
ugen5.1: <Intel> at usbus5
uhub5: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus5
ugen6.1: <Intel> at usbus6
uhub6: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus6
ugen7.1: <Intel> at usbus7
uhub7: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus7
SATA 2.x device
ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 305245MB (625142448 512 byte sectors: 16H 63S/T 16383C)
ada1 at ahcich1 bus 0 scbus1 target 0 lun 0
ada1: <WDC WD5000AAKS-00YGA0 12.01C02> ATA-8 SATA 2.x device
ada1: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada1: Command Queueing enabled
ada1: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C)
ada2 at ahcich2 bus 0 scbus2 target 0 lun 0
ada2: <WDC WD5000AAKS-00A7B2 01.03B01> ATA-8 SATA 2.x device
ada2: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada2: Command Queueing enabled
ada2: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C)
ada3 at ahcich3 bus 0 scbus3 target 0 lun 0
ada3: <WDC WD5000AAKS-00YGA0 12.01C02> ATA-8 SATA 2.x device
ada3: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada3: Command Queueing enabled
ada3: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C)
ada4 at ahcich4 bus 0 scbus4 target 0 lun 0
ada4: <WDC WD5000AAKS-00YGA0 12.01C02> ATA-8 SATA 2.x device
ada4: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada4: Command Queueing enabled
ada4: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C)
ada5 at ahcich5 bus 0 scbus5 target 0 lun 0
ada5: <WDC WD5000AAKS-00YGA0 12.01C02> ATA-8 SATA 2.x device
ada5: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada5: Command Queueing enabled
ada5: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C)
SMP: AP CPU #1 Launched!
stray irq0
WARNING: WITNESS option enabled, expect reduced performance.
WARNING: DIAGNOSTIC option enabled, expect reduced performance.
GEOM_RAID5: storage: device created (stripesize=131072).
GEOM_RAID5: storage: ada1(4): newest disk data (CALM): 1.
GEOM_RAID5: storage: ada1(4): disk attached.
GEOM_RAID5: storage: ada2(3): newest disk data (CALM): 1.
GEOM_RAID5: storage: ada2(3): disk attached.
GEOM_RAID5: storage: ada3(2): newest disk data (CALM): 1.
GEOM_RAID5: storage: ada3(2): disk attached.
GEOM_RAID5: storage: ada4(0): newest disk data (CALM): 1.
GEOM_RAID5: storage: ada4(0): disk attached.
GEOM_RAID5: storage: ada5(1): newest disk data (CALM): 1.
GEOM_RAID5: storage: ada5(1): disk attached.
GEOM_RAID5: storage: activated (need about 95MiB kmem (max)).
GEOM_RAID5: storage: ada5(1): re-sync in progress: 61.99% p:0 ETA:0min (cause: store verify progress).
uhub0: 2 ports with 2 removable, self powered
uhub1: 2 ports with 2 removable, self powered
uhub2: 2 ports with 2 removable, self powered
uhub4: 2 ports with 2 removable, self powered
uhub5: 2 ports with 2 removable, self powered
uhub6: 2 ports with 2 removable, self powered
Root mount waiting for: usbus7 usbus3
Root mount waiting for: usbus7 usbus3
Root mount waiting for: usbus7 usbus3
uhub3: 6 ports with 6 removable, self powered
uhub7: 6 ports with 6 removable, self powered
Root mount waiting for: usbus7 usbus3
ugen3.2: <vendor 0x9710> at usbus3
ugen7.2: <Generic> at usbus7
umass0: <Generic Mass Storage Device, class 0/0, rev 2.00/1.00, addr 2> on usbus7
Root mount waiting for: usbus7
Trying to mount root from ufs:/dev/ada0s1a
da0 at umass-sim0 bus 0 scbus6 target 0 lun 0
da0: <Generic USB SD Reader 1.00> Removable Direct Access SCSI-0 device
da0: 40.000MB/s transfers
da0: Attempt to query device size failed: NOT READY, Medium not present
da1 at umass-sim0 bus 0 scbus6 target 0 lun 1
da1: <Generic USB CF Reader 1.01> Removable Direct Access SCSI-0 device
da1: 40.000MB/s transfers
da1: Attempt to query device size failed: NOT READY, Medium not present
da2 at umass-sim0 bus 0 scbus6 target 0 lun 2
da2: <Generic USB SM Reader 1.02> Removable Direct Access SCSI-0 device
da2: 40.000MB/s transfers
da2: Attempt to query device size failed: NOT READY, Medium not present
da3 at umass-sim0 bus 0 scbus6 target 0 lun 3
da3: <Generic USB MS Reader 1.03> Removable Direct Access SCSI-0 device
da3: 40.000MB/s transfers
da3: Attempt to query device size failed: NOT READY, Medium not present
Enter full pathname of shell or RETURN for /bin/sh:
[-- Attachment #4 --]
cpu HAMMER
ident BLOBDIAG
makeoptions DEBUG=-g # Build kernel with gdb(1) debug symbols
options PRINTF_BUFR_SIZE=1024
options DDB
options KDB
options BREAK_TO_DEBUGGER
options INVARIANTS
options INVARIANT_SUPPORT
options WITNESS
options DEBUG_LOCKS
options DEBUG_VFS_LOCKS
options DIAGNOSTIC
options SCHED_ULE # ULE scheduler
options PREEMPTION # Enable kernel thread preemption
options INET # InterNETworking
options FFS # Berkeley Fast Filesystem
options SOFTUPDATES # Enable FFS soft updates support
options UFS_ACL # Support for access control lists
options UFS_DIRHASH # Improve performance on big directories
options UFS_GJOURNAL # Enable gjournal-based UFS journaling
options MD_ROOT # MD is a potential root device
options NFSCLIENT # Network Filesystem Client
options NFSSERVER # Network Filesystem Server
options NFSLOCKD # Network Lock Manager
options PROCFS # Process filesystem (requires PSEUDOFS)
options PSEUDOFS # Pseudo-filesystem framework
options GEOM_LABEL # Provides labelization
options COMPAT_43TTY # BSD 4.3 TTY compat [KEEP THIS!]
options COMPAT_IA32 # Compatible with i386 binaries
options COMPAT_FREEBSD4 # Compatible with FreeBSD4
options COMPAT_FREEBSD5 # Compatible with FreeBSD5
options COMPAT_FREEBSD6 # Compatible with FreeBSD6
options COMPAT_FREEBSD7 # Compatible with FreeBSD7
options SCSI_DELAY=5000 # Delay (in ms) before probing SCSI
options KTRACE # ktrace(1) support
options STACK # stack(9) support
options SYSVSHM # SYSV-style shared memory
options SYSVMSG # SYSV-style message queues
options SYSVSEM # SYSV-style semaphores
options _KPOSIX_PRIORITY_SCHEDULING # POSIX P1003_1B real-time extensions
options KBD_INSTALL_CDEV # install a CDEV entry in /dev
options AUDIT # Security event auditing
# Make an SMP-capable kernel by default
options SMP # Symmetric MultiProcessor Kernel
# Device polling
options DEVICE_POLLING
# CPU frequency control
device cpufreq
device coretemp
device smb
device smbus
device ichsmb
device iicbus
device iicsmb
device iic
# Bus support.
device acpi
device pci
# SCSI
device scbus
device pass
device da
# ATA and ATAPI devices
device ahci
# atkbdc0 controls both the keyboard and the PS/2 mouse
device atkbdc # AT keyboard controller
device atkbd # AT keyboard
device psm # PS/2 mouse
device kbdmux # keyboard multiplexer
device vga # VGA video card driver
# syscons is the default console driver, resembling an SCO console
device sc
# Serial (COM) ports
device uart # Generic UART driver
# Parallel port
device ppc
device ppbus # Parallel port bus (required)
device em # Intel PRO/1000 adapter Gigabit Ethernet Card
# Pseudo devices.
device loop # Network loopback
device random # Entropy device
device ether # Ethernet support
device tun # Packet tunnel.
device pty # Pseudo-ttys (telnet etc)
device md # Memory "disks"
device firmware # firmware assist module
# The `bpf' device enables the Berkeley Packet Filter.
# Be aware of the administrative consequences of enabling this!
# Note that 'bpf' is required for DHCP.
device bpf # Berkeley packet filter
# USB support
device uhci # UHCI PCI->USB interface
device ehci # EHCI PCI->USB interface (USB 2.0)
device usb # USB Bus (required)
device ucom # Disks/Mass storage - Requires scbus and da
device umass # Disks/Mass storage - Requires scbus and da
# FireWire support
device firewire # FireWire bus code
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?204344488.20110108214457>