Skip site navigation (1)Skip section navigation (2)
Date:      Sun, 04 Jan 2015 15:16:32 +0100
From:      Nikos Vassiliadis <nvass@gmx.com>
To:        sthaug@nethelp.no, rodrigc@FreeBSD.org
Cc:        freebsd-stable@freebsd.org
Subject:   Re: 10.1-STABLE/i386 GENERIC + VIMAGE: Panic when going multiuser
Message-ID:  <54A94B40.5000908@gmx.com>
In-Reply-To: <20150103.215108.41660163.sthaug@nethelp.no>
References:  <20150103.180210.74719874.sthaug@nethelp.no> <CAG=rPVeLUav5ovqcinaiknX6HKs9QTDrOb3nxHJtDkeEE7AfDw@mail.gmail.com> <20150103.215108.41660163.sthaug@nethelp.no>

next in thread | previous in thread | raw e-mail | index | archive | help
Hi,

Can you update to a more recent revision? I am on 10-stable a few days 
later (1/1/15) than you and everything is ok.

On 01/03/15 21:51, sthaug@nethelp.no wrote:
>>> I have a reproducible crash in 10.1-STABLE/i386, svn updated to r276174.
>>> The kernel is based on GENERIC with *one* line added: options VIMAGE.
>>>
>>> I can boot to single user with no problem. Going multiuser results in
>>> immediate crash with backtrace
>>>
>>> #0 0xc0b59be2 at kdb_backtrace+0x52
>>> #1 0xc0b1b65f at panic+0x11f
>>> #2 0xc0dd1666 at vm_fault_hold+0x2076
>>> #3 0xc0dcf5b1 at vm_fault+0x81
>>> #4 0xc103008b at trap_pfault+0x1bb
>>> #5 0xc102f8e4 at trap+0x674
>>> #6 0xc101ad0c at calltrap+0x6
>>> #7 0xc0d0ca7a at sysctl_ip6_temppltime+0x3a
>>> #8 0xc0b28031 at sysctl_root+0x2b1
>>> #9 0xc0b2862a at userland_sysctl+0x1fa
>>> #10 0xc0b283e8 at sys___sysctl+0x98
>>> #11 0xc1030986 at syscall+0x4a6
>>> #12 0xc101ada1 at Xint0x80_syscall+0x21
>>>
>>
>>
>> That stack trace doesn't have enough info.  Can you:
>> (1)  boot into single mode on your system
>> (2)  Add this to /etc/rc.conf:
>>              ddb_enable="YES"
>> (3)  Reboot the system and let it go to multi-user
>
> I found I had to also add "options DDB" to the kernel. So this is
> GENERIC + options VIMAGE + options DDB. I didn't get the panic when
> going to multiuser this time - but as soon as I did "sysctl -a" the
> expected panic came. Below is the result of the generated files in
> /var/crash (I unpacked the textdump.tar.4 file).
>
> Steinar Haug, Nethelp consulting, sthaug@nethelp.no
>
> ----------------------------------------------------------------------
>
> info.4
>
> Dump header from device /dev/ada0s1b
>    Architecture: i386
>    Architecture Version: 1
>    Dump Length: 71168B (0 MB)
>    Blocksize: 512
>    Dumptime: Sat Jan  3 21:26:03 2015
>    Hostname: verdi.nethelp.no
>    Magic: FreeBSD Text Dump
>    Version String: FreeBSD 10.1-STABLE #1 r276174: Sat Jan  3 20:50:10 CET 2015
>      root@verdi.nethelp.no:/usr/src/sys/i386/compile/GENERICV
>    Panic String: vm_fault: fault on nofault entry, addr: cc0e5000
>    Dump Parity: 1182659946
>    Bounds: 4
>    Dump Status: good
>
> ----------------------------------------------------------------------
>
> ddb.txt
>
> db:0:kdb.enter.panic>  run lockinfo
> db:1:lockinfo> show locks
> No such command
> db:1:locks>  show alllocks
> No such command
> db:1:alllocks>  show lockedvnods
> Locked vnodes
> db:0:kdb.enter.panic>  show pcpu
> cpuid        = 0
> dynamic pcpu = 0x3d3a00
> curthread    = 0xc769f310: pid 984 "sysctl"
> curpcb       = 0xf0923d40
> fpcurthread  = none
> idlethread   = 0xc6ac3000: tid 100003 "idle: cpu0"
> APIC ID      = 0
> currentldt   = 0x50
> curvnet      = 0xc69713c0
> db:0:kdb.enter.panic>  bt
> Tracing pid 984 tid 100105 td 0xc769f310
> kdb_enter(c11b2609,c11b2609,c11e064d,f09236ec,0,...) at kdb_enter+0x3d/frame 0xf09236a0
> panic(c11e064d,cc0e5000,1,f0923804,f09237f4,...) at panic+0x13f/frame 0xf09236e0
> vm_fault_hold(c1a6d000,cc0e5000,1,0,0,...) at vm_fault_hold+0x2076/frame 0xf0923840
> vm_fault(c1a6d000,cc0e5000,1,0,c0b72331,...) at vm_fault+0x81/frame 0xf0923868
> trap_pfault(cc0e5fb8,c1472000,f0923914,c6baf200,f09239a4,...) at trap_pfault+0x1bb/frame 0xf09238e8
> trap(f0923a34) at trap+0x674/frame 0xf0923a28
> calltrap() at calltrap+0x6/frame 0xf0923a28
> --- trap 0xc, eip = 0xc1049023, esp = 0xf0923a74, ebp = 0xf0923a9c ---
> copyout(f0923b28,cc0e5fb8,4,f0923acc,c142c7a8,...) at copyout+0x37/frame 0xf0923a9c
> sysctl_ip6_temppltime(c142c7a8,c6a9e3a8,0,f0923b28,f0923b28,...) at sysctl_ip6_temppltime+0x3a/frame 0xf0923ac0
> sysctl_root(f0923b28,8,2,c0a058a7,c7017850,...) at sysctl_root+0x2b1/frame 0xf0923b00
> userland_sysctl(c769f310,f0923bac,4,28803030,bfbfdb70,...) at userland_sysctl+0x1fa/frame 0xf0923b70
> sys___sysctl(c769f310,f0923ca8,2e,f0923c64,c0b329f2,...) at sys___sysctl+0x98/frame 0xf0923c18
> syscall(f0923ce8) at syscall+0x4a6/frame 0xf0923cdc
> Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf0923cdc
> --- syscall (202, FreeBSD ELF32, sys___sysctl), eip = 0x281a28b7, esp = 0xbfbfdb00, ebp = 0xbfbfdb28 ---
> db:0:kdb.enter.panic>  ps
>    pid  ppid  pgrp   uid   state   wmesg     wchan    cmd
>    984   980   984     0  R+      CPU 0               sysctl
>    980   972   980     0  S+      pause    0xc6f66934 csh
>    979     1   979     0  Ss+     ttyin    0xc6d4a870 getty
>    978     1   978     0  Ss+     ttyin    0xc6d4aa70 getty
>    977     1   977     0  Ss+     ttyin    0xc6d4ac70 getty
>    976     1   976     0  Ss+     ttyin    0xc6d4ae70 getty
>    975     1   975     0  Ss+     ttyin    0xc6d4c070 getty
>    974     1   974     0  Ss+     ttyin    0xc6d4c270 getty
>    973     1   973     0  Ss+     ttyin    0xc6baf070 getty
>    972     1   972     0  Ss+     wait     0xc6f655e0 login
>    967   965    17     0  S+      nanslp   0xc1515641 sleep
>    966     1    17     0  S+      piperd   0xc70377f8 logger
>    965     1    17     0  S+      wait     0xc729c8d0 sh
>    928     1   928     0  Ss      nanslp   0xc1515640 cron
>    924     1   924    25  Ss      pause    0xc729bc24 sendmail
>    921     1   921     0  Ss      select   0xc6fa0b24 sendmail
>    918     1   918     0  Ss      select   0xc6fd23e4 sshd
>    725     1   725     0  Ss      select   0xc6d57da4 syslogd
>    649     1   649     0  Ss      select   0xc6fa1524 devd
>     16     0     0     0  DL      vlruwt   0xc6f658d0 [vnlru]
>      9     0     0     0  DL      syncer   0xc15349c4 [syncer]
>      8     0     0     0  DL      (threaded)          [bufdaemon]
> 100080                   D       sdflush  0xc6fb6a84 [/var worker]
> 100079                   D       sdflush  0xc6fb6884 [/usr worker]
> 100066                   D       psleep   0xc1534104 [bufdaemon]
>      7     0     0     0  DL      pgzero   0xc1539320 [pagezero]
>      6     0     0     0  DL      psleep   0xc1539044 [vmdaemon]
>      5     0     0     0  DL      psleep   0xc1594604 [pagedaemon]
>      4     0     0     0  DL      waiting_ 0xc1592874 [sctp_iterator]
>      3     0     0     0  DL      -        0xc6baf83c [fdc0]
>     15     0     0     0  DL      (threaded)          [usb]
> 100053                   D       -        0xc6d09d34 [usbus4]
> 100052                   D       -        0xc6d09d04 [usbus4]
> 100051                   D       -        0xc6d09cd4 [usbus4]
> 100050                   D       -        0xc6d09ca4 [usbus4]
> 100049                   D       -        0xc6cf2dac [usbus3]
> 100048                   D       -        0xc6cf2d7c [usbus3]
> 100047                   D       -        0xc6cf2d4c [usbus3]
> 100046                   D       -        0xc6cf2d1c [usbus3]
> 100044                   D       -        0xc6cdbdac [usbus2]
> 100043                   D       -        0xc6cdbd7c [usbus2]
> 100042                   D       -        0xc6cdbd4c [usbus2]
> 100041                   D       -        0xc6cdbd1c [usbus2]
> 100039                   D       -        0xc6cc6dac [usbus1]
> 100038                   D       -        0xc6cc6d7c [usbus1]
> 100037                   D       -        0xc6cc6d4c [usbus1]
> 100036                   D       -        0xc6cc6d1c [usbus1]
> 100034                   D       -        0xc6ca9dac [usbus0]
> 100033                   D       -        0xc6ca9d7c [usbus0]
> 100032                   D       -        0xc6ca9d4c [usbus0]
> 100031                   D       -        0xc6ca9d1c [usbus0]
>      2     0     0     0  DL      (threaded)          [cam]
> 100062                   D       -        0xc1456928 [scanner]
> 100014                   D       -        0xc1456a80 [doneq0]
>     14     0     0     0  DL      -        0xc14717e0 [rand_harvestq]
>     13     0     0     0  DL      (threaded)          [geom]
> 100011                   D       -        0xc158ec60 [g_down]
> 100010                   D       -        0xc158ec5c [g_up]
> 100009                   D       -        0xc158ec58 [g_event]
>     12     0     0     0  WL      (threaded)          [intr]
> 100058                   I                           [irq1: atkbd0]
> 100057                   I                           [swi0: uart]
> 100055                   I                           [irq20: hpet0+]
> 100054                   I                           [irq14: ata0]
> 100045                   I                           [irq23: uhci3]
> 100040                   I                           [irq18: uhci2]
> 100035                   I                           [irq22: uhci1]
> 100030                   I                           [irq21: uhci0 ehci0]
> 100029                   I                           [irq17: bge1]
> 100028                   I                           [irq16: bge0]
> 100018                   I                           [swi5: fast taskq]
> 100016                   I                           [swi6: Giant taskq]
> 100015                   I                           [swi6: task queue]
> 100008                   I                           [swi4: clock]
> 100007                   I                           [swi4: clock]
> 100006                   I                           [swi3: vm]
> 100005                   I                           [swi1: netisr 0]
>     11     0     0     0  RL      (threaded)          [idle]
> 100004                   Run     CPU 1               [idle: cpu1]
> 100003                   CanRun                      [idle: cpu0]
>      1     0     1     0  SLs     wait     0xc6ac02f0 [init]
>     10     0     0     0  DL      audit_wo 0xc1592f14 [audit]
>      0     0     0     0  DLs     (threaded)          [kernel]
> 100061                   D       -        0xc6ac5380 [CAM taskq]
> 100059                   D       -        0xc6d46200 [mca taskq]
> 100027                   D       -        0xc6c28e00 [em1 txq]
> 100026                   D       -        0xc6c28e80 [em1 que]
> 100025                   D       -        0xc6c29200 [em0 txq]
> 100024                   D       -        0xc6c29280 [em0 que]
> 100023                   D       -        0xc6ac4480 [acpi_task_2]
> 100022                   D       -        0xc6ac4480 [acpi_task_1]
> 100021                   D       -        0xc6ac4480 [acpi_task_0]
> 100020                   D       -        0xc6ac4500 [ffs_trim taskq]
> 100019                   D       -        0xc6ac4580 [kqueue taskq]
> 100017                   D       -        0xc6ac4700 [thread taskq]
> 100012                   D       -        0xc6ac5a80 [firmware taskq]
> 100000                   D       swapin   0xc158ece4 [swapper]
> db:0:kdb.enter.panic>  alltrace
>
> Tracing command sysctl pid 984 tid 100105 td 0xc769f310
> kdb_enter(c11b2609,c11b2609,c11e064d,f09236ec,0,...) at kdb_enter+0x3d/frame 0xf09236a0
> panic(c11e064d,cc0e5000,1,f0923804,f09237f4,...) at panic+0x13f/frame 0xf09236e0
> vm_fault_hold(c1a6d000,cc0e5000,1,0,0,...) at vm_fault_hold+0x2076/frame 0xf0923840
> vm_fault(c1a6d000,cc0e5000,1,0,c0b72331,...) at vm_fault+0x81/frame 0xf0923868
> trap_pfault(cc0e5fb8,c1472000,f0923914,c6baf200,f09239a4,...) at trap_pfault+0x1bb/frame 0xf09238e8
> trap(f0923a34) at trap+0x674/frame 0xf0923a28
> calltrap() at calltrap+0x6/frame 0xf0923a28
> --- trap 0xc, eip = 0xc1049023, esp = 0xf0923a74, ebp = 0xf0923a9c ---
> copyout(f0923b28,cc0e5fb8,4,f0923acc,c142c7a8,...) at copyout+0x37/frame 0xf0923a9c
> sysctl_ip6_temppltime(c142c7a8,c6a9e3a8,0,f0923b28,f0923b28,...) at sysctl_ip6_temppltime+0x3a/frame 0xf0923ac0
> sysctl_root(f0923b28,8,2,c0a058a7,c7017850,...) at sysctl_root+0x2b1/frame 0xf0923b00
> userland_sysctl(c769f310,f0923bac,4,28803030,bfbfdb70,...) at userland_sysctl+0x1fa/frame 0xf0923b70
> sys___sysctl(c769f310,f0923ca8,2e,f0923c64,c0b329f2,...) at sys___sysctl+0x98/frame 0xf0923c18
> syscall(f0923ce8) at syscall+0x4a6/frame 0xf0923cdc
> Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf0923cdc
> --- syscall (202, FreeBSD ELF32, sys___sysctl), eip = 0x281a28b7, esp = 0xbfbfdb00, ebp = 0xbfbfdb28 ---
>
> Tracing command csh pid 980 tid 100104 td 0xc6f69930
> sched_switch(c6f69930,0,104,c0b0edad,0,...) at sched_switch+0x2d2/frame 0xf091fa7c
> mi_switch(104,0,c0b134a4,c0b0edad,c1a69000,c6f69930) at mi_switch+0x122/frame 0xf091fab4
> sleepq_switch(c6f69930,0,c11b698a,1a8,0,...) at sleepq_switch+0x15b/frame 0xf091fadc
> sleepq_catch_signals(0,c11b698a,154,c6f69930,f091fba4,...) at sleepq_catch_signals+0x5be/frame 0xf091fb30
> sleepq_wait_sig(c6f66934,74,c10a57b4,100,0,...) at sleepq_wait_sig+0x14/frame 0xf091fb5c
> _sleep(c6f66934,c6f66968,174,c10a57b4,0,...) at _sleep+0x29b/frame 0xf091fba4
> kern_sigsuspend(c6f69930,0,0,0,0,...) at kern_sigsuspend+0x137/frame 0xf091fbe8
> sys_sigsuspend(c6f69930,f091fca8,fffffed8,0,0,...) at sys_sigsuspend+0x58/frame 0xf091fc18
> syscall(f091fce8) at syscall+0x4a6/frame 0xf091fcdc
> Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf091fcdc
> --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x28176fbb, esp = 0xbfbfe374, ebp = 0xbfbfe3dc ---
>
> Tracing command getty pid 979 tid 100103 td 0xc6f69c40
> sched_switch(c6f69c40,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xf091b984
> mi_switch(104,0,c0b134a4,0,f091ba0c,c6f69c40) at mi_switch+0x122/frame 0xf091b9bc
> sleepq_switch(c6f69c40,0,c11b698a,1a8,c6d48200,...) at sleepq_switch+0x15b/frame 0xf091b9e4
> sleepq_catch_signals(0,c11b698a,154,c6d48200,c154e760,...) at sleepq_catch_signals+0x5be/frame 0xf091ba38
> sleepq_wait_sig(c6d4a870,0,c11b907b,101,0,...) at sleepq_wait_sig+0x14/frame 0xf091ba64
> _cv_wait_sig(c6d4a870,c158f610,1,1,f091baec,...) at _cv_wait_sig+0x17c/frame 0xf091ba94
> tty_wait(c6d4a800,c6d4a870,f091bbe8,1,0,...) at tty_wait+0x1f/frame 0xf091baac
> ttydisc_read(c6d4a800,f091bbe8,0,c0be7ba0,c7017578,...) at ttydisc_read+0x31c/frame 0xf091baec
> ttydev_read(c6d19700,f091bbe8,0,f091bb40,c6f69c40,...) at ttydev_read+0x8f/frame 0xf091bb10
> devfs_read_f(c7017578,f091bbe8,c6fa9580,0,c6f69c40,...) at devfs_read_f+0xb4/frame 0xf091bb48
> dofileread(c7017578,f091bbe8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xf091bb80
> kern_readv(c6f69c40,0,f091bbe8,0,bfbfedf7,...) at kern_readv+0x96/frame 0xf091bbc8
> sys_read(c6f69c40,f091bca8,c6f66bc0,f091bc64,c0b329f2,...) at sys_read+0x5c/frame 0xf091bc18
> syscall(f091bce8) at syscall+0x4a6/frame 0xf091bcdc
> Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf091bcdc
> --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b52b7, esp = 0xbfbfeddc, ebp = 0xbfbfee08 ---
>
> Tracing command getty pid 978 tid 100102 td 0xc71b8000
> sched_switch(c71b8000,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xf0917984
> mi_switch(104,0,c0b134a4,0,f0917a0c,c71b8000) at mi_switch+0x122/frame 0xf09179bc
> sleepq_switch(c71b8000,0,c11b698a,1a8,c6d48400,...) at sleepq_switch+0x15b/frame 0xf09179e4
> sleepq_catch_signals(0,c11b698a,154,c6d48400,c154e760,...) at sleepq_catch_signals+0x5be/frame 0xf0917a38
> sleepq_wait_sig(c6d4aa70,0,c11b907b,101,0,...) at sleepq_wait_sig+0x14/frame 0xf0917a64
> _cv_wait_sig(c6d4aa70,c158f610,1,1,f0917aec,...) at _cv_wait_sig+0x17c/frame 0xf0917a94
> tty_wait(c6d4aa00,c6d4aa70,f0917be8,1,0,...) at tty_wait+0x1f/frame 0xf0917aac
> ttydisc_read(c6d4aa00,f0917be8,0,c0be7ba0,c7017508,...) at ttydisc_read+0x31c/frame 0xf0917aec
> ttydev_read(c6d19800,f0917be8,0,f0917b40,c71b8000,...) at ttydev_read+0x8f/frame 0xf0917b10
> devfs_read_f(c7017508,f0917be8,c74b4380,0,c71b8000,...) at devfs_read_f+0xb4/frame 0xf0917b48
> dofileread(c7017508,f0917be8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xf0917b80
> kern_readv(c71b8000,0,f0917be8,0,bfbfedf7,...) at kern_readv+0x96/frame 0xf0917bc8
> sys_read(c71b8000,f0917ca8,c729b000,c71b8000,c71bac40,...) at sys_read+0x5c/frame 0xf0917c18
> syscall(f0917ce8) at syscall+0x4a6/frame 0xf0917cdc
> Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf0917cdc
> --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b52b7, esp = 0xbfbfeddc, ebp = 0xbfbfee08 ---
>
> Tracing command getty pid 977 tid 100101 td 0xc71b8310
> sched_switch(c71b8310,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xf0913984
> mi_switch(104,0,c0b134a4,0,f0913a0c,c71b8310) at mi_switch+0x122/frame 0xf09139bc
> sleepq_switch(c71b8310,0,c11b698a,1a8,c6d48600,...) at sleepq_switch+0x15b/frame 0xf09139e4
> sleepq_catch_signals(0,c11b698a,154,c6d48600,c154e760,...) at sleepq_catch_signals+0x5be/frame 0xf0913a38
> sleepq_wait_sig(c6d4ac70,0,c11b907b,101,0,...) at sleepq_wait_sig+0x14/frame 0xf0913a64
> _cv_wait_sig(c6d4ac70,c158f610,1,1,f0913aec,...) at _cv_wait_sig+0x17c/frame 0xf0913a94
> tty_wait(c6d4ac00,c6d4ac70,f0913be8,1,0,...) at tty_wait+0x1f/frame 0xf0913aac
> ttydisc_read(c6d4ac00,f0913be8,0,0,0,...) at ttydisc_read+0x31c/frame 0xf0913aec
> ttydev_read(c6d19900,f0913be8,0,f0913b40,c71b8310,...) at ttydev_read+0x8f/frame 0xf0913b10
> devfs_read_f(c7017690,f0913be8,c74b4400,0,c71b8310,...) at devfs_read_f+0xb4/frame 0xf0913b48
> dofileread(c7017690,f0913be8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xf0913b80
> kern_readv(c71b8310,0,f0913be8,0,bfbfedf7,...) at kern_readv+0x96/frame 0xf0913bc8
> sys_read(c71b8310,f0913ca8,c729b2f0,f0913c64,c0b329f2,...) at sys_read+0x5c/frame 0xf0913c18
> syscall(f0913ce8) at syscall+0x4a6/frame 0xf0913cdc
> Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf0913cdc
> --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b52b7, esp = 0xbfbfeddc, ebp = 0xbfbfee08 ---
>
> Tracing command getty pid 976 tid 100085 td 0xc72cc620
> sched_switch(c72cc620,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xf0895984
> mi_switch(104,0,c0b134a4,0,f0895a0c,c72cc620) at mi_switch+0x122/frame 0xf08959bc
> sleepq_switch(c72cc620,0,c11b698a,1a8,c6d48800,...) at sleepq_switch+0x15b/frame 0xf08959e4
> sleepq_catch_signals(0,c11b698a,154,c6d48800,c154e760,...) at sleepq_catch_signals+0x5be/frame 0xf0895a38
> sleepq_wait_sig(c6d4ae70,0,c11b907b,101,0,...) at sleepq_wait_sig+0x14/frame 0xf0895a64
> _cv_wait_sig(c6d4ae70,c158f610,1,1,f0895aec,...) at _cv_wait_sig+0x17c/frame 0xf0895a94
> tty_wait(c6d4ae00,c6d4ae70,f0895be8,1,0,...) at tty_wait+0x1f/frame 0xf0895aac
> ttydisc_read(c6d4ae00,f0895be8,0,c0be7ba0,c702e038,...) at ttydisc_read+0x31c/frame 0xf0895aec
> ttydev_read(c6d19a00,f0895be8,0,f0895b40,c72cc620,...) at ttydev_read+0x8f/frame 0xf0895b10
> devfs_read_f(c702e038,f0895be8,c74b4480,0,c72cc620,...) at devfs_read_f+0xb4/frame 0xf0895b48
> dofileread(c702e038,f0895be8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xf0895b80
> kern_readv(c72cc620,0,f0895be8,0,bfbfedf7,...) at kern_readv+0x96/frame 0xf0895bc8
> sys_read(c72cc620,f0895ca8,c72c2000,f0895c64,c0b329f2,...) at sys_read+0x5c/frame 0xf0895c18
> syscall(f0895ce8) at syscall+0x4a6/frame 0xf0895cdc
> Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf0895cdc
> --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b52b7, esp = 0xbfbfeddc, ebp = 0xbfbfee08 ---
>
> Tracing command getty pid 975 tid 100094 td 0xc71bac40
> sched_switch(c71bac40,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xf08c8984
> mi_switch(104,0,c0b134a4,0,f08c8a0c,c71bac40) at mi_switch+0x122/frame 0xf08c89bc
> sleepq_switch(c71bac40,0,c11b698a,1a8,c6d48a00,...) at sleepq_switch+0x15b/frame 0xf08c89e4
> sleepq_catch_signals(0,c11b698a,154,c6d48a00,c154e760,...) at sleepq_catch_signals+0x5be/frame 0xf08c8a38
> sleepq_wait_sig(c6d4c070,0,c11b907b,101,0,...) at sleepq_wait_sig+0x14/frame 0xf08c8a64
> _cv_wait_sig(c6d4c070,c158f610,1,1,f08c8aec,...) at _cv_wait_sig+0x17c/frame 0xf08c8a94
> tty_wait(c6d4c000,c6d4c070,f08c8be8,1,0,...) at tty_wait+0x1f/frame 0xf08c8aac
> ttydisc_read(c6d4c000,f08c8be8,0,c0be7ba0,c70175b0,...) at ttydisc_read+0x31c/frame 0xf08c8aec
> ttydev_read(c6d19b00,f08c8be8,0,f08c8b40,c71bac40,...) at ttydev_read+0x8f/frame 0xf08c8b10
> devfs_read_f(c70175b0,f08c8be8,c6fa9500,0,c71bac40,...) at devfs_read_f+0xb4/frame 0xf08c8b48
> dofileread(c70175b0,f08c8be8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xf08c8b80
> kern_readv(c71bac40,0,f08c8be8,0,bfbfedf7,...) at kern_readv+0x96/frame 0xf08c8bc8
> sys_read(c71bac40,f08c8ca8,c72c05e0,1,c6f67930,...) at sys_read+0x5c/frame 0xf08c8c18
> syscall(f08c8ce8) at syscall+0x4a6/frame 0xf08c8cdc
> Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf08c8cdc
> --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b52b7, esp = 0xbfbfeddc, ebp = 0xbfbfee08 ---
>
> Tracing command getty pid 974 tid 100075 td 0xc6f67930
> sched_switch(c6f67930,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xee3bf984
> mi_switch(104,0,c0b134a4,0,ee3bfa0c,c6f67930) at mi_switch+0x122/frame 0xee3bf9bc
> sleepq_switch(c6f67930,0,c11b698a,1a8,c6d48c00,...) at sleepq_switch+0x15b/frame 0xee3bf9e4
> sleepq_catch_signals(0,c11b698a,154,c6d48c00,c154e760,...) at sleepq_catch_signals+0x5be/frame 0xee3bfa38
> sleepq_wait_sig(c6d4c270,0,c11b907b,101,0,...) at sleepq_wait_sig+0x14/frame 0xee3bfa64
> _cv_wait_sig(c6d4c270,c158f610,1,1,ee3bfaec,...) at _cv_wait_sig+0x17c/frame 0xee3bfa94
> tty_wait(c6d4c200,c6d4c270,ee3bfbe8,1,0,...) at tty_wait+0x1f/frame 0xee3bfaac
> ttydisc_read(c6d4c200,ee3bfbe8,0,c0be7ba0,c7017540,...) at ttydisc_read+0x31c/frame 0xee3bfaec
> ttydev_read(c6d19c00,ee3bfbe8,0,ee3bfb40,c6f67930,...) at ttydev_read+0x8f/frame 0xee3bfb10
> devfs_read_f(c7017540,ee3bfbe8,c6fa9480,0,c6f67930,...) at devfs_read_f+0xb4/frame 0xee3bfb48
> dofileread(c7017540,ee3bfbe8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xee3bfb80
> kern_readv(c6f67930,0,ee3bfbe8,0,bfbfedf7,...) at kern_readv+0x96/frame 0xee3bfbc8
> sys_read(c6f67930,ee3bfca8,c6f642f0,1,c72cc620,...) at sys_read+0x5c/frame 0xee3bfc18
> syscall(ee3bfce8) at syscall+0x4a6/frame 0xee3bfcdc
> Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3bfcdc
> --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b52b7, esp = 0xbfbfeddc, ebp = 0xbfbfee08 ---
>
> Tracing command getty pid 973 tid 100076 td 0xc6f67620
> sched_switch(c6f67620,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xee3c2984
> mi_switch(104,0,c0b134a4,0,ee3c2a0c,c6f67620) at mi_switch+0x122/frame 0xee3c29bc
> sleepq_switch(c6f67620,0,c11b698a,1a8,c6bafe00,...) at sleepq_switch+0x15b/frame 0xee3c29e4
> sleepq_catch_signals(0,c11b698a,154,c6bafe00,c154e760,...) at sleepq_catch_signals+0x5be/frame 0xee3c2a38
> sleepq_wait_sig(c6baf070,0,c11b907b,101,0,...) at sleepq_wait_sig+0x14/frame 0xee3c2a64
> _cv_wait_sig(c6baf070,c158f610,1,1,ee3c2aec,...) at _cv_wait_sig+0x17c/frame 0xee3c2a94
> tty_wait(c6baf000,c6baf070,ee3c2be8,1,0,...) at tty_wait+0x1f/frame 0xee3c2aac
> ttydisc_read(c6baf000,ee3c2be8,0,c0be7ba0,c70174d0,...) at ttydisc_read+0x31c/frame 0xee3c2aec
> ttydev_read(c6d19d00,ee3c2be8,0,ee3c2b40,c6f67620,...) at ttydev_read+0x8f/frame 0xee3c2b10
> devfs_read_f(c70174d0,ee3c2be8,c6fa9400,0,c6f67620,...) at devfs_read_f+0xb4/frame 0xee3c2b48
> dofileread(c70174d0,ee3c2be8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xee3c2b80
> kern_readv(c6f67620,0,ee3c2be8,0,bfbfedf7,...) at kern_readv+0x96/frame 0xee3c2bc8
> sys_read(c6f67620,ee3c2ca8,c6f64000,1,c0b329f2,...) at sys_read+0x5c/frame 0xee3c2c18
> syscall(ee3c2ce8) at syscall+0x4a6/frame 0xee3c2cdc
> Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3c2cdc
> --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b52b7, esp = 0xbfbfeddc, ebp = 0xbfbfee08 ---
>
> Tracing command login pid 972 tid 100069 td 0xc6f68c40
> sched_switch(c6f68c40,0,104,c0dea0cc,0,...) at sched_switch+0x2d2/frame 0xee3aa960
> mi_switch(104,0,c315c7c4,3,2,c6f68c40) at mi_switch+0x122/frame 0xee3aa998
> sleepq_switch(c6f68c40,0,c11b698a,1a8,0,...) at sleepq_switch+0x15b/frame 0xee3aa9c0
> sleepq_catch_signals(0,c11b698a,154,c6f68c40,ee3aaa44,...) at sleepq_catch_signals+0x5be/frame 0xee3aaa14
> sleepq_wait_sig(c6f655e0,6c,c11b77f6,100,0,...) at sleepq_wait_sig+0x14/frame 0xee3aaa40
> _sleep(c6f655e0,c6f65678,16c,c11b77f6,0,...) at _sleep+0x29b/frame 0xee3aaa88
> kern_wait6(c6f68c40,0,3d4,0,ee3aab24,...) at kern_wait6+0x725/frame 0xee3aaaf8
> sys_wait4(c6f68c40,ee3aaca8,c6f655e0,4,c088707e,...) at sys_wait4+0x94/frame 0xee3aac18
> syscall(ee3aace8) at syscall+0x4a6/frame 0xee3aacdc
> Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3aacdc
> --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2811c143, esp = 0xbfbfed20, ebp = 0xbfbfed38 ---
>
> Tracing command sleep pid 967 tid 100077 td 0xc6f67310
> sched_switch(c6f67310,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xee3caa4c
> mi_switch(104,0,c0b40637,1,c7293444,c6f67310) at mi_switch+0x122/frame 0xee3caa84
> sleepq_switch(c6f67310,0,c11b698a,1a8,4a,...) at sleepq_switch+0x15b/frame 0xee3caaac
> sleepq_catch_signals(c0000000,3,c0b72670,c6f67310,1,...) at sleepq_catch_signals+0x5be/frame 0xee3cab00
> sleepq_timedwait_sig(c1515641,6c,4a,c0000000,3,...) at sleepq_timedwait_sig+0x14/frame 0xee3cab30
> _sleep(c1515641,0,16c,c11b32c4,a1dea2f,...) at _sleep+0x26b/frame 0xee3cab78
> kern_nanosleep(bfbfee40,ee3cabf0,ee3cabf8,ee3cace8,3c,...) at kern_nanosleep+0x14b/frame 0xee3cabd8
> sys_nanosleep(c6f67310,ee3caca8,c6ac0bc0,c6f67310,c71b9930,...) at sys_nanosleep+0x69/frame 0xee3cac18
> syscall(ee3cace8) at syscall+0x4a6/frame 0xee3cacdc
> Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3cacdc
> --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2817b203, esp = 0xbfbfee0c, ebp = 0xbfbfee54 ---
>
> Tracing command logger pid 966 tid 100074 td 0xc6f67c40
> sched_switch(c6f67c40,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xee3bb9dc
> mi_switch(104,0,c0b134a4,0,0,c6f67c40) at mi_switch+0x122/frame 0xee3bba14
> sleepq_switch(c6f67c40,0,c11b698a,1a8,ee3bbaa0,...) at sleepq_switch+0x15b/frame 0xee3bba3c
> sleepq_catch_signals(0,c11b698a,154,0,0,...) at sleepq_catch_signals+0x5be/frame 0xee3bba90
> sleepq_wait_sig(c70377f8,5c,c11b7397,100,0,...) at sleepq_wait_sig+0x14/frame 0xee3bbabc
> _sleep(c70377f8,c7037978,15c,c11b7397,0,...) at _sleep+0x29b/frame 0xee3bbb04
> pipe_read(c70175e8,ee3bbbe8,c6ff5c80,0,c6f67c40,...) at pipe_read+0x33a/frame 0xee3bbb48
> dofileread(c70175e8,ee3bbbe8,ffffffff,ffffffff,0,...) at dofileread+0x9e/frame 0xee3bbb80
> kern_readv(c6f67c40,0,ee3bbbe8,0,28808000,...) at kern_readv+0x96/frame 0xee3bbbc8
> sys_read(c6f67c40,ee3bbca8,c6f645e0,1,c6f67310,...) at sys_read+0x5c/frame 0xee3bbc18
> syscall(ee3bbce8) at syscall+0x4a6/frame 0xee3bbcdc
> Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3bbcdc
> --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a02b7, esp = 0xbfbfe958, ebp = 0xbfbfe96c ---
>
> Tracing command sh pid 965 tid 100081 td 0xc71b9930
> sched_switch(c71b9930,0,104,ee3e19d0,0,...) at sched_switch+0x2d2/frame 0xee3e1960
> mi_switch(104,0,c7294818,0,0,c71b9930) at mi_switch+0x122/frame 0xee3e1998
> sleepq_switch(c71b9930,0,c11b698a,1a8,c71b9930,...) at sleepq_switch+0x15b/frame 0xee3e19c0
> sleepq_catch_signals(0,c11b698a,154,c71b9930,ee3e1a44,...) at sleepq_catch_signals+0x5be/frame 0xee3e1a14
> sleepq_wait_sig(c729c8d0,6c,c11b77f6,100,0,...) at sleepq_wait_sig+0x14/frame 0xee3e1a40
> _sleep(c729c8d0,c729c968,16c,c11b77f6,0,...) at _sleep+0x29b/frame 0xee3e1a88
> kern_wait6(c71b9930,7,0,0,ee3e1b24,...) at kern_wait6+0x725/frame 0xee3e1af8
> sys_wait4(c71b9930,ee3e1ca8,fffffed8,0,0,...) at sys_wait4+0x94/frame 0xee3e1c18
> syscall(ee3e1ce8) at syscall+0x4a6/frame 0xee3e1cdc
> Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3e1cdc
> --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815d143, esp = 0xbfbfdd48, ebp = 0xbfbfdd60 ---
>
> Tracing command cron pid 928 tid 100100 td 0xc71b8620
> sched_switch(c71b8620,0,104,c0b4103a,f0908a70,...) at sched_switch+0x2d2/frame 0xf0908a4c
> mi_switch(104,0,c0b40637,0,0,c71b8620) at mi_switch+0x122/frame 0xf0908a84
> sleepq_switch(c71b8620,0,c11b698a,1a8,6b,...) at sleepq_switch+0x15b/frame 0xf0908aac
> sleepq_catch_signals(bfd19a33,3,c0b72670,c71b8620,0,...) at sleepq_catch_signals+0x5be/frame 0xf0908b00
> sleepq_timedwait_sig(c1515640,6c,6b,bfd19a33,3,...) at sleepq_timedwait_sig+0x14/frame 0xf0908b30
> _sleep(c1515640,0,16c,c11b32c4,3380bb39,...) at _sleep+0x26b/frame 0xf0908b78
> kern_nanosleep(bfbfee28,f0908bf0,f0908bf8,f0908ce8,3b,...) at kern_nanosleep+0x14b/frame 0xf0908bd8
> sys_nanosleep(c71b8620,f0908ca8,c729b5e0,1,0,...) at sys_nanosleep+0x69/frame 0xf0908c18
> syscall(f0908ce8) at syscall+0x4a6/frame 0xf0908cdc
> Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf0908cdc
> --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2819f203, esp = 0xbfbfecb4, ebp = 0xbfbfee44 ---
>
> Tracing command sendmail pid 924 tid 100098 td 0xc71b8c40
> sched_switch(c71b8c40,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xf08e5a7c
> mi_switch(104,0,c0b134a4,0,0,c71b8c40) at mi_switch+0x122/frame 0xf08e5ab4
> sleepq_switch(c71b8c40,0,c11b698a,1a8,0,...) at sleepq_switch+0x15b/frame 0xf08e5adc
> sleepq_catch_signals(0,c11b698a,154,c71b8c40,f08e5ba4,...) at sleepq_catch_signals+0x5be/frame 0xf08e5b30
> sleepq_wait_sig(c729bc24,74,c10a57b4,100,0,...) at sleepq_wait_sig+0x14/frame 0xf08e5b5c
> _sleep(c729bc24,c729bc58,174,c10a57b4,0,...) at _sleep+0x29b/frame 0xf08e5ba4
> kern_sigsuspend(c71b8c40,0,0,0,0,...) at kern_sigsuspend+0x137/frame 0xf08e5be8
> sys_sigsuspend(c71b8c40,f08e5ca8,c729bbc0,c71b8c40,c72cc930,...) at sys_sigsuspend+0x58/frame 0xf08e5c18
> syscall(f08e5ce8) at syscall+0x4a6/frame 0xf08e5cdc
> Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf08e5cdc
> --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2836bfbb, esp = 0xbfbfd9cc, ebp = 0xbfbfd9f8 ---
>
> Tracing command sendmail pid 921 tid 100099 td 0xc71b8930
> sched_switch(c71b8930,0,104,ac,0,...) at sched_switch+0x2d2/frame 0xf08e88d8
> mi_switch(104,0,f08e898c,c0b134a4,2845a000,c71b8930) at mi_switch+0x122/frame 0xf08e8910
> sleepq_switch(c71b8930,0,c11b698a,1a8,f11734f8,...) at sleepq_switch+0x15b/frame 0xf08e8938
> sleepq_catch_signals(50000000,0,c0b72670,c71b8930,1,...) at sleepq_catch_signals+0x5be/frame 0xf08e898c
> sleepq_timedwait_sig(c6fa0b24,0,30,50000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf08e89bc
> _cv_timedwait_sig_sbt(c6fa0b24,c6fa0b10,f11734f8,30,50000000,...) at _cv_timedwait_sig_sbt+0x1a7/frame 0xf08e89f0
> seltdwait(30,50000000,0,c71b8930,f08e8ba0,...) at seltdwait+0xc1/frame 0xf08e8a28
> kern_select(c71b8930,4,bfbfcfb8,0,0,...) at kern_select+0x8c2/frame 0xf08e8bd0
> sys_select(c71b8930,f08e8ca8,c729b8d0,4,c088707e,...) at sys_select+0x69/frame 0xf08e8c18
> syscall(f08e8ce8) at syscall+0x4a6/frame 0xf08e8cdc
> Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf08e8cdc
> --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28444277, esp = 0xbfbfcf1c, ebp = 0xbfbfd9d8 ---
>
> Tracing command sshd pid 918 tid 100072 td 0xc6f68310
> sched_switch(c6f68310,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xee3b48e0
> mi_switch(104,0,0,0,40a,c6f68310) at mi_switch+0x122/frame 0xee3b4918
> sleepq_switch(c6f68310,0,c11b698a,1a8,0,...) at sleepq_switch+0x15b/frame 0xee3b4940
> sleepq_catch_signals(0,c11b698a,154,ee3b4ba8,ee3b49d4,...) at sleepq_catch_signals+0x5be/frame 0xee3b4994
> sleepq_wait_sig(c6fd23e4,0,c11ecb42,101,0,...) at sleepq_wait_sig+0x14/frame 0xee3b49c0
> _cv_wait_sig(c6fd23e4,c6fd23d0,c702dcb0,c6f68310,ee3b4a28,...) at _cv_wait_sig+0x17c/frame 0xee3b49f0
> seltdwait(ffffffff,0,0,c6f68310,ee3b4ba0,...) at seltdwait+0xcf/frame 0xee3b4a28
> kern_select(c6f68310,5,28c0c158,0,0,...) at kern_select+0x8c2/frame 0xee3b4bd0
> sys_select(c6f68310,ee3b4ca8,c6f64bc0,c6f68310,c72cc930,...) at sys_select+0x69/frame 0xee3b4c18
> syscall(ee3b4ce8) at syscall+0x4a6/frame 0xee3b4cdc
> Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3b4cdc
> --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28636277, esp = 0xbfbfe43c, ebp = 0xbfbfe460 ---
>
> Tracing command syslogd pid 725 tid 100084 td 0xc72cc930
> sched_switch(c72cc930,0,104,c152191c,0,...) at sched_switch+0x2d2/frame 0xee3fb8e0
> mi_switch(104,0,ee3fb950,c0af7134,c6d23930,c72cc930) at mi_switch+0x122/frame 0xee3fb918
> sleepq_switch(c72cc930,0,c11b698a,1a8,c6aa5e3c,...) at sleepq_switch+0x15b/frame 0xee3fb940
> sleepq_catch_signals(0,c11b698a,154,ee3fba28,c1036475,...) at sleepq_catch_signals+0x5be/frame 0xee3fb994
> sleepq_wait_sig(c6d57da4,0,c11ecb42,101,0,...) at sleepq_wait_sig+0x14/frame 0xee3fb9c0
> _cv_wait_sig(c6d57da4,c6d57d90,c0a05c9b,c69a4000,0,...) at _cv_wait_sig+0x17c/frame 0xee3fb9f0
> seltdwait(ffffffff,0,0,c72cc930,ee3fbba0,...) at seltdwait+0xcf/frame 0xee3fba28
> kern_select(c72cc930,9,28834118,0,0,...) at kern_select+0x8c2/frame 0xee3fbbd0
> sys_select(c72cc930,ee3fbca8,804c210,c74c5000,0,...) at sys_select+0x69/frame 0xee3fbc18
> syscall(ee3fbce8) at syscall+0x4a6/frame 0xee3fbcdc
> Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3fbcdc
> --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281b8277, esp = 0xbfbfdea4, ebp = 0xbfbfee34 ---
>
> Tracing command devd pid 649 tid 100071 td 0xc6f68620
> sched_switch(c6f68620,0,104,ac,98,...) at sched_switch+0x2d2/frame 0xee3b18d8
> mi_switch(104,0,0,c0b134a4,0,c6f68620) at mi_switch+0x122/frame 0xee3b1910
> sleepq_switch(c6f68620,0,c11b698a,1a8,4127f8c6,...) at sleepq_switch+0x15b/frame 0xee3b1938
> sleepq_catch_signals(c0000000,3,c0b72670,c6f68620,0,...) at sleepq_catch_signals+0x5be/frame 0xee3b198c
> sleepq_timedwait_sig(c6fa1524,0,48,c0000000,3,...) at sleepq_timedwait_sig+0x14/frame 0xee3b19bc
> _cv_timedwait_sig_sbt(c6fa1524,c6fa1510,4127f8c6,48,c0000000,...) at _cv_timedwait_sig_sbt+0x1a7/frame 0xee3b19f0
> seltdwait(48,c0000000,3,c6f68620,ee3b1ba0,...) at seltdwait+0xc1/frame 0xee3b1a28
> kern_select(c6f68620,6,bfbfcda0,0,0,...) at kern_select+0x8c2/frame 0xee3b1bd0
> sys_select(c6f68620,ee3b1ca8,c6f65000,4,c088707e,...) at sys_select+0x69/frame 0xee3b1c18
> syscall(ee3b1ce8) at syscall+0x4a6/frame 0xee3b1cdc
> Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xee3b1cdc
> --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x8097703, esp = 0xbfbfcd3c, ebp = 0xbfbfee54 ---
>
> Tracing command vnlru pid 16 tid 100068 td 0xc6f69000
> sched_switch(c6f69000,0,104,0,36254e5d,...) at sched_switch+0x2d2/frame 0xee3a6b5c
> mi_switch(104,0,101,c6f69000,ee3a6be8,c6f658d0) at mi_switch+0x122/frame 0xee3a6b94
> sleepq_switch(c6f69000,0,c11b698a,28b,101,...) at sleepq_switch+0x15b/frame 0xee3a6bbc
> sleepq_timedwait(c6f658d0,60,0,0,0,...) at sleepq_timedwait+0x3f/frame 0xee3a6be8
> _sleep(c6f658d0,c1534980,260,c11bd97c,fffffed8,...) at _sleep+0x282/frame 0xee3a6c30
> vnlru_proc(0,ee3a6ce8,0,0,0,...) at vnlru_proc+0xcf/frame 0xee3a6ca4
> fork_exit(c0bdb7e0,0,ee3a6ce8) at fork_exit+0xa3/frame 0xee3a6cd4
> fork_trampoline() at fork_trampoline+0x8/frame 0xee3a6cd4
> --- trap 0, eip = 0, esp = 0xee3a6d20, ebp = 0 ---
>
> Tracing command syncer pid 9 tid 100067 td 0xc6f69310
> sched_switch(c6f69310,0,104,36254e5d,0,...) at sched_switch+0x2d2/frame 0xee3a3b68
> mi_switch(104,0,101,c6f69310,ee3a3bf4,c15349c4) at mi_switch+0x122/frame 0xee3a3ba0
> sleepq_switch(c6f69310,0,c11b698a,28b,101,...) at sleepq_switch+0x15b/frame 0xee3a3bc8
> sleepq_timedwait(c15349c4,0,0,0,0,...) at sleepq_timedwait+0x3f/frame 0xee3a3bf4
> _cv_timedwait_sbt(c15349c4,c15349a4,fffffed8,0,0,...) at _cv_timedwait_sbt+0x1a7/frame 0xee3a3c28
> sched_sync(0,ee3a3ce8,0,0,0,...) at sched_sync+0x7a1/frame 0xee3a3ca4
> fork_exit(c0bdaea0,0,ee3a3ce8) at fork_exit+0xa3/frame 0xee3a3cd4
> fork_trampoline() at fork_trampoline+0x8/frame 0xee3a3cd4
> --- trap 0, eip = 0, esp = 0xee3a3d20, ebp = 0 ---
>
> Tracing command bufdaemon pid 8 tid 100080 td 0xc71b9c40
> sched_switch(c71b9c40,0,104,0,e9db9457,...) at sched_switch+0x2d2/frame 0xee3d3b8c
> mi_switch(104,0,101,c71b9c40,ee3d3c18,c6fb6a84) at mi_switch+0x122/frame 0xee3d3bc4
> sleepq_switch(c71b9c40,0,c11b698a,28b,101,...) at sleepq_switch+0x15b/frame 0xee3d3bec
> sleepq_timedwait(c6fb6a84,54,0,0,0,...) at sleepq_timedwait+0x3f/frame 0xee3d3c18
> _sleep(c6fb6a84,c6fb6a00,54,c11de1de,7fffff6c,...) at _sleep+0x282/frame 0xee3d3c60
> softdep_flush(c70f7000,ee3d3ce8,c0da9070,0,ee3d3cd0,...) at softdep_flush+0x16a/frame 0xee3d3ca4
> fork_exit(c0da9070,c70f7000,ee3d3ce8) at fork_exit+0xa3/frame 0xee3d3cd4
> fork_trampoline() at fork_trampoline+0x8/frame 0xee3d3cd4
> --- trap 0, eip = 0, esp = 0xee3d3d20, ebp = 0 ---
>
> Tracing command bufdaemon pid 8 tid 100079 td 0xc71ba000
> sched_switch(c71ba000,0,104,0,d041fadb,...) at sched_switch+0x2d2/frame 0xee3d0b8c
> mi_switch(104,0,101,c71ba000,ee3d0c18,c6fb6884) at mi_switch+0x122/frame 0xee3d0bc4
> sleepq_switch(c71ba000,0,c11b698a,28b,101,...) at sleepq_switch+0x15b/frame 0xee3d0bec
> sleepq_timedwait(c6fb6884,54,0,0,0,...) at sleepq_timedwait+0x3f/frame 0xee3d0c18
> _sleep(c6fb6884,c6fb6800,54,c11de1de,7fffff6c,...) at _sleep+0x282/frame 0xee3d0c60
> softdep_flush(c70f72a0,ee3d0ce8,c0da9070,0,ee3d0cd0,...) at softdep_flush+0x16a/frame 0xee3d0ca4
> fork_exit(c0da9070,c70f72a0,ee3d0ce8) at fork_exit+0xa3/frame 0xee3d0cd4
> fork_trampoline() at fork_trampoline+0x8/frame 0xee3d0cd4
> --- trap 0, eip = 0, esp = 0xee3d0d20, ebp = 0 ---
>
> Tracing command bufdaemon pid 8 tid 100066 td 0xc6f69620
> sched_switch(c6f69620,0,104,36254e5d,0,...) at sched_switch+0x2d2/frame 0xee3a0b98
> mi_switch(104,0,101,c6f69620,ee3a0c24,c1534104) at mi_switch+0x122/frame 0xee3a0bd0
> sleepq_switch(c6f69620,0,c11b698a,28b,101,...) at sleepq_switch+0x15b/frame 0xee3a0bf8
> sleepq_timedwait(c1534104,54,0,0,0,...) at sleepq_timedwait+0x3f/frame 0xee3a0c24
> _sleep(c1534104,c1534080,54,c11bb3e7,fffffed8,...) at _sleep+0x282/frame 0xee3a0c6c
> buf_daemon(0,ee3a0ce8,0,0,0,...) at buf_daemon+0xac/frame 0xee3a0ca4
> fork_exit(c0bbeac0,0,ee3a0ce8) at fork_exit+0xa3/frame 0xee3a0cd4
> fork_trampoline() at fork_trampoline+0x8/frame 0xee3a0cd4
> --- trap 0, eip = 0, esp = 0xee3a0d20, ebp = 0 ---
>
> Tracing command pagezero pid 7 tid 100065 td 0xc6cee620
> sched_switch(c6cee620,0,104,79b9a83d,0,...) at sched_switch+0x2d2/frame 0xee39dba0
> mi_switch(104,0,101,c6cee620,ee39dc2c,c1539320) at mi_switch+0x122/frame 0xee39dbd8
> sleepq_switch(c6cee620,0,c11b698a,28b,101,...) at sleepq_switch+0x15b/frame 0xee39dc00
> sleepq_timedwait(c1539320,0,12b,0,0,...) at sleepq_timedwait+0x3f/frame 0xee39dc2c
> _sleep(c1539320,c1594580,0,c11e2463,fffea520,...) at _sleep+0x282/frame 0xee39dc74
> vm_pagezero(0,ee39dce8,0,0,0,...) at vm_pagezero+0xd2/frame 0xee39dca4
> fork_exit(c0e09ef0,0,ee39dce8) at fork_exit+0xa3/frame 0xee39dcd4
> fork_trampoline() at fork_trampoline+0x8/frame 0xee39dcd4
> --- trap 0, eip = 0, esp = 0xee39dd20, ebp = 0 ---
>
> Tracing command vmdaemon pid 6 tid 100064 td 0xc6cee930
> sched_switch(c6cee930,0,104,0,c6cee930,...) at sched_switch+0x2d2/frame 0xee39ab64
> mi_switch(104,0,0,0,c6cee930,c1539044) at mi_switch+0x122/frame 0xee39ab9c
> sleepq_switch(c6cee930,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee39abc4
> sleepq_wait(c1539044,74,c11bb3e7,0,0,...) at sleepq_wait+0x3f/frame 0xee39abf0
> _sleep(c1539044,c153902c,74,c11bb3e7,0,...) at _sleep+0x2ae/frame 0xee39ac38
> vm_daemon(0,ee39ace8,0,0,0,...) at vm_daemon+0x116/frame 0xee39aca4
> fork_exit(c0e029a0,0,ee39ace8) at fork_exit+0xa3/frame 0xee39acd4
> fork_trampoline() at fork_trampoline+0x8/frame 0xee39acd4
> --- trap 0, eip = 0, esp = 0xee39ad20, ebp = 0 ---
>
> Tracing command pagedaemon pid 5 tid 100063 td 0xc6ceec40
> sched_switch(c6ceec40,0,104,0,36254e5d,...) at sched_switch+0x2d2/frame 0xee397b64
> mi_switch(104,0,101,c6ceec40,ee397bf0,c1594604) at mi_switch+0x122/frame 0xee397b9c
> sleepq_switch(c6ceec40,0,c11b698a,28b,101,...) at sleepq_switch+0x15b/frame 0xee397bc4
> sleepq_timedwait(c1594604,54,0,0,0,...) at sleepq_timedwait+0x3f/frame 0xee397bf0
> _sleep(c1594604,c1594580,54,c11bb3e7,fffffed8,...) at _sleep+0x282/frame 0xee397c38
> vm_pageout(0,ee397ce8,0,0,0,...) at vm_pageout+0x1fb/frame 0xee397ca4
> fork_exit(c0e03410,0,ee397ce8) at fork_exit+0xa3/frame 0xee397cd4
> fork_trampoline() at fork_trampoline+0x8/frame 0xee397cd4
> --- trap 0, eip = 0, esp = 0xee397d20, ebp = 0 ---
>
> Tracing command sctp_iterator pid 4 tid 100060 td 0xc6d22620
> sched_switch(c6d22620,0,104,0,c6d22620,...) at sched_switch+0x2d2/frame 0xee38eba4
> mi_switch(104,0,d6fa6fc8,c0b0eedf,c6d22620,c1592874) at mi_switch+0x122/frame 0xee38ebdc
> sleepq_switch(c6d22620,0,c11b698a,268,c6fa6fc8,...) at sleepq_switch+0x15b/frame 0xee38ec04
> sleepq_wait(c1592874,0,c11ce22b,0,0,...) at sleepq_wait+0x3f/frame 0xee38ec30
> _sleep(c1592874,c159283c,0,c11ce22b,0,...) at _sleep+0x2ae/frame 0xee38ec78
> sctp_iterator_thread(0,ee38ece8,0,0,0,...) at sctp_iterator_thread+0x9c/frame 0xee38eca4
> fork_exit(c0c83920,0,ee38ece8) at fork_exit+0xa3/frame 0xee38ecd4
> fork_trampoline() at fork_trampoline+0x8/frame 0xee38ecd4
> --- trap 0, eip = 0, esp = 0xee38ed20, ebp = 0 ---
>
> Tracing command fdc0 pid 3 tid 100056 td 0xc6d23310
> sched_switch(c6d23310,0,104,0,36254e5d,...) at sched_switch+0x2d2/frame 0xee381b34
> mi_switch(104,0,101,c6d23310,ee381bc0,c6baf83c) at mi_switch+0x122/frame 0xee381b6c
> sleepq_switch(c6d23310,0,c11b698a,28b,101,...) at sleepq_switch+0x15b/frame 0xee381b94
> sleepq_timedwait(c6baf83c,5c,0,0,0,...) at sleepq_timedwait+0x3f/frame 0xee381bc0
> _sleep(c6baf83c,c6baf8f0,5c,c11a23c4,fffffed8,...) at _sleep+0x282/frame 0xee381c08
> fdc_thread(c6baf800,ee381ce8,0,0,0,...) at fdc_thread+0x877/frame 0xee381ca4
> fork_exit(c0fc2e20,c6baf800,ee381ce8) at fork_exit+0xa3/frame 0xee381cd4
> fork_trampoline() at fork_trampoline+0x8/frame 0xee381cd4
> --- trap 0, eip = 0, esp = 0xee381d20, ebp = 0 ---
>
> Tracing command usb pid 15 tid 100053 td 0xc6d23c40
> sched_switch(c6d23c40,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee304bb8
> mi_switch(104,0,0,80246,c6d23c40,c6d09d34) at mi_switch+0x122/frame 0xee304bf0
> sleepq_switch(c6d23c40,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee304c18
> sleepq_wait(c6d09d34,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee304c44
> _cv_wait(c6d09d34,c6d09e74,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee304c74
> usb_process(c6d09d2c,ee304ce8,0,0,0,...) at usb_process+0xf6/frame 0xee304ca4
> fork_exit(c09a4cc0,c6d09d2c,ee304ce8) at fork_exit+0xa3/frame 0xee304cd4
> fork_trampoline() at fork_trampoline+0x8/frame 0xee304cd4
> --- trap 0, eip = 0, esp = 0xee304d20, ebp = 0 ---
>
> Tracing command usb pid 15 tid 100052 td 0xc6c85c40
> sched_switch(c6c85c40,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee301bb8
> mi_switch(104,0,c6c99fc8,c0b3286d,c6c85c40,c6d09d04) at mi_switch+0x122/frame 0xee301bf0
> sleepq_switch(c6c85c40,0,c11b698a,268,c6d57640,...) at sleepq_switch+0x15b/frame 0xee301c18
> sleepq_wait(c6d09d04,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee301c44
> _cv_wait(c6d09d04,c6d09e74,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee301c74
> usb_process(c6d09cfc,ee301ce8,0,0,0,...) at usb_process+0xf6/frame 0xee301ca4
> fork_exit(c09a4cc0,c6d09cfc,ee301ce8) at fork_exit+0xa3/frame 0xee301cd4
> fork_trampoline() at fork_trampoline+0x8/frame 0xee301cd4
> --- trap 0, eip = 0, esp = 0xee301d20, ebp = 0 ---
>
> Tracing command usb pid 15 tid 100051 td 0xc6cec000
> sched_switch(c6cec000,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2febb8
> mi_switch(104,0,0,80246,c6cec000,c6d09cd4) at mi_switch+0x122/frame 0xee2febf0
> sleepq_switch(c6cec000,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee2fec18
> sleepq_wait(c6d09cd4,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2fec44
> _cv_wait(c6d09cd4,c6d09e74,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2fec74
> usb_process(c6d09ccc,ee2fece8,0,0,0,...) at usb_process+0xf6/frame 0xee2feca4
> fork_exit(c09a4cc0,c6d09ccc,ee2fece8) at fork_exit+0xa3/frame 0xee2fecd4
> fork_trampoline() at fork_trampoline+0x8/frame 0xee2fecd4
> --- trap 0, eip = 0, esp = 0xee2fed20, ebp = 0 ---
>
> Tracing command usb pid 15 tid 100050 td 0xc6cec310
> sched_switch(c6cec310,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2fbbb8
> mi_switch(104,0,0,80246,c6cec310,c6d09ca4) at mi_switch+0x122/frame 0xee2fbbf0
> sleepq_switch(c6cec310,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee2fbc18
> sleepq_wait(c6d09ca4,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2fbc44
> _cv_wait(c6d09ca4,c6d09e74,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2fbc74
> usb_process(c6d09c9c,ee2fbce8,0,0,0,...) at usb_process+0xf6/frame 0xee2fbca4
> fork_exit(c09a4cc0,c6d09c9c,ee2fbce8) at fork_exit+0xa3/frame 0xee2fbcd4
> fork_trampoline() at fork_trampoline+0x8/frame 0xee2fbcd4
> --- trap 0, eip = 0, esp = 0xee2fbd20, ebp = 0 ---
>
> Tracing command usb pid 15 tid 100049 td 0xc6cec620
> sched_switch(c6cec620,0,104,c09a52a9,0,...) at sched_switch+0x2d2/frame 0xee2f5bb8
> mi_switch(104,0,0,80246,c6cec620,c6cf2dac) at mi_switch+0x122/frame 0xee2f5bf0
> sleepq_switch(c6cec620,0,c11b698a,268,4,...) at sleepq_switch+0x15b/frame 0xee2f5c18
> sleepq_wait(c6cf2dac,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2f5c44
> _cv_wait(c6cf2dac,c6cf2eec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2f5c74
> usb_process(c6cf2da4,ee2f5ce8,0,0,0,...) at usb_process+0xf6/frame 0xee2f5ca4
> fork_exit(c09a4cc0,c6cf2da4,ee2f5ce8) at fork_exit+0xa3/frame 0xee2f5cd4
> fork_trampoline() at fork_trampoline+0x8/frame 0xee2f5cd4
> --- trap 0, eip = 0, esp = 0xee2f5d20, ebp = 0 ---
>
> Tracing command usb pid 15 tid 100048 td 0xc6cec930
> sched_switch(c6cec930,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2f2bb8
> mi_switch(104,0,c0995672,c158f620,c6cec930,c6cf2d7c) at mi_switch+0x122/frame 0xee2f2bf0
> sleepq_switch(c6cec930,0,c11b698a,268,c6d57380,...) at sleepq_switch+0x15b/frame 0xee2f2c18
> sleepq_wait(c6cf2d7c,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2f2c44
> _cv_wait(c6cf2d7c,c6cf2eec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2f2c74
> usb_process(c6cf2d74,ee2f2ce8,0,0,0,...) at usb_process+0xf6/frame 0xee2f2ca4
> fork_exit(c09a4cc0,c6cf2d74,ee2f2ce8) at fork_exit+0xa3/frame 0xee2f2cd4
> fork_trampoline() at fork_trampoline+0x8/frame 0xee2f2cd4
> --- trap 0, eip = 0, esp = 0xee2f2d20, ebp = 0 ---
>
> Tracing command usb pid 15 tid 100047 td 0xc6cecc40
> sched_switch(c6cecc40,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2efbb8
> mi_switch(104,0,0,80246,c6cecc40,c6cf2d4c) at mi_switch+0x122/frame 0xee2efbf0
> sleepq_switch(c6cecc40,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee2efc18
> sleepq_wait(c6cf2d4c,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2efc44
> _cv_wait(c6cf2d4c,c6cf2eec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2efc74
> usb_process(c6cf2d44,ee2efce8,0,0,0,...) at usb_process+0xf6/frame 0xee2efca4
> fork_exit(c09a4cc0,c6cf2d44,ee2efce8) at fork_exit+0xa3/frame 0xee2efcd4
> fork_trampoline() at fork_trampoline+0x8/frame 0xee2efcd4
> --- trap 0, eip = 0, esp = 0xee2efd20, ebp = 0 ---
>
> Tracing command usb pid 15 tid 100046 td 0xc6ced000
> sched_switch(c6ced000,0,104,8,0,...) at sched_switch+0x2d2/frame 0xee2ecbb8
> mi_switch(104,0,3660,0,c6ced000,c6cf2d1c) at mi_switch+0x122/frame 0xee2ecbf0
> sleepq_switch(c6ced000,0,c11b698a,268,4,...) at sleepq_switch+0x15b/frame 0xee2ecc18
> sleepq_wait(c6cf2d1c,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2ecc44
> _cv_wait(c6cf2d1c,c6cf2eec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2ecc74
> usb_process(c6cf2d14,ee2ecce8,0,0,0,...) at usb_process+0xf6/frame 0xee2ecca4
> fork_exit(c09a4cc0,c6cf2d14,ee2ecce8) at fork_exit+0xa3/frame 0xee2eccd4
> fork_trampoline() at fork_trampoline+0x8/frame 0xee2eccd4
> --- trap 0, eip = 0, esp = 0xee2ecd20, ebp = 0 ---
>
> Tracing command usb pid 15 tid 100044 td 0xc6ced620
> sched_switch(c6ced620,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2e5bb8
> mi_switch(104,0,0,80246,c6ced620,c6cdbdac) at mi_switch+0x122/frame 0xee2e5bf0
> sleepq_switch(c6ced620,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee2e5c18
> sleepq_wait(c6cdbdac,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2e5c44
> _cv_wait(c6cdbdac,c6cdbeec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2e5c74
> usb_process(c6cdbda4,ee2e5ce8,0,0,0,...) at usb_process+0xf6/frame 0xee2e5ca4
> fork_exit(c09a4cc0,c6cdbda4,ee2e5ce8) at fork_exit+0xa3/frame 0xee2e5cd4
> fork_trampoline() at fork_trampoline+0x8/frame 0xee2e5cd4
> --- trap 0, eip = 0, esp = 0xee2e5d20, ebp = 0 ---
>
> Tracing command usb pid 15 tid 100043 td 0xc6ced930
> sched_switch(c6ced930,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2e2bb8
> mi_switch(104,0,0,0,c6ced930,c6cdbd7c) at mi_switch+0x122/frame 0xee2e2bf0
> sleepq_switch(c6ced930,0,c11b698a,268,c6d57140,...) at sleepq_switch+0x15b/frame 0xee2e2c18
> sleepq_wait(c6cdbd7c,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2e2c44
> _cv_wait(c6cdbd7c,c6cdbeec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2e2c74
> usb_process(c6cdbd74,ee2e2ce8,0,0,0,...) at usb_process+0xf6/frame 0xee2e2ca4
> fork_exit(c09a4cc0,c6cdbd74,ee2e2ce8) at fork_exit+0xa3/frame 0xee2e2cd4
> fork_trampoline() at fork_trampoline+0x8/frame 0xee2e2cd4
> --- trap 0, eip = 0, esp = 0xee2e2d20, ebp = 0 ---
>
> Tracing command usb pid 15 tid 100042 td 0xc6cedc40
> sched_switch(c6cedc40,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2dfbb8
> mi_switch(104,0,0,80246,c6cedc40,c6cdbd4c) at mi_switch+0x122/frame 0xee2dfbf0
> sleepq_switch(c6cedc40,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee2dfc18
> sleepq_wait(c6cdbd4c,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2dfc44
> _cv_wait(c6cdbd4c,c6cdbeec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2dfc74
> usb_process(c6cdbd44,ee2dfce8,0,0,0,...) at usb_process+0xf6/frame 0xee2dfca4
> fork_exit(c09a4cc0,c6cdbd44,ee2dfce8) at fork_exit+0xa3/frame 0xee2dfcd4
> fork_trampoline() at fork_trampoline+0x8/frame 0xee2dfcd4
> --- trap 0, eip = 0, esp = 0xee2dfd20, ebp = 0 ---
>
> Tracing command usb pid 15 tid 100041 td 0xc6cee000
> sched_switch(c6cee000,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2dcbb8
> mi_switch(104,0,0,80246,c6cee000,c6cdbd1c) at mi_switch+0x122/frame 0xee2dcbf0
> sleepq_switch(c6cee000,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee2dcc18
> sleepq_wait(c6cdbd1c,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2dcc44
> _cv_wait(c6cdbd1c,c6cdbeec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2dcc74
> usb_process(c6cdbd14,ee2dcce8,0,0,0,...) at usb_process+0xf6/frame 0xee2dcca4
> fork_exit(c09a4cc0,c6cdbd14,ee2dcce8) at fork_exit+0xa3/frame 0xee2dccd4
> fork_trampoline() at fork_trampoline+0x8/frame 0xee2dccd4
> --- trap 0, eip = 0, esp = 0xee2dcd20, ebp = 0 ---
>
> Tracing command usb pid 15 tid 100039 td 0xc6c0d310
> sched_switch(c6c0d310,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2d5bb8
> mi_switch(104,0,0,80246,c6c0d310,c6cc6dac) at mi_switch+0x122/frame 0xee2d5bf0
> sleepq_switch(c6c0d310,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee2d5c18
> sleepq_wait(c6cc6dac,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2d5c44
> _cv_wait(c6cc6dac,c6cc6eec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2d5c74
> usb_process(c6cc6da4,ee2d5ce8,0,0,0,...) at usb_process+0xf6/frame 0xee2d5ca4
> fork_exit(c09a4cc0,c6cc6da4,ee2d5ce8) at fork_exit+0xa3/frame 0xee2d5cd4
> fork_trampoline() at fork_trampoline+0x8/frame 0xee2d5cd4
> --- trap 0, eip = 0, esp = 0xee2d5d20, ebp = 0 ---
>
> Tracing command usb pid 15 tid 100038 td 0xc6c0d620
> sched_switch(c6c0d620,0,104,c1a6c5d0,0,...) at sched_switch+0x2d2/frame 0xee2d2bb8
> mi_switch(104,0,c6c99fc8,c0b3286d,c6c0d620,c6cc6d7c) at mi_switch+0x122/frame 0xee2d2bf0
> sleepq_switch(c6c0d620,0,c11b698a,268,c6d57900,...) at sleepq_switch+0x15b/frame 0xee2d2c18
> sleepq_wait(c6cc6d7c,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2d2c44
> _cv_wait(c6cc6d7c,c6cc6eec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2d2c74
> usb_process(c6cc6d74,ee2d2ce8,0,0,0,...) at usb_process+0xf6/frame 0xee2d2ca4
> fork_exit(c09a4cc0,c6cc6d74,ee2d2ce8) at fork_exit+0xa3/frame 0xee2d2cd4
> fork_trampoline() at fork_trampoline+0x8/frame 0xee2d2cd4
> --- trap 0, eip = 0, esp = 0xee2d2d20, ebp = 0 ---
>
> Tracing command usb pid 15 tid 100037 td 0xc6c0d930
> sched_switch(c6c0d930,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2cfbb8
> mi_switch(104,0,0,80246,c6c0d930,c6cc6d4c) at mi_switch+0x122/frame 0xee2cfbf0
> sleepq_switch(c6c0d930,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee2cfc18
> sleepq_wait(c6cc6d4c,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2cfc44
> _cv_wait(c6cc6d4c,c6cc6eec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2cfc74
> usb_process(c6cc6d44,ee2cfce8,0,0,0,...) at usb_process+0xf6/frame 0xee2cfca4
> fork_exit(c09a4cc0,c6cc6d44,ee2cfce8) at fork_exit+0xa3/frame 0xee2cfcd4
> fork_trampoline() at fork_trampoline+0x8/frame 0xee2cfcd4
> --- trap 0, eip = 0, esp = 0xee2cfd20, ebp = 0 ---
>
> Tracing command usb pid 15 tid 100036 td 0xc6c0dc40
> sched_switch(c6c0dc40,0,104,0,0,...) at sched_switch+0x2d2/frame 0xee2ccbb8
> mi_switch(104,0,0,80246,c6c0dc40,c6cc6d1c) at mi_switch+0x122/frame 0xee2ccbf0
> sleepq_switch(c6c0dc40,0,c11b698a,268,0,...) at sleepq_switch+0x15b/frame 0xee2ccc18
> sleepq_wait(c6cc6d1c,0,c11a23c4,1,0,...) at sleepq_wait+0x3f/frame 0xee2ccc44
> _cv_wait(c6cc6d1c,c6cc6eec,c118e08e,73,0,...) at _cv_wait+0x182/frame 0xee2ccc74
> us
>
> ----------------------------------------------------------------------
>
> config.txt
>
> options	CONFIG_AUTOGENERATED
> ident	GENERIC
> machine	i386
> cpu	I686_CPU
> cpu	I586_CPU
> cpu	I486_CPU
> makeoptions	WITH_CTF=1
> makeoptions	DEBUG=-g
> options	XENHVM
> options	USB_DEBUG
> options	ATH_ENABLE_11N
> options	AH_AR5416_INTERRUPT_MITIGATION
> options	AH_SUPPORT_AR5416
> options	IEEE80211_SUPPORT_MESH
> options	IEEE80211_AMPDU_AGE
> options	IEEE80211_DEBUG
> options	SC_PIXEL_MODE
> options	VESA
> options	AHD_REG_PRETTY_PRINT
> options	AHC_REG_PRETTY_PRINT
> options	ATA_STATIC_ID
> options	SMP
> options	KDB_TRACE
> options	KDB
> options	DDB
> options	VIMAGE
> options	INCLUDE_CONFIG_FILE
> options	DDB_CTF
> options	KDTRACE_HOOKS
> options	MAC
> options	PROCDESC
> options	CAPABILITIES
> options	CAPABILITY_MODE
> options	AUDIT
> options	HWPMC_HOOKS
> options	KBD_INSTALL_CDEV
> options	PRINTF_BUFR_SIZE=128
> options	_KPOSIX_PRIORITY_SCHEDULING
> options	SYSVSEM
> options	SYSVMSG
> options	SYSVSHM
> options	STACK
> options	KTRACE
> options	SCSI_DELAY=5000
> options	COMPAT_FREEBSD7
> options	COMPAT_FREEBSD6
> options	COMPAT_FREEBSD5
> options	COMPAT_FREEBSD4
> options	GEOM_LABEL
> options	GEOM_RAID
> options	GEOM_PART_GPT
> options	PSEUDOFS
> options	PROCFS
> options	CD9660
> options	MSDOSFS
> options	NFS_ROOT
> options	NFSLOCKD
> options	NFSD
> options	NFSCL
> options	MD_ROOT
> options	QUOTA
> options	UFS_GJOURNAL
> options	UFS_DIRHASH
> options	UFS_ACL
> options	SOFTUPDATES
> options	FFS
> options	SCTP
> options	TCP_OFFLOAD
> options	INET6
> options	INET
> options	PREEMPTION
> options	SCHED_ULE
> options	NEW_PCIB
> options	NATIVE
> options	GEOM_PART_MBR
> options	GEOM_PART_EBR_COMPAT
> options	GEOM_PART_EBR
> options	GEOM_PART_BSD
> options	ISAPNP
> device	isa
> device	npx
> device	mem
> device	io
> device	uart_ns8250
> device	atpic
> device	apic
> device	cpufreq
> device	acpi
> device	eisa
> device	pci
> device	fdc
> device	ahci
> device	ata
> device	mvs
> device	siis
> device	ahb
> device	ahc
> device	ahd
> device	esp
> device	hptiop
> device	isp
> device	mpt
> device	mps
> device	mpr
> device	sym
> device	trm
> device	adv
> device	adw
> device	aha
> device	aic
> device	bt
> device	ncv
> device	nsp
> device	stg
> device	isci
> device	scbus
> device	ch
> device	da
> device	sa
> device	cd
> device	pass
> device	ses
> device	amr
> device	arcmsr
> device	asr
> device	ciss
> device	dpt
> device	hptmv
> device	hptnr
> device	hptrr
> device	hpt27xx
> device	iir
> device	ips
> device	mly
> device	twa
> device	tws
> device	aac
> device	aacp
> device	aacraid
> device	ida
> device	mfi
> device	mlx
> device	mrsas
> device	pst
> device	twe
> device	atkbdc
> device	atkbd
> device	psm
> device	kbdmux
> device	vga
> device	splash
> device	sc
> device	vt
> device	vt_vga
> device	agp
> device	pmtimer
> device	cbb
> device	pccard
> device	cardbus
> device	uart
> device	ppc
> device	ppbus
> device	lpt
> device	ppi
> device	puc
> device	bxe
> device	de
> device	em
> device	igb
> device	ixgb
> device	le
> device	ti
> device	txp
> device	vx
> device	miibus
> device	ae
> device	age
> device	alc
> device	ale
> device	bce
> device	bfe
> device	bge
> device	cas
> device	dc
> device	et
> device	fxp
> device	gem
> device	hme
> device	jme
> device	lge
> device	msk
> device	nfe
> device	nge
> device	pcn
> device	re
> device	rl
> device	sf
> device	sge
> device	sis
> device	sk
> device	ste
> device	stge
> device	tl
> device	tx
> device	vge
> device	vr
> device	vte
> device	wb
> device	xl
> device	cs
> device	ed
> device	ex
> device	ep
> device	fe
> device	ie
> device	sn
> device	xe
> device	wlan
> device	wlan_wep
> device	wlan_ccmp
> device	wlan_tkip
> device	wlan_amrr
> device	an
> device	ath
> device	ath_pci
> device	ath_hal
> device	ath_rate_sample
> device	ipw
> device	iwi
> device	iwn
> device	malo
> device	mwl
> device	ral
> device	wi
> device	wpi
> device	loop
> device	random
> device	padlock_rng
> device	rdrand_rng
> device	ether
> device	vlan
> device	tun
> device	md
> device	gif
> device	faith
> device	firmware
> device	bpf
> device	uhci
> device	ohci
> device	ehci
> device	xhci
> device	usb
> device	ukbd
> device	umass
> device	sound
> device	snd_cmi
> device	snd_csa
> device	snd_emu10kx
> device	snd_es137x
> device	snd_hda
> device	snd_ich
> device	snd_via8233
> device	mmc
> device	mmcsd
> device	sdhci
> device	virtio
> device	virtio_pci
> device	vtnet
> device	virtio_blk
> device	virtio_scsi
> device	virtio_balloon
> device	hyperv
> device	xenpci
> device	vmx
>
> ----------------------------------------------------------------------
>
> msgbuf.txt
>
> Copyright (c) 1992-2014 The FreeBSD Project.
> Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
> 	The Regents of the University of California. All rights reserved.
> FreeBSD is a registered trademark of The FreeBSD Foundation.
> FreeBSD 10.1-STABLE #1 r276174: Sat Jan  3 20:50:10 CET 2015
>      root@verdi.nethelp.no:/usr/src/sys/i386/compile/GENERICV i386
> FreeBSD clang version 3.4.1 (tags/RELEASE_34/dot1-final 208032) 20140512
> CPU: Intel(R) Pentium(R) D CPU 2.80GHz (2793.06-MHz 686-class CPU)
>    Origin="GenuineIntel"  Id=0xf47  Family=0xf  Model=0x4  Stepping=7
>    Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
>    Features2=0x641d<SSE3,DTES64,MON,DS_CPL,CNXT-ID,CX16,xTPR>
>    AMD Features=0x20100000<NX,LM>
>    AMD Features2=0x1<LAHF>
>    TSC: P-state invariant
> real memory  = 2147483648 (2048 MB)
> avail memory = 2083926016 (1987 MB)
> Event timer "LAPIC" quality 400
> ACPI APIC Table: <DELL   PESC430>
> FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
> FreeBSD/SMP: 1 package(s) x 2 core(s)
>   cpu0 (BSP): APIC ID:  0
>   cpu1 (AP): APIC ID:  1
> WARNING: VIMAGE (virtualized network stack) is a highly experimental feature.
> ioapic0: Changing APIC ID to 8
> ioapic0 <Version 2.0> irqs 0-23 on motherboard
> lapic0: Forcing LINT1 to edge trigger
> random: <Software, Yarrow> initialized
> kbd1 at kbdmux0
> acpi0: <DELL PESC430> on motherboard
> acpi0: Power Button (fixed)
> acpi0: reservation of 0, a0000 (3) failed
> acpi0: reservation of 100000, f00000 (3) failed
> acpi0: reservation of 1000000, 7ee8cc00 (3) failed
> cpu0: <ACPI CPU> on acpi0
> cpu1: <ACPI CPU> on acpi0
> atrtc0: <AT realtime clock> port 0x70-0x7f irq 8 on acpi0
> Event timer "RTC" frequency 32768 Hz quality 0
> attimer0: <AT timer> port 0x40-0x5f irq 0 on acpi0
> Timecounter "i8254" frequency 1193182 Hz quality 0
> Event timer "i8254" frequency 1193182 Hz quality 100
> Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
> acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
> hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
> Timecounter "HPET" frequency 14318180 Hz quality 950
> Event timer "HPET" frequency 14318180 Hz quality 450
> Event timer "HPET1" frequency 14318180 Hz quality 440
> Event timer "HPET2" frequency 14318180 Hz quality 440
> acpi_button0: <Power Button> on acpi0
> pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
> pci0: <ACPI PCI bus> on pcib0
> pcib1: <ACPI PCI-PCI bridge> irq 16 at device 1.0 on pci0
> pci1: <ACPI PCI bus> on pcib1
> pcib2: <ACPI PCI-PCI bridge> irq 16 at device 28.0 on pci0
> pci2: <ACPI PCI bus> on pcib2
> em0: <Intel(R) PRO/1000 Network Connection 7.4.2> port 0xdcc0-0xdcdf mem 0xfe880000-0xfe89ffff,0xfe8a0000-0xfe8bffff irq 16 at device 0.0 on pci2
> em0: Using an MSI interrupt
> em0: Ethernet address: 00:15:17:36:bc:e8
> em1: <Intel(R) PRO/1000 Network Connection 7.4.2> port 0xdce0-0xdcff mem 0xfe8c0000-0xfe8dffff,0xfe8e0000-0xfe8fffff irq 17 at device 0.1 on pci2
> em1: Using an MSI interrupt
> em1: Ethernet address: 00:15:17:36:bc:e9
> pcib3: <ACPI PCI-PCI bridge> irq 16 at device 28.4 on pci0
> pci3: <ACPI PCI bus> on pcib3
> bge0: <Broadcom NetXtreme PCIe Ethernet Adapter, ASIC rev. 0x004101> mem 0xfe7f0000-0xfe7fffff irq 16 at device 0.0 on pci3
> bge0: CHIP ID 0x00004101; ASIC REV 0x04; CHIP REV 0x41; PCI-E
> miibus0: <MII bus> on bge0
> brgphy0: <BCM5750 1000BASE-T media interface> PHY 1 on miibus0
> brgphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
> bge0: Ethernet address: 00:10:18:1c:60:ce
> pcib4: <ACPI PCI-PCI bridge> irq 17 at device 28.5 on pci0
> pci4: <ACPI PCI bus> on pcib4
> bge1: <Broadcom NetXtreme Gigabit Ethernet Controller, ASIC rev. 0x004001> mem 0xfe6f0000-0xfe6fffff irq 17 at device 0.0 on pci4
> bge1: CHIP ID 0x00004001; ASIC REV 0x04; CHIP REV 0x40; PCI-E
> miibus1: <MII bus> on bge1
> brgphy1: <BCM5750 1000BASE-T media interface> PHY 1 on miibus1
> brgphy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
> bge1: Ethernet address: 00:13:72:20:b4:6f
> uhci0: <Intel 82801G (ICH7) USB controller USB-A> port 0xff80-0xff9f irq 21 at device 29.0 on pci0
> usbus0 on uhci0
> uhci1: <Intel 82801G (ICH7) USB controller USB-B> port 0xff60-0xff7f irq 22 at device 29.1 on pci0
> usbus1 on uhci1
> uhci2: <Intel 82801G (ICH7) USB controller USB-C> port 0xff40-0xff5f irq 18 at device 29.2 on pci0
> usbus2 on uhci2
> uhci3: <Intel 82801G (ICH7) USB controller USB-D> port 0xff20-0xff3f irq 23 at device 29.3 on pci0
> usbus3 on uhci3
> ehci0: <Intel 82801GB/R (ICH7) USB 2.0 controller> mem 0xffa80800-0xffa80bff irq 21 at device 29.7 on pci0
> usbus4: EHCI version 1.0
> usbus4 on ehci0
> pcib5: <ACPI PCI-PCI bridge> at device 30.0 on pci0
> pci5: <ACPI PCI bus> on pcib5
> vgapci0: <VGA-compatible display> port 0xcc80-0xccff mem 0xfc000000-0xfdffffff,0xfe4c0000-0xfe4fffff at device 7.0 on pci5
> vgapci0: Boot video device
> isab0: <PCI-ISA bridge> at device 31.0 on pci0
> isa0: <ISA bus> on isab0
> atapci0: <Intel ICH7 UDMA100 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xffa0-0xffaf irq 16 at device 31.1 on pci0
> ata0: <ATA channel> at channel 0 on atapci0
> atapci1: <Intel ICH7 SATA300 controller> port 0xfe00-0xfe07,0xfe10-0xfe13,0xfe20-0xfe27,0xfe30-0xfe33,0xfea0-0xfeaf irq 20 at device 31.2 on pci0
> ata2: <ATA channel> at channel 0 on atapci1
> ata3: <ATA channel> at channel 1 on atapci1
> fdc0: <floppy drive controller> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
> fd0: <1440-KB 3.5" drive> on fdc0 drive 0
> uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
> pmtimer0 on isa0
> orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xc8fff,0xc9000-0xcafff,0xcb000-0xcbfff pnpid ORM0000 on isa0
> sc0: <System console> at flags 0x100 on isa0
> sc0: VGA <16 virtual consoles, flags=0x300>
> vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
> atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
> atkbd0: <AT Keyboard> irq 1 on atkbdc0
> kbd0 at atkbd0
> atkbd0: [GIANT-LOCKED]
> ppc0: parallel port not found.
> p4tcc0: <CPU Frequency Thermal Control> on cpu0
> p4tcc1: <CPU Frequency Thermal Control> on cpu1
> Timecounters tick every 1.000 msec
> random: unblocking device.
> usbus0: 12Mbps Full Speed USB v1.0
> usbus1: 12Mbps Full Speed USB v1.0
> usbus2: 12Mbps Full Speed USB v1.0
> usbus3: 12Mbps Full Speed USB v1.0
> usbus4: 480Mbps High Speed USB v2.0
> ugen0.1: <Intel> at usbus0
> uhub0: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
> ugen2.1: <Intel> at usbus2
> ugen1.1: <Intel> at usbus1
> uhub1: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1
> ugen4.1: <Intel> at usbus4
> uhub2: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus4
> ugen3.1: <Intel> at usbus3
> uhub3: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus3
> uhub4: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus2
> ada0 at ata2 bus 0 scbus1 target 0 lun 0
> ada0: <ST3500320AS SD15> ATA-8 SATA 2.x device
> ada0: Serial Number 9QM098KE
> ada0: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
> ada0: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C)
> ada0: Previously was known as ad4
> ada1 at ata3 bus 0 scbus2 target 0 lun 0
> ada1: <ST3500320AS SD15> ATA-8 SATA 2.x device
> ada1: Serial Number 9QM0D4DL
> ada1: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
> ada1: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C)
> ada1: Previously was known as ad6
> cd0 at ata0 bus 0 scbus0 target 0 lun 0
> cd0: <HL-DT-ST CD-ROM GCR-8485B 1.06> Removable CD-ROM SCSI-0 device
> cd0: 33.300MB/s transfers (UDMA2, ATAPI 12bytes, PIO 65534bytes)
> cd0: Attempt to query device size failed: NOT READY, Medium not present
> uhub1: 2 ports with 2 removable, self powered
> uhub0: 2 ports with 2 removable, self powered
> uhub3: 2 ports with 2 removable, self powered
> uhub4: 2 ports with 2 removable, self powered
> lapic1: Forcing LINT1 to edge trigger
> SMP: AP CPU #1 Launched!
> Timecounter "TSC-low" frequency 1396531633 Hz quality 1000
> Root mount waiting for: usbus4
> Root mount waiting for: usbus4
> uhub2: 8 ports with 8 removable, self powered
> Trying to mount root from ufs:/dev/ada0s1a [rw]...
> <118>Setting hostuuid: 44454c4c-4400-104a-8054-b8c04f43324a.
> <118>Setting hostid: 0xde1f5676.
> <118>Starting ddb.
> <118>Entropy harvesting: interrupts ethernet point_to_point swi.
> <118>Starting file system checks:
> <118>/dev/ada0s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS
> <118>/dev/ada0s1a: clean, 4499260 free (1612 frags, 562206 blocks, 0.0% fragmentation)
> <118>/dev/ada0s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS
> <118>/dev/ada0s1d: clean, 3269748 free (10100 frags, 407456 blocks, 0.2% fragmentation)
> <118>/dev/ada0s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS
> <118>/dev/ada0s1e: clean, 2462027 free (147 frags, 307735 blocks, 0.0% fragmentation)
> <118>Mounting local file systems:.
> <118>Writing entropy file:.
> <118>Setting hostname: verdi.nethelp.no.
> ugen3.2: <DELL> at usbus3
> ukbd0: <DELL DELL USB Keyboard, class 0/0, rev 1.10/1.05, addr 2> on usbus3
> kbd2 at ukbd0
> <118>Starting Network: lo0 em0 em1 bge0 bge1.
> <118>lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
> <118>	options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
> <118>	inet6 ::1 prefixlen 128
> <118>	inet6 fe80::1%lo0 prefixlen 64 scopeid 0x5
> <118>	inet 127.0.0.1 netmask 0xff000000
> <118>	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
> <118>em0: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500
> <118>	options=4219b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,WOL_MAGIC,VLAN_HWTSO>
> <118>	ether 00:15:17:36:bc:e8
> <118>	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
> <118>	media: Ethernet autoselect
> <118>	status: no carrier
> <118>em1: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500
> <118>	options=4019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO>
> <118>	ether 00:15:17:36:bc:e9
> <118>	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
> <118>	media: Ethernet autoselect
> <118>	status: no carrier
> <118>bge0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
> <118>	options=8009b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LINKSTATE>
> <118>	ether 00:10:18:1c:60:ce
> <118>	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
> <118>	media: Ethernet autoselect
> <118>bge1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
> <118>	options=8009b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LINKSTATE>
> <118>	ether 00:13:72:20:b4:6f
> <118>	inet 10.0.0.2 netmask 0xfffffffc broadcast 10.0.0.3
> <118>	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
> <118>	media: Ethernet autoselect (none)
> <118>	status: no carrier
> <118>Starting devd.
> <118>Starting Network: em0.
> <118>em0: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500
> <118>	options=4219b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,WOL_MAGIC,VLAN_HWTSO>
> <118>	ether 00:15:17:36:bc:e8
> <118>	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
> <118>	media: Ethernet autoselect
> <118>	status: no carrier
> <118>Starting Network: em1.
> <118>em1: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500
> <118>	options=4019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO>
> <118>	ether 00:15:17:36:bc:e9
> <118>	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
> <118>	media: Ethernet autoselect
> <118>	status: no carrier
> <118>Starting Network: bge0.
> <118>bge0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
> <118>	options=8009b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LINKSTATE>
> <118>	ether 00:10:18:1c:60:ce
> <118>	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
> <118>	media: Ethernet autoselect
> <118>Configuring syscons: keymap.
> <118>Starting pflogd:
> <118>add net fe80::: gateway ::1
> <118>add net ff02::: gateway ::1
> <118>add net ::ffff:0.0.0.0: gateway ::1
> <118>add net ::0.0.0.0: gateway ::1
> <118>Creating and/or trimming log files.
> <118>Starting syslogd.
> <118>No core dumps found.
> <118>ELF ldconfig path: /lib /usr/lib /usr/lib/compat
> <118>a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout
> <118>Clearing /tmp (X related).
> <118>Updating motd:.
> <118>Mounting late file systems:.
> <118>Configuring syscons: keymap blanktime.
> <118>Performing sanity check on sshd configuration.
> <118>Starting sshd.
> <118>Starting sendmail_submit.
> <118>Starting sendmail_msp_queue.
> <118>Starting cron.
> <118>Starting background file system checks in 60 seconds.
> <118>
> <118>Sat Jan  3 21:25:26 CET 2015
> <118>Jan  3 21:25:31 verdi login: ROOT LOGIN (root) ON ttyv0
> panic: vm_fault: fault on nofault entry, addr: cc0e5000
> cpuid = 0
> KDB: stack backtrace:
> db_trace_self_wrapper(c11b55f1,fc,0,10000000,1,...) at db_trace_self_wrapper+0x2d/frame 0xf0923638
> kdb_backtrace(c1361c84,0,c11e064d,f09236ec,0,...) at kdb_backtrace+0x30/frame 0xf09236a0
> panic(c11e064d,cc0e5000,1,f0923804,f09237f4,...) at panic+0x11f/frame 0xf09236e0
> vm_fault_hold(c1a6d000,cc0e5000,1,0,0,...) at vm_fault_hold+0x2076/frame 0xf0923840
> vm_fault(c1a6d000,cc0e5000,1,0,c0b72331,...) at vm_fault+0x81/frame 0xf0923868
> trap_pfault(cc0e5fb8,c1472000,f0923914,c6baf200,f09239a4,...) at trap_pfault+0x1bb/frame 0xf09238e8
> trap(f0923a34) at trap+0x674/frame 0xf0923a28
> calltrap() at calltrap+0x6/frame 0xf0923a28
> --- trap 0xc, eip = 0xc1049023, esp = 0xf0923a74, ebp = 0xf0923a9c ---
> copyout(f0923b28,cc0e5fb8,4,f0923acc,c142c7a8,...) at copyout+0x37/frame 0xf0923a9c
> sysctl_ip6_temppltime(c142c7a8,c6a9e3a8,0,f0923b28,f0923b28,...) at sysctl_ip6_temppltime+0x3a/frame 0xf0923ac0
> sysctl_root(f0923b28,8,2,c0a058a7,c7017850,...) at sysctl_root+0x2b1/frame 0xf0923b00
> userland_sysctl(c769f310,f0923bac,4,28803030,bfbfdb70,...) at userland_sysctl+0x1fa/frame 0xf0923b70
> sys___sysctl(c769f310,f0923ca8,2e,f0923c64,c0b329f2,...) at sys___sysctl+0x98/frame 0xf0923c18
> syscall(f0923ce8) at syscall+0x4a6/frame 0xf0923cdc
> Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf0923cdc
> --- syscall (202, FreeBSD ELF32, sys___sysctl), eip = 0x281a28b7, esp = 0xbfbfdb00, ebp = 0xbfbfdb28 ---
> KDB: enter: panic
>
> ----------------------------------------------------------------------
>
> panic.txt
>
> vm_fault: fault on nofault entry, addr: cc0e5000
>
> ----------------------------------------------------------------------
>
> version.txt
>
> FreeBSD 10.1-STABLE #1 r276174: Sat Jan  3 20:50:10 CET 2015
>      root@verdi.nethelp.no:/usr/src/sys/i386/compile/GENERICV
> _______________________________________________
> freebsd-stable@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-stable
> To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org"
>



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?54A94B40.5000908>