Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 13 Aug 2009 12:42:26 -0500
From:      Robert Noland <rnoland@FreeBSD.org>
To:        Damian Gerow <dgerow@afflictions.org>
Cc:        Attilio Rao <attilio@freebsd.org>, freebsd-current@freebsd.org
Subject:   Re: No display after resume in r196086
Message-ID:  <1250185346.33905.2.camel@balrog.2hip.net>
In-Reply-To: <20090813173627.GA1498@plebeian.afflictions.org>
References:  <20090813002104.GA1481@plebeian.afflictions.org> <1250161757.1823.18.camel@balrog.2hip.net> <3bbf2fe10908130652t77767929q44ba12f39cb3f997@mail.gmail.com> <20090813162705.GA1468@plebeian.afflictions.org> <3bbf2fe10908130938v525a18c3p9c4e10db662ab3c0@mail.gmail.com> <20090813173627.GA1498@plebeian.afflictions.org>

next in thread | previous in thread | raw e-mail | index | archive | help
On Thu, 2009-08-13 at 13:36 -0400, Damian Gerow wrote:
> Attilio Rao wrote:
> : So, what you can do is to compile a kernel with the following options:
> : KDB, DDB, INVARIANT_SUPPORT, INVARIANTS, WITNESS
> 
> As I'm running GENERIC, these options are already present.
> 
> : when you get the deadlock, you should break in DDB.
> : Through a textdump(4) (or serial console or whatever you prefer) you
> : should get the following informations:
> : bt, ps, show allpcpu, alltrace, show alllocks
> : 
> : and report here.
> 
> I've set ddb script kdb.enter.default="textdump set; capture on; show
> allpcpu; bt; ps; alltrace; showalllocks; showalllock; call doadump; reset",
> as I don't have a serial console on this machine (and my USB<->serial
> adapter doesn't work on FreeBSD).
> 
> The script does not run when resuming in graphics mode, unfortunately.
> Try as I might, I just don't get anything.  I'm not sure what exactly
> the system is doing when it resumes, as attempts to create files on
> the local fs seem to fail.
> 
> Resuming in text mode does generate a panic.  I've included the requested
> information below.  However, this may be a red herring: I've never been
> able to resume in text mode, so it is possible these two resume problems
> are unrelated.

Manually kldload i915.ko when in text mode.  As long as it is loaded, it
should manage the hardware during suspend/resume.  Meaning that you
don't need to be in X for it to do it's thing...

robert.

> Note that the below was generated on r196037.  I'm currently building an
> 8-STABLE for further testing.
> 
> ----- begin msgbuf.txt
> <snip dmesg output>
> 
> <5>em0: link state changed to DOWN
> usbus7: port reset timeout
> uhub_reattach_port:373: port 1 reset failed, error=USB_ERR_TIMEOUT
> uhub_reattach_port:463: device problem (USB_ERR_TIMEOUT), disabling port 1
> calcru: runtime went backwards from 219239654 usec to 74088058 usec for pid
> 11 (idle)
> <5>em0: link state changed to UP
> ugen1.2: <vendor 0x08ff> at usbus1 (disconnected)
> 
> 
> Fatal trap 9: general protection fault while in kernel mode
> cpuid = 0; apic id = 00
> instruction pointer = 0x20:0xffffffff8048e71b
> stack pointer           = 0x28:0xffffff8072d59ad0
> frame pointer           = 0x28:0xffffff8072d59b20
> code segment        = base 0x0, limit 0xfffff, type 0x1b
>             = DPL 0, pres 1, long 1, def32 0, gran 1
>             processor eflags    = interrupt enabled, resume, IOPL = 0
>             current process     = 22 (usbus1)
> ----- end msgbuf.txt
> 
> ----- begin ddb.txt
> db:0:kdb.enter.default>  show allpcpu
> Current CPU: 0
> 
> cpuid        = 0
> dynamic pcpu    = 0x53d514
> curthread    = 0xffffff0003567720: pid 22 "usbus1"
> curpcb       = 0xffffff8072d59d40
> fpcurthread  = none
> idlethread   = 0xffffff00024e6390: pid 11 "idle: cpu0"
> curpmap         = 0
> tssp            = 0xffffffff80de7300
> commontssp      = 0xffffffff80de7300
> rsp0            = 0xffffff8072d59d40
> gs32p           = 0xffffffff80de6138
> ldt             = 0xffffffff80de6178
> tss             = 0xffffffff80de6168
> spin locks held:
> 
> cpuid        = 1
> dynamic pcpu    = 0xffffff807f484514
> curthread    = 0xffffff000b46d390: pid 1372 "hald"
> curpcb       = 0xffffff80755e4d40
> fpcurthread  = none
> idlethread   = 0xffffff00024e6720: pid 11 "idle: cpu1"
> curpmap         = 0
> tssp            = 0xffffffff80de7368
> commontssp      = 0xffffffff80de7368
> rsp0            = 0xffffff80755e4d40
> gs32p           = 0xffffffff80de61a0
> ldt             = 0xffffffff80de61e0
> tss             = 0xffffffff80de61d0
> spin locks held:
> 
> db:0:kdb.enter.default>  bt
> Tracing pid 22 tid 100047 td 0xffffff0003567720
> usb_unconfigure() at usb_unconfigure+0x267
> usb_free_device() at usb_free_device+0x1bc
> uhub_explore() at uhub_explore+0x2a3
> usb_bus_explore() at usb_bus_explore+0x9e
> usb_process() at usb_process+0xcd
> fork_exit() at fork_exit+0x147
> fork_trampoline() at fork_trampoline+0xe
> --- trap 0, rip = 0, rsp = 0xffffff8072d59d30, rbp = 0 ---
> db:0:kdb.enter.default>  ps
>   pid  ppid  pgrp   uid   state   wmesg         wchan        cmd
>  1424  1416   653     0  R                                   acpiconf
>  1416   653   653     0  S       wait     0xffffff0003d63460 sh
>  1411  1360  1411  1001  S+      ttyin    0xffffff00035010a8 zsh
>  1381  1376  1372     0  S       select   0xffffff000b5ea540 initial thread
>  1376  1372  1372     0  S       select   0xffffff000b0bee40 initial thread
>  1375     1  1375     0  Ss      (threaded)                  console-kit-daemon
> 100206                   S       waitvt   0xffffffff80bd7438 console-kit-daemon
> 100205                   S       waitvt   0xffffffff80bd7430 console-kit-daemon
> 100204                   S       waitvt   0xffffffff80bd7428 console-kit-daemon
> 100203                   S       waitvt   0xffffffff80bd7420 console-kit-daemon
> 100202                   S       waitvt   0xffffffff80bd7418 console-kit-daemon
> 100201                   S       waitvt   0xffffffff80bd7410 console-kit-daemon
> 100200                   S       waitvt   0xffffffff80bd7408 console-kit-daemon
> 100199                   S       waitvt   0xffffffff80bd7400 console-kit-daemon
> 100198                   S       waitvt   0xffffffff80bd73f8 console-kit-daemon
> 100197                   S       waitvt   0xffffffff80bd73f0 console-kit-daemon
> 100196                   S       waitvt   0xffffffff80bd73e8 console-kit-daemon
> 100195                   S       waitvt   0xffffffff80bd73e0 console-kit-daemon
> 100194                   S       waitvt   0xffffffff80bd73d8 console-kit-daemon
> 100193                   S       waitvt   0xffffffff80bd73d0 console-kit-daemon
> 100192                   S       waitvt   0xffffffff80bd73c8 console-kit-daemon
> 100191                   S       ucond    0xffffff0003870980 console-kit-daemon
> 100126                   S       select   0xffffff0003dfda40 console-kit-daemon
>  1372     1  1372   560  Rs      CPU 1                       hald
>  1367     1  1367     0  Ss+     ttyin    0xffffff00033318a8 getty
>  1366     1  1366     0  Ss+     ttyin    0xffffff00034fd8a8 getty
>  1365     1  1365     0  Ss+     ttyin    0xffffff00034fe4a8 getty
>  1364     1  1364     0  Ss+     ttyin    0xffffff00035000a8 getty
>  1363     1  1363     0  Ss+     ttyin    0xffffff00034fd0a8 getty
>  1362     1  1362     0  Ss+     ttyin    0xffffff0003500ca8 getty
>  1361     1  1361     0  Ss+     ttyin    0xffffff00035008a8 getty
>  1360     1  1360     0  Ss+     wait     0xffffff000b416460 login
>  1358  1356   292     0  S+      nanslp   0xffffffff80bdc5e8 sleep
>  1357     1   292     0  S+      piperd   0xffffff00039dc5b0 logger
>  1356     1   292     0  S+      wait     0xffffff0003f738c0 sh
>  1304     1  1304     0  Ss      nanslp   0xffffffff80bdc5e8 cron
>  1295     1  1295     0  Ss      select   0xffffff000b22c2c0 sshd
>  1252     1  1252   556  Ss      select   0xffffff000b0da9c0 dbus-daemon
>  1247  1236  1236   125  S       kqread   0xffffff000b240b00 qmgr
>  1245  1236  1236   125  S       kqread   0xffffff000b3ac000 pickup
>  1236     1  1236     0  Ss      kqread   0xffffff000b37b700 master
>  1117     1  1117    65  Ss      select   0xffffff000b0e8940 dhclient
>  1101     1  1101     0  Ss      select   0xffffff000b0ead40 dhclient
>  1077     1  1077     0  Ss      kqread   0xffffff0003ff4500 cupsd
>  1034     1  1034     0  Ss      select   0xffffff0003e76840 powerd
>   961     1   961     0  Ss      rpcsvc   0xffffff0003d8b1a0 NLM: master
>   948     1   948     0  Ss      select   0xffffff000b009540 rpc.statd
>   946     1   946     0  Ss      select   0xffffff0003e774c0 rpcbind
>   872     0     0     0  SL      mdwait   0xffffff0003e9d800 [md0]
>   823     1   823     0  Ss      select   0xffffff0003e76e40 syslogd
>   726     0     0     0  SL      -        0xffffffff80bd9640 [accounting]
>   653     1   653     0  Ss      wait     0xffffff0003f75000 devd
>   285     0     0     0  SL      tq->tq_d 0xffffff0003ae3720 [zil_clean]
>   284     0     0     0  SL      tq->tq_d 0xffffff0003a70840 [zil_clean]
>   283     0     0     0  SL      tq->tq_d 0xffffff0003ae32a0 [zil_clean]
>   282     0     0     0  SL      tq->tq_d 0xffffff0003ae3180 [zil_clean]
>   281     0     0     0  SL      tq->tq_d 0xffffff0003ae3060 [zil_clean]
>   280     0     0     0  SL      tq->tq_d 0xffffff0003ae3840 [zil_clean]
>   279     0     0     0  SL      tq->tq_d 0xffffff0003a71840 [zil_clean]
>   278     0     0     0  SL      tq->tq_d 0xffffff0003a71720 [zil_clean]
>   277     0     0     0  SL      tq->tq_d 0xffffff0003a71600 [zil_clean]
>   276     0     0     0  SL      tq->tq_d 0xffffff0003a714e0 [zil_clean]
>   275     0     0     0  SL      tx->tx_s 0xffffff000365b638 [txg_thread_enter]
>   274     0     0     0  SL      tx->tx_q 0xffffff000365b658 [txg_thread_enter]
>   273     0     0     0  SL      vgeom:io 0xffffff0003acfc90 [vdev:worker ad4s1d.]
>   272     0     0     0  SL      tq->tq_d 0xffffff0003a713c0 [spa_zio]
>   271     0     0     0  SL      tq->tq_d 0xffffff0003a712a0 [spa_zio]
>   270     0     0     0  SL      tq->tq_d 0xffffff0003a71180 [spa_zio]
>   269     0     0     0  SL      tq->tq_d 0xffffff0003a71de0 [spa_zio]
>   268     0     0     0  SL      tq->tq_d 0xffffff0003af32a0 [spa_zio]
>   267     0     0     0  SL      tq->tq_d 0xffffff0003af3180 [spa_zio]
>   266     0     0     0  SL      tq->tq_d 0xffffff0003af3060 [spa_zio]
>   265     0     0     0  SL      tq->tq_d 0xffffff0003ae3de0 [spa_zio]
>   264     0     0     0  SL      tq->tq_d 0xffffff0003ae3de0 [spa_zio]
>   263     0     0     0  SL      tq->tq_d 0xffffff0003ae3de0 [spa_zio]
>   262     0     0     0  SL      tq->tq_d 0xffffff0003ae3de0 [spa_zio]
>   261     0     0     0  SL      tq->tq_d 0xffffff0003ae3de0 [spa_zio]
>   260     0     0     0  SL      tq->tq_d 0xffffff0003ae3de0 [spa_zio]
>   259     0     0     0  SL      tq->tq_d 0xffffff0003ae3de0 [spa_zio]
>   258     0     0     0  SL      tq->tq_d 0xffffff0003ae3de0 [spa_zio]
>   257     0     0     0  SL      tq->tq_d 0xffffff0003ae3cc0 [spa_zio]
>   256     0     0     0  SL      tq->tq_d 0xffffff0003ae3cc0 [spa_zio]
>   255     0     0     0  SL      tq->tq_d 0xffffff0003ae3cc0 [spa_zio]
>   254     0     0     0  SL      tq->tq_d 0xffffff0003ae3cc0 [spa_zio]
>   253     0     0     0  SL      tq->tq_d 0xffffff0003ae3cc0 [spa_zio]
>   252     0     0     0  SL      tq->tq_d 0xffffff0003ae3cc0 [spa_zio]
>   251     0     0     0  SL      tq->tq_d 0xffffff0003ae3cc0 [spa_zio]
>   250     0     0     0  SL      tq->tq_d 0xffffff0003ae3cc0 [spa_zio]
>   249     0     0     0  SL      tq->tq_d 0xffffff0003ae3ba0 [spa_zio]
>   248     0     0     0  SL      tq->tq_d 0xffffff0003ae3a80 [spa_zio]
>   247     0     0     0  SL      tq->tq_d 0xffffff0003ae3960 [spa_zio]
>   192     0     0     0  SL      geli:w   0xffffff0003649400 [g_eli[1] ad4s1d]
>   191     0     0     0  SL      geli:w   0xffffff0003649400 [g_eli[0] ad4s1d]
>   186     0     0     0  SL      crypto_r 0xffffffff813398a0 [crypto returns]
>   185     0     0     0  SL      crypto_w 0xffffffff81339860 [crypto]
>    75     0     0     0  SL      l2arc_fe 0xffffffff8130be80 [l2arc_feed_thread]
>    74     0     0     0  SL      arc_recl 0xffffffff813038a0 [arc_reclaim_thread]
>    72     0     0     0  SL      vacv     0xffffffff813025a0 [vaclean]
>    71     0     0     0  SL      tq->tq_d 0xffffff0003a71060 [system_taskq]
>    70     0     0     0  SL      tq->tq_d 0xffffff0003a71060 [system_taskq]
>    52     0     0     0  SL      flowclea 0xffffffff80bdc2c4 [flowcleaner]
>    51     0     0     0  SL      sdflush  0xffffffff80dacd58 [softdepflush]
>    50     0     0     0  SL      syncer   0xffffffff80d9dbc0 [syncer]
>    49     0     0     0  SL      vlruwt   0xffffff000358a000 [vnlru]
>    48     0     0     0  SL      psleep   0xffffffff80d9d6e8 [bufdaemon]
>     9     0     0     0  SL      pgzero   0xffffffff80dae7ac [pagezero]
>     8     0     0     0  SL      psleep   0xffffffff80dadb48 [vmdaemon]
>     7     0     0     0  SL      psleep   0xffffffff80dadb0c [pagedaemon]
>    47     0     0     0  SL      wmsg     0xffffff8000326dd0 [usbus7]
>    46     0     0     0  SL      wmsg     0xffffff8000326d78 [usbus7]
>    45     0     0     0  SL      wmsg     0xffffff8000326d20 [usbus7]
>    44     0     0     0  SL      wmsg     0xffffff8000326cc8 [usbus7]
>    43     0     0     0  SL      wmsg     0xffffff800031def0 [usbus6]
>    42     0     0     0  SL      wmsg     0xffffff800031de98 [usbus6]
>    41     0     0     0  SL      wmsg     0xffffff800031de40 [usbus6]
>    40     0     0     0  SL      wmsg     0xffffff800031dde8 [usbus6]
>    39     0     0     0  SL      wmsg     0xffffff8000314ef0 [usbus5]
>    38     0     0     0  SL      wmsg     0xffffff8000314e98 [usbus5]
>    37     0     0     0  SL      wmsg     0xffffff8000314e40 [usbus5]
>    36     0     0     0  SL      wmsg     0xffffff8000314de8 [usbus5]
>    35     0     0     0  SL      wmsg     0xffffff800030bef0 [usbus4]
>    34     0     0     0  SL      wmsg     0xffffff800030be98 [usbus4]
>    33     0     0     0  SL      wmsg     0xffffff800030be40 [usbus4]
>    32     0     0     0  SL      wmsg     0xffffff800030bde8 [usbus4]
>    31     0     0     0  SL      wmsg     0xffffff8000302dd0 [usbus3]
>    30     0     0     0  SL      wmsg     0xffffff8000302d78 [usbus3]
>    29     0     0     0  SL      wmsg     0xffffff8000302d20 [usbus3]
>    28     0     0     0  SL      wmsg     0xffffff8000302cc8 [usbus3]
>    27     0     0     0  SL      wmsg     0xffffff80002f9ef0 [usbus2]
>    26     0     0     0  SL      wmsg     0xffffff80002f9e98 [usbus2]
>    25     0     0     0  SL      wmsg     0xffffff80002f9e40 [usbus2]
>    24     0     0     0  SL      wmsg     0xffffff80002f9de8 [usbus2]
>    23     0     0     0  SL      wmsg     0xffffff80002f0ef0 [usbus1]
>    22     0     0     0  RL      CPU 0                       [usbus1]
>    21     0     0     0  SL      wmsg     0xffffff80002f0e40 [usbus1]
>    20     0     0     0  SL      wmsg     0xffffff80002f0de8 [usbus1]
>    19     0     0     0  SL      wmsg     0xffffff80002e7ef0 [usbus0]
>    18     0     0     0  SL      wmsg     0xffffff80002e7e98 [usbus0]
>    17     0     0     0  SL      wmsg     0xffffff80002e7e40 [usbus0]
>    16     0     0     0  SL      wmsg     0xffffff80002e7de8 [usbus0]
>     6     0     0     0  SL      waiting_ 0xffffffff80da0ae0 [sctp_iterator]
>    15     0     0     0  SL      cooling  0xffffff0002713558 [acpi_cooling1]
>    14     0     0     0  RL                                  [acpi_thermal]
>     5     0     0     0  SL      ccb_scan 0xffffffff80ba5560 [xpt_thrd]
>    13     0     0     0  SL      -        0xffffffff80bdc2c4 [yarrow]
>     4     0     0     0  SL      -        0xffffffff80bd8aa8 [g_down]
>     3     0     0     0  RL                                  [g_up]
>     2     0     0     0  SL      -        0xffffffff80bd8a90 [g_event]
>    12     0     0     0  WL      (threaded)                  intr
> 100039                   I                                   [irq12: psm0]
> 100038                   I                                   [irq1: atkbd0]
> 100035                   I                                   [irq19: ehci1]
> 100034                   I                                   [irq18: uhci5]
> 100033                   I                                   [irq17: uhci4]
> 100032                   I                                   [irq16: uhci3+]
> 100031                   I                                   [irq257: hdac0]
> 100030                   I                                   [irq23: ehci0+]
> 100029                   I                                   [irq22: uhci2]
> 100028                   I                                   [irq21: uhci1]
> 100027                   I                                   [irq20: uhci0]
> 100025                   I                                   [irq9: acpi0]
> 100024                   I                                   [swi6: task queue]
> 100023                   I                                   [swi6: Giant taskq]
> 100020                   I                                   [swi5: +]
> 100019                   I                                   [swi2: cambio]
> 100008                   I                                   [swi1: netisr 0]
> 100007                   I                                   [swi3: vm]
> 100006                   I                                   [swi4: clock]
> 100005                   I                                   [swi4: clock]
>    11     0     0     0  RL      (threaded)                  idle
> 100004                   CanRun                              [idle: cpu0]
> 100003                   CanRun                              [idle: cpu1]
>     1     0     1     0  SLs     wait     0xffffff00024e38c0 [init]
>    10     0     0     0  SL      audit_wo 0xffffffff80dac0b0 [audit]
>     0     0     0     0  SLs     (threaded)                  kernel
> 100026                   D       -        0xffffff0002711d80 [em0 taskq]
> 100022                   D       -        0xffffff0002621980 [aiod_bio taskq]
> 100021                   D       -        0xffffff0002621a00 [thread taskq]
> 100017                   D       -        0xffffff0002647380 [kqueue taskq]
> 100016                   D       -        0xffffff0002647400 [acpi_task_2]
> 100015                   D       -        0xffffff0002647400 [acpi_task_1]
> 100014                   D       ecgpe    0xffffff00026badf0 [acpi_task_0]
> 100012                   D       -        0xffffff00024f7780 [firmware taskq]
> 100000                   D       sched    0xffffffff80bd8ba0 [swapper]
> db:0:kdb.enter.default>  alltrace
> 
> Tracing command acpiconf pid 1424 tid 100177 td 0xffffff0003f86720
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> ast() at ast+0x27d
> doreti_ast() at doreti_ast+0x1f
> 
> Tracing command sh pid 1416 tid 100154 td 0xffffff0003d90390
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _sleep() at _sleep+0x338
> kern_wait() at kern_wait+0xa9e
> wait4() at wait4+0x3a
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (7, FreeBSD ELF64, wait4), rip = 0x80092f16c, rsp = 0x7fffffffe988, rbp = 0x28d ---
> 
> Tracing command zsh pid 1411 tid 100179 td 0xffffff0003f86000
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _cv_wait_sig() at _cv_wait_sig+0x23b
> tty_wait() at tty_wait+0x65
> ttydisc_read() at ttydisc_read+0x220
> ttydev_read() at ttydev_read+0x86
> devfs_read_f() at devfs_read_f+0x7f
> dofileread() at dofileread+0x97
> kern_readv() at kern_readv+0x46
> read() at read+0x4e
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (3, FreeBSD ELF64, read), rip = 0x800bea14c, rsp = 0x7fffffffe768, rbp = 0 ---
> 
> Tracing command hald-addon-mouse-sy pid 1381 tid 100164 td 0xffffff0003afeab0
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12
> _cv_timedwait_sig() at _cv_timedwait_sig+0x24b
> seltdwait() at seltdwait+0x73
> poll() at poll+0x325
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (209, FreeBSD ELF64, poll), rip = 0x800e0d4dc, rsp = 0x7fffffffe6a8, rbp = 0x80161d100 ---
> 
> Tracing command hald-runner pid 1376 tid 100159 td 0xffffff0003d8f000
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _cv_wait_sig() at _cv_wait_sig+0x23b
> seltdwait() at seltdwait+0x84
> poll() at poll+0x325
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (209, FreeBSD ELF64, poll), rip = 0x800c0d4dc, rsp = 0x7fffffffeb68, rbp = 0x1 ---
> 
> Tracing command console-kit-daemon pid 1375 tid 100206 td 0xffffff000b4f8720
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _sleep() at _sleep+0x338
> sctty_ioctl() at sctty_ioctl+0xe13
> tty_ioctl() at tty_ioctl+0xaa
> ttydev_ioctl() at ttydev_ioctl+0x99
> devfs_ioctl_f() at devfs_ioctl_f+0xde
> kern_ioctl() at kern_ioctl+0x1e4
> ioctl() at ioctl+0x158
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffafff38, rbp = 0x10 ---
> 
> Tracing command console-kit-daemon pid 1375 tid 100205 td 0xffffff000b4f8ab0
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _sleep() at _sleep+0x338
> sctty_ioctl() at sctty_ioctl+0xe13
> tty_ioctl() at tty_ioctl+0xaa
> ttydev_ioctl() at ttydev_ioctl+0x99
> devfs_ioctl_f() at devfs_ioctl_f+0xde
> kern_ioctl() at kern_ioctl+0x1e4
> ioctl() at ioctl+0x158
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb10f38, rbp = 0xf ---
> 
> Tracing command console-kit-daemon pid 1375 tid 100204 td 0xffffff000b4fb000
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _sleep() at _sleep+0x338
> sctty_ioctl() at sctty_ioctl+0xe13
> tty_ioctl() at tty_ioctl+0xaa
> ttydev_ioctl() at ttydev_ioctl+0x99
> devfs_ioctl_f() at devfs_ioctl_f+0xde
> kern_ioctl() at kern_ioctl+0x1e4
> ioctl() at ioctl+0x158
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb21f38, rbp = 0xe ---
> 
> Tracing command console-kit-daemon pid 1375 tid 100203 td 0xffffff000b4fb390
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _sleep() at _sleep+0x338
> sctty_ioctl() at sctty_ioctl+0xe13
> tty_ioctl() at tty_ioctl+0xaa
> ttydev_ioctl() at ttydev_ioctl+0x99
> devfs_ioctl_f() at devfs_ioctl_f+0xde
> kern_ioctl() at kern_ioctl+0x1e4
> ioctl() at ioctl+0x158
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb32f38, rbp = 0xd ---
> 
> Tracing command console-kit-daemon pid 1375 tid 100202 td 0xffffff000b4fb720
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _sleep() at _sleep+0x338
> sctty_ioctl() at sctty_ioctl+0xe13
> tty_ioctl() at tty_ioctl+0xaa
> ttydev_ioctl() at ttydev_ioctl+0x99
> devfs_ioctl_f() at devfs_ioctl_f+0xde
> kern_ioctl() at kern_ioctl+0x1e4
> ioctl() at ioctl+0x158
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb43f38, rbp = 0xc ---
> 
> Tracing command console-kit-daemon pid 1375 tid 100201 td 0xffffff000b4fbab0
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _sleep() at _sleep+0x338
> sctty_ioctl() at sctty_ioctl+0xe13
> tty_ioctl() at tty_ioctl+0xaa
> ttydev_ioctl() at ttydev_ioctl+0x99
> devfs_ioctl_f() at devfs_ioctl_f+0xde
> kern_ioctl() at kern_ioctl+0x1e4
> ioctl() at ioctl+0x158
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb54f38, rbp = 0xb ---
> 
> Tracing command console-kit-daemon pid 1375 tid 100200 td 0xffffff000b4fc000
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _sleep() at _sleep+0x338
> sctty_ioctl() at sctty_ioctl+0xe13
> tty_ioctl() at tty_ioctl+0xaa
> ttydev_ioctl() at ttydev_ioctl+0x99
> devfs_ioctl_f() at devfs_ioctl_f+0xde
> kern_ioctl() at kern_ioctl+0x1e4
> ioctl() at ioctl+0x158
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb65f38, rbp = 0xa ---
> 
> Tracing command console-kit-daemon pid 1375 tid 100199 td 0xffffff000b4fc390
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _sleep() at _sleep+0x338
> sctty_ioctl() at sctty_ioctl+0xe13
> tty_ioctl() at tty_ioctl+0xaa
> ttydev_ioctl() at ttydev_ioctl+0x99
> devfs_ioctl_f() at devfs_ioctl_f+0xde
> kern_ioctl() at kern_ioctl+0x1e4
> ioctl() at ioctl+0x158
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb76f38, rbp = 0x9 ---
> 
> Tracing command console-kit-daemon pid 1375 tid 100198 td 0xffffff0003f8b720
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _sleep() at _sleep+0x338
> sctty_ioctl() at sctty_ioctl+0xe13
> tty_ioctl() at tty_ioctl+0xaa
> ttydev_ioctl() at ttydev_ioctl+0x99
> devfs_ioctl_f() at devfs_ioctl_f+0xde
> kern_ioctl() at kern_ioctl+0x1e4
> ioctl() at ioctl+0x158
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb87f38, rbp = 0x8 ---
> 
> Tracing command console-kit-daemon pid 1375 tid 100197 td 0xffffff0003f8bab0
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _sleep() at _sleep+0x338
> sctty_ioctl() at sctty_ioctl+0xe13
> tty_ioctl() at tty_ioctl+0xaa
> ttydev_ioctl() at ttydev_ioctl+0x99
> devfs_ioctl_f() at devfs_ioctl_f+0xde
> kern_ioctl() at kern_ioctl+0x1e4
> ioctl() at ioctl+0x158
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb98f38, rbp = 0x7 ---
> 
> Tracing command console-kit-daemon pid 1375 tid 100196 td 0xffffff000b46f000
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _sleep() at _sleep+0x338
> sctty_ioctl() at sctty_ioctl+0xe13
> tty_ioctl() at tty_ioctl+0xaa
> ttydev_ioctl() at ttydev_ioctl+0x99
> devfs_ioctl_f() at devfs_ioctl_f+0xde
> kern_ioctl() at kern_ioctl+0x1e4
> ioctl() at ioctl+0x158
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffba9f38, rbp = 0x6 ---
> 
> Tracing command console-kit-daemon pid 1375 tid 100195 td 0xffffff000b46f390
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _sleep() at _sleep+0x338
> sctty_ioctl() at sctty_ioctl+0xe13
> tty_ioctl() at tty_ioctl+0xaa
> ttydev_ioctl() at ttydev_ioctl+0x99
> devfs_ioctl_f() at devfs_ioctl_f+0xde
> kern_ioctl() at kern_ioctl+0x1e4
> ioctl() at ioctl+0x158
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffbbaf38, rbp = 0x5 ---
> 
> Tracing command console-kit-daemon pid 1375 tid 100194 td 0xffffff000b46f720
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _sleep() at _sleep+0x338
> sctty_ioctl() at sctty_ioctl+0xe13
> tty_ioctl() at tty_ioctl+0xaa
> ttydev_ioctl() at ttydev_ioctl+0x99
> devfs_ioctl_f() at devfs_ioctl_f+0xde
> kern_ioctl() at kern_ioctl+0x1e4
> ioctl() at ioctl+0x158
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffbcbf38, rbp = 0x4 ---
> 
> Tracing command console-kit-daemon pid 1375 tid 100193 td 0xffffff000b46fab0
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _sleep() at _sleep+0x338
> sctty_ioctl() at sctty_ioctl+0xe13
> tty_ioctl() at tty_ioctl+0xaa
> ttydev_ioctl() at ttydev_ioctl+0x99
> devfs_ioctl_f() at devfs_ioctl_f+0xde
> kern_ioctl() at kern_ioctl+0x1e4
> ioctl() at ioctl+0x158
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffbdcf38, rbp = 0x3 ---
> 
> Tracing command console-kit-daemon pid 1375 tid 100192 td 0xffffff000b46c000
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _sleep() at _sleep+0x338
> sctty_ioctl() at sctty_ioctl+0xe13
> tty_ioctl() at tty_ioctl+0xaa
> ttydev_ioctl() at ttydev_ioctl+0x99
> devfs_ioctl_f() at devfs_ioctl_f+0xde
> kern_ioctl() at kern_ioctl+0x1e4
> ioctl() at ioctl+0x158
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffbedf38, rbp = 0x2 ---
> 
> Tracing command console-kit-daemon pid 1375 tid 100191 td 0xffffff0003a25ab0
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _sleep() at _sleep+0x338
> do_cv_wait() at do_cv_wait+0x4e1
> __umtx_op_cv_wait() at __umtx_op_cv_wait+0x58
> _umtx_op() at _umtx_op+0x1c
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80143ef0c, rsp = 0x7fffffbfed58, rbp = 0x80186d380 ---
> 
> Tracing command console-kit-daemon pid 1375 tid 100126 td 0xffffff0003acb390
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _cv_wait_sig() at _cv_wait_sig+0x23b
> seltdwait() at seltdwait+0x84
> poll() at poll+0x325
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (209, FreeBSD ELF64, poll), rip = 0x8015da4dc, rsp = 0x7fffffffeac8, rbp = 0x4 ---
> 
> Tracing command hald pid 1372 tid 100186 td 0xffffff000b46d390
> cpustop_handler() at cpustop_handler+0x40
> ipi_nmi_handler() at ipi_nmi_handler+0x36
> trap() at trap+0x42
> nmi_calltrap() at nmi_calltrap+0x8
> --- trap 0x13, rip = 0xffffffff8055b213, rsp = 0xffffff8000018fe0, rbp = 0xffffff80755e4970 ---
> _sx_slock_hard() at _sx_slock_hard+0x13c
> _sx_slock() at _sx_slock+0xaa
> newbus_slock() at newbus_slock+0x21
> acpi_battery_ioctl() at acpi_battery_ioctl+0x6f
> acpiioctl() at acpiioctl+0x163
> devfs_ioctl_f() at devfs_ioctl_f+0xde
> kern_ioctl() at kern_ioctl+0x1e4
> ioctl() at ioctl+0x158
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x8012370ec, rsp = 0x7fffffffe598, rbp = 0x801a0ab60 ---
> 
> Tracing command getty pid 1367 tid 100184 td 0xffffff000b46dab0
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _cv_wait_sig() at _cv_wait_sig+0x23b
> tty_wait() at tty_wait+0x65
> ttydisc_read() at ttydisc_read+0x220
> ttydev_read() at ttydev_read+0x86
> devfs_read_f() at devfs_read_f+0x7f
> dofileread() at dofileread+0x97
> kern_readv() at kern_readv+0x46
> read() at read+0x4e
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (3, FreeBSD ELF64, read), rip = 0x80084014c, rsp = 0x7fffffffecc8, rbp = 0 ---
> 
> Tracing command getty pid 1366 tid 100178 td 0xffffff0003f86390
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _cv_wait_sig() at _cv_wait_sig+0x23b
> tty_wait() at tty_wait+0x65
> ttydisc_read() at ttydisc_read+0x220
> ttydev_read() at ttydev_read+0x86
> devfs_read_f() at devfs_read_f+0x7f
> dofileread() at dofileread+0x97
> kern_readv() at kern_readv+0x46
> read() at read+0x4e
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (3, FreeBSD ELF64, read), rip = 0x80084014c, rsp = 0x7fffffffecc8, rbp = 0 ---
> 
> Tracing command getty pid 1365 tid 100183 td 0xffffff000b468000
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _cv_wait_sig() at _cv_wait_sig+0x23b
> tty_wait() at tty_wait+0x65
> ttydisc_read() at ttydisc_read+0x220
> ttydev_read() at ttydev_read+0x86
> devfs_read_f() at devfs_read_f+0x7f
> dofileread() at dofileread+0x97
> kern_readv() at kern_readv+0x46
> read() at read+0x4e
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (3, FreeBSD ELF64, read), rip = 0x80084014c, rsp = 0x7fffffffecc8, rbp = 0 ---
> 
> Tracing command getty pid 1364 tid 100182 td 0xffffff000b468390
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _cv_wait_sig() at _cv_wait_sig+0x23b
> tty_wait() at tty_wait+0x65
> ttydisc_read() at ttydisc_read+0x220
> ttydev_read() at ttydev_read+0x86
> devfs_read_f() at devfs_read_f+0x7f
> dofileread() at dofileread+0x97
> kern_readv() at kern_readv+0x46
> read() at read+0x4e
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (3, FreeBSD ELF64, read), rip = 0x80084014c, rsp = 0x7fffffffecc8, rbp = 0 ---
> 
> Tracing command getty pid 1363 tid 100181 td 0xffffff0003d92720
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _cv_wait_sig() at _cv_wait_sig+0x23b
> tty_wait() at tty_wait+0x65
> ttydisc_read() at ttydisc_read+0x220
> ttydev_read() at ttydev_read+0x86
> devfs_read_f() at devfs_read_f+0x7f
> dofileread() at dofileread+0x97
> kern_readv() at kern_readv+0x46
> read() at read+0x4e
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (3, FreeBSD ELF64, read), rip = 0x80084014c, rsp = 0x7fffffffecc8, rbp = 0 ---
> 
> Tracing command getty pid 1362 tid 100180 td 0xffffff0003d92ab0
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _cv_wait_sig() at _cv_wait_sig+0x23b
> tty_wait() at tty_wait+0x65
> ttydisc_read() at ttydisc_read+0x220
> ttydev_read() at ttydev_read+0x86
> devfs_read_f() at devfs_read_f+0x7f
> dofileread() at dofileread+0x97
> kern_readv() at kern_readv+0x46
> read() at read+0x4e
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (3, FreeBSD ELF64, read), rip = 0x80084014c, rsp = 0x7fffffffecc8, rbp = 0 ---
> 
> Tracing command getty pid 1361 tid 100094 td 0xffffff0003a28ab0
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _cv_wait_sig() at _cv_wait_sig+0x23b
> tty_wait() at tty_wait+0x65
> ttydisc_read() at ttydisc_read+0x220
> ttydev_read() at ttydev_read+0x86
> devfs_read_f() at devfs_read_f+0x7f
> dofileread() at dofileread+0x97
> kern_readv() at kern_readv+0x46
> read() at read+0x4e
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (3, FreeBSD ELF64, read), rip = 0x80084014c, rsp = 0x7fffffffecc8, rbp = 0 ---
> 
> Tracing command login pid 1360 tid 100188 td 0xffffff000b46cab0
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _sleep() at _sleep+0x338
> kern_wait() at kern_wait+0xa9e
> wait4() at wait4+0x3a
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (7, FreeBSD ELF64, wait4), rip = 0x8009e416c, rsp = 0x7fffffffec58, rbp = 0x800b969c0 ---
> 
> Tracing command sleep pid 1358 tid 100089 td 0xffffff00037aeab0
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12
> _sleep() at _sleep+0x312
> kern_nanosleep() at kern_nanosleep+0xec
> nanosleep() at nanosleep+0x61
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (240, FreeBSD ELF64, nanosleep), rip = 0x800710cfc, rsp = 0x7fffffffed58, rbp = 0x7fffffffedb0 ---
> 
> Tracing command logger pid 1357 tid 100170 td 0xffffff0003f8a390
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _sleep() at _sleep+0x338
> pipe_read() at pipe_read+0x3ce
> dofileread() at dofileread+0x97
> kern_readv() at kern_readv+0x46
> read() at read+0x4e
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (3, FreeBSD ELF64, read), rip = 0x80072e14c, rsp = 0x7fffffffe858, rbp = 0x7fffffffed78 ---
> 
> Tracing command sh pid 1356 tid 100167 td 0xffffff0003f8b000
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _sleep() at _sleep+0x338
> kern_wait() at kern_wait+0xa9e
> wait4() at wait4+0x3a
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (7, FreeBSD ELF64, wait4), rip = 0x80092f16c, rsp = 0x7fffffffccb8, rbp = 0x124 ---
> 
> Tracing command cron pid 1304 tid 100176 td 0xffffff0003f86ab0
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12
> _sleep() at _sleep+0x312
> kern_nanosleep() at kern_nanosleep+0xec
> nanosleep() at nanosleep+0x61
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (240, FreeBSD ELF64, nanosleep), rip = 0x80092ecfc, rsp = 0x7fffffffeb38, rbp = 0x29 ---
> 
> Tracing command sshd pid 1295 tid 100169 td 0xffffff0003f8a720
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _cv_wait_sig() at _cv_wait_sig+0x23b
> seltdwait() at seltdwait+0x84
> kern_select() at kern_select+0x507
> select() at select+0x54
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (93, FreeBSD ELF64, select), rip = 0x8013b70cc, rsp = 0x7fffffffe318, rbp = 0x4 ---
> 
> Tracing command dbus-daemon pid 1252 tid 100121 td 0xffffff0003acd720
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12
> _cv_timedwait_sig() at _cv_timedwait_sig+0x24b
> seltdwait() at seltdwait+0x73
> poll() at poll+0x325
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (209, FreeBSD ELF64, poll), rip = 0x8009544dc, rsp = 0x7fffffffe6c8, rbp = 0 ---
> 
> Tracing command qmgr pid 1247 tid 100157 td 0xffffff0003d8f720
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12
> _sleep() at _sleep+0x312
> kern_kevent() at kern_kevent+0x3a7
> kevent() at kevent+0x199
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (363, FreeBSD ELF64, kevent), rip = 0x801132c0c, rsp = 0x7fffffffd9e8, rbp = 0x7fffffffd9f0 ---
> 
> Tracing command pickup pid 1245 tid 100152 td 0xffffff0003d90ab0
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12
> _sleep() at _sleep+0x312
> kern_kevent() at kern_kevent+0x3a7
> kevent() at kevent+0x199
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (363, FreeBSD ELF64, kevent), rip = 0x801126c0c, rsp = 0x7fffffffda28, rbp = 0x7fffffffda30 ---
> 
> Tracing command master pid 1236 tid 100093 td 0xffffff0003a2a000
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12
> _sleep() at _sleep+0x312
> kern_kevent() at kern_kevent+0x3a7
> kevent() at kevent+0x199
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (363, FreeBSD ELF64, kevent), rip = 0x80111dc0c, rsp = 0x7fffffffdce8, rbp = 0x7fffffffdcf0 ---
> 
> Tracing command dhclient pid 1117 tid 100162 td 0xffffff0003d8e390
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12
> _cv_timedwait_sig() at _cv_timedwait_sig+0x24b
> seltdwait() at seltdwait+0x73
> poll() at poll+0x325
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (209, FreeBSD ELF64, poll), rip = 0x8006eb4dc, rsp = 0x7fffffffece8, rbp = 0x2 ---
> 
> Tracing command dhclient pid 1101 tid 100166 td 0xffffff0003f8b390
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _cv_wait_sig() at _cv_wait_sig+0x23b
> seltdwait() at seltdwait+0x84
> poll() at poll+0x325
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (209, FreeBSD ELF64, poll), rip = 0x8006eb4dc, rsp = 0x7fffffffece8, rbp = 0x9 ---
> 
> Tracing command cupsd pid 1077 tid 100132 td 0xffffff0003a94ab0
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _sleep() at _sleep+0x338
> kern_kevent() at kern_kevent+0x3a7
> kevent() at kevent+0x199
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (363, FreeBSD ELF64, kevent), rip = 0x801257c0c, rsp = 0x7fffffffe7d8, rbp = 0x1 ---
> 
> Tracing command powerd pid 1034 tid 100161 td 0xffffff0003d8e720
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12
> _cv_timedwait_sig() at _cv_timedwait_sig+0x24b
> seltdwait() at seltdwait+0x73
> kern_select() at kern_select+0x507
> select() at select+0x54
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (93, FreeBSD ELF64, select), rip = 0x80083d0cc, rsp = 0x7fffffffe7e8, rbp = 0x960 ---
> 
> Tracing command rpc.lockd pid 961 tid 100171 td 0xffffff0003f8a000
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12
> _cv_timedwait_sig() at _cv_timedwait_sig+0x24b
> svc_run_internal() at svc_run_internal+0x2f8
> svc_run() at svc_run+0x97
> nlm_syscall() at nlm_syscall+0x6f7
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (154, FreeBSD ELF64, nlm_syscall), rip = 0x8008baeac, rsp = 0x7fffffffec38, rbp = 0x7fffffffed60 ---
> 
> Tracing command rpc.statd pid 948 tid 100122 td 0xffffff0003acd390
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12
> _cv_timedwait_sig() at _cv_timedwait_sig+0x24b
> seltdwait() at seltdwait+0x73
> kern_select() at kern_select+0x507
> select() at select+0x54
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (93, FreeBSD ELF64, select), rip = 0x8008380cc, rsp = 0x7fffffffeb58, rbp = 0x800980900 ---
> 
> Tracing command rpcbind pid 946 tid 100168 td 0xffffff0003f8aab0
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12
> _cv_timedwait_sig() at _cv_timedwait_sig+0x24b
> seltdwait() at seltdwait+0x73
> poll() at poll+0x325
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (209, FreeBSD ELF64, poll), rip = 0x8008fb4dc, rsp = 0x7fffffffcad8, rbp = 0x800b100c0 ---
> 
> Tracing command md0 pid 872 tid 100090 td 0xffffff0003a2a390
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_wait() at sleepq_wait+0x6d
> _sleep() at _sleep+0x348
> md_kthread() at md_kthread+0x10c
> fork_exit() at fork_exit+0x147
> fork_trampoline() at fork_trampoline+0xe
> --- trap 0, rip = 0, rsp = 0xffffff8075400d30, rbp = 0 ---
> 
> Tracing command syslogd pid 823 tid 100174 td 0xffffff0003f87390
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _cv_wait_sig() at _cv_wait_sig+0x23b
> seltdwait() at seltdwait+0x84
> kern_select() at kern_select+0x507
> select() at select+0x54
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (93, FreeBSD ELF64, select), rip = 0x8008430cc, rsp = 0x7fffffffdd08, rbp = 0x800a2f0d0 ---
> 
> Tracing command accounting pid 726 tid 100103 td 0xffffff0003a94000
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_timedwait() at sleepq_timedwait+0x6d
> _sleep() at _sleep+0x322
> acct_thread() at acct_thread+0x2b2
> fork_exit() at fork_exit+0x147
> fork_trampoline() at fork_trampoline+0xe
> --- trap 0, rip = 0, rsp = 0xffffff8075441d30, rbp = 0 ---
> 
> Tracing command devd pid 653 tid 100163 td 0xffffff0003d8e000
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_catch_signals() at sleepq_catch_signals+0xbf
> sleepq_wait_sig() at sleepq_wait_sig+0xc
> _sleep() at _sleep+0x338
> kern_wait() at kern_wait+0xa9e
> wait4() at wait4+0x3a
> syscall() at syscall+0x2e9
> Xfast_syscall() at Xfast_syscall+0xe1
> --- syscall (7, FreeBSD ELF64, wait4), rip = 0x4215ec, rsp = 0x7fffffffe778, rbp = 0x8006640d8 ---
> 
> Tracing command zil_clean pid 285 tid 100092 td 0xffffff00037ae390
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_wait() at sleepq_wait+0x6d
> _cv_wait() at _cv_wait+0x239
> taskq_thread() at taskq_thread+0x379
> fork_exit() at fork_exit+0x147
> fork_trampoline() at fork_trampoline+0xe
> --- trap 0, rip = 0, rsp = 0xffffff807540ad30, rbp = 0 ---
> 
> Tracing command zil_clean pid 284 tid 100151 td 0xffffff0003d92000
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_wait() at sleepq_wait+0x6d
> _cv_wait() at _cv_wait+0x239
> taskq_thread() at taskq_thread+0x379
> fork_exit() at fork_exit+0x147
> fork_trampoline() at fork_trampoline+0xe
> --- trap 0, rip = 0, rsp = 0xffffff8075535d30, rbp = 0 ---
> 
> Tracing command zil_clean pid 283 tid 100150 td 0xffffff0003d92390
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_wait() at sleepq_wait+0x6d
> _cv_wait() at _cv_wait+0x239
> taskq_thread() at taskq_thread+0x379
> fork_exit() at fork_exit+0x147
> fork_trampoline() at fork_trampoline+0xe
> --- trap 0, rip = 0, rsp = 0xffffff8075530d30, rbp = 0 ---
> 
> Tracing command zil_clean pid 282 tid 100149 td 0xffffff0003ace720
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_wait() at sleepq_wait+0x6d
> _cv_wait() at _cv_wait+0x239
> taskq_thread() at taskq_thread+0x379
> fork_exit() at fork_exit+0x147
> fork_trampoline() at fork_trampoline+0xe
> --- trap 0, rip = 0, rsp = 0xffffff807552bd30, rbp = 0 ---
> 
> Tracing command zil_clean pid 281 tid 100148 td 0xffffff0003aceab0
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_wait() at sleepq_wait+0x6d
> _cv_wait() at _cv_wait+0x239
> taskq_thread() at taskq_thread+0x379
> fork_exit() at fork_exit+0x147
> fork_trampoline() at fork_trampoline+0xe
> --- trap 0, rip = 0, rsp = 0xffffff8075526d30, rbp = 0 ---
> 
> Tracing command zil_clean pid 280 tid 100147 td 0xffffff0003a4f000
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_wait() at sleepq_wait+0x6d
> _cv_wait() at _cv_wait+0x239
> taskq_thread() at taskq_thread+0x379
> fork_exit() at fork_exit+0x147
> fork_trampoline() at fork_trampoline+0xe
> --- trap 0, rip = 0, rsp = 0xffffff8075521d30, rbp = 0 ---
> 
> Tracing command zil_clean pid 279 tid 100146 td 0xffffff0003a4f390
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_wait() at sleepq_wait+0x6d
> _cv_wait() at _cv_wait+0x239
> taskq_thread() at taskq_thread+0x379
> fork_exit() at fork_exit+0x147
> fork_trampoline() at fork_trampoline+0xe
> --- trap 0, rip = 0, rsp = 0xffffff807551cd30, rbp = 0 ---
> 
> Tracing command zil_clean pid 278 tid 100145 td 0xffffff0003a4f720
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_wait() at sleepq_wait+0x6d
> _cv_wait() at _cv_wait+0x239
> taskq_thread() at taskq_thread+0x379
> fork_exit() at fork_exit+0x147
> fork_trampoline() at fork_trampoline+0xe
> --- trap 0, rip = 0, rsp = 0xffffff8075517d30, rbp = 0 ---
> 
> Tracing command zil_clean pid 277 tid 100144 td 0xffffff0003a4fab0
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_wait() at sleepq_wait+0x6d
> _cv_wait() at _cv_wait+0x239
> taskq_thread() at taskq_thread+0x379
> fork_exit() at fork_exit+0x147
> fork_trampoline() at fork_trampoline+0xe
> --- trap 0, rip = 0, rsp = 0xffffff8075512d30, rbp = 0 ---
> 
> Tracing command zil_clean pid 276 tid 100143 td 0xffffff0003af8000
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_wait() at sleepq_wait+0x6d
> _cv_wait() at _cv_wait+0x239
> taskq_thread() at taskq_thread+0x379
> fork_exit() at fork_exit+0x147
> fork_trampoline() at fork_trampoline+0xe
> --- trap 0, rip = 0, rsp = 0xffffff807550dd30, rbp = 0 ---
> 
> Tracing command txg_thread_enter pid 275 tid 100134 td 0xffffff0003afe390
> sched_switch() at sched_switch+0x403
> mi_switch() at mi_switch+0x2a6
> sleepq_switch() at sleepq_switch+0x145
> sleepq_timedwai
> ----- end ddb.txt
-- 
Robert Noland <rnoland@FreeBSD.org>
FreeBSD




Want to link to this message? Use this URL: <https://docs.FreeBSD.org/cgi/mid.cgi?1250185346.33905.2.camel>