From owner-freebsd-current@FreeBSD.ORG Thu Aug 13 17:37:24 2009 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 51EF6106566C; Thu, 13 Aug 2009 17:37:24 +0000 (UTC) (envelope-from dgerow@afflictions.org) Received: from relay2-v.mail.gandi.net (relay2-v.mail.gandi.net [217.70.178.76]) by mx1.freebsd.org (Postfix) with ESMTP id 466408FC4A; Thu, 13 Aug 2009 17:37:23 +0000 (UTC) Received: from plebeian.afflictions.org (CPE000db917e8b9-CM0019475d4056.cpe.net.cable.rogers.com [99.241.168.226]) by relay2-v.mail.gandi.net (Postfix) with ESMTP id AAB4F135D0; Thu, 13 Aug 2009 19:37:15 +0200 (CEST) Received: by plebeian.afflictions.org (Postfix, from userid 1001) id 9273CF0A2; Thu, 13 Aug 2009 13:36:28 -0400 (EDT) Date: Thu, 13 Aug 2009 13:36:28 -0400 From: Damian Gerow To: Attilio Rao Message-ID: <20090813173627.GA1498@plebeian.afflictions.org> References: <20090813002104.GA1481@plebeian.afflictions.org> <1250161757.1823.18.camel@balrog.2hip.net> <3bbf2fe10908130652t77767929q44ba12f39cb3f997@mail.gmail.com> <20090813162705.GA1468@plebeian.afflictions.org> <3bbf2fe10908130938v525a18c3p9c4e10db662ab3c0@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <3bbf2fe10908130938v525a18c3p9c4e10db662ab3c0@mail.gmail.com> User-Agent: Mutt/1.5.20 (2009-06-14) Cc: freebsd-current@freebsd.org, Robert Noland Subject: Re: No display after resume in r196086 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Aug 2009 17:37:24 -0000 Attilio Rao wrote: : So, what you can do is to compile a kernel with the following options: : KDB, DDB, INVARIANT_SUPPORT, INVARIANTS, WITNESS As I'm running GENERIC, these options are already present. : when you get the deadlock, you should break in DDB. : Through a textdump(4) (or serial console or whatever you prefer) you : should get the following informations: : bt, ps, show allpcpu, alltrace, show alllocks : : and report here. I've set ddb script kdb.enter.default="textdump set; capture on; show allpcpu; bt; ps; alltrace; showalllocks; showalllock; call doadump; reset", as I don't have a serial console on this machine (and my USB<->serial adapter doesn't work on FreeBSD). The script does not run when resuming in graphics mode, unfortunately. Try as I might, I just don't get anything. I'm not sure what exactly the system is doing when it resumes, as attempts to create files on the local fs seem to fail. Resuming in text mode does generate a panic. I've included the requested information below. However, this may be a red herring: I've never been able to resume in text mode, so it is possible these two resume problems are unrelated. Note that the below was generated on r196037. I'm currently building an 8-STABLE for further testing. ----- begin msgbuf.txt <5>em0: link state changed to DOWN usbus7: port reset timeout uhub_reattach_port:373: port 1 reset failed, error=USB_ERR_TIMEOUT uhub_reattach_port:463: device problem (USB_ERR_TIMEOUT), disabling port 1 calcru: runtime went backwards from 219239654 usec to 74088058 usec for pid 11 (idle) <5>em0: link state changed to UP ugen1.2: at usbus1 (disconnected) Fatal trap 9: general protection fault while in kernel mode cpuid = 0; apic id = 00 instruction pointer = 0x20:0xffffffff8048e71b stack pointer = 0x28:0xffffff8072d59ad0 frame pointer = 0x28:0xffffff8072d59b20 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 22 (usbus1) ----- end msgbuf.txt ----- begin ddb.txt db:0:kdb.enter.default> show allpcpu Current CPU: 0 cpuid = 0 dynamic pcpu = 0x53d514 curthread = 0xffffff0003567720: pid 22 "usbus1" curpcb = 0xffffff8072d59d40 fpcurthread = none idlethread = 0xffffff00024e6390: pid 11 "idle: cpu0" curpmap = 0 tssp = 0xffffffff80de7300 commontssp = 0xffffffff80de7300 rsp0 = 0xffffff8072d59d40 gs32p = 0xffffffff80de6138 ldt = 0xffffffff80de6178 tss = 0xffffffff80de6168 spin locks held: cpuid = 1 dynamic pcpu = 0xffffff807f484514 curthread = 0xffffff000b46d390: pid 1372 "hald" curpcb = 0xffffff80755e4d40 fpcurthread = none idlethread = 0xffffff00024e6720: pid 11 "idle: cpu1" curpmap = 0 tssp = 0xffffffff80de7368 commontssp = 0xffffffff80de7368 rsp0 = 0xffffff80755e4d40 gs32p = 0xffffffff80de61a0 ldt = 0xffffffff80de61e0 tss = 0xffffffff80de61d0 spin locks held: db:0:kdb.enter.default> bt Tracing pid 22 tid 100047 td 0xffffff0003567720 usb_unconfigure() at usb_unconfigure+0x267 usb_free_device() at usb_free_device+0x1bc uhub_explore() at uhub_explore+0x2a3 usb_bus_explore() at usb_bus_explore+0x9e usb_process() at usb_process+0xcd fork_exit() at fork_exit+0x147 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8072d59d30, rbp = 0 --- db:0:kdb.enter.default> ps pid ppid pgrp uid state wmesg wchan cmd 1424 1416 653 0 R acpiconf 1416 653 653 0 S wait 0xffffff0003d63460 sh 1411 1360 1411 1001 S+ ttyin 0xffffff00035010a8 zsh 1381 1376 1372 0 S select 0xffffff000b5ea540 initial thread 1376 1372 1372 0 S select 0xffffff000b0bee40 initial thread 1375 1 1375 0 Ss (threaded) console-kit-daemon 100206 S waitvt 0xffffffff80bd7438 console-kit-daemon 100205 S waitvt 0xffffffff80bd7430 console-kit-daemon 100204 S waitvt 0xffffffff80bd7428 console-kit-daemon 100203 S waitvt 0xffffffff80bd7420 console-kit-daemon 100202 S waitvt 0xffffffff80bd7418 console-kit-daemon 100201 S waitvt 0xffffffff80bd7410 console-kit-daemon 100200 S waitvt 0xffffffff80bd7408 console-kit-daemon 100199 S waitvt 0xffffffff80bd7400 console-kit-daemon 100198 S waitvt 0xffffffff80bd73f8 console-kit-daemon 100197 S waitvt 0xffffffff80bd73f0 console-kit-daemon 100196 S waitvt 0xffffffff80bd73e8 console-kit-daemon 100195 S waitvt 0xffffffff80bd73e0 console-kit-daemon 100194 S waitvt 0xffffffff80bd73d8 console-kit-daemon 100193 S waitvt 0xffffffff80bd73d0 console-kit-daemon 100192 S waitvt 0xffffffff80bd73c8 console-kit-daemon 100191 S ucond 0xffffff0003870980 console-kit-daemon 100126 S select 0xffffff0003dfda40 console-kit-daemon 1372 1 1372 560 Rs CPU 1 hald 1367 1 1367 0 Ss+ ttyin 0xffffff00033318a8 getty 1366 1 1366 0 Ss+ ttyin 0xffffff00034fd8a8 getty 1365 1 1365 0 Ss+ ttyin 0xffffff00034fe4a8 getty 1364 1 1364 0 Ss+ ttyin 0xffffff00035000a8 getty 1363 1 1363 0 Ss+ ttyin 0xffffff00034fd0a8 getty 1362 1 1362 0 Ss+ ttyin 0xffffff0003500ca8 getty 1361 1 1361 0 Ss+ ttyin 0xffffff00035008a8 getty 1360 1 1360 0 Ss+ wait 0xffffff000b416460 login 1358 1356 292 0 S+ nanslp 0xffffffff80bdc5e8 sleep 1357 1 292 0 S+ piperd 0xffffff00039dc5b0 logger 1356 1 292 0 S+ wait 0xffffff0003f738c0 sh 1304 1 1304 0 Ss nanslp 0xffffffff80bdc5e8 cron 1295 1 1295 0 Ss select 0xffffff000b22c2c0 sshd 1252 1 1252 556 Ss select 0xffffff000b0da9c0 dbus-daemon 1247 1236 1236 125 S kqread 0xffffff000b240b00 qmgr 1245 1236 1236 125 S kqread 0xffffff000b3ac000 pickup 1236 1 1236 0 Ss kqread 0xffffff000b37b700 master 1117 1 1117 65 Ss select 0xffffff000b0e8940 dhclient 1101 1 1101 0 Ss select 0xffffff000b0ead40 dhclient 1077 1 1077 0 Ss kqread 0xffffff0003ff4500 cupsd 1034 1 1034 0 Ss select 0xffffff0003e76840 powerd 961 1 961 0 Ss rpcsvc 0xffffff0003d8b1a0 NLM: master 948 1 948 0 Ss select 0xffffff000b009540 rpc.statd 946 1 946 0 Ss select 0xffffff0003e774c0 rpcbind 872 0 0 0 SL mdwait 0xffffff0003e9d800 [md0] 823 1 823 0 Ss select 0xffffff0003e76e40 syslogd 726 0 0 0 SL - 0xffffffff80bd9640 [accounting] 653 1 653 0 Ss wait 0xffffff0003f75000 devd 285 0 0 0 SL tq->tq_d 0xffffff0003ae3720 [zil_clean] 284 0 0 0 SL tq->tq_d 0xffffff0003a70840 [zil_clean] 283 0 0 0 SL tq->tq_d 0xffffff0003ae32a0 [zil_clean] 282 0 0 0 SL tq->tq_d 0xffffff0003ae3180 [zil_clean] 281 0 0 0 SL tq->tq_d 0xffffff0003ae3060 [zil_clean] 280 0 0 0 SL tq->tq_d 0xffffff0003ae3840 [zil_clean] 279 0 0 0 SL tq->tq_d 0xffffff0003a71840 [zil_clean] 278 0 0 0 SL tq->tq_d 0xffffff0003a71720 [zil_clean] 277 0 0 0 SL tq->tq_d 0xffffff0003a71600 [zil_clean] 276 0 0 0 SL tq->tq_d 0xffffff0003a714e0 [zil_clean] 275 0 0 0 SL tx->tx_s 0xffffff000365b638 [txg_thread_enter] 274 0 0 0 SL tx->tx_q 0xffffff000365b658 [txg_thread_enter] 273 0 0 0 SL vgeom:io 0xffffff0003acfc90 [vdev:worker ad4s1d.] 272 0 0 0 SL tq->tq_d 0xffffff0003a713c0 [spa_zio] 271 0 0 0 SL tq->tq_d 0xffffff0003a712a0 [spa_zio] 270 0 0 0 SL tq->tq_d 0xffffff0003a71180 [spa_zio] 269 0 0 0 SL tq->tq_d 0xffffff0003a71de0 [spa_zio] 268 0 0 0 SL tq->tq_d 0xffffff0003af32a0 [spa_zio] 267 0 0 0 SL tq->tq_d 0xffffff0003af3180 [spa_zio] 266 0 0 0 SL tq->tq_d 0xffffff0003af3060 [spa_zio] 265 0 0 0 SL tq->tq_d 0xffffff0003ae3de0 [spa_zio] 264 0 0 0 SL tq->tq_d 0xffffff0003ae3de0 [spa_zio] 263 0 0 0 SL tq->tq_d 0xffffff0003ae3de0 [spa_zio] 262 0 0 0 SL tq->tq_d 0xffffff0003ae3de0 [spa_zio] 261 0 0 0 SL tq->tq_d 0xffffff0003ae3de0 [spa_zio] 260 0 0 0 SL tq->tq_d 0xffffff0003ae3de0 [spa_zio] 259 0 0 0 SL tq->tq_d 0xffffff0003ae3de0 [spa_zio] 258 0 0 0 SL tq->tq_d 0xffffff0003ae3de0 [spa_zio] 257 0 0 0 SL tq->tq_d 0xffffff0003ae3cc0 [spa_zio] 256 0 0 0 SL tq->tq_d 0xffffff0003ae3cc0 [spa_zio] 255 0 0 0 SL tq->tq_d 0xffffff0003ae3cc0 [spa_zio] 254 0 0 0 SL tq->tq_d 0xffffff0003ae3cc0 [spa_zio] 253 0 0 0 SL tq->tq_d 0xffffff0003ae3cc0 [spa_zio] 252 0 0 0 SL tq->tq_d 0xffffff0003ae3cc0 [spa_zio] 251 0 0 0 SL tq->tq_d 0xffffff0003ae3cc0 [spa_zio] 250 0 0 0 SL tq->tq_d 0xffffff0003ae3cc0 [spa_zio] 249 0 0 0 SL tq->tq_d 0xffffff0003ae3ba0 [spa_zio] 248 0 0 0 SL tq->tq_d 0xffffff0003ae3a80 [spa_zio] 247 0 0 0 SL tq->tq_d 0xffffff0003ae3960 [spa_zio] 192 0 0 0 SL geli:w 0xffffff0003649400 [g_eli[1] ad4s1d] 191 0 0 0 SL geli:w 0xffffff0003649400 [g_eli[0] ad4s1d] 186 0 0 0 SL crypto_r 0xffffffff813398a0 [crypto returns] 185 0 0 0 SL crypto_w 0xffffffff81339860 [crypto] 75 0 0 0 SL l2arc_fe 0xffffffff8130be80 [l2arc_feed_thread] 74 0 0 0 SL arc_recl 0xffffffff813038a0 [arc_reclaim_thread] 72 0 0 0 SL vacv 0xffffffff813025a0 [vaclean] 71 0 0 0 SL tq->tq_d 0xffffff0003a71060 [system_taskq] 70 0 0 0 SL tq->tq_d 0xffffff0003a71060 [system_taskq] 52 0 0 0 SL flowclea 0xffffffff80bdc2c4 [flowcleaner] 51 0 0 0 SL sdflush 0xffffffff80dacd58 [softdepflush] 50 0 0 0 SL syncer 0xffffffff80d9dbc0 [syncer] 49 0 0 0 SL vlruwt 0xffffff000358a000 [vnlru] 48 0 0 0 SL psleep 0xffffffff80d9d6e8 [bufdaemon] 9 0 0 0 SL pgzero 0xffffffff80dae7ac [pagezero] 8 0 0 0 SL psleep 0xffffffff80dadb48 [vmdaemon] 7 0 0 0 SL psleep 0xffffffff80dadb0c [pagedaemon] 47 0 0 0 SL wmsg 0xffffff8000326dd0 [usbus7] 46 0 0 0 SL wmsg 0xffffff8000326d78 [usbus7] 45 0 0 0 SL wmsg 0xffffff8000326d20 [usbus7] 44 0 0 0 SL wmsg 0xffffff8000326cc8 [usbus7] 43 0 0 0 SL wmsg 0xffffff800031def0 [usbus6] 42 0 0 0 SL wmsg 0xffffff800031de98 [usbus6] 41 0 0 0 SL wmsg 0xffffff800031de40 [usbus6] 40 0 0 0 SL wmsg 0xffffff800031dde8 [usbus6] 39 0 0 0 SL wmsg 0xffffff8000314ef0 [usbus5] 38 0 0 0 SL wmsg 0xffffff8000314e98 [usbus5] 37 0 0 0 SL wmsg 0xffffff8000314e40 [usbus5] 36 0 0 0 SL wmsg 0xffffff8000314de8 [usbus5] 35 0 0 0 SL wmsg 0xffffff800030bef0 [usbus4] 34 0 0 0 SL wmsg 0xffffff800030be98 [usbus4] 33 0 0 0 SL wmsg 0xffffff800030be40 [usbus4] 32 0 0 0 SL wmsg 0xffffff800030bde8 [usbus4] 31 0 0 0 SL wmsg 0xffffff8000302dd0 [usbus3] 30 0 0 0 SL wmsg 0xffffff8000302d78 [usbus3] 29 0 0 0 SL wmsg 0xffffff8000302d20 [usbus3] 28 0 0 0 SL wmsg 0xffffff8000302cc8 [usbus3] 27 0 0 0 SL wmsg 0xffffff80002f9ef0 [usbus2] 26 0 0 0 SL wmsg 0xffffff80002f9e98 [usbus2] 25 0 0 0 SL wmsg 0xffffff80002f9e40 [usbus2] 24 0 0 0 SL wmsg 0xffffff80002f9de8 [usbus2] 23 0 0 0 SL wmsg 0xffffff80002f0ef0 [usbus1] 22 0 0 0 RL CPU 0 [usbus1] 21 0 0 0 SL wmsg 0xffffff80002f0e40 [usbus1] 20 0 0 0 SL wmsg 0xffffff80002f0de8 [usbus1] 19 0 0 0 SL wmsg 0xffffff80002e7ef0 [usbus0] 18 0 0 0 SL wmsg 0xffffff80002e7e98 [usbus0] 17 0 0 0 SL wmsg 0xffffff80002e7e40 [usbus0] 16 0 0 0 SL wmsg 0xffffff80002e7de8 [usbus0] 6 0 0 0 SL waiting_ 0xffffffff80da0ae0 [sctp_iterator] 15 0 0 0 SL cooling 0xffffff0002713558 [acpi_cooling1] 14 0 0 0 RL [acpi_thermal] 5 0 0 0 SL ccb_scan 0xffffffff80ba5560 [xpt_thrd] 13 0 0 0 SL - 0xffffffff80bdc2c4 [yarrow] 4 0 0 0 SL - 0xffffffff80bd8aa8 [g_down] 3 0 0 0 RL [g_up] 2 0 0 0 SL - 0xffffffff80bd8a90 [g_event] 12 0 0 0 WL (threaded) intr 100039 I [irq12: psm0] 100038 I [irq1: atkbd0] 100035 I [irq19: ehci1] 100034 I [irq18: uhci5] 100033 I [irq17: uhci4] 100032 I [irq16: uhci3+] 100031 I [irq257: hdac0] 100030 I [irq23: ehci0+] 100029 I [irq22: uhci2] 100028 I [irq21: uhci1] 100027 I [irq20: uhci0] 100025 I [irq9: acpi0] 100024 I [swi6: task queue] 100023 I [swi6: Giant taskq] 100020 I [swi5: +] 100019 I [swi2: cambio] 100008 I [swi1: netisr 0] 100007 I [swi3: vm] 100006 I [swi4: clock] 100005 I [swi4: clock] 11 0 0 0 RL (threaded) idle 100004 CanRun [idle: cpu0] 100003 CanRun [idle: cpu1] 1 0 1 0 SLs wait 0xffffff00024e38c0 [init] 10 0 0 0 SL audit_wo 0xffffffff80dac0b0 [audit] 0 0 0 0 SLs (threaded) kernel 100026 D - 0xffffff0002711d80 [em0 taskq] 100022 D - 0xffffff0002621980 [aiod_bio taskq] 100021 D - 0xffffff0002621a00 [thread taskq] 100017 D - 0xffffff0002647380 [kqueue taskq] 100016 D - 0xffffff0002647400 [acpi_task_2] 100015 D - 0xffffff0002647400 [acpi_task_1] 100014 D ecgpe 0xffffff00026badf0 [acpi_task_0] 100012 D - 0xffffff00024f7780 [firmware taskq] 100000 D sched 0xffffffff80bd8ba0 [swapper] db:0:kdb.enter.default> alltrace Tracing command acpiconf pid 1424 tid 100177 td 0xffffff0003f86720 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 ast() at ast+0x27d doreti_ast() at doreti_ast+0x1f Tracing command sh pid 1416 tid 100154 td 0xffffff0003d90390 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _sleep() at _sleep+0x338 kern_wait() at kern_wait+0xa9e wait4() at wait4+0x3a syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x80092f16c, rsp = 0x7fffffffe988, rbp = 0x28d --- Tracing command zsh pid 1411 tid 100179 td 0xffffff0003f86000 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _cv_wait_sig() at _cv_wait_sig+0x23b tty_wait() at tty_wait+0x65 ttydisc_read() at ttydisc_read+0x220 ttydev_read() at ttydev_read+0x86 devfs_read_f() at devfs_read_f+0x7f dofileread() at dofileread+0x97 kern_readv() at kern_readv+0x46 read() at read+0x4e syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (3, FreeBSD ELF64, read), rip = 0x800bea14c, rsp = 0x7fffffffe768, rbp = 0 --- Tracing command hald-addon-mouse-sy pid 1381 tid 100164 td 0xffffff0003afeab0 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12 _cv_timedwait_sig() at _cv_timedwait_sig+0x24b seltdwait() at seltdwait+0x73 poll() at poll+0x325 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (209, FreeBSD ELF64, poll), rip = 0x800e0d4dc, rsp = 0x7fffffffe6a8, rbp = 0x80161d100 --- Tracing command hald-runner pid 1376 tid 100159 td 0xffffff0003d8f000 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _cv_wait_sig() at _cv_wait_sig+0x23b seltdwait() at seltdwait+0x84 poll() at poll+0x325 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (209, FreeBSD ELF64, poll), rip = 0x800c0d4dc, rsp = 0x7fffffffeb68, rbp = 0x1 --- Tracing command console-kit-daemon pid 1375 tid 100206 td 0xffffff000b4f8720 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _sleep() at _sleep+0x338 sctty_ioctl() at sctty_ioctl+0xe13 tty_ioctl() at tty_ioctl+0xaa ttydev_ioctl() at ttydev_ioctl+0x99 devfs_ioctl_f() at devfs_ioctl_f+0xde kern_ioctl() at kern_ioctl+0x1e4 ioctl() at ioctl+0x158 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffafff38, rbp = 0x10 --- Tracing command console-kit-daemon pid 1375 tid 100205 td 0xffffff000b4f8ab0 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _sleep() at _sleep+0x338 sctty_ioctl() at sctty_ioctl+0xe13 tty_ioctl() at tty_ioctl+0xaa ttydev_ioctl() at ttydev_ioctl+0x99 devfs_ioctl_f() at devfs_ioctl_f+0xde kern_ioctl() at kern_ioctl+0x1e4 ioctl() at ioctl+0x158 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb10f38, rbp = 0xf --- Tracing command console-kit-daemon pid 1375 tid 100204 td 0xffffff000b4fb000 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _sleep() at _sleep+0x338 sctty_ioctl() at sctty_ioctl+0xe13 tty_ioctl() at tty_ioctl+0xaa ttydev_ioctl() at ttydev_ioctl+0x99 devfs_ioctl_f() at devfs_ioctl_f+0xde kern_ioctl() at kern_ioctl+0x1e4 ioctl() at ioctl+0x158 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb21f38, rbp = 0xe --- Tracing command console-kit-daemon pid 1375 tid 100203 td 0xffffff000b4fb390 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _sleep() at _sleep+0x338 sctty_ioctl() at sctty_ioctl+0xe13 tty_ioctl() at tty_ioctl+0xaa ttydev_ioctl() at ttydev_ioctl+0x99 devfs_ioctl_f() at devfs_ioctl_f+0xde kern_ioctl() at kern_ioctl+0x1e4 ioctl() at ioctl+0x158 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb32f38, rbp = 0xd --- Tracing command console-kit-daemon pid 1375 tid 100202 td 0xffffff000b4fb720 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _sleep() at _sleep+0x338 sctty_ioctl() at sctty_ioctl+0xe13 tty_ioctl() at tty_ioctl+0xaa ttydev_ioctl() at ttydev_ioctl+0x99 devfs_ioctl_f() at devfs_ioctl_f+0xde kern_ioctl() at kern_ioctl+0x1e4 ioctl() at ioctl+0x158 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb43f38, rbp = 0xc --- Tracing command console-kit-daemon pid 1375 tid 100201 td 0xffffff000b4fbab0 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _sleep() at _sleep+0x338 sctty_ioctl() at sctty_ioctl+0xe13 tty_ioctl() at tty_ioctl+0xaa ttydev_ioctl() at ttydev_ioctl+0x99 devfs_ioctl_f() at devfs_ioctl_f+0xde kern_ioctl() at kern_ioctl+0x1e4 ioctl() at ioctl+0x158 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb54f38, rbp = 0xb --- Tracing command console-kit-daemon pid 1375 tid 100200 td 0xffffff000b4fc000 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _sleep() at _sleep+0x338 sctty_ioctl() at sctty_ioctl+0xe13 tty_ioctl() at tty_ioctl+0xaa ttydev_ioctl() at ttydev_ioctl+0x99 devfs_ioctl_f() at devfs_ioctl_f+0xde kern_ioctl() at kern_ioctl+0x1e4 ioctl() at ioctl+0x158 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb65f38, rbp = 0xa --- Tracing command console-kit-daemon pid 1375 tid 100199 td 0xffffff000b4fc390 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _sleep() at _sleep+0x338 sctty_ioctl() at sctty_ioctl+0xe13 tty_ioctl() at tty_ioctl+0xaa ttydev_ioctl() at ttydev_ioctl+0x99 devfs_ioctl_f() at devfs_ioctl_f+0xde kern_ioctl() at kern_ioctl+0x1e4 ioctl() at ioctl+0x158 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb76f38, rbp = 0x9 --- Tracing command console-kit-daemon pid 1375 tid 100198 td 0xffffff0003f8b720 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _sleep() at _sleep+0x338 sctty_ioctl() at sctty_ioctl+0xe13 tty_ioctl() at tty_ioctl+0xaa ttydev_ioctl() at ttydev_ioctl+0x99 devfs_ioctl_f() at devfs_ioctl_f+0xde kern_ioctl() at kern_ioctl+0x1e4 ioctl() at ioctl+0x158 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb87f38, rbp = 0x8 --- Tracing command console-kit-daemon pid 1375 tid 100197 td 0xffffff0003f8bab0 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _sleep() at _sleep+0x338 sctty_ioctl() at sctty_ioctl+0xe13 tty_ioctl() at tty_ioctl+0xaa ttydev_ioctl() at ttydev_ioctl+0x99 devfs_ioctl_f() at devfs_ioctl_f+0xde kern_ioctl() at kern_ioctl+0x1e4 ioctl() at ioctl+0x158 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb98f38, rbp = 0x7 --- Tracing command console-kit-daemon pid 1375 tid 100196 td 0xffffff000b46f000 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _sleep() at _sleep+0x338 sctty_ioctl() at sctty_ioctl+0xe13 tty_ioctl() at tty_ioctl+0xaa ttydev_ioctl() at ttydev_ioctl+0x99 devfs_ioctl_f() at devfs_ioctl_f+0xde kern_ioctl() at kern_ioctl+0x1e4 ioctl() at ioctl+0x158 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffba9f38, rbp = 0x6 --- Tracing command console-kit-daemon pid 1375 tid 100195 td 0xffffff000b46f390 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _sleep() at _sleep+0x338 sctty_ioctl() at sctty_ioctl+0xe13 tty_ioctl() at tty_ioctl+0xaa ttydev_ioctl() at ttydev_ioctl+0x99 devfs_ioctl_f() at devfs_ioctl_f+0xde kern_ioctl() at kern_ioctl+0x1e4 ioctl() at ioctl+0x158 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffbbaf38, rbp = 0x5 --- Tracing command console-kit-daemon pid 1375 tid 100194 td 0xffffff000b46f720 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _sleep() at _sleep+0x338 sctty_ioctl() at sctty_ioctl+0xe13 tty_ioctl() at tty_ioctl+0xaa ttydev_ioctl() at ttydev_ioctl+0x99 devfs_ioctl_f() at devfs_ioctl_f+0xde kern_ioctl() at kern_ioctl+0x1e4 ioctl() at ioctl+0x158 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffbcbf38, rbp = 0x4 --- Tracing command console-kit-daemon pid 1375 tid 100193 td 0xffffff000b46fab0 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _sleep() at _sleep+0x338 sctty_ioctl() at sctty_ioctl+0xe13 tty_ioctl() at tty_ioctl+0xaa ttydev_ioctl() at ttydev_ioctl+0x99 devfs_ioctl_f() at devfs_ioctl_f+0xde kern_ioctl() at kern_ioctl+0x1e4 ioctl() at ioctl+0x158 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffbdcf38, rbp = 0x3 --- Tracing command console-kit-daemon pid 1375 tid 100192 td 0xffffff000b46c000 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _sleep() at _sleep+0x338 sctty_ioctl() at sctty_ioctl+0xe13 tty_ioctl() at tty_ioctl+0xaa ttydev_ioctl() at ttydev_ioctl+0x99 devfs_ioctl_f() at devfs_ioctl_f+0xde kern_ioctl() at kern_ioctl+0x1e4 ioctl() at ioctl+0x158 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffbedf38, rbp = 0x2 --- Tracing command console-kit-daemon pid 1375 tid 100191 td 0xffffff0003a25ab0 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _sleep() at _sleep+0x338 do_cv_wait() at do_cv_wait+0x4e1 __umtx_op_cv_wait() at __umtx_op_cv_wait+0x58 _umtx_op() at _umtx_op+0x1c syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80143ef0c, rsp = 0x7fffffbfed58, rbp = 0x80186d380 --- Tracing command console-kit-daemon pid 1375 tid 100126 td 0xffffff0003acb390 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _cv_wait_sig() at _cv_wait_sig+0x23b seltdwait() at seltdwait+0x84 poll() at poll+0x325 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (209, FreeBSD ELF64, poll), rip = 0x8015da4dc, rsp = 0x7fffffffeac8, rbp = 0x4 --- Tracing command hald pid 1372 tid 100186 td 0xffffff000b46d390 cpustop_handler() at cpustop_handler+0x40 ipi_nmi_handler() at ipi_nmi_handler+0x36 trap() at trap+0x42 nmi_calltrap() at nmi_calltrap+0x8 --- trap 0x13, rip = 0xffffffff8055b213, rsp = 0xffffff8000018fe0, rbp = 0xffffff80755e4970 --- _sx_slock_hard() at _sx_slock_hard+0x13c _sx_slock() at _sx_slock+0xaa newbus_slock() at newbus_slock+0x21 acpi_battery_ioctl() at acpi_battery_ioctl+0x6f acpiioctl() at acpiioctl+0x163 devfs_ioctl_f() at devfs_ioctl_f+0xde kern_ioctl() at kern_ioctl+0x1e4 ioctl() at ioctl+0x158 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x8012370ec, rsp = 0x7fffffffe598, rbp = 0x801a0ab60 --- Tracing command getty pid 1367 tid 100184 td 0xffffff000b46dab0 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _cv_wait_sig() at _cv_wait_sig+0x23b tty_wait() at tty_wait+0x65 ttydisc_read() at ttydisc_read+0x220 ttydev_read() at ttydev_read+0x86 devfs_read_f() at devfs_read_f+0x7f dofileread() at dofileread+0x97 kern_readv() at kern_readv+0x46 read() at read+0x4e syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (3, FreeBSD ELF64, read), rip = 0x80084014c, rsp = 0x7fffffffecc8, rbp = 0 --- Tracing command getty pid 1366 tid 100178 td 0xffffff0003f86390 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _cv_wait_sig() at _cv_wait_sig+0x23b tty_wait() at tty_wait+0x65 ttydisc_read() at ttydisc_read+0x220 ttydev_read() at ttydev_read+0x86 devfs_read_f() at devfs_read_f+0x7f dofileread() at dofileread+0x97 kern_readv() at kern_readv+0x46 read() at read+0x4e syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (3, FreeBSD ELF64, read), rip = 0x80084014c, rsp = 0x7fffffffecc8, rbp = 0 --- Tracing command getty pid 1365 tid 100183 td 0xffffff000b468000 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _cv_wait_sig() at _cv_wait_sig+0x23b tty_wait() at tty_wait+0x65 ttydisc_read() at ttydisc_read+0x220 ttydev_read() at ttydev_read+0x86 devfs_read_f() at devfs_read_f+0x7f dofileread() at dofileread+0x97 kern_readv() at kern_readv+0x46 read() at read+0x4e syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (3, FreeBSD ELF64, read), rip = 0x80084014c, rsp = 0x7fffffffecc8, rbp = 0 --- Tracing command getty pid 1364 tid 100182 td 0xffffff000b468390 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _cv_wait_sig() at _cv_wait_sig+0x23b tty_wait() at tty_wait+0x65 ttydisc_read() at ttydisc_read+0x220 ttydev_read() at ttydev_read+0x86 devfs_read_f() at devfs_read_f+0x7f dofileread() at dofileread+0x97 kern_readv() at kern_readv+0x46 read() at read+0x4e syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (3, FreeBSD ELF64, read), rip = 0x80084014c, rsp = 0x7fffffffecc8, rbp = 0 --- Tracing command getty pid 1363 tid 100181 td 0xffffff0003d92720 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _cv_wait_sig() at _cv_wait_sig+0x23b tty_wait() at tty_wait+0x65 ttydisc_read() at ttydisc_read+0x220 ttydev_read() at ttydev_read+0x86 devfs_read_f() at devfs_read_f+0x7f dofileread() at dofileread+0x97 kern_readv() at kern_readv+0x46 read() at read+0x4e syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (3, FreeBSD ELF64, read), rip = 0x80084014c, rsp = 0x7fffffffecc8, rbp = 0 --- Tracing command getty pid 1362 tid 100180 td 0xffffff0003d92ab0 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _cv_wait_sig() at _cv_wait_sig+0x23b tty_wait() at tty_wait+0x65 ttydisc_read() at ttydisc_read+0x220 ttydev_read() at ttydev_read+0x86 devfs_read_f() at devfs_read_f+0x7f dofileread() at dofileread+0x97 kern_readv() at kern_readv+0x46 read() at read+0x4e syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (3, FreeBSD ELF64, read), rip = 0x80084014c, rsp = 0x7fffffffecc8, rbp = 0 --- Tracing command getty pid 1361 tid 100094 td 0xffffff0003a28ab0 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _cv_wait_sig() at _cv_wait_sig+0x23b tty_wait() at tty_wait+0x65 ttydisc_read() at ttydisc_read+0x220 ttydev_read() at ttydev_read+0x86 devfs_read_f() at devfs_read_f+0x7f dofileread() at dofileread+0x97 kern_readv() at kern_readv+0x46 read() at read+0x4e syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (3, FreeBSD ELF64, read), rip = 0x80084014c, rsp = 0x7fffffffecc8, rbp = 0 --- Tracing command login pid 1360 tid 100188 td 0xffffff000b46cab0 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _sleep() at _sleep+0x338 kern_wait() at kern_wait+0xa9e wait4() at wait4+0x3a syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x8009e416c, rsp = 0x7fffffffec58, rbp = 0x800b969c0 --- Tracing command sleep pid 1358 tid 100089 td 0xffffff00037aeab0 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12 _sleep() at _sleep+0x312 kern_nanosleep() at kern_nanosleep+0xec nanosleep() at nanosleep+0x61 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (240, FreeBSD ELF64, nanosleep), rip = 0x800710cfc, rsp = 0x7fffffffed58, rbp = 0x7fffffffedb0 --- Tracing command logger pid 1357 tid 100170 td 0xffffff0003f8a390 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _sleep() at _sleep+0x338 pipe_read() at pipe_read+0x3ce dofileread() at dofileread+0x97 kern_readv() at kern_readv+0x46 read() at read+0x4e syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (3, FreeBSD ELF64, read), rip = 0x80072e14c, rsp = 0x7fffffffe858, rbp = 0x7fffffffed78 --- Tracing command sh pid 1356 tid 100167 td 0xffffff0003f8b000 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _sleep() at _sleep+0x338 kern_wait() at kern_wait+0xa9e wait4() at wait4+0x3a syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x80092f16c, rsp = 0x7fffffffccb8, rbp = 0x124 --- Tracing command cron pid 1304 tid 100176 td 0xffffff0003f86ab0 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12 _sleep() at _sleep+0x312 kern_nanosleep() at kern_nanosleep+0xec nanosleep() at nanosleep+0x61 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (240, FreeBSD ELF64, nanosleep), rip = 0x80092ecfc, rsp = 0x7fffffffeb38, rbp = 0x29 --- Tracing command sshd pid 1295 tid 100169 td 0xffffff0003f8a720 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _cv_wait_sig() at _cv_wait_sig+0x23b seltdwait() at seltdwait+0x84 kern_select() at kern_select+0x507 select() at select+0x54 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (93, FreeBSD ELF64, select), rip = 0x8013b70cc, rsp = 0x7fffffffe318, rbp = 0x4 --- Tracing command dbus-daemon pid 1252 tid 100121 td 0xffffff0003acd720 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12 _cv_timedwait_sig() at _cv_timedwait_sig+0x24b seltdwait() at seltdwait+0x73 poll() at poll+0x325 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (209, FreeBSD ELF64, poll), rip = 0x8009544dc, rsp = 0x7fffffffe6c8, rbp = 0 --- Tracing command qmgr pid 1247 tid 100157 td 0xffffff0003d8f720 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12 _sleep() at _sleep+0x312 kern_kevent() at kern_kevent+0x3a7 kevent() at kevent+0x199 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (363, FreeBSD ELF64, kevent), rip = 0x801132c0c, rsp = 0x7fffffffd9e8, rbp = 0x7fffffffd9f0 --- Tracing command pickup pid 1245 tid 100152 td 0xffffff0003d90ab0 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12 _sleep() at _sleep+0x312 kern_kevent() at kern_kevent+0x3a7 kevent() at kevent+0x199 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (363, FreeBSD ELF64, kevent), rip = 0x801126c0c, rsp = 0x7fffffffda28, rbp = 0x7fffffffda30 --- Tracing command master pid 1236 tid 100093 td 0xffffff0003a2a000 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12 _sleep() at _sleep+0x312 kern_kevent() at kern_kevent+0x3a7 kevent() at kevent+0x199 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (363, FreeBSD ELF64, kevent), rip = 0x80111dc0c, rsp = 0x7fffffffdce8, rbp = 0x7fffffffdcf0 --- Tracing command dhclient pid 1117 tid 100162 td 0xffffff0003d8e390 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12 _cv_timedwait_sig() at _cv_timedwait_sig+0x24b seltdwait() at seltdwait+0x73 poll() at poll+0x325 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (209, FreeBSD ELF64, poll), rip = 0x8006eb4dc, rsp = 0x7fffffffece8, rbp = 0x2 --- Tracing command dhclient pid 1101 tid 100166 td 0xffffff0003f8b390 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _cv_wait_sig() at _cv_wait_sig+0x23b seltdwait() at seltdwait+0x84 poll() at poll+0x325 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (209, FreeBSD ELF64, poll), rip = 0x8006eb4dc, rsp = 0x7fffffffece8, rbp = 0x9 --- Tracing command cupsd pid 1077 tid 100132 td 0xffffff0003a94ab0 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _sleep() at _sleep+0x338 kern_kevent() at kern_kevent+0x3a7 kevent() at kevent+0x199 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (363, FreeBSD ELF64, kevent), rip = 0x801257c0c, rsp = 0x7fffffffe7d8, rbp = 0x1 --- Tracing command powerd pid 1034 tid 100161 td 0xffffff0003d8e720 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12 _cv_timedwait_sig() at _cv_timedwait_sig+0x24b seltdwait() at seltdwait+0x73 kern_select() at kern_select+0x507 select() at select+0x54 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (93, FreeBSD ELF64, select), rip = 0x80083d0cc, rsp = 0x7fffffffe7e8, rbp = 0x960 --- Tracing command rpc.lockd pid 961 tid 100171 td 0xffffff0003f8a000 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12 _cv_timedwait_sig() at _cv_timedwait_sig+0x24b svc_run_internal() at svc_run_internal+0x2f8 svc_run() at svc_run+0x97 nlm_syscall() at nlm_syscall+0x6f7 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (154, FreeBSD ELF64, nlm_syscall), rip = 0x8008baeac, rsp = 0x7fffffffec38, rbp = 0x7fffffffed60 --- Tracing command rpc.statd pid 948 tid 100122 td 0xffffff0003acd390 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12 _cv_timedwait_sig() at _cv_timedwait_sig+0x24b seltdwait() at seltdwait+0x73 kern_select() at kern_select+0x507 select() at select+0x54 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (93, FreeBSD ELF64, select), rip = 0x8008380cc, rsp = 0x7fffffffeb58, rbp = 0x800980900 --- Tracing command rpcbind pid 946 tid 100168 td 0xffffff0003f8aab0 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12 _cv_timedwait_sig() at _cv_timedwait_sig+0x24b seltdwait() at seltdwait+0x73 poll() at poll+0x325 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (209, FreeBSD ELF64, poll), rip = 0x8008fb4dc, rsp = 0x7fffffffcad8, rbp = 0x800b100c0 --- Tracing command md0 pid 872 tid 100090 td 0xffffff0003a2a390 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_wait() at sleepq_wait+0x6d _sleep() at _sleep+0x348 md_kthread() at md_kthread+0x10c fork_exit() at fork_exit+0x147 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8075400d30, rbp = 0 --- Tracing command syslogd pid 823 tid 100174 td 0xffffff0003f87390 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _cv_wait_sig() at _cv_wait_sig+0x23b seltdwait() at seltdwait+0x84 kern_select() at kern_select+0x507 select() at select+0x54 syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (93, FreeBSD ELF64, select), rip = 0x8008430cc, rsp = 0x7fffffffdd08, rbp = 0x800a2f0d0 --- Tracing command accounting pid 726 tid 100103 td 0xffffff0003a94000 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_timedwait() at sleepq_timedwait+0x6d _sleep() at _sleep+0x322 acct_thread() at acct_thread+0x2b2 fork_exit() at fork_exit+0x147 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8075441d30, rbp = 0 --- Tracing command devd pid 653 tid 100163 td 0xffffff0003d8e000 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_catch_signals() at sleepq_catch_signals+0xbf sleepq_wait_sig() at sleepq_wait_sig+0xc _sleep() at _sleep+0x338 kern_wait() at kern_wait+0xa9e wait4() at wait4+0x3a syscall() at syscall+0x2e9 Xfast_syscall() at Xfast_syscall+0xe1 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x4215ec, rsp = 0x7fffffffe778, rbp = 0x8006640d8 --- Tracing command zil_clean pid 285 tid 100092 td 0xffffff00037ae390 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_wait() at sleepq_wait+0x6d _cv_wait() at _cv_wait+0x239 taskq_thread() at taskq_thread+0x379 fork_exit() at fork_exit+0x147 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff807540ad30, rbp = 0 --- Tracing command zil_clean pid 284 tid 100151 td 0xffffff0003d92000 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_wait() at sleepq_wait+0x6d _cv_wait() at _cv_wait+0x239 taskq_thread() at taskq_thread+0x379 fork_exit() at fork_exit+0x147 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8075535d30, rbp = 0 --- Tracing command zil_clean pid 283 tid 100150 td 0xffffff0003d92390 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_wait() at sleepq_wait+0x6d _cv_wait() at _cv_wait+0x239 taskq_thread() at taskq_thread+0x379 fork_exit() at fork_exit+0x147 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8075530d30, rbp = 0 --- Tracing command zil_clean pid 282 tid 100149 td 0xffffff0003ace720 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_wait() at sleepq_wait+0x6d _cv_wait() at _cv_wait+0x239 taskq_thread() at taskq_thread+0x379 fork_exit() at fork_exit+0x147 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff807552bd30, rbp = 0 --- Tracing command zil_clean pid 281 tid 100148 td 0xffffff0003aceab0 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_wait() at sleepq_wait+0x6d _cv_wait() at _cv_wait+0x239 taskq_thread() at taskq_thread+0x379 fork_exit() at fork_exit+0x147 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8075526d30, rbp = 0 --- Tracing command zil_clean pid 280 tid 100147 td 0xffffff0003a4f000 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_wait() at sleepq_wait+0x6d _cv_wait() at _cv_wait+0x239 taskq_thread() at taskq_thread+0x379 fork_exit() at fork_exit+0x147 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8075521d30, rbp = 0 --- Tracing command zil_clean pid 279 tid 100146 td 0xffffff0003a4f390 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_wait() at sleepq_wait+0x6d _cv_wait() at _cv_wait+0x239 taskq_thread() at taskq_thread+0x379 fork_exit() at fork_exit+0x147 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff807551cd30, rbp = 0 --- Tracing command zil_clean pid 278 tid 100145 td 0xffffff0003a4f720 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_wait() at sleepq_wait+0x6d _cv_wait() at _cv_wait+0x239 taskq_thread() at taskq_thread+0x379 fork_exit() at fork_exit+0x147 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8075517d30, rbp = 0 --- Tracing command zil_clean pid 277 tid 100144 td 0xffffff0003a4fab0 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_wait() at sleepq_wait+0x6d _cv_wait() at _cv_wait+0x239 taskq_thread() at taskq_thread+0x379 fork_exit() at fork_exit+0x147 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff8075512d30, rbp = 0 --- Tracing command zil_clean pid 276 tid 100143 td 0xffffff0003af8000 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_wait() at sleepq_wait+0x6d _cv_wait() at _cv_wait+0x239 taskq_thread() at taskq_thread+0x379 fork_exit() at fork_exit+0x147 fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffff807550dd30, rbp = 0 --- Tracing command txg_thread_enter pid 275 tid 100134 td 0xffffff0003afe390 sched_switch() at sched_switch+0x403 mi_switch() at mi_switch+0x2a6 sleepq_switch() at sleepq_switch+0x145 sleepq_timedwai ----- end ddb.txt