Skip site navigation (1)Skip section navigation (2)
Date:      Fri, 23 Sep 2005 23:43:22 -0400
From:      Kris Kennaway <kris@obsecurity.org>
To:        current@FreeBSD.org
Subject:   deadlock in -current
Message-ID:  <20050924034322.GA1636@xor.obsecurity.org>

next in thread | raw e-mail | index | archive | help

[-- Attachment #1 --]
Since updating my (UP i386) machines yesterday they're all hanging

after a few hours of load with all processes in the following states:



db> ps

  pid   proc     uid  ppid  pgrp  flag   stat  wmesg    wchan  cmd

28397 c5267a3c    0 28396 28397 0000110 [SLPQ vmmaps 0xc1027178][SLP] cron

28396 c5267c48    0   386   386 0000000 [SLPQ ppwait 0xc5267c48][SLP] cron

28395 c4f5a624 65534   572 28395 0000100 [SLPQ vmmaps 0xc1027178][SLP] inetd

28394 c4f5a830    2 28393 28394 0000110 [SLPQ vmmaps 0xc1027178][SLP] cron

28393 c4f5aa3c    0   386   386 0000000 [SLPQ ppwait 0xc4f5aa3c][SLP] cron

28392 c4f5ac48    0   371 28392 0000100 [SLPQ vmmaps 0xc1027178][SLP] sshd

28391 c5244000 65534   572 28391 0000100 [SLPQ vmmaps 0xc1027178][SLP] inetd

28390 c524420c    0 28389 28390 0000110 [SLPQ vmmaps 0xc1027178][SLP] cron

28389 c5244418    0   386   386 0000000 [SLPQ ppwait 0xc5244418][SLP] cron

28388 c5244624 65534   572 28388 0000100 [SLPQ vmmaps 0xc1027178][SLP] inetd

28387 c5244830    0 28386 28387 0000110 [SLPQ vmmaps 0xc1027178][SLP] cron

28386 c5244a3c    0   386   386 0000000 [SLPQ ppwait 0xc5244a3c][SLP] cron

28385 c5244c48 65534   572 28385 0000100 [SLPQ vmmaps 0xc1027178][SLP] inetd

28384 c5246000    2 28383 28384 0000110 [SLPQ vmmaps 0xc1027178][SLP] cron

28383 c524620c    0   386   386 0000000 [SLPQ ppwait 0xc524620c][SLP] cron

28382 c5246418    0   371 28382 0000100 [SLPQ vmmaps 0xc1027178][SLP] sshd

28381 c5246624 65534   572 28381 0000100 [SLPQ vmmaps 0xc1027178][SLP] inetd

28380 c5246830    0 28379 28380 0000110 [SLPQ vmmaps 0xc1027178][SLP] cron

28379 c4192830    0   386   386 0000000 [SLPQ ppwait 0xc4192830][SLP] cron

28378 c4191000    0   371 28378 0000100 [SLPQ vmmaps 0xc1027178][SLP] sshd

28377 c419220c 65534   572 28377 0000100 [SLPQ vmmaps 0xc1027178][SLP] inetd

28376 c4191624    0 28375 28376 0000110 [SLPQ vmmaps 0xc1027178][SLP] cron

28375 c4f59c48    0   386   386 0000000 [SLPQ ppwait 0xc4f59c48][SLP] cron

28374 c4f5a000 65534   572 28374 0000100 [SLPQ vmmaps 0xc1027178][SLP] inetd

28373 c4192418    0   371 28373 0000100 [SLPQ vmmaps 0xc1027178][SLP] sshd

28372 c4f5a20c    2 28371 28372 0000110 [SLPQ vmmaps 0xc1027178][SLP] cron

28371 c4f59624    0   386   386 0000000 [SLPQ ppwait 0xc4f59624][SLP] cron

28370 c4191830    0 28369 28370 0000110 [SLPQ vmmaps 0xc1027178][SLP] cron

28369 c4192a3c    0   386   386 0000000 [SLPQ ppwait 0xc4192a3c][SLP] cron

28368 c2707c48 65534   572 28368 0000100 [SLPQ vmmaps 0xc1027178][SLP] inetd

28367 c4192c48 65534   572 28367 0000100 [SLPQ vmmaps 0xc1027178][SLP] inetd

28366 c4f59a3c    0 28365 28366 0000110 [SLPQ vmmaps 0xc1027178][SLP] cron

28365 c2707624    0   386   386 0000000 [SLPQ ppwait 0xc2707624][SLP] cron

28364 c24fcc48    0   371 28364 0000100 [SLPQ vmmaps 0xc1027178][SLP] sshd

28363 c4f5a418 65534   572 28363 0000100 [SLPQ vmmaps 0xc1027178][SLP] inetd

28362 c2e75a3c    0 28359 28362 0000110 [SLPQ vmmaps 0xc1027178][SLP] cron

28361 c418d418    2 28358 28361 0000110 [SLPQ vmmaps 0xc1027178][SLP] cron

28360 c4192000    0 28357 28360 0000110 [SLPQ vmmaps 0xc1027178][SLP] cron

28359 c4f59418    0   386   386 0000000 [SLPQ ppwait 0xc4f59418][SLP] cron

28358 c24fc20c    0   386   386 0000000 [SLPQ ppwait 0xc24fc20c][SLP] cron

28357 c2e7520c    0   386   386 0000000 [SLPQ ppwait 0xc2e7520c][SLP] cron

28356 c4191418 65534   572 28356 0000100 [SLPQ vmmaps 0xc1027178][SLP] inetd

28355 c4f59830    0 28353 28355 0000110 [SLPQ vmmaps 0xc1027178][SLP] cron

28354 c4191c48    2 28352 28354 0000110 [SLPQ vmmaps 0xc1027178][SLP] cron

28353 c418da3c    0   386   386 0000000 [SLPQ ppwait 0xc418da3c][SLP] cron

28352 c24fc830    0   386   386 0000000 [SLPQ ppwait 0xc24fc830][SLP] cron

28350 c4f59000    0 26659  4286 0000000 [SLPQ vmmaps 0xc1027178][SLP] sh

26659 c4192624    0  5172  4286 0004000 [SLPQ wait 0xc4192624][SLP] sh

 5172 c2e75418    0  5171  4286 0004000 [SLPQ wait 0xc2e75418][SLP] sh

 5171 c2e72624    0  5170  4286 0000000 [SLPQ wait 0xc2e72624][SLP] sh

 5170 c418d830    0  5092  4286 0004000 [SLPQ wait 0xc418d830][SLP] sh

 5092 c2e7220c    0  5091  4286 0004000 [SLPQ wait 0xc2e7220c][SLP] make

 5091 c24fb20c    0  5068  4286 0004000 [SLPQ wait 0xc24fb20c][SLP] sh

 5069 c418d624    0  5067  4286 0000000 [SLPQ nanslp 0xc078ca6c][SLP] pnohang

 5068 c419120c    0  5067  4286 0004000 [SLPQ wait 0xc419120c][SLP] make

 5067 c418d000    0  4662  4286 0004000 [SLPQ wait 0xc418d000][SLP] pnohang

 4662 c418d20c    0  4309  4286 0004000 [SLPQ wait 0xc418d20c][SLP] sh

 4309 c2e75c48    0  4286  4286 0004000 [SLPQ wait 0xc2e75c48][SLP] sh

 4286 c418dc48    0  4248  4286 0004000 [SLPQ pause 0xc418dc7c][SLP] csh

 4248 c4191a3c    0   371  4248 0004100 [SLPQ select 0xc07d7584][SLP] sshd

  592 c270720c    0     1   592 0004002 [SLPQ ttyin 0xc23b8410][SLP] getty

  591 c2e75000    0     1   591 0004002 [SLPQ ttyin 0xc23b4810][SLP] getty

  590 c2e72a3c    0     1   590 0004002 [SLPQ ttyin 0xc23b4c10][SLP] getty

  589 c2e72830    0     1   589 0004002 [SLPQ ttyin 0xc238cc10][SLP] getty

  588 c24fc624    0     1   588 0004002 [SLPQ ttyin 0xc2387c10][SLP] getty

  587 c230a830    0     1   587 0004002 [SLPQ ttyin 0xc238c810][SLP] getty

  586 c2707000    0     1   586 0004002 [SLPQ ttyin 0xc2387010][SLP] getty

  585 c2707a3c    0     1   585 0004002 [SLPQ ttyin 0xc238c010][SLP] getty

  584 c2e72000    0     1   584 0004002 [SLPQ ttyin 0xc238bc10][SLP] getty

  572 c2e72c48    0     1   572 0000000 [SLPQ select 0xc07d7584][SLP] inetd

  554 c2e72418  100   540   554 0004000 [SLPQ piperd 0xc259c000][SLP] unlinkd

  540 c2e75830  100   538   538 0004000 [SLPQ select 0xc07d7584][SLP] squid

  538 c2e75624  100     1   538 0000000 [SLPQ wait 0xc2e75624][SLP] squid

  386 c2707418    0     1   386 0000000 [SLPQ nanslp 0xc078ca6c][SLP] cron

  371 c230a624    0     1   371 0000100 [SLPQ select 0xc07d7584][SLP] sshd

  356 c24fb000    0     1   356 0000000 [SLPQ select 0xc07d7584][SLP] ntpd

  280 c24fca3c    0     0     0 0000204 [SLPQ mdwait 0xc28bd000][SLP] md2

  247 c24fc418    0     1   247 0000000 [SLPQ select 0xc07d7584][SLP] syslogd

  229 c230ac48    0     1   229 0000000 [SLPQ select 0xc07d7584][SLP] devd

  117 c2707830    0     0     0 0000204 [SLPQ mdwait 0xc2648000][SLP] md1

   72 c230aa3c    0     0     0 0000204 [SLPQ mdwait 0xc2324800][SLP] md0

   44 c24fb418    0     0     0 0000204 [SLPQ - 0xe504dcf8][SLP] schedcpu

   43 c24fb624    0     0     0 0000204 [SLPQ - 0xc07e05cc][SLP] nfsiod 3

   42 c24fb830    0     0     0 0000204 [SLPQ - 0xc07e05c8][SLP] nfsiod 2

   41 c24fba3c    0     0     0 0000204 [SLPQ - 0xc07e05c4][SLP] nfsiod 1

   40 c24fbc48    0     0     0 0000204 [SLPQ - 0xc07e05c0][SLP] nfsiod 0

   39 c24fc000    0     0     0 0000204 [SLPQ syncer 0xc078c7dc][SLP] syncer

   38 c22c3c48    0     0     0 0000204 [SLPQ vlruwt 0xc22c3c48][SLP] vnlru

   37 c2309000    0     0     0 0000204 [SLPQ psleep 0xc07d7acc][SLP] bufdaemon

   36 c230920c    0     0     0 000020c [SLPQ pgzero 0xc07e1a04][SLP] pagezero

    9 c2309418    0     0     0 0000204 [SLPQ psleep 0xc07e1554][SLP] vmdaemon

    8 c2309624    0     0     0 0000204 [SLPQ psleep 0xc07e1510][SLP] pagedaemon

   35 c2309830    0     0     0 0000204 [IWAIT] swi0: sio

    7 c2309a3c    0     0     0 0000204 [SLPQ - 0xc230e23c][SLP] fdc0

   34 c2309c48    0     0     0 0000204 [IWAIT] swi6:+

   33 c230a000    0     0     0 0000204 [IWAIT] swi6: task queue

   32 c230a20c    0     0     0 0000204 [IWAIT] swi2: cambio

    6 c230a418    0     0     0 0000204 [SLPQ - 0xc226d680][SLP] kqueue taskq

   31 c22b4624    0     0     0 0000204 [IWAIT] swi5:+

    5 c22b4830    0     0     0 0000204 [SLPQ - 0xc226d800][SLP] thread taskq

   30 c22b4a3c    0     0     0 0000204 [SLPQ - 0xc0721480][SLP] yarrow

    4 c22b4c48    0     0     0 0000204 [SLPQ - 0xc0721f28][SLP] g_down

    3 c22c3000    0     0     0 0000204 [SLPQ - 0xc0721f24][SLP] g_up

    2 c22c320c    0     0     0 0000204 [SLPQ - 0xc0721f1c][SLP] g_event

   29 c22c3418    0     0     0 0000204 [IWAIT] swi3: vm

   28 c22c3624    0     0     0 000020c [IWAIT] swi4: clock sio

   27 c22c3830    0     0     0 0000204 [IWAIT] swi1: net

   26 c22c3a3c    0     0     0 0000204 [IWAIT] irq15: ata1

   25 c227420c    0     0     0 0000204 [IWAIT] irq14: ata0

   24 c2274418    0     0     0 0000204 [IWAIT] irq13:

   23 c2274624    0     0     0 0000204 [IWAIT] irq12:

   22 c2274830    0     0     0 0000204 [IWAIT] irq11: fxp1

   21 c2274a3c    0     0     0 0000204 [IWAIT] irq10: fxp0

   20 c2274c48    0     0     0 0000204 [IWAIT] irq9:

   19 c22b4000    0     0     0 0000204 [IWAIT] irq8: rtc

   18 c22b420c    0     0     0 0000204 [IWAIT] irq7:

   17 c22b4418    0     0     0 0000204 [IWAIT] irq6: fdc0

   16 c226e000    0     0     0 0000204 [IWAIT] irq5:

   15 c226e20c    0     0     0 0000204 [IWAIT] irq4: sio0

   14 c226e418    0     0     0 0000204 [IWAIT] irq3: sio1

   13 c226e624    0     0     0 0000204 [IWAIT] irq1: atkbd0

   12 c226e830    0     0     0 0000204 [IWAIT] irq0: clk

   11 c226ea3c    0     0     0 000020c [CPU 0] idle

    1 c226ec48    0     0     1 0004200 [SLPQ wait 0xc226ec48][SLP] init

   10 c2274000    0     0     0 0000204 [SLPQ ktrace 0xc078a9b8][SLP] ktrace

    0 c0722020    0     0     0 0000200 [IWAIT] swapper

28351 c4f5920c    0 28350  4286 0002000 zomb[INACTIVE] sh

db> wh 28397

Tracing pid 28397 tid 100138 td 0xc5265780

sched_switch(c5265780,0,1,11e,ffcfb3b8) at sched_switch+0x190

mi_switch(1,0,c06cbd2a,1a7,0) at mi_switch+0x2e6

sleepq_switch(c1027178,c06c863b,18b,0,e75cac10) at sleepq_switch+0x134

sleepq_wait(c1027178,0,c06c999b,da,0) at sleepq_wait+0x41

msleep(c1027178,c07e1120,244,c06e00d5,0) at msleep+0x405

vm_map_unlock_and_wait(c10270c0,0,42000,e75cac5c,302) at vm_map_unlock_and_wait+0x74

kmem_alloc_wait(c10270c0,41400,c2e27220,c2523cc0,1) at kmem_alloc_wait+0x97

exec_copyin_args(e75cacac,80560e6,0,bfbfe6c0,8052140) at exec_copyin_args+0x44

execve(c5265780,e75cad04,c,424,3) at execve+0x32

syscall(3b,3b,3b,bfbfe6f8,bfbfe6c0) at syscall+0x2c0

Xint0x80_syscall() at Xint0x80_syscall+0x1f

--- syscall (59, FreeBSD ELF32, execve), eip = 0x280e55d3, esp = 0xbfbfe6ac, ebp = 0xbfbfe6e8 ---

db> wh 28396

Tracing pid 28396 tid 100139 td 0xc5265600

sched_switch(c5265600,0,1,11e,b8c08f58) at sched_switch+0x190

mi_switch(1,0,c06cbd2a,1a7,0) at mi_switch+0x2e6

sleepq_switch(c5267c48,c06c863b,18b,0,e75c7c74) at sleepq_switch+0x134

sleepq_wait(c5267c48,0,c06c999b,da,0) at sleepq_wait+0x41

msleep(c5267c48,c5267aa4,5c,c06c696c,0) at msleep+0x405

fork1(c5265600,80000034,0,e75c7ccc,c5265600) at fork1+0x1283

vfork(c5265600,e75c7d04,c06e7254,424,0) at vfork+0x29

syscall(3b,3b,3b,1,8052060) at syscall+0x2c0

Xint0x80_syscall() at Xint0x80_syscall+0x1f

--- syscall (66, FreeBSD ELF32, vfork), eip = 0x280d08e0, esp = 0xbfbfe6f0, ebp = 0xbfbfecc8 ---

db> wh 37

Tracing pid 37 tid 100028 td 0xc22c4000

sched_switch(c22c4000,0,1,11e,d240727c) at sched_switch+0x190

mi_switch(1,0,c06cbd2a,1a7,1) at mi_switch+0x2e6

sleepq_switch(c07d7acc,1,c06c863b,18b,1) at sleepq_switch+0x134

sleepq_timedwait(c07d7acc,0,c06c999b,da,0) at sleepq_timedwait+0x42

msleep(c07d7acc,c07d7ae0,44,c06d0cf2,64) at msleep+0x3e1

buf_daemon(0,e502cd38,c06c68ef,30d,0) at buf_daemon+0x168

fork_exit(c05422c0,0,e502cd38) at fork_exit+0xc1

fork_trampoline() at fork_trampoline+0x8

--- trap 0x1, eip = 0, esp = 0xe502cd6c, ebp = 0 ---

db> wh 9

Tracing pid 9 tid 100030 td 0xc2275c00

sched_switch(c2275c00,0,1,11e,98d498b8) at sched_switch+0x190

mi_switch(1,0,c06cbd2a,1a7,1) at mi_switch+0x2e6

sleepq_switch(c07e1554,c06c863b,18b,1,e360ccc4) at sleepq_switch+0x134

sleepq_wait(c07e1554,0,c06c999b,da,0) at sleepq_wait+0x41

msleep(c07e1554,0,68,c06d0cf2,0) at msleep+0x405

vm_daemon(0,e360cd38,c06c68ef,30d,0) at vm_daemon+0x59

fork_exit(c064cb10,0,e360cd38) at fork_exit+0xc1

fork_trampoline() at fork_trampoline+0x8

--- trap 0x1, eip = 0, esp = 0xe360cd6c, ebp = 0 ---

db> wh 8

Tracing pid 8 tid 100031 td 0xc2275a80

sched_switch(c2275a80,0,1,11e,632b4356) at sched_switch+0x190

mi_switch(1,0,c06cbd2a,1a7,0) at mi_switch+0x2e6

sleepq_switch(c07e1510,1,c06c863b,18b,0) at sleepq_switch+0x134

sleepq_timedwait(c07e1510,0,c06c999b,da,0) at sleepq_timedwait+0x42

msleep(c07e1510,c07e14e0,44,c06d0cf2,1f4) at msleep+0x3e1

vm_pageout(0,e3609d38,c06c68ef,30d,0) at vm_pageout+0x2a0

fork_exit(c064c760,0,e3609d38) at fork_exit+0xc1

fork_trampoline() at fork_trampoline+0x8

--- trap 0x1, eip = 0, esp = 0xe3609d6c, ebp = 0 ---

db> wh 0

Tracing pid 0 tid 0 td 0xc0722240

sched_switch(c0722240,0,1,11e,8b861914) at sched_switch+0x190

mi_switch(1,0,c06dfcb2,28b,c06eb678) at mi_switch+0x2e6

scheduler(0,c1e000,c1ec00,c1e000,0) at scheduler+0x220

mi_startup() at mi_startup+0xb5

begin() at begin+0x2c

db> show alllocks

db> show lockedvnods

Locked vnodes

db> show witness

Sleep locks:

0 md bio queue -- last acquired @ dev/md/md.c:659

0 devfsmount -- last acquired @ fs/devfs/devfs_vnops.c:575

15 cdev -- last acquired @ kern/kern_conf.c:62

16  UMA zone -- last acquired @ vm/uma_core.c:2268

16 UMA zone -- (already displayed)

1  devfsrules -- last acquired @ fs/devfs/devfs_rule.c:140

11 system map -- last acquired @ vm/vm_kern.c:295

13  vm page queue mutex -- last acquired @ vm/vm_pageout.c:1498

14   vnode interlock -- last acquired @ kern/vfs_subr.c:2185

15    cdev -- (already displayed)

15    vnode_free_list -- last acquired @ kern/vfs_subr.c:701

15    Syncer mtx -- last acquired @ kern/vfs_subr.c:1692

14   pmap -- last acquired @ i386/i386/pmap.c:2667

16    UMA zone -- (already displayed)

15    uma object -- last acquired @ vm/uma_core.c:985

15    SYSMAPS -- last acquired @ i386/i386/pmap.c:2478

16   UMA zone -- (already displayed)

15   SYSMAPS -- (already displayed)

12  kmem object -- last acquired @ vm/vm_kern.c:397

15   SYSMAPS -- (already displayed)

13   vm page queue mutex -- (already displayed)

12  KMAP ENTRY -- last acquired @ vm/uma_core.c:413

15  SYSMAPS -- (already displayed)

12  kernel object -- last acquired @ kern/vfs_bio.c:3545

15   SYSMAPS -- (already displayed)

13   vm page queue mutex -- (already displayed)

14  pmap -- (already displayed)

15  uma object -- (already displayed)

16  UMA zone -- (already displayed)

5  eventhandler -- last acquired @ kern/subr_eventhandler.c:212

6   eventhandler list -- last acquired @ kern/kern_exit.c:199

6  eventhandler list -- (already displayed)

15 vnode_free_list -- (already displayed)

7  struct mount mtx -- last acquired @ kern/vfs_vnops.c:964

14  vnode interlock -- (already displayed)

14 vnode interlock -- (already displayed)

5  Name Cache -- last acquired @ kern/vfs_cache.c:356

14  vnode interlock -- (already displayed)

16  UMA zone -- (already displayed)

11  system map -- (already displayed)

10 process lock -- last acquired @ kern/subr_sleepqueue.c:369

11  session -- last acquired @ kern/kern_prot.c:2046

12   uidinfo hash -- last acquired @ kern/kern_resource.c:1032

13    uidinfo struct -- last acquired @ order list:0

14     allprison -- last acquired @ kern/kern_jail.c:537

13    sleep mtxpool -- last acquired @ kern/kern_prot.c:1876

12   tty -- last acquired @ kern/kern_event.c:1643

11  sigacts -- last acquired @ kern/subr_sleepqueue.c:370

13  sleep mtxpool -- (already displayed)

11  ktrace -- last acquired @ kern/kern_fork.c:590

11  struct pargs.ref -- last acquired @ kern/kern_proc.c:1111

3  user map -- last acquired @ vm/vm_glue.c:180

16  UMA zone -- (already displayed)

11  system map -- (already displayed)

6   vm object_list -- last acquired @ vm/vm_object.c:229

5   standard object -- last acquired @ kern/vfs_bio.c:3363

13   vm page queue mutex -- (already displayed)

14   vnode interlock -- (already displayed)

15   SYSMAPS -- (already displayed)

6    vm object_list -- (already displayed)

16   UMA zone -- (already displayed)

14   pmap -- (already displayed)

13  vm page queue mutex -- (already displayed)

14  vnode interlock -- (already displayed)

14  pmap -- (already displayed)

4   Giant -- last acquired @ kern/kern_timeout.c:258

5    filedesc structure -- last acquired @ kern/sys_generic.c:1036

6     pipe mutex -- last acquired @ kern/sys_pipe.c:1342

7      sigio lock -- last acquired @ kern/kern_descrip.c:741

8       process group -- last acquired @ kern/kern_proc.c:390

10       process lock -- (already displayed)

11       session -- (already displayed)

16       UMA zone -- (already displayed)

9        ttylist -- last acquired @ kern/tty.c:2806

12        tty -- (already displayed)

10     sellck -- last acquired @ kern/sys_generic.c:944

13     vm page queue mutex -- (already displayed)

7     accept -- last acquired @ kern/uipc_socket.c:480

8      so_snd -- last acquired @ kern/uipc_socket.c:2003

9       so_rcv -- last acquired @ kern/uipc_socket.c:2004

10       sellck -- (already displayed)

10       radix node head -- last acquired @ net/route.c:148

11        rtentry -- last acquired @ net/route.c:197

12         ifaddr -- last acquired @ net/route.c:791

16         UMA zone -- (already displayed)

16        UMA zone -- (already displayed)

11        system map -- (already displayed)

11        ifnet -- last acquired @ net/if.c:1166

16         UMA zone -- (already displayed)

12         arc4_mtx -- last acquired @ libkern/arc4random.c:137

10       process lock -- (already displayed)

13       sleep mtxpool -- (already displayed)

16       UMA zone -- (already displayed)

11       system map -- (already displayed)

13      sleep mtxpool -- (already displayed)

16      UMA zone -- (already displayed)

10      radix node head -- (already displayed)

11      rtentry -- (already displayed)

9       tcp_hc_entry -- last acquired @ netinet/tcp_hostcache.c:654

16       UMA zone -- (already displayed)

11       system map -- (already displayed)

10      sellck -- (already displayed)

11      system map -- (already displayed)

9      so_rcv -- (already displayed)

14    vnode interlock -- (already displayed)

13    sleep mtxpool -- (already displayed)

16   UMA zone -- (already displayed)

11   system map -- (already displayed)

9    UMA boot pages -- last acquired @ vm/uma_core.c:915

5    UMA lock -- last acquired @ vm/uma_core.c:1491

16    UMA zone -- (already displayed)

12    KMAP ENTRY -- (already displayed)

11    system map -- (already displayed)

5    eventhandler -- (already displayed)

6    eventhandler list -- (already displayed)

5    kobj -- last acquired @ kern/subr_kobj.c:307

5    kernel linker -- last acquired @ kern/kern_linker.c:440

12   kernel object -- (already displayed)

10   process lock -- (already displayed)

6    vm object_list -- (already displayed)

12   KMAP ENTRY -- (already displayed)

12   uidinfo hash -- (already displayed)

13   sleep mtxpool -- (already displayed)

5    standard object -- (already displayed)

5    TID lock -- last acquired @ kern/subr_unit.c:592

5    ithread -- last acquired @ kern/kern_intr.c:275

15   cdev -- (already displayed)

5    GEOM orphanage -- last acquired @ geom/geom_event.c:196

9    ttylist -- (already displayed)

5    taskqueue list -- last acquired @ kern/subr_taskqueue.c:90

5    rman head -- last acquired @ kern/subr_rman.c:111

5    rman -- last acquired @ kern/subr_rman.c:449

16    UMA zone -- (already displayed)

11    system map -- (already displayed)

5    devd -- last acquired @ kern/subr_bus.c:488

10    sellck -- (already displayed)

10   sellck -- (already displayed)

13   vm page queue mutex -- (already displayed)

5    bounce pages lock -- last acquired @ i386/i386/busdma_machdep.c:1041

11   ifnet -- (already displayed)

5    bpf global lock -- last acquired @ net/bpf.c:1548

6     bpf interface lock -- last acquired @ order list:0

7      bpf cdev lock -- last acquired @ order list:0

14   pmap -- (already displayed)

5    vm86 lock -- last acquired @ i386/i386/vm86.c:583

5    unit# allocation -- last acquired @ kern/subr_unit.c:719

16    UMA zone -- (already displayed)

5    pseudofs -- last acquired @ fs/pseudofs/pseudofs_fileno.c:55

7    random reseed -- last acquired @ dev/random/yarrow.c:193

12   arc4_mtx -- (already displayed)

5    if_clone lock -- last acquired @ net/if_clone.c:318

5    if_cloners lock -- last acquired @ net/if_clone.c:199

5    domain list -- last acquired @ kern/uipc_domain.c:224

8    pfil_head_list lock -- last acquired @ net/pfil.c:228

7    pfil_head_mtx -- last acquired @ net/pfil.c:71

8     pfil_head_list lock -- (already displayed)

5    tcp -- last acquired @ netinet/tcp_subr.c:1403

6     tcpinp -- last acquired @ netinet/tcp_input.c:742

8      so_snd -- (already displayed)

16     UMA zone -- (already displayed)

9      so_rcv -- (already displayed)

7      accept -- (already displayed)

11     system map -- (already displayed)

7      random reseed -- (already displayed)

12     arc4_mtx -- (already displayed)

10     radix node head -- (already displayed)

11     rtentry -- (already displayed)

9      tcp_hc_entry -- (already displayed)

7      pfil_head_mtx -- (already displayed)

7      IPFW static rules -- last acquired @ netinet/ip_fw2.c:157

9      if send queue -- last acquired @ dev/fxp/if_fxp.c:1218

8      network driver -- last acquired @ dev/fxp/if_fxp.c:1715

9       if_addr_mtx -- last acquired @ netinet6/ip6_output.c:746

16       UMA zone -- (already displayed)

9       taskqueue -- last acquired @ kern/subr_taskqueue.c:219

9       if send queue -- (already displayed)

16      UMA zone -- (already displayed)

9       UMA boot pages -- (already displayed)

11      system map -- (already displayed)

7      so_glabel -- last acquired @ kern/uipc_socket.c:267

13     sleep mtxpool -- (already displayed)

7      if_afdata -- last acquired @ netinet6/scope6.c:415

8       scope6_lock -- last acquired @ netinet6/scope6.c:444

7      ip6_inq -- last acquired @ net/netisr.c:232

7      ip_inq -- last acquired @ net/netisr.c:232

10    radix node head -- (already displayed)

7     pfil_head_mtx -- (already displayed)

7     IPFW static rules -- (already displayed)

11    rtentry -- (already displayed)

9     if send queue -- (already displayed)

8     network driver -- (already displayed)

8     so_snd -- (already displayed)

16    UMA zone -- (already displayed)

11    system map -- (already displayed)

13    sleep mtxpool -- (already displayed)

7     if_afdata -- (already displayed)

9     tcp_hc_entry -- (already displayed)

7     ip6_inq -- (already displayed)

10   radix node head -- (already displayed)

5    lo_mtx -- last acquired @ net/if_loop.c:160

7    IPFW static rules -- (already displayed)

5    ATA queue lock -- last acquired @ dev/ata/ata-queue.c:168

6     ATA state lock -- last acquired @ dev/ata/ata-all.c:327

12   tty -- (already displayed)

5    devstat -- last acquired @ kern/subr_devstat.c:83

7    buffer daemon lock -- last acquired @ kern/vfs_bio.c:2003

15   vnode_free_list -- (already displayed)

15   Syncer mtx -- (already displayed)

6    Softdep Lock -- last acquired @ ufs/ffs/ffs_softdep.c:675

16    UMA zone -- (already displayed)

9     UMA boot pages -- (already displayed)

11    system map -- (already displayed)

14    vnode interlock -- (already displayed)

7     buffer daemon lock -- (already displayed)

6    mountlist -- last acquired @ kern/vfs_subr.c:3050

7     struct mount mtx -- (already displayed)

7    struct mount mtx -- (already displayed)

5    mntid -- last acquired @ kern/vfs_subr.c:438

6     mountlist -- (already displayed)

14   vnode interlock -- (already displayed)

7    so_glabel -- (already displayed)

5    udp -- last acquired @ netinet/udp_usrreq.c:246

6     udpinp -- last acquired @ netinet/udp_usrreq.c:386

7      in_multi_mtx -- last acquired @ netinet/in.c:964

8       igmp_mtx -- last acquired @ netinet/igmp.c:443

9        if_addr_mtx -- (already displayed)

9       if_addr_mtx -- (already displayed)

8       network driver -- (already displayed)

16      UMA zone -- (already displayed)

8      so_snd -- (already displayed)

7      accept -- (already displayed)

12     arc4_mtx -- (already displayed)

16     UMA zone -- (already displayed)

10     radix node head -- (already displayed)

11     rtentry -- (already displayed)

9      so_rcv -- (already displayed)

7      pfil_head_mtx -- (already displayed)

7      IPFW static rules -- (already displayed)

9      if send queue -- (already displayed)

8      network driver -- (already displayed)

7      NFS reqq lock -- last acquired @ nfsclient/nfs_socket.c:1034

8       Synch NFS reply posting -- last acquired @ nfsclient/nfs_socket.c:582

16      UMA zone -- (already displayed)

10      process lock -- (already displayed)

11     ifnet -- (already displayed)

7      random reseed -- (already displayed)

7      ip_inq -- (already displayed)

11     system map -- (already displayed)

8     so_snd -- (already displayed)

16    UMA zone -- (already displayed)

11    system map -- (already displayed)

6     udp6inp -- last acquired @ netinet6/udp6_usrreq.c:743

16     UMA zone -- (already displayed)

7      accept -- (already displayed)

11     ifnet -- (already displayed)

10    radix node head -- (already displayed)

7     pfil_head_mtx -- (already displayed)

7     IPFW static rules -- (already displayed)

7     ip_inq -- (already displayed)

11    rtentry -- (already displayed)

8    network driver -- (already displayed)

9    if send queue -- (already displayed)

11   rtentry -- (already displayed)

7    in_multi_mtx -- (already displayed)

7    if_afdata -- (already displayed)

9    if_addr_mtx -- (already displayed)

12   ifaddr -- (already displayed)

7    sigio lock -- (already displayed)

7    accept -- (already displayed)

8    so_snd -- (already displayed)

9    so_rcv -- (already displayed)

6    udpinp -- (already displayed)

5    vfs hash -- last acquired @ kern/vfs_hash.c:71

14    vnode interlock -- (already displayed)

7    NFS reqq lock -- (already displayed)

8    Synch NFS reply posting -- (already displayed)

5    Name Cache -- (already displayed)

5    knlist lock for lockless objects -- last acquired @ kern/kern_event.c:1643

5    pbuf mutex -- last acquired @ vm/vm_pager.c:401

5    sf_buf -- last acquired @ i386/i386/vm_machdep.c:756

5    buf queue lock -- last acquired @ kern/vfs_bio.c:1398

14    vnode interlock -- (already displayed)

6     Softdep Lock -- (already displayed)

7     struct mount mtx -- (already displayed)

5    bdone lock -- last acquired @ kern/vfs_bio.c:3665

5    needsbuffer lock -- last acquired @ kern/vfs_bio.c:309

11   session -- (already displayed)

11   struct pargs.ref -- (already displayed)

5    fdesc -- last acquired @ kern/kern_descrip.c:1427

6    pipe mutex -- (already displayed)

5    bio queue -- last acquired @ geom/geom_io.c:68

5    FFS Lock -- last acquired @ ufs/ffs/ffs_vfsops.c:1039

12    arc4_mtx -- (already displayed)

5    runningbufspace lock -- last acquired @ kern/vfs_bio.c:328

5    rip -- last acquired @ netinet/raw_ip.c:198

8     so_snd -- (already displayed)

16    UMA zone -- (already displayed)

11    system map -- (already displayed)

5    unp -- last acquired @ kern/uipc_usrreq.c:250

8     so_snd -- (already displayed)

9     so_rcv -- (already displayed)

7     accept -- (already displayed)

5    ipqlock -- last acquired @ netinet/ip_input.c:1132

16    UMA zone -- (already displayed)

7    ip6_inq -- (already displayed)

9   UMA boot pages -- (already displayed)

7   struct mount mtx -- (already displayed)

5   buf queue lock -- (already displayed)

5   needsbuffer lock -- (already displayed)

6   Softdep Lock -- (already displayed)

7   buffer daemon lock -- (already displayed)

5   FFS Lock -- (already displayed)

4   vm map sleep mutex -- last acquired @ vm/vm_map.c:450

0 g_disk_done -- last acquired @ geom/geom_disk.c:198

16 UMA zone -- (already displayed)

5  bio queue -- (already displayed)

11 system map -- (already displayed)

0 MD config lock -- last acquired @ dev/md/md.c:1101

16 UMA zone -- (already displayed)

1  proctree -- last acquired @ kern/tty.c:842

2   allproc -- last acquired @ kern/sched_4bsd.c:441

10   process lock -- (already displayed)

5    fdesc -- (already displayed)

5    filedesc structure -- (already displayed)

14   vnode interlock -- (already displayed)

3    user map -- (already displayed)

8   process group -- (already displayed)

10  process lock -- (already displayed)

11  session -- (already displayed)

4   Giant -- (already displayed)

7   sigio lock -- (already displayed)

16  UMA zone -- (already displayed)

5  filedesc structure -- (already displayed)

10 process lock -- (already displayed)

5  eventhandler -- (already displayed)

5  UMA lock -- (already displayed)

1  GEOM topology -- last acquired @ geom/geom_event.c:228

5   GEOM orphanage -- (already displayed)

16  UMA zone -- (already displayed)

15  cdev -- (already displayed)

5   devstat -- (already displayed)

5   unit# allocation -- (already displayed)

11  system map -- (already displayed)

2   fdc lock -- last acquired @ dev/fdc/fdc.c:780

3    callout_wait_lock -- last acquired @ kern/kern_timeout.c:321

5   bio queue -- (already displayed)

5   bdone lock -- (already displayed)

6   vm object_list -- (already displayed)

14  vnode interlock -- (already displayed)

5   standard object -- (already displayed)

2   swapdev -- last acquired @ vm/swap_pager.c:2058

0 arp_inq -- last acquired @ net/netisr.c:232

0 ip6qlock -- last acquired @ netinet6/frag6.c:682

0 sem -- last acquired @ kern/sysv_sem.c:1268

0 p_peers -- last acquired @ kern/kern_exit.c:250

0 module subsystem sx lock -- last acquired @ kern/kern_module.c:315

0 protect sysfilt_ops -- last acquired @ kern/kern_event.c:739

0 kernel environment -- last acquired @ kern/kern_environment.c:286

0 sysctl lock -- last acquired @ kern/kern_sysctl.c:1349

16 UMA zone -- (already displayed)

10 process lock -- (already displayed)

3  user map -- (already displayed)

2  allproc -- (already displayed)

11 struct pargs.ref -- (already displayed)

15 cdev -- (already displayed)

1  filelist lock -- last acquired @ kern/kern_descrip.c:2129

13  sleep mtxpool -- (already displayed)

5   filedesc structure -- (already displayed)

5  GEOM orphanage -- (already displayed)

4  Giant -- (already displayed)

11 ktrace -- (already displayed)

5  kernel linker -- (already displayed)

1  malloc -- last acquired @ kern/kern_malloc.c:750

11 system map -- (already displayed)

5  devstat -- (already displayed)

9  ttylist -- (already displayed)

6  vm object_list -- (already displayed)

5  UMA lock -- (already displayed)

15 Syncer mtx -- (already displayed)

5  unp -- (already displayed)

5  tcp -- (already displayed)

5  udp -- (already displayed)

5  rip -- (already displayed)

1  addrsel_sxlock -- last acquired @ netinet6/in6_src.c:1031

1  linux osname -- last acquired @ compat/linux/linux_mib.c:231

14 allprison -- (already displayed)

11 ifnet -- (already displayed)

0 nfsd_mtx -- last acquired @ order list:0

8  so_snd -- (already displayed)

0 ddp_list_mtx -- last acquired @ order list:0

1  ddp_mtx -- last acquired @ order list:0

0 slip_mtx -- last acquired @ order list:0

1  slip sc_mtx -- last acquired @ order list:0



Spin locks:



Locks which were never acquired:

swap_pager swhash

IPFW dynamic rules

rts_inq

addrsel_lock

pseudofs_vncache

gif_mtx

ppp_softc_list_mtx

faith_mtx

tunmtx

msq

semid

nfs4dev state

nfs4dev waitq

nfs4dev newq

nullhs

CAM BIOQ lock

LED sx

LED mtx

nfslock

umtxq_lock

pmc shared lock

UUID generator mutex lock

rtsock route_cb lock

rawcb

accept_filter_mtx

kqueue order

accounting

securelevel mutex lock

fifo mutex

encapmtx

phys_pager list

dev_pager list

dev_pager create

swap_pager list

PMAP2

db> 



Anything else needed from DDB?



Kris


[-- Attachment #2 --]
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.2 (FreeBSD)

iD8DBQFDNMtaWry0BWjoQKURAs+HAJ44GIoCIjHWplu+qvgXBtp74lRvCACg/wut
fNSTm19s8gLIw8t3wYo6yyA=
=2/k7
-----END PGP SIGNATURE-----

Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20050924034322.GA1636>