Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 11 Jan 2006 11:42:34 GMT
From:      Henri Hennebert <hlh@ciger.be>
To:        freebsd-gnats-submit@FreeBSD.org
Subject:   kern/91631: 6.0-RELEASE freeze repetitively
Message-ID:  <200601111142.k0BBgYnt011388@www.freebsd.org>
Resent-Message-ID: <200601111150.k0BBo3ph009895@freefall.freebsd.org>

next in thread | raw e-mail | index | archive | help

>Number:         91631
>Category:       kern
>Synopsis:       6.0-RELEASE freeze repetitively
>Confidential:   no
>Severity:       critical
>Priority:       high
>Responsible:    freebsd-bugs
>State:          open
>Quarter:        
>Keywords:       
>Date-Required:
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Wed Jan 11 11:50:02 GMT 2006
>Closed-Date:
>Last-Modified:
>Originator:     Henri Hennebert
>Release:        6.0-RELEASE
>Organization:
CIGER sa
>Environment:
FreeBSD morzine.ciger.be 6.0-RELEASE FreeBSD 6.0-RELEASE #0: Thu Dec 22 11:15:36 CET 2005     root@morzine.ciger.be:/usr/obj/usr/src/sys/MORZINE  i386          
>Description:
I have a production server  (boprocessor PIII) which freeze from time to time
(from 5 hours to 7 days between freeze).

I try (in /boot/loader.conf.local):

   - hint.acpi.0.disabled="1"

   - debug.mpsafevfs=0
     debug.mpsafevm=0

   to no avail.

I setup a serial console and go into ddb and get: (I have another instance of this if necessary)

KDB: enter: Line break on console
[thread pid 61 tid 100052 ]
Stopped at      kdb_enter+0x30: leave
db> bt
Tracing pid 61 tid 100052 td 0xc355e300
kdb_enter(c075ddb2,c355e300,55e300,c355c6f9,e69e0a18) at kdb_enter+0x30
siointr1(c3660800,c07d6120,c07d6120,50,e69e0a54) at siointr1+0xe7
siointr(c3660800,e69e0a80,c04e2ef6,4,c355e300) at siointr+0x78
intr_execute_handlers(c352b090,e69e0a8c,e69e0ae0,c06fee23,34) at intr_execute_handlers+0x98
lapic_handle_intr(34) at lapic_handle_intr+0x3a
Xapic_isr1() at Xapic_isr1+0x33
--- interrupt, eip = 0xc057d1ef, esp = 0xe69e0ad0, ebp = 0xe69e0ae0 ---
vop_stdlock(e69e0b50,0,c078db60,e69e0b50,e69e0b08) at vop_stdlock+0x2f
VOP_LOCK_APV(c078e260,e69e0b50,e69e0b20,c0721424,e69e0b50) at VOP_LOCK_APV+0x54
ffs_lock(e69e0b50,0,2012,c5c38880,e69e0b6c) at ffs_lock+0x19
VOP_LOCK_APV(c078db60,e69e0b50,c37fa000,e69e0b4c,c057d232) at VOP_LOCK_APV+0x54
vn_lock(c5c38880,2012,c355e300,c079a980,c78b6550) at vn_lock+0x13e
vget(c5c38880,2012,c355e300,c400f660,0) at vget+0xff
qsync(c37fa000,c37fa000,c355e300,c3908278,c355e300) at qsync+0x1df
ffs_sync(c37fa000,3,c355e300,c355e300,c355e300) at ffs_sync+0x3fb
sync_fsync(e69e0ca0,e69e0cbc,c05876a4,c0782700,e69e0ca0) at sync_fsync+0x21b
VOP_FSYNC_APV(c0782700,e69e0ca0,c355e300,0,e69e0cbc) at VOP_FSYNC_APV+0x3e
sync_vnode(c39082e0,c355e300,68,c07493b5,0) at sync_vnode+0x1b4
sched_sync(0,e69e0d38,4489e045,458d1424,244489dc) at sched_sync+0x2ef
fork_exit(c05877a0,0,e69e0d38) at fork_exit+0x80
fork_trampoline() at fork_trampoline+0x8
--- trap 0x1, eip = 0, esp = 0xe69e0d6c, ebp = 0 ---
db> ps
  pid   proc     uid  ppid  pgrp  flag   stat  wmesg    wchan  cmd
17495 c389d624   80 17494 17488 0004000 [RUNQ] rrdtool
17494 c3d4320c   80 17488 17488 0004000 [SLPQ wait 0xc3d4320c][SLP] perl5.8.7
17493 c94c720c   80 17489 17489 0004000 [RUNQ] perl
17492 c3896c48  113 17490 17490 0004001 [RUNQ] perl5.8.7
17490 c8e9720c  113 17486 17490 0004000 [SLPQ wait 0xc8e9720c][SLP] sh
17489 c8e95830   80 17485 17489 0004000 [SLPQ wait 0xc8e95830][SLP] sh
17488 c4934624   80 17484 17488 0004000 [SLPQ wait 0xc4934624][SLP] sh
17486 c41a0c48    0   727   727 0000000 [SLPQ piperd 0xc54b2198][SLP] cron
17485 c389c624    0   727   727 0000000 [SLPQ piperd 0xc5d9f660][SLP] cron
17484 c39d3830    0   727   727 0000000 [SLPQ piperd 0xc664d198][SLP] cron
17482 c3896a3c    0   821   821 0000101 [SLPQ select 0xc07a7404][SLP] rsync
17439 c3d43624    8   776   757 0004000 [SLPQ nanslp 0xc07a086c][SLP] sleep
17241 c94c7830    8   772   772 0004000 [SLPQ sbwait 0xc41e1e90][SLP] perl5.8.7
17239 c389620c    8   772   772 0004000 [SLPQ select 0xc07a7404][SLP] innfeed
17156 c493420c 60667   691   691 0000100 [SLPQ lockf 0xc39b6d80][SLP] perl5.8.7
16744 c8e95418 60667   691   691 0000100 [SLPQ lockf 0xc4413640][SLP] perl5.8.7
16342 c3d43000 60667   691   691 0000100 [SLPQ lockf 0xc7bf3540][SLP] perl5.8.7
16106 c4935418 60667   691   691 0000100 [SLPQ select 0xc07a7404][SLP] perl5.8.7
 9825 c8e97000   80   749   749 0008180 (threaded)  httpd
   thread 0xc5be0780 ksegrp 0xc6c126c0 [SLPQ kserel 0xc6c126f4][SLP]
   thread 0xc4430d80 ksegrp 0xc6c126c0 [SLPQ kserel 0xc6c126f4][SLP]
   thread 0xc537e600 ksegrp 0xc6c126c0 [SLPQ lockf 0xc3a5c580][SLP]
   thread 0xc5226180 ksegrp 0xc419ea20 [SLPQ ksesigwait 0xc8e97138][SLP]
   thread 0xc43d2180 ksegrp 0xc6c126c0 [SLPQ piperd 0xc65a4000][SLP]
 9815 c41a0830   80   749   749 0008180 (threaded)  httpd
   thread 0xc5137780 ksegrp 0xc419e1e0 [SLPQ kserel 0xc419e214][SLP]
   thread 0xc7976780 ksegrp 0xc419e1e0 [SLPQ kserel 0xc419e214][SLP]
   thread 0xc7985300 ksegrp 0xc419e1e0 [SLPQ lockf 0xc95acac0][SLP]
   thread 0xc4450d80 ksegrp 0xc3d37720 [SLPQ ksesigwait 0xc41a0968][SLP]
   thread 0xc3b85d80 ksegrp 0xc419e1e0 [SLPQ piperd 0xc65a4000][SLP]
 9803 c6c0e20c   80   749   749 0008180 (threaded)  httpd
   thread 0xc862ba80 ksegrp 0xc3d46960 [SLPQ kserel 0xc3d46994][SLP]
   thread 0xc3bacd80 ksegrp 0xc3d46960 [SLPQ select 0xc07a7404][SLP]
   thread 0xc3d48c00 ksegrp 0xc3d46960 [SLPQ kserel 0xc3d46994][SLP]
   thread 0xc75d7c00 ksegrp 0xc3d46960 [SLPQ piperd 0xc65a4000][SLP]
   thread 0xc4433180 ksegrp 0xc419e960 [SLPQ ksesigwait 0xc6c0e344][SLP]
74361 c8e98624 60001 74360 74360 000c180 (threaded)  python2.3
   thread 0xc3c82780 ksegrp 0xc6c12300 [SLPQ kserel 0xc6c12334][SLP]
   thread 0xc7977780 ksegrp 0xc6c12300 [SLPQ kserel 0xc6c12334][SLP]
   thread 0xc3f2b300 ksegrp 0xc6c12300 [SLPQ select 0xc07a7404][SLP]
   thread 0xc406e300 ksegrp 0xc419e840 [SLPQ ksesigwait 0xc8e9875c][SLP]
   thread 0xc3f2b300 ksegrp 0xc6c12300 [SLPQ select 0xc07a7404][SLP]
   thread 0xc406e300 ksegrp 0xc419e840 [SLPQ ksesigwait 0xc8e9875c][SLP]
74360 c4935624    0     1 74360 0000000 [SLPQ select 0xc07a7404][SLP] python2.3
23802 c41a0624    0     1 23802 0004002 [SLPQ ttyin 0xc3666010][SLP] getty
98175 c4935a3c    0   749   749 0000000 [SLPQ accept 0xc75a619e][SLP] httpd
98169 c3d43c48   80   749   749 0000100 [SLPQ accept 0xc3f88cbe][SLP] httpd
  988 c3d43418    0     1   988 0004002 [SLPQ ttyin 0xc3665410][SLP] getty
  987 c419dc48    0     1   987 0004002 [SLPQ ttyin 0xc3666410][SLP] getty
  985 c419f000    0     1   985 0004002 [SLPQ ttyin 0xc3664c10][SLP] getty
  963 c39d3624    0     1   963 0000000 [SLPQ select 0xc07a7404][SLP] inetd
  947 c3d38000    0     1   947 0000000 [SLPQ select 0xc07a7404][SLP] moused
  923 c419f418    0     1    68 000c082 (threaded)  java
   thread 0xc5211480 ksegrp 0xc419e540 [SLPQ kserel 0xc419e574][SLP]
   thread 0xc441f780 ksegrp 0xc419e540 [SLPQ sbwait 0xc48d9900][SLP]
   thread 0xc7976000 ksegrp 0xc419e540 [SLPQ sbwait 0xc5308e90][SLP]
   thread 0xc75d7180 ksegrp 0xc419e540 [SLPQ kserel 0xc419e574][SLP]
   thread 0xc520a000 ksegrp 0xc419e540 [SLPQ sbwait 0xc3c38900][SLP]
   thread 0xc4696c00 ksegrp 0xc419e540 [SLPQ sbwait 0xc47364d4][SLP]
   thread 0xc8653900 ksegrp 0xc419e540 [SLPQ accept 0xc3f889f6][SLP]
   thread 0xc4220780 ksegrp 0xc419e540 [SLPQ accept 0xc3b8e892][SLP]
   thread 0xc3c7e900 ksegrp 0xc419e0c0 [SLPQ ksesigwait 0xc419f550][SLP]
  864 c3d36a3c  100   860   864 0004000 [SLPQ piperd 0xc38c1000][SLP] unlinkd
  860 c3d4720c  100   858   858 000c080 (threaded)  squid
   thread 0xc4391000 ksegrp 0xc3d463c0 [SLPQ kserel 0xc3d463f4][SLP]
   thread 0xc58e0c00 ksegrp 0xc3d463c0 [SLPQ kserel 0xc3d463f4][SLP]
   thread 0xc4391c00 ksegrp 0xc3d463c0 [SLPQ select 0xc07a7404][SLP]
   thread 0xc3f2c900 ksegrp 0xc3898360 [SLPQ kserel 0xc3898394][SLP]
   thread 0xc3f2ca80 ksegrp 0xc38983c0 [SLPQ kserel 0xc38983f4][SLP]
   thread 0xc3f2cc00 ksegrp 0xc3898420 [SLPQ kserel 0xc3898454][SLP]
   thread 0xc3f2cd80 ksegrp 0xc3898480 [SLPQ kserel 0xc38984b4][SLP]
   thread 0xc3f2d000 ksegrp 0xc38984e0 [SLPQ kserel 0xc3898514][SLP]
   thread 0xc3d4c600 ksegrp 0xc3898540 [SLPQ kserel 0xc3898574][SLP]
   thread 0xc3d4c780 ksegrp 0xc38985a0 [SLPQ kserel 0xc38985d4][SLP]
   thread 0xc3d4c900 ksegrp 0xc3898600 [SLPQ kserel 0xc3898634][SLP]
   thread 0xc3d4ca80 ksegrp 0xc3898660 [SLPQ kserel 0xc3898694][SLP]
   thread 0xc3d4cc00 ksegrp 0xc38986c0 [SLPQ kserel 0xc38986f4][SLP]
   thread 0xc3d4cd80 ksegrp 0xc3898720 [SLPQ kserel 0xc3898754][SLP]
   thread 0xc3f26000 ksegrp 0xc3898780 [SLPQ kserel 0xc38987b4][SLP]
   thread 0xc3f26180 ksegrp 0xc38987e0 [SLPQ kserel 0xc3898814][SLP]
   thread 0xc3f26300 ksegrp 0xc3898840 [SLPQ kserel 0xc3898874][SLP]
   thread 0xc3f26480 ksegrp 0xc38988a0 [SLPQ kserel 0xc38988d4][SLP]
   thread 0xc3f26600 ksegrp 0xc3898900 [SLPQ kserel 0xc3898934][SLP]
   thread 0xc3f26780 ksegrp 0xc3898960 [SLPQ kserel 0xc3898994][SLP]
   thread 0xc3f26900 ksegrp 0xc38989c0 [SLPQ kserel 0xc38989f4][SLP]
   thread 0xc3f26a80 ksegrp 0xc3898a20 [SLPQ kserel 0xc3898a54][SLP]
   thread 0xc3f26c00 ksegrp 0xc3898a80 [SLPQ kserel 0xc3898ab4][SLP]
   thread 0xc3f26d80 ksegrp 0xc3898ae0 [SLPQ kserel 0xc3898b14][SLP]
   thread 0xc3f29000 ksegrp 0xc3898b40 [SLPQ kserel 0xc3898b74][SLP]
   thread 0xc3f29180 ksegrp 0xc3898ba0 [SLPQ kserel 0xc3898bd4][SLP]
   thread 0xc3f29300 ksegrp 0xc3898c00 [SLPQ kserel 0xc3898c34][SLP]
   thread 0xc3f29480 ksegrp 0xc3898c60 [SLPQ kserel 0xc3898c94][SLP]
   thread 0xc3f29600 ksegrp 0xc3898cc0 [SLPQ kserel 0xc3898cf4][SLP]
   thread 0xc3f29780 ksegrp 0xc3898d20 [SLPQ kserel 0xc3898d54][SLP]
   thread 0xc3f29900 ksegrp 0xc3898d80 [SLPQ kserel 0xc3898db4][SLP]
   thread 0xc3c7f480 ksegrp 0xc3898de0 [SLPQ kserel 0xc3898e14][SLP]
   thread 0xc3b85900 ksegrp 0xc3898e40 [SLPQ kserel 0xc3898e74][SLP]
   thread 0xc3d48480 ksegrp 0xc3898ea0 [SLPQ kserel 0xc3898ed4][SLP]
   thread 0xc3c82d80 ksegrp 0xc3d37000 [SLPQ kserel 0xc3d37034][SLP]
   thread 0xc3c7e180 ksegrp 0xc3d37060 [SLPQ ksesigwait 0xc3d47344][SLP]
  858 c3d47624  100     1   858 0000000 [SLPQ wait 0xc3d47624][SLP] squid
  845 c3896830 60001   844   844 000c180 (threaded)  python2.3
   thread 0xc3b86000 ksegrp 0xc3898060 [SLPQ kserel 0xc3898094][SLP]
   thread 0xc5134180 ksegrp 0xc3898060 [SLPQ kserel 0xc3898094][SLP]
   thread 0xc3d4c180 ksegrp 0xc3898060 [SLPQ select 0xc07a7404][SLP]
   thread 0xc7983c00 ksegrp 0xc3d46000 [SLPQ ksesigwait 0xc3896968][SLP]
  844 c3d36c48    0     1   844 0000000 [SLPQ select 0xc07a7404][SLP] python2.3
  840 c3d36624    0   834   834 0000001 [SLPQ lockf 0xc361c640][SLP] saslauthd
  838 c3d36830    0   834   834 0000001 [SLPQ lockf 0xc9267380][SLP] saslauthd
  837 c3d36000    0   834   834 0000001 [SLPQ lockf 0xc4c00940][SLP] saslauthd
  836 c39d3c48    0   834   834 0000001 [SLPQ lockf 0xc43d4480][SLP] saslauthd
  834 c3d43830    0     1   834 0000001 [SLPQ accept 0xc3b9d03a][SLP] saslauthd
  821 c3d36418    0     1   821 0000000 [SLPQ select 0xc07a7404][SLP] rsync
  814 c3d47418    0     1   814 0000000 [SLPQ select 0xc07a7404][SLP] racoon
  807 c3d3820c 60001   806   806 000c180 (threaded)  python2.3
   thread 0xc537e000 ksegrp 0xc3d372a0 [SLPQ kserel 0xc3d372d4][SLP]
   thread 0xc4433900 ksegrp 0xc3d372a0 [SLPQ kserel 0xc3d372d4][SLP]
   thread 0xc7977180 ksegrp 0xc3d372a0 [SLPQ select 0xc07a7404][SLP]
   thread 0xc3c7f780 ksegrp 0xc3d37de0 [SLPQ ksesigwait 0xc3d38344][SLP]
  806 c3d47c48    0     1   806 0000000 [SLPQ select 0xc07a7404][SLP] python2.3
  777 c389dc48    8   774   757 0004002 [SLPQ nanslp 0xc07a086c][SLP] perl5.8.7
  776 c389cc48    8   773   757 0004002 [SLPQ wait 0xc389cc48][SLP] sh
  774 c39d320c    8     1   757 0000002 [SLPQ wait 0xc39d320c][SLP] sh
  773 c3827a3c    8     1   757 0000002 [SLPQ wait 0xc3827a3c][SLP] sh
  772 c389ca3c    8     1   772 0000001 [SLPQ select 0xc07a7404][SLP] innd
  749 c382a20c    0     1   749 0000000 [SLPQ nanslp 0xc07a086c][SLP] httpd
  727 c382a000    0     1   727 0000000 [SLPQ nanslp 0xc07a086c][SLP] cron
  715 c389c830   25     1   715 0000100 [SLPQ pause 0xc389c864][SLP] sendmail
  709 c3896624    0     1   709 0000100 [SLPQ select 0xc07a7404][SLP] sendmail
  702 c3827830 60667     1   702 0008080 (threaded)  amavis-milter
   thread 0xc5211a80 ksegrp 0xc34dd600 [SLPQ kserel 0xc34dd634][SLP]
   thread 0xc75ed780 ksegrp 0xc34dd600 [SLPQ select 0xc07a7404][SLP]
   thread 0xc53a1300 ksegrp 0xc34dd600 [SLPQ kserel 0xc34dd634][SLP]
   thread 0xc3b86600 ksegrp 0xc354f3c0 [SLPQ ksesigwait 0xc3827968][SLP]
  691 c382720c 60667     1   691 0000100 [SLPQ nanslp 0xc07a086c][SLP] perl5.8.7
  686 c39d3000    0     1   686 0000100 [SLPQ select 0xc07a7404][SLP] sshd
  656 c389d20c    0     1   656 0000000 [SLPQ select 0xc07a7404][SLP] ntpd
  641 c39d220c    0     1   641 0000000 [SLPQ select 0xc07a7404][SLP] lpd
  626 c389c000    0     1   626 0000000 [SLPQ select 0xc07a7404][SLP] timed
  547 c39d2000   53     1   547 0000100 [SLPQ select 0xc07a7404][SLP] named
  486 c39d2624    0     1   486 0000000 [SLPQ select 0xc07a7404][SLP] syslogd
  451 c39d2418    0     1   451 0000000 [SLPQ select 0xc07a7404][SLP] devd
   67 c382a624    0     0     0 0000204 [SLPQ - 0xe6c2ecf8][SLP] schedcpu
   66 c382a830    0     0     0 0000204 [SLPQ - 0xc07bb92c][SLP] nfsiod 3
   65 c382aa3c    0     0     0 0000204 [SLPQ - 0xc07bb928][SLP] nfsiod 2
   64 c382ac48    0     0     0 0000204 [SLPQ - 0xc07bb924][SLP] nfsiod 1
   63 c355c20c    0     0     0 0000204 [SLPQ - 0xc07bb920][SLP] nfsiod 0
   62 c355c418    0     0     0 0000204 [SLPQ vlruwt 0xc355c418][SLP] vnlru
   61 c355c624    0     0     0 0000204 [CPU 1] syncer
   60 c355c830    0     0     0 0000204 [SLPQ psleep 0xc07a794c][SLP] bufdaemon
   59 c355ca3c    0     0     0 000020c [SLPQ pgzero 0xc07c1de4][SLP] pagezero
   58 c355cc48    0     0     0 0000204 [SLPQ psleep 0xc07c1934][SLP] vmdaemon
   57 c35bc000    0     0     0 0000204 [SLPQ psleep 0xc07c18f0][SLP] pagedaemon
   56 c35bc20c    0     0     0 0000204 [RUNQ] swi0: sio
   55 c35bc418    0     0     0 0000204 [SLPQ - 0xc352b43c][SLP] fdc0
   54 c35bc624    0     0     0 0000204 [SLPQ usbtsk 0xc079d8c4][SLP] usbtask
   53 c35bc830    0     0     0 0000204 [SLPQ usbevt 0xc35c0210][SLP] usb0
    9 c35bca3c    0     0     0 0000204 [SLPQ - 0xc3563300][SLP] acpi_task2
    8 c35bcc48    0     0     0 0000204 [SLPQ - 0xc3563300][SLP] acpi_task1
    7 c354d624    0     0     0 0000204 [SLPQ - 0xc3563300][SLP] acpi_task0
    6 c354d830    0     0     0 0000204 [SLPQ - 0xc3563380][SLP] thread taskq
   52 c354da3c    0     0     0 0000204 [IWAIT] swi6:+
   51 c354dc48    0     0     0 0000204 [IWAIT] swi6: task queue
   50 c355b000    0     0     0 0000204 [IWAIT] swi2: cambio
    5 c355b20c    0     0     0 0000204 [SLPQ - 0xc3563700][SLP] kqueue taskq
   49 c355b418    0     0     0 0000204 [IWAIT] swi5:+
   48 c355b624    0     0     0 0000204 [SLPQ - 0xc079d1c0][SLP] yarrow
    4 c355b830    0     0     0 0000204 [SLPQ - 0xc079dd88][SLP] g_down
    3 c355ba3c    0     0     0 0000204 [SLPQ - 0xc079dd84][SLP] g_up
    2 c355bc48    0     0     0 0000204 [SLPQ - 0xc079dd7c][SLP] g_event
   47 c355c000    0     0     0 0000204 [IWAIT] swi3: vm
   46 c353ec48    0     0     0 000020c [LOCK  Giant c4393740] swi4: clock sio
   45 c354c000    0     0     0 0000204 [IWAIT] swi1: net
   44 c354c20c    0     0     0 0000204 [IWAIT] irq0:
   43 c354c418    0     0     0 0000204 [IWAIT] irq31:
   42 c354c624    0     0     0 0000204 [LOCK  Giant c4393740] irq30: fxp0
   41 c354c830    0     0     0 0000204 [CPU 0] irq29: sym1
   40 c354ca3c    0     0     0 0000204 [IWAIT] irq28: ohci0
   39 c354cc48    0     0     0 0000204 [IWAIT] irq27:
   38 c354d000    0     0     0 0000204 [IWAIT] irq26:
   37 c354d20c    0     0     0 0000204 [IWAIT] irq25:
   36 c354d418    0     0     0 0000204 [IWAIT] irq24:
   35 c352d624    0     0     0 0000204 [IWAIT] irq23:
   34 c352d830    0     0     0 0000204 [IWAIT] irq22:
   33 c352da3c    0     0     0 0000204 [IWAIT] irq21:
   32 c352dc48    0     0     0 0000204 [IWAIT] irq20: sym0
   31 c353e000    0     0     0 0000204 [IWAIT] irq19:
   30 c353e20c    0     0     0 0000204 [IWAIT] irq18:
   29 c353e418    0     0     0 0000204 [IWAIT] irq17:
   28 c353e624    0     0     0 0000204 [IWAIT] irq16:
   27 c353e830    0     0     0 0000204 [IWAIT] irq15: ata1
   26 c353ea3c    0     0     0 0000204 [IWAIT] irq14: ata0
   25 c34de20c    0     0     0 0000204 [IWAIT] irq13:
   24 c34de418    0     0     0 0000204 [IWAIT] irq12: psm0
   23 c34de624    0     0     0 0000204 [IWAIT] irq11:
   22 c34de830    0     0     0 0000204 [IWAIT] irq10:
   21 c34dea3c    0     0     0 0000204 [IWAIT] irq9: acpi0
   20 c34dec48    0     0     0 0000204 [IWAIT] irq8:
   19 c352d000    0     0     0 0000204 [IWAIT] irq7: ppc0
   18 c352d20c    0     0     0 0000204 [IWAIT] irq6: fdc0
   17 c352d418    0     0     0 0000204 [IWAIT] irq5:
   16 c34d9000    0     0     0 0000204 [IWAIT] irq4: sio0
   15 c34d920c    0     0     0 0000204 [IWAIT] irq3: sio1
   14 c34d9418    0     0     0 0000204 [IWAIT] irq2:
   13 c34d9624    0     0     0 0000204 [RUNQ] irq1: atkbd0
   12 c34d9830    0     0     0 000020c [Can run] idle: cpu0
   11 c34d9a3c    0     0     0 000020c [Can run] idle: cpu1
    1 c34d9c48    0     0     1 0004200 [SLPQ wait 0xc34d9c48][SLP] init
   10 c34de000    0     0     0 0000204 [SLPQ ktrace 0xc079e7d8][SLP] ktrace
    0 c079de80    0     0     0 0000200 [IWAIT] swapper
db> show lockedvnods
Locked vnodes

0xc3908220: tag syncer, type VNON
    usecount 1, writecount 0, refcount 2 mountedhere 0
    flags ()
     lock type syncer: EXCL (count 1) by thread 0xc355e300 (pid 61)

0xc7fdbaa0: tag ufs, type VDIR
    usecount 1, writecount 0, refcount 3 mountedhere 0
    flags ()
    v_object 0xc8af1840 ref 0 pages 1
     lock type ufs: EXCL (count 1) by thread 0xc3897180 (pid 17492)
        ino 8, on dev da1s1h

0xc5c38880: tag ufs, type VREG
    usecount 1, writecount 0, refcount 1 mountedhere 0
    flags ()
    v_object 0xc713c630 ref 0 pages 0
     lock type ufs: EXCL (count 1) by thread 0xc355e300 (pid 61)
        ino 989, on dev da1s1h

0xc61b7cc0: tag ufs, type VREG
    usecount 0, writecount 0, refcount 1 mountedhere 0
    flags (VI_DOOMED)
     lock type ufs: EXCL (count 1) by thread 0xc3897180 (pid 17492)
        ino 331, on dev da1s1h
db> show thread
  100094 (0xc389f780)  sched_switch(c389f780,c34dfa80,6,f012f22e,34bee348) at sched_switch+0x160
  100119 (0xc4696a80)  sched_switch(c4696a80,0,1,dabba84a,610d1de2) at sched_switch+0x160
  100209 (0xc74f1780)  sched_switch(c74f1780,c34df900,6,647678da,69a4c152) at sched_switch+0x160
  100083 (0xc3897180)  sched_switch(c3897180,c34df900,6,25cf296c,5ff01778) at sched_switch+0x160
  100278 (0xc537e180)  sched_switch(c537e180,0,1,46bc941c,e51fa1b1) at sched_switch+0x160
  100274 (0xc7976c00)  sched_switch(c7976c00,0,1,c5914198,e63fdc60) at sched_switch+0x160
  100243 (0xc3b86d80)  sched_switch(c3b86d80,0,1,8b276b98,e73848fb) at sched_switch+0x160
  100225 (0xc3c7e300)  sched_switch(c3c7e300,0,1,4af868ca,e04d8c5f) at sched_switch+0x160
  100087 (0xc3829a80)  sched_switch(c3829a80,0,1,ef5da2c2,e0c9afec) at sched_switch+0x160
  100118 (0xc5be0180)  sched_switch(c5be0180,0,1,40af45ae,e1943a48) at sched_switch+0x160
  100082 (0xc3897300)  sched_switch(c3897300,0,1,50d54436,9c08f45d) at sched_switch+0x160
  100153 (0xc3c7f300)  sched_switch(c3c7f300,0,1,9e15dcd8,872dd794) at sched_switch+0x160
  100302 (0xc74f9300)  sched_switch(c74f9300,0,1,a9e8f68c,811a43f5) at sched_switch+0x160
  100078 (0xc3897900)  sched_switch(c3897900,0,1,f0fc23c2,4fcb285d) at sched_switch+0x160
  100232 (0xc43d2a80)  sched_switch(c43d2a80,0,1,442671b8,f4243b88) at sched_switch+0x160
  100351 (0xc5134d80)  sched_switch(c5134d80,0,1,7f50c04,147f751) at sched_switch+0x160
  100295 (0xc5214900)  sched_switch(c5214900,0,1,543b62ae,39f1688) at sched_switch+0x160
  100253 (0xc3f2da80)  sched_switch(c3f2da80,0,1,b4c8ae2,db083755) at sched_switch+0x160
  100221 (0xc5be0780)  sched_switch(c5be0780,0,1,5bfa6806,f09b4e68) at sched_switch+0x160
  100155 (0xc4430d80)  sched_switch(c4430d80,0,1,9eaf346e,f090f16c) at sched_switch+0x160
  100266 (0xc537e600)  sched_switch(c537e600,c406ea80,1,abc41d0a,6de03704) at sched_switch+0x160
  100344 (0xc5226180)  sched_switch(c5226180,0,1,22b03572,6f3d4783) at sched_switch+0x160
  100277 (0xc43d2180)  sched_switch(c43d2180,0,1,f6a95856,ea76f3c7) at sched_switch+0x160
  100231 (0xc5137780)  sched_switch(c5137780,0,1,529ecc56,9f2f005a) at sched_switch+0x160
  100230 (0xc7976780)  sched_switch(c7976780,0,1,f4e78482,9f25638b) at sched_switch+0x160
  100165 (0xc7985300)  sched_switch(c7985300,0,1,798b1c1e,a4ee3f9e) at sched_switch+0x160
  100310 (0xc4450d80)  sched_switch(c4450d80,0,1,e51347b8,9e27f9fb) at sched_switch+0x160
  100223 (0xc3b85d80)  sched_switch(c3b85d80,0,1,eea33d8c,36a86010) at sched_switch+0x160
  100115 (0xc862ba80)  sched_switch(c862ba80,0,1,b55e7528,12818010) at sched_switch+0x160
  100220 (0xc3bacd80)  sched_switch(c3bacd80,c862ba80,1,5db2884,127e8d6b) at sched_switch+0x160
  100202 (0xc3d48c00)  sched_switch(c3d48c00,0,1,3cea115c,1283597a) at sched_switch+0x160
  100323 (0xc75d7c00)  sched_switch(c75d7c00,0,1,a309e4d4,a51bc700) at sched_switch+0x160
  100319 (0xc4433180)  sched_switch(c4433180,0,1,3c72e10c,2a895c0) at sched_switch+0x160
  100128 (0xc3c82780)  sched_switch(c3c82780,0,1,77bb15fe,ce9660e6) at sched_switch+0x160
  100126 (0xc7977780)  sched_switch(c7977780,0,1,631c66b4,ce74f6ab) at sched_switch+0x160
  100136 (0xc3f2b300)  sched_switch(c3f2b300,c3c82780,1,228185f4,ce839c78) at sched_switch+0x160
  100113 (0xc406e300)  sched_switch(c406e300,0,1,844105b6,6c2418cc) at sched_switch+0x160
  100255 (0xc3f2c600)  sched_switch(c3f2c600,0,1,1ff7f696,e0f099c8) at sched_switch+0x160
  100222 (0xc355ec00)  sched_switch(c355ec00,0,1,8d53b796,f61643d5) at sched_switch+0x160
  100257 (0xc3828c00)  sched_switch(c3828c00,0,1,4c3c645e,2ae05bd7) at sched_switch+0x160
  100156 (0xc3c7fc00)  sched_switch(c3c7fc00,0,1,170ce290,d8970e83) at sched_switch+0x160
  100152 (0xc3b85600)  sched_switch(c3b85600,0,1,a88d2226,3941ec57) at sched_switch+0x160
  100211 (0xc3d4c000)  sched_switch(c3d4c000,0,1,8bfbf536,315e152a) at sched_switch+0x160
  100212 (0xc3c82300)  sched_switch(c3c82300,0,1,d5eac258,cbf82b8c) at sched_switch+0x160
  100108 (0xc389e180)  sched_switch(c389e180,0,1,60e49eba,f61aa592) at sched_switch+0x160
  100145 (0xc3c7dd80)  sched_switch(c3c7dd80,0,1,101b877e,4932d611) at sched_switch+0x160
  100258 (0xc5211480)  sched_switch(c5211480,0,1,eac6f800,dab073a4) at sched_switch+0x160
  100214 (0xc441f780)  sched_switch(c441f780,c5211480,1,fcdaebe,8e9cf870) at sched_switch+0x160
  100248 (0xc7976000)  sched_switch(c7976000,c441f780,1,20f54c7e,f6ed5262) at sched_switch+0x160
  100249 (0xc75d7180)  sched_switch(c75d7180,0,1,ea0b2a2a,daf30b2b) at sched_switch+0x160
  100247 (0xc520a000)  sched_switch(c520a000,c520ac00,1,712e5c1c,3c82ebd1) at sched_switch+0x160
  100269 (0xc4696c00)  sched_switch(c4696c00,c5134000,1,93d7cec6,c3f2b332) at sched_switch+0x160
  100161 (0xc8653900)  sched_switch(c8653900,c4450480,1,439e8526,13390485) at sched_switch+0x160
  100133 (0xc4220780)  sched_switch(c4220780,c3c7f000,1,f5efe02,cb0b074f) at sched_switch+0x160
  100235 (0xc3c7e900)  sched_switch(c3c7e900,0,1,586937be,b88548b8) at sched_switch+0x160
  100143 (0xc3c7ec00)  sched_switch(c3c7ec00,0,1,1b37949a,f8286dd6) at sched_switch+0x160
  100085 (0xc4391000)  sched_switch(c4391000,0,1,c017a390,338579b5) at sched_switch+0x160
  100114 (0xc58e0c00)  sched_switch(c58e0c00,0,1,b8603b86,33897c37) at sched_switch+0x160
  100129 (0xc4391c00)  sched_switch(c4391c00,c4391000,1,b23ac98a,33653216) at sched_switch+0x160
  100200 (0xc3f2c900)  sched_switch(c3f2c900,0,1,a6285d90,33ec0707) at sched_switch+0x160
  100199 (0xc3f2ca80)  sched_switch(c3f2ca80,0,1,4eac683a,234ea8e3) at sched_switch+0x160
  100198 (0xc3f2cc00)  sched_switch(c3f2cc00,0,1,bb47fabc,2c32703b) at sched_switch+0x160
  100197 (0xc3f2cd80)  sched_switch(c3f2cd80,0,1,c60d48c8,33fcda9c) at sched_switch+0x160
  100196 (0xc3f2d000)  sched_switch(c3f2d000,0,1,731b7610,3c9fc308) at sched_switch+0x160
  100195 (0xc3d4c600)  sched_switch(c3d4c600,0,1,bf31228,3442cbe8) at sched_switch+0x160
  100194 (0xc3d4c780)  sched_switch(c3d4c780,0,1,a66c1420,2be5de27) at sched_switch+0x160
  100193 (0xc3d4c900)  sched_switch(c3d4c900,0,1,6cfd5eec,3c3773c5) at sched_switch+0x160
  100192 (0xc3d4ca80)  sched_switch(c3d4ca80,0,1,d6705a26,236ff24e) at sched_switch+0x160
  100191 (0xc3d4cc00)  sched_switch(c3d4cc00,0,1,2bad8b08,33ac2537) at sched_switch+0x160
  100190 (0xc3d4cd80)  sched_switch(c3d4cd80,0,1,31a0bd0a,2ba443bd) at sched_switch+0x160
  100189 (0xc3f26000)  sched_switch(c3f26000,0,1,44565750,2bc16527) at sched_switch+0x160
  100188 (0xc3f26180)  sched_switch(c3f26180,0,1,9a77b4a0,3c491ef7) at sched_switch+0x160
  100187 (0xc3f26300)  sched_switch(c3f26300,0,1,f95490d0,3457650f) at sched_switch+0x160
  100186 (0xc3f26480)  sched_switch(c3f26480,0,1,a1ea4460,3c25ac73) at sched_switch+0x160
  100185 (0xc3f26600)  sched_switch(c3f26600,0,1,6ea70588,341e1aa8) at sched_switch+0x160
  100184 (0xc3f26780)  sched_switch(c3f26780,0,1,a4efacac,3c6f6801) at sched_switch+0x160
  100183 (0xc3f26900)  sched_switch(c3f26900,0,1,6eb12ff0,2c115f0f) at sched_switch+0x160
  100182 (0xc3f26a80)  sched_switch(c3f26a80,0,1,78c83c8,33cb0d4b) at sched_switch+0x160
  100181 (0xc3f26c00)  sched_switch(c3f26c00,0,1,7fdacad8,33db7e71) at sched_switch+0x160
  100180 (0xc3f26d80)  sched_switch(c3f26d80,0,1,d68a0fa4,3cc08485) at sched_switch+0x160
  100179 (0xc3f29000)  sched_switch(c3f29000,0,1,744e130e,2c6c88e0) at sched_switch+0x160
  100178 (0xc3f29180)  sched_switch(c3f29180,0,1,771a1d64,3cad79c8) at sched_switch+0x160
  100177 (0xc3f29300)  sched_switch(c3f29300,0,1,8aaf3038,3c5cdbd2) at sched_switch+0x160
  100176 (0xc3f29480)  sched_switch(c3f29480,0,1,19441306,2bfe9aa1) at sched_switch+0x160
  100175 (0xc3f29600)  sched_switch(c3f29600,0,1,3a7713d4,2c817667) at sched_switch+0x160
  100174 (0xc3f29780)  sched_switch(c3f29780,0,1,97a6f8d0,3c05f622) at sched_switch+0x160
  100173 (0xc3f29900)  sched_switch(c3f29900,0,1,60ed8cd0,342f8d9b) at sched_switch+0x160
  100172 (0xc3c7f480)  sched_switch(c3c7f480,0,1,692687c0,340d88b2) at sched_switch+0x160
  100171 (0xc3b85900)  sched_switch(c3b85900,0,1,c2f79064,3ccd1d59) at sched_switch+0x160
  100170 (0xc3d48480)  sched_switch(c3d48480,0,1,f627f000,2c573d9a) at sched_switch+0x160
  100169 (0xc3c82d80)  sched_switch(c3c82d80,0,1,9efa6f0c,2c222df4) at sched_switch+0x160
  100167 (0xc3c7e180)  sched_switch(c3c7e180,0,1,7e3dbc0e,573f97eb) at sched_switch+0x160
  100160 (0xc389f900)  sched_switch(c389f900,0,1,4d6ca7de,d9eaef0a) at sched_switch+0x160
  100095 (0xc3b86000)  sched_switch(c3b86000,0,1,18767452,707b8f0d) at sched_switch+0x160
  100150 (0xc5134180)  sched_switch(c5134180,0,1,f891c886,706428be) at sched_switch+0x160
  100139 (0xc3d4c180)  sched_switch(c3d4c180,c3b86000,1,669901be,706dc0dd) at sched_switch+0x160
  100245 (0xc7983c00)  sched_switch(c7983c00,0,1,fdb4daa8,151eb1c7) at sched_switch+0x160
  100144 (0xc3c82180)  sched_switch(c3c82180,0,1,225bbac6,65acdaec) at sched_switch+0x160
  100141 (0xc3c7fa80)  sched_switch(c3c7fa80,0,1,41542d3a,a468c51f) at sched_switch+0x160
  100142 (0xc3b85c00)  sched_switch(c3b85c00,0,1,25b014fa,a434dcaa) at sched_switch+0x160
  100138 (0xc3b85000)  sched_switch(c3b85000,0,1,5ed917ca,a4c1716a) at sched_switch+0x160
  100111 (0xc3897c00)  sched_switch(c3897c00,0,1,4ec2f7ec,a8e6af77) at sched_switch+0x160
  100154 (0xc3829000)  sched_switch(c3829000,0,1,60672c8e,a51aaa65) at sched_switch+0x160
  100140 (0xc3c7e000)  sched_switch(c3c7e000,0,1,d3df5a5a,b8956bcd) at sched_switch+0x160
  100159 (0xc3c7e780)  sched_switch(c3c7e780,0,1,d81e1162,3c749920) at sched_switch+0x160
  100124 (0xc537e000)  sched_switch(c537e000,0,1,aa25b234,a10ac6b4) at sched_switch+0x160
  100096 (0xc4433900)  sched_switch(c4433900,0,1,eda1dffc,a0e8fa0a) at sched_switch+0x160
  100131 (0xc7977180)  sched_switch(c7977180,c537e000,1,d7f45680,a0f7dcc6) at sched_switch+0x160
  100079 (0xc3c7f780)  sched_switch(c3c7f780,0,1,77e177da,8c18510) at sched_switch+0x160
  100163 (0xc3d4c300)  sched_switch(c3d4c300,0,1,490da77e,c3b29cdc) at sched_switch+0x160
  100097 (0xc389f300)  sched_switch(c389f300,0,1,fd1129dc,41e74e14) at sched_switch+0x160
  100090 (0xc3829600)  sched_switch(c3829600,0,1,fada2934,99ce1c1d) at sched_switch+0x160
  100106 (0xc389e480)  sched_switch(c389e480,0,1,3d9e6d4a,cbdac310) at sched_switch+0x160
  100068 (0xc3828a80)  sched_switch(c3828a80,0,1,4076875e,cbbab3ae) at sched_switch+0x160
  100089 (0xc3829780)  sched_switch(c3829780,0,1,200d0e82,4a146fab) at sched_switch+0x160
  100071 (0xc3828600)  sched_switch(c3828600,0,1,76b280de,9ae45f83) at sched_switch+0x160
  100070 (0xc3828780)  sched_switch(c3828780,0,1,ea747b34,5515c146) at sched_switch+0x160
  100088 (0xc3829900)  sched_switch(c3829900,0,1,c3e1bcfa,a61d49cc) at sched_switch+0x160
  100080 (0xc3897600)  sched_switch(c3897600,0,1,b9d4b1a6,e1f43bb) at sched_switch+0x160
  100149 (0xc5211a80)  sched_switch(c5211a80,0,1,13527b8a,9ec11878) at sched_switch+0x160
  100116 (0xc75ed780)  sched_switch(c75ed780,c5211a80,1,d971ce08,9ebd28b5) at sched_switch+0x160
  100158 (0xc53a1300)  sched_switch(c53a1300,0,1,320d5d04,9ec35900) at sched_switch+0x160
  100112 (0xc3b86600)  sched_switch(c3b86600,0,1,9dcf4e,c0e3f14e) at sched_switch+0x160
  100064 (0xc355d000)  sched_switch(c355d000,0,1,bcb79f96,f8479dda) at sched_switch+0x160
  100105 (0xc389e600)  sched_switch(c389e600,0,1,33070bfa,6268d7d0) at sched_switch+0x160
  100092 (0xc3829300)  sched_switch(c3829300,0,1,1e90eec2,254873fa) at sched_switch+0x160
  100099 (0xc389f000)  sched_switch(c389f000,0,1,80d8770c,b3250d73) at sched_switch+0x160
  100084 (0xc3897000)  sched_switch(c3897000,0,1,be1d37b2,3895ec93) at sched_switch+0x160
  100098 (0xc389f180)  sched_switch(c389f180,0,1,dd54e696,30b0c1f5) at sched_switch+0x160
  100101 (0xc389ec00)  sched_switch(c389ec00,0,1,ea5bccd0,1709d153) at sched_switch+0x160
  100100 (0xc389ed80)  sched_switch(c389ed80,0,1,79e2248c,c4188220) at sched_switch+0x160
  100073 (0xc3828300)  sched_switch(c3828300,0,1,de57d0d8,9a3ae4e1) at sched_switch+0x160
  100074 (0xc3828180)  sched_switch(c3828180,0,1,d3a72f44,bbc913fb) at sched_switch+0x160
  100075 (0xc3828000)  sched_switch(c3828000,0,1,3ce87228,3bf7c3fb) at sched_switch+0x160
  100076 (0xc355ed80)  sched_switch(c355ed80,0,1,cb549cf4,193c42d2) at sched_switch+0x160
  100050 (0xc355e600)  sched_switch(c355e600,0,1,900dec04,32315f00) at sched_switch+0x160
  100051 (0xc355e480)  sched_switch(c355e480,0,1,4a33ccfc,51caafe1) at sched_switch+0x160
  100052 (0xc355e300)  kdb_enter(c075ddb2,c355e300,55e300,c355c6f9,e69e0a18) at kdb_enter+0x30
  100053 (0xc355e180)  sched_switch(c355e180,0,1,b139ab7c,2b9bbf5a) at sched_switch+0x160
  100054 (0xc355e000)  sched_switch(c355e000,0,1,c101d892,27a356e1) at sched_switch+0x160
  100055 (0xc355dd80)  sched_switch(c355dd80,0,1,6ed13a8c,1e64123c) at sched_switch+0x160
  100056 (0xc355dc00)  sched_switch(c355dc00,0,1,2c15b168,4035605e) at sched_switch+0x160
  100057 (0xc355da80)  sched_switch(c355da80,0,1,1d02258c,591b873d) at sched_switch+0x160
  100058 (0xc355d900)  sched_switch(c355d900,0,1,d16c6b00,76bab52a) at sched_switch+0x160
  100059 (0xc355d780)  sched_switch(c355d780,0,1,641770c,593b2f02) at sched_switch+0x160
  100060 (0xc355d600)  sched_switch(c355d600,0,1,e718493c,763447bf) at sched_switch+0x160
  100061 (0xc355d480)  sched_switch(c355d480,0,1,1843690c,593a3b49) at sched_switch+0x160
  100062 (0xc355d300)  sched_switch(c355d300,0,1,67ff1f8c,5939eb9b) at sched_switch+0x160
  100038 (0xc354ea80)  sched_switch(c354ea80,0,1,ab627b8c,59397b1e) at sched_switch+0x160
  100039 (0xc354e900)  sched_switch(c354e900,0,1,1fe4f80c,15b69cde) at sched_switch+0x160
  100040 (0xc354e780)  fork_trampoline() at fork_trampoline
  100041 (0xc354e600)  sched_switch(c354e600,0,1,25014d0c,d0f8fc3f) at sched_switch+0x160
  100042 (0xc354e480)  sched_switch(c354e480,0,1,59e686c4,90091874) at sched_switch+0x160
  100043 (0xc354e300)  sched_switch(c354e300,0,1,1f22160c,593743ff) at sched_switch+0x160
  100044 (0xc354e180)  fork_trampoline() at fork_trampoline
  100045 (0xc354e000)  sched_switch(c354e000,0,1,faf81da6,f2185cfa) at sched_switch+0x160
  100046 (0xc353fd80)  sched_switch(c353fd80,0,1,ff16c4a6,c656cbe6) at sched_switch+0x160
  100047 (0xc353fc00)  sched_switch(c353fc00,0,1,89636b1c,f8615f08) at sched_switch+0x160
  100048 (0xc353fa80)  sched_switch(c353fa80,0,1,fd4e99d8,e2c5f7e4) at sched_switch+0x160
  100049 (0xc353f900)  fork_trampoline() at fork_trampoline
  100027 (0xc353f180)  sched_switch(c353f180,0,1,a87ee61c,df196413) at sched_switch+0x160
  100028 (0xc353f000)  sched_switch(c353f000,0,1,71200118,91e59646) at sched_switch+0x160
  100029 (0xc34dfd80)  fork_trampoline() at fork_trampoline
  100030 (0xc34dfc00)  fork_trampoline() at fork_trampoline
  100031 (0xc34dfa80)  sched_switch(c34dfa80,0,1,e0f5d25c,c84ca366) at sched_switch+0x160
  100032 (0xc34df900)  sched_switch(c34d0028,92,c06ff181,c07d8840,e4f50008) at sched_switch+0x160
  100033 (0xc34df780)  fork_trampoline() at fork_trampoline
  100034 (0xc34df600)  fork_trampoline() at fork_trampoline
  100035 (0xc34df480)  fork_trampoline() at fork_trampoline
  100036 (0xc354ed80)  fork_trampoline() at fork_trampoline
  100037 (0xc354ec00)  fork_trampoline() at fork_trampoline
  100017 (0xc34db900)  fork_trampoline() at fork_trampoline
  100018 (0xc34db780)  fork_trampoline() at fork_trampoline
  100019 (0xc34db600)  fork_trampoline() at fork_trampoline
  100020 (0xc34db480)  sched_switch(c34db480,0,1,db5deaca,d0f3b299) at sched_switch+0x160
  100021 (0xc34db300)  fork_trampoline() at fork_trampoline
  100022 (0xc34db180)  fork_trampoline() at fork_trampoline
  100023 (0xc353f780)  fork_trampoline() at fork_trampoline
  100024 (0xc353f600)  fork_trampoline() at fork_trampoline
  100025 (0xc353f480)  sched_switch(c353f480,0,1,419fbf8c,2fbe0490) at sched_switch+0x160
  100026 (0xc353f300)  fork_trampoline() at fork_trampoline
  100008 (0xc34da300)  fork_trampoline() at fork_trampoline
  100009 (0xc34da180)  sched_switch(c34da180,0,1,b6b8383e,4b97ce62) at sched_switch+0x160
  100010 (0xc34da000)  fork_trampoline() at fork_trampoline
  100011 (0xc34df300)  fork_trampoline() at fork_trampoline
  100012 (0xc34df180)  fork_trampoline() at fork_trampoline
  100013 (0xc34df000)  fork_trampoline() at fork_trampoline
  100014 (0xc34dbd80)  fork_trampoline() at fork_trampoline
  100015 (0xc34dbc00)  fork_trampoline() at fork_trampoline
  100016 (0xc34dba80)  fork_trampoline() at fork_trampoline
  100000 (0xc34db000)  fork_trampoline() at fork_trampoline
  100001 (0xc34dad80)  fork_trampoline() at fork_trampoline
  100002 (0xc34dac00)  fork_trampoline() at fork_trampoline
  100003 (0xc34daa80)  sched_switch(c34daa80,0,1,46808a0,ebefbd06) at sched_switch+0x160
  100004 (0xc34da900)  sched_switch(c34da900,0,1,1e4610b2,9eb697fd) at sched_switch+0x160
  100005 (0xc34da780)  sched_switch(c34da780,0,1,e0e9cb58,96d93f5a) at sched_switch+0x160
  100006 (0xc34da600)  sched_switch(c34da600,0,1,3f2f0406,801852d) at sched_switch+0x160
  100007 (0xc34da480)  sched_switch(c34da480,0,1,e6fc4f8c,591e6267) at sched_switch+0x160
       0 (0xc079e0a0)  sched_switch(c079e0a0,0,1,38eb828c,26ffd34e) at sched_switch+0x160
db> call cpu_reset(0)
cpu_reset: Restarting BSP
cpu_reset_proxy: Stopped CPU 1


Here is /var/run/dmesg.boot

Copyright (c) 1992-2005 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD 6.0-RELEASE #0: Thu Dec 22 11:15:36 CET 2005
    root@morzine.ciger.be:/usr/obj/usr/src/sys/MORZINE
WARNING: debug.mpsafenet forced to 0 as ipsec requires Giant
WARNING: MPSAFE network stack disabled, expect reduced performance.
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Pentium(R) III CPU family      1266MHz (1260.61-MHz 686-class CPU)
  Origin = "GenuineIntel"  Id = 0x6b1  Stepping = 1
  Features=0x383fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE>
real memory  = 2147483648 (2048 MB)
avail memory = 2096680960 (1999 MB)
ACPI APIC Table: <PTLTD          APIC  >
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
 cpu0 (BSP): APIC ID:  3
 cpu1 (AP): APIC ID:  0
ioapic0 <Version 1.1> irqs 0-15 on motherboard
ioapic1 <Version 1.1> irqs 16-31 on motherboard
npx0: [FAST]
npx0: <math processor> on motherboard
npx0: INT 16 interface
acpi0: <PTLTD   RSDT> on motherboard
acpi0: Power Button (fixed)
pci_link0: <ACPI PCI Link LNKA> on acpi0
pci_link1: <ACPI PCI Link LNKB> on acpi0
pci_link2: <ACPI PCI Link LNKC> on acpi0
pci_link3: <ACPI PCI Link LNKD> on acpi0
pci_link4: <ACPI PCI Link LNKE> irq 5 on acpi0
pci_link5: <ACPI PCI Link LNKF> on acpi0
pci_link6: <ACPI PCI Link LNKG> on acpi0
pci_link7: <ACPI PCI Link LNKH> on acpi0
pci_link8: <ACPI PCI Link LNKI> on acpi0
pci_link9: <ACPI PCI Link LNKJ> on acpi0
pci_link10: <ACPI PCI Link LNKK> on acpi0
pci_link11: <ACPI PCI Link LNKL> on acpi0
pci_link12: <ACPI PCI Link LNKM> irq 9 on acpi0
pci_link13: <ACPI PCI Link LNKN> irq 10 on acpi0
pci_link14: <ACPI PCI Link LNKO> irq 9 on acpi0
pci_link15: <ACPI PCI Link LNKP> on acpi0
Timecounter "ACPI-safe" frequency 3579545 Hz quality 1000
acpi_timer0: <32-bit timer at 3.579545MHz> port 0xf008-0xf00b on acpi0
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
acpi_button0: <Power Button> on acpi0
pcib0: <ACPI Host-PCI bridge> on acpi0
pci0: <ACPI PCI bus> on pcib0
pci0: <display, VGA> at device 4.0 (no driver attached)
fxp0: <Intel 82559ER Pro/100 Ethernet> port 0x1400-0x143f mem 0xfc021000-0xfc021fff,0xfc000000-0xfc01ffff irq 30 at device 10.0 on pci0
miibus0: <MII bus> on fxp0
inphy0: <i82555 10/100 media interface> on miibus0
inphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
fxp0: Ethernet address: 00:30:05:19:9f:a8
fxp0: [GIANT-LOCKED]
isab0: <PCI-ISA bridge> port 0xf100-0xf10f at device 15.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <ServerWorks ROSB4 UDMA33 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x1800-0x180f at device 15.1 on pci0
ata0: <ATA channel 0> on atapci0
ata1: <ATA channel 1> on atapci0
ohci0: <OHCI (generic) USB controller> mem 0xfc022000-0xfc022fff irq 28 at device 15.2 on pci0
ohci0: [GIANT-LOCKED]
usb0: OHCI version 1.0, legacy support
usb0: <OHCI (generic) USB controller> on ohci0
usb0: USB revision 1.0
uhub0: (0x1166) OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 4 ports with 4 removable, self powered
pcib1: <ACPI Host-PCI bridge> on acpi0
pci1: <ACPI PCI bus> on pcib1
sym0: <1010-66> port 0x1c00-0x1cff mem 0xfe004000-0xfe0043ff,0xfe000000-0xfe001fff irq 20 at device 8.0 on pci1
sym0: Symbios NVRAM, ID 7, Fast-80, LVD, parity checking
sym0: open drain IRQ line driver, using on-chip SRAM
sym0: using LOAD/STORE-based firmware.
sym0: handling phase mismatch from SCRIPTS.
sym0: [GIANT-LOCKED]
sym1: <1010-66> port 0x2000-0x20ff mem 0xfe004400-0xfe0047ff,0xfe002000-0xfe003fff irq 29 at device 10.0 on pci1
sym1: Symbios NVRAM, ID 7, Fast-80, LVD, parity checking
sym1: open drain IRQ line driver, using on-chip SRAM
sym1: using LOAD/STORE-based firmware.
sym1: handling phase mismatch from SCRIPTS.
sym1: [GIANT-LOCKED]
pcib2: <ACPI Host-PCI bridge> on acpi0
pci2: <ACPI PCI bus> on pcib2
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
psm0: model IntelliMouse Explorer, device ID 4
fdc0: <floppy drive controller> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
fdc0: [FAST]
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
ppc0: <Standard parallel printer port> port 0x378-0x37b irq 7 on acpi0
ppc0: Generic chipset (EPP/NIBBLE) in COMPATIBLE mode
ppbus0: <Parallel port bus> on ppc0
lpt0: <Printer> on ppbus0
lpt0: Interrupt-driven port
ppi0: <Parallel I/O> on ppbus0
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x90 on acpi0
sio0: type 16550A, console
sio1: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 on acpi0
sio1: type 16550A
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc8fff,0xc9000-0xccfff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <4 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounters tick every 1.000 msec
IPv6 packet filtering initialized, default to accept, logging limited to 100 packets/entry
IPsec: Initialized Security Association Processing.
ipfw2 (+ipv6) initialized, divert loadable, rule-based forwarding enabled, default to deny, logging limited to 100 packets/entry by default
acd0: CDROM <FX4830T/R02N> at ata1-master UDMA33
Waiting 3 seconds for SCSI devices to settle
(noperiph:sym0:0:-1:-1): SCSI BUS reset delivered.
(noperiph:sym1:0:-1:-1): SCSI BUS reset delivered.
GEOM_LABEL: Label for provider fd0 is msdosfs/DOS 6_22.
(probe22:sym1:0:8:0): phase change 6-7 6@00c7a58c resid=4.
sa0 at sym0 bus 0 target 4 lun 0
sa0: <HP C5683A C111> Removable Sequential Access SCSI-2 device
sa0: 40.000MB/s transfers (20.000MHz, offset 31, 16bit)
pass5 at sym1 bus 0 target 8 lun 0
pass5: <SDR GEM318 0> Fixed Processor SCSI-2 device
pass5: 3.300MB/s transfers
da0 at sym1 bus 0 target 0 lun 0
da0: <SEAGATE ST318452LC 8501> Fixed Direct Access SCSI-3 device
da0: 160.000MB/s transfers (80.000MHz, offset 62, 16bit), Tagged Queueing Enabled
da0: 17501MB (35843670 512 byte sectors: 255H 63S/T 2231C)
da1 at sym1 bus 0 target 1 lun 0
da1: <SEAGATE ST318452LC 8501> Fixed Direct Access SCSI-3 device
da1: 160.000MB/s transfers (80.000MHz, offset 62, 16bit), Tagged Queueing Enabled
da1: 17501MB (35843670 512 byte sectors: 255H 63S/T 2231C)
da2 at sym1 bus 0 target 2 lun 0
da2: <SEAGATE ST318452LC 8501> Fixed Direct Access SCSI-3 device
da2: 160.000MB/s transfers (80.000MHz, offset 62, 16bit), Tagged Queueing Enabled
da2: 17501MB (35843670 512 byte sectors: 255H 63S/T 2231C)
da3 at sym1 bus 0 target 3 lun 0
da3: <SEAGATE ST318452LC 8501> Fixed Direct Access SCSI-3 device
da3: 160.000MB/s transfers (80.000MHz, offset 62, 16bit), Tagged Queueing Enabled
da3: 17501MB (35843670 512 byte sectors: 255H 63S/T 2231C)
SMP: AP CPU #1 Launched!
Trying to mount root from ufs:/dev/da0s1a

Thank you for your time


Henri
>How-To-Repeat:
On this server, just wait from 5 hours to max 10 days...
>Fix:
              
>Release-Note:
>Audit-Trail:
>Unformatted:



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?200601111142.k0BBgYnt011388>