Skip site navigation (1)Skip section navigation (2)
Date:      Fri, 26 Dec 2008 20:32:39 -0500
From:      "Dylan Cochran" <a134qaed@gmail.com>
To:        freebsd-stable <freebsd-stable@freebsd.org>
Subject:   Re: Hard lock on 7.1-RC1
Message-ID:  <bdf82f800812261732t427debb5vd5963895aec8e9a7@mail.gmail.com>
In-Reply-To: <bdf82f800812222218j3c77f564gf9b8e48bbbda7ca2@mail.gmail.com>
References:  <bdf82f800812211205k1a90c926q473f468126d58d7f@mail.gmail.com> <bdf82f800812222218j3c77f564gf9b8e48bbbda7ca2@mail.gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
On Tue, Dec 23, 2008 at 1:18 AM, Dylan Cochran <a134qaed@gmail.com> wrote:
> On Sun, Dec 21, 2008 at 3:05 PM, Dylan Cochran <a134qaed@gmail.com> wrote:
>> I'm hitting a strange lockup on 7.1-RC1, where some socket operations
>> seem to stall, as well as basic file operations. The only reproducable
>> way I have of triggering it is by doing multiple inserts into
>> phpmyadmin on lighttpd+fastcgi php5 + mysql51-server, though this
>> isn't the only thing which triggers it, just the only one which is
>> semi reliable. I've also reproduced this on another machine, set up
>> specifically to rule out any machine specific problems (as they have
>> different drive controllers, one uses gjournal, etc).
>>
>> I inititially built a kernel with SW_WATCHDOG, and attempted to use
>> watchdogd and DDB to get an output from show locks, but the watchdogd
>> hasn't panicked the machine, so at least devfs is still unlocked; I'm
>> not able to get physical access to the machine until monday.
>>
>> The bug was introduced as far as I can tell, between 7.1-BETA2 and 7.1-RC1.


Here's the output of alltrace and show pcpu, as requested on IRC:

KDB: debugger backends: ddb
KDB: current backend: ddb
Copyright (c) 1992-2008 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 7.1-RC2 #2: Tue Dec 23 05:35:44 UTC 2008
    root@venti.coppolino.lan:/usr/obj/usr/src/sys/DEBUG
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Celeron(R) CPU 3.06GHz (3095.61-MHz 686-class CPU)
  Origin = "GenuineIntel"  Id = 0xf41  Stepping = 1
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x441d<SSE3,DTES64,MON,DS_CPL,CNXT-ID,xTPR>
real memory  = 1073676288 (1023 MB)
avail memory = 1037094912 (989 MB)
ACPI APIC Table: <AMIINT INTEL865>
ioapic0 <Version 2.0> irqs 0-23 on motherboard
kbd1 at kbdmux0
ath_hal: 0.9.20.3 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413)
acpi0: <AMIINT INTEL865> on motherboard
acpi0: [ITHREAD]
acpi0: Power Button (fixed)
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
acpi_button0: <Power Button> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
agp0: <Intel 82865 host to AGP bridge> on hostb0
pcib1: <PCI-PCI bridge> at device 1.0 on pci0
pci1: <PCI bus> on pcib1
vgapci0: <VGA-compatible display> mem
0xfd000000-0xfdffffff,0xf4000000-0xf5ffffff irq 16 at device 0.0 on
pci1
uhci0: <Intel 82801EB (ICH5) USB controller USB-A> port 0xcc00-0xcc1f
irq 16 at device 29.0 on pci0
uhci0: [GIANT-LOCKED]
uhci0: [ITHREAD]
usb0: <Intel 82801EB (ICH5) USB controller USB-A> on uhci0
usb0: USB revision 1.0
uhub0: <Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb0
uhub0: 2 ports with 2 removable, self powered
uhci1: <Intel 82801EB (ICH5) USB controller USB-B> port 0xd000-0xd01f
irq 19 at device 29.1 on pci0
uhci1: [GIANT-LOCKED]
uhci1: [ITHREAD]
usb1: <Intel 82801EB (ICH5) USB controller USB-B> on uhci1
usb1: USB revision 1.0
uhub1: <Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb1
uhub1: 2 ports with 2 removable, self powered
uhci2: <Intel 82801EB (ICH5) USB controller USB-C> port 0xd400-0xd41f
irq 18 at device 29.2 on pci0
uhci2: [GIANT-LOCKED]
uhci2: [ITHREAD]
usb2: <Intel 82801EB (ICH5) USB controller USB-C> on uhci2
usb2: USB revision 1.0
uhub2: <Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb2
uhub2: 2 ports with 2 removable, self powered
uhci3: <Intel 82801EB (ICH5) USB controller USB-D> port 0xd800-0xd81f
irq 16 at device 29.3 on pci0
uhci3: [GIANT-LOCKED]
uhci3: [ITHREAD]
usb3: <Intel 82801EB (ICH5) USB controller USB-D> on uhci3
usb3: USB revision 1.0
uhub3: <Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb3
uhub3: 2 ports with 2 removable, self powered
ehci0: <Intel 82801EB/R (ICH5) USB 2.0 controller> mem
0xfebffc00-0xfebfffff irq 23 at device 29.7 on pci0
ehci0: [GIANT-LOCKED]
ehci0: [ITHREAD]
usb4: EHCI version 1.0
usb4: companion controllers, 2 ports each: usb0 usb1 usb2 usb3
usb4: <Intel 82801EB/R (ICH5) USB 2.0 controller> on ehci0
usb4: USB revision 2.0
uhub4: <Intel EHCI root hub, class 9/0, rev 2.00/1.00, addr 1> on usb4
uhub4: 8 ports with 8 removable, self powered
umass0: <Western Digital My Book ES, class 0/0, rev 2.00/0.12, addr 2> on uhub4
uhid0: <Western Digital My Book ES, class 0/0, rev 2.00/0.12, addr 2> on uhub4
pcib2: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci2: <ACPI PCI bus> on pcib2
rl0: <RealTek 8139 10/100BaseTX> port 0x9c00-0x9cff mem
0xfeafff00-0xfeafffff irq 18 at device 2.0 on pci2
miibus0: <MII bus> on rl0
rlphy0: <RealTek internal media interface> PHY 0 on miibus0
rlphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
rl0: Ethernet address: 00:08:54:e0:78:cb
rl0: [ITHREAD]
fwohci0: <VIA Fire II (VT6306)> port 0x9800-0x987f mem
0xfeaff000-0xfeaff7ff irq 17 at device 5.0 on pci2
fwohci0: [FILTER]
fwohci0: OHCI version 1.0 (ROM=1)
fwohci0: No. of Isochronous channels is 4.
fwohci0: EUI64 26:2d:48:00:01:00:00:00
fwohci0: Phy 1394a available S400, 3 ports.
fwohci0: Link S100, max_rec 2 bytes.
fwohci0: max_rec 2 -> 2048
firewire0: <IEEE1394(FireWire) bus> on fwohci0
fwe0: <Ethernet over FireWire> on firewire0
if_fwe0: Fake Ethernet address: 26:2d:48:00:00:00
fwe0: Ethernet address: 26:2d:48:00:00:00
fwip0: <IP over FireWire> on firewire0
fwip0: Firewire address: 26:2d:48:00:01:00:00:00 @ 0xfffe00000000,
S400, maxrec 2048
sbp0: <SBP-2/SCSI over FireWire> on firewire0
dcons_crom0: <dcons configuration ROM> on firewire0
dcons_crom0: bus_addr 0x13c8000
fwohci0: Initiate bus reset
fwohci0: BUS reset
fwohci0: node_id=0xc800ffc0, gen=1, CYCLEMASTER mode
rl1: <RealTek 8139 10/100BaseTX> port 0x9400-0x94ff mem
0xfeaffe00-0xfeaffeff irq 23 at device 11.0 on pci2
miibus1: <MII bus> on rl1
rlphy1: <RealTek internal media interface> PHY 0 on miibus1
rlphy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
rl1: Ethernet address: 00:13:d3:ea:00:2c
rl1: [ITHREAD]
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel ICH5 UDMA100 controller> port
0xc000-0xc007,0xbc00-0xbc03,0xb800-0xb807,0xb400-0xb403,0xb000-0xb00f
irq 18 at device 31.1 on pci0
atapci0: [ITHREAD]
ata2: <ATA channel 0> on atapci0
ata2: [ITHREAD]
ata3: <ATA channel 1> on atapci0
ata3: [ITHREAD]
atapci1: <Intel ICH5 SATA150 controller> port
0xec00-0xec07,0xe800-0xe803,0xe400-0xe407,0xe000-0xe003,0xdc00-0xdc0f
irq 18 at device 31.2 on pci0
atapci1: [ITHREAD]
ata4: <ATA channel 0> on atapci1
ata4: [ITHREAD]
ata5: <ATA channel 1> on atapci1
ata5: [ITHREAD]
pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
pci0: <multimedia, audio> at device 31.5 (no driver attached)
fdc0: <floppy drive controller> port 0x3f2-0x3f3,0x3f4-0x3f5,0x3f7 irq
6 drq 2 on acpi0
fdc0: [FILTER]
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
sio0: type 16550A, console
sio0: [FILTER]
cpu0: <ACPI CPU> on acpi0
p4tcc0: <CPU Frequency Thermal Control> on cpu0
pmtimer0 on isa0
orm0: <ISA Option ROMs> at iomem
0xc0000-0xc97ff,0xc9800-0xcbfff,0xe0000-0xe0fff pnpid ORM0000 on isa0
ata0 at port 0x1f0-0x1f7,0x3f6 irq 14 on isa0
ata0: [ITHREAD]
ata1 at port 0x170-0x177,0x376 irq 15 on isa0
ata1: [ITHREAD]
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
atkbd0: [ITHREAD]
ppc0: <Parallel port> at port 0x378-0x37f irq 7 on isa0
ppc0: Generic chipset (NIBBLE-only) in COMPATIBLE mode
ppbus0: <Parallel port bus> on ppc0
ppbus0: [ITHREAD]
plip0: <PLIP network interface> on ppbus0
plip0: WARNING: using obsoleted IFF_NEEDSGIANT flag
lpt0: <Printer> on ppbus0
lpt0: Interrupt-driven port
ppi0: <Parallel I/O> on ppbus0
ppc0: [GIANT-LOCKED]
ppc0: [ITHREAD]
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x100>
sio1: configured irq 3 not in bitmap of probed irqs 0
sio1: port may not be enabled
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounter "TSC" ffirewire0: 1 nodes, maxhop <= 0, cable IRM = 0 (me)
firewire0: bus manager 0 (me)
requency 3095605075 Hz quality 800
Timecounters tick every 1.000 msec
ad4: 38166MB <WDC WD400EB-75CPF0 06.04G06> at ata2-master UDMA100
acd0: CDRW <HL-DT-ST RW/DVD GCC-4320B/1.10> at ata3-master UDMA40
ad8: 381554MB <WDC WD4000AAKS-00TMA0 12.01C01> at ata4-master SATA150
da0 at umass-sim0 bus 0 target 0 lun 0
da0: <WD My Book ES 012> Fixed Direct Access SCSI-4 device
da0: 40.000MB/s transfers
da0: 476940MB (976773168 512 byte sectors: 255H 63S/T 60801C)
GEOM_LABEL: Label for provider da0s1 is msdosfs/My Book.
Trying to mount root from ufs:/dev/ad4s1a
WARNING: / was not properly dismounted
Loading configuration files.
kernel dumps on /dev/ad4s1b
Entropy harvesting: interrupts ethernet point_to_point kickstart.
swapon: adding /dev/ad4s1b as swap device
Starting file system checks:
/dev/ad4s1a: INCORRECT BLOCK COUNT I=3184756 (960 should be 416) (CORRECTED)
/dev/ad4s1a: UNREF FILE I=3184741  OWNER=mysql MODE=100600
/dev/ad4s1a: SIZE=0 MTIME=Dec 26 23:03 2008  (CLEARED)
/dev/ad4s1a: UNREF FILE I=3184742  OWNER=mysql MODE=100600
/dev/ad4s1a: SIZE=0 MTIME=Dec 26 23:03 2008  (CLEARED)
/dev/ad4s1a: UNREF FILE I=3184743  OWNER=mysql MODE=100600
/dev/ad4s1a: SIZE=0 MTIME=Dec 26 23:03 2008  (CLEARED)
/dev/ad4s1a: UNREF FILE I=3184745  OWNER=mysql MODE=100600
/dev/ad4s1a: SIZE=0 MTIME=Dec 26 23:03 2008  (CLEARED)
/dev/ad4s1a: UNREF FILE I=3184748  OWNER=mysql MODE=100600
/dev/ad4s1a: SIZE=0 MTIME=Dec 26 23:03 2008  (CLEARED)
/dev/ad4s1a: FREE BLK COUNT(S) WRONG IN SUPERBLK (SALVAGED)
/dev/ad4s1a: SUMMARY INFORMATION BAD (SALVAGED)
/dev/ad4s1a: BLK(S) MISSING IN BIT MAPS (SALVAGED)
/dev/ad4s1a: 301883 files, 2007620 used, 15899682 free (104434 frags,
1974406 blocks, 0.6% fragmentation)
/dev/ad8p1: 3 files, 24001394 used, 165206304 free (24 frags, 20650785
blocks, 0.0% fragmentation)
Setting hostuuid: 6cc18842-cc89-11dd-a258-000854e078cb.
Setting hostid: 0x48a14ae1.
Mounting local file systems:.
Setting hostname: venti.coppolino.lan.
net.inet6.ip6.auto_linklocal: 1 -> 0
rl0: link state changed to DOWN
rl0: no link ....rl0: link state changed to UP
 got link
DHCPREQUEST on rl0 to 255.255.255.255 port 67
DHCPACK from 172.17.0.1
bound to 172.17.1.2 -- renewal in 2592000 seconds.
rl1: link state changed to DOWN
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
	inet6 fe80::1%lo0 prefixlen 64 scopeid 0x6
	inet6 ::1 prefixlen 128
	inet 127.0.0.1 netmask 0xff000000
rl0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=8<VLAN_MTU>
	ether 00:08:54:e0:78:cb
	inet 172.17.1.2 netmask 0xffff0000 broadcast 172.17.255.255
	inet 172.17.1.4 netmask 0xffffffff broadcast 172.17.1.4
	media: Ethernet autoselect (100baseTX <full-duplex>)
	status: active
Additional routing options:.
Starting devd.
hw.acpi.cpu.cx_lowest: C1 -> C1
Additional IP options:.
Mounting NFS file systems:.
ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib
a.out ldconfig path: /usr/lib/aorlut /usr/lib/comp1:at/aout
 link state changed to UP
Creating and/or trimming log files:.
Checking for core dump on /dev/ad4s1b...
savecore: no dumps found
Initial i386 initialization:.
Additional ABI support:.
Setting date via ntp.
27 Dec 00:12:43 ntpdate[837]: step time server 172.17.0.1 offset 0.301237 sec
Clearing /tmp (X related).
Starting gmond.
Starting watchdogd.
Starting local daemons:2008/1227 00:12:44 venti: conf...httpd
tcp!172.17.1.2!http...init...icache 104,857,600 bytes = 1,638,400
entries; 16 scache
sync...2008/1227 00:12:52 err 2: pre-copy sha1 wrong at arena055
248610572: expected=2e62696158543588314ff8e3fe2b22a8bf999ddd
got=7333baa941bd97b468859c770552e4146bd24335
announce tcp!*!venti...serving.
Loading configuration files.
/etc/rc: WARNING: $hostname is not set -- see rc.conf(5).
ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib
/usr/local/lib/mysql
a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout
Creating and/or trimming log files:.
Clearing /tmp (X related).
Starting local daemons:.
Updating motd.
Starting mysql.
Starting lighttpd.
Starting sshd.
/etc/rc: WARNING: $sendmail_enable is not set properly - see rc.conf(5).
/etc/rc: WARNING: $sendmail_enable is not set properly - see rc.conf(5).
Local package initialization:.

Sat Dec 27 00:13:04 UTC 2008
.
Updating motd.
Mounting late file systems:.
Configuring syscons: blanktime.
Starting sshd.
Starting cron.
Local package initialization:.
Starting background file system checks in 60 seconds.

Sat Dec 27 00:13:07 UTC 2008


FreeBSD/i386 (venti.coppolino.lan) (ttyd0)



Last login: Fri Dec 26 23:03:19 on ttyd0
Copyright (c) 1992-2008 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.

FreeBSD 7.1-RC2 (DEBUG) #2: Tue Dec 23 05:35:44 UTC 2008

Welcome to FreeBSD!

Before seeking technical support, please use the following resources:

o  Security advisories and updated errata information for all releases are
   at http://www.FreeBSD.org/releases/ - always consult the ERRATA section
   for your release first as it's updated frequently.

o  The Handbook and FAQ documents are at http://www.FreeBSD.org/ and,
   along with the mailing lists, can be searched by going to
   http://www.FreeBSD.org/search/.  If the doc distribution has
   been installed, they're also available formatted in /usr/share/doc.

If you still have a question or problem, please take the output of
`uname -a', along with any relevant error messages, and email it
as a question to the questions@FreeBSD.org mailing list.  If you are
unfamiliar with FreeBSD's directory layout, please refer to the hier(7)
manual page.  If you are not familiar with manual pages, type `man man'.

You may also use sysinstall(8) to re-enter the installation and
configuration utility.  Edit /etc/motd to change this login announcement.

You have new mail.
venti# interrupt                   total
irq4: sio0                           620
irq6: fdc0                             1
irq17: fwohci0                         3
irq18: rl0 uhci2++                 58746
irq23: rl1 ehci0                     206
cpu0: timer                       431028
Total                      490604
KDB: stack backtrace:
db_trace_self_wrapper(c0b55b52,e66daae0,c07615e9,c0b50617,77c6c,...)
at db_trace_self_wrapper+0x26
kdb_backtrace(c0b50617,77c6c,0,e66daae0,c07bf27a,...) at kdb_backtrace+0x29
hardclock(0,c07fedf3,0,0,0,...) at hardclock+0x1f9
lapic_handle_timer(e66dab08) at lapic_handle_timer+0x9c
Xtimerint() at Xtimerint+0x1f
--- interrupt, eip = 0xc07fedf3, esp = 0xe66dab48, ebp = 0xe66dac34 ---
kern_sendfile(c41a7af0,e66dacfc,0,0,0,...) at kern_sendfile+0x463
do_sendfile(e66dad2c,c0aba265,c41a7af0,e66dacfc,20,...) at do_sendfile+0xb1
sendfile(c41a7af0,e66dacfc,20,16,e66dad2c,...) at sendfile+0x13
syscall(e66dad38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (393, FreeBSD ELF32, sendfile), eip = 0x282cb0cb, esp =
0xbfbfc7cc, ebp = 0xbfbfe848 ---
KDB: enter: watchdog timeout
[thread pid 1288 tid 100058 ]
Stopped at      kdb_enter_why+0x3a:     movl    $0,kdb_why
db> show lock
db> show pcpu
cpuid        = 0
curthread    = 0xc41a7af0: pid 1288 "lighttpd"
curpcb       = 0xe66dad90
fpcurthread  = none
idlethread   = 0xc3f18af0: pid 11 "idle: cpu0"
APIC ID      = 0
currentldt   = 0x50
db> show all proc
  pid  ppid  pgrp   uid   state   wmesg     wchan    cmd
 1516   902   902     0  R                           watchdogd
 1470  1467  1470     0  S+      ttyin    0xc418fc10 csh
 1467     1  1467     0  Ss+     wait     0xc4602570 login
 1466     1  1466     0  Ss+     ttyin    0xc41ac810 getty
 1465  1464    49     0  S+      nanslp   0xc0c7dc44 sleep
 1464  1461    49     0  S+      wait     0xc4603570 sh
 1462     1    49     0  S+      piperd   0xc439d18c logger
 1461     1    49     0  S+      wait     0xc4343828 sh
 1427     1  1427     0  Ss      nanslp   0xc0c7dc44 cron
 1420     1  1420     0  Ss      select   0xc0c88eb8 sshd
 1417  1301  1301    80  SJ      accept   0xc445a1da php-cgi
 1416  1301  1301    80  SJ      accept   0xc445a1da php-cgi
 1415  1301  1301    80  SJ      accept   0xc445a1da php-cgi
 1414  1301  1301    80  SJ      accept   0xc445a1da php-cgi
 1413  1301  1301    80  SJ      accept   0xc445a1da php-cgi
 1412  1301  1301    80  SJ      accept   0xc445a1da php-cgi
 1411  1301  1301    80  SJ      accept   0xc445a1da php-cgi
 1410  1301  1301    80  SJ      accept   0xc445a1da php-cgi
 1409  1292  1292    80  SJ      accept   0xc445ab9a php-cgi
--More--

 1408  1292  1292    80  SJ      accept   0xc445ab9a php-cgi
 1407  1292  1292    80  SJ      accept   0xc445ab9a php-cgi
 1406  1292  1292    80  SJ      accept   0xc445ab9a php-cgi
 1405  1292  1292    80  SJ      accept   0xc445ab9a php-cgi
 1404  1292  1292    80  SJ      accept   0xc445ab9a php-cgi
 1403  1292  1292    80  SJ      accept   0xc445ab9a php-cgi
 1402  1292  1292    80  SJ      accept   0xc445ab9a php-cgi
 1401  1292  1292    80  SJ      accept   0xc445ab9a php-cgi
 1400  1292  1292    80  SJ      accept   0xc445ab9a php-cgi
 1399  1292  1292    80  SJ      accept   0xc445ab9a php-cgi
 1398  1292  1292    80  SJ      accept   0xc445ab9a php-cgi
 1397  1292  1292    80  SJ      accept   0xc445ab9a php-cgi
 1396  1292  1292    80  SJ      accept   0xc445ab9a php-cgi
 1395  1292  1292    80  SJ      accept   0xc445ab9a php-cgi
 1394  1292  1292    80  SJ      accept   0xc445ab9a php-cgi
 1393  1301  1301    80  SJ      accept   0xc445a1da php-cgi
 1392  1301  1301    80  SJ      accept   0xc445a1da php-cgi
 1391  1301  1301    80  SJ      accept   0xc445a1da php-cgi
 1390  1301  1301    80  SJ      accept   0xc445a1da php-cgi
 1389  1301  1301    80  SJ      accept   0xc445a1da php-cgi
--More--

 1388  1301  1301    80  SJ      accept   0xc445a1da php-cgi
 1387  1301  1301    80  SJ      accept   0xc445a1da php-cgi
 1386  1301  1301    80  RJ                          php-cgi
 1322     1  1322    25  SsJ     pause    0xc4566318 sendmail
 1314     1  1314     0  RsJ                         sendmail
 1306     1  1306     0  SsJ     select   0xc0c88eb8 sshd
 1301  1288  1301    80  SsJ     wait     0xc4567000 initial thread
 1292  1288  1292    80  SsJ     wait     0xc433f2b8 initial thread
 1288     1  1287    80  RJ      CPU 0               lighttpd
 1286  1173  1170    88  R+J     (threaded)          mysqld
100114                   S       sigwait  0xe67a2be0 mysqld
100111                   S       ucond    0xc43583c0 mysqld
100113                   RunQ                        mysqld
100112                   RunQ                        mysqld
100089                   S       ucond    0xc43576c0 mysqld
100088                   S       ucond    0xc41b13c0 mysqld
100087                   S       ucond    0xc43587c0 mysqld
100086                   S       ucond    0xc4357a80 mysqld
100053                   S       select   0xc0c88eb8 initial thread
 1173     1  1170    88  S+J     wait     0xc43be2b8 sh
--More--

  920     1   920     0  R+      (threaded)          venti
100072                   S       ucond    0xc4357300 venti
100071                   S       accept   0xc445b03a venti
100070                   S       ucond    0xc41b0040 venti
100069                   S       ucond    0xc4095980 venti
100068                   S       ucond    0xc4357140 venti
100067                   S       ucond    0xc41b1e00 venti
100066                   S       ucond    0xc4357100 venti
100065                   S       ucond    0xc41a4500 venti
100064                   S       accept   0xc445a6ba venti
100063                   RunQ                        venti
100051                   RunQ                        venti
  902     1   902     0  Ss      wait     0xc43bdae0 watchdogd
  891     1   891   102  Rs                          gmond
  770     1   770     0  Ss      select   0xc0c88eb8 devd
  338     1   338    65  Ss      select   0xc0c88eb8 dhclient
  322     1    49     0  S+      select   0xc0c88eb8 dhclient
   48     0     0     0  SL      sdflush  0xc0c95228 [softdepflush]
   47     0     0     0  SL      syncer   0xc0c7da6c [syncer]
   46     0     0     0  SL      vlruwt   0xc4342000 [vnlru]
--More--

   45     0     0     0  SL      psleep   0xc0c89324 [bufdaemon]
   44     0     0     0  SL      pgzero   0xc0c95e00 [pagezero]
   43     0     0     0  SL      psleep   0xc0c95a18 [vmdaemon]
   42     0     0     0  SL      psleep   0xc0c959e0 [pagedaemon]
   41     0     0     0  SL      waiting_ 0xc0c8b0b4 [sctp_iterator]
   40     0     0     0  WL                          [irq7: ppbus0 ppc0]
   39     0     0     0  WL                          [irq1: atkbd0]
   38     0     0     0  WL                          [irq15: ata1]
   37     0     0     0  WL                          [irq14: ata0]
   36     0     0     0  WL                          [swi0: sio]
   35     0     0     0  SL      -        0xc418d83c [fdc0]
   34     0     0     0  SL      -        0xc4097000 [fw0_probe]
   33     0     0     0  SL      -        0xc408c200 [fw0_taskq]
   32     0     0     0  SL      usbevt   0xc4013210 [usb4]
   31     0     0     0  WL                          [irq23: rl1 ehci0]
   30     0     0     0  SL      usbevt   0xc407f210 [usb3]
   29     0     0     0  SL      usbevt   0xc406c210 [usb2]
   28     0     0     0  WL                          [irq18: rl0 uhci2++]
   27     0     0     0  SL      usbevt   0xc405c210 [usb1]
   26     0     0     0  WL                          [irq19: uhci1]
--More--

   25     0     0     0  SL      usbtsk   0xc0c7b234 [usbtask-dr]
   24     0     0     0  SL      usbtsk   0xc0c7b220 [usbtask-hc]
   23     0     0     0  SL      usbevt   0xc4024210 [usb0]
   22     0     0     0  WL                          [irq16: uhci0 uhci3]
   21     0     0     0  WL                          [irq9: acpi0]
   20     0     0     0  WL                          [swi6: task queue]
   19     0     0     0  WL                          [swi6: Giant taskq]
   18     0     0     0  SL      -        0xc3fe3700 [thread taskq]
   17     0     0     0  WL                          [swi5: +]
    9     0     0     0  SL      -        0xc3fe3880 [acpi_task_2]
    8     0     0     0  SL      -        0xc3fe3880 [acpi_task_1]
    7     0     0     0  SL      -        0xc3fe3880 [acpi_task_0]
   16     0     0     0  WL                          [swi2: cambio]
    6     0     0     0  SL      ccb_scan 0xc0c4b054 [xpt_thrd]
    5     0     0     0  SL      -        0xc3fe3a80 [kqueue taskq]
   15     0     0     0  SL      -        0xc0c7da74 [yarrow]
    4     0     0     0  SL      -        0xc0c7b62c [g_down]
    3     0     0     0  SL      -        0xc0c7b628 [g_up]
    2     0     0     0  SL      -        0xc0c7b620 [g_event]
   14     0     0     0  WL                          [swi3: vm]
--More--

   13     0     0     0  WL                          [swi4: clock sio]
   12     0     0     0  WL                          [swi1: net]
   11     0     0     0  RL                          [idle: cpu0]
    1     0     1     0  SLs     wait     0xc3f16ae0 [init]
   10     0     0     0  SL      audit_wo 0xc0c94c64 [audit]
    0     0     0     0  SLs     sched    0xc0c7b6e0 [swapper]
db> alltrace

Tracing command watchdogd pid 1516 tid 100048 td 0xc40748c0
fork_trampoline() at fork_trampoline

Tracing command csh pid 1470 tid 100083 td 0xc4571230
sched_switch(c4571230,0,1,e91c6875,b2,...) at sched_switch+0x43b
mi_switch(1,0,c4571230,c4565000,e672d924,...) at mi_switch+0x146
sleepq_switch(c4571230,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(1,c4571230,e672d968,c07a8857,c418fc10,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c418fc10,59,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c418fc10,0,159,c0b57586,0,...) at _sleep+0x2c7
ttysleep(c418fc00,c418fc10,159,c0b57586,0,...) at ttysleep+0x39
ttread(c418fc00,e672dc60,0,e672dbb4,c0763e39,...) at ttread+0x617
ttyread(c4179500,e672dc60,0,c4213450,e672dbd8,...) at ttyread+0x38
giant_read(c4179500,e672dc60,0,0,1,...) at giant_read+0x89
devfs_read_f(c456b8e8,e672dc60,c4617000,0,c4571230,...) at devfs_read_f+0x7d
dofileread(e672dc60,ffffffff,ffffffff,0,c456b8e8,...) at dofileread+0x96
kern_readv(c4571230,10,e672dc60,bfbfe976,1,...) at kern_readv+0x58
read(c4571230,e672dcfc,c,e672dcd8,c07abdd8,...) at read+0x4f
syscall(e672dd38) at syscall+0x335
--More--

Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (3, FreeBSD ELF32, read), eip = 0x281f9983, esp =
0xbfbfe92c, ebp = 0xbfbfe948 ---

Tracing command login pid 1467 tid 100120 td 0xc45ceaf0
sched_switch(c45ceaf0,0,1,ac163d54,b1,...) at sched_switch+0x43b
mi_switch(1,0,c45ceaf0,c4602570,e67b9b90,...) at mi_switch+0x146
sleepq_switch(c45ceaf0,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c45ceaf0,e67b9bd4,c07a8857,c4602570,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c4602570,5c,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c4602570,c4602600,15c,c0b53aa3,0,...) at _sleep+0x2c7
kern_wait(c45ceaf0,5be,e67b9c2c,0,0,...) at kern_wait+0xf98
wait4(c45ceaf0,e67b9cfc,10,e67b9d38,e67b9d2c,...) at wait4+0x3b
syscall(e67b9d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x2810558b, esp =
0xbfbfed9c, ebp = 0xbfbfedb8 ---

Tracing command getty pid 1466 tid 100116 td 0xc4610460
sched_switch(c4610460,0,1,7ed1eca5,b1,...) at sched_switch+0x43b
mi_switch(1,0,c4610460,c46032b8,e67a9910,...) at mi_switch+0x146
sleepq_switch(c4610460,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
--More--

sleepq_catch_signals(1,c4610460,e67a9954,c07a8857,c41ac810,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c41ac810,59,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c41ac810,0,159,c0b57586,0,...) at _sleep+0x2c7
ttysleep(c41ac800,c41ac810,159,c0b57586,0,...) at ttysleep+0x39
ttread(c41ac800,e67a9c60,0,e67a9b8c,c06b149d,...) at ttread+0x617
ttyread(c41ab100,e67a9c60,0,e67a9bb4,c0763e39,...) at ttyread+0x38
scread(c41ab100,e67a9c60,0,c458878c,e67a9bd8,...) at scread+0x2d
giant_read(c41ab100,e67a9c60,0,0,1,...) at giant_read+0x89
devfs_read_f(c456bc2c,e67a9c60,c3ee9300,0,c4610460,...) at devfs_read_f+0x7d
dofileread(e67a9c60,ffffffff,ffffffff,0,c456bc2c,...) at dofileread+0x96
kern_readv(c4610460,0,e67a9c60,bfbfee4b,1,...) at kern_readv+0x58
read(c4610460,e67a9cfc,c,16,e67a9d2c,...) at read+0x4f
syscall(e67a9d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (3, FreeBSD ELF32, read), eip = 0x2816a983, esp =
0xbfbfee2c, ebp = 0xbfbfee58 ---

Tracing command sleep pid 1465 tid 100119 td 0xc45ced20
sched_switch(c45ced20,0,1,4d9b73f4,b1,...) at sched_switch+0x43b
mi_switch(1,0,c45ced20,c4602828,e67b5bc8,...) at mi_switch+0x146
sleepq_switch(c45ced20,0,c0b5647e,19d,e67b5bb8,...) at sleepq_switch+0xcb
--More--

sleepq_catch_signals(0,c45ced20,5c,e67b5c10,c07a8831,...) at
sleepq_catch_signals+0x2fc
sleepq_timedwait_sig(c0c7dc44,5c,c0b54014,d6,0,...) at sleepq_timedwait_sig+0x19
_sleep(c0c7dc44,0,15c,c0b544e9,ea61,...) at _sleep+0x2a1
kern_nanosleep(c45ced20,e67b5c64,e67b5c6c,3c,0,...) at kern_nanosleep+0xc1
nanosleep(c45ced20,e67b5cfc,8,e67b5cd8,c07abdd8,...) at nanosleep+0x6f
syscall(e67b5d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2813a36f, esp =
0xbfbfee5c, ebp = 0xbfbfee98 ---

Tracing command sh pid 1464 tid 100115 td 0xc4610690
sched_switch(c4610690,0,1,4d6253ae,b1,...) at sched_switch+0x43b
mi_switch(1,0,c4610690,c4603570,e67a5b90,...) at mi_switch+0x146
sleepq_switch(c4610690,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c4610690,e67a5bd4,c07a8857,c4603570,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c4603570,5c,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c4603570,c4603600,15c,c0b53aa3,0,...) at _sleep+0x2c7
kern_wait(c4610690,ffffffff,e67a5c2c,2,0,...) at kern_wait+0xf98
wait4(c4610690,e67a5cfc,10,e67a5d38,e67a5d2c,...) at wait4+0x3b
syscall(e67a5d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--More--

--- syscall (7, FreeBSD ELF32, wait4), eip = 0x2814658b, esp =
0xbfbfd8fc, ebp = 0xbfbfd918 ---

Tracing command logger pid 1462 tid 100118 td 0xc4610000
sched_switch(c4610000,0,1,4d38fcac,b1,...) at sched_switch+0x43b
mi_switch(1,0,c4610000,c4602ae0,e67b1b74,...) at mi_switch+0x146
sleepq_switch(c4610000,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c4610000,e67b1bb8,c07a8857,c439d18c,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c439d18c,4c,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c439d18c,c439d2fc,14c,c0b56a3d,0,...) at _sleep+0x2c7
pipe_read(c456bcc4,e67b1c60,c3ee9300,0,c4610000,...) at pipe_read+0x4a6
dofileread(e67b1c60,ffffffff,ffffffff,0,c456bcc4,...) at dofileread+0x96
kern_readv(c4610000,0,e67b1c60,28206000,1000,...) at kern_readv+0x58
read(c4610000,e67b1cfc,c,e67b1d38,e67b1d2c,...) at read+0x4f
syscall(e67b1d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (3, FreeBSD ELF32, read), eip = 0x28159983, esp =
0xbfbfe99c, ebp = 0xbfbfe9b8 ---

Tracing command sh pid 1461 tid 100060 td 0xc41a7690
sched_switch(c41a7690,0,1,4ce984d0,b1,...) at sched_switch+0x43b
mi_switch(1,0,c41a7690,c4343828,e66e0b90,...) at mi_switch+0x146
--More--

sleepq_switch(c41a7690,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c41a7690,e66e0bd4,c07a8857,c4343828,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c4343828,5c,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c4343828,c43438b8,15c,c0b53aa3,0,...) at _sleep+0x2c7
kern_wait(c41a7690,ffffffff,e66e0c2c,2,0,...) at kern_wait+0xf98
wait4(c41a7690,e66e0cfc,10,e66e0d38,e66e0d2c,...) at wait4+0x3b
syscall(e66e0d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x2814658b, esp =
0xbfbfda9c, ebp = 0xbfbfdab8 ---

Tracing command cron pid 1427 tid 100121 td 0xc45ce8c0
sched_switch(c45ce8c0,0,1,42ec0c9b,b1,...) at sched_switch+0x43b
mi_switch(1,0,c45ce8c0,c46022b8,e67bdbc8,...) at mi_switch+0x146
sleepq_switch(c45ce8c0,0,c0b5647e,19d,e67bdbb8,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c45ce8c0,5c,e67bdc10,c07a8831,...) at
sleepq_catch_signals+0x2fc
sleepq_timedwait_sig(c0c7dc44,5c,c0b54014,d6,0,...) at sleepq_timedwait_sig+0x19
_sleep(c0c7dc44,0,15c,c0b544e9,cf09,...) at _sleep+0x2a1
kern_nanosleep(c45ce8c0,e67bdc64,e67bdc6c,35,0,...) at kern_nanosleep+0xc1
nanosleep(c45ce8c0,e67bdcfc,8,e67bdd38,e67bdd2c,...) at nanosleep+0x6f
syscall(e67bdd38) at syscall+0x335
--More--

Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2815636f, esp =
0xbfbfed0c, ebp = 0xbfbfed38 ---

Tracing command sshd pid 1420 tid 100117 td 0xc4610230
sched_switch(c4610230,0,1,303876cf,b1,...) at sched_switch+0x43b
mi_switch(1,0,c4610230,c4603000,e67ada84,...) at mi_switch+0x146
sleepq_switch(c4610230,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c4610230,e67adac4,c0762080,c0c88eb8,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c0c88eb8,c0c88ea0,c0b695ef,101,0,...) at sleepq_wait_sig+0xd
_cv_wait_sig(c0c88eb8,c0c88ea0,c0b569cc,30a,e67adae8,...) at _cv_wait_sig+0x180
kern_select(c4610230,4,285090ac,0,0,0,c4603000,e67adc98) at kern_select+0x7e7
select(c4610230,e67adcfc,14,e67add38,e67add2c,...) at select+0x5e
syscall(e67add38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (93, FreeBSD ELF32, select), eip = 0x28391903, esp =
0xbfbfe6ac, ebp = 0xbfbfee98 ---

Tracing command php-cgi pid 1417 tid 100110 td 0xc4612460
sched_switch(c4612460,0,1,8bb08d1c,b0,...) at sched_switch+0x43b
mi_switch(1,0,c4612460,c4603828,e6795bc4,...) at mi_switch+0x146
sleepq_switch(c4612460,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
--More--

sleepq_catch_signals(0,c4612460,e6795c08,c07a8857,c445a1da,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445a1da,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445a1da,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c4612460,0,e6795c70,e6795c6c,e6795c68,...) at kern_accept+0x168
accept(c4612460,e6795cfc,c,e6795cd8,c07abdd8,...) at accept+0x8f
syscall(e6795d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---

Tracing command php-cgi pid 1416 tid 100109 td 0xc4612690
sched_switch(c4612690,0,1,8ba183aa,b0,...) at sched_switch+0x43b
mi_switch(1,0,c4612690,c4603ae0,e6791bc4,...) at mi_switch+0x146
sleepq_switch(c4612690,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c4612690,e6791c08,c07a8857,c445a1da,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445a1da,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445a1da,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c4612690,0,e6791c70,e6791c6c,e6791c68,...) at kern_accept+0x168
accept(c4612690,e6791cfc,c,e6791d38,e6791d2c,...) at accept+0x8f
syscall(e6791d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--More--

--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---

Tracing command php-cgi pid 1415 tid 100108 td 0xc46128c0
sched_switch(c46128c0,0,1,8b93707b,b0,...) at sched_switch+0x43b
mi_switch(1,0,c46128c0,c4604000,e678dbc4,...) at mi_switch+0x146
sleepq_switch(c46128c0,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c46128c0,e678dc08,c07a8857,c445a1da,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445a1da,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445a1da,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c46128c0,0,e678dc70,e678dc6c,e678dc68,...) at kern_accept+0x168
accept(c46128c0,e678dcfc,c,e678dd38,e678dd2c,...) at accept+0x8f
syscall(e678dd38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---

Tracing command php-cgi pid 1414 tid 100107 td 0xc4572230
sched_switch(c4572230,0,1,8b8476ab,b0,...) at sched_switch+0x43b
mi_switch(1,0,c4572230,c46042b8,e6789bc4,...) at mi_switch+0x146
sleepq_switch(c4572230,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c4572230,e6789c08,c07a8857,c445a1da,...) at
sleepq_catch_signals+0x2fc
--More--

sleepq_wait_sig(c445a1da,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445a1da,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c4572230,0,e6789c70,e6789c6c,e6789c68,...) at kern_accept+0x168
accept(c4572230,e6789cfc,c,e6789d38,e6789d2c,...) at accept+0x8f
syscall(e6789d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---

Tracing command php-cgi pid 1413 tid 100106 td 0xc4572460
sched_switch(c4572460,0,1,8b769822,b0,...) at sched_switch+0x43b
mi_switch(1,0,c4572460,c4604570,e6785bc4,...) at mi_switch+0x146
sleepq_switch(c4572460,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c4572460,e6785c08,c07a8857,c445a1da,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445a1da,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445a1da,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c4572460,0,e6785c70,e6785c6c,e6785c68,...) at kern_accept+0x168
accept(c4572460,e6785cfc,c,e6785d38,e6785d2c,...) at accept+0x8f
syscall(e6785d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---
--More--


Tracing command php-cgi pid 1412 tid 100105 td 0xc4572690
sched_switch(c4572690,0,1,8bb31441,b0,...) at sched_switch+0x43b
mi_switch(1,0,c4572690,c4604828,e6781bc4,...) at mi_switch+0x146
sleepq_switch(c4572690,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c4572690,e6781c08,c07a8857,c445a1da,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445a1da,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445a1da,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c4572690,0,e6781c70,e6781c6c,e6781c68,...) at kern_accept+0x168
accept(c4572690,e6781cfc,c,e6781d38,e6781d2c,...) at accept+0x8f
syscall(e6781d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---

Tracing command php-cgi pid 1411 tid 100104 td 0xc45728c0
sched_switch(c45728c0,0,1,8b5da0d4,b0,...) at sched_switch+0x43b
mi_switch(1,0,c45728c0,c4604ae0,e677dbc4,...) at mi_switch+0x146
sleepq_switch(c45728c0,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c45728c0,e677dc08,c07a8857,c445a1da,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445a1da,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
--More--

_sleep(c445a1da,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c45728c0,0,e677dc70,e677dc6c,e677dc68,...) at kern_accept+0x168
accept(c45728c0,e677dcfc,c,e677dd38,e677dd2c,...) at accept+0x8f
syscall(e677dd38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---

Tracing command php-cgi pid 1410 tid 100103 td 0xc4572af0
sched_switch(c4572af0,0,1,8b4f9884,b0,...) at sched_switch+0x43b
mi_switch(1,0,c4572af0,c45672b8,e6779bc4,...) at mi_switch+0x146
sleepq_switch(c4572af0,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c4572af0,e6779c08,c07a8857,c445a1da,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445a1da,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445a1da,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c4572af0,0,e6779c70,e6779c6c,e6779c68,...) at kern_accept+0x168
accept(c4572af0,e6779cfc,c,e6779d38,e6779d2c,...) at accept+0x8f
syscall(e6779d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---

--More--

Tracing command php-cgi pid 1409 tid 100102 td 0xc4572d20
sched_switch(c4572d20,0,1,8b36b37f,b0,...) at sched_switch+0x43b
mi_switch(1,0,c4572d20,c4567570,e6775bc4,...) at mi_switch+0x146
sleepq_switch(c4572d20,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c4572d20,e6775c08,c07a8857,c445ab9a,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445ab9a,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445ab9a,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c4572d20,0,e6775c70,e6775c6c,e6775c68,...) at kern_accept+0x168
accept(c4572d20,e6775cfc,c,e6775d38,e6775d2c,...) at accept+0x8f
syscall(e6775d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---

Tracing command php-cgi pid 1408 tid 100101 td 0xc45cc000
sched_switch(c45cc000,0,1,8b285aaf,b0,...) at sched_switch+0x43b
mi_switch(1,0,c45cc000,c4567828,e6771bc4,...) at mi_switch+0x146
sleepq_switch(c45cc000,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c45cc000,e6771c08,c07a8857,c445ab9a,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445ab9a,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445ab9a,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
--More--

kern_accept(c45cc000,0,e6771c70,e6771c6c,e6771c68,...) at kern_accept+0x168
accept(c45cc000,e6771cfc,c,e6771d38,e6771d2c,...) at accept+0x8f
syscall(e6771d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---

Tracing command php-cgi pid 1407 tid 100100 td 0xc45cc230
sched_switch(c45cc230,0,1,8b18ef43,b0,...) at sched_switch+0x43b
mi_switch(1,0,c45cc230,c4567ae0,e676dbc4,...) at mi_switch+0x146
sleepq_switch(c45cc230,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c45cc230,e676dc08,c07a8857,c445ab9a,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445ab9a,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445ab9a,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c45cc230,0,e676dc70,e676dc6c,e676dc68,...) at kern_accept+0x168
accept(c45cc230,e676dcfc,c,e676dd38,e676dd2c,...) at accept+0x8f
syscall(e676dd38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---

Tracing command php-cgi pid 1406 tid 100099 td 0xc45cc460
--More--

sched_switch(c45cc460,0,1,8b039b0e,b0,...) at sched_switch+0x43b
mi_switch(1,0,c45cc460,c45c2000,e6769bc4,...) at mi_switch+0x146
sleepq_switch(c45cc460,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c45cc460,e6769c08,c07a8857,c445ab9a,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445ab9a,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445ab9a,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c45cc460,0,e6769c70,e6769c6c,e6769c68,...) at kern_accept+0x168
accept(c45cc460,e6769cfc,c,e6769d38,e6769d2c,...) at accept+0x8f
syscall(e6769d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---

Tracing command php-cgi pid 1405 tid 100098 td 0xc45cc690
sched_switch(c45cc690,0,1,8af5aa25,b0,...) at sched_switch+0x43b
mi_switch(1,0,c45cc690,c45c22b8,e6765bc4,...) at mi_switch+0x146
sleepq_switch(c45cc690,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c45cc690,e6765c08,c07a8857,c445ab9a,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445ab9a,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445ab9a,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c45cc690,0,e6765c70,e6765c6c,e6765c68,...) at kern_accept+0x168
--More--

accept(c45cc690,e6765cfc,c,e6765d38,e6765d2c,...) at accept+0x8f
syscall(e6765d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---

Tracing command php-cgi pid 1404 tid 100097 td 0xc45cc8c0
sched_switch(c45cc8c0,0,1,8ae7a63c,b0,...) at sched_switch+0x43b
mi_switch(1,0,c45cc8c0,c45c2570,e6762bc4,...) at mi_switch+0x146
sleepq_switch(c45cc8c0,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c45cc8c0,e6762c08,c07a8857,c445ab9a,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445ab9a,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445ab9a,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c45cc8c0,0,e6762c70,e6762c6c,e6762c68,...) at kern_accept+0x168
accept(c45cc8c0,e6762cfc,c,e6762d38,e6762d2c,...) at accept+0x8f
syscall(e6762d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---

Tracing command php-cgi pid 1403 tid 100096 td 0xc45ccaf0
sched_switch(c45ccaf0,0,1,8ad9d447,b0,...) at sched_switch+0x43b
--More--

mi_switch(1,0,c45ccaf0,c45c2828,e675fbc4,...) at mi_switch+0x146
sleepq_switch(c45ccaf0,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c45ccaf0,e675fc08,c07a8857,c445ab9a,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445ab9a,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445ab9a,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c45ccaf0,0,e675fc70,e675fc6c,e675fc68,...) at kern_accept+0x168
accept(c45ccaf0,e675fcfc,c,e675fd38,e675fd2c,...) at accept+0x8f
syscall(e675fd38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---

Tracing command php-cgi pid 1402 tid 100095 td 0xc45ccd20
sched_switch(c45ccd20,0,1,88eacfa0,b0,...) at sched_switch+0x43b
mi_switch(1,0,c45ccd20,c45c2ae0,e675cbc4,...) at mi_switch+0x146
sleepq_switch(c45ccd20,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c45ccd20,e675cc08,c07a8857,c445ab9a,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445ab9a,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445ab9a,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c45ccd20,0,e675cc70,e675cc6c,e675cc68,...) at kern_accept+0x168
accept(c45ccd20,e675ccfc,c,e675cd38,e675cd2c,...) at accept+0x8f
--More--

syscall(e675cd38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---

Tracing command php-cgi pid 1401 tid 100094 td 0xc45ce000
sched_switch(c45ce000,0,1,88dcdf13,b0,...) at sched_switch+0x43b
mi_switch(1,0,c45ce000,c45c3000,e6759bc4,...) at mi_switch+0x146
sleepq_switch(c45ce000,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c45ce000,e6759c08,c07a8857,c445ab9a,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445ab9a,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445ab9a,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c45ce000,0,e6759c70,e6759c6c,e6759c68,...) at kern_accept+0x168
accept(c45ce000,e6759cfc,c,e6759d38,e6759d2c,...) at accept+0x8f
syscall(e6759d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---

Tracing command php-cgi pid 1400 tid 100093 td 0xc45ce230
sched_switch(c45ce230,0,1,88cf2da4,b0,...) at sched_switch+0x43b
mi_switch(1,0,c45ce230,c45c32b8,e6756bc4,...) at mi_switch+0x146
--More--

sleepq_switch(c45ce230,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c45ce230,e6756c08,c07a8857,c445ab9a,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445ab9a,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445ab9a,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c45ce230,0,e6756c70,e6756c6c,e6756c68,...) at kern_accept+0x168
accept(c45ce230,e6756cfc,c,e6756d38,e6756d2c,...) at accept+0x8f
syscall(e6756d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---

Tracing command php-cgi pid 1399 tid 100092 td 0xc45ce460
sched_switch(c45ce460,0,1,88c1713f,b0,...) at sched_switch+0x43b
mi_switch(1,0,c45ce460,c45c3570,e6753bc4,...) at mi_switch+0x146
sleepq_switch(c45ce460,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c45ce460,e6753c08,c07a8857,c445ab9a,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445ab9a,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445ab9a,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c45ce460,0,e6753c70,e6753c6c,e6753c68,...) at kern_accept+0x168
accept(c45ce460,e6753cfc,c,e6753d38,e6753d2c,...) at accept+0x8f
syscall(e6753d38) at syscall+0x335
--More--

Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---

Tracing command php-cgi pid 1398 tid 100091 td 0xc4570000
sched_switch(c4570000,0,1,88b36380,b0,...) at sched_switch+0x43b
mi_switch(1,0,c4570000,c45c3828,e6750bc4,...) at mi_switch+0x146
sleepq_switch(c4570000,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c4570000,e6750c08,c07a8857,c445ab9a,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445ab9a,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445ab9a,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c4570000,0,e6750c70,e6750c6c,e6750c68,...) at kern_accept+0x168
accept(c4570000,e6750cfc,c,e6750d38,e6750d2c,...) at accept+0x8f
syscall(e6750d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---

Tracing command php-cgi pid 1397 tid 100090 td 0xc4570230
sched_switch(c4570230,0,1,8b0a85e0,b0,...) at sched_switch+0x43b
mi_switch(1,0,c4570230,c45c3ae0,e674dbc4,...) at mi_switch+0x146
sleepq_switch(c4570230,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
--More--

sleepq_catch_signals(0,c4570230,e674dc08,c07a8857,c445ab9a,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445ab9a,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445ab9a,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c4570230,0,e674dc70,e674dc6c,e674dc68,...) at kern_accept+0x168
accept(c4570230,e674dcfc,c,e674dd38,e674dd2c,...) at accept+0x8f
syscall(e674dd38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---

Tracing command php-cgi pid 1396 tid 100085 td 0xc4570d20
sched_switch(c4570d20,0,1,889d2d05,b0,...) at sched_switch+0x43b
mi_switch(1,0,c4570d20,c43be828,e6735bc4,...) at mi_switch+0x146
sleepq_switch(c4570d20,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c4570d20,e6735c08,c07a8857,c445ab9a,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445ab9a,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445ab9a,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c4570d20,0,e6735c70,e6735c6c,e6735c68,...) at kern_accept+0x168
accept(c4570d20,e6735cfc,c,e6735d38,e6735d2c,...) at accept+0x8f
syscall(e6735d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--More--

--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---

Tracing command php-cgi pid 1395 tid 100082 td 0xc4571460
sched_switch(c4571460,0,1,888f28b4,b0,...) at sched_switch+0x43b
mi_switch(1,0,c4571460,c45652b8,e6729bc4,...) at mi_switch+0x146
sleepq_switch(c4571460,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c4571460,e6729c08,c07a8857,c445ab9a,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445ab9a,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445ab9a,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c4571460,0,e6729c70,e6729c6c,e6729c68,...) at kern_accept+0x168
accept(c4571460,e6729cfc,c,e6729d38,e6729d2c,...) at accept+0x8f
syscall(e6729d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---

Tracing command php-cgi pid 1394 tid 100081 td 0xc4571690
sched_switch(c4571690,0,1,88818577,b0,...) at sched_switch+0x43b
mi_switch(1,0,c4571690,c4565570,e6725bc4,...) at mi_switch+0x146
sleepq_switch(c4571690,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c4571690,e6725c08,c07a8857,c445ab9a,...) at
sleepq_catch_signals+0x2fc
--More--

sleepq_wait_sig(c445ab9a,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445ab9a,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c4571690,0,e6725c70,e6725c6c,e6725c68,...) at kern_accept+0x168
accept(c4571690,e6725cfc,c,e6725d38,e6725d2c,...) at accept+0x8f
syscall(e6725d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---

Tracing command php-cgi pid 1393 tid 100056 td 0xc439f000
sched_switch(c439f000,0,1,89c1bbfb,b0,...) at sched_switch+0x43b
mi_switch(1,0,c439f000,c43bd570,e66d4bc4,...) at mi_switch+0x146
sleepq_switch(c439f000,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c439f000,e66d4c08,c07a8857,c445a1da,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445a1da,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445a1da,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c439f000,0,e66d4c70,e66d4c6c,e66d4c68,...) at kern_accept+0x168
accept(c439f000,e66d4cfc,c,e66d4d38,e66d4d2c,...) at accept+0x8f
syscall(e66d4d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---
--More--


Tracing command php-cgi pid 1392 tid 100062 td 0xc41a7230
sched_switch(c41a7230,0,1,89b36c55,b0,...) at sched_switch+0x43b
mi_switch(1,0,c41a7230,c43432b8,e66e6bc4,...) at mi_switch+0x146
sleepq_switch(c41a7230,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c41a7230,e66e6c08,c07a8857,c445a1da,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445a1da,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445a1da,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c41a7230,0,e66e6c70,e66e6c6c,e66e6c68,...) at kern_accept+0x168
accept(c41a7230,e66e6cfc,c,e66e6d38,e66e6d2c,...) at accept+0x8f
syscall(e66e6d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---

Tracing command php-cgi pid 1391 tid 100074 td 0xc44f7460
sched_switch(c44f7460,0,1,8932b788,b0,...) at sched_switch+0x43b
mi_switch(1,0,c44f7460,c4566ae0,e670abc4,...) at mi_switch+0x146
sleepq_switch(c44f7460,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c44f7460,e670ac08,c07a8857,c445a1da,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445a1da,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
--More--

_sleep(c445a1da,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c44f7460,0,e670ac70,e670ac6c,e670ac68,...) at kern_accept+0x168
accept(c44f7460,e670acfc,c,e670ad38,e670ad2c,...) at accept+0x8f
syscall(e670ad38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---

Tracing command php-cgi pid 1390 tid 100061 td 0xc41a7460
sched_switch(c41a7460,0,1,892518bd,b0,...) at sched_switch+0x43b
mi_switch(1,0,c41a7460,c4343570,e66e3bc4,...) at mi_switch+0x146
sleepq_switch(c41a7460,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c41a7460,e66e3c08,c07a8857,c445a1da,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445a1da,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445a1da,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c41a7460,0,e66e3c70,e66e3c6c,e66e3c68,...) at kern_accept+0x168
accept(c41a7460,e66e3cfc,c,e66e3d38,e66e3d2c,...) at accept+0x8f
syscall(e66e3d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---

--More--

Tracing command php-cgi pid 1389 tid 100076 td 0xc44f7000
sched_switch(c44f7000,0,1,8914eaac,b0,...) at sched_switch+0x43b
mi_switch(1,0,c44f7000,c4566570,e6711bc4,...) at mi_switch+0x146
sleepq_switch(c44f7000,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c44f7000,e6711c08,c07a8857,c445a1da,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445a1da,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445a1da,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c44f7000,0,e6711c70,e6711c6c,e6711c68,...) at kern_accept+0x168
accept(c44f7000,e6711cfc,c,e6711d38,e6711d2c,...) at accept+0x8f
syscall(e6711d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---

Tracing command php-cgi pid 1388 tid 100075 td 0xc44f7230
sched_switch(c44f7230,0,1,89076543,b0,...) at sched_switch+0x43b
mi_switch(1,0,c44f7230,c4566828,e670dbc4,...) at mi_switch+0x146
sleepq_switch(c44f7230,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c44f7230,e670dc08,c07a8857,c445a1da,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445a1da,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445a1da,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
--More--

kern_accept(c44f7230,0,e670dc70,e670dc6c,e670dc68,...) at kern_accept+0x168
accept(c44f7230,e670dcfc,c,e670dd38,e670dd2c,...) at accept+0x8f
syscall(e670dd38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---

Tracing command php-cgi pid 1387 tid 100079 td 0xc4571af0
sched_switch(c4571af0,0,1,88f9ff91,b0,...) at sched_switch+0x43b
mi_switch(1,0,c4571af0,c4565ae0,e671dbc4,...) at mi_switch+0x146
sleepq_switch(c4571af0,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c4571af0,e671dc08,c07a8857,c445a1da,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445a1da,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445a1da,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c4571af0,0,e671dc70,e671dc6c,e671dc68,...) at kern_accept+0x168
accept(c4571af0,e671dcfc,c,e671dd38,e671dd2c,...) at accept+0x8f
syscall(e671dd38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2857a66f, esp =
0xbfbecb5c, ebp = 0xbfbfcc38 ---

Tracing command php-cgi pid 1386 tid 100080 td 0xc45718c0
--More--

sched_switch(c45718c0,0,2,74676e16,c1,...) at sched_switch+0x43b
mi_switch(2,0,c0b56762,ec,bfbecb60,...) at mi_switch+0x146
ast(e6721d38) at ast+0x2ad
doreti_ast() at doreti_ast+0x17

Tracing command sendmail pid 1322 tid 100077 td 0xc4572000
sched_switch(c4572000,0,1,623e3053,af,...) at sched_switch+0x43b
mi_switch(1,0,c4572000,c45662b8,e6715bd8,...) at mi_switch+0x146
sleepq_switch(c4572000,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c4572000,e6715c1c,c07a8857,c4566318,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c4566318,68,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c4566318,c4566348,168,c0b1883d,0,...) at _sleep+0x2c7
kern_sigsuspend(c4572000,0,0,0,0,...) at kern_sigsuspend+0x107
sigsuspend(c4572000,e6715cfc,4,e6715d38,e6715d2c,...) at sigsuspend+0x4d
syscall(e6715d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (341, FreeBSD ELF32, sigsuspend), eip = 0x2830f5cb, esp =
0xbfbfdaac, ebp = 0xbfbfdad8 ---

Tracing command sendmail pid 1314 tid 100084 td 0xc4571000
sched_switch(c4571000,0,1,6376cced,c1,...) at sched_switch+0x43b
--More--

mi_switch(1,0,c4571000,c43beae0,e6731a80,...) at mi_switch+0x146
sleepq_switch(c4571000,0,c0b5647e,19d,e6731a70,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c4571000,0,e6731ac4,c0761c10,...) at
sleepq_catch_signals+0x2fc
sleepq_timedwait_sig(c0c88eb8,1389,c0b695ef,101,0,...) at
sleepq_timedwait_sig+0x19
_cv_timedwait_sig(c0c88eb8,c0c88ea0,1389,30a,c1472d34,...) at
_cv_timedwait_sig+0x190
kern_select(c4571000,4,bfbfd8bc,0,0,e6731c70,5,0) at kern_select+0x7cf
select(c4571000,e6731cfc,14,16,e6731d2c,...) at select+0x5e
syscall(e6731d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (93, FreeBSD ELF32, select), eip = 0x283a5903, esp =
0xbfbfd02c, ebp = 0xbfbfdac8 ---

Tracing command sshd pid 1306 tid 100078 td 0xc4571d20
sched_switch(c4571d20,0,1,b556df22,ae,...) at sched_switch+0x43b
mi_switch(1,0,c4571d20,c4566000,e6719a84,...) at mi_switch+0x146
sleepq_switch(c4571d20,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c4571d20,e6719ac4,c0762080,c0c88eb8,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c0c88eb8,c0c88ea0,c0b695ef,101,0,...) at sleepq_wait_sig+0xd
_cv_wait_sig(c0c88eb8,c0c88ea0,c0b569cc,30a,e6719ae8,...) at _cv_wait_sig+0x180
kern_select(c4571d20,4,285090ac,0,0,0,c4566000,e6719c98) at kern_select+0x7e7
select(c4571d20,e6719cfc,14,e6719d38,e6719d2c,...) at select+0x5e
--More--

syscall(e6719d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (93, FreeBSD ELF32, select), eip = 0x28391903, esp =
0xbfbfe63c, ebp = 0xbfbfee28 ---

Tracing command php-cgi pid 1301 tid 100073 td 0xc44f7690
sched_switch(c44f7690,0,1,8ac8ad13,b0,...) at sched_switch+0x43b
mi_switch(1,0,c44f7690,c4567000,e6707b90,...) at mi_switch+0x146
sleepq_switch(c44f7690,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c44f7690,e6707bd4,c07a8857,c4567000,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c4567000,5c,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c4567000,c4567090,15c,c0b53aa3,0,...) at _sleep+0x2c7
kern_wait(c44f7690,ffffffff,e6707c2c,0,0,...) at kern_wait+0xf98
wait4(c44f7690,e6707cfc,10,e6707d38,e6707d2c,...) at wait4+0x3b
syscall(e6707d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x2855d58b, esp =
0xbfbfcc1c, ebp = 0xbfbfcc38 ---

Tracing command php-cgi pid 1292 tid 100049 td 0xc4074690
sched_switch(c4074690,0,1,8b3f6013,b0,...) at sched_switch+0x43b
mi_switch(1,0,c4074690,c433f2b8,e66afb90,...) at mi_switch+0x146
--More--

sleepq_switch(c4074690,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c4074690,e66afbd4,c07a8857,c433f2b8,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c433f2b8,5c,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c433f2b8,c433f348,15c,c0b53aa3,0,...) at _sleep+0x2c7
kern_wait(c4074690,ffffffff,e66afc2c,0,0,...) at kern_wait+0xf98
wait4(c4074690,e66afcfc,10,e66afd38,e66afd2c,...) at wait4+0x3b
syscall(e66afd38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x2855d58b, esp =
0xbfbfcc1c, ebp = 0xbfbfcc38 ---

Tracing command lighttpd pid 1288 tid 100058 td 0xc41a7af0
kdb_enter_why(c0b11901,c0b2827a,0,e66daae0,c07bf27a,...) at kdb_enter_why+0x3a
hardclock(0,c07fedf3,0,0,0,...) at hardclock+0x20d
lapic_handle_timer(e66dab08) at lapic_handle_timer+0x9c
Xtimerint() at Xtimerint+0x1f
--- interrupt, eip = 0xc07fedf3, esp = 0xe66dab48, ebp = 0xe66dac34 ---
kern_sendfile(c41a7af0,e66dacfc,0,0,0,...) at kern_sendfile+0x463
do_sendfile(e66dad2c,c0aba265,c41a7af0,e66dacfc,20,...) at do_sendfile+0xb1
sendfile(c41a7af0,e66dacfc,20,16,e66dad2c,...) at sendfile+0x13
syscall(e66dad38) at syscall+0x335
--More--

Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (393, FreeBSD ELF32, sendfile), eip = 0x282cb0cb, esp =
0xbfbfc7cc, ebp = 0xbfbfe848 ---

Tracing command mysqld pid 1286 tid 100114 td 0xc46108c0
sched_switch(c46108c0,0,1,c81a48ed,b0,...) at sched_switch+0x43b
mi_switch(1,0,c46108c0,c43be000,e67a2b3c,...) at mi_switch+0x146
sleepq_switch(c46108c0,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c46108c0,e67a2b80,c07a8857,e67a2be0,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(e67a2be0,68,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(e67a2be0,c43be090,168,c0b51a46,0,...) at _sleep+0x2c7
kern_sigtimedwait(c46108c0,26005,0,0,0,...) at kern_sigtimedwait+0x358
sigwait(c46108c0,e67a2cfc,8,0,0,...) at sigwait+0x77
syscall(e67a2d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (429, FreeBSD ELF32, sigwait), eip = 0x286e8d8b, esp =
0xbf1f6f0c, ebp = 0xbf1f6f38 ---

Tracing command mysqld pid 1286 tid 100111 td 0xc4610af0
sched_switch(c4610af0,0,1,5c635c09,b1,...) at sched_switch+0x43b
mi_switch(1,0,c4610af0,c43be000,e6799bd0,...) at mi_switch+0x146
sleepq_switch(c4610af0,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
--More--

sleepq_catch_signals(0,c4610af0,e6799c14,c07a8857,c43583c0,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c43583c0,c0c7eaf8,c0b5472e,100,0,...) at sleepq_wait_sig+0xd
_sleep(c43583c0,c0c7eaf8,100,c0b5472e,0,...) at _sleep+0x2c7
__umtx_op_cv_wait(c4610af0,e6799cfc,e6799d2c,c0aba265,c4610af0,...) at
__umtx_op_cv_wait+0x3c4
_umtx_op(c4610af0,e6799cfc,14,e6799d38,e6799d2c,...) at _umtx_op+0x27
syscall(e6799d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (454, FreeBSD ELF32, _umtx_op), eip = 0x286a0037, esp =
0xbf2f7e8c, ebp = 0xbf2f7ea8 ---

Tracing command mysqld pid 1286 tid 100113 td 0xc4610d20
sched_switch(c4610d20,0,1,35985de5,c1,...) at sched_switch+0x43b
mi_switch(1,0,c4610d20,c43be000,e679fa80,...) at mi_switch+0x146
sleepq_switch(c4610d20,0,c0b5647e,19d,e679fa70,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c4610d20,0,e679fac4,c0761c10,...) at
sleepq_catch_signals+0x2fc
sleepq_timedwait_sig(c0c88eb8,3e9,c0b695ef,101,0,...) at
sleepq_timedwait_sig+0x19
_cv_timedwait_sig(c0c88eb8,c0c88ea0,3e9,30a,0,...) at _cv_timedwait_sig+0x190
kern_select(c4610d20,0,0,0,0,e679fc70,1,0) at kern_select+0x7cf
select(c4610d20,e679fcfc,14,16,e679fd2c,...) at select+0x5e
syscall(e679fd38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--More--

--- syscall (93, FreeBSD ELF32, select), eip = 0x2877f903, esp =
0xbf3f8efc, ebp = 0xbf3f8f28 ---

Tracing command mysqld pid 1286 tid 100112 td 0xc4612000
sched_switch(c4612000,0,1,358b6bb2,c1,...) at sched_switch+0x43b
mi_switch(1,0,c4612000,c43be000,e679ca80,...) at mi_switch+0x146
sleepq_switch(c4612000,0,c0b5647e,19d,e679ca70,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c4612000,0,e679cac4,c0761c10,...) at
sleepq_catch_signals+0x2fc
sleepq_timedwait_sig(c0c88eb8,3e9,c0b695ef,101,0,...) at
sleepq_timedwait_sig+0x19
_cv_timedwait_sig(c0c88eb8,c0c88ea0,3e9,30a,1223d7,...) at
_cv_timedwait_sig+0x190
kern_select(c4612000,0,0,0,0,e679cc70,1,0) at kern_select+0x7cf
select(c4612000,e679ccfc,14,16,e679cd2c,...) at select+0x5e
syscall(e679cd38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (93, FreeBSD ELF32, select), eip = 0x2877f903, esp =
0xbf4f9efc, ebp = 0xbf4f9f28 ---

Tracing command mysqld pid 1286 tid 100089 td 0xc4570460
sched_switch(c4570460,0,1,d59abff1,af,...) at sched_switch+0x43b
mi_switch(1,0,c4570460,c43be000,e674abd0,...) at mi_switch+0x146
sleepq_switch(c4570460,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c4570460,e674ac14,c07a8857,c43576c0,...) at
sleepq_catch_signals+0x2fc
--More--

sleepq_wait_sig(c43576c0,c0c7de80,c0b5472e,100,0,...) at sleepq_wait_sig+0xd
_sleep(c43576c0,c0c7de80,100,c0b5472e,0,...) at _sleep+0x2c7
__umtx_op_cv_wait(c4570460,e674acfc,e674ad2c,c0aba265,c4570460,...) at
__umtx_op_cv_wait+0x3c4
_umtx_op(c4570460,e674acfc,14,62696c2f,7173796d,...) at _umtx_op+0x27
syscall(e674ad38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (454, FreeBSD ELF32, _umtx_op), eip = 0x286a0037, esp =
0xbf6fbcdc, ebp = 0xbf6fbcf8 ---

Tracing command mysqld pid 1286 tid 100088 td 0xc4570690
sched_switch(c4570690,0,1,9a3c1adb,b0,...) at sched_switch+0x43b
mi_switch(1,0,c4570690,c43be000,e6747bd0,...) at mi_switch+0x146
sleepq_switch(c4570690,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c4570690,e6747c14,c07a8857,c41b13c0,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c41b13c0,c0c7f770,c0b5472e,100,0,...) at sleepq_wait_sig+0xd
_sleep(c41b13c0,c0c7f770,100,c0b5472e,0,...) at _sleep+0x2c7
__umtx_op_cv_wait(c4570690,e6747cfc,e6747d2c,c0aba265,c4570690,...) at
__umtx_op_cv_wait+0x3c4
_umtx_op(c4570690,e6747cfc,14,e6747d38,e6747d2c,...) at _umtx_op+0x27
syscall(e6747d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (454, FreeBSD ELF32, _umtx_op), eip = 0x286a0037, esp =
0xbf7fccdc, ebp = 0xbf7fccf8 ---
--More--


Tracing command mysqld pid 1286 tid 100087 td 0xc45708c0
sched_switch(c45708c0,0,1,9d6bde01,b0,...) at sched_switch+0x43b
mi_switch(1,0,c45708c0,c43be000,e6744bd0,...) at mi_switch+0x146
sleepq_switch(c45708c0,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c45708c0,e6744c14,c07a8857,c43587c0,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c43587c0,c0c7f818,c0b5472e,100,0,...) at sleepq_wait_sig+0xd
_sleep(c43587c0,c0c7f818,100,c0b5472e,0,...) at _sleep+0x2c7
__umtx_op_cv_wait(c45708c0,e6744cfc,e6744d2c,c0aba265,c45708c0,...) at
__umtx_op_cv_wait+0x3c4
_umtx_op(c45708c0,e6744cfc,14,16,e6744d2c,...) at _umtx_op+0x27
syscall(e6744d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (454, FreeBSD ELF32, _umtx_op), eip = 0x286a0037, esp =
0xbf8fdcdc, ebp = 0xbf8fdcf8 ---

Tracing command mysqld pid 1286 tid 100086 td 0xc4570af0
sched_switch(c4570af0,0,1,d5985c82,af,...) at sched_switch+0x43b
mi_switch(1,0,c4570af0,c43be000,e6741bd0,...) at mi_switch+0x146
sleepq_switch(c4570af0,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c4570af0,e6741c14,c07a8857,c4357a80,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c4357a80,c0c7f508,c0b5472e,100,0,...) at sleepq_wait_sig+0xd
--More--

_sleep(c4357a80,c0c7f508,100,c0b5472e,0,...) at _sleep+0x2c7
__umtx_op_cv_wait(c4570af0,e6741cfc,e6741d2c,c0aba265,c4570af0,...) at
__umtx_op_cv_wait+0x3c4
_umtx_op(c4570af0,e6741cfc,14,0,0,...) at _umtx_op+0x27
syscall(e6741d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (454, FreeBSD ELF32, _umtx_op), eip = 0x286a0037, esp =
0xbf9fecdc, ebp = 0xbf9fecf8 ---

Tracing command mysqld pid 1286 tid 100053 td 0xc439f690
sched_switch(c439f690,0,1,347ac8ca,b1,...) at sched_switch+0x43b
mi_switch(1,0,c439f690,c43be000,e66cba84,...) at mi_switch+0x146
sleepq_switch(c439f690,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c439f690,e66cbac4,c0762080,c0c88eb8,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c0c88eb8,c0c88ea0,c0b695ef,101,0,...) at sleepq_wait_sig+0xd
_cv_wait_sig(c0c88eb8,c0c88ea0,c0b569cc,30a,e66cbafc,...) at _cv_wait_sig+0x180
kern_select(c439f690,f,bfbfea58,0,0,0,0,0) at kern_select+0x7e7
select(c439f690,e66cbcfc,14,e66cbd38,e66cbd2c,...) at select+0x5e
syscall(e66cbd38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (93, FreeBSD ELF32, select), eip = 0x2877f903, esp =
0xbfbfe62c, ebp = 0xbfbfe658 ---

--More--

Tracing command sh pid 1173 tid 100052 td 0xc439f8c0
sched_switch(c439f8c0,0,1,2e2cbfba,ad,...) at sched_switch+0x43b
mi_switch(1,0,c439f8c0,c43be2b8,e66c8b90,...) at mi_switch+0x146
sleepq_switch(c439f8c0,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c439f8c0,e66c8bd4,c07a8857,c43be2b8,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c43be2b8,5c,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c43be2b8,c43be348,15c,c0b53aa3,0,...) at _sleep+0x2c7
kern_wait(c439f8c0,ffffffff,e66c8c2c,2,0,...) at kern_wait+0xf98
wait4(c439f8c0,e66c8cfc,10,e66c8d38,e66c8d2c,...) at wait4+0x3b
syscall(e66c8d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x2814658b, esp =
0xbfbfe50c, ebp = 0xbfbfe528 ---

Tracing command venti pid 920 tid 100072 td 0xc44f78c0
sched_switch(c44f78c0,0,1,de387c47,aa,...) at sched_switch+0x43b
mi_switch(1,0,c44f78c0,c43be570,e6704bd0,...) at mi_switch+0x146
sleepq_switch(c44f78c0,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c44f78c0,e6704c14,c07a8857,c4357300,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c4357300,c0c7e0b0,c0b5472e,100,0,...) at sleepq_wait_sig+0xd
_sleep(c4357300,c0c7e0b0,100,c0b5472e,0,...) at _sleep+0x2c7
--More--

__umtx_op_cv_wait(c44f78c0,e6704cfc,e6704d2c,c0aba265,c44f78c0,...) at
__umtx_op_cv_wait+0x3c4
_umtx_op(c44f78c0,e6704cfc,14,e6704d38,e6704d2c,...) at _umtx_op+0x27
syscall(e6704d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (454, FreeBSD ELF32, _umtx_op), eip = 0x280f1037, esp =
0xbf0f5e9c, ebp = 0xbf0f5eb8 ---

Tracing command venti pid 920 tid 100071 td 0xc44f7af0
sched_switch(c44f7af0,0,1,de36989b,aa,...) at sched_switch+0x43b
mi_switch(1,0,c44f7af0,c43be570,e6701bc4,...) at mi_switch+0x146
sleepq_switch(c44f7af0,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c44f7af0,e6701c08,c07a8857,c445b03a,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445b03a,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445b03a,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c44f7af0,7,0,0,0,...) at kern_accept+0x168
accept(c44f7af0,e6701cfc,c,28159000,0,...) at accept+0x41
syscall(e6701d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2816d66f, esp =
0x377d33fc, ebp = 0x377d3418 ---

Tracing command venti pid 920 tid 100070 td 0xc44f7d20
--More--

sched_switch(c44f7d20,0,1,de357794,aa,...) at sched_switch+0x43b
mi_switch(1,0,c44f7d20,c43be570,e66febd0,...) at mi_switch+0x146
sleepq_switch(c44f7d20,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c44f7d20,e66fec14,c07a8857,c41b0040,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c41b0040,c0c7ddd8,c0b5472e,100,0,...) at sleepq_wait_sig+0xd
_sleep(c41b0040,c0c7ddd8,100,c0b5472e,0,...) at _sleep+0x2c7
__umtx_op_cv_wait(c44f7d20,e66fecfc,e66fed2c,c0aba265,c44f7d20,...) at
__umtx_op_cv_wait+0x3c4
_umtx_op(c44f7d20,e66fecfc,14,e66fed38,e66fed2c,...) at _umtx_op+0x27
syscall(e66fed38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (454, FreeBSD ELF32, _umtx_op), eip = 0x280f1037, esp =
0xbf2f7e9c, ebp = 0xbf2f7eb8 ---

Tracing command venti pid 920 tid 100069 td 0xc44f8000
sched_switch(c44f8000,0,1,7e57a54,a6,...) at sched_switch+0x43b
mi_switch(1,0,c44f8000,c43be570,e66fbbd0,...) at mi_switch+0x146
sleepq_switch(c44f8000,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c44f8000,e66fbc14,c07a8857,c4095980,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c4095980,c0c7e708,c0b5472e,100,0,...) at sleepq_wait_sig+0xd
_sleep(c4095980,c0c7e708,100,c0b5472e,0,...) at _sleep+0x2c7
__umtx_op_cv_wait(c44f8000,e66fbcfc,e66fbd2c,c0aba265,c44f8000,...) at
__umtx_op_cv_wait+0x3c4
--More--

_umtx_op(c44f8000,e66fbcfc,14,0,0,...) at _umtx_op+0x27
syscall(e66fbd38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (454, FreeBSD ELF32, _umtx_op), eip = 0x280f1037, esp =
0xbf3f8e9c, ebp = 0xbf3f8eb8 ---

Tracing command venti pid 920 tid 100068 td 0xc44f8230
sched_switch(c44f8230,0,1,de4f59f5,aa,...) at sched_switch+0x43b
mi_switch(1,0,c44f8230,c43be570,e66f8bd0,...) at mi_switch+0x146
sleepq_switch(c44f8230,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c44f8230,e66f8c14,c07a8857,c4357140,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c4357140,c0c7f038,c0b5472e,100,0,...) at sleepq_wait_sig+0xd
_sleep(c4357140,c0c7f038,100,c0b5472e,0,...) at _sleep+0x2c7
__umtx_op_cv_wait(c44f8230,e66f8cfc,e66f8d2c,c0aba265,c44f8230,...) at
__umtx_op_cv_wait+0x3c4
_umtx_op(c44f8230,e66f8cfc,14,2,c07bf92b,...) at _umtx_op+0x27
syscall(e66f8d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (454, FreeBSD ELF32, _umtx_op), eip = 0x280f1037, esp =
0xbf4f9e9c, ebp = 0xbf4f9eb8 ---

Tracing command venti pid 920 tid 100067 td 0xc44f8460
sched_switch(c44f8460,0,1,d4d327e3,a5,...) at sched_switch+0x43b
--More--

mi_switch(1,0,c44f8460,c43be570,e66f5bd0,...) at mi_switch+0x146
sleepq_switch(c44f8460,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c44f8460,e66f5c14,c07a8857,c41b1e00,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c41b1e00,c0c7f5e8,c0b5472e,100,0,...) at sleepq_wait_sig+0xd
_sleep(c41b1e00,c0c7f5e8,100,c0b5472e,0,...) at _sleep+0x2c7
__umtx_op_cv_wait(c44f8460,e66f5cfc,e66f5d2c,c0aba265,c44f8460,...) at
__umtx_op_cv_wait+0x3c4
_umtx_op(c44f8460,e66f5cfc,14,246,c44f8460,...) at _umtx_op+0x27
syscall(e66f5d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (454, FreeBSD ELF32, _umtx_op), eip = 0x280f1037, esp =
0xbf5fae9c, ebp = 0xbf5faeb8 ---

Tracing command venti pid 920 tid 100066 td 0xc44f8690
sched_switch(c44f8690,0,1,d4d20184,a5,...) at sched_switch+0x43b
mi_switch(1,0,c44f8690,c43be570,e66f2bd0,...) at mi_switch+0x146
sleepq_switch(c44f8690,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c44f8690,e66f2c14,c07a8857,c4357100,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c4357100,c0c7e660,c0b5472e,100,0,...) at sleepq_wait_sig+0xd
_sleep(c4357100,c0c7e660,100,c0b5472e,0,...) at _sleep+0x2c7
__umtx_op_cv_wait(c44f8690,e66f2cfc,e66f2d2c,c0aba265,c44f8690,...) at
__umtx_op_cv_wait+0x3c4
_umtx_op(c44f8690,e66f2cfc,14,e66f2d38,e66f2d2c,...) at _umtx_op+0x27
--More--

syscall(e66f2d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (454, FreeBSD ELF32, _umtx_op), eip = 0x280f1037, esp =
0xbf6fbe9c, ebp = 0xbf6fbeb8 ---

Tracing command venti pid 920 tid 100065 td 0xc44f88c0
sched_switch(c44f88c0,0,1,eaa9512e,a5,...) at sched_switch+0x43b
mi_switch(1,0,c44f88c0,c43be570,e66efbd0,...) at mi_switch+0x146
sleepq_switch(c44f88c0,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c44f88c0,e66efc14,c07a8857,c41a4500,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c41a4500,c0c7ec80,c0b5472e,100,0,...) at sleepq_wait_sig+0xd
_sleep(c41a4500,c0c7ec80,100,c0b5472e,0,...) at _sleep+0x2c7
__umtx_op_cv_wait(c44f88c0,e66efcfc,e66efd2c,c0aba265,c44f88c0,...) at
__umtx_op_cv_wait+0x3c4
_umtx_op(c44f88c0,e66efcfc,14,e66efd38,e66efd2c,...) at _umtx_op+0x27
syscall(e66efd38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (454, FreeBSD ELF32, _umtx_op), eip = 0x280f1037, esp =
0xbf7fce9c, ebp = 0xbf7fceb8 ---

Tracing command venti pid 920 tid 100064 td 0xc44f8af0
sched_switch(c44f8af0,0,1,9daa439d,a5,...) at sched_switch+0x43b
mi_switch(1,0,c44f8af0,c43be570,e66ecbc4,...) at mi_switch+0x146
--More--

sleepq_switch(c44f8af0,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c44f8af0,e66ecc08,c07a8857,c445a6ba,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c445a6ba,58,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c445a6ba,c0c89198,158,c0b64515,0,...) at _sleep+0x2c7
kern_accept(c44f8af0,5,0,0,0,...) at kern_accept+0x168
accept(c44f8af0,e66eccfc,c,e66ecd38,e66ecd2c,...) at accept+0x41
syscall(e66ecd38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (30, FreeBSD ELF32, accept), eip = 0x2816d66f, esp =
0x29c413dc, ebp = 0x29c413f8 ---

Tracing command venti pid 920 tid 100063 td 0xc44f8d20
sched_switch(c44f8d20,0,1,67e06ec1,c1,...) at sched_switch+0x43b
mi_switch(1,0,c44f8d20,c43be570,e66e9a80,...) at mi_switch+0x146
sleepq_switch(c44f8d20,0,c0b5647e,19d,e66e9a70,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c44f8d20,0,e66e9ac4,c0761c10,...) at
sleepq_catch_signals+0x2fc
sleepq_timedwait_sig(c0c88eb8,3e9,c0b695ef,101,0,...) at
sleepq_timedwait_sig+0x19
_cv_timedwait_sig(c0c88eb8,c0c88ea0,3e9,30a,0,...) at _cv_timedwait_sig+0x190
kern_select(c44f8d20,0,0,0,0,e66e9c70,1,0) at kern_select+0x7cf
select(c44f8d20,e66e9cfc,14,6,c07bf92b,...) at select+0x5e
syscall(e66e9d38) at syscall+0x335
--More--

Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (93, FreeBSD ELF32, select), eip = 0x281d0903, esp =
0x2829741c, ebp = 0x28297448 ---

Tracing command venti pid 920 tid 100051 td 0xc439faf0
sched_switch(c439faf0,0,1,3b98272d,c1,...) at sched_switch+0x43b
mi_switch(1,0,c439faf0,c43be570,e66c5a80,...) at mi_switch+0x146
sleepq_switch(c439faf0,0,c0b5647e,19d,e66c5a70,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c439faf0,0,e66c5ac4,c0761c10,...) at
sleepq_catch_signals+0x2fc
sleepq_timedwait_sig(c0c88eb8,3e9,c0b695ef,101,0,...) at
sleepq_timedwait_sig+0x19
_cv_timedwait_sig(c0c88eb8,c0c88ea0,3e9,30a,c07bee1c,...) at
_cv_timedwait_sig+0x190
kern_select(c439faf0,0,0,0,0,e66c5c70,1,0) at kern_select+0x7cf
select(c439faf0,e66c5cfc,14,6,c07bf92b,...) at select+0x5e
syscall(e66c5d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (93, FreeBSD ELF32, select), eip = 0x281d0903, esp =
0xbfbfed9c, ebp = 0xbfbfedc8 ---

Tracing command watchdogd pid 902 tid 100054 td 0xc439f460
sched_switch(c439f460,0,1,824b7df2,c1,...) at sched_switch+0x43b
mi_switch(1,0,c439f460,c43bdae0,e66ceb90,...) at mi_switch+0x146
sleepq_switch(c439f460,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
--More--

sleepq_catch_signals(0,c439f460,e66cebd4,c07a8857,c43bdae0,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c43bdae0,5c,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c43bdae0,c43bdb70,15c,c0b53aa3,0,...) at _sleep+0x2c7
kern_wait(c439f460,5ec,e66cec2c,0,0,...) at kern_wait+0xf98
wait4(c439f460,e66cecfc,10,e66ced38,e66ced2c,...) at wait4+0x3b
syscall(e66ced38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x280fc58b, esp =
0xbfbfed0c, ebp = 0xbfbfedb8 ---

Tracing command gmond pid 891 tid 100057 td 0xc41a7d20
sched_switch(c41a7d20,0,1,fd4ff264,c0,...) at sched_switch+0x43b
mi_switch(1,0,c41a7d20,c43bd2b8,e66d7ad8,...) at mi_switch+0x146
sleepq_switch(c41a7d20,0,c0b5647e,19d,e66d7ac8,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c41a7d20,c4356b00,e66d7b1c,c0761c10,...) at
sleepq_catch_signals+0x2fc
sleepq_timedwait_sig(c0c88eb8,3b5d,c0b695ef,101,0,...) at
sleepq_timedwait_sig+0x19
_cv_timedwait_sig(c0c88eb8,c0c88ea0,3b5d,3b6,c445a050,...) at
_cv_timedwait_sig+0x190
poll(c41a7d20,e66d7cfc,c,e66d7cd8,c07abdd8,...) at poll+0x677
syscall(e66d7d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (209, FreeBSD ELF32, poll), eip = 0x28170bbf, esp =
0xbfbfe1ac, ebp = 0xbfbfe1c8 ---
--More--


Tracing command devd pid 770 tid 100055 td 0xc439f230
sched_switch(c439f230,0,1,29db3768,a0,...) at sched_switch+0x43b
mi_switch(1,0,c439f230,c43bd828,e66d1a84,...) at mi_switch+0x146
sleepq_switch(c439f230,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c439f230,e66d1ac4,c0762080,c0c88eb8,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c0c88eb8,c0c88ea0,c0b695ef,101,0,...) at sleepq_wait_sig+0xd
_cv_wait_sig(c0c88eb8,c0c88ea0,c0b569cc,30a,e66d1ae8,...) at _cv_wait_sig+0x180
kern_select(c439f230,5,bfbfedf8,0,0,0,c43bd828,e66d1c98) at kern_select+0x7e7
select(c439f230,e66d1cfc,14,e66d1d38,e66d1d2c,...) at select+0x5e
syscall(e66d1d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (93, FreeBSD ELF32, select), eip = 0x8086b3f, esp =
0xbfbfe9bc, ebp = 0xbfbfee98 ---

Tracing command dhclient pid 338 tid 100059 td 0xc41a78c0
sched_switch(c41a78c0,0,1,b268fa62,a0,...) at sched_switch+0x43b
mi_switch(1,0,c41a78c0,c4343ae0,e66ddad8,...) at mi_switch+0x146
sleepq_switch(c41a78c0,0,c0b5647e,19d,e66ddac8,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c41a78c0,c44b9700,e66ddb1c,c0761c10,...) at
sleepq_catch_signals+0x2fc
sleepq_timedwait_sig(c0c88eb8,5265c00,c0b695ef,101,0,...) at
sleepq_timedwait_sig+0x19
--More--

_cv_timedwait_sig(c0c88eb8,c0c88ea0,5265c00,3b6,0,...) at
_cv_timedwait_sig+0x190
poll(c41a78c0,e66ddcfc,c,e66ddd38,e66ddd2c,...) at poll+0x677
syscall(e66ddd38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (209, FreeBSD ELF32, poll), eip = 0x28113bbf, esp =
0xbfbfee1c, ebp = 0xbfbfee48 ---

Tracing command dhclient pid 322 tid 100050 td 0xc439fd20
sched_switch(c439fd20,0,1,9000c40a,9e,...) at sched_switch+0x43b
mi_switch(1,0,c439fd20,c433f000,e66b3adc,...) at mi_switch+0x146
sleepq_switch(c439fd20,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c439fd20,e66b3b1c,c0762080,c0c88eb8,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c0c88eb8,c0c88ea0,c0b695ef,101,0,...) at sleepq_wait_sig+0xd
_cv_wait_sig(c0c88eb8,c0c88ea0,c0b569cc,3b6,c439db8c,...) at _cv_wait_sig+0x180
poll(c439fd20,e66b3cfc,c,6,c07bf92b,...) at poll+0x68d
syscall(e66b3d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (209, FreeBSD ELF32, poll), eip = 0x28113bbf, esp =
0xbfbfee1c, ebp = 0xbfbfee48 ---

Tracing command softdepflush pid 48 tid 100047 td 0xc4074af0
sched_switch(c4074af0,0,1,c633a526,cb,...) at sched_switch+0x43b
--More--

mi_switch(1,0,c4074af0,c4074af0,e44bcc94,...) at mi_switch+0x146
sleepq_switch(c4074af0,0,c0b5647e,266,0,...) at sleepq_switch+0xcb
sleepq_timedwait(c0c95228,3e8,c0b6aca8,0,0,...) at sleepq_timedwait+0x37
_sleep(c0c95228,c0c951e8,44,c0b6aca8,3e8,...) at _sleep+0x2b4
softdep_flush(0,e44bcd38,2816fcca,2816ac81,2816a468,...) at softdep_flush+0x3ce
fork_exit(c09ae7f0,0,e44bcd38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe44bcd70, ebp = 0 ---

Tracing command syncer pid 47 tid 100046 td 0xc4074d20
sched_switch(c4074d20,0,1,345ca9a,cc,...) at sched_switch+0x43b
mi_switch(1,0,c4074d20,c4074d20,e44b9c5c,...) at mi_switch+0x146
sleepq_switch(c4074d20,0,c0b5647e,243,0,...) at sleepq_switch+0xcb
sleepq_wait(c0c7da6c,0,c0b5a641,0,0,...) at sleepq_wait+0x36
_sleep(c0c7da6c,c0c89604,68,c0b5a641,0,...) at _sleep+0x2d6
sched_sync(0,e44b9d38,0,0,0,...) at sched_sync+0x920
fork_exit(c0822660,0,e44b9d38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe44b9d70, ebp = 0 ---

--More--

Tracing command vnlru pid 46 tid 100045 td 0xc41a6000
sched_switch(c41a6000,0,1,c691a970,cb,...) at sched_switch+0x43b
mi_switch(1,0,c41a6000,c41a6000,e44b6c58,...) at mi_switch+0x146
sleepq_switch(c41a6000,0,c0b5647e,266,1,...) at sleepq_switch+0xcb
sleepq_timedwait(c4342000,3e8,c0b5a688,0,0,...) at sleepq_timedwait+0x37
_sleep(c4342000,c0c895d8,250,c0b5a688,3e8,...) at _sleep+0x2b4
vnlru_proc(0,e44b6d38,48041b00,dc3e0000,8c0b01,...) at vnlru_proc+0x153
fork_exit(c0823830,0,e44b6d38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe44b6d70, ebp = 0 ---

Tracing command bufdaemon pid 45 tid 100044 td 0xc41a6230
sched_switch(c41a6230,0,1,c6337a6e,cb,...) at sched_switch+0x43b
mi_switch(1,0,c41a6230,c41a6230,e44b3ca0,...) at mi_switch+0x146
sleepq_switch(c41a6230,0,c0b5647e,266,0,...) at sleepq_switch+0xcb
sleepq_timedwait(c0c89324,3e8,c0b58cc1,0,0,...) at sleepq_timedwait+0x37
_sleep(c0c89324,c0c89328,44,c0b58cc1,3e8,...) at _sleep+0x2b4
buf_daemon(0,e44b3d38,0,0,0,...) at buf_daemon+0x2fd
fork_exit(c080b8b0,0,e44b3d38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--More--

--- trap 0, eip = 0, esp = 0xe44b3d70, ebp = 0 ---

Tracing command pagezero pid 44 tid 100043 td 0xc41a6460
sched_switch(c41a6460,0,1,2d29fc76,34,...) at sched_switch+0x43b
mi_switch(1,0,c41a6460,c41a6460,e44b0ca4,...) at mi_switch+0x146
sleepq_switch(c41a6460,0,c0b5647e,266,0,...) at sleepq_switch+0xcb
sleepq_timedwait(c0c95e00,493e0,c0b6e221,0,0,...) at sleepq_timedwait+0x37
_sleep(c0c95e00,c0c959a4,0,c0b6e221,493e0,...) at _sleep+0x2b4
vm_pagezero(0,e44b0d38,0,0,0,...) at vm_pagezero+0xd2
fork_exit(c09ebef0,0,e44b0d38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe44b0d70, ebp = 0 ---

Tracing command vmdaemon pid 43 tid 100042 td 0xc41a6690
sched_switch(c41a6690,0,1,2d28d181,34,...) at sched_switch+0x43b
mi_switch(1,0,c41a6690,c41a6690,e44adc60,...) at mi_switch+0x146
sleepq_switch(c41a6690,0,c0b5647e,243,0,...) at sleepq_switch+0xcb
sleepq_wait(c0c95a18,68,c0b54014,d6,0,...) at sleepq_wait+0x36
_sleep(c0c95a18,c0c95a1c,68,c0b58cc1,0,...) at _sleep+0x2d6
vm_daemon(0,e44add38,0,0,0,...) at vm_daemon+0x78
--More--

fork_exit(c09e7a30,0,e44add38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe44add70, ebp = 0 ---

Tracing command pagedaemon pid 42 tid 100041 td 0xc41a68c0
sched_switch(c41a68c0,0,1,c6335bbf,cb,...) at sched_switch+0x43b
mi_switch(1,0,c41a68c0,c41a68c0,e44aabf0,...) at mi_switch+0x146
sleepq_switch(c41a68c0,0,c0b5647e,266,0,...) at sleepq_switch+0xcb
sleepq_timedwait(c0c959e0,1388,c0b58cc1,0,0,...) at sleepq_timedwait+0x37
_sleep(c0c959e0,c0c959a4,44,c0b58cc1,1388,...) at _sleep+0x2b4
vm_pageout(0,e44aad38,f7b9fe29,ffce73be,eea8f39c,...) at vm_pageout+0x2da
fork_exit(c09e8140,0,e44aad38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe44aad70, ebp = 0 ---

Tracing command sctp_iterator pid 41 tid 100040 td 0xc41a6af0
sched_switch(c41a6af0,0,1,aa6df4fd,9e,...) at sched_switch+0x43b
mi_switch(1,0,c41a6af0,c41a6af0,e44a7ca4,...) at mi_switch+0x146
sleepq_switch(c41a6af0,0,c0b5647e,243,0,...) at sleepq_switch+0xcb
sleepq_wait(c0c8b0b4,c0c8afbc,c0b5ff3a,0,0,...) at sleepq_wait+0x36
--More--

_sleep(c0c8b0b4,c0c8afbc,0,c0b5ff3a,0,...) at _sleep+0x2d6
sctp_iterator_thread(0,e44a7d38,762e,d601,764f,...) at sctp_iterator_thread+0x7f
fork_exit(c088e9f0,0,e44a7d38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe44a7d70, ebp = 0 ---

Tracing command irq7: ppbus0 ppc0 pid 40 tid 100039 td 0xc41a6d20
fork_trampoline() at fork_trampoline

Tracing command irq1: atkbd0 pid 39 tid 100038 td 0xc41a7000
fork_trampoline() at fork_trampoline

Tracing command irq15: ata1 pid 38 tid 100037 td 0xc402cd20
fork_trampoline() at fork_trampoline

Tracing command irq14: ata0 pid 37 tid 100036 td 0xc4073000
fork_trampoline() at fork_trampoline

Tracing command swi0: sio pid 36 tid 100035 td 0xc4073230
sched_switch(c4073230,0,1,e91bd185,b2,...) at sched_switch+0x43b
--More--

mi_switch(1,0,c0b515a9,4a1,0,...) at mi_switch+0x146
ithread_loop(c418e4c0,e4495d38,0,0,0,...) at ithread_loop+0x308
fork_exit(c077e800,c418e4c0,e4495d38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe4495d70, ebp = 0 ---

Tracing command fdc0 pid 35 tid 100034 td 0xc4073460
sched_switch(c4073460,0,1,374ef44,cc,...) at sched_switch+0x43b
mi_switch(1,0,c4073460,c4073460,e4492c00,...) at mi_switch+0x146
sleepq_switch(c4073460,0,c0b5647e,266,0,...) at sleepq_switch+0xcb
sleepq_timedwait(c418d83c,3e8,c0b4da2d,0,0,...) at sleepq_timedwait+0x37
_sleep(c418d83c,c418d8f0,4c,c0b4da2d,3e8,...) at _sleep+0x2b4
fdc_thread(c418d800,e4492d38,0,0,0,...) at fdc_thread+0x3da
fork_exit(c0a798a0,c418d800,e4492d38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe4492d70, ebp = 0 ---

Tracing command fw0_probe pid 34 tid 100033 td 0xc4073690
sched_switch(c4073690,0,1,f8d7766e,30,...) at sched_switch+0x43b
mi_switch(1,0,c4073690,c408a2b8,e44257f0,...) at mi_switch+0x146
--More--

sleepq_switch(c4073690,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c4073690,e4425834,c07a8857,c4097000,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c4097000,c409b484,c0b4da2d,100,0,...) at sleepq_wait_sig+0xd
_sleep(c4097000,c409b484,15c,c0b4da2d,0,...) at _sleep+0x2c7
fw_bus_probe_thread(c4097000,e4425d38,0,c0b41166,c0b3fe7a,...) at
fw_bus_probe_thread+0x785
fork_exit(c05bbd20,c4097000,e4425d38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe4425d70, ebp = 0 ---

Tracing command fw0_taskq pid 33 tid 100032 td 0xc40738c0
sched_switch(c40738c0,0,1,48d4ce10,cc,...) at sched_switch+0x43b
mi_switch(1,0,c40738c0,c408c21c,e4422ca4,...) at mi_switch+0x146
sleepq_switch(c40738c0,0,c0b5647e,243,0,...) at sleepq_switch+0xcb
sleepq_wait(c408c200,c408c21c,c0b4da2d,0,0,...) at sleepq_wait+0x36
msleep_spin(c408c200,c408c21c,c0b4da2d,0,e4422cf4,...) at msleep_spin+0x181
taskqueue_thread_loop(c409b49c,e4422d38,40100014,40,2000040,...) at
taskqueue_thread_loop+0xdd
fork_exit(c07d4070,c409b49c,e4422d38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe4422d70, ebp = 0 ---

--More--

Tracing command usb4 pid 32 tid 100031 td 0xc4073af0
sched_switch(c4073af0,0,1,ab89b8a6,b5,...) at sched_switch+0x43b
mi_switch(1,0,c4073af0,c4073af0,e4409ca0,...) at mi_switch+0x146
sleepq_switch(c4073af0,0,c0b5647e,266,1,...) at sleepq_switch+0xcb
sleepq_timedwait(c4013210,ea60,c0b4ab7f,0,0,...) at sleepq_timedwait+0x37
_sleep(c4013210,0,5c,c0b4ab7f,ea60,...) at _sleep+0x2b4
usb_event_thread(c4087380,e4409d38,0,0,0,...) at usb_event_thread+0xeb
fork_exit(c070a720,c4087380,e4409d38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe4409d70, ebp = 0 ---

Tracing command irq23: rl1 ehci0 pid 31 tid 100030 td 0xc4073d20
sched_switch(c4073d20,0,1,e9f445d0,9f,...) at sched_switch+0x43b
mi_switch(1,0,c0b515a9,4a1,0,...) at mi_switch+0x146
ithread_loop(c4065590,e43f7d38,0,0,0,...) at ithread_loop+0x308
fork_exit(c077e800,c4065590,e43f7d38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe43f7d70, ebp = 0 ---

Tracing command usb3 pid 30 tid 100029 td 0xc4074000
--More--

sched_switch(c4074000,0,1,abb994f4,b5,...) at sched_switch+0x43b
mi_switch(1,0,c4074000,c4074000,e43f3ca0,...) at mi_switch+0x146
sleepq_switch(c4074000,0,c0b5647e,266,1,...) at sleepq_switch+0xcb
sleepq_timedwait(c407f210,ea60,c0b4ab7f,0,0,...) at sleepq_timedwait+0x37
_sleep(c407f210,0,5c,c0b4ab7f,ea60,...) at _sleep+0x2b4
usb_event_thread(c40549c0,e43f3d38,0,0,0,...) at usb_event_thread+0xeb
fork_exit(c070a720,c40549c0,e43f3d38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe43f3d70, ebp = 0 ---

Tracing command usb2 pid 29 tid 100028 td 0xc4074230
sched_switch(c4074230,0,1,abb97f14,b5,...) at sched_switch+0x43b
mi_switch(1,0,c4074230,c4074230,e43efca0,...) at mi_switch+0x146
sleepq_switch(c4074230,0,c0b5647e,266,1,...) at sleepq_switch+0xcb
sleepq_timedwait(c406c210,ea60,c0b4ab7f,0,0,...) at sleepq_timedwait+0x37
_sleep(c406c210,0,5c,c0b4ab7f,ea60,...) at _sleep+0x2b4
usb_event_thread(c4066300,e43efd38,0,0,0,...) at usb_event_thread+0xeb
fork_exit(c070a720,c4066300,e43efd38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe43efd70, ebp = 0 ---
--More--


Tracing command irq18: rl0 uhci2++ pid 28 tid 100027 td 0xc4074460
sched_switch(c4074460,0,1,45e08085,c9,...) at sched_switch+0x43b
mi_switch(1,0,c0b515a9,4a1,0,...) at mi_switch+0x146
ithread_loop(c4065860,e43ebd38,0,0,0,...) at ithread_loop+0x308
fork_exit(c077e800,c4065860,e43ebd38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe43ebd70, ebp = 0 ---

Tracing command usb1 pid 27 tid 100026 td 0xc3f63690
sched_switch(c3f63690,0,1,abb967c3,b5,...) at sched_switch+0x43b
mi_switch(1,0,c3f63690,c3f63690,e43e8ca0,...) at mi_switch+0x146
sleepq_switch(c3f63690,0,c0b5647e,266,1,...) at sleepq_switch+0xcb
sleepq_timedwait(c405c210,ea60,c0b4ab7f,0,0,...) at sleepq_timedwait+0x37
_sleep(c405c210,0,5c,c0b4ab7f,ea60,...) at _sleep+0x2b4
usb_event_thread(c4066e80,e43e8d38,0,0,0,...) at usb_event_thread+0xeb
fork_exit(c070a720,c4066e80,e43e8d38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe43e8d70, ebp = 0 ---

--More--

Tracing command irq19: uhci1 pid 26 tid 100025 td 0xc3f638c0
fork_trampoline() at fork_trampoline

Tracing command usbtask-dr pid 25 tid 100024 td 0xc3f63af0
sched_switch(c3f63af0,0,1,b7630020,30,...) at sched_switch+0x43b
mi_switch(1,0,c3f63af0,c3f63af0,e43e1ca0,...) at mi_switch+0x146
sleepq_switch(c3f63af0,0,c0b5647e,243,1,...) at sleepq_switch+0xcb
sleepq_wait(c0c7b234,5c,c0b54014,d6,0,...) at sleepq_wait+0x36
_sleep(c0c7b234,0,5c,c0b4ab71,0,...) at _sleep+0x2d6
usb_task_thread(c0c7b234,e43e1d38,0,0,0,...) at usb_task_thread+0x7e
fork_exit(c070a640,c0c7b234,e43e1d38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe43e1d70, ebp = 0 ---

Tracing command usbtask-hc pid 24 tid 100023 td 0xc3f63d20
sched_switch(c3f63d20,0,1,b762eba4,30,...) at sched_switch+0x43b
mi_switch(1,0,c3f63d20,c3f63d20,e43deca0,...) at mi_switch+0x146
sleepq_switch(c3f63d20,0,c0b5647e,243,1,...) at sleepq_switch+0xcb
sleepq_wait(c0c7b220,5c,c0b54014,d6,0,...) at sleepq_wait+0x36
_sleep(c0c7b220,0,5c,c0b4ab71,0,...) at _sleep+0x2d6
--More--

usb_task_thread(c0c7b220,e43ded38,0,0,0,...) at usb_task_thread+0x7e
fork_exit(c070a640,c0c7b220,e43ded38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe43ded70, ebp = 0 ---

Tracing command usb0 pid 23 tid 100022 td 0xc402c000
sched_switch(c402c000,0,1,abb94f0e,b5,...) at sched_switch+0x43b
mi_switch(1,0,c402c000,c402c000,e43dbca0,...) at mi_switch+0x146
sleepq_switch(c402c000,0,c0b5647e,266,1,...) at sleepq_switch+0xcb
sleepq_timedwait(c4024210,ea60,c0b4ab7f,0,0,...) at sleepq_timedwait+0x37
_sleep(c4024210,0,5c,c0b4ab7f,ea60,...) at _sleep+0x2b4
usb_event_thread(c4053280,e43dbd38,0,0,0,...) at usb_event_thread+0xeb
fork_exit(c070a720,c4053280,e43dbd38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe43dbd70, ebp = 0 ---

Tracing command irq16: uhci0 uhci3 pid 22 tid 100021 td 0xc402c230
fork_trampoline() at fork_trampoline

Tracing command irq9: acpi0 pid 21 tid 100020 td 0xc402c460
--More--

fork_trampoline() at fork_trampoline

Tracing command swi6: task queue pid 20 tid 100019 td 0xc402c690
sched_switch(c402c690,0,1,261ad3d4,a0,...) at sched_switch+0x43b
mi_switch(1,0,c0b515a9,4a1,1,...) at mi_switch+0x146
ithread_loop(c3fcac30,e43bcd38,1110e,1000120,c4025a00,...) at ithread_loop+0x308
fork_exit(c077e800,c3fcac30,e43bcd38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe43bcd70, ebp = 0 ---

Tracing command swi6: Giant taskq pid 19 tid 100018 td 0xc402c8c0
fork_trampoline() at fork_trampoline

Tracing command thread taskq pid 18 tid 100017 td 0xc402caf0
sched_switch(c402caf0,0,1,55fa8ee0,34,...) at sched_switch+0x43b
mi_switch(1,0,c402caf0,c402caf0,e43b6c9c,...) at mi_switch+0x146
sleepq_switch(c402caf0,0,c0b5647e,243,0,...) at sleepq_switch+0xcb
sleepq_wait(c3fe3700,c3fe371c,c0b4da2d,0,0,...) at sleepq_wait+0x36
_sleep(c3fe3700,c3fe371c,0,c0b4da2d,0,...) at _sleep+0x2d6
taskqueue_thread_loop(c0c8801c,e43b6d38,100110f,534b4157,0,...) at
taskqueue_thread_loop+0x104
--More--

fork_exit(c07d4070,c0c8801c,e43b6d38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe43b6d70, ebp = 0 ---

Tracing command swi5: + pid 17 tid 100016 td 0xc3f1a230
fork_trampoline() at fork_trampoline

Tracing command acpi_task_2 pid 9 tid 100015 td 0xc3f1a460
sched_switch(c3f1a460,0,1,b76db3bb,30,...) at sched_switch+0x43b
mi_switch(1,0,c3f1a460,c3f1a460,e43b0c9c,...) at mi_switch+0x146
sleepq_switch(c3f1a460,0,c0b5647e,243,0,...) at sleepq_switch+0xcb
sleepq_wait(c3fe3880,c3fe389c,c0b4da2d,0,0,...) at sleepq_wait+0x36
_sleep(c3fe3880,c3fe389c,0,c0b4da2d,0,...) at _sleep+0x2d6
taskqueue_thread_loop(c0e1bebc,e43b0d38,1008000,80,88000020,...) at
taskqueue_thread_loop+0x104
fork_exit(c07d4070,c0e1bebc,e43b0d38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe43b0d70, ebp = 0 ---

Tracing command acpi_task_1 pid 8 tid 100014 td 0xc3f1a690
sched_switch(c3f1a690,0,1,b76d9523,30,...) at sched_switch+0x43b
--More--

mi_switch(1,0,c3f1a690,c3f1a690,e43adc9c,...) at mi_switch+0x146
sleepq_switch(c3f1a690,0,c0b5647e,243,0,...) at sleepq_switch+0xcb
sleepq_wait(c3fe3880,c3fe389c,c0b4da2d,0,0,...) at sleepq_wait+0x36
_sleep(c3fe3880,c3fe389c,0,c0b4da2d,0,...) at _sleep+0x2d6
taskqueue_thread_loop(c0e1bebc,e43add38,0,0,0,...) at
taskqueue_thread_loop+0x104
fork_exit(c07d4070,c0e1bebc,e43add38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe43add70, ebp = 0 ---

Tracing command acpi_task_0 pid 7 tid 100013 td 0xc3f1a8c0
sched_switch(c3f1a8c0,0,1,b76d7624,30,...) at sched_switch+0x43b
mi_switch(1,0,c3f1a8c0,c3f1a8c0,e43aac9c,...) at mi_switch+0x146
sleepq_switch(c3f1a8c0,0,c0b5647e,243,0,...) at sleepq_switch+0xcb
sleepq_wait(c3fe3880,c3fe389c,c0b4da2d,0,0,...) at sleepq_wait+0x36
_sleep(c3fe3880,c3fe389c,0,c0b4da2d,0,...) at _sleep+0x2d6
taskqueue_thread_loop(c0e1bebc,e43aad38,0,0,0,...) at
taskqueue_thread_loop+0x104
fork_exit(c07d4070,c0e1bebc,e43aad38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe43aad70, ebp = 0 ---

--More--

Tracing command swi2: cambio pid 16 tid 100012 td 0xc3f1aaf0
sched_switch(c3f1aaf0,0,1,7f9b39a5,34,...) at sched_switch+0x43b
mi_switch(1,0,c0b515a9,4a1,0,...) at mi_switch+0x146
ithread_loop(c3fcac80,e43a7d38,0,0,0,...) at ithread_loop+0x308
fork_exit(c077e800,c3fcac80,e43a7d38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe43a7d70, ebp = 0 ---

Tracing command xpt_thrd pid 6 tid 100011 td 0xc3f1ad20
sched_switch(c3f1ad20,0,1,b7629af6,30,...) at sched_switch+0x43b
mi_switch(1,0,c3f1ad20,c3f1ad20,e43a4c90,...) at mi_switch+0x146
sleepq_switch(c3f1ad20,0,c0b5647e,243,0,...) at sleepq_switch+0xcb
sleepq_wait(c0c4b054,4c,c0b54014,d6,0,...) at sleepq_wait+0x36
_sleep(c0c4b054,c0c4b06c,4c,c0b0ae09,0,...) at _sleep+0x2d6
xpt_scanner_thread(0,e43a4d38,0,0,0,...) at xpt_scanner_thread+0x41
fork_exit(c046f530,0,e43a4d38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe43a4d70, ebp = 0 ---

Tracing command kqueue taskq pid 5 tid 100010 td 0xc3f63000
--More--

sched_switch(c3f63000,0,1,b76c4f80,30,...) at sched_switch+0x43b
mi_switch(1,0,c3f63000,c3f63000,e43a1c9c,...) at mi_switch+0x146
sleepq_switch(c3f63000,0,c0b5647e,243,0,...) at sleepq_switch+0xcb
sleepq_wait(c3fe3a80,c3fe3a9c,c0b4da2d,0,0,...) at sleepq_wait+0x36
_sleep(c3fe3a80,c3fe3a9c,0,c0b4da2d,0,...) at _sleep+0x2d6
taskqueue_thread_loop(c0c7be84,e43a1d38,0,0,0,...) at
taskqueue_thread_loop+0x104
fork_exit(c07d4070,c0c7be84,e43a1d38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe43a1d70, ebp = 0 ---

Tracing command yarrow pid 15 tid 100009 td 0xc3f63230
sched_switch(c3f63230,0,1,4991b243,cc,...) at sched_switch+0x43b
mi_switch(1,0,c3f63230,c3f63230,e439ac74,...) at mi_switch+0x146
sleepq_switch(c3f63230,0,c0b5647e,266,0,...) at sleepq_switch+0xcb
sleepq_timedwait(c0c7da74,64,c0b4da2d,2,0,...) at sleepq_timedwait+0x37
_sleep(c0c7da74,0,0,c0b4da2d,64,...) at _sleep+0x2b4
pause(c0b4da2d,64,23330424,48000104,5320254,...) at pause+0x30
random_kthread(0,e439ad38,67badf3f,dcfeb2df,7eaf373f,...) at
random_kthread+0x22a
fork_exit(c0687350,0,e439ad38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--More--

--- trap 0, eip = 0, esp = 0xe439ad70, ebp = 0 ---

Tracing command g_down pid 4 tid 100008 td 0xc3f63460
sched_switch(c3f63460,0,1,4d13247f,cc,...) at sched_switch+0x43b
mi_switch(1,0,c3f63460,c3f63460,e4397c60,...) at mi_switch+0x146
sleepq_switch(c3f63460,0,c0b5647e,266,0,...) at sleepq_switch+0xcb
sleepq_timedwait(c0c7b62c,64,c0b4da2d,0,0,...) at sleepq_timedwait+0x37
_sleep(c0c7b62c,c0c7b548,24c,c0b4da2d,64,...) at _sleep+0x2b4
g_io_schedule_down(c3f63460,4c,c0b4e6e7,72,0,...) at g_io_schedule_down+0x6b
g_down_procbody(0,e4397d38,7ff73fff,7ff537ff,effffdff,...) at
g_down_procbody+0x6e
fork_exit(c0746110,0,e4397d38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe4397d70, ebp = 0 ---

Tracing command g_up pid 3 tid 100007 td 0xc3f18000
sched_switch(c3f18000,0,1,4da0d2d3,cc,...) at sched_switch+0x43b
mi_switch(1,0,c3f18000,c3f18000,e4394c84,...) at mi_switch+0x146
sleepq_switch(c3f18000,0,c0b5647e,266,0,...) at sleepq_switch+0xcb
sleepq_timedwait(c0c7b628,64,c0b4da2d,0,0,...) at sleepq_timedwait+0x37
_sleep(c0c7b628,c0c7b588,24c,c0b4da2d,64,...) at _sleep+0x2b4
--More--

g_io_schedule_up(c3f18000,4c,c0b4e6e7,5b,0,...) at g_io_schedule_up+0xd2
g_up_procbody(0,e4394d38,20102016,a20001d1,2000322,...) at g_up_procbody+0x6e
fork_exit(c0745ff0,0,e4394d38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe4394d70, ebp = 0 ---

Tracing command g_event pid 2 tid 100006 td 0xc3f18230
sched_switch(c3f18230,0,1,4e5dc57c,cc,...) at sched_switch+0x43b
mi_switch(1,0,c3f18230,c3f18230,e4391ca0,...) at mi_switch+0x146
sleepq_switch(c3f18230,0,c0b5647e,266,0,...) at sleepq_switch+0xcb
sleepq_timedwait(c0c7b620,64,c0b4da2d,0,0,...) at sleepq_timedwait+0x37
_sleep(c0c7b620,0,4c,c0b4da2d,64,...) at _sleep+0x2b4
g_event_procbody(0,e4391d38,0,82b64920,c3f64ce0,...) at g_event_procbody+0xac
fork_exit(c0746060,0,e4391d38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe4391d70, ebp = 0 ---

Tracing command swi3: vm pid 14 tid 100005 td 0xc3f18460
fork_trampoline() at fork_trampoline

--More--

Tracing command swi4: clock sio pid 13 tid 100004 td 0xc3f18690
sched_switch(c3f18690,0,1,5151748d,cc,...) at sched_switch+0x43b
mi_switch(1,0,c0b515a9,4a1,6202331,...) at mi_switch+0x146
ithread_loop(c3f15270,e438bd38,2001,dbf5fde3,c3f5fcfd,...) at ithread_loop+0x308
fork_exit(c077e800,c3f15270,e438bd38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe438bd70, ebp = 0 ---

Tracing command swi1: net pid 12 tid 100003 td 0xc3f188c0
sched_switch(c3f188c0,0,1,87353bda,bd,...) at sched_switch+0x43b
mi_switch(1,0,c0b515a9,4a1,0,...) at mi_switch+0x146
ithread_loop(c3f15280,e4388d38,1000,0,0,...) at ithread_loop+0x308
fork_exit(c077e800,c3f15280,e4388d38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe4388d70, ebp = 0 ---

Tracing command idle: cpu0 pid 11 tid 100002 td 0xc3f18af0
sched_switch(c3f18af0,0,6,7438c670,c1,...) at sched_switch+0x43b
mi_switch(6,0,c0b54d2c,b6,0,...) at mi_switch+0x146
critical_exit(c3f5a600,0,214,c3f18af0,c3f5a600,...) at critical_exit+0x83
--More--

intr_execute_handlers(c3efbec8,e2984c48,e2984c88,c0aa0224,33,...) at
intr_execute_handlers+0x135
lapic_handle_intr(33,e2984c48) at lapic_handle_intr+0x3f
Xapic_isr1() at Xapic_isr1+0x34
--- interrupt, eip = 0xc0e0b615, esp = 0xe2984c88, ebp = 0xe2984c88 ---
acpi_cpu_c1(c3f18af0,3e8,0,0,c0e04517,...) at acpi_cpu_c1+0x5
acpi_cpu_idle(e2984cf4,c07c0004,c3f2eac0,c3f2e7e8,c1c4a788,...) at
acpi_cpu_idle+0x184
cpu_idle(c3f2eac0,c3f2e7e8,c1c4a788,e2a6b000,0,...) at cpu_idle+0x28
sched_idletd(0,e2984d38,c3f18764,c3f1a640,c3f1a448,...) at sched_idletd+0x2c4
fork_exit(c07bfd40,0,e2984d38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe2984d70, ebp = 0 ---

Tracing command init pid 1 tid 100001 td 0xc3f18d20
sched_switch(c3f18d20,0,1,71df2080,b1,...) at sched_switch+0x43b
mi_switch(1,0,c3f18d20,c3f16ae0,e2980b90,...) at mi_switch+0x146
sleepq_switch(c3f18d20,0,c0b5647e,19d,c0aa9f80,...) at sleepq_switch+0xcb
sleepq_catch_signals(0,c3f18d20,e2980bd4,c07a8857,c3f16ae0,...) at
sleepq_catch_signals+0x2fc
sleepq_wait_sig(c3f16ae0,5c,c0b54014,d6,0,...) at sleepq_wait_sig+0xd
_sleep(c3f16ae0,c3f16b70,15c,c0b53aa3,0,...) at _sleep+0x2c7
kern_wait(c3f18d20,ffffffff,e2980c2c,0,0,...) at kern_wait+0xf98
--More--

wait4(c3f18d20,e2980cfc,10,e2980d38,e2980d2c,...) at wait4+0x3b
syscall(e2980d38) at syscall+0x335
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x805455f, esp =
0xbfbfe97c, ebp = 0xbfbfe998 ---

Tracing command audit pid 10 tid 100000 td 0xc3f1a000
sched_switch(c3f1a000,0,1,b7600188,30,...) at sched_switch+0x43b
mi_switch(1,0,c3f1a000,c3f1a000,e297dc7c,...) at mi_switch+0x146
sleepq_switch(c3f1a000,0,c0b5647e,243,0,...) at sleepq_switch+0xcb
sleepq_wait(c0c94c64,c0c94c44,c0b690af,1,0,...) at sleepq_wait+0x36
_cv_wait(c0c94c64,c0c94c44,e2984cc0,c0a98c48,e2984cb4,...) at _cv_wait+0x171
audit_worker(0,e297dd38,1000000,4000010,20000000,...) at audit_worker+0x6f
fork_exit(c0994530,0,e297dd38) at fork_exit+0x99
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe297dd70, ebp = 0 ---

Tracing command swapper pid 0 tid 0 td 0xc0c7b9a0
sched_switch(c0c7b9a0,0,1,c6058838,cb,...) at sched_switch+0x43b
mi_switch(1,0,c0c7b9a0,c0c7b9a0,c1020d08,...) at mi_switch+0x146
sleepq_switch(c0c7b9a0,0,c0b5647e,266,0,...) at sleepq_switch+0xcb
--More--

sleepq_timedwait(c0c7b6e0,2710,c0b55019,0,0,...) at sleepq_timedwait+0x37
_sleep(c0c7b6e0,0,44,c0b55019,2710,...) at _sleep+0x2b4
scheduler(0,101ec00,101ec00,101e000,1025000,...) at scheduler+0x35d
mi_startup() at mi_startup+0x96
begin() at begin+0x2c
db>  reboot
Killed
# exit


Script done on Fri Dec 26 19:19:35 2008



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?bdf82f800812261732t427debb5vd5963895aec8e9a7>