Date: Tue, 15 Jun 2004 13:55:13 -0400 From: Don Bowman <don@sandvine.com> To: "'current@freebsd.org'" <current@freebsd.org>, "'acpi@freebsd.org'" <acpi@freebsd.org> Subject: acpi interrupt storm when disabling, IPI hang Message-ID: <FE045D4D9F7AED4CBFF1B3B813C85337051D8FE6@mail.sandvine.com>
next in thread | raw e-mail | index | archive | help
[-- Attachment #1 --]
When i run 'acpiconf -d', i get an interrupt storm on irq9...
vmstat -i shows ~1000/s.
Jun 15 13:41:33 cdata kernel: Interrupt storm detected on "irq9: acpi0";
throttling interrupt source
when i try to re-enable, i get an error:
# acpiconf -e
acpi0: interrupt handler already installed
ACPI-0210: *** Error: Unable to install System Control Interrupt
Handler, AE_ALREADY_EXISTS
acpiconf: enable failed: Device not configured
#
System is a Supermicro X5DPE motherboard, dual 2.8GHz Xeon,
533MHz FSB, Intel e7501 chipset.
# sysctl hw.acpi
hw.acpi.supported_sleep_state: S1 S4 S5
hw.acpi.power_button_state: S5
hw.acpi.sleep_button_state: S1
hw.acpi.lid_switch_state: NONE
hw.acpi.standby_state: S1
hw.acpi.suspend_state: S3
hw.acpi.sleep_delay: 1
hw.acpi.s4bios: 0
hw.acpi.verbose: 0
hw.acpi.disable_on_poweroff: 0
hw.acpi.reset_video: 1
hw.acpi.cpu.cx_supported: C1/0
hw.acpi.cpu.cx_lowest: C1
hw.acpi.cpu.cx_usage: 99%
The system will not boot 5.x if acpi is disabled.
It will run 4.x without trouble tho.
I am currently debugging a problem where 2
of the processors are in acpi_cpu_c1, 1 is
in idle, and 1 calls smp_tlb_shootdown, but
the IPI to one of the other processors never
completes, so it hangs. I have a core file
from this state.
(kgdb) printStack2 0xed09acdc
<acpi_cpu_idle+129>: 0xa10cc483
<cpu_idle+40>: 0xf689c3c9
<idle_proc+25>: 0xe800768d
<fork_exit+113>: 0xb808c483
<fork_trampoline+8>: 0xe90cc483
(kgdb) printStack2 0xed09dcd8
<acpi_cpu_c1+5>: 0x5590c3c9
<acpi_cpu_idle+193>: 0x0000d4e9
<cpu_idle+40>: 0xf689c3c9
<idle_proc+25>: 0xe800768d
<fork_exit+113>: 0xb808c483
<fork_trampoline+8>: 0xe90cc483
(kgdb) printStack2 0xed0a0cd8
<acpi_cpu_c1+5>: 0x5590c3c9
<acpi_cpu_idle+193>: 0x0000d4e9
<cpu_idle+40>: 0xf689c3c9
<idle_proc+25>: 0xe800768d
<fork_exit+113>: 0xb808c483
<fork_trampoline+8>: 0xe90cc483
(kgdb) printStack2 0xeec7dc3c
<cluster_callback+43>: 0x0128978b
<bufdone+275>: 0x000350e9
<bufdonebio+63>: 0x6404c483
<biodone+134>: 0x8d04c483
<g_dev_done+91>: 0x5bf8658d
<biodone+134>: 0x8d04c483
<g_io_schedule_up+218>: 0xc483f689
<g_up_procbody+26>: 0xeb04c483
<fork_exit+113>: 0xb808c483
<fork_trampoline+8>: 0xe90cc483
Sometimes that last one is like:
#7 0xc068e066 in smp_tlb_shootdown (vector=246, addr1=0, addr2=0)
at machine/cpufunc.h:305
#8 0xc068e1d0 in smp_invlpg_range (addr1=3876638720, addr2=3876769792)
at /usr/src/sys/i386/i386/mp_machdep.c:1030
#9 0xc0690643 in pmap_invalidate_range (pmap=0xc077dd80, sva=3876638720,
eva=3876769792) at /usr/src/sys/i386/i386/pmap.c:640
#10 0xc0690be0 in pmap_qenter (sva=3876638720, m=0xde548600, count=0)
at /usr/src/sys/i386/i386/pmap.c:958
#11 0xc058aca3 in cluster_rbuild (vp=0xc83db104, filesize=1073741824,
lbn=40844, blkno=241691456, size=16384, run=8, fbp=0x0)
at /usr/src/sys/kern/vfs_cluster.c:508
#12 0xc058a3a8 in cluster_read (vp=0xc83db104, filesize=1073741824,
lblkno=40844, size=16384, cred=0x0, totread=8192, seqcount=127, bpp=0x0)
at /usr/src/sys/kern/vfs_cluster.c:263
#13 0xc063dc4a in ffs_read (ap=0x0) at /usr/src/sys/ufs/ffs/ffs_vnops.c:441
#14 0xc059e325 in vn_read (fp=0xc5a02198, uio=0xf53c1c88,
active_cred=0xc59f6280, flags=0, td=0xc6645e70) at vnode_if.h:398
#15 0xc05655bc in dofileread (td=0xc6645e70, fp=0xc5a02198, fd=23,
buf=0x706b40c0, nbyte=8192, offset=0, flags=0)
at /usr/src/sys/sys/file.h:233
#16 0xc0565467 in read (td=0xc6645e70, uap=0xf53c1d14)
at /usr/src/sys/kern/sys_generic.c:107
#17 0xc06956f7 in syscall (frame=
{tf_fs = 138149935, tf_es = 138149935, tf_ds = -1078001617, tf_edi =
81682, tf_esi = 137404728, tf_ebp = -1077946040, tf_isp = -180609676, tf_ebx
= 608, tf_edx = 23, tf_ecx = 137834496, tf_eax = 3, tf_trapno = 22, tf_err =
2, tf_eip = 1749868123, tf_cs = 31, tf_eflags = 582, tf_esp = -1077946068,
tf_ss = 47})
at /usr/src/sys/i386/i386/trap.c:1004
#18 0x684cde5b in ?? ()
(kgdb) disass acpi_cpu_c1
Dump of assembler code for function acpi_cpu_c1:
0xc084cc44 <acpi_cpu_c1>: push %ebp
0xc084cc45 <acpi_cpu_c1+1>: mov %esp,%ebp
0xc084cc47 <acpi_cpu_c1+3>: sti
0xc084cc48 <acpi_cpu_c1+4>: hlt
0xc084cc49 <acpi_cpu_c1+5>: leave
0xc084cc4a <acpi_cpu_c1+6>: ret
0xc084cc4b <acpi_cpu_c1+7>: nop
End of assembler dump.
(kgdb) disass acpi_cpu_idle
Dump of assembler code for function acpi_cpu_idle:
0xc084caa0 <acpi_cpu_idle>: push %ebp
...
0xc084cb4f <acpi_cpu_idle+175>: cltd
0xc084cb50 <acpi_cpu_idle+176>: idivl 0xc0753f0c
0xc084cb56 <acpi_cpu_idle+182>: mov %eax,0x9c(%esi)
0xc084cb5c <acpi_cpu_idle+188>: call 0xc084cc44 <acpi_cpu_c1>
0xc084cb61 <acpi_cpu_idle+193>: jmp 0xc084cc3a <acpi_cpu_idle+410>
0xc084cb66 <acpi_cpu_idle+198>: mov %esi,%esi
0xc084cb68 <acpi_cpu_idle+200>: cmpl $0x3,0x4(%edi)
0xc084cb6c <acpi_cpu_idle+204>: jne 0xc084cb88 <acpi_cpu_idle+232>
[-- Attachment #2 --]
Copyright (c) 1992-2004 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD 5.2-CURRENT #10: Thu Jun 10 08:54:08 EDT 2004
root@cdata.sandvine.com:/usr/obj/usr/src/sys/CDATA
Preloaded elf kernel "/boot/kernel/kernel" at 0xc086b000.
Preloaded elf module "/boot/kernel/acpi.ko" at 0xc086b30c.
ACPI APIC Table: <PTLTD APIC >
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(TM) CPU 2.80GHz (2799.22-MHz 686-class CPU)
Origin = "GenuineIntel" Id = 0xf27 Stepping = 7
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Hyperthreading: 2 logical CPUs
real memory = 4026007552 (3839 MB)
avail memory = 3940634624 (3758 MB)
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
cpu0 (BSP): APIC ID: 0
cpu1 (AP): APIC ID: 1
cpu2 (AP): APIC ID: 6
cpu3 (AP): APIC ID: 7
Pentium 4 TCC support enabled, current performance 100%
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 24-47 on motherboard
ioapic2 <Version 2.0> irqs 48-71 on motherboard
ioapic3 <Version 2.0> irqs 72-95 on motherboard
ioapic4 <Version 2.0> irqs 96-119 on motherboard
random: <entropy source, Software, Yarrow>
Pentium Pro MTRR support enabled
npx0: [FAST]
npx0: <math processor> on motherboard
npx0: INT 16 interface
acpi0: <PTLTD RSDT> on motherboard
acpi0: [GIANT-LOCKED]
pcibios: BIOS version 2.10
acpi0: Power Button (fixed)
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1008-0x100b on acpi0
cpu0: <ACPI CPU (2 Cx states)> on acpi0
cpu1: <ACPI CPU (2 Cx states)> on acpi0
cpu2: <ACPI CPU (2 Cx states)> on acpi0
cpu3: <ACPI CPU (2 Cx states)> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pci0: <unknown> at device 0.1 (no driver attached)
pcib1: <ACPI PCI-PCI bridge> at device 2.0 on pci0
pcib1: could not get PCI interrupt routing table for \\_SB_.PCI0.HLB_ - AE_NOT_FOUND
pci1: <ACPI PCI bus> on pcib1
pci1: <base peripheral, interrupt controller> at device 28.0 (no driver attached)
pcib2: <ACPI PCI-PCI bridge> at device 29.0 on pci1
pci2: <ACPI PCI bus> on pcib2
pci1: <base peripheral, interrupt controller> at device 30.0 (no driver attached)
pcib3: <ACPI PCI-PCI bridge> at device 31.0 on pci1
pci3: <ACPI PCI bus> on pcib3
em0: <Intel(R) PRO/1000 Network Connection, Version - 1.7.25> port 0x3000-0x303f mem 0xf4200000-0xf421ffff irq 28 at device 2.0 on pci3
em0: [GIANT-LOCKED]
em0: Ethernet address: 00:30:48:2a:a0:1c
em0: Speed:N/A Duplex:N/A
em1: <Intel(R) PRO/1000 Network Connection, Version - 1.7.25> port 0x3040-0x307f mem 0xf4220000-0xf423ffff irq 29 at device 2.1 on pci3
em1: [GIANT-LOCKED]
em1: Ethernet address: 00:30:48:2a:a0:1d
em1: Speed:N/A Duplex:N/A
pci0: <unknown> at device 2.1 (no driver attached)
pcib4: <ACPI PCI-PCI bridge> at device 3.0 on pci0
pcib4: could not get PCI interrupt routing table for \\_SB_.PCI0.HLC_ - AE_NOT_FOUND
pci4: <ACPI PCI bus> on pcib4
pci4: <base peripheral, interrupt controller> at device 28.0 (no driver attached)
pcib5: <ACPI PCI-PCI bridge> at device 29.0 on pci4
pci5: <ACPI PCI bus> on pcib5
aac0: <Adaptec SCSI RAID 2200S> mem 0xf8000000-0xfbffffff irq 96 at device 1.0 on pci5
aac0: [FAST]
aac0: i960RX 100MHz, 48MB cache memory, optional battery present
aac0: Kernel 4.0-0, Build 6011, S/N ba8ff3
aac0: Supported Options=1f7e<CLUSTERS,WCACHE,DATA64,HOSTTIME,RAID50,WINDOW4GB,SOFTERR,NORECOND,SGMAP64,ALARM,NONDASD>
aacp0: <SCSI Passthrough Bus> on aac0
aacp1: <SCSI Passthrough Bus> on aac0
pci4: <base peripheral, interrupt controller> at device 30.0 (no driver attached)
pcib6: <ACPI PCI-PCI bridge> at device 31.0 on pci4
pci6: <ACPI PCI bus> on pcib6
pci0: <unknown> at device 3.1 (no driver attached)
uhci0: <Intel 82801CA/CAM (ICH3) USB controller USB-A> port 0x2000-0x201f irq 16 at device 29.0 on pci0
uhci0: [GIANT-LOCKED]
usb0: <Intel 82801CA/CAM (ICH3) USB controller USB-A> on uhci0
usb0: USB revision 1.0
uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
uhci1: <Intel 82801CA/CAM (ICH3) USB controller USB-B> port 0x2020-0x203f irq 19 at device 29.1 on pci0
uhci1: [GIANT-LOCKED]
usb1: <Intel 82801CA/CAM (ICH3) USB controller USB-B> on uhci1
usb1: USB revision 1.0
uhub1: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub1: 2 ports with 2 removable, self powered
uhci2: <Intel 82801CA/CAM (ICH3) USB controller USB-C> port 0x2040-0x205f irq 18 at device 29.2 on pci0
uhci2: [GIANT-LOCKED]
usb2: <Intel 82801CA/CAM (ICH3) USB controller USB-C> on uhci2
usb2: USB revision 1.0
uhub2: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub2: 2 ports with 2 removable, self powered
pcib7: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci7: <ACPI PCI bus> on pcib7
pci7: <display, VGA> at device 1.0 (no driver attached)
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel ICH3 UDMA100 controller> port 0x2080-0x208f,0x376,0x170-0x177,0x3f6,0x1f0-0x1f7 at device 31.1 on pci0
ata0: at 0x1f0 irq 14 on atapci0
ata1: at 0x170 irq 15 on atapci0
ichsmb0: <Intel 82801CA (ICH3) SMBus controller> port 0x1100-0x111f irq 17 at device 31.3 on pci0
ichsmb0: [GIANT-LOCKED]
smbus0: <System Management Bus> on ichsmb0
smb0: <SMBus generic I/O> on smbus0
acpi_button0: <Power Button> on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x64,0x60 irq 1 on acpi0
atkbd0: <AT Keyboard> flags 0x1 irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
sio0 port 0x3f8-0x3ff irq 4 on acpi0
sio0: type 16550A, console
sio1 port 0x2f8-0x2ff irq 3 on acpi0
sio1: type 16550A
fdc0: <Enhanced floppy controller (i82077, NE72065 or clone)> port 0x3f7,0x3f0-0x3f5 irq 6 drq 2 on acpi0
fdc0: FIFO enabled, 8 bytes threshold
orm0: <Option ROMs> at iomem 0xe0000-0xe3fff,0xc9000-0xccfff,0xc8000-0xc8fff,0xc0000-0xc7fff on isa0
pmtimer0 on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x100>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounters tick every 1.000 msec
ipfw2 initialized, divert disabled, rule-based forwarding enabled, default to accept, logging disabled
aacd0: <RAID 5> on aac0
aacd0: 419994MB (860149632 sectors)
ses0 at aacp0 bus 0 target 8 lun 0
ses0: <SUPER GEM359 REV001 1.09> Fixed unknown SCSI-2 device
ses0: 3.300MB/s transfers
ses0: SAF-TE Compliant Device
ses1 at aacp1 bus 0 target 8 lun 0
ses1: <SUPER GEM359 REV001 1.09> Fixed unknown SCSI-2 device
ses1: 3.300MB/s transfers
ses1: SAF-TE Compliant Device
pass0 at aacp0 bus 0 target 0 lun 0
pass0: <IBM IC35L146UCDY10-0 S29A> Fixed unknown SCSI-3 device
pass0: 160.000MB/s transfers (80.000MHz, offset 127, 16bit)
pass1 at aacp0 bus 0 target 1 lun 0
pass1: <IBM IC35L146UCDY10-0 S29A> Fixed unknown SCSI-3 device
pass1: 160.000MB/s transfers (80.000MHz, offset 127, 16bit)
pass2 at aacp0 bus 0 target 2 lun 0
pass2: <IBM IC35L146UCDY10-0 S29A> Fixed unknown SCSI-3 device
pass2: 160.000MB/s transfers (80.000MHz, offset 127, 16bit)
pass3 at aacp0 bus 0 target 3 lun 0
pass3: <IBM IC35L146UCDY10-0 S29A> Fixed unknown SCSI-3 device
pass3: 160.000MB/s transfers (80.000MHz, offset 127, 16bit)
pass5 at aacp1 bus 0 target 0 lun 0
pass5: <IBM IC35L146UCDY10-0 S27E> Fixed unknown SCSI-3 device
pass5: 160.000MB/s transfers (80.000MHz, offset 127, 16bit)
pass6 at aacp1 bus 0 target 1 lun 0
pass6: <IBM IC35L146UCDY10-0 S27E> Fixed unknown SCSI-3 device
pass6: 160.000MB/s transfers (80.000MHz, offset 127, 16bit)
pass7 at aacp1 bus 0 target 2 lun 0
pass7: <IBM IC35L146UCDY10-0 S27E> Fixed unknown SCSI-3 device
pass7: 160.000MB/s transfers (80.000MHz, offset 127, 16bit)
pass8 at aacp1 bus 0 target 3 lun 0
pass8: <IBM IC35L146UCDY10-0 S27E> Fixed unknown SCSI-3 device
pass8: 160.000MB/s transfers (80.000MHz, offset 127, 16bit)
SMP: AP CPU #3 Launched!
SMP: AP CPU #1 Launched!
SMP: AP CPU #2 Launched!
Mounting root from ufs:/dev/aacd0s1a
WARNING: / was not properly dismounted
WARNING: /usr was not properly dismounted
em0: Link is up 100 Mbps Half Duplex
em1: Link is up 100 Mbps Full Duplex
[-- Attachment #3 --]
5@ cdata.asl =ioH_AއdlZIgM;8vV俿!}e$ȮVUoOÅR,g:ߎww+lq~kSl˿گא7el>(VwZKq>yz
5pet+]@&x;"@_n8p1EWfV~Gm_Os[
o9KDMxq1ؚׯkm.zu=|/W+*\ cD`>\8#Ɩ=Лk5|+$Ϲi&ZxxiGo4$~C)[],F^W'SO{=xm_[Jޚ{Zѽ~CkqCKow_gӋOT̖Z.{bϽy>pǨPDž55&x60΅=,.sz2] %9nk>^gdg۫P;HqN;_݀C@_.Η$Oۋ_qn_}ׁnsqGk~47 >0Ӏó5k@yAl@f߲eR0+L|F\bZ3h
<ЩOkW_-WЖgzvM5'4Q*Sc`v:Scbn9Dh'BTPZz^hF]7I=&7{d|Nwu"ʿ?orׯ9l0~DMor,֫}_?4BGB4oomFǣAZtuPPa>I$IՓ4
mm3iM봙vayӶ|ͧ,jr̙(p2J /_b/?6q
݆bzX><_'k[):6ԶfDnr㗯gţ㝢4kw1̔_VD۾EݬK-R$-]E[U=ۦܱ/ʛHo @>:Pe:j-)mTUW˝N%x߀H̼$%څsw$No"~}e]^OitqyߵۖBo>AM
{of0omƷV6=$d,\gṔVp
zϫVajxo"h$rx鯑{믾W__-b}fo~!<MUIz7ZqS ?[T/!-ףI~TDHv}A@W'eSr:׃a3nӟ$LD~1p8Kډ# c'c'\p_p9v}1v}1v c'c'<^w$lҿjg3so>_)o.%o)sZޮϿEo_Vˋh}bQH qd{1Kbu1X}PBVòcyuMP4B (1O1I[
qäQP%!{Go:;kG6xrӸ\#{y\"YAMYTd#<R^N-%`JyotUCCdL9X#H)D8\ rOUC}
A̍RPqXX!(9a)8W!ܓBBs*yZb>R
ႅp9L#8\ rOUW!(DAGF!69!lpc)pS2$0*x
A.E^!Bt`Ū+CS8R
Ua¨Bs*a|dK]I+h%}~H)DBfA.E^!̲3BH:%8+G ,!W-=
;Qȓ eDiOʓ$TMZ6ƒT ,Z@RvւO-ȥȫE #j?jXjav0Z`qBثhW`-ȹqBЫh|drWjmX*WZGXj9,Z*E!߂\ZtZҾ}Bڷb,Y:KR-z&`qBطTa-
RPԢ-fq};IOMg<ۖӁ.VtyPm &M f>e$/O&$~
o JM!OI/
U^)6OdoE_$ԊW+ԥjx&8Q0<7Sê|szM2r6 Z@hx#z
P`)ӑm^JHL Od*LViD H6v{^"fd\QQPw;y9$>+NT6 }Z8ƖgKK=PpR5,BL=P襞E(8g
m5(0<z:2zjꩅ@
GjY@-3, Izञ(jY.^Y'+ۣg@'QhR(rVK=SOy
L
7 .ޝA`E#RjbTB9t1p?`q;*;ۂD<t,8SX/S
Eeb ӣ}mg,IHWUgU'AzZO5tH8yVvLJa{yõ:oMxSs_M=4ƻ[O:]|F~y~"jFʷڏE<5S^E+~骩gbU!\{O'z2$rYF^ihO'SM=EƩUh{?6.3RWJcycڶUrԳмc|
r%+1}k@ms`{6 j' l փ1!lZejю-ۜ;r{|9r8rsp
1^*+fh3625!|[r_l4i-limF峲Y
R2wPAlƍ
B-lh6;Fbd aQ>tJa1h"q-T UTEr#@%RPWH_Z_7Q-ƸVy݅5)z|: iP!`WQU;=(>g{ga'z=îؓYy;iXV><+_>,nʋVIXk_XN\V9<+_źQQ+Oli~Zy7a jy&Vm^Zy7iXV=<+_~^Sv5V~?5<+5~
ˇGAݭ Chz=ރ\|G?{{';=M!'ރ&g{4=NGAݭ89ޣ]}Dس4{LzӦ|i({L'#aLx
~T/2/cd{(p2(8X_Qh%cA4.=Cwxy6
<
t
R,"TZS{Z\$#-ڑe'So.X#^<<<i&|8k=r/xrWQ!?-MqWޜw(rmt>6tD+ -oSțʒ7eĕe0vgm3p%]ݕ=9$ S碽&l5Kb4Y`ZX:LZ}ʫEfOѹt|w|l{ɢ厬9I|Mh=&_&Nk4q=2
- V
0zb7+2,r'=ᘫ6խ@9{[']?Cn[*K@6.eju0y6m?QҳN!!(wq89@
@W߱dY[?℣V8YZiFU+T,Jt g#HcɈbr۪F,'8 ykg
0EAXZ$1$e =Dh_qE
2+Ax@CC^tl61l[lF48G0lຐ |mEscTypꋐ WLm<G~2l ^OEG z_+nӿzG-F g~/$ Af0W5tzXpP`?`xi@XpTAŚ#`B֠P.h.hJwww'/Y`27*R'Sn7,C`j,1D."bfLx1g#i I8iU! D0 9VǓID8Oy$gJ8hy4JM8<Np a78%Wk< 5&ׄp^kyM81E{ἒaZyL$8wAPh^//C1K5"8RqA {e%:7N/RQ\ MAy`S )E,@90Z
8Q56( 8sL&4T 80uu+I|4dЎ2uW&|ezw!~7q!xN~(TotԳDuVP+b`bEb5s1ע>oBM<AoŷJjo1y4oMgd#G*`ϱ0N>#-fUUMM,\Xu-~%\ZJå@{bzYePȵd}-ٕ1:"ZBK+I訂a#uLZjﹲ>N#.vdhGڑmGvvdoQvT-O 6c{Xզ%/ m>PhB#1 92NE?-7)Rn$&J ӄMr2( $# St k2ɨd*e\Q9#J"cSH>sűFud-:A4C;@@!;snh"ZnϠUm=1/F5EF56HN(ZͮjiWAEnp*ٓh^Yzs؈T (ףEÂ/U vR@ ϡh@(,$;(s!
dYmi籕YTj߲:!Nӂp[Pq gB
ݻZ M(YA{]<}s]8"]bSb*$MU+EN8E&8KEf$I-aZB&!MBh) r6 %%lBJ$I-/ْ>((UhHEh@M#}ΰR{GXYޙrll&ƊLisl6ƊLusll9Y-yݒ=$0-K9ZeC3,9qUrA-;//\ߋrY͉Гk[ovq8#a`fTym-HnJshռe<hA{$V~*Im':{5NR/gq_Nb-d8BsHp0 4~_Qף]u0b_T䇒wgʋ?ep'|,Qb?^_k^WU |耥HLsA_K%Ţava
1GNmJ?E9CFTF Mh}6s1ږx t#Dp =ұ>,4h#
R2"_dK5]QsTQ5TH |X鵘-ZgQ
zDK2(o`lB wk
-[ɦZV0UJtՔ `=bԸx= Cd3[A)qQ(o|CGS̞dpRč|C]9
v5ʱ-&hecs!Bd<~-EfLl}"
dR y<n#ib`¬|²,{J`u cbE_\9xp-
$j gXHy1*ўsɌ[SjQCeh_SB 1ϼ^
MVtaIeXXɝ/nQqٱV#[_7V*^*طD\(} dUjNb;
XQvPr䙒̫#b D̥M7=&Qj8o슗
o7?
ĥ^m*R="'[m]
D)e) Ɏd>pu+*z>HC O!|'7r/zFql*a8,5e>C0*纍Tsc#HENӳ3RO9"3"i)R$%F9"[rQWz(#M>
d!!q)ڵۿR`Q)G9aVnv4wƢuw5Jɀ7:[L@bi2"͈]O`(JJZ-4pN3\^-.;g̓l7)My",`W.S;_<1
dF~ݿ-&9D8>CZrBwSgN%Hm0F[047uƩD0.FhP'/L;EKB7ITܤ%݆ד{Д\Lfu7o
89zug4#.-8.%B4-GQ.Z`>X`
&>~xS-%͙<tw=E#(G]c}桙<g,.XME|:pri֜Y=(QB
@(tX);]tg1j)>4ooED,#ٹt)fpNΓ2Rfb:8?NȘ2@v2<]
b[ZpϬg2SR0Tm\Jj2C9חn{lO<QY.!&1]|j
c@JgM3;|}KPb ,@Le8"@+PD
D@QcI UqxDX풱EdyZ2Y[MLLy1k&ʰCvCnw'd )h Ͳ;wkuW\1в#^
b4Ҭ>
yЀaqB145l>K2
#oF$4i,DŽ^$hD
It{L&'AD4KD(+(#ni,F3`""yNDbA?iF琺"
.QpS8 3[:)S;Q:P;Q"A(Ս(*fbO( +u7͎/K<y8J$+]NS
ܤRѡx8`FnʘBc,ld61e++9^!fъKSejeON?pV&
vQlakqZHHbыWy
#lc)*@Ek3P}*uVĤ;nwԮ(/Aޖ`[S6a2ul.e)oM2XɈ:߱(PN&!w)8շՕ% ' *fȲJd'"sWZkmZZkbW$W7O3ّ&Ѯ{pJ_a\r/5Jm#"r#j{wUK%u&wc2DGR).)D FrolX05R9ᙫg!k5b
'u?h+3./p!k,W!i#5)~cD, @ȈFf v=@#<;Bi7jQ*(
VU r` U`݉NL+@E#d 'YɅTL8T'G5v>fnIsmX&
v'lAY4VY exe%nrtHYvo"_vք<}
Ȏ r 8yl Mے
| e ^V>\~ )DNf rKOU"tQ#t;@6 ݁d;b Rt^{(nv%7H 3l]-E\< Q`s# Q TI|؉/6@j~uUhݳǟ-1@]ӣp@]iH<X)ȯ]bV]gIbcՙ$u:SQH|odaSOJw)ffH-yeN-EoT2u@ƈ}2P1PMHgccO4ei|._h|ׅ5>Y;˲zN@cGpB;::%='L|3>[澺5x'_cp<<Y?y͕w4 ީ39rf.J;zuvu~uyu@
D Ǚ}~n,"E2_ "j!ܴHbQ+E[LÉLȢqFo&b& af7@L? #HImRlb$j DLT~>>=peos;`J
kB>e(XZ7N:`Mfث\OEF0?vrG^Eu*% KٳP˃xW\fu?sȷȟmYN?8=ꄛbsbHOL@S~U@Pb6sbwi 4H\c)F `MD&܄{?FhK-@Y1F#4ˊ#FhBLAq؈%_:QSg/'h.'%$ڝIw)I90)c]RAS.qH}I?bF7&"%HI;XM+ }i{{{y^TRc>TKLJcߥ7<0)cȡ$</)cMKTWpM0Z`ٜ,K M&}t;``v$~BK%5esIfٜ@Rs:CXz>Dtp+",ˈ{DD"xzZ4$<-ش.;$M>56V@hbӪV T<FRI;{0a>,Hi$4Kvmf=vY
,90)c.FrR5
Y头/jIi-iP*'%cޢJoQ0-
Ix>vva|$=&_Њz_ЊzZ],@Łޗgv~\!>z{1pa-žB @3Hwlآ[$[Hzth
QD QD "_(|&z *a9@^/TuT痌gMlnkp10*lK^yzY?..
1k=غ7-l[ov5GӸ,r0eGeͪA dd
"r T}z!&h[RR7JOTBJM*iQjF~YNu~y4qg@o,`gzB{»ᕿRpV8\[.cB)˖6V!ut%Dʛmbdy>}anԖhjG#Eۖm&Jmh2cDm'#hu0k0L,.S2\C 6`smޙqi'h$2m>nL7OfdB:%pm
ZJ0ۖb''9bg-3c>s'X GhYHH;&NTU̾ms-`e¢=FMέ5NbL**|x45ӧ'ydH0w;މ;i pfC
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?FE045D4D9F7AED4CBFF1B3B813C85337051D8FE6>
