Date: Thu, 07 Oct 2004 10:54:55 -0700 From: Sean McNeil <sean@mcneil.com> To: Kris Kennaway <kris@obsecurity.org> Cc: freebsd-current@freebsd.org Subject: Re: current/amd64 panic is back Message-ID: <1097171694.4190.18.camel@server> In-Reply-To: <20041007173501.GA7114@xor.obsecurity.org> References: <1097170117.1288.1.camel@server> <20041007173501.GA7114@xor.obsecurity.org>
next in thread | previous in thread | raw e-mail | index | archive | help
--=-vsPaEYHeUJ83YYtKVE4o
Content-Type: text/plain
Content-Transfer-Encoding: quoted-printable
On Thu, 2004-10-07 at 10:35, Kris Kennaway wrote:
> On Thu, Oct 07, 2004 at 10:28:37AM -0700, Sean McNeil wrote:
> > First unsolicited crash for me in a long time :)
>=20
> Traceback, etc.
Sorry, this was a bad report. Thought it might be a regression in the
preemption stuff, but still I should have provided more info than I
did. Let me give what I can and you can let me know if there is
anything more I can provide. I get a long string of panic info but no
core dump or drop into debugger. Just a reboot. I tried to look at the
address in the debugger and this is what I get:
(gdb) list *0xffffffff80351940
0xffffffff80351940 is in m_copym (/usr/src/sys/kern/uipc_mbuf.c:373).
368 MBUF_CHECKSLEEP(wait);
369 if (off =3D=3D 0 && m->m_flags & M_PKTHDR)
370 copyhdr =3D 1;
371 while (off > 0) {
372 KASSERT(m !=3D NULL, ("m_copym, offset > size of mb=
uf chain"));
373 if (off < m->m_len)
374 break;
375 off -=3D m->m_len;
376 m =3D m->m_next;
377 }
I think it goes off into lala land after that. Here is the full panic.
Oct 7 09:52:31 server syslogd: kernel boot file is /boot/kernel/kernel
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel: Fatal trap 12: page fault while in kernel mo=
de
Oct 7 09:52:31 server kernel: fault virtual address =3D 0x18
Oct 7 09:52:31 server kernel: fault code =3D supervisor read, page not pr=
esent
Oct 7 09:52:31 server kernel: instruction pointer =3D 0x8:0xffffffff803519=
40
Oct 7 09:52:31 server kernel: stack pointer =3D 0x10:0xffffffffb1c=
1a5f0
Oct 7 09:52:31 server kernel: frame pointer =3D 0x10:0xffffffffb1c=
1a650
Oct 7 09:52:31 server kernel: code segment =3D base 0x0, limit 0xfffff, t=
ype 0x1b
Oct 7 09:52:31 server kernel: =3D DPL 0, pres 1, long 1, def32 0, gran 1
Oct 7 09:52:31 server kernel: processor eflags =3D interrupt enabled, resu=
me, IOPL =3D 0
Oct 7 09:52:31 server kernel: current process =3D 262 (natd)
Oct 7 09:52:31 server kernel: trap number =3D 12
Oct 7 09:52:31 server kernel: panic: page fault
Oct 7 09:52:31 server kernel: KDB: enter: panic
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel: Fatal trap 3: breakpoint instruction fault w=
hile in kernel mode
Oct 7 09:52:31 server kernel: instruction pointer =3D 0x8:0xffffffff8032e1=
4f
Oct 7 09:52:31 server kernel: stack pointer =3D 0x10:0xffffffffb1c=
1a310
Oct 7 09:52:31 server kernel: frame pointer =3D 0x10:0xffffffffb1c=
1a320
Oct 7 09:52:31 server kernel: code segment =3D base 0x0, limit 0xfffff, t=
ype 0x1b
Oct 7 09:52:31 server kernel: =3D DPL 0, pres 1, long 1, def32 0, gran 1
Oct 7 09:52:31 server kernel: processor eflags =3D interrupt enabled, IOPL=
=3D 0
Oct 7 09:52:31 server kernel: current process =3D 262 (natd)
Oct 7 09:52:31 server kernel: trap number =3D 3
Oct 7 09:52:31 server kernel: panic: breakpoint instruction fault
Oct 7 09:52:31 server kernel: KDB: enter: panic
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel: Fatal trap 3: breakpoint instruction fault w=
hile in kernel mode
Oct 7 09:52:31 server kernel: instruction pointer =3D 0x8:0xffffffff8032e1=
4f
Oct 7 09:52:31 server kernel: stack pointer =3D 0x10:0xffffffffb1c=
1a090
Oct 7 09:52:31 server kernel: frame pointer =3D 0x10:0xffffffffb1c=
1a0a0
Oct 7 09:52:31 server kernel: code segment =3D base 0x0, limit 0xfffff, t=
ype 0x1b
Oct 7 09:52:31 server kernel: =3D DPL 0, pres 1, long 1, def32 0, gran 1
Oct 7 09:52:31 server kernel: processor eflags =3D IOPL =3D 0
Oct 7 09:52:31 server kernel: current process =3D 262 (natd)
Oct 7 09:52:31 server kernel: trap number =3D 3
Oct 7 09:52:31 server kernel: panic: breakpoint instruction fault
Oct 7 09:52:31 server kernel: KDB: enter: panic
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel: Fatal trap 3: breakpoint instruction fault w=
hile in kernel mode
Oct 7 09:52:31 server kernel: instruction pointer =3D 0x8:0xffffffff8032e1=
4f
Oct 7 09:52:31 server kernel: stack pointer =3D 0x10:0xffffffffb1c=
19e10
Oct 7 09:52:31 server kernel: frame pointer =3D 0x10:0xffffffffb1c=
19e20
Oct 7 09:52:31 server kernel: code segment =3D base 0x0, limit 0xfffff, t=
ype 0x1b
Oct 7 09:52:31 server kernel: =3D DPL 0, pres 1, long 1, def32 0, gran 1
Oct 7 09:52:31 server kernel: processor eflags =3D IOPL =3D 0
Oct 7 09:52:31 server kernel: current process =3D 262 (natd)
Oct 7 09:52:31 server kernel: trap number =3D 3
Oct 7 09:52:31 server kernel: panic: breakpoint instruction fault
Oct 7 09:52:31 server kernel: KDB: enter: panic
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel: Fatal trap 3: breakpoint instruction fault w=
hile in kernel mode
Oct 7 09:52:31 server kernel: instruction pointer =3D 0x8:0xffffffff8032e1=
4f
Oct 7 09:52:31 server kernel: stack pointer =3D 0x10:0xffffffffb1c=
19b90
Oct 7 09:52:31 server kernel: frame pointer =3D 0x10:0xffffffffb1c=
19ba0
Oct 7 09:52:31 server kernel: code segment =3D base 0x0, limit 0xfffff, t=
ype 0x1b
Oct 7 09:52:31 server kernel: =3D DPL 0, pres 1, long 1, def32 0, gran 1
Oct 7 09:52:31 server kernel: processor eflags =3D IOPL =3D 0
Oct 7 09:52:31 server kernel: current process =3D 262 (natd)
Oct 7 09:52:31 server kernel: trap number =3D 3
Oct 7 09:52:31 server kernel: panic: breakpoint instruction fault
Oct 7 09:52:31 server kernel: KDB: enter: panic
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel: Fatal trap 3: breakpoint instruction fault w=
hile in kernel mode
Oct 7 09:52:31 server kernel: instruction pointer =3D 0x8:0xffffffff8032e1=
4f
Oct 7 09:52:31 server kernel: stack pointer =3D 0x10:0xffffffffb1c=
19910
Oct 7 09:52:31 server kernel: frame pointer =3D 0x10:0xffffffffb1c=
19920
Oct 7 09:52:31 server kernel: code segment =3D base 0x0, limit 0xfffff, t=
ype 0x1b
Oct 7 09:52:31 server kernel: =3D DPL 0, pres 1, long 1, def32 0, gran 1
Oct 7 09:52:31 server kernel: processor eflags =3D IOPL =3D 0
Oct 7 09:52:31 server kernel: current process =3D 262 (natd)
Oct 7 09:52:31 server kernel: trap number =3D 3
Oct 7 09:52:31 server kernel: panic: breakpoint instruction fault
Oct 7 09:52:31 server kernel: KDB: enter: panic
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel: Fatal trap 3: breakpoint instruction fault w=
hile in kernel mode
Oct 7 09:52:31 server kernel: instruction pointer =3D 0x8:0xffffffff8032e1=
4f
Oct 7 09:52:31 server kernel: stack pointer =3D 0x10:0xffffffffb1c=
19690
Oct 7 09:52:31 server kernel: frame pointer =3D 0x10:0xffffffffb1c=
196a0
Oct 7 09:52:31 server kernel: code segment =3D base 0x0, limit 0xfffff, t=
ype 0x1b
Oct 7 09:52:31 server kernel: =3D DPL 0, pres 1, long 1, def32 0, gran 1
Oct 7 09:52:31 server kernel: processor eflags =3D IOPL =3D 0
Oct 7 09:52:31 server kernel: current process =3D 262 (natd)
Oct 7 09:52:31 server kernel: trap number =3D 3
Oct 7 09:52:31 server kernel: panic: breakpoint instruction fault
Oct 7 09:52:31 server kernel: KDB: enter: panic
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel: Fatal trap 3: breakpoint instruction fault w=
hile in kernel mode
Oct 7 09:52:31 server kernel: instruction pointer =3D 0x8:0xffffffff8032e1=
4f
Oct 7 09:52:31 server kernel: stack pointer =3D 0x10:0xffffffffb1c=
19410
Oct 7 09:52:31 server kernel: frame pointer =3D 0x10:0xffffffffb1c=
19420
Oct 7 09:52:31 server kernel: code segment =3D base 0x0, limit 0xfffff, t=
ype 0x1b
Oct 7 09:52:31 server kernel: =3D DPL 0, pres 1, long 1, def32 0, gran 1
Oct 7 09:52:31 server kernel: processor eflags =3D IOPL =3D 0
Oct 7 09:52:31 server kernel: current process =3D 262 (natd)
Oct 7 09:52:31 server kernel: trap number =3D 3
Oct 7 09:52:31 server kernel: panic: breakpoint instruction fault
Oct 7 09:52:31 server kernel: KDB: enter: panic
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel: Fatal trap 3: breakpoint instruction fault w=
hile in kernel mode
Oct 7 09:52:31 server kernel: instruction pointer =3D 0x8:0xffffffff8032e1=
4f
Oct 7 09:52:31 server kernel: stack pointer =3D 0x10:0xffffffffb1c=
19190
Oct 7 09:52:31 server kernel: frame pointer =3D 0x10:0xffffffffb1c=
191a0
Oct 7 09:52:31 server kernel: code segment =3D base 0x0, limit 0xfffff, t=
ype 0x1b
Oct 7 09:52:31 server kernel: =3D DPL 0, pres 1, long 1, def32 0, gran 1
Oct 7 09:52:31 server kernel: processor eflags =3D IOPL =3D 0
Oct 7 09:52:31 server kernel: current process =3D 262 (natd)
Oct 7 09:52:31 server kernel: trap number =3D 3
Oct 7 09:52:31 server kernel: panic: breakpoint instruction fault
Oct 7 09:52:31 server kernel: KDB: enter: panic
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel: Fatal trap 3: breakpoint instruction fault w=
hile in kernel mode
Oct 7 09:52:31 server kernel: instruction pointer =3D 0x8:0xffffffff8032e1=
4f
Oct 7 09:52:31 server kernel: stack pointer =3D 0x10:0xffffffffb1c=
18f10
Oct 7 09:52:31 server kernel: frame pointer =3D 0x10:0xffffffffb1c=
18f20
Oct 7 09:52:31 server kernel: code segment =3D base 0x0, limit 0xfffff, t=
ype 0x1b
Oct 7 09:52:31 server kernel: =3D DPL 0, pres 1, long 1, def32 0, gran 1
Oct 7 09:52:31 server kernel: processor eflags =3D IOPL =3D 0
Oct 7 09:52:31 server kernel: current process =3D 262 (natd)
Oct 7 09:52:31 server kernel: trap number =3D 3
Oct 7 09:52:31 server kernel: panic: breakpoint instruction fault
Oct 7 09:52:31 server kernel: KDB: enter: panic
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel: Fatal trap 3: breakpoint instruction fault w=
hile in kernel mode
Oct 7 09:52:31 server kernel: instruction pointer =3D 0x8:0xffffffff8032e1=
4f
Oct 7 09:52:31 server kernel: stack pointer =3D 0x10:0xffffffffb1c=
18c90
Oct 7 09:52:31 server kernel: frame pointer =3D 0x10:0xffffffffb1c=
18ca0
Oct 7 09:52:31 server kernel: code segment =3D base 0x0, limit 0xfffff, t=
ype 0x1b
Oct 7 09:52:31 server kernel: =3D DPL 0, pres 1, long 1, def32 0, gran 1
Oct 7 09:52:31 server kernel: processor eflags =3D IOPL =3D 0
Oct 7 09:52:31 server kernel: current process =3D 262 (natd)
Oct 7 09:52:31 server kernel: trap number =3D 3
Oct 7 09:52:31 server kernel: panic: breakpoint instruction fault
Oct 7 09:52:31 server kernel: KDB: enter: panic
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel: Fatal trap 3: breakpoint instruction fault w=
hile in kernel mode
Oct 7 09:52:31 server kernel: instruction pointer =3D 0x8:0xffffffff8032e1=
4f
Oct 7 09:52:31 server kernel: stack pointer =3D 0x10:0xffffffffb1c=
18a10
Oct 7 09:52:31 server kernel: frame pointer =3D 0x10:0xffffffffb1c=
18a20
Oct 7 09:52:31 server kernel: code segment =3D base 0x0, limit 0xfffff, t=
ype 0x1b
Oct 7 09:52:31 server kernel: =3D DPL 0, pres 1, long 1, def32 0, gran 1
Oct 7 09:52:31 server kernel: processor eflags =3D IOPL =3D 0
Oct 7 09:52:31 server kernel: current process =3D 262 (natd)
Oct 7 09:52:31 server kernel: trap number =3D 3
Oct 7 09:52:31 server kernel: panic: breakpoint instruction fault
Oct 7 09:52:31 server kernel: KDB: enter: panic
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel: Fatal trap 3: breakpoint instruction fault w=
hile in kernel mode
Oct 7 09:52:31 server kernel: instruction pointer =3D 0x8:0xffffffff8032e1=
4f
Oct 7 09:52:31 server kernel: stack pointer =3D 0x10:0xffffffffb1c=
18790
Oct 7 09:52:31 server kernel: frame pointer =3D 0x10:0xffffffffb1c=
187a0
Oct 7 09:52:31 server kernel: code segment =3D base 0x0, limit 0xfffff, t=
ype 0x1b
Oct 7 09:52:31 server kernel: =3D DPL 0, pres 1, long 1, def32 0, gran 1
Oct 7 09:52:31 server kernel: processor eflags =3D IOPL =3D 0
Oct 7 09:52:31 server kernel: current process =3D 262 (natd)
Oct 7 09:52:31 server kernel: trap number =3D 3
Oct 7 09:52:31 server kernel: panic: breakpoint instruction fault
Oct 7 09:52:31 server kernel: KDB: enter: panic
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel: Fatal trap 3: breakpoint instruction fault w=
hile in kernel mode
Oct 7 09:52:31 server kernel: instruction pointer =3D 0x8:0xffffffff8032e1=
4f
Oct 7 09:52:31 server kernel: stack pointer =3D 0x10:0xffffffffb1c=
18510
Oct 7 09:52:31 server kernel: frame pointer =3D 0x10:0xffffffffb1c=
18520
Oct 7 09:52:31 server kernel: code segment =3D base 0x0, limit 0xfffff, t=
ype 0x1b
Oct 7 09:52:31 server kernel: =3D DPL 0, pres 1, long 1, def32 0, gran 1
Oct 7 09:52:31 server kernel: processor eflags =3D IOPL =3D 0
Oct 7 09:52:31 server kernel: current process =3D 262 (natd)
Oct 7 09:52:31 server kernel: trap number =3D 3
Oct 7 09:52:31 server kernel: panic: breakpoint instruction fault
Oct 7 09:52:31 server kernel: KDB: enter: panic
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel: Fatal trap 3: breakpoint instruction fault w=
hile in kernel mode
Oct 7 09:52:31 server kernel: instruction pointer =3D 0x8:0xffffffff8032e1=
4f
Oct 7 09:52:31 server kernel: stack pointer =3D 0x10:0xffffffffb1c=
18290
Oct 7 09:52:31 server kernel: frame pointer =3D 0x10:0xffffffffb1c=
182a0
Oct 7 09:52:31 server kernel: code segment =3D base 0x0, limit 0xfffff, t=
ype 0x1b
Oct 7 09:52:31 server kernel: =3D DPL 0, pres 1, long 1, def32 0, gran 1
Oct 7 09:52:31 server kernel: processor eflags =3D IOPL =3D 0
Oct 7 09:52:31 server kernel: current process =3D 262 (natd)
Oct 7 09:52:31 server kernel: trap number =3D 3
Oct 7 09:52:31 server kernel: panic: breakpoint instruction fault
Oct 7 09:52:31 server kernel: KDB: enter: panic
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel: Fatal trap 3: breakpoint instruction fault w=
hile in kernel mode
Oct 7 09:52:31 server kernel: instruction pointer =3D 0x8:0xffffffff8032e1=
4f
Oct 7 09:52:31 server kernel: stack pointer =3D 0x10:0xffffffffb1c=
18010
Oct 7 09:52:31 server kernel: frame pointer =3D 0x10:0xffffffffb1c=
18020
Oct 7 09:52:31 server kernel: code segment =3D base 0x0, limit 0xfffff, t=
ype 0x1b
Oct 7 09:52:31 server kernel: =3D DPL 0, pres 1, long 1, def32 0, gran 1
Oct 7 09:52:31 server kernel: processor eflags =3D IOPL =3D 0
Oct 7 09:52:31 server kernel: current process =3D 262 (natd)
Oct 7 09:52:31 server kernel: trap number =3D 3
Oct 7 09:52:31 server kernel: panic: breakpoint instruction fault
Oct 7 09:52:31 server kernel: KDB: enter: panic
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel: Fatal trap 3: breakpoint instruction fault w=
hile in kernel mode
Oct 7 09:52:31 server kernel: instruction pointer =3D 0x8:0xffffffff8032e1=
4f
Oct 7 09:52:31 server kernel: stack pointer =3D 0x10:0xffffffffb1c=
17d90
Oct 7 09:52:31 server kernel: frame pointer =3D 0x10:0xffffffffb1c=
17da0
Oct 7 09:52:31 server kernel: code segment =3D base 0x0, limit 0xfffff, t=
ype 0x1b
Oct 7 09:52:31 server kernel: =3D DPL 0, pres 1, long 1, def32 0, gran 1
Oct 7 09:52:31 server kernel: processor eflags =3D IOPL =3D 0
Oct 7 09:52:31 server kernel: current process =3D 262 (natd)
Oct 7 09:52:31 server kernel: trap number =3D 3
Oct 7 09:52:31 server kernel: panic: breakpoint instruction fault
Oct 7 09:52:31 server kernel: KDB: enter: panic
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel: Fatal trap 3: breakpoint instruction fault w=
hile in kernel mode
Oct 7 09:52:31 server kernel: instruction pointer =3D 0x8:0xffffffff8032e1=
4f
Oct 7 09:52:31 server kernel: stack pointer =3D 0x10:0xffffffffb1c=
17b10
Oct 7 09:52:31 server kernel: frame pointer =3D 0x10:0xffffffffb1c=
17b20
Oct 7 09:52:31 server kernel: code segment =3D base 0x0, limit 0xfffff, t=
ype 0x1b
Oct 7 09:52:31 server kernel: =3D DPL 0, pres 1, long 1, def32 0, gran 1
Oct 7 09:52:31 server kernel: processor eflags =3D IOPL =3D 0
Oct 7 09:52:31 server kernel: current process =3D 262 (natd)
Oct 7 09:52:31 server kernel: trap number =3D 3
Oct 7 09:52:31 server kernel: panic: breakpoint instruction fault
Oct 7 09:52:31 server kernel: KDB: enter: panic
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel: Fatal trap 3: breakpoint instruction fault w=
hile in kernel mode
Oct 7 09:52:31 server kernel: instruction pointer =3D 0x8:0xffffffff8032e1=
4f
Oct 7 09:52:31 server kernel: stack pointer =3D 0x10:0xffffffffb1c=
17890
Oct 7 09:52:31 server kernel: frame pointer =3D 0x10:0xffffffffb1c=
178a0
Oct 7 09:52:31 server kernel: code segment =3D base 0x0, limit 0xfffff, t=
ype 0x1b
Oct 7 09:52:31 server kernel: =3D DPL 0, pres 1, long 1, def32 0, gran 1
Oct 7 09:52:31 server kernel: processor eflags =3D IOPL =3D 0
Oct 7 09:52:31 server kernel: current process =3D 262 (natd)
Oct 7 09:52:31 server kernel: trap number =3D 3
Oct 7 09:52:31 server kernel: panic: breakpoint instruction fault
Oct 7 09:52:31 server kernel: KDB: enter: panic
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel:=20
Oct 7 09:52:31 server kernel: Fatal trap 3: breakpoint instruction fault w=
hile in kernel mode
Oct 7 09:52:31 server kernel: instruction pointer =3D 0x8:0xffffffff8032e1=
4f
Oct 7 09:52:31 server kernel: stack pointer =3D 0x10:0xffffffffb1c=
17610
Oct 7 09:52:31 server kernel: frame pointer =3D 0x10:0xffffffffb1c=
17620
Oct 7 09:52:31 server kernel: code segment =3D base 0x0, limit 0xfffff, t=
ype 0x1b
Oct 7 09:52:31 server kernel: =3D DPL 0, pres 1, long 1, def32 0, gran 1
Oct 7 09:52:31 server kernel: processor eflags =3D IOPL =3D 0
Oct 7 09:52:31 server kernel: current process =3D 262 (natd)
Oct 7 09:52:31 server kernel: trap number =3D 3
Oct 7 09:52:31 server kernel: panic: breakpoint instruction fault
Oct 7 09:52:31 server kernel: KDB: enter: panic
Oct 7 09:52:31 server kernel: Copyright (c) 1992-2004 The FreeBSD Project.
--=-vsPaEYHeUJ83YYtKVE4o
Content-Type: application/pgp-signature; name=signature.asc
Content-Description: This is a digitally signed message part
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.6 (FreeBSD)
iD8DBQBBZYLuyQsGN30uGE4RAj2bAJwNAHyZGCUGodoPbar5Sq1a05efTgCffV/u
avavGrvb1DYQw1ExuM48xaQ=
=6e8B
-----END PGP SIGNATURE-----
--=-vsPaEYHeUJ83YYtKVE4o--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1097171694.4190.18.camel>