Date: Sun, 20 Feb 2022 20:53:09 +0000 From: Michael Jung <mikej@paymentallianceintl.com> To: freebsd-current <freebsd-current@freebsd.org> Subject: New panic in main-n253273-a52d8d4a6c6: Message-ID: <b7ca5b5e7a9a4df3951a2cb2f1d63552@MAIL-HUB.pai.local>
next in thread | raw e-mail | index | archive | help
--_000_b7ca5b5e7a9a4df3951a2cb2f1d63552MAILHUBpailocal_
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
Hi!
The box was quite busy at the time. The only odd thing I am aware of and w=
hich I do
not think is related is I have not been able to expand one of my zpool's. =
ZFS sees my
added draid2:2d:10c:0s vdev but I can't seem to force zpool's expansion - m=
y bet this
is somehow related to the mirrored special device in the pool even though a=
utoexpand
is set to 'on' for the pool.
Not asking anyone to solve this, I plan on putting together a "how to repro=
duce" and
post to freebsd-fs@ but wanted to note this oddity.
--mikej
This is a unmodified GENERIC kernel.
Unread portion of the kernel message buffer:
panic: refcount 0xfffff801cc119284 wraparound
cpuid =3D 7
time =3D 1645382575
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0119a83=
c80
vpanic() at vpanic+0x17f/frame 0xfffffe0119a83cd0
panic() at panic+0x43/frame 0xfffffe0119a83d30
fdclose() at fdclose/frame 0xfffffe0119a83dc0
closefp_impl() at closefp_impl+0x77/frame 0xfffffe0119a83e00
amd64_syscall() at amd64_syscall+0x12e/frame 0xfffffe0119a83f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0119a83f30
--- syscall (6, FreeBSD ELF64, sys_close), rip =3D 0x3309a531b62a, rsp =3D =
0x3309a2802bc8, rbp =3D 0x3309a2803000 ---
KDB: enter: panic
__curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55
55 __asm("movq %%gs:%P1,%0" : "=3Dr" (td) : "n" (offsetof(str=
uct pcpu,
(kgdb) #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55
#1 doadump (textdump=3Dtextdump@entry=3D0)
at /usr/src/sys/kern/kern_shutdown.c:399
#2 0xffffffff804c86ba in db_dump (dummy=3D<optimized out>,
dummy2=3D<unavailable>, dummy3=3D<unavailable>, dummy4=3D<unavailable>)
at /usr/src/sys/ddb/db_command.c:575
#3 0xffffffff804c8572 in db_command (last_cmdp=3D<optimized out>,
cmd_table=3D<optimized out>, dopager=3Ddopager@entry=3D1)
at /usr/src/sys/ddb/db_command.c:482
#4 0xffffffff804c81cd in db_command_loop ()
at /usr/src/sys/ddb/db_command.c:535
#5 0xffffffff804cb806 in db_trap (type=3D<optimized out>, code=3D<optimize=
d out>)
at /usr/src/sys/ddb/db_main.c:270
#6 0xffffffff80c566fb in kdb_trap (type=3Dtype@entry=3D3, code=3Dcode@entr=
y=3D0,
tf=3Dtf@entry=3D0xfffffe0119a83bb0) at /usr/src/sys/kern/subr_kdb.c:733
#7 0xffffffff810e75ca in trap (frame=3D0xfffffe0119a83bb0)
at /usr/src/sys/amd64/amd64/trap.c:609
#8 <signal handler called>
#9 kdb_enter (why=3D0xffffffff812e5eaf "panic", msg=3D<optimized out>)
at /usr/src/sys/kern/subr_kdb.c:506
#10 0xffffffff80c08c50 in vpanic (
fmt=3D0xffffffff8122606d "refcount %p wraparound",
ap=3Dap@entry=3D0xfffffe0119a83d10) at /usr/src/sys/kern/kern_shutdown.=
c:908
#11 0xffffffff80c089e3 in panic (
fmt=3D0xffffffff81e8cf40 <cnputs_mtx> "\332#*\201\377\377\377\377")
at /usr/src/sys/kern/kern_shutdown.c:844
#12 0xffffffff80ba9180 in _refcount_update_saturated (count=3D0xfffff801cc1=
19284)
at /usr/src/sys/sys/refcount.h:55
#13 refcount_releasen (count=3D0xfffff801cc119284, n=3D1)
at /usr/src/sys/sys/refcount.h:154
#14 refcount_release (count=3D0xfffff801cc119284)
at /usr/src/sys/sys/refcount.h:174
#15 closef (fp=3D<optimized out>, td=3D0xfffffe00df8d0560)
at /usr/src/sys/kern/kern_descrip.c:2776
#16 0xffffffff80bad587 in closefp_impl (fdp=3D0xfffffe012b7c0430, fd=3D4,
fp=3D0xfffff801cc119280, td=3D0xfffffe00df8d0560, audit=3Dtrue)
at /usr/src/sys/kern/kern_descrip.c:1300
#17 0xffffffff810e838e in syscallenter (td=3D<optimized out>)
at /usr/src/sys/amd64/amd64/../../kern/subr_syscall.c:189
#18 amd64_syscall (td=3D0xfffffe00df8d0560, traced=3D0)
at /usr/src/sys/amd64/amd64/trap.c:1191
#19 <signal handler called>
#20 0x00003309a531b62a in ?? ()
Backtrace stopped: Cannot access memory at address 0x3309a2802bc8
(kgdb)
http://mail.mikej.com/core.txt.0
http://mail.mikej.com/info.0
http://mail.mikej.com/kernel.full.0
http://mail.mikej.com/vmcore.0
CONFIDENTIALITY NOTE: This message is intended only for the use
of the individual or entity to whom it is addressed and may
contain information that is privileged, confidential, and
exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby
notified that any dissemination, distribution or copying
of this communication is strictly prohibited. If you have
received this transmission in error, please notify us by
telephone at (502) 212-4000 or notify us at: PAI, Dept. 99,
2101 High Wickham Place, Suite 101, Louisville, KY 40245
Disclaimer
The information contained in this communication from the sender is confiden=
tial. It is intended solely for use by the recipient and others authorized =
to receive it. If you are not the recipient, you are hereby notified that a=
ny disclosure, copying, distribution or taking action in relation of the co=
ntents of this information is strictly prohibited and may be unlawful.
This email has been scanned for viruses and malware, and may have been auto=
matically archived by Mimecast, a leader in email security and cyber resili=
ence. Mimecast integrates email defenses with brand protection, security aw=
areness training, web security, compliance and other essential capabilities=
. Mimecast helps protect large and small organizations from malicious activ=
ity, human error and technology failure; and to lead the movement toward bu=
ilding a more resilient world. To find out more, visit our website.
--_000_b7ca5b5e7a9a4df3951a2cb2f1d63552MAILHUBpailocal_
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
<html><head>
<meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dus-ascii"=
>
<meta name=3D"Generator" content=3D"Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
=09{font-family:"Cambria Math";
=09panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
=09{font-family:Calibri;
=09panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
=09{margin:0in;
=09margin-bottom:.0001pt;
=09font-size:11.0pt;
=09font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
=09{mso-style-priority:99;
=09color:#0563C1;
=09text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
=09{mso-style-priority:99;
=09color:#954F72;
=09text-decoration:underline;}
pre
=09{mso-style-priority:99;
=09mso-style-link:"HTML Preformatted Char";
=09margin:0in;
=09margin-bottom:.0001pt;
=09font-size:10.0pt;
=09font-family:"Courier New";}
span.EmailStyle17
=09{mso-style-type:personal-compose;
=09font-family:"Calibri",sans-serif;
=09color:windowtext;}
span.HTMLPreformattedChar
=09{mso-style-name:"HTML Preformatted Char";
=09mso-style-priority:99;
=09mso-style-link:"HTML Preformatted";
=09font-family:"Courier New";}
.MsoChpDefault
=09{mso-style-type:export-only;
=09font-family:"Calibri",sans-serif;}
@page WordSection1
=09{size:8.5in 11.0in;
=09margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
=09{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext=3D"edit">
<o:idmap v:ext=3D"edit" data=3D"1" />
</o:shapelayout></xml><![endif]-->
<style type=3D"text/css">.style1 {font-family: "Times New Roman";}</style><=
/head><body lang=3D"EN-US" link=3D"#0563C1" vlink=3D"#954F72">
<div class=3D"WordSection1">
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">Hi!<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">The box was quite busy at the time. The only odd thin=
g I am aware of and which I do
<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">not think is related is I have not been able to expand one =
of my zpool’s. ZFS sees my<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">added draid2:2d:10c:0s vdev but I can’t seem to force=
zpool’s expansion – my bet this<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">is somehow related to the mirrored special device in the po=
ol even though autoexpand<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">is set to ‘on’ for the pool.<o:p></o:p></span><=
/p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">Not asking anyone to solve this, I plan on putting together=
a “how to reproduce” and
<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">post to freebsd-fs@ but wanted to note this oddity.<o:p></o=
:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">--mikej<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">This is a unmodified GENERIC kernel.<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">Unread portion of the kernel message buffer:<o:p></o:p></sp=
an></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">panic: refcount 0xfffff801cc119284 wraparound<o:p></o:p></s=
pan></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">cpuid =3D 7<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">time =3D 1645382575<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">KDB: stack backtrace:<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/f=
rame 0xfffffe0119a83c80<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">vpanic() at vpanic+0x17f/frame 0xfffffe0119a83cd0<o:p><=
/o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">panic() at panic+0x43/frame 0xfffffe0119a83d30<o:p></o:=
p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">fdclose() at fdclose/frame 0xfffffe0119a83dc0<o:p></o:p></s=
pan></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">closefp_impl() at closefp_impl+0x77/frame 0xfffffe0119a=
83e00<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">amd64_syscall() at amd64_syscall+0x12e/frame 0xfffffe01=
19a83f30<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">fast_syscall_common() at fast_syscall_common+0xf8/frame=
0xfffffe0119a83f30<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">--- syscall (6, FreeBSD ELF64, sys_close), rip =3D 0x3309a5=
31b62a, rsp =3D 0x3309a2802bc8, rbp =3D 0x3309a2803000 ---<o:p></o:p></span=
></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">KDB: enter: panic<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">__curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55<=
o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">55 &nb=
sp; __asm("movq %%gs:%P1,%0" : "=3Dr=
" (td) : "n" (offsetof(struct pcpu,<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">(kgdb) #0 __curthread () at /usr/src/sys/amd64/includ=
e/pcpu_aux.h:55<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">#1 doadump (textdump=3Dtextdump@entry=3D0)<o:p></o:p>=
</span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""> at /usr/src/sys/kern/kern_shutdown.c:399=
<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">#2 0xffffffff804c86ba in db_dump (dummy=3D<optimiz=
ed out>,
<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""> dummy2=3D<unavailable>, dummy=
3=3D<unavailable>, dummy4=3D<unavailable>)<o:p></o:p></span></p=
>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""> at /usr/src/sys/ddb/db_command.c:575<o:p=
></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">#3 0xffffffff804c8572 in db_command (last_cmdp=3D<=
optimized out>,
<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""> cmd_table=3D<optimized out>, =
dopager=3Ddopager@entry=3D1)<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""> at /usr/src/sys/ddb/db_command.c:482<o:p=
></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">#4 0xffffffff804c81cd in db_command_loop ()<o:p></o:p=
></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""> at /usr/src/sys/ddb/db_command.c:535<o:p=
></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">#5 0xffffffff804cb806 in db_trap (type=3D<optimize=
d out>, code=3D<optimized out>)<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""> at /usr/src/sys/ddb/db_main.c:270<o:p></=
o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">#6 0xffffffff80c566fb in kdb_trap (type=3Dtype@entry=
=3D3, code=3Dcode@entry=3D0,
<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""> tf=3Dtf@entry=3D0xfffffe0119a83bb0)=
at /usr/src/sys/kern/subr_kdb.c:733<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">#7 0xffffffff810e75ca in trap (frame=3D0xfffffe0119a8=
3bb0)<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""> at /usr/src/sys/amd64/amd64/trap.c:609<o=
:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">#8 <signal handler called><o:p></o:p></span></p=
>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">#9 kdb_enter (why=3D0xffffffff812e5eaf "panic&qu=
ot;, msg=3D<optimized out>)<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""> at /usr/src/sys/kern/subr_kdb.c:506<o:p>=
</o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">#10 0xffffffff80c08c50 in vpanic (<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""> fmt=3D0xffffffff8122606d "refcount =
%p wraparound",
<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""> ap=3Dap@entry=3D0xfffffe0119a83d10)=
at /usr/src/sys/kern/kern_shutdown.c:908<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">#11 0xffffffff80c089e3 in panic (<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""> fmt=3D0xffffffff81e8cf40 <cnputs_mtx&=
gt; "\332#*\201\377\377\377\377")<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""> at /usr/src/sys/kern/kern_shutdown.c:844=
<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">#12 0xffffffff80ba9180 in _refcount_update_saturated (count=
=3D0xfffff801cc119284)<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""> at /usr/src/sys/sys/refcount.h:55<o:p></=
o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">#13 refcount_releasen (count=3D0xfffff801cc119284, n=3D1)<o=
:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""> at /usr/src/sys/sys/refcount.h:154<o:p><=
/o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">#14 refcount_release (count=3D0xfffff801cc119284)<o:p></o:p=
></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""> at /usr/src/sys/sys/refcount.h:174<o:p><=
/o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">#15 closef (fp=3D<optimized out>, td=3D0xfffffe00df8d=
0560)<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""> at /usr/src/sys/kern/kern_descrip.c:2776=
<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">#16 0xffffffff80bad587 in closefp_impl (fdp=3D0xfffffe012b7=
c0430, fd=3D4,
<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""> fp=3D0xfffff801cc119280, td=3D0xfff=
ffe00df8d0560, audit=3Dtrue)<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""> at /usr/src/sys/kern/kern_descrip.c:1300=
<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">#17 0xffffffff810e838e in syscallenter (td=3D<optimized =
out>)<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""> at /usr/src/sys/amd64/amd64/../../kern/s=
ubr_syscall.c:189<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">#18 amd64_syscall (td=3D0xfffffe00df8d0560, traced=3D0)<o:p=
></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""> at /usr/src/sys/amd64/amd64/trap.c:1191<=
o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">#19 <signal handler called><o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">#20 0x00003309a531b62a in ?? ()<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">Backtrace stopped: Cannot access memory at address 0x3309a2=
802bc8<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New"">(kgdb)
<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""><a href=3D"http://mail.mikej.com/core.txt.0">http://mail.mi=
kej.com/core.txt.0</a><o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""><a href=3D"http://mail.mikej.com/info.0">http://mail.mikej.=
com/info.0</a><o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""><a href=3D"http://mail.mikej.com/kernel.full.0">http://mail=
.mikej.com/kernel.full.0</a><o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:8.0pt;font-family:"Cou=
rier New""><a href=3D"http://mail.mikej.com/vmcore.0">http://mail.mike=
j.com/vmcore.0</a><o:p></o:p></span></p>
<p class=3D"MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial"> </p>
<div style=3D"FONT-SIZE: 10px; BORDER-TOP: #666666 1px solid; FONT-FAMILY: =
Verdana; WIDTH: 410px; BORDER-BOTTOM: #666666 1px solid; PADDING-BOTTOM: 5p=
x; PADDING-TOP: 5px; PADDING-LEFT: 5px; PADDING-RIGHT: 5px">
CONFIDENTIALITY NOTE: This message is intended only for the use<br>
of the individual or entity to whom it is addressed and may <br>
contain information that is privileged, confidential, and <br>
exempt from disclosure under applicable law. If the reader <br>
of this message is not the intended recipient, you are hereby <br>
notified that any dissemination, distribution or copying <br>
of this communication is strictly prohibited. If you have <br>
received this transmission in error, please notify us by <br>
telephone at (502) 212-4000 or notify us at: PAI, Dept. 99, <br>
2101 High Wickham Place, Suite 101, Louisville, KY 40245<br>
<br>
<br>
<br>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
<p style=3D"FONT-SIZE: 10px; FONT-FAMILY: Verdana"></p>
</div>
</div>
<br><br><p style=3D"font-family: Verdana; font-size:10pt; color:#666666;"><=
b>Disclaimer</b></p><p style=3D"font-family: Verdana; font-size:8pt; color:=
#666666;">The information contained in this communication from the sender i=
s confidential. It is intended solely for use by the recipient and others a=
uthorized to receive it. If you are not the recipient, you are hereby notif=
ied that any disclosure, copying, distribution or taking action in relation=
of the contents of this information is strictly prohibited and may be unla=
wful.<br><br>This email has been scanned for viruses and malware, and may h=
ave been automatically archived by Mimecast, a leader in email security and=
cyber resilience. Mimecast integrates email defenses with brand protection=
, security awareness training, web security, compliance and other essential=
capabilities. Mimecast helps protect large and small organizations from ma=
licious activity, human error and technology failure; and to lead the movem=
ent toward building a more resilient world. To find out more, visit our web=
site.</p></body></html>
--_000_b7ca5b5e7a9a4df3951a2cb2f1d63552MAILHUBpailocal_--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?b7ca5b5e7a9a4df3951a2cb2f1d63552>