Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 22 Feb 2022 03:04:57 +0000
From:      Michael Jung <mikej@paymentallianceintl.com>
To:        Rob Wing <rob.fx907@gmail.com>
Cc:        Hans Petter Selasky <hps@selasky.org>, freebsd-current <freebsd-current@freebsd.org>
Subject:   RE: New panic in main-n253273-a52d8d4a6c6:
Message-ID:  <903498700a1c4b32acb8fe283e746189@MAIL-HUB.pai.local>
In-Reply-To: <CAF3%2Bn_dGf%2BA3o0PnQ28xL0RNhu5q=wyp=hsNNw9Bw3dw5bcSkw@mail.gmail.com>
References:  <b7ca5b5e7a9a4df3951a2cb2f1d63552@MAIL-HUB.pai.local> <d04c0d93-8168-f53a-a5fd-865a1f6d2486@selasky.org> <6fcc161dd23b4f7ebe7cc789f11c017e@MAIL-HUB.pai.local> <dbd20a4d-b5a3-390e-a231-8ccca4f64c70@selasky.org> <924c13764ce342cf968ef9a93699be9a@MAIL-HUB.pai.local> <719aa03f-6f34-fdf8-1258-c7e5fcf33043@selasky.org> <794fbec71b714f6ea3931b942f17e1ea@MAIL-HUB.pai.local> <CAF3%2Bn_dsm0tK6_9pSJxwMVRxxGeAzps0BSx8MvqQdgGTbTFkYw@mail.gmail.com> <CAF3%2Bn_dGf%2BA3o0PnQ28xL0RNhu5q=wyp=hsNNw9Bw3dw5bcSkw@mail.gmail.com>

index | next in thread | previous in thread | raw e-mail

[-- Attachment #1 --]
Rob:

I did not remove Hans earlier patch, but your “latest” patch applied and compiled with no errors.

I can now watch and control a TTY (v0) or a SSH session (pts/1) without crashing.

Anything else you would like me to try?

--mikej


From: Rob Wing [mailto:rob.fx907@gmail.com]
Sent: Monday, February 21, 2022 9:30 PM
To: Michael Jung <mikej@paymentallianceintl.com>
Cc: Hans Petter Selasky <hps@selasky.org>; freebsd-current <freebsd-current@freebsd.org>
Subject: Re: New panic in main-n253273-a52d8d4a6c6:

The previous attached patch should work for testing purposes, but it's incorrect if an error occurs.

The fhold() should be below FILEDESC_SUNLOCK(), this patch addresses that.

On Mon, Feb 21, 2022 at 5:18 PM Rob Wing <rob.fx907@gmail.com<mailto:rob.fx907@gmail.com>> wrote:
try the attached patch

On Mon, Feb 21, 2022 at 5:14 PM Michael Jung <mikej@paymentallianceintl.com<mailto:mikej@paymentallianceintl.com>> wrote:




CONFIDENTIALITY NOTE: This message is intended only for the use
of the individual or entity to whom it is addressed and may
contain information that is privileged, confidential, and
exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby
notified that any dissemination, distribution or copying
of this communication is strictly prohibited. If you have
received this transmission in error, please notify us by
telephone at (502) 212-4000 or notify us at: PAI, Dept. 99,
2101 High Wickham Place, Suite 101, Louisville, KY 40245


From: Michael Jung
Sent: Monday, February 21, 2022 9:06 PM
To: 'Hans Petter Selasky' <hps@selasky.org<mailto:hps@selasky.org>>; freebsd-current <freebsd-current@freebsd.org<mailto:freebsd-current@freebsd.org>>
Subject: RE: New panic in main-n253273-a52d8d4a6c6:

From: Hans Petter Selasky [mailto:hps@selasky.org]
Sent: Monday, February 21, 2022 8:34 PM
To: Michael Jung <mikej@paymentallianceintl.com<mailto:mikej@paymentallianceintl.com>>; freebsd-current <freebsd-current@freebsd.org<mailto:freebsd-current@freebsd.org>>
Subject: Re: New panic in main-n253273-a52d8d4a6c6:

On 2/22/22 00:42, Michael Jung wrote:
> Hi:
>
> I was trying to remember what I did that was odd when this crash occurred then it
> hit me. You can repeat this panic by doing:
>
> # watch -I -W pts/0
>
> Here is another panic that happened write after issuing "watch" for comparison.
>
> http://mail.mikej.com/core.txt.1<http://mail.mikej.com/core.txt.1>;
>
> http://mail.mikej.com/info.1<http://mail.mikej.com/info.1>;
>
> http://mail.mikej.com/vmcore.1<http://mail.mikej.com/vmcore.1>;
>

I also need your kernel and debug kernel to fully debug this.

1) Do ssh to machine.
2) watch -i -W pts/0 (does not panic over here)

Can you explain what step 1 is? An scp ?

Refcount is -1.
f_count = 0xffffffff

f_data = 0xfffff800158b0400

In your KGDB, can you enter:

info 0xffffffff81b052d0

Does the attached patch make any difference?

--HPS


So sorry, yes step one, ssh to machine….

Even open a second console on the computer, no SSH and do “watch –I  -W v0” it panics.

Example of “watch –I –W v0” for comparison – kernel/kernel.full have not changed since .2

http://mail.mikej.com/core.txt.3<http://mail.mikej.com/core.txt.3>;

http://mail.mikej.com/info.3<http://mail.mikej.com/info.3>;

http://mail.mikej.com/vmcore.3<http://mail.mikej.com/vmcore.3>;





Disclaimer

The information contained in this communication from the sender is confidential. It is intended solely for use by the recipient and others authorized to receive it. If you are not the recipient, you are hereby notified that any disclosure, copying, distribution or taking action in relation of the contents of this information is strictly prohibited and may be unlawful.

This email has been scanned for viruses and malware, and may have been automatically archived by Mimecast, a leader in email security and cyber resilience. Mimecast integrates email defenses with brand protection, security awareness training, web security, compliance and other essential capabilities. Mimecast helps protect large and small organizations from malicious activity, human error and technology failure; and to lead the movement toward building a more resilient world. To find out more, visit our website.

Disclaimer

The information contained in this communication from the sender is confidential. It is intended solely for use by the recipient and others authorized to receive it. If you are not the recipient, you are hereby notified that any disclosure, copying, distribution or taking action in relation of the contents of this information is strictly prohibited and may be unlawful.

This email has been scanned for viruses and malware, and may have been automatically archived by Mimecast, a leader in email security and cyber resilience. Mimecast integrates email defenses with brand protection, security awareness training, web security, compliance and other essential capabilities. Mimecast helps protect large and small organizations from malicious activity, human error and technology failure; and to lead the movement toward building a more resilient world. To find out more, visit our website.

[-- Attachment #2 --]
<html><head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
	{font-family:"Cambria Math";
	panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
	{font-family:Calibri;
	panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
	{font-family:Verdana;
	panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
	{margin:0in;
	margin-bottom:.0001pt;
	font-size:12.0pt;
	font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
	{mso-style-priority:99;
	color:blue;
	text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
	{mso-style-priority:99;
	color:purple;
	text-decoration:underline;}
p
	{mso-style-priority:99;
	mso-margin-top-alt:auto;
	margin-right:0in;
	mso-margin-bottom-alt:auto;
	margin-left:0in;
	font-size:12.0pt;
	font-family:"Times New Roman",serif;}
span.EmailStyle18
	{mso-style-type:personal;
	font-family:"Calibri",sans-serif;
	color:#1F497D;}
span.EmailStyle19
	{mso-style-type:personal-compose;
	font-family:"Calibri",sans-serif;
	color:windowtext;}
.MsoChpDefault
	{mso-style-type:export-only;
	font-family:"Calibri",sans-serif;}
@page WordSection1
	{size:8.5in 11.0in;
	margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
	{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<style type="text/css">.style1 {font-family: "Times New Roman";}</style></head><body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D">Rob:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D"><o:p>&nbsp;</o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D">I did not remove Hans earlier patch, but your “latest” patch applied and compiled with no errors.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D"><o:p>&nbsp;</o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D">I can now watch and control a TTY (v0) or a SSH session (pts/1) without crashing.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D"><o:p>&nbsp;</o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D">Anything else you would like me to try?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D"><o:p>&nbsp;</o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D">--mikej<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D"><o:p>&nbsp;</o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D"><o:p>&nbsp;</o:p></span></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif"> Rob Wing [mailto:rob.fx907@gmail.com]
<br>
<b>Sent:</b> Monday, February 21, 2022 9:30 PM<br>
<b>To:</b> Michael Jung &lt;mikej@paymentallianceintl.com&gt;<br>
<b>Cc:</b> Hans Petter Selasky &lt;hps@selasky.org&gt;; freebsd-current &lt;freebsd-current@freebsd.org&gt;<br>
<b>Subject:</b> Re: New panic in main-n253273-a52d8d4a6c6:<o:p></o:p></span></p>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
<div>
<div>
<p class="MsoNormal">The previous attached patch should work for testing purposes, but it's incorrect if an error occurs.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
</div>
<div>
<p class="MsoNormal">The fhold() should be below FILEDESC_SUNLOCK(), this patch addresses that.<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
<div>
<div>
<p class="MsoNormal">On Mon, Feb 21, 2022 at 5:18 PM Rob Wing &lt;<a href="mailto:rob.fx907@gmail.com">rob.fx907@gmail.com</a>&gt; wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<p class="MsoNormal">try the attached patch<o:p></o:p></p>
</div>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
<div>
<div>
<p class="MsoNormal">On Mon, Feb 21, 2022 at 5:14 PM Michael Jung &lt;<a href="mailto:mikej@paymentallianceintl.com" target="_blank">mikej@paymentallianceintl.com</a>&gt; wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D">&nbsp;</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D">&nbsp;</span><o:p></o:p></p>
<div>
<p><span style="font-size:10.0pt;font-family:&quot;Arial&quot;,sans-serif">&nbsp;<o:p></o:p></span></p>
<div style="border-top:solid #666666 1.0pt;border-left:none;border-bottom:solid #666666 1.0pt;border-right:none;padding:4.0pt 0in 4.0pt 0in">
<p class="MsoNormal" style="margin-bottom:12.0pt"><span style="font-size:7.5pt;font-family:&quot;Verdana&quot;,sans-serif">CONFIDENTIALITY NOTE: This message is intended only for the use<br>
of the individual or entity to whom it is addressed and may <br>
contain information that is privileged, confidential, and <br>
exempt from disclosure under applicable law. If the reader <br>
of this message is not the intended recipient, you are hereby <br>
notified that any dissemination, distribution or copying <br>
of this communication is strictly prohibited. If you have <br>
received this transmission in error, please notify us by <br>
telephone at (502) 212-4000 or notify us at: PAI, Dept. 99, <br>
2101 High Wickham Place, Suite 101, Louisville, KY 40245<br>
<br>
<br>
<o:p></o:p></span></p>
</div>
</div>
<div>
<div style="border:none;border-top:solid windowtext 1.0pt;padding:3.0pt 0in 0in 0in;border-color:currentcolor currentcolor">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif"> Michael Jung
<br>
<b>Sent:</b> Monday, February 21, 2022 9:06 PM<br>
<b>To:</b> 'Hans Petter Selasky' &lt;<a href="mailto:hps@selasky.org" target="_blank">hps@selasky.org</a>&gt;; freebsd-current &lt;<a href="mailto:freebsd-current@freebsd.org" target="_blank">freebsd-current@freebsd.org</a>&gt;<br>
<b>Subject:</b> RE: New panic in main-n253273-a52d8d4a6c6:</span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">&nbsp;<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif"> Hans Petter Selasky [<a href="mailto:hps@selasky.org" target="_blank">mailto:hps@selasky.org</a>]
<br>
<b>Sent:</b> Monday, February 21, 2022 8:34 PM<br>
<b>To:</b> Michael Jung &lt;<a href="mailto:mikej@paymentallianceintl.com" target="_blank">mikej@paymentallianceintl.com</a>&gt;; freebsd-current &lt;<a href="mailto:freebsd-current@freebsd.org" target="_blank">freebsd-current@freebsd.org</a>&gt;<br>
<b>Subject:</b> Re: New panic in main-n253273-a52d8d4a6c6:</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">&nbsp;<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">On 2/22/22 00:42, Michael Jung wrote:<br>
&gt; Hi:<br>
&gt; <br>
&gt; I was trying to remember what I did that was odd when this crash occurred then it<br>
&gt; hit me. You can repeat this panic by doing:<br>
&gt; <br>
&gt; # watch -I -W pts/0<br>
&gt; <br>
&gt; Here is another panic that happened write after issuing &quot;watch&quot; for comparison.<br>
&gt; <br>
&gt; <a href="http://mail.mikej.com/core.txt.1" target="_blank">
http://mail.mikej.com/core.txt.1</a><br>;
&gt; <br>
&gt; <a href="http://mail.mikej.com/info.1" target="_blank">
http://mail.mikej.com/info.1</a><br>;
&gt; <br>
&gt; <a href="http://mail.mikej.com/vmcore.1" target="_blank">
http://mail.mikej.com/vmcore.1</a><br>;
&gt; <br>
<br>
I also need your kernel and debug kernel to fully debug this.<br>
<br>
1) Do ssh to machine.<br>
2) watch -i -W pts/0 (does not panic over here)<br>
<br>
Can you explain what step 1 is? An scp ?<br>
<br>
Refcount is -1.<br>
f_count = 0xffffffff<br>
<br>
f_data = 0xfffff800158b0400<br>
<br>
In your KGDB, can you enter:<br>
<br>
info 0xffffffff81b052d0<br>
<br>
Does the attached patch make any difference?<br>
<br>
--HPS<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D">&nbsp;</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D">&nbsp;</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D">So sorry, yes step one, ssh to machine….
</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D">&nbsp;</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D">Even open a second console on the computer, no SSH and do “watch –I &nbsp;-W v0” it panics.</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D">&nbsp;</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D">Example of “watch –I –W v0” for comparison – kernel/kernel.full have not changed since .2</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D">&nbsp;</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D"><a href="http://mail.mikej.com/core.txt.3" target="_blank">http://mail.mikej.com/core.txt.3</a></span><o:p></o:p></p>;
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D">&nbsp;</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D"><a href="http://mail.mikej.com/info.3" target="_blank">http://mail.mikej.com/info.3</a></span><o:p></o:p></p>;
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D">&nbsp;</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D"><a href="http://mail.mikej.com/vmcore.3" target="_blank">http://mail.mikej.com/vmcore.3</a></span><o:p></o:p></p>;
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D">&nbsp;</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D">&nbsp;</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D">&nbsp;</span><o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><o:p>&nbsp;</o:p></p>
<p><b><span style="font-size:10.0pt;font-family:&quot;Verdana&quot;,sans-serif;color:#666666">Disclaimer</span></b><span style="font-size:10.0pt;font-family:&quot;Verdana&quot;,sans-serif;color:#666666"><o:p></o:p></span></p>
<p><span style="font-size:8.0pt;font-family:&quot;Verdana&quot;,sans-serif;color:#666666">The information contained in this communication from the sender is confidential. It is intended solely for use by the recipient and others authorized to receive it. If you are not
 the recipient, you are hereby notified that any disclosure, copying, distribution or taking action in relation of the contents of this information is strictly prohibited and may be unlawful.<br>
<br>
This email has been scanned for viruses and malware, and may have been automatically archived by Mimecast, a leader in email security and cyber resilience. Mimecast integrates email defenses with brand protection, security awareness training, web security,
 compliance and other essential capabilities. Mimecast helps protect large and small organizations from malicious activity, human error and technology failure; and to lead the movement toward building a more resilient world. To find out more, visit our website.<o:p></o:p></span></p>
</div>
</blockquote>
</div>
</blockquote>
</div>
</div>


<br><br><p style="font-family: Verdana; font-size:10pt; color:#666666;"><b>Disclaimer</b></p><p style="font-family: Verdana; font-size:8pt; color:#666666;">The information contained in this communication from the sender is confidential. It is intended solely for use by the recipient and others authorized to receive it. If you are not the recipient, you are hereby notified that any disclosure, copying, distribution or taking action in relation of the contents of this information is strictly prohibited and may be unlawful.<br><br>This email has been scanned for viruses and malware, and may have been automatically archived by Mimecast, a leader in email security and cyber resilience. Mimecast integrates email defenses with brand protection, security awareness training, web security, compliance and other essential capabilities. Mimecast helps protect large and small organizations from malicious activity, human error and technology failure; and to lead the movement toward building a more resilient world. To find out more, visit our website.</p></body></html>
help

Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?903498700a1c4b32acb8fe283e746189>