Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 22 Feb 2022 09:43:46 -0900
From:      Rob Wing <rob.fx907@gmail.com>
To:        Michael Jung <mikej@paymentallianceintl.com>
Cc:        Hans Petter Selasky <hps@selasky.org>, freebsd-current <freebsd-current@freebsd.org>
Subject:   Re: New panic in main-n253273-a52d8d4a6c6:
Message-ID:  <CAF3%2Bn_f3x2ZVg6_SuecgMfurV-46X%2BVF8UVhAgd6M9jPSga5eA@mail.gmail.com>
In-Reply-To: <CAF3%2Bn_fhyRctPhUC1WcrV79FpWjeP279wZ-tVzgHZCAa4ujU4A@mail.gmail.com>
References:  <b7ca5b5e7a9a4df3951a2cb2f1d63552@MAIL-HUB.pai.local> <d04c0d93-8168-f53a-a5fd-865a1f6d2486@selasky.org> <6fcc161dd23b4f7ebe7cc789f11c017e@MAIL-HUB.pai.local> <dbd20a4d-b5a3-390e-a231-8ccca4f64c70@selasky.org> <924c13764ce342cf968ef9a93699be9a@MAIL-HUB.pai.local> <719aa03f-6f34-fdf8-1258-c7e5fcf33043@selasky.org> <794fbec71b714f6ea3931b942f17e1ea@MAIL-HUB.pai.local> <CAF3%2Bn_dsm0tK6_9pSJxwMVRxxGeAzps0BSx8MvqQdgGTbTFkYw@mail.gmail.com> <CAF3%2Bn_dGf%2BA3o0PnQ28xL0RNhu5q=wyp=hsNNw9Bw3dw5bcSkw@mail.gmail.com> <903498700a1c4b32acb8fe283e746189@MAIL-HUB.pai.local> <CAF3%2Bn_fhyRctPhUC1WcrV79FpWjeP279wZ-tVzgHZCAa4ujU4A@mail.gmail.com>

index | next in thread | previous in thread | raw e-mail

[-- Attachment #1 --]
Hey Mike,

Should be fixed in commit 0a2f498234023008d9a3b13ad7fc8fd81d384bab
<https://cgit.freebsd.org/src/commit/?id=0a2f498234023008d9a3b13ad7fc8fd81d384bab>;

Thanks for the report

-Rob

On Mon, Feb 21, 2022 at 7:48 PM Rob Wing <rob.fx907@gmail.com> wrote:

> Think that's it...thanks for testing for the patch.
>
> I opened up https://reviews.freebsd.org/D34335 for review.
>
> -Rob
>
> On Mon, Feb 21, 2022 at 6:05 PM Michael Jung <
> mikej@paymentallianceintl.com> wrote:
>
>> Rob:
>>
>>
>>
>> I did not remove Hans earlier patch, but your “latest” patch applied and
>> compiled with no errors.
>>
>>
>>
>> I can now watch and control a TTY (v0) or a SSH session (pts/1) without
>> crashing.
>>
>>
>>
>> Anything else you would like me to try?
>>
>>
>>
>> --mikej
>>
>>
>>
>>
>>
>> *From:* Rob Wing [mailto:rob.fx907@gmail.com]
>> *Sent:* Monday, February 21, 2022 9:30 PM
>> *To:* Michael Jung <mikej@paymentallianceintl.com>
>> *Cc:* Hans Petter Selasky <hps@selasky.org>; freebsd-current <
>> freebsd-current@freebsd.org>
>> *Subject:* Re: New panic in main-n253273-a52d8d4a6c6:
>>
>>
>>
>> The previous attached patch should work for testing purposes, but it's
>> incorrect if an error occurs.
>>
>>
>>
>> The fhold() should be below FILEDESC_SUNLOCK(), this patch addresses that.
>>
>>
>>
>> On Mon, Feb 21, 2022 at 5:18 PM Rob Wing <rob.fx907@gmail.com> wrote:
>>
>> try the attached patch
>>
>>
>>
>> On Mon, Feb 21, 2022 at 5:14 PM Michael Jung <
>> mikej@paymentallianceintl.com> wrote:
>>
>>
>>
>>
>>
>>
>>
>> CONFIDENTIALITY NOTE: This message is intended only for the use
>> of the individual or entity to whom it is addressed and may
>> contain information that is privileged, confidential, and
>> exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby
>> notified that any dissemination, distribution or copying
>> of this communication is strictly prohibited. If you have
>> received this transmission in error, please notify us by
>> telephone at (502) 212-4000 or notify us at: PAI, Dept. 99,
>> 2101 High Wickham Place, Suite 101, Louisville, KY 40245
>>
>>
>> *From:* Michael Jung
>> *Sent:* Monday, February 21, 2022 9:06 PM
>> *To:* 'Hans Petter Selasky' <hps@selasky.org>; freebsd-current <
>> freebsd-current@freebsd.org>
>> *Subject:* RE: New panic in main-n253273-a52d8d4a6c6:
>>
>>
>>
>> *From:* Hans Petter Selasky [mailto:hps@selasky.org <hps@selasky.org>]
>> *Sent:* Monday, February 21, 2022 8:34 PM
>> *To:* Michael Jung <mikej@paymentallianceintl.com>; freebsd-current <
>> freebsd-current@freebsd.org>
>> *Subject:* Re: New panic in main-n253273-a52d8d4a6c6:
>>
>>
>>
>> On 2/22/22 00:42, Michael Jung wrote:
>> > Hi:
>> >
>> > I was trying to remember what I did that was odd when this crash
>> occurred then it
>> > hit me. You can repeat this panic by doing:
>> >
>> > # watch -I -W pts/0
>> >
>> > Here is another panic that happened write after issuing "watch" for
>> comparison.
>> >
>> > http://mail.mikej.com/core.txt.1
>> >
>> > http://mail.mikej.com/info.1
>> >
>> > http://mail.mikej.com/vmcore.1
>> >
>>
>> I also need your kernel and debug kernel to fully debug this.
>>
>> 1) Do ssh to machine.
>> 2) watch -i -W pts/0 (does not panic over here)
>>
>> Can you explain what step 1 is? An scp ?
>>
>> Refcount is -1.
>> f_count = 0xffffffff
>>
>> f_data = 0xfffff800158b0400
>>
>> In your KGDB, can you enter:
>>
>> info 0xffffffff81b052d0
>>
>> Does the attached patch make any difference?
>>
>> --HPS
>>
>>
>>
>>
>>
>> So sorry, yes step one, ssh to machine….
>>
>>
>>
>> Even open a second console on the computer, no SSH and do “watch –I  -W
>> v0” it panics.
>>
>>
>>
>> Example of “watch –I –W v0” for comparison – kernel/kernel.full have not
>> changed since .2
>>
>>
>>
>> http://mail.mikej.com/core.txt.3
>>
>>
>>
>> http://mail.mikej.com/info.3
>>
>>
>>
>> http://mail.mikej.com/vmcore.3
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> *Disclaimer*
>>
>> The information contained in this communication from the sender is
>> confidential. It is intended solely for use by the recipient and others
>> authorized to receive it. If you are not the recipient, you are hereby
>> notified that any disclosure, copying, distribution or taking action in
>> relation of the contents of this information is strictly prohibited and may
>> be unlawful.
>>
>> This email has been scanned for viruses and malware, and may have been
>> automatically archived by Mimecast, a leader in email security and cyber
>> resilience. Mimecast integrates email defenses with brand protection,
>> security awareness training, web security, compliance and other essential
>> capabilities. Mimecast helps protect large and small organizations from
>> malicious activity, human error and technology failure; and to lead the
>> movement toward building a more resilient world. To find out more, visit
>> our website.
>>
>>
>>
>> *Disclaimer*
>>
>> The information contained in this communication from the sender is
>> confidential. It is intended solely for use by the recipient and others
>> authorized to receive it. If you are not the recipient, you are hereby
>> notified that any disclosure, copying, distribution or taking action in
>> relation of the contents of this information is strictly prohibited and may
>> be unlawful.
>>
>> This email has been scanned for viruses and malware, and may have been
>> automatically archived by Mimecast, a leader in email security and cyber
>> resilience. Mimecast integrates email defenses with brand protection,
>> security awareness training, web security, compliance and other essential
>> capabilities. Mimecast helps protect large and small organizations from
>> malicious activity, human error and technology failure; and to lead the
>> movement toward building a more resilient world. To find out more, visit
>> our website.
>>
>

[-- Attachment #2 --]
<div dir="ltr"><div>Hey Mike,</div><div><br></div><div>Should be fixed in <a href="https://cgit.freebsd.org/src/commit/?id=0a2f498234023008d9a3b13ad7fc8fd81d384bab">commit 0a2f498234023008d9a3b13ad7fc8fd81d384bab</a></div><div><br></div><div>Thanks for the report</div><div><br></div><div>-Rob<br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Feb 21, 2022 at 7:48 PM Rob Wing &lt;<a href="mailto:rob.fx907@gmail.com">rob.fx907@gmail.com</a>&gt; wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>Think that&#39;s it...thanks for testing for the patch.<br></div><div><br></div><div>I opened up <a href="https://reviews.freebsd.org/D34335" target="_blank">https://reviews.freebsd.org/D34335</a>; for review.<br></div><div><br></div><div>-Rob<br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Feb 21, 2022 at 6:05 PM Michael Jung &lt;<a href="mailto:mikej@paymentallianceintl.com" target="_blank">mikej@paymentallianceintl.com</a>&gt; wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">



<div lang="EN-US">
<div>
<p class="MsoNormal"><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif;color:rgb(31,73,125)">Rob:<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif;color:rgb(31,73,125)">I did not remove Hans earlier patch, but your “latest” patch applied and compiled with no errors.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif;color:rgb(31,73,125)">I can now watch and control a TTY (v0) or a SSH session (pts/1) without crashing.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif;color:rgb(31,73,125)">Anything else you would like me to try?<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif;color:rgb(31,73,125)">--mikej<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p>
<p class="MsoNormal"><b><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif">From:</span></b><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif"> Rob Wing [mailto:<a href="mailto:rob.fx907@gmail.com" target="_blank">rob.fx907@gmail.com</a>]
<br>
<b>Sent:</b> Monday, February 21, 2022 9:30 PM<br>
<b>To:</b> Michael Jung &lt;<a href="mailto:mikej@paymentallianceintl.com" target="_blank">mikej@paymentallianceintl.com</a>&gt;<br>
<b>Cc:</b> Hans Petter Selasky &lt;<a href="mailto:hps@selasky.org" target="_blank">hps@selasky.org</a>&gt;; freebsd-current &lt;<a href="mailto:freebsd-current@freebsd.org" target="_blank">freebsd-current@freebsd.org</a>&gt;<br>
<b>Subject:</b> Re: New panic in main-n253273-a52d8d4a6c6:<u></u><u></u></span></p>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<p class="MsoNormal">The previous attached patch should work for testing purposes, but it&#39;s incorrect if an error occurs.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">The fhold() should be below FILEDESC_SUNLOCK(), this patch addresses that.<u></u><u></u></p>
</div>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<p class="MsoNormal">On Mon, Feb 21, 2022 at 5:18 PM Rob Wing &lt;<a href="mailto:rob.fx907@gmail.com" target="_blank">rob.fx907@gmail.com</a>&gt; wrote:<u></u><u></u></p>
</div>
<blockquote style="border-color:currentcolor currentcolor currentcolor rgb(204,204,204);border-style:none none none solid;border-width:medium medium medium 1pt;padding:0in 0in 0in 6pt;margin-left:4.8pt;margin-right:0in">
<div>
<p class="MsoNormal">try the attached patch<u></u><u></u></p>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<p class="MsoNormal">On Mon, Feb 21, 2022 at 5:14 PM Michael Jung &lt;<a href="mailto:mikej@paymentallianceintl.com" target="_blank">mikej@paymentallianceintl.com</a>&gt; wrote:<u></u><u></u></p>
</div>
<blockquote style="border-color:currentcolor currentcolor currentcolor rgb(204,204,204);border-style:none none none solid;border-width:medium medium medium 1pt;padding:0in 0in 0in 6pt;margin-left:4.8pt;margin-right:0in">
<div>
<div>
<p class="MsoNormal"><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif;color:rgb(31,73,125)"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif;color:rgb(31,73,125)"> </span><u></u><u></u></p>
<div>
<p><span style="font-size:10pt;font-family:&quot;Arial&quot;,sans-serif"> <u></u><u></u></span></p>
<div style="border-color:rgb(102,102,102) currentcolor;border-style:solid none;border-width:1pt medium;padding:4pt 0in">
<p class="MsoNormal" style="margin-bottom:12pt"><span style="font-size:7.5pt;font-family:&quot;Verdana&quot;,sans-serif">CONFIDENTIALITY NOTE: This message is intended only for the use<br>
of the individual or entity to whom it is addressed and may <br>
contain information that is privileged, confidential, and <br>
exempt from disclosure under applicable law. If the reader <br>
of this message is not the intended recipient, you are hereby <br>
notified that any dissemination, distribution or copying <br>
of this communication is strictly prohibited. If you have <br>
received this transmission in error, please notify us by <br>
telephone at (502) 212-4000 or notify us at: PAI, Dept. 99, <br>
2101 High Wickham Place, Suite 101, Louisville, KY 40245<br>
<br>
<br>
<u></u><u></u></span></p>
</div>
</div>
<div>
<div style="border-style:solid none none;border-width:1pt medium medium;padding:3pt 0in 0in;border-color:currentcolor">
<p class="MsoNormal"><b><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif">From:</span></b><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif"> Michael Jung
<br>
<b>Sent:</b> Monday, February 21, 2022 9:06 PM<br>
<b>To:</b> &#39;Hans Petter Selasky&#39; &lt;<a href="mailto:hps@selasky.org" target="_blank">hps@selasky.org</a>&gt;; freebsd-current &lt;<a href="mailto:freebsd-current@freebsd.org" target="_blank">freebsd-current@freebsd.org</a>&gt;<br>
<b>Subject:</b> RE: New panic in main-n253273-a52d8d4a6c6:</span><u></u><u></u></p>
</div>
</div>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal"><b><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif">From:</span></b><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif"> Hans Petter Selasky [<a href="mailto:hps@selasky.org" target="_blank">mailto:hps@selasky.org</a>]
<br>
<b>Sent:</b> Monday, February 21, 2022 8:34 PM<br>
<b>To:</b> Michael Jung &lt;<a href="mailto:mikej@paymentallianceintl.com" target="_blank">mikej@paymentallianceintl.com</a>&gt;; freebsd-current &lt;<a href="mailto:freebsd-current@freebsd.org" target="_blank">freebsd-current@freebsd.org</a>&gt;<br>
<b>Subject:</b> Re: New panic in main-n253273-a52d8d4a6c6:</span><u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">On 2/22/22 00:42, Michael Jung wrote:<br>
&gt; Hi:<br>
&gt; <br>
&gt; I was trying to remember what I did that was odd when this crash occurred then it<br>
&gt; hit me. You can repeat this panic by doing:<br>
&gt; <br>
&gt; # watch -I -W pts/0<br>
&gt; <br>
&gt; Here is another panic that happened write after issuing &quot;watch&quot; for comparison.<br>
&gt; <br>
&gt; <a href="http://mail.mikej.com/core.txt.1" target="_blank">
http://mail.mikej.com/core.txt.1</a><br>;
&gt; <br>
&gt; <a href="http://mail.mikej.com/info.1" target="_blank">
http://mail.mikej.com/info.1</a><br>;
&gt; <br>
&gt; <a href="http://mail.mikej.com/vmcore.1" target="_blank">
http://mail.mikej.com/vmcore.1</a><br>;
&gt; <br>
<br>
I also need your kernel and debug kernel to fully debug this.<br>
<br>
1) Do ssh to machine.<br>
2) watch -i -W pts/0 (does not panic over here)<br>
<br>
Can you explain what step 1 is? An scp ?<br>
<br>
Refcount is -1.<br>
f_count = 0xffffffff<br>
<br>
f_data = 0xfffff800158b0400<br>
<br>
In your KGDB, can you enter:<br>
<br>
info 0xffffffff81b052d0<br>
<br>
Does the attached patch make any difference?<br>
<br>
--HPS<u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif;color:rgb(31,73,125)"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif;color:rgb(31,73,125)"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif;color:rgb(31,73,125)">So sorry, yes step one, ssh to machine….
</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif;color:rgb(31,73,125)"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif;color:rgb(31,73,125)">Even open a second console on the computer, no SSH and do “watch –I  -W v0” it panics.</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif;color:rgb(31,73,125)"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif;color:rgb(31,73,125)">Example of “watch –I –W v0” for comparison – kernel/kernel.full have not changed since .2</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif;color:rgb(31,73,125)"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif;color:rgb(31,73,125)"><a href="http://mail.mikej.com/core.txt.3" target="_blank">http://mail.mikej.com/core.txt.3</a></span><u></u><u></u></p>;
<p class="MsoNormal"><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif;color:rgb(31,73,125)"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif;color:rgb(31,73,125)"><a href="http://mail.mikej.com/info.3" target="_blank">http://mail.mikej.com/info.3</a></span><u></u><u></u></p>;
<p class="MsoNormal"><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif;color:rgb(31,73,125)"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif;color:rgb(31,73,125)"><a href="http://mail.mikej.com/vmcore.3" target="_blank">http://mail.mikej.com/vmcore.3</a></span><u></u><u></u></p>;
<p class="MsoNormal"><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif;color:rgb(31,73,125)"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif;color:rgb(31,73,125)"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:&quot;Calibri&quot;,sans-serif;color:rgb(31,73,125)"> </span><u></u><u></u></p>
</div>
<p class="MsoNormal" style="margin-bottom:12pt"><u></u> <u></u></p>
<p><b><span style="font-size:10pt;font-family:&quot;Verdana&quot;,sans-serif;color:rgb(102,102,102)">Disclaimer</span></b><span style="font-size:10pt;font-family:&quot;Verdana&quot;,sans-serif;color:rgb(102,102,102)"><u></u><u></u></span></p>
<p><span style="font-size:8pt;font-family:&quot;Verdana&quot;,sans-serif;color:rgb(102,102,102)">The information contained in this communication from the sender is confidential. It is intended solely for use by the recipient and others authorized to receive it. If you are not
 the recipient, you are hereby notified that any disclosure, copying, distribution or taking action in relation of the contents of this information is strictly prohibited and may be unlawful.<br>
<br>
This email has been scanned for viruses and malware, and may have been automatically archived by Mimecast, a leader in email security and cyber resilience. Mimecast integrates email defenses with brand protection, security awareness training, web security,
 compliance and other essential capabilities. Mimecast helps protect large and small organizations from malicious activity, human error and technology failure; and to lead the movement toward building a more resilient world. To find out more, visit our website.<u></u><u></u></span></p>
</div>
</blockquote>
</div>
</blockquote>
</div>
</div>


<br><br><p style="font-family:Verdana;font-size:10pt;color:rgb(102,102,102)"><b>Disclaimer</b></p><p style="font-family:Verdana;font-size:8pt;color:rgb(102,102,102)">The information contained in this communication from the sender is confidential. It is intended solely for use by the recipient and others authorized to receive it. If you are not the recipient, you are hereby notified that any disclosure, copying, distribution or taking action in relation of the contents of this information is strictly prohibited and may be unlawful.<br><br>This email has been scanned for viruses and malware, and may have been automatically archived by Mimecast, a leader in email security and cyber resilience. Mimecast integrates email defenses with brand protection, security awareness training, web security, compliance and other essential capabilities. Mimecast helps protect large and small organizations from malicious activity, human error and technology failure; and to lead the movement toward building a more resilient world. To find out more, visit our website.</p></div>
</blockquote></div>
</blockquote></div>
help

Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAF3%2Bn_f3x2ZVg6_SuecgMfurV-46X%2BVF8UVhAgd6M9jPSga5eA>