Date: Sun, 24 Sep 2023 00:32:34 +0800 From: Zhenlei Huang <zlei@FreeBSD.org> To: Peter Holm <pho@FreeBSD.org> Cc: src-committers@freebsd.org, dev-commits-src-main@freebsd.org, dev-commits-src-all@freebsd.org Subject: Re: git: cf7974fd9e55 - main - sysctl: Update 'master' copy of vnet SYSCTLs on kernel environment variables change Message-ID: <F9BD1CE8-AC85-4503-BB50-2A962A691D89@FreeBSD.org> In-Reply-To: <15442125-499F-44FD-924A-472CE0709001@FreeBSD.org> References: <202309210413.38L4D42w076513@gitrepo.freebsd.org> <ZQvdoQHZe1YrZAUf@Peters-Air> <C7ABF1AF-2815-44D0-AA61-85636184C08B@FreeBSD.org> <ZQwS/vrfoxesWgvT@Peters-Air> <649B777A-CA29-42B7-AF92-DE8AF664D5CB@FreeBSD.org> <ZQxf/hkprgtNMqg1@Peters-Air> <800CB4EC-7AAF-4825-8146-47FBA94FEFAE@FreeBSD.org> <ZQxxpLlGekLg4/dD@Peters-Air> <15442125-499F-44FD-924A-472CE0709001@FreeBSD.org>
next in thread | previous in thread | raw e-mail | index | archive | help
[-- Attachment #1 --] > On Sep 22, 2023, at 12:59 AM, Zhenlei Huang <zlei@FreeBSD.org> wrote: > > > >> On Sep 22, 2023, at 12:39 AM, Peter Holm <pho@FreeBSD.org <mailto:pho@FreeBSD.org>> wrote: >> >> On Thu, Sep 21, 2023 at 11:35:49PM +0800, Zhenlei Huang wrote: >>> >>> >>>> On Sep 21, 2023, at 11:23 PM, Peter Holm <pho@freebsd.org <mailto:pho@freebsd.org>> wrote: >>>> >>>> On Thu, Sep 21, 2023 at 10:45:20PM +0800, Zhenlei Huang wrote: >>>>> >>>>> >>>>>> On Sep 21, 2023, at 5:55 PM, Peter Holm <pho@freebsd.org <mailto:pho@freebsd.org>> wrote: >>>>>> >>>>>> On Thu, Sep 21, 2023 at 04:05:19PM +0800, Zhenlei Huang wrote: >>>>>>> >>>>>>> >>>>>>>> On Sep 21, 2023, at 2:07 PM, Peter Holm <pho@FreeBSD.org <mailto:pho@FreeBSD.org>> wrote: >>>>>>>> >>>>>>>> On Thu, Sep 21, 2023 at 04:13:04AM +0000, Zhenlei Huang wrote: >>>>>>>>> The branch main has been updated by zlei: >>>>>>>>> >>>>>>>>> URL: https://cgit.FreeBSD.org/src/commit/?id=cf7974fd9e554552989237c3d6bc736d672ac7c6 <https://cgit.freebsd.org/src/commit/?id=cf7974fd9e554552989237c3d6bc736d672ac7c6>; >>>>>>>>> >>>>>>>>> commit cf7974fd9e554552989237c3d6bc736d672ac7c6 >>>>>>>>> Author: Zhenlei Huang <zlei@FreeBSD.org <mailto:zlei@FreeBSD.org>> >>>>>>>>> AuthorDate: 2023-09-21 04:11:28 +0000 >>>>>>>>> Commit: Zhenlei Huang <zlei@FreeBSD.org <mailto:zlei@FreeBSD.org>> >>>>>>>>> CommitDate: 2023-09-21 04:11:28 +0000 >>>>>>>>> >>>>>>>>> sysctl: Update 'master' copy of vnet SYSCTLs on kernel environment variables change >>>>>>>>> >>>>>>>>> Complete phase three of 3da1cf1e88f8. >>>>>>>>> >>>>>>>>> With commit 110113bc086f, vnet sysctl variables can be loader tunable >>>>>>>>> but the feature is limited. When the kernel modules have been initialized, >>>>>>>>> any changes (e.g. via kenv) to kernel environment variable will not affect >>>>>>>>> subsequently created VNETs. >>>>>>>>> >>>>>>>>> This change relexes the limitation by listening on kernel environment >>>>>>>>> variable's set / unset events, and then update the 'master' copy of vnet >>>>>>>>> SYSCTL or restore it to its initial value. >>>>>>>>> >>>>>>>>> With this change, TUNABLE_XXX_FETCH can be greately eliminated for vnet >>>>>>>>> loader tunables. >>>>>>>>> >>>>>>>>> Reviewed by: glebius >>>>>>>>> Fixes: 110113bc086f sysctl(9): Enable vnet sysctl variables to be loader tunable >>>>>>>>> MFC after: 2 weeks >>>>>>>>> Differential Revision: https://reviews.freebsd.org/D41825 <https://reviews.freebsd.org/D41825>; >>>>>>>> >>>>>>>> This commit seems to cause: >>>>>>>> >>>>>>>> b> bt >>>>>>>> Tracing pid 0 tid 100000 td 0xffffffff8196ba00 >>>>>>>> kdb_enter() at kdb_enter+0x32/frame 0xffffffff821658e0 >>>>>>>> vpanic() at vpanic+0x163/frame 0xffffffff82165a10 >>>>>>>> panic() at panic+0x43/frame 0xffffffff82165a70 >>>>>>>> vm_fault() at vm_fault+0x18c9/frame 0xffffffff82165ba0 >>>>>>>> vm_fault_trap() at vm_fault_trap+0x6f/frame 0xffffffff82165be0 >>>>>>>> trap_pfault() at trap_pfault+0x24a/frame 0xffffffff82165c50 >>>>>>>> calltrap() at calltrap+0x8/frame 0xffffffff82165c50 >>>>>>>> --- trap 0xc, rip = 0xffffffff80c6f39b, rsp = 0xffffffff82165d20, rbp = 0xffffffff82165d20 --- >>>>>>>> strsep() at strsep+0x3b/frame 0xffffffff82165d20 >>>>>>>> name2oid() at name2oid+0x66/frame 0xffffffff82165d70 >>>>>>>> sysctl_setenv_vnet() at sysctl_setenv_vnet+0x38/frame 0xffffffff82165e00 >>>>>>>> kern_setenv() at kern_setenv+0x324/frame 0xffffffff82165e40 >>>>>>>> nfs_setup_diskless() at nfs_setup_diskless+0x4b2/frame 0xffffffff82165f90 >>>>>>> >>>>>>> Is that a NFS diskless workstation ? >>>>>>> >>>>>> >>>>>> Yes, sort of. It's a host in the netperf cluster, which uses pxeboot & >>>>>> NFS. >>>>>> >>>>>> - Peter >>>>>> >>>>>>> I have tested that yet. I'll look at that tonight (UTC+8) . >>>>>>> >>>>>> >>>>>> Let me know when you have a patch, so I can test it (if you like). >>>>> >>>>> I believe I've found the root cause. >>>>> >>>>> strsep(char **stringp, const char *delim) have side effect, it will modify (* stringp) . >>>>> If stringp is pointed to some const value, such as "boot.netif.name" in 'sys/nfs/nfs_diskless.c', then >>>>> the kernel will panic. >>>>> >>>>> I'm preparing the patch, I'll reply when it is done. >>>>> >>>> >>>> This is great news! >>> >>> Can you please try the attached patch ? >>> >> >> Yes, the patch works for me: > > Excellent ! > > I'm going to send the patch to Phabricator. Alexander Motin has just committed f80babf906b7 (kern_sysctl: Make name2oid() non-destructive to the name), that should fix this issue perfectly ;) > >> >> root@mercat1:~ # uname -a >> FreeBSD mercat1.netperf.freebsd.org <http://mercat1.netperf.freebsd.org/>; 15.0-CURRENT FreeBSD 15.0-CURRENT #0 main-n265437-cf7974fd9e5545-dirty: Thu Sep 21 18:26:45 CEST 2023 pho@mercat1.netperf.freebsd.org <mailto:pho@mercat1.netperf.freebsd.org>:/usr/src/sys/amd64/compile/PHO amd64 >> root@mercat1:~ # cd /usr/src; git status | grep kern_sysctl.c >> modified: sys/kern/kern_sysctl.c >> root@mercat1:/usr/src # >> >> - Peter [-- Attachment #2 --] <html><head><meta http-equiv="Content-Type" content="text/html; charset=us-ascii"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><br class=""><div><br class=""><blockquote type="cite" class=""><div class="">On Sep 22, 2023, at 12:59 AM, Zhenlei Huang <<a href="mailto:zlei@FreeBSD.org" class="">zlei@FreeBSD.org</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><meta charset="UTF-8" class=""><br class="Apple-interchange-newline"><br class="" style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;"><blockquote type="cite" class="" style="font-family: Helvetica; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; text-decoration: none;"><div class="">On Sep 22, 2023, at 12:39 AM, Peter Holm <<a href="mailto:pho@FreeBSD.org" class="">pho@FreeBSD.org</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><span class="" style="caret-color: rgb(0, 0, 0); font-family: Menlo-Regular; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;">On Thu, Sep 21, 2023 at 11:35:49PM +0800, Zhenlei Huang wrote:</span><br class="" style="caret-color: rgb(0, 0, 0); font-family: Menlo-Regular; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;"><blockquote type="cite" class="" style="font-family: Menlo-Regular; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;"><br class=""><br class=""><blockquote type="cite" class="">On Sep 21, 2023, at 11:23 PM, Peter Holm <<a href="mailto:pho@freebsd.org" class="">pho@freebsd.org</a>> wrote:<br class=""><br class="">On Thu, Sep 21, 2023 at 10:45:20PM +0800, Zhenlei Huang wrote:<br class=""><blockquote type="cite" class=""><br class=""><br class=""><blockquote type="cite" class="">On Sep 21, 2023, at 5:55 PM, Peter Holm <<a href="mailto:pho@freebsd.org" class="">pho@freebsd.org</a>> wrote:<br class=""><br class="">On Thu, Sep 21, 2023 at 04:05:19PM +0800, Zhenlei Huang wrote:<br class=""><blockquote type="cite" class=""><br class=""><br class=""><blockquote type="cite" class="">On Sep 21, 2023, at 2:07 PM, Peter Holm <<a href="mailto:pho@FreeBSD.org" class="">pho@FreeBSD.org</a>> wrote:<br class=""><br class="">On Thu, Sep 21, 2023 at 04:13:04AM +0000, Zhenlei Huang wrote:<br class=""><blockquote type="cite" class="">The branch main has been updated by zlei:<br class=""><br class="">URL:<span class="Apple-converted-space"> </span><a href="https://cgit.freebsd.org/src/commit/?id=cf7974fd9e554552989237c3d6bc736d672ac7c6" class="">https://cgit.FreeBSD.org/src/commit/?id=cf7974fd9e554552989237c3d6bc736d672ac7c6</a><br class=""><br class="">commit cf7974fd9e554552989237c3d6bc736d672ac7c6<br class="">Author: Zhenlei Huang <<a href="mailto:zlei@FreeBSD.org" class="">zlei@FreeBSD.org</a>><br class="">AuthorDate: 2023-09-21 04:11:28 +0000<br class="">Commit: Zhenlei Huang <<a href="mailto:zlei@FreeBSD.org" class="">zlei@FreeBSD.org</a>><br class="">CommitDate: 2023-09-21 04:11:28 +0000<br class=""><br class="">sysctl: Update 'master' copy of vnet SYSCTLs on kernel environment variables change<br class=""><br class="">Complete phase three of 3da1cf1e88f8.<br class=""><br class="">With commit 110113bc086f, vnet sysctl variables can be loader tunable<br class="">but the feature is limited. When the kernel modules have been initialized,<br class="">any changes (e.g. via kenv) to kernel environment variable will not affect<br class="">subsequently created VNETs.<br class=""><br class="">This change relexes the limitation by listening on kernel environment<br class="">variable's set / unset events, and then update the 'master' copy of vnet<br class="">SYSCTL or restore it to its initial value.<br class=""><br class="">With this change, TUNABLE_XXX_FETCH can be greately eliminated for vnet<br class="">loader tunables.<br class=""><br class="">Reviewed by: glebius<br class="">Fixes: 110113bc086f sysctl(9): Enable vnet sysctl variables to be loader tunable<br class="">MFC after: 2 weeks<br class="">Differential Revision: <a href="https://reviews.freebsd.org/D41825" class="">https://reviews.freebsd.org/D41825</a><br class=""></blockquote><br class="">This commit seems to cause:<br class=""><br class="">b> bt<br class="">Tracing pid 0 tid 100000 td 0xffffffff8196ba00<br class="">kdb_enter() at kdb_enter+0x32/frame 0xffffffff821658e0<br class="">vpanic() at vpanic+0x163/frame 0xffffffff82165a10<br class="">panic() at panic+0x43/frame 0xffffffff82165a70<br class="">vm_fault() at vm_fault+0x18c9/frame 0xffffffff82165ba0<br class="">vm_fault_trap() at vm_fault_trap+0x6f/frame 0xffffffff82165be0<br class="">trap_pfault() at trap_pfault+0x24a/frame 0xffffffff82165c50<br class="">calltrap() at calltrap+0x8/frame 0xffffffff82165c50<br class="">--- trap 0xc, rip = 0xffffffff80c6f39b, rsp = 0xffffffff82165d20, rbp = 0xffffffff82165d20 ---<br class="">strsep() at strsep+0x3b/frame 0xffffffff82165d20<br class="">name2oid() at name2oid+0x66/frame 0xffffffff82165d70<br class="">sysctl_setenv_vnet() at sysctl_setenv_vnet+0x38/frame 0xffffffff82165e00<br class="">kern_setenv() at kern_setenv+0x324/frame 0xffffffff82165e40<br class="">nfs_setup_diskless() at nfs_setup_diskless+0x4b2/frame 0xffffffff82165f90<br class=""></blockquote><br class="">Is that a NFS diskless workstation ?<br class=""><br class=""></blockquote><br class="">Yes, sort of. It's a host in the netperf cluster, which uses pxeboot &<br class="">NFS.<br class=""><br class="">- Peter<br class=""><br class=""><blockquote type="cite" class="">I have tested that yet. I'll look at that tonight (UTC+8) .<br class=""><br class=""></blockquote><br class="">Let me know when you have a patch, so I can test it (if you like).<br class=""></blockquote><br class="">I believe I've found the root cause.<br class=""><br class="">strsep(char **stringp, const char *delim) have side effect, it will modify (* stringp) .<br class="">If stringp is pointed to some const value, such as "boot.netif.name" in 'sys/nfs/nfs_diskless.c', then<br class="">the kernel will panic.<br class=""><br class="">I'm preparing the patch, I'll reply when it is done.<br class=""><br class=""></blockquote><br class="">This is great news!<br class=""></blockquote><br class="">Can you please try the attached patch ? <br class=""><br class=""></blockquote><br class="" style="caret-color: rgb(0, 0, 0); font-family: Menlo-Regular; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;"><span class="" style="caret-color: rgb(0, 0, 0); font-family: Menlo-Regular; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;">Yes, the patch works for me:</span><br class="" style="caret-color: rgb(0, 0, 0); font-family: Menlo-Regular; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;"></div></blockquote><div style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><br class=""></div><div style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class="">Excellent !</div><div style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><br class=""></div><div style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class="">I'm going to send the patch to Phabricator.</div></div></blockquote><div><br class=""></div><div>Alexander Motin has just committed f80babf906b7 (kern_sysctl: Make name2oid() non-destructive to the name),</div><div>that should fix this issue perfectly ;)</div><br class=""><blockquote type="cite" class=""><div class=""><br class="" style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;"><blockquote type="cite" class="" style="font-family: Helvetica; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; text-decoration: none;"><div class=""><br class="" style="caret-color: rgb(0, 0, 0); font-family: Menlo-Regular; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;"><span class="" style="caret-color: rgb(0, 0, 0); font-family: Menlo-Regular; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;">root@mercat1:~ # uname -a</span><br class="" style="caret-color: rgb(0, 0, 0); font-family: Menlo-Regular; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;"><span class="" style="caret-color: rgb(0, 0, 0); font-family: Menlo-Regular; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;">FreeBSD<span class="Apple-converted-space"> </span></span><a href="http://mercat1.netperf.freebsd.org/" class="" style="font-family: Menlo-Regular; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;">mercat1.netperf.freebsd.org</a><span class="" style="caret-color: rgb(0, 0, 0); font-family: Menlo-Regular; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;"><span class="Apple-converted-space"> </span>15.0-CURRENT FreeBSD 15.0-CURRENT #0 main-n265437-cf7974fd9e5545-dirty: Thu Sep 21 18:26:45 CEST 2023<span class="Apple-converted-space"> </span></span><a href="mailto:pho@mercat1.netperf.freebsd.org" class="" style="font-family: Menlo-Regular; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;">pho@mercat1.netperf.freebsd.org</a><span class="" style="caret-color: rgb(0, 0, 0); font-family: Menlo-Regular; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;">:/usr/src/sys/amd64/compile/PHO amd64</span><br class="" style="caret-color: rgb(0, 0, 0); font-family: Menlo-Regular; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;"><span class="" style="caret-color: rgb(0, 0, 0); font-family: Menlo-Regular; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;">root@mercat1:~ # cd /usr/src; git status | grep kern_sysctl.c</span><br class="" style="caret-color: rgb(0, 0, 0); font-family: Menlo-Regular; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;"><span class="" style="caret-color: rgb(0, 0, 0); font-family: Menlo-Regular; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;"> modified: sys/kern/kern_sysctl.c</span><br class="" style="caret-color: rgb(0, 0, 0); font-family: Menlo-Regular; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;"><span class="" style="caret-color: rgb(0, 0, 0); font-family: Menlo-Regular; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;">root@mercat1:/usr/src #<span class="Apple-converted-space"> </span></span><br class="" style="caret-color: rgb(0, 0, 0); font-family: Menlo-Regular; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;"><br class="" style="caret-color: rgb(0, 0, 0); font-family: Menlo-Regular; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;"><span class="" style="caret-color: rgb(0, 0, 0); font-family: Menlo-Regular; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;">- Peter</span></div></blockquote></div></blockquote></div><div class=""><div><br class=""></div> </div> <br class=""></body></html>
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?F9BD1CE8-AC85-4503-BB50-2A962A691D89>