Date: Mon, 28 Oct 2024 11:00:54 +0100 From: Alexander Leidinger <Alexander@Leidinger.net> To: Maku Bex <zagazaw2004@gmail.com>, "'David Wolfskill'" <david@catwhisker.org> Cc: <freebsd-current@freebsd.org> Subject: RE: speedup build time Message-ID: <192d2702590.2805.fa4b1493b064008fe79f0f905b8e5741@Leidinger.net> In-Reply-To: <015001db28db$690b03c0$3b210b40$@gmail.com> References: <012d01db28cc$5fc66ac0$1f534040$@gmail.com> <Zx7fqFzbjuCvZgaw@albert.catwhisker.org> <015001db28db$690b03c0$3b210b40$@gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
This is a multi-part message in MIME format. --192d2924626520e28056d47bab Content-Type: text/plain; format=flowed; charset="us-ascii" Content-Transfer-Encoding: 8bit Hi, Try (add) src.conf: WITHOUT_CLEAN=YES WITH_MALLOC_PRODUCTION=YES WITHOUT_LLVM_ASSERTIONS=yes This may only give a result in subsequent builds, not on the first build or when a lot or something essential has changed. Note (just in case...) the make jobs number you use is not used for the world, only for ports. For the world/kernel build it's really the -j option. Bye, Alexander. -- Send from a mobile device, please forgive brevity and misspellings. Am 28. Oktober 2024 02:50:38 schrieb "Maku Bex" <zagazaw2004@gmail.com>: > Hi David, > > * What (if any) "max_jobs" (make's "-j" parameter) are you using? 16 > > * For a 16T system, I expect I would start with a value of around 28. > Shouldn't this number be equal to $(nproc --all)? > > * Are you using make's "meta" mode? I do. Yes. > > * Can you get more memory for that system? Yes, I can bump it to 32GB. This > is a Dell OptiPlex 7080 Micro, and not sure if it is worth upgrading the > other components. > > If your laptop can complete the builds in such a small amount of time, then > there's either something wrong with my machine or the config files. Oh! The > build just finished as I was typing this reply and...(not for the weak hearts): > > -------------------------------------------------------------- >>>> World built in 32437 seconds, ncpu: 16 > -------------------------------------------------------------- > > Here are the contents of: > > make.conf: > > CPUTYPE?=icelake-client > CFLAGS= -O2 -pipe -march=${CPUTYPE} > #CXXFLAGS=${CFLAGS} > MACHINE_CPU+= avx512 avx2 avx sse42 sse41 ssse3 sse3 f16c > MAKE_JOBS_NUMBER= 16 > BATCH=yes > WRKDIRPREFIX=/var/ports/tmp > CCACHE_DIR=/var/ccache/tmp > > OPTIONS_UNSET+= QT5 QT6 CUPS VESA SCFB TWM XCONSOLE XCLOCK GNOME KDE EXAMPLES \ > DEBUG ASPELL NLS DOCS > ------------------------------------------------------------------------------- > src-env.conf: > > WITH_META_MODE=yes > WITH_CCACHE_BUILD=yes > #WITH_DIRDEPS_BUILD=yes <<fails > #WITH_DIRDEPS_CACHE=yes <<fails > > WITHOUT_TALK=yes > WITHOUT_TELNET=yes > WITHOUT_TFTP=yes > WITHOUT_IPFILTER=yes > WITHOUT_IPFW=yes > WITHOUT_FLOPPY=yes > WITHOUT_GAMES=yes > WITHOUT_BLUETOOTH=yes > WITHOUT_EE=yes > WITHOUT_FREEBSD_UPDATE=yes > WITHOUT_GPIO=yes > WITHOUT_MAIL=yes > WITHOUT_TESTS=yes > WITHOUT_AMD=yes > WITHOUT_CLANG=yes > WITHOUT_DEBUG_FILES=yes > WITHOUT_EXAMPLES=yes > WITHOUT_HYPERV=yes > > Happy Hacking, > > -----BEGIN PGP PUBLIC KEY BLOCK----- > > mJMEZlPMfxMFK4EEACMEIwQA/hAHZ4KNJLw5eRl6DAOyzkuHQ7PaK2hTYLVIPoxC > sCe8lB/hzET5KxMW9GXgFgPaSP7Es+ul6ajyq8pr9DeGnXUAFymi7GoT1kLIqgrn > X+rDAwMk9JNEElTmVNvgKWv/G+pSg2rAQ8sIw6smgckA0CaX1JdcNavrHDgKMO4u > Duo44Te0BkpPTUlTTYjbBBMTCgBBFiEENyUvu5bQVBXM019e8anbed+sQ8YFAmZT > zH8CGwMFCQHnaREFCwkIBwICIgIGFQoJCAsCBBYCAwECHgcCF4AACgkQ8anbed+s > Q8Y5BgIHcX19jz0KP89uTmqvLGZcKsITDJKweAnccCZRS8hvXT8JBwR1LyxsBBKF > ++eN2JJasZLo+s6sy7pDMN+9z4Gkdy0CCOj+arfLdvajfzdK4QeKpINfpa2SkQD1 > CP98lvfI/luIbetUVW+qNDkzT1jZphYuzgsCaofTGCIQpFk19q22ZcZquJcEZlPM > fxIFK4EEACMEIwQANy4VvpnTHneZipCPwzVJnMN82coCudRAiL2i2m3GPA06lRtU > njcn9r9Sm26A0sajwc3kQw/ekWrHXpXV0aL076cAUW9GKYDljIHVlr76wgHbLt6q > BX5VkA6xS0cq3skbMEI0QpIqIK81Yf0z8wfyF5uqAgNPUpY4nHMV9S856JB2VDQD > AQoJiMEEGBMKACYWIQQ3JS+7ltBUFczTX17xqdt536xDxgUCZlPMfwIbDAUJAedp > EQAKCRDxqdt536xDxjIuAgjacZCttPWpKGfMbnNWePz6t9rcMUb496tSWfKRActr > Rco8lSaDNTVohT/6hLZ5wUX5NFUqTb+kOXJcUGHGbnw2KQIJAQu1m9zEP5XdWmFi > SvGg1NHW2kzqAvFsG37flbwrGRu5fmTnS/LZ/oPzOCuwU6F+o1q0E7gLwFwnzD93 > riKeabdd > =iCV+ > -----END PGP PUBLIC KEY BLOCK----- > > -----Original Message----- > From: David Wolfskill <david@catwhisker.org> > Sent: Sunday, October 27, 2024 19:50 > To: Maku Bex <zagazaw2004@gmail.com> > Cc: freebsd-current@freebsd.org > Subject: Re: speedup build time > > On Sun, Oct 27, 2024 at 07:00:17PM -0500, Maku Bex wrote: >> ... >> I'm trying to figure out a way to decrease build time of -CURRENT >> and/or -STABLE but it is not working out that well. >> I've tried the following: >> * Tuning /etc/make.conf and /etc/src-env.conf based on their manpages >> (make.conf(5), make(1), src.conf(5)). >> * Removed certain options from GENERIC, which reduced the kernel build >> time significantly. >> >> Hardware specs: >> * I7-10700T 8C/16T @2.0GHz. >> * 16GB RAM. >> * 256GB NVMe. >> >> Currently, 'make buildworld' has been running for 7hrs and counting. >> Is there anything else I can do to speed up world build? >> .... > > First, some questions -- whether or not you wish to share the answers, I > believe that answering the questions (if only for yourself) may be > helpful: > > * What (if any) "max_jobs" (make's "-j" parameter) are you using? For a > 16T system, I expect I would start with a value of around 28. > > * Are you using make's "meta" mode? I do. > > * Can you get more memory for that system? > > Some context: I am in the (definitely peculiar; perhaps unfortunate) habit > of "tracking" FreeBSD head and latest stable branch on a small collection > of machines ... daily. One of those is the laptop that I use for normal > "desktop" stuff, as well as accessing all other machines on the planet that > I access. (Oh: I also update ports daily, too -- though I let my dedicated > "build machine" handle chromium.) > > That laptop has 4C/8T & 32 GB RAM. This morning, it took: > > * 17:46 for stable/14-n269310-bbd018d0aaaf -> stable/14-n269315-b21c677ed28a > (0:02 to update /usr/src; 17:44 to build; 0:00 to delete old libraries) > > * 24:03 for main-n273250-9d585fc395c3 -> main-n273270-cadb71e4b013 > (0:03 to update /usr/src; 23:59 to build; 0:01 to delete old libraries) > > * Updating ports (other than www/chromium) took 1:52. > > (Those times are "mm:ss" in case it wasn't obvious.) > > The above is fairly classic "sample size of 1" -- it's not necessarily > representative. Folks who are "sufficiently interested" are welcome to > trawl through the logs at > https://www.catwhisker.org/~david/FreeBSD/history/ to get a rough idea of > how long it is before the "uname" output from a successful build is logged; > there is probably some correlation to build times. > > I also recently acquired a replacement "build machine": 64C/128T; 256 GB > RAM; a fistful of SATA SSDs (build/boot on one; the rest is a poudriere > play area in a zraid). That's a wee bit faster than the laptop. :-) > > Peace, > david > -- > David H. Wolfskill david@catwhisker.org > It has been said that history repeats itself. This is perhaps not quite > correct; it merely rhymes. -- Theodor Reik > > See https://www.catwhisker.org/~david/publickey.gpg for my public key. --192d2924626520e28056d47bab Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.= w3.org/TR/html4/loose.dtd"> <html> <body> <div dir=3D"auto"> <div dir=3D"auto">Hi, </div><div dir=3D"auto"><br></div><div dir=3D"au= to">Try (add)</div><div dir=3D"auto">src.conf:</div><div dir=3D"auto">WITHO= UT_CLEAN=3DYES</div><div dir=3D"auto">WITH_MALLOC_PRODUCTION=3DYES</div><di= v dir=3D"auto">WITHOUT_LLVM_ASSERTIONS=3Dyes</div><div dir=3D"auto"><br></d= iv><div dir=3D"auto">This may only give a result in subsequent builds, not = on the first build or when a lot or something essential has changed. <= /div><div dir=3D"auto"><br></div><div dir=3D"auto">Note (just in case...) t= he make jobs number you use is not used for the world, only for ports. For = the world/kernel build it's really the -j option. </div><div dir=3D"au= to"><br></div><div dir=3D"auto">Bye, </div><div dir=3D"auto">Alexander= . </div><div dir=3D"auto"><br></div><div id=3D"aqm-signature" dir=3D"a= uto" style=3D"color: black;"><div dir=3D"auto">-- </div><div dir=3D"au= to">Send from a mobile device, please forgive brevity and misspellings.</di= v></div><div dir=3D"auto"><br></div> <div id=3D"aqm-original" style=3D"color: black;"> <div dir=3D"auto">Am 28. Oktober 2024 02:50:38 schrieb "Maku Bex" <zagaz= aw2004@gmail.com>:</div> <div><br></div> <blockquote type=3D"cite" class=3D"gmail_quote" style=3D"margin: 0 0 0 0.75= ex; border-left: 1px solid #808080; padding-left: 0.75ex;"> <div dir=3D"auto">Hi David,</div> <div dir=3D"auto"><br></div> <div dir=3D"auto">* What (if any) "max_jobs" (make's "-j" parameter) are yo= u using? 16</div> <div dir=3D"auto"><br></div> <div dir=3D"auto">* For a 16T system, I expect I would start with a value o= f around 28. Shouldn't this number be equal to $(nproc --all)?</div> <div dir=3D"auto"><br></div> <div dir=3D"auto">* Are you using make's "meta" mode? I do. Yes.</div= > <div dir=3D"auto"><br></div> <div dir=3D"auto">* Can you get more memory for that system? Yes, I can bum= p it to 32GB. This is a Dell OptiPlex 7080 Micro, and not sure if it is wor= th upgrading the other components.</div> <div dir=3D"auto"><br></div> <div dir=3D"auto">If your laptop can complete the builds in such a small am= ount of time, then there's either something wrong with my machine or the co= nfig files. Oh! The build just finished as I was typing this reply and...(n= ot for the weak hearts):</div> <div dir=3D"auto"><br></div> <div dir=3D"auto">---------------------------------------------------------= -----</div> <blockquote type=3D"cite" class=3D"gmail_quote" style=3D"margin: 0 0 0 0.75= ex; border-left: 1px solid #0099CC; padding-left: 0.75ex;"> <blockquote type=3D"cite" class=3D"gmail_quote" style=3D"margin: 0 0 0 0.75= ex; border-left: 1px solid #9933CC; padding-left: 0.75ex;"> <blockquote type=3D"cite" class=3D"gmail_quote" style=3D"margin: 0 0 0 0.75= ex; border-left: 1px solid #669900; padding-left: 0.75ex;"> <div dir=3D"auto">World built in 32437 seconds, ncpu: 16</div> </blockquote> </blockquote> </blockquote> <div dir=3D"auto">---------------------------------------------------------= ----- </div> <div dir=3D"auto"><br></div> <div dir=3D"auto">Here are the contents of:</div> <div dir=3D"auto"><br></div> <div dir=3D"auto">make.conf:</div> <div dir=3D"auto"><br></div> <div dir=3D"auto">CPUTYPE?=3Dicelake-client</div> <div dir=3D"auto">CFLAGS=3D -O2 -pipe -march=3D${CPUTYPE}</div> <div dir=3D"auto">#CXXFLAGS=3D${CFLAGS}</div> <div dir=3D"auto">MACHINE_CPU+=3D avx512 avx2 avx sse42 sse41 ssse3 sse3 f1= 6c</div> <div dir=3D"auto">MAKE_JOBS_NUMBER=3D 16</div> <div dir=3D"auto">BATCH=3Dyes</div> <div dir=3D"auto">WRKDIRPREFIX=3D/var/ports/tmp</div> <div dir=3D"auto">CCACHE_DIR=3D/var/ccache/tmp</div> <div dir=3D"auto"><br></div> <div dir=3D"auto">OPTIONS_UNSET+=3D QT5 QT6 CUPS VESA SCFB TWM XCONSOLE XCL= OCK GNOME KDE EXAMPLES \</div> <div dir=3D"auto"> D= EBUG ASPELL NLS DOCS</div> <div dir=3D"auto">---------------------------------------------------------= ----------------------</div> <div dir=3D"auto">src-env.conf:</div> <div dir=3D"auto"><br></div> <div dir=3D"auto">WITH_META_MODE=3Dyes</div> <div dir=3D"auto">WITH_CCACHE_BUILD=3Dyes</div> <div dir=3D"auto">#WITH_DIRDEPS_BUILD=3Dyes <<fails</div> <div dir=3D"auto">#WITH_DIRDEPS_CACHE=3Dyes <<fails </div> <div dir=3D"auto"><br></div> <div dir=3D"auto">WITHOUT_TALK=3Dyes</div> <div dir=3D"auto">WITHOUT_TELNET=3Dyes</div> <div dir=3D"auto">WITHOUT_TFTP=3Dyes</div> <div dir=3D"auto">WITHOUT_IPFILTER=3Dyes</div> <div dir=3D"auto">WITHOUT_IPFW=3Dyes</div> <div dir=3D"auto">WITHOUT_FLOPPY=3Dyes</div> <div dir=3D"auto">WITHOUT_GAMES=3Dyes</div> <div dir=3D"auto">WITHOUT_BLUETOOTH=3Dyes</div> <div dir=3D"auto">WITHOUT_EE=3Dyes</div> <div dir=3D"auto">WITHOUT_FREEBSD_UPDATE=3Dyes</div> <div dir=3D"auto">WITHOUT_GPIO=3Dyes</div> <div dir=3D"auto">WITHOUT_MAIL=3Dyes</div> <div dir=3D"auto">WITHOUT_TESTS=3Dyes</div> <div dir=3D"auto">WITHOUT_AMD=3Dyes</div> <div dir=3D"auto">WITHOUT_CLANG=3Dyes</div> <div dir=3D"auto">WITHOUT_DEBUG_FILES=3Dyes</div> <div dir=3D"auto">WITHOUT_EXAMPLES=3Dyes</div> <div dir=3D"auto">WITHOUT_HYPERV=3Dyes</div> <div dir=3D"auto"><br></div> <div dir=3D"auto">Happy Hacking,</div> <div dir=3D"auto"><br></div> <div dir=3D"auto">-----BEGIN PGP PUBLIC KEY BLOCK-----</div> <div dir=3D"auto"><br></div> <div dir=3D"auto">mJMEZlPMfxMFK4EEACMEIwQA/hAHZ4KNJLw5eRl6DAOyzkuHQ7PaK2hTY= LVIPoxC</div> <div dir=3D"auto">sCe8lB/hzET5KxMW9GXgFgPaSP7Es+ul6ajyq8pr9DeGnXUAFymi7GoT1= kLIqgrn</div> <div dir=3D"auto">X+rDAwMk9JNEElTmVNvgKWv/G+pSg2rAQ8sIw6smgckA0CaX1JdcNavrH= DgKMO4u</div> <div dir=3D"auto">Duo44Te0BkpPTUlTTYjbBBMTCgBBFiEENyUvu5bQVBXM019e8anbed+sQ= 8YFAmZT</div> <div dir=3D"auto">zH8CGwMFCQHnaREFCwkIBwICIgIGFQoJCAsCBBYCAwECHgcCF4AACgkQ8= anbed+s</div> <div dir=3D"auto">Q8Y5BgIHcX19jz0KP89uTmqvLGZcKsITDJKweAnccCZRS8hvXT8JBwR1L= yxsBBKF</div> <div dir=3D"auto">++eN2JJasZLo+s6sy7pDMN+9z4Gkdy0CCOj+arfLdvajfzdK4QeKpINfp= a2SkQD1</div> <div dir=3D"auto">CP98lvfI/luIbetUVW+qNDkzT1jZphYuzgsCaofTGCIQpFk19q22ZcZqu= JcEZlPM</div> <div dir=3D"auto">fxIFK4EEACMEIwQANy4VvpnTHneZipCPwzVJnMN82coCudRAiL2i2m3GP= A06lRtU</div> <div dir=3D"auto">njcn9r9Sm26A0sajwc3kQw/ekWrHXpXV0aL076cAUW9GKYDljIHVlr76w= gHbLt6q</div> <div dir=3D"auto">BX5VkA6xS0cq3skbMEI0QpIqIK81Yf0z8wfyF5uqAgNPUpY4nHMV9S856= JB2VDQD</div> <div dir=3D"auto">AQoJiMEEGBMKACYWIQQ3JS+7ltBUFczTX17xqdt536xDxgUCZlPMfwIbD= AUJAedp</div> <div dir=3D"auto">EQAKCRDxqdt536xDxjIuAgjacZCttPWpKGfMbnNWePz6t9rcMUb496tSW= fKRActr</div> <div dir=3D"auto">Rco8lSaDNTVohT/6hLZ5wUX5NFUqTb+kOXJcUGHGbnw2KQIJAQu1m9zEP= 5XdWmFi</div> <div dir=3D"auto">SvGg1NHW2kzqAvFsG37flbwrGRu5fmTnS/LZ/oPzOCuwU6F+o1q0E7gLw= FwnzD93</div> <div dir=3D"auto">riKeabdd</div> <div dir=3D"auto">=3DiCV+</div> <div dir=3D"auto">-----END PGP PUBLIC KEY BLOCK-----</div> <div dir=3D"auto"><br></div> <div dir=3D"auto">-----Original Message-----</div> <div dir=3D"auto">From: David Wolfskill <david@catwhisker.org> <= /div> <div dir=3D"auto">Sent: Sunday, October 27, 2024 19:50</div> <div dir=3D"auto">To: Maku Bex <zagazaw2004@gmail.com></div> <div dir=3D"auto">Cc: freebsd-current@freebsd.org</div> <div dir=3D"auto">Subject: Re: speedup build time</div> <div dir=3D"auto"><br></div> <div dir=3D"auto">On Sun, Oct 27, 2024 at 07:00:17PM -0500, Maku Bex wrote:= </div> <blockquote type=3D"cite" class=3D"gmail_quote" style=3D"margin: 0 0 0 0.75= ex; border-left: 1px solid #0099CC; padding-left: 0.75ex;"> <div dir=3D"auto">...</div> <div dir=3D"auto">I'm trying to figure out a way to decrease build time of = -CURRENT </div> <div dir=3D"auto">and/or -STABLE but it is not working out that well.</div> <div dir=3D"auto">I've tried the following:</div> <div dir=3D"auto">*=09Tuning /etc/make.conf and /etc/src-env.conf based on = their manpages</div> <div dir=3D"auto">(make.conf(5), make(1), src.conf(5)).</div> <div dir=3D"auto">*=09Removed certain options from GENERIC, which reduced t= he kernel build</div> <div dir=3D"auto">time significantly. </div> <div dir=3D"auto"><br></div> <div dir=3D"auto">Hardware specs:</div> <div dir=3D"auto">*=09I7-10700T 8C/16T @2.0GHz.</div> <div dir=3D"auto">*=0916GB RAM.</div> <div dir=3D"auto">*=09256GB NVMe.</div> <div dir=3D"auto"><br></div> <div dir=3D"auto">Currently, 'make buildworld' has been running for 7hrs an= d counting. </div> <div dir=3D"auto">Is there anything else I can do to speed up world build?<= /div> <div dir=3D"auto">....</div> </blockquote> <div dir=3D"auto"><br></div> <div dir=3D"auto">First, some questions -- whether or not you wish to share= the answers, I believe that answering the questions (if only for yourself)= may be</div> <div dir=3D"auto">helpful:</div> <div dir=3D"auto"><br></div> <div dir=3D"auto">* What (if any) "max_jobs" (make's "-j" parameter) are yo= u using? For a</div> <div dir=3D"auto"> 16T system, I expect I would start with a value of= around 28.</div> <div dir=3D"auto"><br></div> <div dir=3D"auto">* Are you using make's "meta" mode? I do.</div> <div dir=3D"auto"><br></div> <div dir=3D"auto">* Can you get more memory for that system?</div> <div dir=3D"auto"><br></div> <div dir=3D"auto">Some context: I am in the (definitely peculiar; per= haps unfortunate) habit of "tracking" FreeBSD head and latest stable branch= on a small collection of machines ... daily. One of those is the lap= top that I use for normal "desktop" stuff, as well as accessing all other m= achines on the planet that I access. (Oh: I also update ports daily, = too -- though I let my dedicated "build machine" handle chromium.)</div> <div dir=3D"auto"><br></div> <div dir=3D"auto">That laptop has 4C/8T & 32 GB RAM. This morning= , it took:</div> <div dir=3D"auto"><br></div> <div dir=3D"auto">* 17:46 for stable/14-n269310-bbd018d0aaaf -> stable/1= 4-n269315-b21c677ed28a</div> <div dir=3D"auto"> (0:02 to update /usr/src; 17:44 to build; 0:00 to = delete old libraries)</div> <div dir=3D"auto"><br></div> <div dir=3D"auto">* 24:03 for main-n273250-9d585fc395c3 -> main-n273270-= cadb71e4b013</div> <div dir=3D"auto"> (0:03 to update /usr/src; 23:59 to build; 0:01 to = delete old libraries)</div> <div dir=3D"auto"><br></div> <div dir=3D"auto">* Updating ports (other than www/chromium) took 1:52.</di= v> <div dir=3D"auto"><br></div> <div dir=3D"auto">(Those times are "mm:ss" in case it wasn't obvious.)</div= > <div dir=3D"auto"><br></div> <div dir=3D"auto">The above is fairly classic "sample size of 1" -- it's no= t necessarily representative. Folks who are "sufficiently interested"= are welcome to trawl through the logs at https://www.catwhisker.org/~david= /FreeBSD/history/ to get a rough idea of how long it is before the "uname" = output from a successful build is logged; there is probably some correlatio= n to build times.</div> <div dir=3D"auto"><br></div> <div dir=3D"auto">I also recently acquired a replacement "build machine": 6= 4C/128T; 256 GB RAM; a fistful of SATA SSDs (build/boot on one; the rest is= a poudriere play area in a zraid). That's a wee bit faster than the = laptop. :-)</div> <div dir=3D"auto"><br></div> <div dir=3D"auto">Peace,</div> <div dir=3D"auto">david</div> <div dir=3D"auto">-- </div> <div dir=3D"auto">David H. Wolfskill &nb= sp; david@cat= whisker.org</div> <div dir=3D"auto">It has been said that history repeats itself. This is per= haps not quite correct; it merely rhymes. -- Theodor Reik</div> <div dir=3D"auto"><br></div> <div dir=3D"auto">See https://www.catwhisker.org/~david/publickey.gpg for m= y public key.</div> </blockquote> </div><div dir=3D"auto"><br></div> </div></body> </html> --192d2924626520e28056d47bab--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?192d2702590.2805.fa4b1493b064008fe79f0f905b8e5741>