Date: Mon, 19 Nov 2018 18:17:05 +0530 From: Steevan Rodrigues <steevanxperia@gmail.com> To: se@freebsd.org Cc: mad@madpilot.net, freebsd-hackers@freebsd.org, =?UTF-8?Q?V=C3=A1clav_Haisman?= <vhaisman@gmail.com> Subject: Re: FreeBSD 11.x thread creation time is 9000+ microseconds on Intel Xeon Gold series CPU Message-ID: <CAKsGTHQ%2Bjn6%2BY_vu4ArsE8LDQH-r9fYMEUeD_fU1OtOCyTbH_g@mail.gmail.com> In-Reply-To: <0f7e583f-9ad9-f210-4bdb-1ace13ab8c5f@freebsd.org> References: <CAKsGTHQnaEsqmf_g%2BhH=agmfJ5Z4sZY8qkw1iJWyOF=1e6qm-g@mail.gmail.com> <7bb8463e-aa5d-bade-7ae7-6c612bae65f9@gmail.com> <CAKsGTHTLAaPW6P94J_uv%2ByPpOv9FuZZQQjBDYV-vTJUDYZSa%2Bg@mail.gmail.com> <e5333ed8-9788-41e0-5c75-c72af1525029@madpilot.net> <CAKsGTHRUUxW0Ww-0HXKN-S-r9V5Sj1ZU%2BDgdQ1ObHg75RkGxCQ@mail.gmail.com> <0f7e583f-9ad9-f210-4bdb-1ace13ab8c5f@freebsd.org>
next in thread | previous in thread | raw e-mail | index | archive | help
I tried FreeBSD 12 Beta 3 version on this server with Xeon Gold 5115 CPU. All these problems have disappeared. Thread creation time has improved greatly . It is now below 100 usec ( in FreeBSD 11.x 9000+ usec) Also I had another issue with FreeBSD 11.x which related to contigmalloc and contigfree . Actually contigfree was taking too much time on FreeBSD 11.x on this same server with Xeon Gold 5115 CPU. In FreeBSD 12 Beta3 also contigfree takes much more time compared to contigmalloc. However when I compare the values to FreeBSD 11.x number I can see huge improvement in FreeBSD 12 Beta 3 . Because of this contigfree issue my driver unload used to take 5 to 20 minutes in FreeBSD 11.x. Now my driver takes only a few seconds to load and a few seconds to unload in FreeBSD 12. BEta 3. Hence it looks like the problem is with FreeBSD 11.x. I am still waiting for final release version of FreeBSD 12.0 Regards, Steevan On Tue, Nov 6, 2018 at 6:18 PM Stefan Esser <se@freebsd.org> wrote: > Am 06.11.18 um 12:05 schrieb Steevan Rodrigues: > > Thanks to all of you for the quick responses. > > > > I see this issue only on a particular server. > > I do not see this issue on another server with slightly older processor > > Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz (dual socket 6 core per > socket) > > In this system the same program takes only about 800 usec > > > > I wonder whether it is problem with 11.x FreeBSD release on this > particular > > processor. > > I came across two results (given below) from Phoronix OSbench test suite > > which also show poor thread creation time for FreeBSD 11.x > > > > https://openbenchmarking.org/result/1804094-AR-1804096AR58 > > https://openbenchmarking.org/result/1807114-RA-WINDOWSSE47 > > > > In this look for "Create Threads" row. > > This list shows, that FreeBSD-12 is fast, only FreeBSD-11 shows the long > thread creation time (16000 vs 36 in whatever units), even though > FreeBSD-12 > was running with KPTI-Patches. > > This lets me think that the issue that caused these delays has been fixed, > but not merged to FreeBSD-11, yet.# > > I guess that the cause for the delays is the synchronization IPIs between > sockets, and that these might be very high due to some cores in deep sleep > modes (with corresponding long wake-up delays). > > Regards, STefan >
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAKsGTHQ%2Bjn6%2BY_vu4ArsE8LDQH-r9fYMEUeD_fU1OtOCyTbH_g>