From owner-netperf-users@freebsd.org Fri Sep 14 14:18:11 2018 Return-Path: Delivered-To: netperf-users@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 385791089D25 for ; Fri, 14 Sep 2018 14:18:11 +0000 (UTC) (envelope-from gjb@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E0D4883A78; Fri, 14 Sep 2018 14:18:10 +0000 (UTC) (envelope-from gjb@freebsd.org) Received: from FreeBSD.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by freefall.freebsd.org (Postfix) with ESMTPS id 964D21F790; Fri, 14 Sep 2018 14:18:10 +0000 (UTC) (envelope-from gjb@freebsd.org) Date: Fri, 14 Sep 2018 14:18:08 +0000 From: Glen Barber To: Mike Tancsa Cc: George Neville-Neil , Paul Holes , Mateusz Guzik , netperf-users@freebsd.org, netperf-admin@freebsd.org Subject: Re: update of zoo to r338656 12.0 (was Re: zoo vs 12.0 (was: zoo vs 11.2-rc2) Message-ID: <20180914141808.GC52847@FreeBSD.org> References: <8ca07d41-b753-9741-49be-150d42197edc@sentex.net> <7dc50e6a-191b-002d-9adf-df16e591c9da@sentex.net> <20180914140300.GB52847@FreeBSD.org> <2dcd8d1b-12f3-1da7-673c-8d24bc0eb948@sentex.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="ZmUaFz6apKcXQszQ" Content-Disposition: inline In-Reply-To: <2dcd8d1b-12f3-1da7-673c-8d24bc0eb948@sentex.net> User-Agent: Mutt/1.10.1 (2018-07-13) X-BeenThere: netperf-users@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Announcements and discussions related to the netperf cluster. " List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 14 Sep 2018 14:18:11 -0000 --ZmUaFz6apKcXQszQ Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Sep 14, 2018 at 10:12:56AM -0400, Mike Tancsa wrote: > On 9/14/2018 10:03 AM, Glen Barber wrote: > > Mike, > >=20 > > In the interest of morbid curiosity, could you rebuild the 12.0 kernel > > without the 'options NUMA' line? This was turned on very late, and too > > close to the stable/12 branch, and I'd like to at least confirm this is > > not in any way at fault. > A couple of people are already working on the box. >=20 > If its an MFI driver issue, I could put a spare card in one of the zoo > members that makes use of NUMA and has more than one domain ? I just > tried a mfi card in an EPYC based machine with the same rev, and it > boots up OK. But his only has one NUMA domain. >=20 Yeah, this is why I want to rule out NUMA being a factor. > I think pig would have multiple numa domains as does flix1a which noone > seems to be on right now. >=20 The only machine at Sentex I access (or that I think I have access to) is zoo, so I don't know the specs of pig and flix1a, but based on vague recollection of flix1a, I believe it has multiple NUMA domains. So that would be an interesting test case. Does it also have an mfi controller? Glen --ZmUaFz6apKcXQszQ Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEjRJAPC5sqwhs9k2jAxRYpUeP4pMFAlubwyAACgkQAxRYpUeP 4pNWrw/+Mnae5vv/g38mgoLL5N5OQPG+3p+CMKynMBooONHkGHv6+6LdMDU5Uk1R b5xpiY7AZSGRFGiKnlekTvsogbWyW0grAbNTpE5xBumd+KkJ9ix1vftC1UmCULK0 v/O78K6ijiydh7G+t9Z3F55mOIAoR1gBNPzT4lTyzBkl9mnW8TAW4aDFOSGX6XlE 5ujiNtz560+zZU8+BUry01qkcQiTynFALydInqkxZMSeJzUTdstvWIMdBRGo9c4l 6hJNBv+5NVAE0PqTM3wDDZIttZ8wEn1I+GbyehFmGgLUTo+b8CIqqHwZtdPxZefg 3OVCDBI6nMGv77svYj22frz0ou1xindd3NUvLEZ02WqPg1ixqOd1Gn8vucCAe2nH iT0hreb9YzmsyKt9zafyh2sISXgTdDsyY1SiJ57s+A9PyyYLfAVidLWcX91bsFix 3NVYV+h5tspUUyo03wOyp6JcDs1FcdK4L76rsk88Iaea6gxJ50m7suTDwN2YWJgp 7fvAM+xrBvcUgwzWYDdd/1qtQioCNzTGgP8fyBIBO5/qPou2mBXa4pzs5xRcBjzR BIynMADM1TUohAyF1FnYM7U3nF53aMeAlso2/roMQJFOMPiE4KOEXgdnK2r82Dpl h83eWJToXLxL3Wnn6HBKwFRndW3CjkZVOa03C8co/NZZqYHaZto= =tx+Z -----END PGP SIGNATURE----- --ZmUaFz6apKcXQszQ--