From owner-netperf-users@freebsd.org Fri Sep 14 14:03:03 2018 Return-Path: Delivered-To: netperf-users@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4E53C1089637 for ; Fri, 14 Sep 2018 14:03:03 +0000 (UTC) (envelope-from gjb@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id EE1DE83247; Fri, 14 Sep 2018 14:03:02 +0000 (UTC) (envelope-from gjb@freebsd.org) Received: from FreeBSD.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by freefall.freebsd.org (Postfix) with ESMTPS id 97B771F3BC; Fri, 14 Sep 2018 14:03:02 +0000 (UTC) (envelope-from gjb@freebsd.org) Date: Fri, 14 Sep 2018 14:03:00 +0000 From: Glen Barber To: Mike Tancsa Cc: George Neville-Neil , Paul Holes , Mateusz Guzik , netperf-users@freebsd.org, netperf-admin@freebsd.org Subject: Re: update of zoo to r338656 12.0 (was Re: zoo vs 12.0 (was: zoo vs 11.2-rc2) Message-ID: <20180914140300.GB52847@FreeBSD.org> References: <8ca07d41-b753-9741-49be-150d42197edc@sentex.net> <7dc50e6a-191b-002d-9adf-df16e591c9da@sentex.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="hHWLQfXTYDoKhP50" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.10.1 (2018-07-13) X-BeenThere: netperf-users@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Announcements and discussions related to the netperf cluster. " List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 14 Sep 2018 14:03:03 -0000 --hHWLQfXTYDoKhP50 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Mike, In the interest of morbid curiosity, could you rebuild the 12.0 kernel without the 'options NUMA' line? This was turned on very late, and too close to the stable/12 branch, and I'd like to at least confirm this is not in any way at fault. Glen On Fri, Sep 14, 2018 at 09:37:23AM -0400, Mike Tancsa wrote: >=20 >=20 > On 9/14/2018 9:12 AM, Mike Tancsa wrote: > > On 9/13/2018 2:27 PM, Mike Tancsa wrote: > >> FYI, > >> I will be upgrading zoo's kernel (only the kernel) to -r338656 tomorr= ow > >> morning 9am zoo time, 13:00 UTC. > >=20 > >=20 > > The boot to a 12 kernel is not looking good. It seems to have issue with > > the mfi controller. Everything seems to post fine up until the timeouts. > > Going to try a hard power cycle of the box and then revert to the > > RELENG_11 kernel > >=20 >=20 > No luck even with a full power cycle. The 2 drives are part of the > pool's logs >=20 > 0-zoo-# zpool status > pool: zroot > state: ONLINE > scan: scrub repaired 0 in 12h59m with 0 errors on Fri Dec 29 02:24:52 2= 017 > config: >=20 > NAME STATE READ WRITE CKSUM > zroot ONLINE 0 0 0 > mirror-0 ONLINE 0 0 0 > diskid/DISK-WD-WCC137TALF5Kp3 ONLINE 0 0 0 > ada1 ONLINE 0 0 0 > mirror-1 ONLINE 0 0 0 > ada3p3 ONLINE 0 0 0 > ada4p3 ONLINE 0 0 0 > mirror-2 ONLINE 0 0 0 > ada5p3 ONLINE 0 0 0 > ada6p3 ONLINE 0 0 0 > logs > mirror-3 ONLINE 0 0 0 > mfid0p1 ONLINE 0 0 0 > mfid1p1 ONLINE 0 0 0 > cache > nvd0p2 ONLINE 0 0 0 >=20 > errors: No known data errors > 0-zoo-# >=20 > Not sure if we want to remove those. This controller is on the > motherboard, so I cant swap it out either. I have some MFI cards in the > lab. I will try them on a test box that is running HEAD, however, its > not the exact same card. >=20 > For the onboard card, perhaps a firmware update might help ? >=20 > 0-zoo-# mfiutil show firmware > mfi0 Firmware Package Version: 24.1.1-0001 > mfi0 Firmware Images: > Name Version Date Time Status > BIOS 6.13.00_4.14.05.00_0x06010600 09/05/2013 > 09/05/2013 > active > CTLR 5.01-0004 Sep 25 2013 10:39:54 active > APP 4.210.10-2910 Oct 30 2013 23:15:24 active > NVDT 3.1310.00-0054 Oct 31 2013 14:34:22 active > BTBL 3.00.00.00-0009 Mar 15 2013 17:01:49 active > 0-zoo-# > 0-zoo-# mfiutil show adapter > mfi0 Adapter: > Product Name: LSI 3108 MegaRAID ROMB > Serial Number: > Firmware: 24.1.1-0001 > RAID Levels: JBOD, RAID0, RAID1, RAID5, RAID6, RAID10, RAID50 > Battery Backup: not present > NVRAM: 32K > Onboard Memory: 2048M > Minimum Stripe: 64K > Maximum Stripe: 1M > 0-zoo-# > 0-zoo-# pciconf -lvcb mfi0 > mfi0@pci0:1:0:0: class=3D0x010400 card=3D0x080915d9 chip=3D0x005d1= 000 > rev=3D0x02 hdr=3D0x00 > vendor =3D 'LSI Logic / Symbios Logic' > device =3D 'MegaRAID SAS-3 3108 [Invader]' > class =3D mass storage > subclass =3D RAID > bar [10] =3D type I/O Port, range 32, base 0x6000, size 256, enabled > bar [14] =3D type Memory, range 64, base 0xc7300000, size 65536, en= abled > bar [1c] =3D type Memory, range 64, base 0xc7200000, size 1048576, > enabled > cap 01[50] =3D powerspec 3 supports D0 D1 D2 D3 current D0 > cap 10[68] =3D PCI-Express 2 endpoint max data 256(4096) FLR NS > link x8(x8) speed 8.0(8.0) ASPM disabled(L0s) > cap 03[d0] =3D VPD > cap 05[a8] =3D MSI supports 1 message, 64 bit, vector masks enabled > with 1 message > cap 11[c0] =3D MSI-X supports 97 messages > Table in map 0x14[0xe000], PBA in map 0x14[0xf000] > ecap 0001[100] =3D AER 2 0 fatal 0 non-fatal 1 corrected > ecap 0019[1e0] =3D PCIe Sec 1 lane errors 0 > ecap 0004[1c0] =3D Power Budgeting 1 > ecap 0016[190] =3D DPA 1 > ecap 000e[148] =3D ARI 1 > 0-zoo-# >=20 >=20 > Not sure if that needs to be done through the MB bios or directly from MS= I ? >=20 > ---Mike >=20 >=20 > --=20 > ------------------- > Mike Tancsa, tel +1 519 651 3400 x203 > Sentex Communications, mike@sentex.net > Providing Internet services since 1994 www.sentex.net > Cambridge, Ontario Canada >=20 --hHWLQfXTYDoKhP50 Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEjRJAPC5sqwhs9k2jAxRYpUeP4pMFAlubv48ACgkQAxRYpUeP 4pPzXg//ZFNYTksyhgHBKCWYtb+H4Lr6x6gCzNmArlBgKQ2R8YIzKrxkjxmVlvYE 8I9M7LpdSIDZx4GqCBjSGc41m/SyeA+PJ8Edi94jt2c2tLi2NJYqHADbeS5ig7VX K6tsal0IUj8uHtEXy09Dmo2hEhDjm9G7tFYcvbbhy7oHsaveZiTqGZd5HDtXgYLm DTW/6vOKo0WeE4jbBR3SzZjKmL6p4B+mclLln/tMBSHxRALhhidWPC+7tb0Hd1ep vlGGAE73UFwZWvHsgC7B1epbDiguVHPM6lbuYEv3P9ELGCuhFnxVQ5y/ig8acYll iXnhYkqMA/TrI1TZNKnCdtN3hjc+KQlFjgU7VC1eSsoIlPqprimrgACd3XukjzJy rZxf1KZqlh4WuVhWVFCDP94F0DtMpdCozNpDPkLuaaBFzwwopiPigGReXz6wsRP3 9Al83LrjMfNtYSNEElskj7dEHX/H5EFmaO6yP4GcyKAGOnhDie4Kw1z+YzFXF6UG M7l54StLIzgKkX+J8MtrMivzKVHz2rW/GGJd4Q/EGSwZ/sp3uGYaRV95hkDc/5TW +BhRgfu2R0oe03rBn4xD8209uSwCLolsJ6JsyDDsyI/c6ABmyLYgJPuyYW90hlxo WsORLlGxZH9nuBS+688t9CBKsXTzB/Mb4R5/GdC6kly88wHFvuw= =2M+l -----END PGP SIGNATURE----- --hHWLQfXTYDoKhP50--