Date: Fri, 14 Sep 2018 14:03:00 +0000 From: Glen Barber <gjb@freebsd.org> To: Mike Tancsa <mike@sentex.net> Cc: George Neville-Neil <gnn@neville-neil.com>, Paul Holes <pholes@sentex.ca>, Mateusz Guzik <mjguzik@gmail.com>, netperf-users@freebsd.org, netperf-admin@freebsd.org Subject: Re: update of zoo to r338656 12.0 (was Re: zoo vs 12.0 (was: zoo vs 11.2-rc2) Message-ID: <20180914140300.GB52847@FreeBSD.org> In-Reply-To: <ea0b113f-7b45-1ec3-f752-fcfa0ef7b2c0@sentex.net> References: <CAGudoHGb3FtoWAroBzVdDks6S2td-nnqJcdrkAsoiT_Q1PCYJQ@mail.gmail.com> <e3a7c7b6-e564-b5fe-ddad-6332bf6c96a0@sentex.net> <A344C6D5-BF69-48E8-8C0A-3610FE5BA15F@neville-neil.com> <b3f74263-127f-0b33-8d35-8e5c245cf826@sentex.net> <8ca07d41-b753-9741-49be-150d42197edc@sentex.net> <7dc50e6a-191b-002d-9adf-df16e591c9da@sentex.net> <ea0b113f-7b45-1ec3-f752-fcfa0ef7b2c0@sentex.net>
next in thread | previous in thread | raw e-mail | index | archive | help
[-- Attachment #1 --] Mike, In the interest of morbid curiosity, could you rebuild the 12.0 kernel without the 'options NUMA' line? This was turned on very late, and too close to the stable/12 branch, and I'd like to at least confirm this is not in any way at fault. Glen On Fri, Sep 14, 2018 at 09:37:23AM -0400, Mike Tancsa wrote: > > > On 9/14/2018 9:12 AM, Mike Tancsa wrote: > > On 9/13/2018 2:27 PM, Mike Tancsa wrote: > >> FYI, > >> I will be upgrading zoo's kernel (only the kernel) to -r338656 tomorrow > >> morning 9am zoo time, 13:00 UTC. > > > > > > The boot to a 12 kernel is not looking good. It seems to have issue with > > the mfi controller. Everything seems to post fine up until the timeouts. > > Going to try a hard power cycle of the box and then revert to the > > RELENG_11 kernel > > > > No luck even with a full power cycle. The 2 drives are part of the > pool's logs > > 0-zoo-# zpool status > pool: zroot > state: ONLINE > scan: scrub repaired 0 in 12h59m with 0 errors on Fri Dec 29 02:24:52 2017 > config: > > NAME STATE READ WRITE CKSUM > zroot ONLINE 0 0 0 > mirror-0 ONLINE 0 0 0 > diskid/DISK-WD-WCC137TALF5Kp3 ONLINE 0 0 0 > ada1 ONLINE 0 0 0 > mirror-1 ONLINE 0 0 0 > ada3p3 ONLINE 0 0 0 > ada4p3 ONLINE 0 0 0 > mirror-2 ONLINE 0 0 0 > ada5p3 ONLINE 0 0 0 > ada6p3 ONLINE 0 0 0 > logs > mirror-3 ONLINE 0 0 0 > mfid0p1 ONLINE 0 0 0 > mfid1p1 ONLINE 0 0 0 > cache > nvd0p2 ONLINE 0 0 0 > > errors: No known data errors > 0-zoo-# > > Not sure if we want to remove those. This controller is on the > motherboard, so I cant swap it out either. I have some MFI cards in the > lab. I will try them on a test box that is running HEAD, however, its > not the exact same card. > > For the onboard card, perhaps a firmware update might help ? > > 0-zoo-# mfiutil show firmware > mfi0 Firmware Package Version: 24.1.1-0001 > mfi0 Firmware Images: > Name Version Date Time Status > BIOS 6.13.00_4.14.05.00_0x06010600 09/05/2013 > 09/05/2013 > active > CTLR 5.01-0004 Sep 25 2013 10:39:54 active > APP 4.210.10-2910 Oct 30 2013 23:15:24 active > NVDT 3.1310.00-0054 Oct 31 2013 14:34:22 active > BTBL 3.00.00.00-0009 Mar 15 2013 17:01:49 active > 0-zoo-# > 0-zoo-# mfiutil show adapter > mfi0 Adapter: > Product Name: LSI 3108 MegaRAID ROMB > Serial Number: > Firmware: 24.1.1-0001 > RAID Levels: JBOD, RAID0, RAID1, RAID5, RAID6, RAID10, RAID50 > Battery Backup: not present > NVRAM: 32K > Onboard Memory: 2048M > Minimum Stripe: 64K > Maximum Stripe: 1M > 0-zoo-# > 0-zoo-# pciconf -lvcb mfi0 > mfi0@pci0:1:0:0: class=0x010400 card=0x080915d9 chip=0x005d1000 > rev=0x02 hdr=0x00 > vendor = 'LSI Logic / Symbios Logic' > device = 'MegaRAID SAS-3 3108 [Invader]' > class = mass storage > subclass = RAID > bar [10] = type I/O Port, range 32, base 0x6000, size 256, enabled > bar [14] = type Memory, range 64, base 0xc7300000, size 65536, enabled > bar [1c] = type Memory, range 64, base 0xc7200000, size 1048576, > enabled > cap 01[50] = powerspec 3 supports D0 D1 D2 D3 current D0 > cap 10[68] = PCI-Express 2 endpoint max data 256(4096) FLR NS > link x8(x8) speed 8.0(8.0) ASPM disabled(L0s) > cap 03[d0] = VPD > cap 05[a8] = MSI supports 1 message, 64 bit, vector masks enabled > with 1 message > cap 11[c0] = MSI-X supports 97 messages > Table in map 0x14[0xe000], PBA in map 0x14[0xf000] > ecap 0001[100] = AER 2 0 fatal 0 non-fatal 1 corrected > ecap 0019[1e0] = PCIe Sec 1 lane errors 0 > ecap 0004[1c0] = Power Budgeting 1 > ecap 0016[190] = DPA 1 > ecap 000e[148] = ARI 1 > 0-zoo-# > > > Not sure if that needs to be done through the MB bios or directly from MSI ? > > ---Mike > > > -- > ------------------- > Mike Tancsa, tel +1 519 651 3400 x203 > Sentex Communications, mike@sentex.net > Providing Internet services since 1994 www.sentex.net > Cambridge, Ontario Canada > [-- Attachment #2 --] -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEjRJAPC5sqwhs9k2jAxRYpUeP4pMFAlubv48ACgkQAxRYpUeP 4pPzXg//ZFNYTksyhgHBKCWYtb+H4Lr6x6gCzNmArlBgKQ2R8YIzKrxkjxmVlvYE 8I9M7LpdSIDZx4GqCBjSGc41m/SyeA+PJ8Edi94jt2c2tLi2NJYqHADbeS5ig7VX K6tsal0IUj8uHtEXy09Dmo2hEhDjm9G7tFYcvbbhy7oHsaveZiTqGZd5HDtXgYLm DTW/6vOKo0WeE4jbBR3SzZjKmL6p4B+mclLln/tMBSHxRALhhidWPC+7tb0Hd1ep vlGGAE73UFwZWvHsgC7B1epbDiguVHPM6lbuYEv3P9ELGCuhFnxVQ5y/ig8acYll iXnhYkqMA/TrI1TZNKnCdtN3hjc+KQlFjgU7VC1eSsoIlPqprimrgACd3XukjzJy rZxf1KZqlh4WuVhWVFCDP94F0DtMpdCozNpDPkLuaaBFzwwopiPigGReXz6wsRP3 9Al83LrjMfNtYSNEElskj7dEHX/H5EFmaO6yP4GcyKAGOnhDie4Kw1z+YzFXF6UG M7l54StLIzgKkX+J8MtrMivzKVHz2rW/GGJd4Q/EGSwZ/sp3uGYaRV95hkDc/5TW +BhRgfu2R0oe03rBn4xD8209uSwCLolsJ6JsyDDsyI/c6ABmyLYgJPuyYW90hlxo WsORLlGxZH9nuBS+688t9CBKsXTzB/Mb4R5/GdC6kly88wHFvuw= =2M+l -----END PGP SIGNATURE-----
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20180914140300.GB52847>