Date: Fri, 10 Jun 2011 11:23:26 -0700 From: "Vogel, Jack" <jack.vogel@intel.com> To: Bartosz Stec <bartosz.stec@it4pro.pl>, Jeremy Chadwick <freebsd@jdc.parodius.com> Cc: FreeBSD Stable <freebsd-stable@FreeBSD.org> Subject: RE: Panic during kernel booting on HP Proliant DL180G6 and latest STABLE Message-ID: <1DB50624F8348F48840F2E2CF6040A9D018ACA75C7@orsmsx508.amr.corp.intel.com> In-Reply-To: <4DF1EB98.9080109@it4pro.pl> References: <4DC6A277.4030801@it4pro.pl> <4DC6E23B.2040207@it4pro.pl> <4DC81E22.5030806@it4pro.pl> <4DCC3844.6070008@it4pro.pl> <4DCD1672.4020405@FreeBSD.org> <4DF1DC26.5010600@it4pro.pl> <20110610093728.GA39453@icarus.home.lan> <4DF1EB98.9080109@it4pro.pl>
next in thread | previous in thread | raw e-mail | index | archive | help
Er, so what if you get rid of ZFS, does your panic go away? It doesn't rea= lly matter what type adapter it is, the igb driver only requests standard s= ize clusters, so memory is getting trashed somewhere I suspect. Jack From: Bartosz Stec [mailto:bartosz.stec@it4pro.pl] Sent: Friday, June 10, 2011 3:02 AM To: Jeremy Chadwick Cc: FreeBSD Stable; Vogel, Jack Subject: Re: Panic during kernel booting on HP Proliant DL180G6 and latest = STABLE W dniu 2011-06-10 11:37, Jeremy Chadwick pisze: On Fri, Jun 10, 2011 at 10:56:06AM +0200, Bartosz Stec wrote: W dniu 2011-05-13 13:30, Andriy Gapon pisze: on 12/05/2011 22:43 Bartosz Stec said the following: Allright, if anyone want to follow: http://www.freebsd.org/cgi/query-pr.cgi= ?pr=3D156974 I suspect that your best course here is to add some diagnostic printfs in igb_refresh_mbufs and in m_getzone to see what value is actually passed to m_getjcl and why. You're probably right, although I would need some guidance how to do it. Sorry :( Yesterday I rebuilt this machine with fresh sources to upgrade filesystem to ZFSv28 which was MFC'ed lately. After that server started to panic regardless of igb loaded as module or integrated into kernel. Finally I found that problem was caused by MSIX somehow. No more panic after hw.pci.enable_msix=3D0 was included in loader.conf. There's also no panic with GENERIC kernel. Should I really care abou MSIX? Yes, you absolutely should. The performance hit, depending on your interrupt load, can be quite dramatic with this turned off. Remember: what you just turned off was MSI-X for the *entire system*, not just for NICs. Please read about it here: http://en.wikipedia.org/wiki/Message_Signaled_Interrupts CC'ing Jack Vogel here, because your issue pertains to igb(4). Please provide output from "pciconv -lvcb" that pertain to your igb NIC(s), as well as relevant dmesg info that pertains to them (driver, etc.). You can XXX out MAC addresses if you're worried. Jack, original thread starts here: http://lists.freebsd.org/pipermail/freebsd-stable/2011-May/thread.html#6259= 6 Thanks Jeremy, you are helpful as always :) Full dmesg output (was already included in this thread): http://pastebin.co= m/Es0CKD64 #pciconf -lcvb hostb0@pci0:0:0:0: class=3D0x060000 card=3D0x330b103c chip=3D0x34068086 = rev=3D0x13 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'QuickPath Architecture I/O Hub to ESI Port' class =3D bridge subclass =3D HOST-PCI cap 05[60] =3D MSI supports 2 messages, vector masks cap 10[90] =3D PCI-Express 2 root port max data 128(128) link x4(x4) cap 01[e0] =3D powerspec 3 supports D0 D3 current D0 ecap 0001[100] =3D AER 1 0 fatal 0 non-fatal 0 corrected ecap 000d[150] =3D unknown 1 ecap 000b[160] =3D unknown 0 pcib1@pci0:0:1:0: class=3D0x060400 card=3D0x330b103c chip=3D0x34088086 r= ev=3D0x13 hdr=3D0x01 vendor =3D 'Intel Corporation' device =3D 'QuickPath Architecture I/O Hub PCI Express Root Port 1' class =3D bridge subclass =3D PCI-PCI cap 0d[40] =3D PCI Bridge card=3D0x330b103c cap 05[60] =3D MSI supports 2 messages, vector masks cap 10[90] =3D PCI-Express 2 root port max data 256(256) link x4(x4) cap 01[e0] =3D powerspec 3 supports D0 D3 current D0 ecap 0001[100] =3D AER 1 0 fatal 0 non-fatal 0 corrected ecap 000d[150] =3D unknown 1 ecap 000b[160] =3D unknown 0 pcib2@pci0:0:3:0: class=3D0x060400 card=3D0x330b103c chip=3D0x340a8086 r= ev=3D0x13 hdr=3D0x01 vendor =3D 'Intel Corporation' device =3D 'QuickPath Architecture I/O Hub PCI Express Root Port 3' class =3D bridge subclass =3D PCI-PCI cap 0d[40] =3D PCI Bridge card=3D0x330b103c cap 05[60] =3D MSI supports 2 messages, vector masks cap 10[90] =3D PCI-Express 2 root port max data 256(256) link x0(x16) cap 01[e0] =3D powerspec 3 supports D0 D3 current D0 ecap 0001[100] =3D AER 1 0 fatal 0 non-fatal 0 corrected ecap 000d[150] =3D unknown 1 ecap 000b[160] =3D unknown 0 pcib3@pci0:0:7:0: class=3D0x060400 card=3D0x330b103c chip=3D0x340e8086 r= ev=3D0x13 hdr=3D0x01 vendor =3D 'Intel Corporation' device =3D 'QuickPath Architecture I/O Hub PCI Express Root Port 7' class =3D bridge subclass =3D PCI-PCI cap 0d[40] =3D PCI Bridge card=3D0x330b103c cap 05[60] =3D MSI supports 2 messages, vector masks cap 10[90] =3D PCI-Express 2 root port max data 256(256) link x0(x16) cap 01[e0] =3D powerspec 3 supports D0 D3 current D0 ecap 0001[100] =3D AER 1 0 fatal 0 non-fatal 0 corrected ecap 000d[150] =3D unknown 1 ecap 000b[160] =3D unknown 0 pcib4@pci0:0:9:0: class=3D0x060400 card=3D0x330b103c chip=3D0x34108086 r= ev=3D0x13 hdr=3D0x01 vendor =3D 'Intel Corporation' device =3D 'QuickPath Architecture I/O Hub PCI Express Root Port 9' class =3D bridge subclass =3D PCI-PCI cap 0d[40] =3D PCI Bridge card=3D0x330b103c cap 05[60] =3D MSI supports 2 messages, vector masks cap 10[90] =3D PCI-Express 2 root port max data 256(256) link x0(x4) cap 01[e0] =3D powerspec 3 supports D0 D3 current D0 ecap 0001[100] =3D AER 1 0 fatal 0 non-fatal 0 corrected ecap 000d[150] =3D unknown 1 none0@pci0:0:20:0: class=3D0x080000 card=3D0x000b003c chip=3D0x342e8086 = rev=3D0x13 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'QuickPath Architecture I/O Hub System Management Regist= ers' class =3D base peripheral subclass =3D interrupt controller cap 10[40] =3D PCI-Express 2 root endpoint max data 128(128) link x0(x0= ) none1@pci0:0:20:1: class=3D0x080000 card=3D0x000b003c chip=3D0x34228086 = rev=3D0x13 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'QuickPath Architecture I/O Hub GPIO and Scratch Pad Reg= isters' class =3D base peripheral subclass =3D interrupt controller cap 10[40] =3D PCI-Express 2 root endpoint max data 128(128) link x0(x0= ) none2@pci0:0:20:2: class=3D0x080000 card=3D0x000b003c chip=3D0x34238086 = rev=3D0x13 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'QuickPath Architecture I/O Hub Control Status and RAS R= egisters' class =3D base peripheral subclass =3D interrupt controller cap 10[40] =3D PCI-Express 2 root endpoint max data 128(128) link x0(x0= ) uhci0@pci0:0:26:0: class=3D0x0c0300 card=3D0x330b103c chip=3D0x3a378086 = rev=3D0x00 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'USB UHCI Controller *4' class =3D serial bus subclass =3D USB bar [20] =3D type I/O Port, range 32, base 0xc800, size 32, enabled cap 13[50] =3D PCI Advanced Features: FLR TP ehci0@pci0:0:26:7: class=3D0x0c0320 card=3D0x330b103c chip=3D0x3a3c8086 = rev=3D0x00 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'USB EHCI Controller *2' class =3D serial bus subclass =3D USB bar [10] =3D type Memory, range 32, base 0xfaff8000, size 1024, enabl= ed cap 01[50] =3D powerspec 2 supports D0 D3 current D0 cap 0a[58] =3D EHCI Debug Port at offset 0xa0 in map 0x14 cap 13[98] =3D PCI Advanced Features: FLR TP pcib5@pci0:0:28:0: class=3D0x060400 card=3D0x330b103c chip=3D0x3a408086 = rev=3D0x00 hdr=3D0x01 vendor =3D 'Intel Corporation' device =3D 'PCI Express Port 1' class =3D bridge subclass =3D PCI-PCI cap 10[40] =3D PCI-Express 1 root port max data 128(128) link x0(x4) cap 05[80] =3D MSI supports 1 message cap 0d[90] =3D PCI Bridge card=3D0x330b103c cap 01[a0] =3D powerspec 2 supports D0 D3 current D0 ecap 0002[100] =3D VC 1 max VC0 ecap 0005[180] =3D unknown 1 pcib6@pci0:0:28:4: class=3D0x060400 card=3D0x330b103c chip=3D0x3a488086 = rev=3D0x00 hdr=3D0x01 vendor =3D 'Intel Corporation' device =3D 'PCI Express Port 5' class =3D bridge subclass =3D PCI-PCI cap 10[40] =3D PCI-Express 1 root port max data 128(128) link x1(x2) cap 05[80] =3D MSI supports 1 message cap 0d[90] =3D PCI Bridge card=3D0x330b103c cap 01[a0] =3D powerspec 2 supports D0 D3 current D0 ecap 0002[100] =3D VC 1 max VC0 ecap 0005[180] =3D unknown 1 uhci1@pci0:0:29:0: class=3D0x0c0300 card=3D0x330b103c chip=3D0x3a348086 = rev=3D0x00 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'USB UHCI Controller *1' class =3D serial bus subclass =3D USB bar [20] =3D type I/O Port, range 32, base 0xc880, size 32, enabled cap 13[50] =3D PCI Advanced Features: FLR TP uhci2@pci0:0:29:1: class=3D0x0c0300 card=3D0x330b103c chip=3D0x3a358086 = rev=3D0x00 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'USB UHCI Controller *2' class =3D serial bus subclass =3D USB bar [20] =3D type I/O Port, range 32, base 0xcc00, size 32, enabled cap 13[50] =3D PCI Advanced Features: FLR TP uhci3@pci0:0:29:2: class=3D0x0c0300 card=3D0x330b103c chip=3D0x3a368086 = rev=3D0x00 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'USB UHCI Controller *3' class =3D serial bus subclass =3D USB bar [20] =3D type I/O Port, range 32, base 0xd000, size 32, enabled cap 13[50] =3D PCI Advanced Features: FLR TP ehci1@pci0:0:29:7: class=3D0x0c0320 card=3D0x330b103c chip=3D0x3a3a8086 = rev=3D0x00 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'USB EHCI Controller *1' class =3D serial bus subclass =3D USB bar [10] =3D type Memory, range 32, base 0xfaffa000, size 1024, enabl= ed cap 01[50] =3D powerspec 2 supports D0 D3 current D0 cap 0a[58] =3D EHCI Debug Port at offset 0xa0 in map 0x14 cap 13[98] =3D PCI Advanced Features: FLR TP pcib7@pci0:0:30:0: class=3D0x060401 card=3D0x330b103c chip=3D0x244e8086 = rev=3D0x90 hdr=3D0x01 vendor =3D 'Intel Corporation' device =3D '82801 Family (ICH2/3/4/5/6/7/8/9,63xxESB) Hub Interface= to PCI Bridge' class =3D bridge subclass =3D PCI-PCI cap 0d[50] =3D PCI Bridge card=3D0x330b103c isab0@pci0:0:31:0: class=3D0x060100 card=3D0x330b103c chip=3D0x3a168086 = rev=3D0x00 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'LPC Interface Controller' class =3D bridge subclass =3D PCI-ISA cap 09[e0] =3D vendor (length 12) Intel cap 1 version 0 features: SATA RAID-5, 4 PCI-e x1 slots atapci0@pci0:0:31:2: class=3D0x010601 card=3D0x330b103c chip=3D0x3a22808= 6 rev=3D0x00 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D '6 port SATA AHCI Controller' class =3D mass storage subclass =3D SATA bar [10] =3D type I/O Port, range 32, base 0xd880, size 8, enabled bar [14] =3D type I/O Port, range 32, base 0xd800, size 4, enabled bar [18] =3D type I/O Port, range 32, base 0xd480, size 8, enabled bar [1c] =3D type I/O Port, range 32, base 0xd400, size 4, enabled bar [20] =3D type I/O Port, range 32, base 0xd080, size 32, enabled bar [24] =3D type Memory, range 32, base 0xfaffc000, size 2048, enabl= ed cap 05[80] =3D MSI supports 16 messages cap 01[70] =3D powerspec 3 supports D0 D3 current D0 cap 12[a8] =3D SATA Index-Data Pair cap 13[b0] =3D PCI Advanced Features: FLR TP igb0@pci0:7:0:0: class=3D0x020000 card=3D0x323f103c chip=3D0x10c98086 re= v=3D0x01 hdr=3D0x00 vendor =3D 'Intel Corporation' class =3D network subclass =3D ethernet bar [10] =3D type Memory, range 32, base 0xfbe60000, size 131072, ena= bled bar [14] =3D type Memory, range 32, base 0xfbe40000, size 131072, ena= bled bar [18] =3D type I/O Port, range 32, base 0xe880, size 32, enabled cap 01[40] =3D powerspec 3 supports D0 D3 current D0 cap 05[50] =3D MSI supports 1 message, 64 bit, vector masks enabled wit= h 1 message cap 11[70] =3D MSI-X supports 10 messages in map 0x1c cap 10[a0] =3D PCI-Express 2 endpoint max data 256(512) link x4(x4) ecap 0001[100] =3D AER 1 0 fatal 0 non-fatal 1 corrected ecap 0003[140] =3D Serial 1 d8d385ffffe3e4f6 ecap 000e[150] =3D unknown 1 ecap 0010[160] =3D unknown 1 igb1@pci0:7:0:1: class=3D0x020000 card=3D0x323f103c chip=3D0x10c98086 re= v=3D0x01 hdr=3D0x00 vendor =3D 'Intel Corporation' class =3D network subclass =3D ethernet bar [10] =3D type Memory, range 32, base 0xfbee0000, size 131072, ena= bled bar [14] =3D type Memory, range 32, base 0xfbec0000, size 131072, ena= bled bar [18] =3D type I/O Port, range 32, base 0xec00, size 32, enabled cap 01[40] =3D powerspec 3 supports D0 D3 current D0 cap 05[50] =3D MSI supports 1 message, 64 bit, vector masks enabled wit= h 1 message cap 11[70] =3D MSI-X supports 10 messages in map 0x1c cap 10[a0] =3D PCI-Express 2 endpoint max data 256(512) link x4(x4) ecap 0001[100] =3D AER 1 0 fatal 0 non-fatal 1 corrected ecap 0003[140] =3D Serial 1 d8d385ffffe3e4f6 ecap 000e[150] =3D unknown 1 ecap 0010[160] =3D unknown 1 vgapci0@pci0:2:0:0: class=3D0x030000 card=3D0x010019a2 chip=3D0x0522102b= rev=3D0x02 hdr=3D0x00 vendor =3D 'Matrox Electronic Systems Ltd.' device =3D 'Matrox G200e (ServerEngines) - English (G200e)' class =3D display subclass =3D VGA bar [10] =3D type Prefetchable Memory, range 32, base 0xf8000000, siz= e 16777216, enabled bar [14] =3D type Memory, range 32, base 0xfbdfc000, size 16384, enab= led bar [18] =3D type Memory, range 32, base 0xfb000000, size 8388608, en= abled cap 01[dc] =3D powerspec 2 supports D0 D3 current D0 cap 10[e4] =3D PCI-Express 1 legacy endpoint max data 128(128) link x1(= x1) cap 05[54] =3D MSI supports 1 message -- Bartosz Stec
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1DB50624F8348F48840F2E2CF6040A9D018ACA75C7>