Date: Wed, 27 Feb 2008 22:11:44 +0100 From: Holger Kipp <hk@intserv.int1.b.intern> To: Jack Vogel <jfvogel@gmail.com> Cc: freebsd-stable@freebsd.org Subject: Re: [solved/workaround?] Re: em very slow, shared irq... on 6.3p8 Message-ID: <20080227211144.GB28902@intserv.int1.b.intern> In-Reply-To: <2a41acea0802271216m2796f90fnb7650bc06c86ed25@mail.gmail.com> References: <20080227104942.GA14530@intserv.int1.b.intern> <200802271452.m1REqJ6H059687@lava.sentex.ca> <20080227195058.GA27997@intserv.int1.b.intern> <2a41acea0802271216m2796f90fnb7650bc06c86ed25@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
On Wed, Feb 27, 2008 at 12:16:27PM -0800, Jack Vogel wrote: > > Hmmm, something is really broken here that POLL just is just bypassing, > what was the adapter type exactly (pciconf -l). Sorry, but I must have > missed this email earlier. Problem is with em0-em13 that many share an IRQ 16/17, and because I was using 6.2-p8 and therefore did not have MSI enabled/available. Polling was also not compiled into the kernel. Polling alone will give times between 0.2 and 1.3 ms (with HZ=1000), and MSI alone (after activated during boot within loader.conf) will give best results (around 0.4 to 0.5 ms for a ping through firewall and back across two lans). This was then with 6.3-p1 Still, 6.3-p1 without msi and polling is still very slow in handling IRQs from the em-nics. I still don't know exactly why this took up to 1.5 seconds (sometimes even more) without MSI or POLLING. Please see my previous emails for dmesg. pciconf -l gives: em0@pci4:4:0: class=0x020000 card=0x11998086 chip=0x10b58086 rev=0x03 hdr=0x00 em1@pci4:4:1: class=0x020000 card=0x11998086 chip=0x10b58086 rev=0x03 hdr=0x00 em2@pci4:6:0: class=0x020000 card=0x11998086 chip=0x10b58086 rev=0x03 hdr=0x00 em3@pci4:6:1: class=0x020000 card=0x11998086 chip=0x10b58086 rev=0x03 hdr=0x00 em4@pci12:0:0: class=0x020000 card=0x10a48086 chip=0x10a48086 rev=0x06 hdr=0x00 em5@pci12:0:1: class=0x020000 card=0x10a48086 chip=0x10a48086 rev=0x06 hdr=0x00 em6@pci13:0:0: class=0x020000 card=0x10a48086 chip=0x10a48086 rev=0x06 hdr=0x00 em7@pci13:0:1: class=0x020000 card=0x10a48086 chip=0x10a48086 rev=0x06 hdr=0x00 em8@pci16:0:0: class=0x020000 card=0x10a48086 chip=0x10a48086 rev=0x06 hdr=0x00 em9@pci16:0:1: class=0x020000 card=0x10a48086 chip=0x10a48086 rev=0x06 hdr=0x00 em10@pci17:0:0: class=0x020000 card=0x10a48086 chip=0x10a48086 rev=0x06 hdr=0x00 em11@pci17:0:1: class=0x020000 card=0x10a48086 chip=0x10a48086 rev=0x06 hdr=0x00 em12@pci18:0:0: class=0x020000 card=0x108c15d9 chip=0x108c8086 rev=0x03 hdr=0x00 em13@pci19:0:0: class=0x020000 card=0x109a15d9 chip=0x109a8086 rev=0x00 hdr=0x00 We have one quad PCI-X 64bit card (the first four) and two quad PCI-Express cards. The last two devices are on-board ports. device = '82546GB PRO/1000 GT Quad Port Server Adapter' device = '82546GB PRO/1000 GT Quad Port Server Adapter' device = '82546GB PRO/1000 GT Quad Port Server Adapter' device = '82546GB PRO/1000 GT Quad Port Server Adapter' device = '82571EB Gigabit Ethernet Controller' device = '82571EB Gigabit Ethernet Controller' device = '82571EB Gigabit Ethernet Controller' device = '82571EB Gigabit Ethernet Controller' device = '82571EB Gigabit Ethernet Controller' device = '82571EB Gigabit Ethernet Controller' device = '82571EB Gigabit Ethernet Controller' device = '82571EB Gigabit Ethernet Controller' device = '82573E Intel Corporation 82573E Gigabit Ethernet Controller (Copper)' device = '82573L Intel PRO/1000 PL Network Adaptor' Is this helpful? Please let me know if you need anything else. Best regards, Holger Kipp
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20080227211144.GB28902>