From owner-freebsd-net@FreeBSD.ORG Sun Jan 3 17:35:16 2010 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 021971065693 for ; Sun, 3 Jan 2010 17:35:16 +0000 (UTC) (envelope-from barney_cordoba@yahoo.com) Received: from web63904.mail.re1.yahoo.com (web63904.mail.re1.yahoo.com [69.147.97.119]) by mx1.freebsd.org (Postfix) with SMTP id 9C70E8FC14 for ; Sun, 3 Jan 2010 17:35:15 +0000 (UTC) Received: (qmail 81279 invoked by uid 60001); 3 Jan 2010 17:35:10 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1262540110; bh=RsNpfy/410vb8ZnQASQsHpnDvjOavl41ItdTG6k81V8=; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:Cc:MIME-Version:Content-Type:Content-Transfer-Encoding; b=m3IswwgoaDHxjmiMu2ffOMx2D+B2T0ulWT7AjSLsTsKfXIYB6GPW4jbel7QeI7HN7uYpwzzXUne8UHJuEQES8amso2u3O2foBGKCb5wzd8MgJ4ZVZUaCVpPRxs9PQYw18WG/1K4KbNdLlDo6hTT7Cy/gBghmiqDxuA5ibY/uLKY= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:Cc:MIME-Version:Content-Type:Content-Transfer-Encoding; b=lOlqg/P7cd3MQs7hhQbrBkZCl5NYuCUkksLbpxczYciR/YqGL63cwsnKuH+tX7niNhMJzr4cPfo+tRV9rjaTF4BjGIcL9BduHwjbypaKUWJOlWczHtttc6+7fY/Gc8DbAPWT9Xd9N5V7Ps0yuodsxaA4d92lKfWMz0QrI+8K47I=; Message-ID: <608024.81055.qm@web63904.mail.re1.yahoo.com> X-YMail-OSG: I0xJq5gVM1kShWWIsbVQPscb8rDOl2e4n_CLMH4oNbcpFWM8nQkDoTz_CRcKEPV61da3d2EC2JVG9G55qHtbH5XfUHq6_BqtcXVsPAlEeLkZ.o.rBGYY1YBqjyp6_nJ_uL_A4c0GwhuLDlhYOEk2zHvczLr9KfjIklLckQiQd7w5qJUoqBAumAL9_oIKz6JZDSp2p8f7PLZwr_SegMeUKrr9cD2NpIcVEPl8XOPgAtnvZrMPvG3ZmY4pX0Opj2JGc4iB0I9B663oVhgIVxSBr2NgNKukQXJscCkElOmHoGjsdECWL1lIJrc5faE- Received: from [98.203.21.152] by web63904.mail.re1.yahoo.com via HTTP; Sun, 03 Jan 2010 09:35:10 PST X-Mailer: YahooMailClassic/9.0.20 YahooMailWebService/0.8.100.260964 Date: Sun, 3 Jan 2010 09:35:10 -0800 (PST) From: Barney Cordoba To: =?iso-8859-1?Q?Michael_T=FCxen?= MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable Cc: freebsd-net@freebsd.org, Mike Tancsa Subject: Re: igb interrupt moderation X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 03 Jan 2010 17:35:16 -0000 --- On Sun, 1/3/10, Michael T=FCxen wrot= e:=0A=0A> From: Michael T=FCxen =0A> Subj= ect: Re: igb interrupt moderation=0A> To: "Barney Cordoba" =0A> Cc: freebsd-net@freebsd.org, "Mike Tancsa" = =0A> Date: Sunday, January 3, 2010, 12:14 PM=0A> On Jan 3, 2010, at 6:00 PM= , Barney=0A> Cordoba wrote:=0A> =0A> > =0A> > =0A> > --- On Sun, 1/3/10, Mi= chael T=FCxen =0A> wrote:=0A> > =0A> >> F= rom: Michael T=FCxen =0A> >> Subject: Re:= igb interrupt moderation=0A> >> To: "Mike Tancsa" =0A> >>= Cc: "Barney Cordoba" ,=0A> jfvogel@gmail.com,=0A= > freebsd-net@freebsd.org=0A> >> Date: Sunday, January 3, 2010, 11:38 AM=0A= > >> On Jan 3, 2010, at 5:23 PM, Mike=0A> >> Tancsa wrote:=0A> >> =0A> >>> = At 11:13 AM 1/3/2010, Michael T=FCxen wrote:=0A> >>>>> =0A> >>>>> Just a se= parate datapoint about this=0A> driver,=0A> >> unless I apply=0A> >>>>> =0A= > >>>>> http://people.freebsd.org/~yongari/igb/igb.buf.patch6=0A> >>>>> =0A= > >>>>> the driver is not really usable for me=0A> in=0A> >> RELENG_8 on th= e dual port version of the card=0A> >>>> Could you elaborate on what you me= an by=0A> "not=0A> >> really usable"?=0A> >>> =0A> >>> =0A> >>> Hi,=0A> >>>= =A0 =A0 =A0 =A0=A0=A0Some=0A> link state issues=0A> >> (getting confused ab= out what port is up), problems=0A> at high=0A> >> packet rates.=A0 I dont h= ave this card in=0A> production, but=0A> >> in my test environment it was m= uch more stable on=0A> RELENG_8=0A> >> with the above patch in that I was n= ot able to=0A> wedge the=0A> >> box.=A0 pps rates were pretty ok on a low e= nd=0A> i7 as=0A> >> well.=0A> >> Thanks for the information. I'll give it a= try. I=0A> have a=0A> >> problem when I flood=0A> >> a system with SCTP IN= ITs. The system under attack=0A> becomes=0A> >> completely unresponsive=0A>= >> on the console. However, it continues to send=0A> INIT-ACKs=0A> >> back= . After the last=0A> >> commit from Jack it recovers after the attack. Not= =0A> yet sure=0A> >> what is going on.=0A> >> Using the em driver does not = have the problem.=0A> However,=0A> >> when using the em=0A> >> driver only = one core is fully used, when using the=0A> igb=0A> >> driver both cores are= fully=0A> >> used. Unfortunately I do not have a more than dual=0A> core= =0A> >> machine available for=0A> >> this testing...=0A> > =0A> > Try em an= d lower the interrupt moderation to something=0A> like 500 (about=0A> > 100= packets per int is good). The latency isn't going=0A> to be noticable and= =0A> > you'll see your cpu burden reduced quite a bit. =0A> I'll try. Thank= s.=0A> > =0A> > Are you using a single NIC on a server, or do you have=0A> = a firewall or=0A> > bridge?=0A> The system is a sender/receiver for SCTP. I= 'm interested in=0A> the 82576=0A> since it provides checksum offloading fo= r it. I use one or=0A> two ports=0A> for simultaneous data transfer. The ca= rds using the em=0A> driver do=0A> not support this feature. So I'm trying = to verify that the=0A> performance=0A> goes up when using hardware checksum= . But under attack,=0A> this is currently=0A> not the case... =0A> > =0A> >= Barney=0A=0AI usually try to find something that actually works before I w= orry=0Aabout special features. But we all work differently.=0A=0ABarney=0A= =0A=0A