From owner-freebsd-stable@FreeBSD.ORG Thu May 27 10:30:32 2010 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 54D961065672 for ; Thu, 27 May 2010 10:30:32 +0000 (UTC) (envelope-from ykirill@yahoo.com) Received: from web120513.mail.ne1.yahoo.com (web120513.mail.ne1.yahoo.com [98.138.85.240]) by mx1.freebsd.org (Postfix) with SMTP id 19B038FC1C for ; Thu, 27 May 2010 10:30:31 +0000 (UTC) Received: (qmail 71338 invoked by uid 60001); 27 May 2010 10:30:31 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1274956231; bh=cw8TD0r8zgi4LM1CgawPiBrWdEWQdk8zPLJmYcfQTKQ=; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=j4yGHRsGd5AmXkdlrnvRL7mS+nOH/gEhL/5/cwLtTasj6DSLeCZutsIY2yjw5RLeYtM7+mvT6mueWRflx4eoaFKBBxUX2ntNzXuktxaG682tciWiVdEuir8Sn26DDiOGSXWce/ZGbnMd6oCR/Qs641woNkaQJjK5uCvqxWNOaBA= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=APcSkKpYZLP0nb/rehp2bAo6pmb85b0A8b5IRctsGsbV6lJHa1aef96xct+qPAiFRVuK1c08aYZRL24CtwKovN0CJTyXCsh5nQI5srsPtrO1wmKg+Shw0enFt+iTO7554JjHCJpWwlJ9OqZCOnLd6mosDM6fcE59TwGenEea2m0=; Message-ID: <619287.68177.qm@web120513.mail.ne1.yahoo.com> X-YMail-OSG: _DJQplMVM1nXj8zd4EmQPgOCvehaKntt1rUNYBRU0Pwv7Kj Gg_4- Received: from [212.74.229.235] by web120513.mail.ne1.yahoo.com via HTTP; Thu, 27 May 2010 03:30:31 PDT X-Mailer: YahooMailClassic/11.0.8 YahooMailWebService/0.8.103.269680 Date: Thu, 27 May 2010 03:30:31 -0700 (PDT) From: Kirill Yelizarov To: freebsd-stable@freebsd.org In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable Cc: Jack Vogel Subject: Re: Strange igb befavior X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 27 May 2010 10:30:32 -0000 Thank You Jack=0A=0Ai'll keep it at 2048 now. I have plans to add two more = igb interfaces. Should i decrease values to 1024 in case i will have four i= nterfaces in server?=0A=0AI found there are additional tweaks for igb card = available:=0Ahw.igb.enable_aim=3D1 this one enabled by default and i unders= tand its meaning=0AWhere can i read about the rest?=0Ahw.igb.low_latency=3D= 1000=0Ahw.igb.ave_latency=3D2000=0Ahw.igb.bulk_latency=3D4000=0Ahw.igb.rx_p= rocess_limit=3D400=0Ahw.igb.fc_setting=3D0=0Ahw.igb.lro=3D0=0A=0ASome years= ago i downloaded an article about em card from intel site. Perhaps there i= s one for igb as well?=0A=0AKirill=0A=0A--- On Thu, 5/27/10, Jack Vogel wrote:=0A=0A> From: Jack Vogel =0A> Sub= ject: Re: Strange igb befavior=0A> To: "Kirill Yelizarov" =0A> Cc: freebsd-stable@freebsd.org=0A> Date: Thursday, May 27, 2010, 1:0= 6 PM=0A> Panic is due to a failure to get=0A> enough mbufs, when you make= =A0 your ring that=0A> big=A0 you=0A> hit the problem, I have been experime= nting with a change to=0A> fix it but am=0A> not yet=0A> completely confide= nt, for the moment don't make your ring=0A> so big :)=0A> =0A> Jack=0A> =0A= > =0A> On Thu, May 27, 2010 at 1:08 AM, Kirill Yelizarov =0A> wrote:=0A> =0A> > Hi=0A> >=0A> > I'm having reproducible panics with = 8-Stable of May13=0A> 2010. Panic occurs in=0A> > igb code. Panic start to = happen when i set=0A> hw.igb.rxd=3D"4096" and=0A> > hw.igb.txd=3D"4096" in = /boot/loader.conf. Panic happens=0A> immediately after boot=0A> > in igb1 c= ode in my case. igb1 is connected to 100Mbit=0A> 3COM switch and switch=0A>= > is not connected to anything else.=0A> >=0A> > Here is dmesg for igb=0A>= > # dmesg | grep igb=0A> > igb0: - 1.9.5> port=0A> > 0x2020-0x203f mem=0A> 0xb1a20000-0xb1a3ffff,0x= b1a44000-0xb1a47fff irq 40 at=0A> > device 0.0 on pci1=0A> > igb0: Using MS= IX interrupts with 5 vectors=0A> > igb0: [ITHREAD]=0A> > igb0: [ITHREAD]=0A= > > igb0: [ITHREAD]=0A> > igb0: [ITHREAD]=0A> > igb0: [ITHREAD]=0A> > igb0:= Ethernet address: 00:15:17:ba:2e:00=0A> > igb1: - 1.9.5> port=0A> > 0x2000-0x201f mem=0A> 0xb1a0000= 0-0xb1a1ffff,0xb1a40000-0xb1a43fff irq 28 at=0A> > device 0.1 on pci1=0A> >= igb1: Using MSIX interrupts with 5 vectors=0A> > igb1: [ITHREAD]=0A> > igb= 1: [ITHREAD]=0A> > igb1: [ITHREAD]=0A> > igb1: [ITHREAD]=0A> > igb1: [ITHRE= AD]=0A> > igb1: Ethernet address: 00:15:17:ba:2e:01=0A> > igb1: link state = changed to UP=0A> > igb0: link state changed to UP=0A> >=0A> > border2# ifc= onfig=0A> > igb0:=0A> flags=3D8843= =0A> metric 0 mtu 1500=0A> >=A0 =A0 =A0 =A0=0A> options=3D13b=0A> >=A0 =A0 =A0 =A0 ether 00:15:1= 7:ba:2e:00=0A> >=A0 =A0 =A0 =A0 inet 192.168.10.2 netmask=0A> 0xffffff00 br= oadcast 192.168.10.255=0A> >=A0 =A0 =A0 =A0 inet 192.168.10.201 netmask=0A>= 0xffffffff broadcast 192.168.10.201=0A> >=A0 =A0 =A0 =A0 inet 192.168.10.2= 02 netmask=0A> 0xffffffff broadcast 192.168.10.202=0A> >=A0 =A0 =A0 =A0 ine= t 192.168.10.203 netmask=0A> 0xffffffff broadcast 192.168.10.203=0A> >=A0 = =A0 =A0 =A0 inet 192.168.10.204 netmask=0A> 0xffffffff broadcast 192.168.10= .204=0A> >=A0 =A0 =A0 =A0 media: Ethernet autoselect=0A> (1000baseT )=0A> >=A0 =A0 =A0 =A0 status: active=0A> > igb1:=0A> flags=3D8843=0A> metric 0 mtu 1500=0A> >=A0 =A0 = =A0 =A0=0A> options=3D13b=0A> >=A0 =A0 =A0 =A0 ether 00:15:17:ba:2e:01=0A> >=A0 =A0 =A0 =A0 inet= XXX.74.229.230 netmask=0A> 0xfffffff0 broadcast XXX.74.229.239=0A> >=A0 = =A0 =A0 =A0 inet XXX.74.229.226 netmask=0A> 0xffffffff broadcast XXX.74.229= .226=0A> >=A0 =A0 =A0 =A0 inet XXX.74.229.227 netmask=0A> 0xffffffff broadc= ast XXX.74.229.227=0A> >=A0 =A0 =A0 =A0 media: Ethernet autoselect=0A> (100= baseTX )=0A> >=A0 =A0 =A0 =A0 status: active=0A> > lo0: flags= =3D8049=0A> metric 0 mtu 16384=0A> >=A0 =A0 = =A0 =A0=0A> options=3D3=0A> >=A0 =A0 =A0 =A0 inet 127.0.0.1 = netmask=0A> 0xff000000=0A> > pfsync0: flags=3D0<> metric 0 mtu 1460=0A> >= =A0 =A0 =A0 =A0 syncpeer: 224.0.0.240=0A> maxupd: 128=0A> > pflog0: flags= =3D141 metric 0=0A> mtu 33152=0A> >=0A> > #pciconf -lv= =0A> > igb0@pci0:1:0:0:=A0 =A0 =A0 =A0=0A> class=3D0x020000 card=3D0x34de80= 86 chip=3D0x10a78086=0A> > rev=3D0x02 hdr=3D0x00=0A> >=A0 =A0 vendor=A0 =A0= =A0=A0=3D 'Intel=0A> Corporation'=0A> >=A0 =A0 device=A0 =A0=A0=A0=3D '8257= 5EB=0A> Gigabit Network Connection'=0A> >=A0 =A0 class=A0 =A0 =A0 =3D netwo= rk=0A> >=A0 =A0 subclass=A0=A0=A0=3D ethernet=0A> > igb1@pci0:1:0:1:=A0 =A0= =A0 =A0=0A> class=3D0x020000 card=3D0x34de8086 chip=3D0x10a78086=0A> > rev= =3D0x02 hdr=3D0x00=0A> >=A0 =A0 vendor=A0 =A0=A0=A0=3D 'Intel=0A> Corporati= on'=0A> >=A0 =A0 device=A0 =A0=A0=A0=3D '82575EB=0A> Gigabit Network Connec= tion'=0A> >=A0 =A0 class=A0 =A0 =A0 =3D network=0A> >=A0 =A0 subclass=A0=A0= =A0=3D ethernet=0A> >=0A> > # netstat -i=0A> > Name=A0 =A0 Mtu Network=A0 = =A0=0A> =A0=A0=A0Address=A0 =A0 =A0 =A0 =A0=0A> =A0 =A0 Ipkts Ierrs Idrop= =A0 =A0 Opkts=0A> > Oerrs=A0 Coll=0A> > igb0=A0=A0=A01500 =A0 =A0= =0A> =A0 00:15:17:ba:2e:00=A0 =A0=A0=A02315=A0=0A> =A0=A0=A00=A0 =A0=A0=A00= =A0 =A0=0A> 1415=0A> >=A0=A0=A00=A0 =A0=A0=A00=0A> > igb0=A0=A0=A01500 192.= 168.10.0=A0=0A> border2=A0 =A0 =A0 =A0 =A0 =A0=0A> =A0=A0=A01664=A0 =A0=A0= =A0-=A0=0A> =A0=A0=A0-=A0 =A0=A0=A01412=0A> >=A0=A0=A0-=A0 =A0=A0=A0-=0A> >= igb0=A0=A0=A01500 192.168.10.20=0A> mysql-border2=A0 =A0 =A0 =A0 =A0 =A0= =0A> 0=A0 =A0=A0=A0-=A0 =A0=A0=A0-=A0=0A> =A0 =A0 =A0 0=0A> >=A0=A0=A0-=A0 = =A0=A0=A0-=0A> > igb0=A0=A0=A01500 192.168.10.20=0A> apache-border2=A0 =A0 = =A0 =A0=0A> =A0=A0=A00=A0 =A0=A0=A0-=A0=0A> =A0=A0=A0-=A0 =A0 =A0 =A0 0=0A>= >=A0=A0=A0-=A0 =A0=A0=A0-=0A> > igb0=A0=A0=A01500 192.168.10.20=0A> squid-= border2=A0 =A0 =A0 =A0 =A0 =A0=0A> 0=A0 =A0=A0=A0-=A0 =A0=A0=A0-=A0=0A> =A0= =A0 =A0 0=0A> >=A0=A0=A0-=A0 =A0=A0=A0-=0A> > igb0=A0=A0=A01500 192.168.10= .20=0A> postgresql-border=A0 =A0 =A0 =A0 1=A0=0A> =A0=A0=A0-=A0 =A0=A0=A0-= =A0 =A0=0A> =A0 =A0 0=0A> >=A0=A0=A0-=A0 =A0=A0=A0-=0A> > igb1=A0=A0=A01500= =A0 =A0=0A> =A0 00:15:17:ba:2e:01=A0 =A0 =A0 129=A0=0A> =A0=A0=A00= =A0 =A0=A0=A00=A0 =A0=0A> =A0 =A0 0=0A> >=A0=A0=A00=A0 =A0=A0=A00=0A> > igb= 1=A0=A0=A01500 XXX.74.229.22 border2=A0=0A> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0= =0A> 0=A0 =A0=A0=A0-=A0 =A0=A0=A0-=A0=0A> =A0 =A0 =A0 0=0A> >=A0=A0=A0-=A0 = =A0=A0=A0-=0A> > igb1=A0=A0=A01500 XXX.74.229.22=0A> apache-border2=A0 =A0 = =A0 =A0=0A> =A0=A0=A00=A0 =A0=A0=A0-=A0=0A> =A0=A0=A0-=A0 =A0 =A0 =A0 0=0A>= >=A0=A0=A0-=A0 =A0=A0=A0-=0A> > igb1=A0=A0=A01500 XXX.74.229.22=0A> squid-= border2=A0 =A0 =A0 =A0 =A0 =A0=0A> 0=A0 =A0=A0=A0-=A0 =A0=A0=A0-=A0=0A> =A0= =A0 =A0 0=0A> >=A0=A0=A0-=A0 =A0=A0=A0-=0A> > lo0=A0=A0=A016384 = =A0 =A0=0A> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0=0A> =A0 =A0 =A0 =A0 =A0=A0=A01= =A0=0A> =A0=A0=A00=A0 =A0=A0=A00=A0 =A0=0A> =A0 =A0 1=0A> >=A0=A0=A00=A0 = =A0=A0=A00=0A> > lo0=A0=A0=A016384 your-net=A0 =A0=0A> =A0 localhost=A0 =A0= =A0 =A0 =A0 =A0=0A> =A0 =A0 0=A0 =A0=A0=A0-=A0=0A> =A0=A0=A0-=A0 =A0 =A0 = =A0 1=0A> >=A0=A0=A0-=A0 =A0=A0=A0-=0A> > pfsyn=A0 1460 =A0 =A0 =A0= =0A> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0=0A> =A0 =A0 =A0 =A0=A0=A00=A0=0A> =A0= =A0=A00=A0 =A0=A0=A00=A0 =A0=0A> =A0 =A0 0=0A> >=A0=A0=A00=A0 =A0=A0=A00=0A= > > pflog 33152 =A0 =A0 =A0 =A0=0A> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0= =0A> =A0 =A0 =A0=A0=A00=A0=0A> =A0=A0=A00=A0 =A0=A0=A00=A0 =A0=0A> =A0 =A0 = 0=0A> >=A0=A0=A00=A0 =A0=A0=A00=0A> >=0A> > There are several jails on this= server.=0A> >=0A> > When i set hw.igb.rxd=3D"2048" and hw.igb.txd=3D"2048"= i=0A> don't have panic=0A> > anymore.=0A> >=0A> > The reason i tried to ad= d more buffers than default is=0A> because i have NFS=0A> > export on this = server. But it is on igb0. igb1 is=0A> currently doing nothing=0A> > but it= will soon once the server will be ready for=0A> production.=0A> >=0A> > I = didn't get core dump because my system is rather=0A> old. But i can do it i= f=0A> > needed.=0A> >=0A> > Regards,=0A> > Kirill=0A> >=0A> >=0A> >=0A> > _= ______________________________________________=0A> > freebsd-stable@freebsd= .org=0A> mailing list=0A> > http://lists.freebsd.org/mailman/listinfo/freeb= sd-stable=0A> > To unsubscribe, send any mail to "freebsd-stable-unsubscrib= e@freebsd.org"=0A> >=0A> _______________________________________________=0A= > freebsd-stable@freebsd.org=0A> mailing list=0A> http://lists.freebsd.org/= mailman/listinfo/freebsd-stable=0A> To unsubscribe, send any mail to "freeb= sd-stable-unsubscribe@freebsd.org"=0A> =0A=0A=0A