Date: Thu, 27 May 2010 03:30:31 -0700 (PDT) From: Kirill Yelizarov <ykirill@yahoo.com> To: freebsd-stable@freebsd.org Cc: Jack Vogel <jfvogel@gmail.com> Subject: Re: Strange igb befavior Message-ID: <619287.68177.qm@web120513.mail.ne1.yahoo.com> In-Reply-To: <AANLkTikGCa4Zf9qIXin0XMghyPjbkZLjB9uAzoWr3JvA@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
Thank You Jack=0A=0Ai'll keep it at 2048 now. I have plans to add two more = igb interfaces. Should i decrease values to 1024 in case i will have four i= nterfaces in server?=0A=0AI found there are additional tweaks for igb card = available:=0Ahw.igb.enable_aim=3D1 this one enabled by default and i unders= tand its meaning=0AWhere can i read about the rest?=0Ahw.igb.low_latency=3D= 1000=0Ahw.igb.ave_latency=3D2000=0Ahw.igb.bulk_latency=3D4000=0Ahw.igb.rx_p= rocess_limit=3D400=0Ahw.igb.fc_setting=3D0=0Ahw.igb.lro=3D0=0A=0ASome years= ago i downloaded an article about em card from intel site. Perhaps there i= s one for igb as well?=0A=0AKirill=0A=0A--- On Thu, 5/27/10, Jack Vogel <jf= vogel@gmail.com> wrote:=0A=0A> From: Jack Vogel <jfvogel@gmail.com>=0A> Sub= ject: Re: Strange igb befavior=0A> To: "Kirill Yelizarov" <ykirill@yahoo.co= m>=0A> Cc: freebsd-stable@freebsd.org=0A> Date: Thursday, May 27, 2010, 1:0= 6 PM=0A> Panic is due to a failure to get=0A> enough mbufs, when you make= =A0 your ring that=0A> big=A0 you=0A> hit the problem, I have been experime= nting with a change to=0A> fix it but am=0A> not yet=0A> completely confide= nt, for the moment don't make your ring=0A> so big :)=0A> =0A> Jack=0A> =0A= > =0A> On Thu, May 27, 2010 at 1:08 AM, Kirill Yelizarov <ykirill@yahoo.com= >=0A> wrote:=0A> =0A> > Hi=0A> >=0A> > I'm having reproducible panics with = 8-Stable of May13=0A> 2010. Panic occurs in=0A> > igb code. Panic start to = happen when i set=0A> hw.igb.rxd=3D"4096" and=0A> > hw.igb.txd=3D"4096" in = /boot/loader.conf. Panic happens=0A> immediately after boot=0A> > in igb1 c= ode in my case. igb1 is connected to 100Mbit=0A> 3COM switch and switch=0A>= > is not connected to anything else.=0A> >=0A> > Here is dmesg for igb=0A>= > # dmesg | grep igb=0A> > igb0: <Intel(R) PRO/1000 Network Connection ver= sion=0A> - 1.9.5> port=0A> > 0x2020-0x203f mem=0A> 0xb1a20000-0xb1a3ffff,0x= b1a44000-0xb1a47fff irq 40 at=0A> > device 0.0 on pci1=0A> > igb0: Using MS= IX interrupts with 5 vectors=0A> > igb0: [ITHREAD]=0A> > igb0: [ITHREAD]=0A= > > igb0: [ITHREAD]=0A> > igb0: [ITHREAD]=0A> > igb0: [ITHREAD]=0A> > igb0:= Ethernet address: 00:15:17:ba:2e:00=0A> > igb1: <Intel(R) PRO/1000 Network= Connection version=0A> - 1.9.5> port=0A> > 0x2000-0x201f mem=0A> 0xb1a0000= 0-0xb1a1ffff,0xb1a40000-0xb1a43fff irq 28 at=0A> > device 0.1 on pci1=0A> >= igb1: Using MSIX interrupts with 5 vectors=0A> > igb1: [ITHREAD]=0A> > igb= 1: [ITHREAD]=0A> > igb1: [ITHREAD]=0A> > igb1: [ITHREAD]=0A> > igb1: [ITHRE= AD]=0A> > igb1: Ethernet address: 00:15:17:ba:2e:01=0A> > igb1: link state = changed to UP=0A> > igb0: link state changed to UP=0A> >=0A> > border2# ifc= onfig=0A> > igb0:=0A> flags=3D8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST>= =0A> metric 0 mtu 1500=0A> >=A0 =A0 =A0 =A0=0A> options=3D13b<RXCSUM,TXCSUM= ,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,TSO4>=0A> >=A0 =A0 =A0 =A0 ether 00:15:1= 7:ba:2e:00=0A> >=A0 =A0 =A0 =A0 inet 192.168.10.2 netmask=0A> 0xffffff00 br= oadcast 192.168.10.255=0A> >=A0 =A0 =A0 =A0 inet 192.168.10.201 netmask=0A>= 0xffffffff broadcast 192.168.10.201=0A> >=A0 =A0 =A0 =A0 inet 192.168.10.2= 02 netmask=0A> 0xffffffff broadcast 192.168.10.202=0A> >=A0 =A0 =A0 =A0 ine= t 192.168.10.203 netmask=0A> 0xffffffff broadcast 192.168.10.203=0A> >=A0 = =A0 =A0 =A0 inet 192.168.10.204 netmask=0A> 0xffffffff broadcast 192.168.10= .204=0A> >=A0 =A0 =A0 =A0 media: Ethernet autoselect=0A> (1000baseT <full-d= uplex>)=0A> >=A0 =A0 =A0 =A0 status: active=0A> > igb1:=0A> flags=3D8843<UP= ,BROADCAST,RUNNING,SIMPLEX,MULTICAST>=0A> metric 0 mtu 1500=0A> >=A0 =A0 = =A0 =A0=0A> options=3D13b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,T= SO4>=0A> >=A0 =A0 =A0 =A0 ether 00:15:17:ba:2e:01=0A> >=A0 =A0 =A0 =A0 inet= XXX.74.229.230 netmask=0A> 0xfffffff0 broadcast XXX.74.229.239=0A> >=A0 = =A0 =A0 =A0 inet XXX.74.229.226 netmask=0A> 0xffffffff broadcast XXX.74.229= .226=0A> >=A0 =A0 =A0 =A0 inet XXX.74.229.227 netmask=0A> 0xffffffff broadc= ast XXX.74.229.227=0A> >=A0 =A0 =A0 =A0 media: Ethernet autoselect=0A> (100= baseTX <full-duplex>)=0A> >=A0 =A0 =A0 =A0 status: active=0A> > lo0: flags= =3D8049<UP,LOOPBACK,RUNNING,MULTICAST>=0A> metric 0 mtu 16384=0A> >=A0 =A0 = =A0 =A0=0A> options=3D3<RXCSUM,TXCSUM>=0A> >=A0 =A0 =A0 =A0 inet 127.0.0.1 = netmask=0A> 0xff000000=0A> > pfsync0: flags=3D0<> metric 0 mtu 1460=0A> >= =A0 =A0 =A0 =A0 syncpeer: 224.0.0.240=0A> maxupd: 128=0A> > pflog0: flags= =3D141<UP,RUNNING,PROMISC> metric 0=0A> mtu 33152=0A> >=0A> > #pciconf -lv= =0A> > igb0@pci0:1:0:0:=A0 =A0 =A0 =A0=0A> class=3D0x020000 card=3D0x34de80= 86 chip=3D0x10a78086=0A> > rev=3D0x02 hdr=3D0x00=0A> >=A0 =A0 vendor=A0 =A0= =A0=A0=3D 'Intel=0A> Corporation'=0A> >=A0 =A0 device=A0 =A0=A0=A0=3D '8257= 5EB=0A> Gigabit Network Connection'=0A> >=A0 =A0 class=A0 =A0 =A0 =3D netwo= rk=0A> >=A0 =A0 subclass=A0=A0=A0=3D ethernet=0A> > igb1@pci0:1:0:1:=A0 =A0= =A0 =A0=0A> class=3D0x020000 card=3D0x34de8086 chip=3D0x10a78086=0A> > rev= =3D0x02 hdr=3D0x00=0A> >=A0 =A0 vendor=A0 =A0=A0=A0=3D 'Intel=0A> Corporati= on'=0A> >=A0 =A0 device=A0 =A0=A0=A0=3D '82575EB=0A> Gigabit Network Connec= tion'=0A> >=A0 =A0 class=A0 =A0 =A0 =3D network=0A> >=A0 =A0 subclass=A0=A0= =A0=3D ethernet=0A> >=0A> > # netstat -i=0A> > Name=A0 =A0 Mtu Network=A0 = =A0=0A> =A0=A0=A0Address=A0 =A0 =A0 =A0 =A0=0A> =A0 =A0 Ipkts Ierrs Idrop= =A0 =A0 Opkts=0A> > Oerrs=A0 Coll=0A> > igb0=A0=A0=A01500 <Link#1>=A0 =A0= =0A> =A0 00:15:17:ba:2e:00=A0 =A0=A0=A02315=A0=0A> =A0=A0=A00=A0 =A0=A0=A00= =A0 =A0=0A> 1415=0A> >=A0=A0=A00=A0 =A0=A0=A00=0A> > igb0=A0=A0=A01500 192.= 168.10.0=A0=0A> border2=A0 =A0 =A0 =A0 =A0 =A0=0A> =A0=A0=A01664=A0 =A0=A0= =A0-=A0=0A> =A0=A0=A0-=A0 =A0=A0=A01412=0A> >=A0=A0=A0-=A0 =A0=A0=A0-=0A> >= igb0=A0=A0=A01500 192.168.10.20=0A> mysql-border2=A0 =A0 =A0 =A0 =A0 =A0= =0A> 0=A0 =A0=A0=A0-=A0 =A0=A0=A0-=A0=0A> =A0 =A0 =A0 0=0A> >=A0=A0=A0-=A0 = =A0=A0=A0-=0A> > igb0=A0=A0=A01500 192.168.10.20=0A> apache-border2=A0 =A0 = =A0 =A0=0A> =A0=A0=A00=A0 =A0=A0=A0-=A0=0A> =A0=A0=A0-=A0 =A0 =A0 =A0 0=0A>= >=A0=A0=A0-=A0 =A0=A0=A0-=0A> > igb0=A0=A0=A01500 192.168.10.20=0A> squid-= border2=A0 =A0 =A0 =A0 =A0 =A0=0A> 0=A0 =A0=A0=A0-=A0 =A0=A0=A0-=A0=0A> =A0= =A0 =A0 0=0A> >=A0=A0=A0-=A0 =A0=A0=A0-=0A> > igb0=A0=A0=A01500 192.168.10= .20=0A> postgresql-border=A0 =A0 =A0 =A0 1=A0=0A> =A0=A0=A0-=A0 =A0=A0=A0-= =A0 =A0=0A> =A0 =A0 0=0A> >=A0=A0=A0-=A0 =A0=A0=A0-=0A> > igb1=A0=A0=A01500= <Link#2>=A0 =A0=0A> =A0 00:15:17:ba:2e:01=A0 =A0 =A0 129=A0=0A> =A0=A0=A00= =A0 =A0=A0=A00=A0 =A0=0A> =A0 =A0 0=0A> >=A0=A0=A00=A0 =A0=A0=A00=0A> > igb= 1=A0=A0=A01500 XXX.74.229.22 border2=A0=0A> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0= =0A> 0=A0 =A0=A0=A0-=A0 =A0=A0=A0-=A0=0A> =A0 =A0 =A0 0=0A> >=A0=A0=A0-=A0 = =A0=A0=A0-=0A> > igb1=A0=A0=A01500 XXX.74.229.22=0A> apache-border2=A0 =A0 = =A0 =A0=0A> =A0=A0=A00=A0 =A0=A0=A0-=A0=0A> =A0=A0=A0-=A0 =A0 =A0 =A0 0=0A>= >=A0=A0=A0-=A0 =A0=A0=A0-=0A> > igb1=A0=A0=A01500 XXX.74.229.22=0A> squid-= border2=A0 =A0 =A0 =A0 =A0 =A0=0A> 0=A0 =A0=A0=A0-=A0 =A0=A0=A0-=A0=0A> =A0= =A0 =A0 0=0A> >=A0=A0=A0-=A0 =A0=A0=A0-=0A> > lo0=A0=A0=A016384 <Link#3>= =A0 =A0=0A> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0=0A> =A0 =A0 =A0 =A0 =A0=A0=A01= =A0=0A> =A0=A0=A00=A0 =A0=A0=A00=A0 =A0=0A> =A0 =A0 1=0A> >=A0=A0=A00=A0 = =A0=A0=A00=0A> > lo0=A0=A0=A016384 your-net=A0 =A0=0A> =A0 localhost=A0 =A0= =A0 =A0 =A0 =A0=0A> =A0 =A0 0=A0 =A0=A0=A0-=A0=0A> =A0=A0=A0-=A0 =A0 =A0 = =A0 1=0A> >=A0=A0=A0-=A0 =A0=A0=A0-=0A> > pfsyn=A0 1460 <Link#4>=A0 =A0 =A0= =0A> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0=0A> =A0 =A0 =A0 =A0=A0=A00=A0=0A> =A0= =A0=A00=A0 =A0=A0=A00=A0 =A0=0A> =A0 =A0 0=0A> >=A0=A0=A00=A0 =A0=A0=A00=0A= > > pflog 33152 <Link#5>=A0 =A0 =A0 =A0=0A> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0= =0A> =A0 =A0 =A0=A0=A00=A0=0A> =A0=A0=A00=A0 =A0=A0=A00=A0 =A0=0A> =A0 =A0 = 0=0A> >=A0=A0=A00=A0 =A0=A0=A00=0A> >=0A> > There are several jails on this= server.=0A> >=0A> > When i set hw.igb.rxd=3D"2048" and hw.igb.txd=3D"2048"= i=0A> don't have panic=0A> > anymore.=0A> >=0A> > The reason i tried to ad= d more buffers than default is=0A> because i have NFS=0A> > export on this = server. But it is on igb0. igb1 is=0A> currently doing nothing=0A> > but it= will soon once the server will be ready for=0A> production.=0A> >=0A> > I = didn't get core dump because my system is rather=0A> old. But i can do it i= f=0A> > needed.=0A> >=0A> > Regards,=0A> > Kirill=0A> >=0A> >=0A> >=0A> > _= ______________________________________________=0A> > freebsd-stable@freebsd= .org=0A> mailing list=0A> > http://lists.freebsd.org/mailman/listinfo/freeb= sd-stable=0A> > To unsubscribe, send any mail to "freebsd-stable-unsubscrib= e@freebsd.org"=0A> >=0A> _______________________________________________=0A= > freebsd-stable@freebsd.org=0A> mailing list=0A> http://lists.freebsd.org/= mailman/listinfo/freebsd-stable=0A> To unsubscribe, send any mail to "freeb= sd-stable-unsubscribe@freebsd.org"=0A> =0A=0A=0A
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?619287.68177.qm>