Date: Sat, 17 Dec 2011 18:54:34 +0200 From: Sami Halabi <sodynet1@gmail.com> To: Arnaud Lacombe <lacombar@gmail.com> Cc: pyunyh@gmail.com, freebsd-net@freebsd.org Subject: Re: Problem on re0 Message-ID: <CAEW%2Bogbsa%2BBLYMnhTj=SufnwRqCu83s5%2BqnLe6BC42VYa-Lqpw@mail.gmail.com> In-Reply-To: <CAEW%2Bogbdtm3jYpGTxyejhZwUJdhcAHuQGgg6VfLtZ=bW26tM-w@mail.gmail.com> References: <CAEW%2BogauicnjsNdMCBBtoYzOLKVQoxP92Lw9Q_YgYPAe96dS5g@mail.gmail.com> <20111205022730.GE1729@michelle.cdnetworks.com> <CAEW%2BogbPwPY8r=uHhpkkp9-_K_gNsAVzKhVmgWScAMsHt2SJKQ@mail.gmail.com> <20111207005958.GE5825@michelle.cdnetworks.com> <CAEW%2BogZ7wivLcNm8rpcDR-ekP7Z6iEBZ0DtExhg5NVGfho0Ckw@mail.gmail.com> <20111207235810.GB9211@michelle.cdnetworks.com> <CAEW%2BogZKetpmwuCuyQo-g5DVZ4jCFM0L-mRApV9RTQ4S=Yi3hg@mail.gmail.com> <20111208215256.GB13605@michelle.cdnetworks.com> <CACqU3MVyDD=Vj1wK%2BNmrjjauzq85JSqrj2WEjLj878fSqhzT%2BQ@mail.gmail.com> <CAEW%2BogZOyBDN36t0BMEFcgKgWydShuC82Ym5=eDUAGNCvU0w5Q@mail.gmail.com> <CAEW%2Bogbdtm3jYpGTxyejhZwUJdhcAHuQGgg6VfLtZ=bW26tM-w@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
updated sysctl: dev.bge.1.stats.FramesDroppedDueToFilters: 0 dev.bge.1.stats.DmaWriteQueueFull: 2291364 dev.bge.1.stats.DmaWriteHighPriQueueFull: 0 dev.bge.1.stats.NoMoreRxBDs: 0 dev.bge.1.stats.InputDiscards: 0 dev.bge.1.stats.InputErrors: 0 dev.bge.1.stats.RecvThresholdHit: 124125195 dev.bge.1.stats.DmaReadQueueFull: 13471017 dev.bge.1.stats.DmaReadHighPriQueueFull: 962 dev.bge.1.stats.SendDataCompQueueFull: 0 dev.bge.1.stats.RingSetSendProdIndex: 349298815 dev.bge.1.stats.RingStatusUpdate: 260314059 dev.bge.1.stats.Interrupts: 260314059 dev.bge.1.stats.AvoidedInterrupts: 0 dev.bge.1.stats.SendThresholdHit: 0 dev.bge.1.stats.rx.ifHCInOctets: 2168102685 dev.bge.1.stats.rx.Fragments: 0 dev.bge.1.stats.rx.UnicastPkts: 237511300 dev.bge.1.stats.rx.MulticastPkts: 0 dev.bge.1.stats.rx.FCSErrors: 0 dev.bge.1.stats.rx.AlignmentErrors: 0 dev.bge.1.stats.rx.xonPauseFramesReceived: 0 dev.bge.1.stats.rx.xoffPauseFramesReceived: 0 dev.bge.1.stats.rx.ControlFramesReceived: 0 dev.bge.1.stats.rx.xoffStateEntered: 0 dev.bge.1.stats.rx.FramesTooLong: 0 dev.bge.1.stats.rx.Jabbers: 0 dev.bge.1.stats.rx.UndersizePkts: 0 dev.bge.1.stats.rx.inRangeLengthError: 0 dev.bge.1.stats.rx.outRangeLengthError: 0 dev.bge.1.stats.tx.ifHCOutOctets: 1965505340 dev.bge.1.stats.tx.Collisions: 0 dev.bge.1.stats.tx.XonSent: 0 dev.bge.1.stats.tx.XoffSent: 0 dev.bge.1.stats.tx.flowControlDone: 0 dev.bge.1.stats.tx.InternalMacTransmitErrors: 0 dev.bge.1.stats.tx.SingleCollisionFrames: 0 dev.bge.1.stats.tx.MultipleCollisionFrames: 0 dev.bge.1.stats.tx.DeferredTransmissions: 0 dev.bge.1.stats.tx.ExcessiveCollisions: 0 dev.bge.1.stats.tx.LateCollisions: 0 dev.bge.1.stats.tx.UnicastPkts: 347270086 dev.bge.1.stats.tx.MulticastPkts: 0 dev.bge.1.stats.tx.BroadcastPkts: 30311 dev.bge.1.stats.tx.CarrierSenseErrors: 0 dev.bge.1.stats.tx.Discards: 0 dev.bge.1.stats.tx.Errors: 0 Sami On Sat, Dec 17, 2011 at 6:53 PM, Sami Halabi <sodynet1@gmail.com> wrote: > Hi, > > here is # pciconf -lv | grep -A4 bge\[0-9]\@ > bge0@pci0:2:0:0: class=0x020000 card=0x03781014 chip=0x165a14e4 > rev=0x00 hdr=0x00 > vendor = 'Broadcom Corporation' > device = 'Broadcom NetXtreme BCM5722 Gigabit (94309)' > class = network > subclass = ethernet > -- > bge1@pci0:3:1:0: class=0x020000 card=0x026f1014 chip=0x16c714e4 > rev=0x10 hdr=0x00 > vendor = 'Broadcom Corporation' > device = 'BCM5703A3 NetXtreme Gigabit Ethernet' > class = network > subclass = ethernet > > and dmesg: > bge1: <Broadcom NetXtreme Gigabit Ethernet Controller, ASIC rev. 0x001100> > mem 0xe8400000-0xe840ffff irq 21 at device 1.0 on pci3 > bge1: CHIP ID 0x00001100; ASIC REV 0x01; CHIP REV 0x11; PCI > miibus1: <MII bus> on bge1 > brgphy1: <BCM5703 10/100/1000baseTX PHY> PHY 1 on miibus1 > brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, > 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow > bge1: Ethernet address: 00:1a:64:21:86:29 > bge1: [ITHREAD] > > > Thanks > > On Sat, Dec 17, 2011 at 6:49 PM, Sami Halabi <sodynet1@gmail.com> wrote: > >> Hi, >> >> I've moved to a new server with bge card driver, similar configuration: >> /etc/sysctl.conf >> net.inet.flowtable.enable=0 >> net.inet.ip.fastforwarding=1 >> kern.ipc.somaxconn=8192 >> kern.ipc.shmmax=2147483648 >> kern.ipc.maxsockets=204800 >> kern.ipc.maxsockbuf=2097152 >> hw.intr_storm_threshold=9000 >> kern.maxfiles=256000 >> kern.maxfilesperproc=230400 >> net.inet.ip.dummynet.pipe_slot_limit=1000 >> #net.inet.ip.dummynet.io_fast=1 >> net.link.ether.ipfw=1 >> kern.ipc.nmbclusters=409600 >> net.graph.recvspace=40960 >> net.graph.maxdgram=40960 >> >> Kernel >> ----------- >> device lagg >> options IPFIREWALL >> options IPFIREWALL_FORWARD >> options IPFIREWALL_VERBOSE >> options DUMMYNET >> options HZ=1000 >> options TCP_SIGNATURE >> device crypto # core crypto support >> device cryptodev # /dev/crypto for access to h/w >> options IPSEC >> options DEVICE_POLLING >> device if_bridge >> >> /boot/loader.conf >> net.graph.maxalloc=128000 >> net.graph.maxdata=128000 >> net.graph.threads=4 >> >> and i have similar problem.. i check each minute for ping and i see >> sometimes loss of 50% or 100% (ping -c 2 -t 4 otherside.ip.com), >> here are the sysctl dev.bge.1.stats: >> dev.bge.1.stats.FramesDroppedDueToFilters: 0 >> dev.bge.1.stats.DmaWriteQueueFull: 2291350 >> dev.bge.1.stats.DmaWriteHighPriQueueFull: 0 >> dev.bge.1.stats.NoMoreRxBDs: 0 >> dev.bge.1.stats.InputDiscards: 0 >> dev.bge.1.stats.InputErrors: 0 >> dev.bge.1.stats.RecvThresholdHit: 124120300 >> dev.bge.1.stats.DmaReadQueueFull: 13470948 >> dev.bge.1.stats.DmaReadHighPriQueueFull: 962 >> dev.bge.1.stats.SendDataCompQueueFull: 0 >> dev.bge.1.stats.RingSetSendProdIndex: 349289174 >> dev.bge.1.stats.RingStatusUpdate: 260304688 >> dev.bge.1.stats.Interrupts: 260304688 >> dev.bge.1.stats.AvoidedInterrupts: 0 >> dev.bge.1.stats.SendThresholdHit: 0 >> dev.bge.1.stats.rx.ifHCInOctets: 2165908673 >> dev.bge.1.stats.rx.Fragments: 0 >> dev.bge.1.stats.rx.UnicastPkts: 237503495 >> dev.bge.1.stats.rx.MulticastPkts: 0 >> dev.bge.1.stats.rx.FCSErrors: 0 >> dev.bge.1.stats.rx.AlignmentErrors: 0 >> dev.bge.1.stats.rx.xonPauseFramesReceived: 0 >> dev.bge.1.stats.rx.xoffPauseFramesReceived: 0 >> dev.bge.1.stats.rx.ControlFramesReceived: 0 >> dev.bge.1.stats.rx.xoffStateEntered: 0 >> dev.bge.1.stats.rx.FramesTooLong: 0 >> dev.bge.1.stats.rx.Jabbers: 0 >> dev.bge.1.stats.rx.UndersizePkts: 0 >> dev.bge.1.stats.rx.inRangeLengthError: 0 >> dev.bge.1.stats.rx.outRangeLengthError: 0 >> dev.bge.1.stats.tx.ifHCOutOctets: 1956421618 >> dev.bge.1.stats.tx.Collisions: 0 >> dev.bge.1.stats.tx.XonSent: 0 >> dev.bge.1.stats.tx.XoffSent: 0 >> dev.bge.1.stats.tx.flowControlDone: 0 >> dev.bge.1.stats.tx.InternalMacTransmitErrors: 0 >> dev.bge.1.stats.tx.SingleCollisionFrames: 0 >> dev.bge.1.stats.tx.MultipleCollisionFrames: 0 >> dev.bge.1.stats.tx.DeferredTransmissions: 0 >> dev.bge.1.stats.tx.ExcessiveCollisions: 0 >> dev.bge.1.stats.tx.LateCollisions: 0 >> dev.bge.1.stats.tx.UnicastPkts: 347260508 >> dev.bge.1.stats.tx.MulticastPkts: 0 >> dev.bge.1.stats.tx.BroadcastPkts: 30306 >> dev.bge.1.stats.tx.CarrierSenseErrors: 0 >> dev.bge.1.stats.tx.Discards: 0 >> dev.bge.1.stats.tx.Errors: 0 >> >> this driver gives more statics... >> >> please help me, this causes us serious problems with customers. >> >> Thanks in advance, >> Sami >> >> On Fri, Dec 9, 2011 at 8:51 AM, Arnaud Lacombe <lacombar@gmail.com>wrote: >> >>> Hi, >>> >>> On Thu, Dec 8, 2011 at 4:52 PM, YongHyeon PYUN <pyunyh@gmail.com> wrote: >>> > On Thu, Dec 08, 2011 at 11:56:51AM +0200, Sami Halabi wrote: >>> >> hi, >>> >> i can see what it does. >>> >> how do i compile the driver and load it instead of the running driver >>> >> without restarting? its a production server. >>> > >>> > There is no such way. You have to rebuild/install kernel and >>> > reboot. >>> > >>> How so ? AFAIK, you should be able to build the driver as a module, >>> tell the bootloader to pre-load the module so that the built-in driver >>> ends up being ignored. I did that some time ago with em(4). From >>> memory, the steps should be: >>> >>> # From the source root >>> % cd sys/modules/re >>> % make >>> % scp if_re.ko <target>:/boot/kernel >>> >>> then on the target, add in `/boot/loader.conf': >>> >>> if_re_load="YES" >>> >>> - Arnaud >>> >> >> >> >> -- >> Sami Halabi >> Information Systems Engineer >> NMS Projects Expert >> >> > > > -- > Sami Halabi > Information Systems Engineer > NMS Projects Expert > > -- Sami Halabi Information Systems Engineer NMS Projects Expert
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAEW%2Bogbsa%2BBLYMnhTj=SufnwRqCu83s5%2BqnLe6BC42VYa-Lqpw>