Date: Sat, 17 Dec 2011 18:53:04 +0200 From: Sami Halabi <sodynet1@gmail.com> To: Arnaud Lacombe <lacombar@gmail.com> Cc: pyunyh@gmail.com, freebsd-net@freebsd.org Subject: Re: Problem on re0 Message-ID: <CAEW%2Bogbdtm3jYpGTxyejhZwUJdhcAHuQGgg6VfLtZ=bW26tM-w@mail.gmail.com> In-Reply-To: <CAEW%2BogZOyBDN36t0BMEFcgKgWydShuC82Ym5=eDUAGNCvU0w5Q@mail.gmail.com> References: <CAEW%2BogauicnjsNdMCBBtoYzOLKVQoxP92Lw9Q_YgYPAe96dS5g@mail.gmail.com> <20111205022730.GE1729@michelle.cdnetworks.com> <CAEW%2BogbPwPY8r=uHhpkkp9-_K_gNsAVzKhVmgWScAMsHt2SJKQ@mail.gmail.com> <20111207005958.GE5825@michelle.cdnetworks.com> <CAEW%2BogZ7wivLcNm8rpcDR-ekP7Z6iEBZ0DtExhg5NVGfho0Ckw@mail.gmail.com> <20111207235810.GB9211@michelle.cdnetworks.com> <CAEW%2BogZKetpmwuCuyQo-g5DVZ4jCFM0L-mRApV9RTQ4S=Yi3hg@mail.gmail.com> <20111208215256.GB13605@michelle.cdnetworks.com> <CACqU3MVyDD=Vj1wK%2BNmrjjauzq85JSqrj2WEjLj878fSqhzT%2BQ@mail.gmail.com> <CAEW%2BogZOyBDN36t0BMEFcgKgWydShuC82Ym5=eDUAGNCvU0w5Q@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
Hi,
here is # pciconf -lv | grep -A4 bge\[0-9]\@
bge0@pci0:2:0:0: class=0x020000 card=0x03781014 chip=0x165a14e4
rev=0x00 hdr=0x00
vendor = 'Broadcom Corporation'
device = 'Broadcom NetXtreme BCM5722 Gigabit (94309)'
class = network
subclass = ethernet
--
bge1@pci0:3:1:0: class=0x020000 card=0x026f1014 chip=0x16c714e4
rev=0x10 hdr=0x00
vendor = 'Broadcom Corporation'
device = 'BCM5703A3 NetXtreme Gigabit Ethernet'
class = network
subclass = ethernet
and dmesg:
bge1: <Broadcom NetXtreme Gigabit Ethernet Controller, ASIC rev. 0x001100>
mem 0xe8400000-0xe840ffff irq 21 at device 1.0 on pci3
bge1: CHIP ID 0x00001100; ASIC REV 0x01; CHIP REV 0x11; PCI
miibus1: <MII bus> on bge1
brgphy1: <BCM5703 10/100/1000baseTX PHY> PHY 1 on miibus1
brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT,
1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
bge1: Ethernet address: 00:1a:64:21:86:29
bge1: [ITHREAD]
Thanks
On Sat, Dec 17, 2011 at 6:49 PM, Sami Halabi <sodynet1@gmail.com> wrote:
> Hi,
>
> I've moved to a new server with bge card driver, similar configuration:
> /etc/sysctl.conf
> net.inet.flowtable.enable=0
> net.inet.ip.fastforwarding=1
> kern.ipc.somaxconn=8192
> kern.ipc.shmmax=2147483648
> kern.ipc.maxsockets=204800
> kern.ipc.maxsockbuf=2097152
> hw.intr_storm_threshold=9000
> kern.maxfiles=256000
> kern.maxfilesperproc=230400
> net.inet.ip.dummynet.pipe_slot_limit=1000
> #net.inet.ip.dummynet.io_fast=1
> net.link.ether.ipfw=1
> kern.ipc.nmbclusters=409600
> net.graph.recvspace=40960
> net.graph.maxdgram=40960
>
> Kernel
> -----------
> device lagg
> options IPFIREWALL
> options IPFIREWALL_FORWARD
> options IPFIREWALL_VERBOSE
> options DUMMYNET
> options HZ=1000
> options TCP_SIGNATURE
> device crypto # core crypto support
> device cryptodev # /dev/crypto for access to h/w
> options IPSEC
> options DEVICE_POLLING
> device if_bridge
>
> /boot/loader.conf
> net.graph.maxalloc=128000
> net.graph.maxdata=128000
> net.graph.threads=4
>
> and i have similar problem.. i check each minute for ping and i see
> sometimes loss of 50% or 100% (ping -c 2 -t 4 otherside.ip.com),
> here are the sysctl dev.bge.1.stats:
> dev.bge.1.stats.FramesDroppedDueToFilters: 0
> dev.bge.1.stats.DmaWriteQueueFull: 2291350
> dev.bge.1.stats.DmaWriteHighPriQueueFull: 0
> dev.bge.1.stats.NoMoreRxBDs: 0
> dev.bge.1.stats.InputDiscards: 0
> dev.bge.1.stats.InputErrors: 0
> dev.bge.1.stats.RecvThresholdHit: 124120300
> dev.bge.1.stats.DmaReadQueueFull: 13470948
> dev.bge.1.stats.DmaReadHighPriQueueFull: 962
> dev.bge.1.stats.SendDataCompQueueFull: 0
> dev.bge.1.stats.RingSetSendProdIndex: 349289174
> dev.bge.1.stats.RingStatusUpdate: 260304688
> dev.bge.1.stats.Interrupts: 260304688
> dev.bge.1.stats.AvoidedInterrupts: 0
> dev.bge.1.stats.SendThresholdHit: 0
> dev.bge.1.stats.rx.ifHCInOctets: 2165908673
> dev.bge.1.stats.rx.Fragments: 0
> dev.bge.1.stats.rx.UnicastPkts: 237503495
> dev.bge.1.stats.rx.MulticastPkts: 0
> dev.bge.1.stats.rx.FCSErrors: 0
> dev.bge.1.stats.rx.AlignmentErrors: 0
> dev.bge.1.stats.rx.xonPauseFramesReceived: 0
> dev.bge.1.stats.rx.xoffPauseFramesReceived: 0
> dev.bge.1.stats.rx.ControlFramesReceived: 0
> dev.bge.1.stats.rx.xoffStateEntered: 0
> dev.bge.1.stats.rx.FramesTooLong: 0
> dev.bge.1.stats.rx.Jabbers: 0
> dev.bge.1.stats.rx.UndersizePkts: 0
> dev.bge.1.stats.rx.inRangeLengthError: 0
> dev.bge.1.stats.rx.outRangeLengthError: 0
> dev.bge.1.stats.tx.ifHCOutOctets: 1956421618
> dev.bge.1.stats.tx.Collisions: 0
> dev.bge.1.stats.tx.XonSent: 0
> dev.bge.1.stats.tx.XoffSent: 0
> dev.bge.1.stats.tx.flowControlDone: 0
> dev.bge.1.stats.tx.InternalMacTransmitErrors: 0
> dev.bge.1.stats.tx.SingleCollisionFrames: 0
> dev.bge.1.stats.tx.MultipleCollisionFrames: 0
> dev.bge.1.stats.tx.DeferredTransmissions: 0
> dev.bge.1.stats.tx.ExcessiveCollisions: 0
> dev.bge.1.stats.tx.LateCollisions: 0
> dev.bge.1.stats.tx.UnicastPkts: 347260508
> dev.bge.1.stats.tx.MulticastPkts: 0
> dev.bge.1.stats.tx.BroadcastPkts: 30306
> dev.bge.1.stats.tx.CarrierSenseErrors: 0
> dev.bge.1.stats.tx.Discards: 0
> dev.bge.1.stats.tx.Errors: 0
>
> this driver gives more statics...
>
> please help me, this causes us serious problems with customers.
>
> Thanks in advance,
> Sami
>
> On Fri, Dec 9, 2011 at 8:51 AM, Arnaud Lacombe <lacombar@gmail.com> wrote:
>
>> Hi,
>>
>> On Thu, Dec 8, 2011 at 4:52 PM, YongHyeon PYUN <pyunyh@gmail.com> wrote:
>> > On Thu, Dec 08, 2011 at 11:56:51AM +0200, Sami Halabi wrote:
>> >> hi,
>> >> i can see what it does.
>> >> how do i compile the driver and load it instead of the running driver
>> >> without restarting? its a production server.
>> >
>> > There is no such way. You have to rebuild/install kernel and
>> > reboot.
>> >
>> How so ? AFAIK, you should be able to build the driver as a module,
>> tell the bootloader to pre-load the module so that the built-in driver
>> ends up being ignored. I did that some time ago with em(4). From
>> memory, the steps should be:
>>
>> # From the source root
>> % cd sys/modules/re
>> % make
>> % scp if_re.ko <target>:/boot/kernel
>>
>> then on the target, add in `/boot/loader.conf':
>>
>> if_re_load="YES"
>>
>> - Arnaud
>>
>
>
>
> --
> Sami Halabi
> Information Systems Engineer
> NMS Projects Expert
>
>
--
Sami Halabi
Information Systems Engineer
NMS Projects Expert
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAEW%2Bogbdtm3jYpGTxyejhZwUJdhcAHuQGgg6VfLtZ=bW26tM-w>