From owner-freebsd-stable@FreeBSD.ORG Mon Jul 19 20:36:40 2010 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C75A91065680 for ; Mon, 19 Jul 2010 20:36:40 +0000 (UTC) (envelope-from jhay@meraka.csir.co.za) Received: from zibbi.meraka.csir.co.za (zibbi.meraka.csir.co.za [146.64.24.58]) by mx1.freebsd.org (Postfix) with ESMTP id 40A598FC14 for ; Mon, 19 Jul 2010 20:36:40 +0000 (UTC) Received: by zibbi.meraka.csir.co.za (Postfix, from userid 3973) id 14CB239824; Mon, 19 Jul 2010 22:25:42 +0200 (SAST) Date: Mon, 19 Jul 2010 22:25:42 +0200 From: John Hay To: freebsd-stable@freebsd.org Message-ID: <20100719202541.GA42777@zibbi.meraka.csir.co.za> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.2.3i Subject: packet loss on ixgbe using vlans and ipv6 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Jul 2010 20:36:40 -0000 Hi, I have a Dell T710 with 4 X 10G ethernet interfaces (2 X Dual port Intel 82599 cards). It is running FreeBSD RELENG_8 last updated on July 13. What I see is packet loss (0 - 40%) on IPv6 packets in vlans, when the machine is not the originator of the packets. Let me try to describe a little more. If a neigbouring machine ping6 it, there will be packet loss. If it act as a router for ipv6, there will be packet loss. This happen even when the network is pretty idle and with different switches (Nortel and Cisco equipment). The packet loss is very fluctuating. Pinging 1000 packets might loose 1% one time and the next time 30%. Looking with tcpdump, I can see the packets arriving and going out, but the packet never arrive at the next machine. (My feeling is that they get lost inside the card.) The error counters on the switch does not increment. I do not see packet loss if the machine originate the packets, for example ping6 from the machine. Also ipv4 packets do not have any packets loss. If I do not use vlans, I don't see packet loss with ipv6 either. pciconf -l of the ethernet cards: ix0@pci0:129:0:0: class=0x020000 card=0x00038086 chip=0x10fb8086 rev=0x01 hdr=0x00 ix1@pci0:129:0:1: class=0x020000 card=0x00038086 chip=0x10fb8086 rev=0x01 hdr=0x00 ix2@pci0:131:0:0: class=0x020000 card=0x00038086 chip=0x10fb8086 rev=0x01 hdr=0x00 ix3@pci0:131:0:1: class=0x020000 card=0x00038086 chip=0x10fb8086 rev=0x01 hdr=0x00 dmesg of the first ethernet card. The others look the same, except for the memory and irq values: ix0: port 0xdcc 0-0xdcdf mem 0xd4100000-0xd417ffff,0xd40f8000-0xd40fbfff irq 64 at device 0.0 on pci129 ix0: Using MSIX interrupts with 17 vectors ix0: [ITHREAD] ... ix0: Ethernet address: 00:1b:21:57:b4:20 ix0: PCI Express Bus: Speed 5.0Gb/s Width x8 If anybody need more info, please ask. John -- John Hay -- jhay@meraka.csir.co.za / jhay@FreeBSD.org