From owner-freebsd-net@FreeBSD.ORG Fri Feb 19 07:43:22 2010 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BAFFB1065670; Fri, 19 Feb 2010 07:43:22 +0000 (UTC) (envelope-from jfvogel@gmail.com) Received: from mail-ew0-f225.google.com (mail-ew0-f225.google.com [209.85.219.225]) by mx1.freebsd.org (Postfix) with ESMTP id C64038FC08; Fri, 19 Feb 2010 07:43:21 +0000 (UTC) Received: by ewy25 with SMTP id 25so799632ewy.3 for ; Thu, 18 Feb 2010 23:43:20 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:cc:content-type; bh=gS2pZogCVsn7ZQAc+VM2BGGhSh+VhuZyej80Um4K6uc=; b=X2tOIdCfIMHw4bLGCa+sYOlxw/sTi7dQH0dQCxDVWBHOeDiaX83jxvublnkZ7x33uK QUD0x5DUBnugM0c9hUh3j9Wy576yJK1uxbi3TJ+BIjsuVffvWsovI6W1F2srQYCRoixv Kiig0AQDoZtNePO/N5Y3SxcZxX4afomRFGvQA= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=SC6f/hSW8+2nJohdIu5Jz4EBRtL04TUmBo9+wMsLN5Kho7q3zx5ZaY56JIwzp4MQwC yLeN61gScXCKLmh+dwnS2bsjYWkO50BA3kqP0IcDe5336+KTB9/D82sduw8vE/IDBhhM eA9I/9Uv2ZbgaBkcPu/vS/n5R84WFdt856cR0= MIME-Version: 1.0 Received: by 10.216.90.137 with SMTP id e9mr1044955wef.141.1266565400684; Thu, 18 Feb 2010 23:43:20 -0800 (PST) In-Reply-To: <20100219034255.GG11675@michelle.cdnetworks.com> References: <4B79297D.9080403@FreeBSD.org> <4B79205B.619A0A1A@verizon.net> <4B7ADFC6.7020202@FreeBSD.org> <4B7DE3CC.7040704@FreeBSD.org> <20100219034255.GG11675@michelle.cdnetworks.com> Date: Thu, 18 Feb 2010 23:43:20 -0800 Message-ID: <2a41acea1002182343i1ef0124fm8e2f6cc56846454c@mail.gmail.com> From: Jack Vogel To: pyunyh@gmail.com Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: Maxim Sobolev , Sergey Babkin , FreeBSD Hackers , Alfred Perlstein , freebsd-net@freebsd.org, "David G. Lawrence" Subject: Re: Sudden mbuf demand increase and shortage under the load (igb issue?) X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 19 Feb 2010 07:43:22 -0000 This thread is confusing, first he says its an igb problem, then you offer an em patch :) I have an important rev of igb that I am about ready to release, anyone that wishes to test against a problem they have would be welcome to have early access, just let me know. I am not sure about this ich10 change, there are client NICs that specifically do NOT support jumbo frames, I'll need to look into it tomorrow at work. Jack On Thu, Feb 18, 2010 at 7:42 PM, Pyun YongHyeon wrote: > On Thu, Feb 18, 2010 at 05:05:16PM -0800, Maxim Sobolev wrote: > > Folks, > > > > Indeed, it looks like igb(4) issue. Replacing the card with the > > desktop-grade em(4)-supported card has fixed the problem for us. The > > system has been happily pushing 110mbps worth of RTP traffic and 2000 > > concurrent calls without any problems for two days now. > > > > em0@pci0:7:0:0: class=0x020000 card=0xa01f8086 chip=0x10d38086 rev=0x00 > > hdr=0x00 > > vendor = 'Intel Corporation' > > class = network > > subclass = ethernet > > > > em0: port 0xec00-0xec1f mem > > 0xfbee0000-0xfbefffff,0xfbe00000-0xfbe7ffff,0xfbedc000-0xfbedffff irq 24 > > at device 0.0 on pci7 > > em0: Using MSIX interrupts > > em0: [ITHREAD] > > em0: [ITHREAD] > > em0: [ITHREAD] > > em0: Ethernet address: 00:1b:21:50:02:49 > > > > I really think that this has to be addressed before 7.3 release is out. > > FreeBSD used to be famous for its excellent network performance and it's > > shame to see that deteriorating due to sub-standard quality drivers. > > Especially when there is a multi-billion vendor supporting the driver in > > question. No finger pointing, but it really looks like either somebody > > is not doing his job or the said vendor doesn't care so much about > > supporting FreeBSD. I am pretty sure the vendor in question has access > > to numerous load-testing tools, that should have catched this issue. > > > > This is the second time during the past 6 months I have issue with the > > quality of the Intel-based drivers - the first one is filed as > > kern/140326, which has stalled apparently despite me providing all > > necessary debug information. > > > > I can reproduce this bug on my box and I guess the root cause comes > from PBA(Packet Buffer Allocation) configuration. Some controllers > seems to require more TX buffer size to use 9000 MTU. The datasheet > is not clear which controller has how much amount of Packet Buffer > storage. This parameter seems to affect performance a lot because > increasing TX buffer size results in decreasing RX buffer size. The > attached patch seems to fix the issue for me but Jack may know > better the hardware details as publicly available datasheet seems > to be useless here. >