From owner-freebsd-net@FreeBSD.ORG Thu Apr 19 19:27:05 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 1AF4F106566B; Thu, 19 Apr 2012 19:27:05 +0000 (UTC) (envelope-from seanbru@yahoo-inc.com) Received: from mrout1-b.corp.bf1.yahoo.com (mrout1-b.corp.bf1.yahoo.com [98.139.253.104]) by mx1.freebsd.org (Postfix) with ESMTP id AFA2B8FC12; Thu, 19 Apr 2012 19:27:04 +0000 (UTC) Received: from [IPv6:::1] (rideseveral.corp.yahoo.com [10.73.160.231]) by mrout1-b.corp.bf1.yahoo.com (8.14.4/8.14.4/y.out) with ESMTP id q3JJQgk1090349; Thu, 19 Apr 2012 12:26:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=yahoo-inc.com; s=cobra; t=1334863604; bh=CgezNIxFrgin2tMRRpsfPTaW6RUEp393NHbdHPoSqQE=; h=Subject:From:To:Cc:In-Reply-To:References:Content-Type:Date: Message-ID:Mime-Version:Content-Transfer-Encoding; b=Phi0UC6vDlgaAu9pnng8tbRZAbYMatcLf6MZXioRzpVsICgEPV8H4Q+0V9i4IYPV/ fDJBhz3ovoE6pCzVvT9zB6zJkY9rGrVSC6BhjgSwgqpeSr6kuW6ueAaNYcY50zJnGO nLIUlXLgc8WuU1RMPvKMGsKnkEvomQ4hL0YELl9I= From: Sean Bruno To: Jack Vogel In-Reply-To: References: <1334705064.4486.23.camel@powernoodle-l7.corp.yahoo.com> <1334767746.3466.6.camel@powernoodle-l7.corp.yahoo.com> <1334792417.19343.11.camel@powernoodle-l7.corp.yahoo.com> <201204190822.31010.jhb@freebsd.org> Content-Type: text/plain; charset="UTF-8" Date: Thu, 19 Apr 2012 12:26:42 -0700 Message-ID: <1334863602.4126.9.camel@powernoodle-l7.corp.yahoo.com> Mime-Version: 1.0 X-Mailer: Evolution 2.32.1 FreeBSD GNOME Team Port Content-Transfer-Encoding: 7bit X-Milter-Version: master.31+4-gbc07cd5+ X-CLX-ID: 863603002 Cc: "freebsd-net@freebsd.org" , Luigi Rizzo , John Baldwin Subject: Re: igb(4) Raising IGB_MAX_RXD ?? X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 Apr 2012 19:27:05 -0000 On Thu, 2012-04-19 at 07:09 -0700, Jack Vogel wrote: > OH, well that's interesting to know, thanks John. > > Jack > Front end box looks pretty happy today at 8k descriptors. http://people.freebsd.org/~sbruno/igb_8k_stats.txt Under peak, we're approaching 20MBytes/sec in and out of the interface. :-) Nifty. -bash-4.2$ netstat 1 input (Total) output packets errs idrops bytes packets errs bytes colls 59542 0 0 18189602 59131 0 19884085 0 58941 0 0 18036651 58673 0 19702671 0 58790 0 0 18069235 58422 0 19897858 0 58226 0 0 17948175 57969 0 19648810 0 58689 0 0 18167855 58479 0 19909843 0 58633 0 0 17952951 58437 0 19760197 0 61019 0 0 18779030 60592 0 20394481 0 56696 0 0 17647407 56552 0 19261155 0 58853 0 0 18186019 58530 0 19886197 0 58739 0 0 18314790 58768 0 20165654 0 58748 0 0 18267243 58539 0 20016668 0 58672 0 0 17914657 58378 0 19558833 0 59885 0 0 18332641 59780 0 20239241 0 We're going to crank one server up to 8 igb queues and hw.igb.max_rxd/txd to 32k and see what blows up. Sean