From owner-freebsd-net@FreeBSD.ORG Mon May 14 21:44:36 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id E8A4C106564A for ; Mon, 14 May 2012 21:44:36 +0000 (UTC) (envelope-from kirk.davis@epsb.ca) Received: from Exchange22.EDU.epsb.ca (exchange22.epsb.ca [198.161.119.187]) by mx1.freebsd.org (Postfix) with ESMTP id B37F48FC12 for ; Mon, 14 May 2012 21:44:36 +0000 (UTC) Received: from Exchange26.EDU.epsb.ca ([10.0.5.123]) by Exchange22.EDU.epsb.ca with Microsoft SMTPSVC(6.0.3790.4675); Mon, 14 May 2012 15:43:39 -0600 X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Date: Mon, 14 May 2012 15:43:38 -0600 Message-ID: <529374128DC1B04D9D037911B8E8F0531095BEFE@Exchange26.EDU.epsb.ca> In-Reply-To: X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: 10Gb/s ixgbe and mbuf performance tuning. Thread-Index: Ac0yDIILyjl0fS0CSMmDbGWsnT06kAADVNYg References: <529374128DC1B04D9D037911B8E8F0531095BEF8@Exchange26.EDU.epsb.ca> From: "Kirk Davis" To: "Jack Vogel" X-OriginalArrivalTime: 14 May 2012 21:43:39.0182 (UTC) FILETIME=[9F99FCE0:01CD321A] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-net@freebsd.org Subject: RE: 10Gb/s ixgbe and mbuf performance tuning. X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 May 2012 21:44:37 -0000 On Mon, May 14, 2012 at 2:02 PM, Jack Vogel [mailto:jfvogel@gmail.com] wrote: =20 >Do you have LRO enabled? Also, you say it stops routing, do you mean it >passes non-routing traffic, or does everything stop? I do have LRO enabled on both of the interfaces. It stops accepting traffic. It doesn't router traffic and I can't ssh into the server. If I try to ping a host on the local network from the console, I get an "Out of Buffer Space" error (not sure of the exact wording). >Jack > >On Mon, May 14, 2012 at 9:49 AM, Kirk Davis wrote: >Hi, > > I am running FreeBSD 8.1p3 amd64 with 6Gb of RAM. This >is a router using Quagga for BGP. It has two 10Gb/s network connections >using the intel ixgbe 2.4.4 driver. It is handling routing for about >200 remote sites and about 300k simultaneous sessions through the box. >After a few hours at high traffic volumes (just over a 1Gb/s) it will >stop routing any traffic. It look like I am running out of mbuf's. I >have increased them but I am worried that there is a limit as to how >much I can increase them without starving the kernel of space. Console >is still responsive but no network. > I have looked over Tuning(7) and some other great >articles on the net on performance tuning FreeBSD but it has left me a >little confused. Can someone help to explain the best way to >troubleshoot this issue and any formulas to tune it. --- Kirk _______________________________________________ freebsd-net@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" =20