From owner-freebsd-net@FreeBSD.ORG Thu May 19 16:55:42 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3E7BD106566B for ; Thu, 19 May 2011 16:55:42 +0000 (UTC) (envelope-from kip.macy@gmail.com) Received: from mail-vx0-f182.google.com (mail-vx0-f182.google.com [209.85.220.182]) by mx1.freebsd.org (Postfix) with ESMTP id E5C098FC13 for ; Thu, 19 May 2011 16:55:41 +0000 (UTC) Received: by vxc34 with SMTP id 34so2859386vxc.13 for ; Thu, 19 May 2011 09:55:41 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type :content-transfer-encoding; bh=x1T+UUWtMqejhEmnUidLVCjNgv4kci8wdcAMuxt2Fio=; b=X5W6KcQd+MRjeLNadx0X/57lxdaBajkETJ1wMq+YrLp/BRP46jrZ4hh23uyQUazWdF P81ygwQFrkNUR7I7nor9G6tTwzTkGmK+J+Dz3c2AH9cmK+9+hsU4HR8JH0QtvccDZEuz 7ueR6z7v4VoYMv1DGu46gfJmTekz+ZHzQQdvA= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; b=qRO/I5BdQGoDat0cWUWeP/f0PKtjQAR/hzyPRTXVJQNIw/7NSfnUhH765pFg5m5vZl NrgI+pPzChOoJX4njlDnV57RTObYe1DQzJJnk8Q1SxvobyJ2zY+tV4aetmQjtCPVjaMv O4Co6D3YF1YRwta8MUF/A3HHs7C35K5ywOXRQ= MIME-Version: 1.0 Received: by 10.52.31.103 with SMTP id z7mr4945663vdh.89.1305822498445; Thu, 19 May 2011 09:28:18 -0700 (PDT) Received: by 10.52.112.73 with HTTP; Thu, 19 May 2011 09:28:18 -0700 (PDT) In-Reply-To: References: Date: Thu, 19 May 2011 18:28:18 +0200 Message-ID: From: Kip Macy To: William Salt Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: freebsd-net@freebsd.org Subject: Re: Intel 10GbE Tuning under freebsd X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 May 2011 16:55:42 -0000 Four very quick points: - Enabling flowtable can help provided you don't have a large (greater than a few thousand) number of peers. - I have a patch under review to cache the rtentry (L3) and llentry (L2) in the inpcb for TCP connections, which improves scaling at high packet rates. - You'll want to ensure that the number of transmit and receive queues is getting configured properly (at least one per core up to the maximum number supported by the cards) - If you have very large numbers of connections you'll want to increase the size of the TCB hash, to dramatically reduce the lookup times when receiving packets. I hope that helps a little bit. Cheers, Kip On Thu, May 19, 2011 at 3:52 PM, William Salt wrote: > Hi All, > =A0 =A0 =A0 =A0 I have just got a couple of 10GbE intel X520-DA2 cards to= test. Im > running freebsd 8.1 on a super micro intel xeon server, and a hp core 2 d= uo > workstation, both machines have 4gb of ram. > Both are attached via sfp+ cables to a brocade turbo iron switch, which > simply has jumbo frames enabled. > > Initial testing was pretty basic, i simply enabled jumbo frames, and > increased max send/recv buffer to 16MB, which should be more than enough. > I then ran iperf and managed to get approximately 5gbps, i was expecting > around 8.5gbps. > However, i realise that the ix driver probably needs to be tuned, as well= as > the OS. > > After a bit of googling, i cant find a tuning guide under freebsd for 10G= bE, > or many recommendations, and wondered if anyone has already successfully > managed to tune freebsd with intel 10gbe nics, to gain a higher throughpu= t? > If so, has anyone got any tips, or sample configs? > > Thanks in advance > Will > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >