From owner-freebsd-performance@FreeBSD.ORG Wed Apr 21 18:13:55 2010 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 844CF106564A for ; Wed, 21 Apr 2010 18:13:55 +0000 (UTC) (envelope-from jfvogel@gmail.com) Received: from mail-ww0-f54.google.com (mail-ww0-f54.google.com [74.125.82.54]) by mx1.freebsd.org (Postfix) with ESMTP id 1209B8FC1A for ; Wed, 21 Apr 2010 18:13:54 +0000 (UTC) Received: by wwa36 with SMTP id 36so4790992wwa.13 for ; Wed, 21 Apr 2010 11:13:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:received:message-id:subject:from:to:cc:content-type; bh=e+hUVD/dqeNykZa/GbVjvLv9TQSXwfxYDc9z9F+bitI=; b=kQPQZTxM8F5lwtpwx6jjlrXK0hJ/XGE5En+eMGg6smJeYikgHwH1mZrTCk8aenQQmj 1hlzRQWXAVA+psJckmvQ0JaWP7WlYehW6ysZZ3jkWj+x6fTCdvLa/Uh7O4uP0Hq1lUVp gQXb/MXCZ2/DDmf0hT9vkJTuqYMHRzd01btNo= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=RsjjZzM1kgCN7qrxsjY6hKsXozDcSlnr8fxG92edWHb/WToz63uwvPctT7LojVR5gS R2Z++rmamMbBQ1Amhg+beMb4YcdD0PaHW3lSymxpkPepoDke5zS+/cEtWwYHQwXvDC4E tM42XZlo2tXk2orkHM4QtPIVHsxeZM94yxe6o= MIME-Version: 1.0 Received: by 10.216.11.8 with HTTP; Wed, 21 Apr 2010 11:13:53 -0700 (PDT) In-Reply-To: References: <4BCF0C9A.10005@softhammer.net> Date: Wed, 21 Apr 2010 11:13:53 -0700 Received: by 10.216.87.146 with SMTP id y18mr5524553wee.127.1271873633620; Wed, 21 Apr 2010 11:13:53 -0700 (PDT) Message-ID: From: Jack Vogel To: Brandon Gooch Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-performance@freebsd.org, Stephen Sanders Subject: Re: FreeBSD 8.0 ixgbe Poor Performance X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Apr 2010 18:13:55 -0000 When you get into the 10G world your performance will only be as good as your weakest link, what I mean is if you connect to something that has less than stellar bus and/or memory performance it is going to throttle everything. Running back to back with two good systems you should be able to get near line rate (9K range). Things that can effect that: 64 bit kernel, TSO, LRO, how many queues come to mind. The default driver config should get you there, so tell me more about your hardware/os config?? Jack On Wed, Apr 21, 2010 at 8:04 AM, Brandon Gooch wrote: > On Wed, Apr 21, 2010 at 9:32 AM, Stephen Sanders > wrote: > > I am running speed tests on a pair of systems equipped with Intel 10Gbps > > cards and am getting poor performance. > > > > iperf and tcpdump testing indicates that the card is running at roughly > > 2.5Gbps max transmit/receive. > > > > My attempts at turning fiddling with netisr, polling, and varying the > > buffer sizes has been fruitless. I'm sure there is something that I'm > > missing so I'm hoping for suggestions. > > > > There are two systems that are connected head to head via cross over > > cable. The two systems have the same hardware configuration. The > > hardware is as follows: > > > > 2 Intel E5430 (Quad core) @ 2.66 Ghz > > Intel S5000PAL Motherboard > > 16GB Memory > > > > My iperf command line for the client is: > > > > iperf -t 10 -c 169.0.0.1 -w 2.5M -l 2.5M > > > > My TCP dump test command lines are: > > > > tcpdump -i ix0 -w/dev/null > > tcpreplay -i ix0 -t -l 0 -K ./test.pcap > > If you're running 8.0-RELEASE, you might try updating to 8-STABLE. > Jack Vogel recently committed updated Intel NIC driver code: > > http://svn.freebsd.org/viewvc/base/stable/8/sys/dev/ixgbe/ > > -Brandon > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to " > freebsd-performance-unsubscribe@freebsd.org" >