From owner-freebsd-performance@FreeBSD.ORG Thu Apr 22 10:53:21 2010 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 30B51106564A for ; Thu, 22 Apr 2010 10:53:21 +0000 (UTC) (envelope-from jiashiun@gmail.com) Received: from mail-pz0-f172.google.com (mail-pz0-f172.google.com [209.85.222.172]) by mx1.freebsd.org (Postfix) with ESMTP id 00A1E8FC0A for ; Thu, 22 Apr 2010 10:53:20 +0000 (UTC) Received: by pzk2 with SMTP id 2so5376744pzk.27 for ; Thu, 22 Apr 2010 03:53:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :from:date:received:message-id:subject:to:cc:content-type :content-transfer-encoding; bh=8wn39FYO7bJxNj1B1Vos7ItF3ufsvCUZIyDj3jV54pA=; b=aiyAbxHl2ezcVdadnw9+v6etTR4L1OYHufck4zUi2ILTt142sWzYbIG9b1PA4pYDmY z471qrV9G7K1D8L0orTK/43LF2714deItJMBxYuixkAkgEWTEjunWC+U00Va8IgEOUaM VEZJOYf8Z1Zp1e9amNE0igObrx38+8n9oehBw= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type:content-transfer-encoding; b=RIZweO5bdlzOeTNcQN6GkNPaYUIeAGjIw4J/uKfhKebexJR1s7xUNFQfIR965I/hzi cF4wUqv2DC3/poDxIR0rWE87gsdX7mfEUp2Zw6OcoM5pRESLkutTxrLFem1zWgjls2EL OSqP8tSRzgmMmR3NRFTcZV3ZojSqBaIPi7ZXE= MIME-Version: 1.0 Received: by 10.140.143.7 with HTTP; Thu, 22 Apr 2010 03:30:44 -0700 (PDT) In-Reply-To: <4BCF6F52.7030802@softhammer.net> References: <4BCF0C9A.10005@softhammer.net> <4BCF5783.9050007@softhammer.net> <4BCF6F52.7030802@softhammer.net> From: Jia-Shiun Li Date: Thu, 22 Apr 2010 18:30:44 +0800 Received: by 10.140.248.4 with SMTP id v4mr4660117rvh.213.1271932264108; Thu, 22 Apr 2010 03:31:04 -0700 (PDT) Message-ID: To: Stephen Sanders Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: Brandon Gooch , freebsd-performance@freebsd.org, Jack Vogel Subject: Re: FreeBSD 8.0 ixgbe Poor Performance X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Apr 2010 10:53:21 -0000 On Thu, Apr 22, 2010 at 5:34 AM, Stephen Sanders wrote: > According to pciconf, the card is a "82598EB 10 Gigabit AF Dual Port > Network Connection". > > It looks to me like the card is plugged into a 4xPCIe slot. =C2=A0I'm sur= e > this means we're not going to make the 10Gbps but I would imagine that > we should get north of 5 Gbps. Some suggestions: - 'pciconf -lc' too can be used to check pcie link width. Look for pcie capability in the output. - IIRC the kernel auto adjusts TCP window size and one does not need to set it manually. - Set greater MTU size than default 1500. It helps reduce CPU loading. - Do not use file as source or destination unless you are sure disks and I/O paths are fast enough. 10Gbe means 1000+MB/s. Only storage beasts can handle that. BTW, is FreeBSD able to cache and buffer them all in memory? - Finally, use 'top' to make sure nothing is eating up all CPU cycles. Cheers, Jia-Shiun.