From owner-freebsd-performance@FreeBSD.ORG Sun Oct 18 20:35:30 2009 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A45B2106566C; Sun, 18 Oct 2009 20:35:30 +0000 (UTC) (envelope-from brent@servuhome.net) Received: from mail-px0-f186.google.com (mail-px0-f186.google.com [209.85.216.186]) by mx1.freebsd.org (Postfix) with ESMTP id 7FB348FC1A; Sun, 18 Oct 2009 20:35:30 +0000 (UTC) Received: by pxi16 with SMTP id 16so2161894pxi.3 for ; Sun, 18 Oct 2009 13:35:29 -0700 (PDT) MIME-Version: 1.0 Received: by 10.142.3.35 with SMTP id 35mr249229wfc.205.1255896323541; Sun, 18 Oct 2009 13:05:23 -0700 (PDT) In-Reply-To: References: <78DB4AE8EF5F4A1EBD3992D7404B2725@china.huawei.com> Date: Sun, 18 Oct 2009 13:05:23 -0700 Message-ID: From: Brent Jones To: Adrian Chadd Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: Hongtao Yin , freebsd-performance@freebsd.org Subject: Re: Comparison of FreeBSD/Linux TCP Throughput performance X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Oct 2009 20:35:30 -0000 On Sun, Oct 18, 2009 at 7:55 AM, Adrian Chadd wrote: > FYI, I installed netperf on my local p4-D test boxes that I use for > other testing. > > 128 byte send/receive buffers on the client side: > > kristy# netperf -H 192.168.10.2 -p 22113 -l 10 > TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 192.168.10.2 > (192.168.10.2) port 0 AF_INET > Recv =A0 Send =A0 =A0Send > Socket Socket =A0Message =A0Elapsed > Size =A0 Size =A0 =A0Size =A0 =A0 Time =A0 =A0 Throughput > bytes =A0bytes =A0 bytes =A0 =A0secs. =A0 =A010^6bits/sec > > =A08192 =A0 =A0128 =A0 =A0128 =A0 =A010.00 =A0 =A0 426.17 > > 1kbyte send/receive buffers: > > kristy# netperf -H 192.168.10.2 -p 22113 -l 10 > TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 192.168.10.2 > (192.168.10.2) port 0 AF_INET > Recv =A0 Send =A0 =A0Send > Socket Socket =A0Message =A0Elapsed > Size =A0 Size =A0 =A0Size =A0 =A0 Time =A0 =A0 Throughput > bytes =A0bytes =A0 bytes =A0 =A0secs. =A0 =A010^6bits/sec > > =A08192 =A0 1024 =A0 1024 =A0 =A010.00 =A0 =A0 903.39 > > 8kbyte send/receive buffers: > > kristy# netperf -H 192.168.10.2 -p 22113 -l 10 > TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 192.168.10.2 > (192.168.10.2) port 0 AF_INET > Recv =A0 Send =A0 =A0Send > Socket Socket =A0Message =A0Elapsed > Size =A0 Size =A0 =A0Size =A0 =A0 Time =A0 =A0 Throughput > bytes =A0bytes =A0 bytes =A0 =A0secs. =A0 =A010^6bits/sec > > =A08192 =A0 8192 =A0 8192 =A0 =A010.00 =A0 =A0 913.71 > > Both boxes are 7.2-REL amd64 boxes on 3.4GHz Pentium-D CPUs using some > onboard flavour of the intel e1000 NIC: > > =A0 =A0device =A0 =A0 =3D '82573E Intel Corporation 82573E Gigabit Ethern= et > Controller (Copper)' > > They are connected via a Cisco 3750G L3 switch. In fact, the traffic > is routed, rather than switched. > > My /etc/sysctl.conf: > > net.inet.icmp.icmplim=3D0 > net.inet.icmp.icmplim_output=3D0 > net.inet.tcp.msl=3D3000 > net.inet.tcp.sendspace=3D8192 > net.inet.tcp.recvspace=3D8192 > kern.maxfilesperproc=3D65536 > kern.maxfiles=3D262144 > kern.ipc.maxsockets=3D32768 > kern.ipc.somaxconn=3D1024 > kern.ipc.nmbclusters=3D131072 > net.inet.ip.fw.enable=3D0 > kern.ipc.somaxconn=3D10240 > > 2c, > > > Adrian > > 2009/10/15 Hongtao Yin : >> Hi, >> >> Can you try with 64K and up tp 1MB buffers? I see ~1Gbit speeds with my FreeBSD boxes using Broadcom NIC's and cheap Netgear switches. I'm not sure how the original tester got such poor numbers, when my setup is relatively low end, and sustaining Gbit speeds is no major feat. --=20 Brent Jones brent@servuhome.net