From owner-freebsd-performance@FreeBSD.ORG Thu Aug 5 20:16:47 2010 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 35ABF1065679 for ; Thu, 5 Aug 2010 20:16:47 +0000 (UTC) (envelope-from case.vanrij@gmail.com) Received: from mail-wy0-f182.google.com (mail-wy0-f182.google.com [74.125.82.182]) by mx1.freebsd.org (Postfix) with ESMTP id C1DA98FC13 for ; Thu, 5 Aug 2010 20:16:46 +0000 (UTC) Received: by wyj26 with SMTP id 26so8735640wyj.13 for ; Thu, 05 Aug 2010 13:16:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:date:message-id :subject:from:to:content-type; bh=bKk9SpffnFS18laDZKvQJ2KV5bajrCRgnigRfTrDx/g=; b=pNtKEsu7AddkDnze6pSXk02JsYmVKOcFtPRNOcfGTU7XvksVeU3j69zihtIV5qjSzB umnEP4OaLEkmAPUjGmvOntNXUztcbuTn99mvuQHDyLQMOyHCGx0650+IbSj9vhzTvUSp i6hUTzgZZRC9b8cJC2WnY9uT8edVOxHycgDMU= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; b=CPrhjehPVSslmNQYVsALyvyvhMKxOHDmsnARuMO24lPtDmadYU2tVmbQwhUj4bXICl EH2tJqgvQuEjfcn2AiCIYX6xs1MjzTTZnpz2kIZiyhXzS3nogK1Tg3L2opqKtuA/LCAu EdzC3a0gkxqlF8J/WPMJ+/SLhbR/Qn3+91/6s= MIME-Version: 1.0 Received: by 10.227.147.82 with SMTP id k18mr9878927wbv.64.1281038014337; Thu, 05 Aug 2010 12:53:34 -0700 (PDT) Received: by 10.227.146.10 with HTTP; Thu, 5 Aug 2010 12:53:34 -0700 (PDT) Date: Thu, 5 Aug 2010 12:53:34 -0700 Message-ID: From: Case van Rij To: freebsd-performance@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 Subject: 7.2-RELEASE performance of em + 9k MTU + tso on ESB2 chipset X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Aug 2010 20:16:47 -0000 While investigating a performance issue on a 7.2-RELEASE system I noticed iperf performance on systems with an ESB2 chipset (supermicro X7DBU onboard em) is worse when TSO is enabled at 9000 MTU: em0: flags=8843 metric 0 mtu 9000 options=19b ether 00:30:48:33:43:4e inet 10.53.13.161 netmask 0xffff0000 broadcast 10.53.255.255 media: Ethernet autoselect (1000baseTX ) status: active em0@pci0:4:0:0: class=0x020000 card=0x000015d9 chip=0x10968086 rev=0x01 hdr=0x00 vendor = 'Intel Corporation' device = 'PRO/1000 EB Network Connection' ad005# /usr/local/bin/iperf -c 10.53.13.236 -l 512k -w 1024k -N -t 30 ------------------------------------------------------------ Client connecting to 10.53.13.236, TCP port 5001 TCP window size: 32.0 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.53.13.161 port 56621 connected with 10.53.13.236 port 5001 [ ID] Interval Transfer Bandwidth [ 3] 0.0-30.0 sec 2.69 GBytes 769 Mbits/sec ad005# ifconfig em0 -tso ad005# /usr/local/bin/iperf -c 10.53.13.236 -l 512k -w 1024k -N -t 30 ------------------------------------------------------------ Client connecting to 10.53.13.236, TCP port 5001 TCP window size: 32.0 KByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.53.13.161 port 54876 connected with 10.53.13.236 port 5001 [ ID] Interval Transfer Bandwidth [ 3] 0.0-30.0 sec 3.26 GBytes 933 Mbits/sec I looked through the archive and didn't see anything related to this, but I'm curious if this is a known issue. I have not yet verified if the behaviour is the same on 8.0 Curiously, this doesn't seem to be a problem (or much less so) on 82546EB qaI-LSI-A-2# ifconfig em0 10.53.138.12 netmask 255.255.0.0 mtu 9000 tso qaI-LSI-A-2# iperf -c 10.53.138.11 -l 512k -w 1024k -N -t 30 ------------------------------------------------------------ Client connecting to 10.53.138.11, TCP port 5001 TCP window size: 1.01 MByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.53.138.12 port 49694 connected with 10.53.138.11 port 5001 [ ID] Interval Transfer Bandwidth [ 3] 0.0-30.0 sec 3.29 GBytes 942 Mbits/sec qaI-LSI-A-2# ifconfig em0 10.53.138.12 netmask 255.255.0.0 mtu 9000 -tso qaI-LSI-A-2# iperf -c 10.53.138.11 -l 512k -w 1024k -N -t 30 ------------------------------------------------------------ Client connecting to 10.53.138.11, TCP port 5001 TCP window size: 1.01 MByte (WARNING: requested 1.00 MByte) ------------------------------------------------------------ [ 3] local 10.53.138.12 port 52284 connected with 10.53.138.11 port 5001 [ ID] Interval Transfer Bandwidth [ 3] 0.0-30.0 sec 3.27 GBytes 935 Mbits/sec Thanks, Case