From owner-freebsd-net@FreeBSD.ORG Thu Jul 1 02:01:02 2010 Return-Path: Delivered-To: net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C140F106566C for ; Thu, 1 Jul 2010 02:01:02 +0000 (UTC) (envelope-from yanefbsd@gmail.com) Received: from mail-qw0-f54.google.com (mail-qw0-f54.google.com [209.85.216.54]) by mx1.freebsd.org (Postfix) with ESMTP id 7F50F8FC17 for ; Thu, 1 Jul 2010 02:01:02 +0000 (UTC) Received: by qwg5 with SMTP id 5so629903qwg.13 for ; Wed, 30 Jun 2010 19:00:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:date:message-id :subject:from:to:content-type; bh=ROEzDjwnArVeJtwXLrBJecJ739DFvU6FBptbY5G9F9Q=; b=kewiii30r+Be8SfO99tyJBN3om9mcyKFogeRGiPYPcdqBVtKMfIdxVQN+hZ6zQwlVf 5k+jcezEwhc+JZ50ZsRPt95gGea5uZxzY3ieqGkUEMmRJ77Ysj09Lr+CGMqGHHNxCZXY gxr0HfaeDOr8dDRZ3gTNrAsDbF9VQRMbQfkBU= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; b=jCCAzKYdLAWnjPlhHOt2APwap6yyLFAn4IUdJjl4+qky4CJ7GA1QZ5QubeAMC/IXW5 H1v2svRDNFaykv75zVJfmUqe7CueEJRW/QJ5tBdcrS2ECnSiHtDQ4o75ENKkFMtTNFbo FHx7TGZ84OMVczuBQt9dE4IoHoKIEUHnMnu40= MIME-Version: 1.0 Received: by 10.224.35.229 with SMTP id q37mr6761806qad.163.1277949653074; Wed, 30 Jun 2010 19:00:53 -0700 (PDT) Received: by 10.229.221.83 with HTTP; Wed, 30 Jun 2010 19:00:53 -0700 (PDT) Date: Wed, 30 Jun 2010 19:00:53 -0700 Message-ID: From: Garrett Cooper To: net@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 Cc: Subject: Poor performance with natd/ipfw and TSO enabled on bce(4) card and 8.1-PRERELEASE X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Jul 2010 02:01:02 -0000 Hi, Just an observation I made while transferring a file: # time scp floppy.img somehost: Password: floppy.img 100% 1440KB 13.7KB/s 01:45 real 1m59.400s user 0m0.031s sys 0m0.028s # sysctl net.inet.tcp.tso=0 net.inet.tcp.tso: 1 -> 0 # time scp floppy.img somehost: floppy.img 100% 1440KB 1.4MB/s 00:00 real 0m0.712s user 0m0.018s sys 0m0.018s Going ISDN speeds transferring a 1.44MB file is sad when you have a gigabit uplink :(... natd seems to be doing a LOT of spinning when TSO is enabled (it's going up to 73% CPU on a dual-proc quad-core machine). Here are some other details: # ipfw list 00050 divert 8668 ip4 from any to any via bce1 00100 allow ip from any to any via lo0 00200 deny ip from any to 127.0.0.0/8 00300 deny ip from 127.0.0.0/8 to any 00400 deny ip from any to ::1 00500 deny ip from ::1 to any 00600 allow ipv6-icmp from :: to ff02::/16 00700 allow ipv6-icmp from fe80::/10 to fe80::/10 00800 allow ipv6-icmp from fe80::/10 to ff02::/16 00900 allow ipv6-icmp from any to any ip6 icmp6types 1 01000 allow ipv6-icmp from any to any ip6 icmp6types 2,135,136 65000 allow ip from any to any 65535 deny ip from any to any # ls /etc/natd* ls: /etc/natd*: No such file or directory # uname -a FreeBSD tameshi.cisco.com 8.1-PRERELEASE FreeBSD 8.1-PRERELEASE #0 r209169: Mon Jun 14 12:41:49 PDT 2010 root@:/usr/obj/data/scratch/src/stable/8/sys/TAMESHI_STABLE amd64 # pciconf -lv | grep -A 4 bce bce1@pci0:7:0:0: class=0x020000 card=0x01b21028 chip=0x164c14e4 rev=0x12 hdr=0x00 vendor = 'Broadcom Corporation' device = 'Broadcom NetXtreme II Gigabit Ethernet Adapter (BCM5708)' class = network subclass = ethernet -- bce0@pci0:3:0:0: class=0x020000 card=0x01b21028 chip=0x164c14e4 rev=0x12 hdr=0x00 vendor = 'Broadcom Corporation' device = 'Broadcom NetXtreme II Gigabit Ethernet Adapter (BCM5708)' class = network subclass = ethernet Let me know what other info is required. Thanks, -Garrett PS Please keep me CCed in all emails.