From owner-freebsd-net@FreeBSD.ORG Sun Apr 24 22:15:27 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1484A1065676 for ; Sun, 24 Apr 2011 22:15:27 +0000 (UTC) (envelope-from pyunyh@gmail.com) Received: from mail-pz0-f54.google.com (mail-pz0-f54.google.com [209.85.210.54]) by mx1.freebsd.org (Postfix) with ESMTP id 980A58FC12 for ; Sun, 24 Apr 2011 22:15:26 +0000 (UTC) Received: by pzk27 with SMTP id 27so1249862pzk.13 for ; Sun, 24 Apr 2011 15:15:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:from:date:to:cc:subject:message-id:reply-to :references:mime-version:content-type:content-disposition :in-reply-to:user-agent; bh=nLU36AalXFmtbBSlwGiaHbo9o2lpI6wrYYzs5R5XavU=; b=S7TCHXc2PQW4JKZa93ym3JX64wWs0TliL34JNwz6Edf4ri0DyS2GqambYxlu4g8fld LwcHkID6FWf7wfL4UFzEZKTcl1n6AAzTY0G8qbGoPLrgwUN2nobs5ciZaxxbt3y/R/RR oaXsPItw2kaRpiCtv/c6NeNZ4mT9q+LM3jjW8= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:date:to:cc:subject:message-id:reply-to:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; b=rY0jNpO3i9+8JzrBWpndLQq7rZ/PkoB2cePj/noxkcmf5/cCe3sX8GaMyl7pzc77xE djCgBD+LFuNEd2Y4eE0j5wvC9UE4ecKjN+THkRB8WWPZMeBf02396TxbJHjbaY8tzzhx kH/U1sfx043ufp5MkzrXqu4WsC+hEzT+uz978= Received: by 10.68.39.40 with SMTP id m8mr1416526pbk.258.1303683325037; Sun, 24 Apr 2011 15:15:25 -0700 (PDT) Received: from pyunyh@gmail.com ([174.35.1.224]) by mx.google.com with ESMTPS id a4sm3470057pbf.56.2011.04.24.15.15.20 (version=TLSv1/SSLv3 cipher=OTHER); Sun, 24 Apr 2011 15:15:22 -0700 (PDT) Received: by pyunyh@gmail.com (sSMTP sendmail emulation); Sun, 24 Apr 2011 15:14:33 -0700 From: YongHyeon PYUN Date: Sun, 24 Apr 2011 15:14:33 -0700 To: Paul Thornton Message-ID: <20110424221433.GA1730@michelle.cdnetworks.com> References: <4DADD913.5010208@prt.org> <20110419220907.GD1637@michelle.cdnetworks.com> <4DAEBB67.7070303@prt.org> <20110420131613.GA84319@alchemy.franken.de> <4DAEDE27.8080205@prt.org> <20110420134459.GL38455@alchemy.franken.de> <4DAEF9F8.5070305@prt.org> <20110420171813.GA8566@michelle.cdnetworks.com> <4DB2F04C.9000006@prt.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <4DB2F04C.9000006@prt.org> User-Agent: Mutt/1.4.2.3i Cc: freebsd-net@freebsd.org, Marius Strobl Subject: Re: Broadcom BCM57765 support? X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: pyunyh@gmail.com List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 24 Apr 2011 22:15:27 -0000 On Sat, Apr 23, 2011 at 04:29:16PM +0100, Paul Thornton wrote: > Hi, > > Good news - I have success! > Glad to hear that. > On 20/04/2011 18:18, YongHyeon PYUN wrote: > > Ok, that would indicate there is an interrupt delivery issue if all > > others changes(including Marius' patch) are correct. Because there > > is no publicly available data sheet for BCM57765 yet I'm not sure > > what is real difference between BCM5717 and BCM57765. However I > > guess they require similar hardware configuration. Both BCM5717 and > > BCM57765 will use tagged status feature of controller if MSI is > > available. And NVIDIA bridge controller is known to have MSI issues > > for a long time in FreeBSD. Please check whether you received any > > interrupts for bge(4) with vmstat(8). If you see no interrupt from > > the output, either try disabling MSI or apply r219737 and r219740 > > and see whether that makes any difference. > > The problem is definitely with the interrupts. I saw nothing for bge in > vmstat with MSI enabled. > > Rebooting with MSI disabled and all works well so far - I haven't done a > lot of testing yet, but it has been operating with pings / file > transfers for over 1 hour now without problems. > > Apologies for asking such a basic question, but I've typically > downloaded latest sources etc. from HEAD via cvsweb in the past when I > needed them. > How do I locate the r219737 and r219740 changes on their own to try them > out with MSI enabled? I'm guessing I'll need to cvsup the relevant > sources but I can't see how to find out what I need. > SVN: http://svnweb.freebsd.org/base/head/sys/dev/pci/pci.c?r1=219737&r2=219736&view=patch http://svnweb.freebsd.org/base/head/sys/dev/pci/pcivar.h?r1=219737&r2=219736&view=patch http://svnweb.freebsd.org/base/head/sys/dev/pci/pci.c?r1=219740&r2=219737&view=patch OR CVS: http://www.freebsd.org/cgi/cvsweb.cgi/src/sys/dev/pci/pci.c.diff?r1=1.413;r2=1.414;f=h http://www.freebsd.org/cgi/cvsweb.cgi/src/sys/dev/pci/pcivar.h.diff?r1=1.88;r2=1.89;f=h http://www.freebsd.org/cgi/cvsweb.cgi/src/sys/dev/pci/pci.c.diff?r1=1.414;r2=1.415;f=h Apply them and remove an entry in loader.conf that disables MSI. > Thanks, > > Paul. From owner-freebsd-net@FreeBSD.ORG Mon Apr 25 11:07:04 2011 Return-Path: Delivered-To: freebsd-net@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A20DD1065672 for ; Mon, 25 Apr 2011 11:07:04 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 8F2FF8FC1B for ; Mon, 25 Apr 2011 11:07:04 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.4/8.14.4) with ESMTP id p3PB74oD084636 for ; Mon, 25 Apr 2011 11:07:04 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.4/8.14.4/Submit) id p3PB739O084634 for freebsd-net@FreeBSD.org; Mon, 25 Apr 2011 11:07:03 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 25 Apr 2011 11:07:03 GMT Message-Id: <201104251107.p3PB739O084634@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-net@FreeBSD.org Cc: Subject: Current problem reports assigned to freebsd-net@FreeBSD.org X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 Apr 2011 11:07:04 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/156493 net [msk] Marvell Yukon 2 device works only few seconds o kern/156408 net [vlan] Routing failure when using VLANs vs. Physical e o kern/156328 net [icmp]: host can ping other subnet but no have IP from o kern/156317 net [ip6] Wrong order of IPv6 NS DAD/MLD Report o kern/156283 net [ip6] [patch] nd6_ns_input - rtalloc_mpath does not re o kern/156279 net [if_bridge][divert][ipfw] unable to correctly re-injec o kern/156226 net [lagg]: failover does not announce the failover to swi o kern/156030 net [ip6] [panic] Crash in nd6_dad_start() due to null ptr o kern/155772 net ifconfig(8): ioctl (SIOCAIFADDR): File exists on direc o kern/155680 net [multicast] problems with multicast s kern/155642 net [request] Add driver for Realtek RTL8191SE/RTL8192SE W o kern/155636 net [msk] msk driver locks marvel yukon 88E8057 NIC o kern/155604 net [flowtable] Flowtable excessively caches dest MAC addr o kern/155597 net [panic] Kernel panics with "sbdrop" message o kern/155585 net [tcp] [panic] tcp_output tcp_mtudisc loop until kernel o kern/155498 net [ral] ral(4) needs to be resynced with OpenBSD's to ga o kern/155420 net [vlan] adding vlan break existent vlan o bin/155365 net [patch] routed(8): if.c in routed fails to compile if o kern/155177 net [route] [panic] Panic when inject routes in kernel o kern/155030 net [igb] igb(4) DEVICE_POLLING does not work with carp(4) o kern/155010 net [msk] ntfs-3g via iscsi using msk driver cause kernel o kern/155004 net [bce] [panic] kernel panic in bce0 driver o kern/154943 net [gif] ifconfig gifX create on existing gifX clears IP s kern/154851 net [request]: Port brcm80211 driver from Linux to FreeBSD o kern/154850 net [netgraph] [patch] ng_ether fails to name nodes when t o kern/154831 net [arp] [patch] arp sysctl setting log_arp_permanent_mod o kern/154679 net [em] Fatal trap 12: "em1 taskq" only at startup (8.1-R o kern/154600 net [tcp] [panic] Random kernel panics on tcp_output o kern/154567 net [ath] ath(4) lot of bad series(0) o kern/154557 net [tcp] Freeze tcp-session of the clients, if in the gat o kern/154443 net [if_bridge] Kernel module bridgestp.ko missing after u o kern/154286 net [netgraph] [panic] 8.2-PRERELEASE panic in netgraph o kern/154284 net [ath] Modern ath wifi cards (such as AR9285) have miss o kern/154255 net [nfs] NFS not responding o kern/154214 net [stf] [panic] Panic when creating stf interface o kern/154185 net race condition in mb_dupcl o kern/154169 net [multicast] [ip6] Node Information Query multicast add o kern/154134 net [ip6] stuck kernel state in LISTEN on ipv6 daemon whic o kern/154091 net [netgraph] [panic] netgraph, unaligned mbuf? o conf/154062 net [vlan] [patch] change to way of auto-generatation of v o kern/153937 net [ral] ralink panics the system (amd64 freeBSDD 8.X) wh o kern/153936 net [ixgbe] [patch] MPRC workaround incorrectly applied to o kern/153816 net [ixgbe] ixgbe doesn't work properly with the Intel 10g o kern/153772 net [ixgbe] [patch] sysctls reference wrong XON/XOFF varia o kern/153671 net [em] [panic] 8.2-PRERELEASE repeatable kernel in if_em o kern/153497 net [netgraph] netgraph panic due to race conditions o kern/153454 net [patch] [wlan] [urtw] Support ad-hoc and hostap modes o kern/153308 net [em] em interface use 100% cpu o kern/153255 net [panic] 8.2-PRERELEASE repeatable kernel panic under h o kern/153244 net [em] em(4) fails to send UDP to port 0xffff o kern/152893 net [netgraph] [panic] 8.2-PRERELEASE panic in netgraph o kern/152853 net [em] tftpd (and likely other udp traffic) fails over e o kern/152828 net [em] poor performance on 8.1, 8.2-PRE o kern/152569 net [net]: Multiple ppp connections and routing table prob o kern/152360 net [dummynet] [panic] Crash related to dummynet. o kern/152235 net [arp] Permanent local ARP entries are not properly upd o kern/152141 net [vlan] [patch] encapsulate vlan in ng_ether before out o kern/151690 net [ep] network connectivity won't work until dhclient is o kern/151681 net [nfs] NFS mount via IPv6 leads to hang on client with o kern/151593 net [igb] [panic] Kernel panic when bringing up igb networ o kern/150920 net [ixgbe][igb] Panic when packets are dropped with heade o bin/150642 net netstat(1) doesn't print anything for SCTP sockets o kern/150557 net [igb] igb0: Watchdog timeout -- resetting o kern/150251 net [patch] [ixgbe] Late cable insertion broken o kern/150249 net [ixgbe] Media type detection broken o bin/150224 net ppp(8) does not reassign static IP after kill -KILL co f kern/149969 net [wlan] [ral] ralink rt2661 fails to maintain connectio o kern/149937 net [ipfilter] [patch] kernel panic in ipfilter IP fragmen o kern/149643 net [rum] device not sending proper beacon frames in ap mo o kern/149609 net [panic] reboot after adding second default route o kern/149306 net [alc] Doesn't work Atheros AR8131 PCIe Gigabit Etherne o kern/149117 net [inet] [patch] in_pcbbind: redundant test o kern/149086 net [multicast] Generic multicast join failure in 8.1 o kern/148018 net [flowtable] flowtable crashes on ia64 o kern/147912 net [boot] FreeBSD 8 Beta won't boot on Thinkpad i1300 11 o kern/147894 net [ipsec] IPv6-in-IPv4 does not work inside an ESP-only o kern/147155 net [ip6] setfb not work with ipv6 o kern/146845 net [libc] close(2) returns error 54 (connection reset by f kern/146792 net [flowtable] flowcleaner 100% cpu's core load o kern/146719 net [pf] [panic] PF or dumynet kernel panic o kern/146534 net [icmp6] wrong source address in echo reply o kern/146427 net [mwl] Additional virtual access points don't work on m o kern/146426 net [mwl] 802.11n rates not possible on mwl o kern/146425 net [mwl] mwl dropping all packets during and after high u f kern/146394 net [vlan] IP source address for outgoing connections o bin/146377 net [ppp] [tun] Interface doesn't clear addresses when PPP o kern/146358 net [vlan] wrong destination MAC address o kern/146165 net [wlan] [panic] Setting bssid in adhoc mode causes pani o kern/146082 net [ng_l2tp] a false invaliant check was performed in ng_ o kern/146037 net [panic] mpd + CoA = kernel panic o bin/145934 net [patch] add count option to netstat(1) o kern/145826 net [ath] Unable to configure adhoc mode on ath0/wlan0 o kern/145825 net [panic] panic: soabort: so_count o kern/145728 net [lagg] Stops working lagg between two servers. f kern/144917 net [flowtable] [panic] flowtable crashes system [regressi o kern/144882 net MacBookPro =>4.1 does not connect to BSD in hostap wit o kern/144874 net [if_bridge] [patch] if_bridge frees mbuf after pfil ho o conf/144700 net [rc.d] async dhclient breaks stuff for too many people o kern/144642 net [rum] [panic] Enabling rum interface causes panic o kern/144616 net [nat] [panic] ip_nat panic FreeBSD 7.2 o kern/144572 net [carp] CARP preemption mode traffic partially goes to f kern/144315 net [ipfw] [panic] freebsd 8-stable reboot after add ipfw o kern/144231 net bind/connect/sendto too strict about sockaddr length o kern/143939 net [ipfw] [em] ipfw nat and em interface rxcsum problem o kern/143846 net [gif] bringing gif3 tunnel down causes gif0 tunnel to s kern/143673 net [stf] [request] there should be a way to support multi s kern/143666 net [ip6] [request] PMTU black hole detection not implemen o kern/143622 net [pfil] [patch] unlock pfil lock while calling firewall o kern/143593 net [ipsec] When using IPSec, tcpdump doesn't show outgoin o kern/143591 net [ral] RT2561C-based DLink card (DWL-510) fails to work o kern/143208 net [ipsec] [gif] IPSec over gif interface not working o kern/143034 net [panic] system reboots itself in tcp code [regression] o kern/142877 net [hang] network-related repeatable 8.0-STABLE hard hang o kern/142774 net Problem with outgoing connections on interface with mu o kern/142772 net [libc] lla_lookup: new lle malloc failed o kern/142018 net [iwi] [patch] Possibly wrong interpretation of beacon- o kern/141861 net [wi] data garbled with WEP and wi(4) with Prism 2.5 f kern/141741 net Etherlink III NIC won't work after upgrade to FBSD 8, o kern/141023 net [carp] CARP arp replays with wrong src mac o kern/140796 net [ath] [panic] privileged instruction fault o kern/140742 net rum(4) Two asus-WL167G adapters cannot talk to each ot o kern/140682 net [netgraph] [panic] random panic in netgraph o kern/140634 net [vlan] destroying if_lagg interface with if_vlan membe o kern/140619 net [ifnet] [patch] refine obsolete if_var.h comments desc o kern/140346 net [wlan] High bandwidth use causes loss of wlan connecti o kern/140142 net [ip6] [panic] FreeBSD 7.2-amd64 panic w/IPv6 o kern/140066 net [bwi] install report for 8.0 RC 2 (multiple problems) o kern/139565 net [ipfilter] ipfilter ioctl SIOCDELST broken o kern/139387 net [ipsec] Wrong lenth of PF_KEY messages in promiscuous o bin/139346 net [patch] arp(8) add option to remove static entries lis o kern/139268 net [if_bridge] [patch] allow if_bridge to forward just VL p kern/139204 net [arp] DHCP server replies rejected, ARP entry lost bef o kern/139117 net [lagg] + wlan boot timing (EBUSY) o kern/139058 net [ipfilter] mbuf cluster leak on FreeBSD 7.2 o kern/138850 net [dummynet] dummynet doesn't work correctly on a bridge o kern/138782 net [panic] sbflush_internal: cc 0 || mb 0xffffff004127b00 o kern/138688 net [rum] possibly broken on 8 Beta 4 amd64: able to wpa a o kern/138678 net [lo] FreeBSD does not assign linklocal address to loop o kern/138620 net [lagg] [patch] lagg port bpf-writes blocked o kern/138407 net [gre] gre(4) interface does not come up after reboot o kern/138332 net [tun] [lor] ifconfig tun0 destroy causes LOR if_adata/ o kern/138266 net [panic] kernel panic when udp benchmark test used as r o kern/138177 net [ipfilter] FreeBSD crashing repeatedly in ip_nat.c:257 o kern/137881 net [netgraph] [panic] ng_pppoe fatal trap 12 o bin/137841 net [patch] wpa_supplicant(8) cannot verify SHA256 signed p kern/137776 net [rum] panic in rum(4) driver on 8.0-BETA2 o bin/137641 net ifconfig(8): various problems with "vlan_device.vlan_i o bin/137484 net [patch] Integer overflow in wpa_supplicant(8) base64 e o kern/137392 net [ip] [panic] crash in ip_nat.c line 2577 o kern/137372 net [ral] FreeBSD doesn't support wireless interface from o kern/137089 net [lagg] lagg falsely triggers IPv6 duplicate address de o bin/136994 net [patch] ifconfig(8) print carp mac address o kern/136911 net [netgraph] [panic] system panic on kldload ng_bpf.ko t o bin/136661 net [patch] ndp(8) ignores -f option o kern/136618 net [pf][stf] panic on cloning interface without unit numb o kern/136426 net [panic] spawning several dhclients in parallel panics o kern/135502 net [periodic] Warning message raised by rtfree function i o kern/134931 net [route] Route messages sent to all socket listeners re o kern/134583 net [hang] Machine with jail freezes after random amount o o kern/134531 net [route] [panic] kernel crash related to routes/zebra o kern/134157 net [dummynet] dummynet loads cpu for 100% and make a syst o kern/133969 net [dummynet] [panic] Fatal trap 12: page fault while in o kern/133968 net [dummynet] [panic] dummynet kernel panic o kern/133736 net [udp] ip_id not protected ... o kern/133595 net [panic] Kernel Panic at pcpu.h:195 o kern/133572 net [ppp] [hang] incoming PPTP connection hangs the system o kern/133490 net [bpf] [panic] 'kmem_map too small' panic on Dell r900 o kern/133235 net [netinet] [patch] Process SIOCDLIFADDR command incorre o kern/133218 net [carp] [hang] use of carp(4) causes system to freeze f kern/133213 net arp and sshd errors on 7.1-PRERELEASE o kern/133060 net [ipsec] [pfsync] [panic] Kernel panic with ipsec + pfs o kern/132889 net [ndis] [panic] NDIS kernel crash on load BCM4321 AGN d o conf/132851 net [patch] rc.conf(5): allow to setfib(1) for service run o kern/132734 net [ifmib] [panic] panic in net/if_mib.c o kern/132705 net [libwrap] [patch] libwrap - infinite loop if hosts.all o kern/132672 net [ndis] [panic] ndis with rt2860.sys causes kernel pani o kern/132554 net [ipl] There is no ippool start script/ipfilter magic t o kern/132354 net [nat] Getting some packages to ipnat(8) causes crash o kern/132285 net [carp] alias gives incorrect hash in dmesg o kern/132277 net [crypto] [ipsec] poor performance using cryptodevice f o kern/132107 net [carp] carp(4) advskew setting ignored when carp IP us o kern/131781 net [ndis] ndis keeps dropping the link o kern/131776 net [wi] driver fails to init o kern/131753 net [altq] [panic] kernel panic in hfsc_dequeue o bin/131567 net [socket] [patch] Update for regression/sockets/unix_cm o bin/131365 net route(8): route add changes interpretation of network f kern/130820 net [ndis] wpa_supplicant(8) returns 'no space on device' o kern/130628 net [nfs] NFS / rpc.lockd deadlock on 7.1-R o conf/130555 net [rc.d] [patch] No good way to set ipfilter variables a o kern/130525 net [ndis] [panic] 64 bit ar5008 ndisgen-erated driver cau o kern/130311 net [wlan_xauth] [panic] hostapd restart causing kernel pa o kern/130109 net [ipfw] Can not set fib for packets originated from loc f kern/130059 net [panic] Leaking 50k mbufs/hour f kern/129750 net [ath] Atheros AR5006 exits on "cannot map register spa f kern/129719 net [nfs] [panic] Panic during shutdown, tcp_ctloutput: in o kern/129517 net [ipsec] [panic] double fault / stack overflow o kern/129508 net [carp] [panic] Kernel panic with EtherIP (may be relat o kern/129219 net [ppp] Kernel panic when using kernel mode ppp o kern/129197 net [panic] 7.0 IP stack related panic o bin/128954 net ifconfig(8) deletes valid routes o bin/128602 net [an] wpa_supplicant(8) crashes with an(4) o kern/128448 net [nfs] 6.4-RC1 Boot Fails if NFS Hostname cannot be res o conf/128334 net [request] use wpa_cli in the "WPA DHCP" situation o bin/128295 net [patch] ifconfig(8) does not print TOE4 or TOE6 capabi o bin/128001 net wpa_supplicant(8), wlan(4), and wi(4) issues o kern/127826 net [iwi] iwi0 driver has reduced performance and connecti o kern/127815 net [gif] [patch] if_gif does not set vlan attributes from o kern/127724 net [rtalloc] rtfree: 0xc5a8f870 has 1 refs f bin/127719 net [arp] arp: Segmentation fault (core dumped) f kern/127528 net [icmp]: icmp socket receives icmp replies not owned by o bin/127192 net routed(8) removes the secondary alias IP of interface f kern/127145 net [wi]: prism (wi) driver crash at bigger traffic o kern/127057 net [udp] Unable to send UDP packet via IPv6 socket to IPv o kern/127050 net [carp] ipv6 does not work on carp interfaces [regressi o kern/126945 net [carp] CARP interface destruction with ifconfig destro o kern/126895 net [patch] [ral] Add antenna selection (marked as TBD) o kern/126874 net [vlan]: Zebra problem if ifconfig vlanX destroy o kern/126714 net [carp] CARP interface renaming makes system no longer o kern/126695 net rtfree messages and network disruption upon use of if_ o kern/126339 net [ipw] ipw driver drops the connection o kern/126075 net [inet] [patch] internet control accesses beyond end of o bin/125922 net [patch] Deadlock in arp(8) o kern/125920 net [arp] Kernel Routing Table loses Ethernet Link status o kern/125845 net [netinet] [patch] tcp_lro_rx() should make use of hard o kern/125816 net [carp] [if_bridge] carp stuck in init when using bridg o kern/125617 net [ath] [panic] ath(4) related panic o kern/125501 net [ath] atheros cardbus driver hangs f kern/125442 net [carp] [lagg] CARP combined with LAGG causes system pa o kern/125258 net [socket] socket's SO_REUSEADDR option does not work o kern/125239 net [gre] kernel crash when using gre o kern/124341 net [ral] promiscuous mode for wireless device ral0 looses o kern/124225 net [ndis] [patch] ndis network driver sometimes loses net o kern/124160 net [libc] connect(2) function loops indefinitely o kern/124021 net [ip6] [panic] page fault in nd6_output() o kern/123968 net [rum] [panic] rum driver causes kernel panic with WPA. o kern/123892 net [tap] [patch] No buffer space available o kern/123890 net [ppp] [panic] crash & reboot on work with PPP low-spee o kern/123858 net [stf] [patch] stf not usable behind a NAT o kern/123796 net [ipf] FreeBSD 6.1+VPN+ipnat+ipf: port mapping does not o kern/123758 net [panic] panic while restarting net/freenet6 o bin/123633 net ifconfig(8) doesn't set inet and ether address in one o kern/123559 net [iwi] iwi periodically disassociates/associates [regre o bin/123465 net [ip6] route(8): route add -inet6 -interfac o kern/123463 net [ipsec] [panic] repeatable crash related to ipsec-tool o conf/123330 net [nsswitch.conf] Enabling samba wins in nsswitch.conf c o kern/123160 net [ip] Panic and reboot at sysctl kern.polling.enable=0 f kern/123045 net [ng_mppc] ng_mppc_decompress - disabling node o kern/122989 net [swi] [panic] 6.3 kernel panic in swi1: net o kern/122954 net [lagg] IPv6 EUI64 incorrectly chosen for lagg devices f kern/122780 net [lagg] tcpdump on lagg interface during high pps wedge o kern/122697 net [ath] Atheros card is not well supported o kern/122685 net It is not visible passing packets in tcpdump(1) o kern/122319 net [wi] imposible to enable ad-hoc demo mode with Orinoco o kern/122290 net [netgraph] [panic] Netgraph related "kmem_map too smal o kern/122033 net [ral] [lor] Lock order reversal in ral0 at bootup ieee o bin/121895 net [patch] rtsol(8)/rtsold(8) doesn't handle managed netw s kern/121774 net [swi] [panic] 6.3 kernel panic in swi1: net o kern/121555 net [panic] Fatal trap 12: current process = 12 (swi1: net o kern/121443 net [gif] [lor] icmp6_input/nd6_lookup o kern/121437 net [vlan] Routing to layer-2 address does not work on VLA o bin/121359 net [patch] [security] ppp(8): fix local stack overflow in o kern/121257 net [tcp] TSO + natd -> slow outgoing tcp traffic o kern/121181 net [panic] Fatal trap 3: breakpoint instruction fault whi o kern/120966 net [rum] kernel panic with if_rum and WPA encryption p docs/120945 net [patch] ip6(4) man page lacks documentation for TCLASS o kern/120566 net [request]: ifconfig(8) make order of arguments more fr o kern/120304 net [netgraph] [patch] netgraph source assumes 32-bit time o kern/120266 net [udp] [panic] gnugk causes kernel panic when closing U o kern/120130 net [carp] [panic] carp causes kernel panics in any conste o bin/120060 net routed(8) deletes link-level routes in the presence of o kern/119945 net [rum] [panic] rum device in hostap mode, cause kernel o kern/119791 net [nfs] UDP NFS mount of aliased IP addresses from a Sol o kern/119617 net [nfs] nfs error on wpa network when reseting/shutdown f kern/119516 net [ip6] [panic] _mtx_lock_sleep: recursed on non-recursi o kern/119432 net [arp] route add -host -iface causes arp e o kern/119225 net [wi] 7.0-RC1 no carrier with Prism 2.5 wifi card [regr o kern/118727 net [netgraph] [patch] [request] add new ng_pf module o kern/117448 net [carp] 6.2 kernel crash [regression] o kern/117423 net [vlan] Duplicate IP on different interfaces o bin/117339 net [patch] route(8): loading routing management commands o kern/117271 net [tap] OpenVPN TAP uses 99% CPU on releng_6 when if_tap o bin/116643 net [patch] [request] fstat(1): add INET/INET6 socket deta o kern/116185 net [iwi] if_iwi driver leads system to reboot o kern/115239 net [ipnat] panic with 'kmem_map too small' using ipnat o kern/115019 net [netgraph] ng_ether upper hook packet flow stops on ad o kern/115002 net [wi] if_wi timeout. failed allocation (busy bit). ifco o kern/114915 net [patch] [pcn] pcn (sys/pci/if_pcn.c) ethernet driver f o kern/113432 net [ucom] WARNING: attempt to net_add_domain(netgraph) af o kern/112722 net [ipsec] [udp] IP v4 udp fragmented packet reject o kern/112686 net [patm] patm driver freezes System (FreeBSD 6.2-p4) i38 o bin/112557 net [patch] ppp(8) lock file should not use symlink name o kern/112528 net [nfs] NFS over TCP under load hangs with "impossible p o kern/111457 net [ral] ral(4) freeze o kern/109470 net [wi] Orinoco Classic Gold PC Card Can't Channel Hop o kern/109308 net [pppd] [panic] Multiple panics kernel ppp suspected [r o bin/108895 net pppd(8): PPPoE dead connections on 6.2 [regression] o kern/107944 net [wi] [patch] Forget to unlock mutex-locks f kern/107279 net [ath] [panic] ath_start: attempted use of a free mbuf! o conf/107035 net [patch] bridge(8): bridge interface given in rc.conf n o kern/106444 net [netgraph] [panic] Kernel Panic on Binding to an ip to o kern/106438 net [ipf] ipfilter: keep state does not seem to allow repl o kern/106316 net [dummynet] dummynet with multipass ipfw drops packets o kern/105945 net Address can disappear from network interface s kern/105943 net Network stack may modify read-only mbuf chain copies o bin/105925 net problems with ifconfig(8) and vlan(4) [regression] o kern/104851 net [inet6] [patch] On link routes not configured when usi o kern/104751 net [netgraph] kernel panic, when getting info about my tr o kern/103191 net Unpredictable reboot o kern/103135 net [ipsec] ipsec with ipfw divert (not NAT) encodes a pac o kern/102540 net [netgraph] [patch] supporting vlan(4) by ng_fec(4) o conf/102502 net [netgraph] [patch] ifconfig name does't rename netgrap o kern/102035 net [plip] plip networking disables parallel port printing o kern/101948 net [ipf] [panic] Kernel Panic Trap No 12 Page Fault - cau o kern/100709 net [libc] getaddrinfo(3) should return TTL info o kern/100519 net [netisr] suggestion to fix suboptimal network polling o kern/98978 net [ipf] [patch] ipfilter drops OOW packets under 6.1-Rel o kern/98597 net [inet6] Bug in FreeBSD 6.1 IPv6 link-local DAD procedu o bin/98218 net wpa_supplicant(8) blacklist not working o kern/97306 net [netgraph] NG_L2TP locks after connection with failed o conf/97014 net [gif] gifconfig_gif? in rc.conf does not recognize IPv f kern/96268 net [socket] TCP socket performance drops by 3000% if pack o kern/95519 net [ral] ral0 could not map mbuf o kern/95288 net [pppd] [tty] [panic] if_ppp panic in sys/kern/tty_subr o kern/95277 net [netinet] [patch] IP Encapsulation mask_match() return o kern/95267 net packet drops periodically appear f kern/93378 net [tcp] Slow data transfer in Postfix and Cyrus IMAP (wo o kern/93019 net [ppp] ppp and tunX problems: no traffic after restarti o kern/92880 net [libc] [patch] almost rewritten inet_network(3) functi s kern/92279 net [dc] Core faults everytime I reboot, possible NIC issu o kern/91859 net [ndis] if_ndis does not work with Asus WL-138 s kern/91777 net [ipf] [patch] wrong behaviour with skip rule inside an o kern/91364 net [ral] [wep] WF-511 RT2500 Card PCI and WEP o kern/91311 net [aue] aue interface hanging s kern/90086 net [hang] 5.4p8 on supermicro P8SCT hangs during boot if o kern/87521 net [ipf] [panic] using ipfilter "auth" keyword leads to k o kern/87421 net [netgraph] [panic]: ng_ether + ng_eiface + if_bridge s kern/86920 net [ndis] ifconfig: SIOCS80211: Invalid argument [regress o kern/86871 net [tcp] [patch] allocation logic for PCBs in TIME_WAIT s o kern/86427 net [lor] Deadlock with FASTIPSEC and nat o kern/86103 net [ipf] Illegal NAT Traversal in IPFilter o kern/85780 net 'panic: bogus refcnt 0' in routing/ipv6 o bin/85445 net ifconfig(8): deprecated keyword to ifconfig inoperativ p kern/85320 net [gre] [patch] possible depletion of kernel stack in ip o bin/82975 net route change does not parse classfull network as given o kern/82881 net [netgraph] [panic] ng_fec(4) causes kernel panic after o bin/82185 net [patch] ndp(8) can delete the incorrect entry o kern/81095 net IPsec connection stops working if associated network i o kern/79895 net [ipf] 5.4-RC2 breaks ipfilter NAT when using netgraph o kern/78968 net FreeBSD freezes on mbufs exhaustion (network interface o kern/78090 net [ipf] ipf filtering on bridged packets doesn't work if o kern/77341 net [ip6] problems with IPV6 implementation o kern/77273 net [ipf] ipfilter breaks ipv6 statefull filtering on 5.3 s kern/77195 net [ipf] [patch] ipfilter ioctl SIOCGNATL does not match o kern/75873 net Usability problem with non-RFC-compliant IP spoof prot s kern/75407 net [an] an(4): no carrier after short time a kern/71474 net [route] route lookup does not skip interfaces marked d o kern/71469 net default route to internet magically disappears with mu o kern/70904 net [ipf] ipfilter ipnat problem with h323 proxy support o kern/66225 net [netgraph] [patch] extend ng_eiface(4) control message o kern/65616 net IPSEC can't detunnel GRE packets after real ESP encryp s kern/60293 net [patch] FreeBSD arp poison patch a kern/56233 net IPsec tunnel (ESP) over IPv6: MTU computation is wrong o kern/54383 net [nfs] [patch] NFS root configurations without dynamic s bin/41647 net ifconfig(8) doesn't accept lladdr along with inet addr s kern/39937 net ipstealth issue a kern/38554 net [patch] changing interface ipaddress doesn't seem to w o kern/34665 net [ipf] [hang] ipfilter rcmd proxy "hangs". o kern/31647 net [libc] socket calls can return undocumented EINVAL o kern/30186 net [libc] getaddrinfo(3) does not handle incorrect servna o kern/27474 net [ipf] [ppp] Interactive use of user PPP and ipfilter c o conf/23063 net [arp] [patch] for static ARP tables in rc.network 371 problems total. From owner-freebsd-net@FreeBSD.ORG Mon Apr 25 14:56:42 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 09D6D106564A for ; Mon, 25 Apr 2011 14:56:42 +0000 (UTC) (envelope-from aboyer@averesystems.com) Received: from zimbra.averesystems.com (75-149-8-245-Pennsylvania.hfc.comcastbusiness.net [75.149.8.245]) by mx1.freebsd.org (Postfix) with ESMTP id A794F8FC08 for ; Mon, 25 Apr 2011 14:56:41 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by zimbra.averesystems.com (Postfix) with ESMTP id F2442446005; Mon, 25 Apr 2011 10:57:13 -0400 (EDT) X-Virus-Scanned: amavisd-new at averesystems.com Received: from zimbra.averesystems.com ([127.0.0.1]) by localhost (zimbra.averesystems.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id SlhqoaFP-SWx; Mon, 25 Apr 2011 10:57:13 -0400 (EDT) Received: from riven.arriad.com (fw.arriad.com [10.0.0.16]) by zimbra.averesystems.com (Postfix) with ESMTPSA id E94FB446001; Mon, 25 Apr 2011 10:57:12 -0400 (EDT) Mime-Version: 1.0 (Apple Message framework v1084) Content-Type: text/plain; charset=us-ascii From: Andrew Boyer In-Reply-To: <4DB25A9E.5040008@freebsd.org> Date: Mon, 25 Apr 2011 10:56:40 -0400 Content-Transfer-Encoding: quoted-printable Message-Id: <40AA1C79-9DCA-49BD-A8E3-63495CC34C6B@averesystems.com> References: <4E85F36598CB480AA8B9706881573CB9@multiplay.co.uk><521514204B99427691043FF127B6E841@multiplay.co.uk> <036FCFE4-98BA-4B90-A060-4597B68A3596@averesystems.com> <4DB25A9E.5040008@freebsd.org> To: Julian Elischer X-Mailer: Apple Mail (2.1084) Cc: freebsd-net@freebsd.org, Jack Vogel Subject: Re: Intel ix (X520) disconnects when manipulating ips? X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 Apr 2011 14:56:42 -0000 On Apr 23, 2011, at 12:50 AM, Julian Elischer wrote: > On 4/22/11 5:08 PM, Andrew Boyer wrote: >> Hello Steve and Jack, >> You need to handle the SIOCSIFADDR ioctl or it gets passed up the = stack to ether_ioctl(). When it goes up the interface gets reset. See = the comments in em_ioctl() and igb_ioctl(). >>=20 >> We fixed this in ixgbe in our internal tree and it seems to work fine = with 82598 and 82599. You also need to include opt_inet.h for the INET = #define to be valid. >=20 > so, what else have you fixed? :-) >=20 >> -Andrew >>=20 Here's a list of suggested improvements that we could give back. I try = to only bother Jack if a problem results in a hang or other serious = issue. - Add tunables for LRO and HWRSC - Add code in ixgbe_attach() to detect 'disabled' hint (call = resource_disabled()) [also useful in e1000!] - Add code in ixgbe_attach() to handle IXGBE_ERR_SFP_NOT_PRESENT = returned by ixgbe_init_hw() (set sfp_probe to TRUE) - Add VLAN_HWTSO support when handling SIOCSIFCAP - Call ixgbe_disable_queue() at the beginning of ixgbe_msix_que() - Add code to ixgbe_local_timer() to first call ixgbe_txeof() on every = queue before checking the queue status - Rework ixgbe_config_link(); if sfp is TRUE, I think it should just = schedule mod_task and let it handle the msf case - Add locking and PHY type detection to ixgbe_handle_link() (to support = copper->optical and optical->copper transitions) - Add locking to ixgbe_handle_mod(), detect the PHY type, and only = schedule msf_task if multispeed_fiber is true - Add locking to ixgbe_handle_msf() I could provide patches for any item that people are interested in = testing / incorporating. Of course Jack still gets the final say on = what goes into ixgbe. -Andrew -------------------------------------------------- Andrew Boyer aboyer@averesystems.com From owner-freebsd-net@FreeBSD.ORG Mon Apr 25 18:47:40 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A68E01065674 for ; Mon, 25 Apr 2011 18:47:40 +0000 (UTC) (envelope-from fbsdmail@dnswatch.com) Received: from fast.dnswatch.com (fast.dnswatch.com [168.103.150.11]) by mx1.freebsd.org (Postfix) with ESMTP id 55D268FC15 for ; Mon, 25 Apr 2011 18:47:39 +0000 (UTC) Received: from www.dnswatch.com (localhost.dnswatch.com [127.0.0.1]) by fast.dnswatch.com (8.14.2/8.14.2) with ESMTP id p3PIlWLe045611 for ; Mon, 25 Apr 2011 11:47:39 -0700 (PDT) (envelope-from fbsdmail@dnswatch.com) Received: from udns0.ultimatedns.net ([168.103.150.26]) (DNSwatchWebMail authenticated user infos) by www.dnswatch.com with HTTP; Mon, 25 Apr 2011 11:47:39 -0700 (PDT) Message-ID: <2b2485288a6e492b3c5c94cc21c79949.dnswclient@www.dnswatch.com> Date: Mon, 25 Apr 2011 11:47:39 -0700 (PDT) From: fbsdmail@dnswatch.com To: freebsd-net@freebsd.org User-Agent: DNSwatchWebMail/1.5.2 [SVN] MIME-Version: 1.0 Content-Type: text/plain;charset=iso-8859-1 Content-Transfer-Encoding: 8bit Subject: two /24's and only one gateway - is routing still possible? X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 Apr 2011 18:47:40 -0000 Greetings, I've been trying to figure an ideal solution to this for some time, and thought I'd post the question here to see if anyone else is working with this situation. Here's my scenario; I have a /24 with a prefix of 168.103.150.xxx with a gateway on this prefix (DSLmodem). I also have a /24 with a prefix of 75.160.109.xxx My question(s) is/are: 1) is it possible to route both of these across the same GW? 2) if answer to 1) == NO, what might I do? Thank you for all your time and consideration. --Chris -- From owner-freebsd-net@FreeBSD.ORG Mon Apr 25 18:54:34 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D54021065674 for ; Mon, 25 Apr 2011 18:54:34 +0000 (UTC) (envelope-from cswiger@mac.com) Received: from asmtpout024.mac.com (asmtpout024.mac.com [17.148.16.99]) by mx1.freebsd.org (Postfix) with ESMTP id BB1EB8FC13 for ; Mon, 25 Apr 2011 18:54:34 +0000 (UTC) MIME-version: 1.0 Content-transfer-encoding: 7BIT Content-type: text/plain; CHARSET=US-ASCII Received: from cswiger1.apple.com ([17.209.4.71]) by asmtp024.mac.com (Oracle Communications Messaging Exchange Server 7u4-18.01 64bit (built Jul 15 2010)) with ESMTPSA id <0LK800LDI1UGRC20@asmtp024.mac.com> for freebsd-net@freebsd.org; Mon, 25 Apr 2011 11:54:17 -0700 (PDT) X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:5.2.15,1.0.148,0.0.0000 definitions=2011-04-25_05:2011-04-25, 2011-04-25, 1970-01-01 signatures=0 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 spamscore=0 ipscore=0 suspectscore=1 phishscore=0 bulkscore=0 adultscore=0 classifier=spam adjust=0 reason=mlx engine=6.0.2-1012030000 definitions=main-1104250108 From: Chuck Swiger In-reply-to: <2b2485288a6e492b3c5c94cc21c79949.dnswclient@www.dnswatch.com> Date: Mon, 25 Apr 2011 11:54:16 -0700 Message-id: References: <2b2485288a6e492b3c5c94cc21c79949.dnswclient@www.dnswatch.com> To: fbsdmail@dnswatch.com X-Mailer: Apple Mail (2.1084) Cc: freebsd-net@freebsd.org Subject: Re: two /24's and only one gateway - is routing still possible? X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 Apr 2011 18:54:34 -0000 On Apr 25, 2011, at 11:47 AM, fbsdmail@dnswatch.com wrote: > I have a /24 with a prefix of 168.103.150.xxx with a gateway on this prefix > (DSLmodem). > I also have a /24 with a prefix of 75.160.109.xxx > My question(s) is/are: > 1) is it possible to route both of these across the same GW? If these netblocks were both owned by you directly and you have an ASN, or if they're both owned by the same ISP who is willing to route them that way, sure. Talk to Quest... Regards, -- -Chuck From owner-freebsd-net@FreeBSD.ORG Mon Apr 25 19:11:18 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E6DB7106564A for ; Mon, 25 Apr 2011 19:11:18 +0000 (UTC) (envelope-from julian@freebsd.org) Received: from vps1.elischer.org (vps1.elischer.org [204.109.63.16]) by mx1.freebsd.org (Postfix) with ESMTP id B8D698FC28 for ; Mon, 25 Apr 2011 19:11:18 +0000 (UTC) Received: from julian-mac.elischer.org (home-nat.elischer.org [67.100.89.137]) (authenticated bits=0) by vps1.elischer.org (8.14.4/8.14.4) with ESMTP id p3PJB0Fe067918 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Mon, 25 Apr 2011 12:11:03 -0700 (PDT) (envelope-from julian@freebsd.org) Message-ID: <4DB5C77B.5000605@freebsd.org> Date: Mon, 25 Apr 2011 12:11:55 -0700 From: Julian Elischer User-Agent: Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10.4; en-US; rv:1.9.2.15) Gecko/20110303 Thunderbird/3.1.9 MIME-Version: 1.0 To: fbsdmail@dnswatch.com References: <2b2485288a6e492b3c5c94cc21c79949.dnswclient@www.dnswatch.com> In-Reply-To: <2b2485288a6e492b3c5c94cc21c79949.dnswclient@www.dnswatch.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-net@freebsd.org Subject: Re: two /24's and only one gateway - is routing still possible? X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 Apr 2011 19:11:19 -0000 On 4/25/11 11:47 AM, fbsdmail@dnswatch.com wrote: > Greetings, > I've been trying to figure an ideal solution to this for some time, > and thought I'd post the question here to see if anyone else is working > with this situation. > Here's my scenario; > I have a /24 with a prefix of 168.103.150.xxx with a gateway on this prefix > (DSLmodem). > I also have a /24 with a prefix of 75.160.109.xxx > My question(s) is/are: > 1) is it possible to route both of these across the same GW? > 2) if answer to 1) == NO, what might I do? you probably need to make a routing request to your ISP to ask them to advertise that 75.160.109.xxx is available via 168.103.150.x they may charge you $$ to do so or may not even want to do it. They may also require proof that you own them. this may be a problem as they are owed by cox communications and Quest. you'd thus have to get permission from each ISP to route teh other.. ***red-tape*** > Thank you for all your time and consideration. > > --Chris > From owner-freebsd-net@FreeBSD.ORG Mon Apr 25 20:09:04 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 79A3C106566C for ; Mon, 25 Apr 2011 20:09:04 +0000 (UTC) (envelope-from fbsdmail@dnswatch.com) Received: from fast.dnswatch.com (fast.dnswatch.com [168.103.150.11]) by mx1.freebsd.org (Postfix) with ESMTP id 3C9DB8FC21 for ; Mon, 25 Apr 2011 20:09:03 +0000 (UTC) Received: from www.dnswatch.com (localhost.dnswatch.com [127.0.0.1]) by fast.dnswatch.com (8.14.2/8.14.2) with ESMTP id p3PK8uKa045856; Mon, 25 Apr 2011 13:09:02 -0700 (PDT) (envelope-from fbsdmail@dnswatch.com) Received: from udns0.ultimatedns.net ([168.103.150.26]) (DNSwatchWebMail authenticated user infos) by www.dnswatch.com with HTTP; Mon, 25 Apr 2011 13:09:03 -0700 (PDT) Message-ID: <87e10af65ceb06031196097d7b8920f8.dnswclient@www.dnswatch.com> In-Reply-To: References: <2b2485288a6e492b3c5c94cc21c79949.dnswclient@www.dnswatch.com> Date: Mon, 25 Apr 2011 13:09:03 -0700 (PDT) From: fbsdmail@dnswatch.com To: freebsd-net@freebsd.org User-Agent: DNSwatchWebMail/1.5.2 [SVN] MIME-Version: 1.0 Content-Type: text/plain;charset=iso-8859-1 Content-Transfer-Encoding: 8bit Cc: Subject: Re: two /24's and only one gateway - is routing still possible? X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 Apr 2011 20:09:04 -0000 On Mon, April 25, 2011 11:54 am, Chuck Swiger wrote: > On Apr 25, 2011, at 11:47 AM, fbsdmail@dnswatch.com wrote: > >> I have a /24 with a prefix of 168.103.150.xxx with a gateway on this >> prefix (DSLmodem). >> I also have a /24 with a prefix of 75.160.109.xxx >> My question(s) is/are: >> 1) is it possible to route both of these across the same GW? >> > > If these netblocks were both owned by you directly and you have an ASN, > or if they're both owned by the same ISP who is willing to route them > that way, sure. Talk to Quest... I lease both, and have ASN's for both. My question is more; what might be a solution that /I/ might employ that would permit routing of both blocks across the single GW. I can envision creating a freebsd based gateway that is directly connected to the DSLmodem carrying an IP out of the 168 block, and one out of the 75 block that routes traffic for both /24's. But this consumes more IP's and creates an additional hop. Thanks for your reply. --Chris > > Regards, > -- > -Chuck > > > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" > > -- From owner-freebsd-net@FreeBSD.ORG Mon Apr 25 21:33:14 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 296241065676 for ; Mon, 25 Apr 2011 21:33:14 +0000 (UTC) (envelope-from mksmith@adhost.com) Received: from mail-defer02.adhost.com (mail-defer02.adhost.com [216.211.128.177]) by mx1.freebsd.org (Postfix) with ESMTP id F2DC58FC18 for ; Mon, 25 Apr 2011 21:33:13 +0000 (UTC) Received: from mail-in03.adhost.com (mail-in03.adhost.com [10.212.3.13]) by mail-defer02.adhost.com (Postfix) with ESMTP id E85DD4DF069 for ; Mon, 25 Apr 2011 14:16:57 -0700 (PDT) (envelope-from mksmith@adhost.com) Received: from AD-EXH02.adhost.lan (unknown [10.142.0.21]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by mail-in03.adhost.com (Postfix) with ESMTPS id 322DDE0481D; Mon, 25 Apr 2011 14:16:47 -0700 (PDT) (envelope-from mksmith@adhost.com) Received: from AD-EXH02.adhost.lan ([fe80::1c5b:7ead:8ba3:6108]) by AD-EXH02.adhost.lan ([fe80::1c5b:7ead:8ba3:6108%11]) with mapi id 14.01.0255.000; Mon, 25 Apr 2011 14:16:47 -0700 From: "Michael K. Smith - Adhost" To: "fbsdmail@dnswatch.com" , "freebsd-net@freebsd.org" Thread-Topic: two /24's and only one gateway - is routing still possible? Thread-Index: AQHMA3meV9Z7xNI95Uu1bMyEJLF0EZRvYr8AgAAU5YD//5sgQA== Date: Mon, 25 Apr 2011 21:16:46 +0000 Message-ID: References: <2b2485288a6e492b3c5c94cc21c79949.dnswclient@www.dnswatch.com> <87e10af65ceb06031196097d7b8920f8.dnswclient@www.dnswatch.com> In-Reply-To: <87e10af65ceb06031196097d7b8920f8.dnswclient@www.dnswatch.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.142.1.52] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: Subject: RE: two /24's and only one gateway - is routing still possible? X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 Apr 2011 21:33:14 -0000 > -----Original Message----- > From: owner-freebsd-net@freebsd.org [mailto:owner-freebsd- > net@freebsd.org] On Behalf Of fbsdmail@dnswatch.com > Sent: Monday, April 25, 2011 1:09 PM > To: freebsd-net@freebsd.org > Subject: Re: two /24's and only one gateway - is routing still possible? >=20 >=20 > On Mon, April 25, 2011 11:54 am, Chuck Swiger wrote: > > On Apr 25, 2011, at 11:47 AM, fbsdmail@dnswatch.com wrote: > > > >> I have a /24 with a prefix of 168.103.150.xxx with a gateway on this > >> prefix (DSLmodem). > >> I also have a /24 with a prefix of 75.160.109.xxx > >> My question(s) is/are: > >> 1) is it possible to route both of these across the same GW? > >> > > > > If these netblocks were both owned by you directly and you have an ASN, > > or if they're both owned by the same ISP who is willing to route them > > that way, sure. Talk to Quest... >=20 > I lease both, and have ASN's for both. > My question is more; what might be a solution that /I/ might employ > that would permit routing of both blocks across the single GW. > I can envision creating a freebsd based gateway that is directly > connected to the DSLmodem carrying an IP out of the 168 block, and one > out of the 75 block that routes traffic for both /24's. > But this consumes more IP's and creates an additional hop. You can't get there from here. Routing multiple blocks out of any interfa= ce is just a matter of routing. If you're getting into routing discrete bl= ocks, particularly with discrete autonomous system numbers, you will have t= o use BGP. In that case you can look at Quagga or Bird or similar. If you= 're just interested in the routing function, you can use route-to in PF to = set up whatever you wish. The outbound route is not a problem - it's how traffic is going to get back= to you. If you don't have some sort of dynamic routing protocol in play, = then the routes will come back the way your upstream directs them. Mike From owner-freebsd-net@FreeBSD.ORG Mon Apr 25 22:23:43 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A3BAE106564A for ; Mon, 25 Apr 2011 22:23:43 +0000 (UTC) (envelope-from fbsdmail@dnswatch.com) Received: from fast.dnswatch.com (fast.dnswatch.com [168.103.150.11]) by mx1.freebsd.org (Postfix) with ESMTP id 4A2A38FC1B for ; Mon, 25 Apr 2011 22:23:43 +0000 (UTC) Received: from www.dnswatch.com (localhost.dnswatch.com [127.0.0.1]) by fast.dnswatch.com (8.14.2/8.14.2) with ESMTP id p3PMNZbO046231; Mon, 25 Apr 2011 15:23:41 -0700 (PDT) (envelope-from fbsdmail@dnswatch.com) Received: from udns0.ultimatedns.net ([168.103.150.26]) (DNSwatchWebMail authenticated user infos) by www.dnswatch.com with HTTP; Mon, 25 Apr 2011 15:23:42 -0700 (PDT) Message-ID: In-Reply-To: <4DB5C77B.5000605@freebsd.org> References: <2b2485288a6e492b3c5c94cc21c79949.dnswclient@www.dnswatch.com> <4DB5C77B.5000605@freebsd.org> Date: Mon, 25 Apr 2011 15:23:42 -0700 (PDT) From: fbsdmail@dnswatch.com To: freebsd-net@freebsd.org User-Agent: DNSwatchWebMail/1.5.2 [SVN] MIME-Version: 1.0 Content-Type: text/plain;charset=iso-8859-1 Content-Transfer-Encoding: 8bit Cc: Subject: Re: two /24's and only one gateway - is routing still possible? X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 Apr 2011 22:23:43 -0000 On Mon, April 25, 2011 12:11 pm, Julian Elischer wrote: > On 4/25/11 11:47 AM, fbsdmail@dnswatch.com wrote: > >> Greetings, >> I've been trying to figure an ideal solution to this for some time, >> and thought I'd post the question here to see if anyone else is working >> with this situation. Here's my scenario; >> I have a /24 with a prefix of 168.103.150.xxx with a gateway on this >> prefix (DSLmodem). >> I also have a /24 with a prefix of 75.160.109.xxx >> My question(s) is/are: >> 1) is it possible to route both of these across the same GW? >> 2) if answer to 1) == NO, what might I do? >> > > you probably need to make a routing request to your ISP to ask them to > advertise that 75.160.109.xxx is available via 168.103.150.x > they may charge you $$ to do so or may not even want to do it. They may > also require proof that you own them. this may be a problem as they are > owed by cox communications and Quest. you'd thus have to get permission > from each ISP to route teh other.. Hello, and thank you for your reply. They're actually owned by US West Communications (now Qwest), and CenturyTEL (now CenturyLink), which recently bought all QWest DSL related business. I lease both blocks, and have ASN's for both. My intention/goal is to route both blocks over the same GW (the 168) The only solution I could come up with was to create a FreeBSD box to serve as a Gateway, having it connected directly to the DSLmodem (external), and simply have it assigned both an IP out of the 168 block, as well as one from the 75 block. Problem is, I'll burn 2 additional addresses, and create an extra hop to & from the network(s). :( Thanks again, Julian Elischer for your reply. --Chris > > ***red-tape*** > > >> Thank you for all your time and consideration. >> >> >> --Chris >> >> > > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" > > -- From owner-freebsd-net@FreeBSD.ORG Tue Apr 26 16:35:10 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C3966106564A for ; Tue, 26 Apr 2011 16:35:10 +0000 (UTC) (envelope-from mksmith@adhost.com) Received: from mail-in04.adhost.com (mail-in04.adhost.com [216.211.128.134]) by mx1.freebsd.org (Postfix) with ESMTP id 9D3A08FC1C for ; Tue, 26 Apr 2011 16:35:10 +0000 (UTC) Received: from AD-EXH02.adhost.lan (unknown [10.142.0.21]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by mail-in04.adhost.com (Postfix) with ESMTPS id 38435614F7B; Tue, 26 Apr 2011 09:35:04 -0700 (PDT) (envelope-from mksmith@adhost.com) Received: from AD-EXH02.adhost.lan ([fe80::1c5b:7ead:8ba3:6108]) by AD-EXH02.adhost.lan ([fe80::1c5b:7ead:8ba3:6108%11]) with mapi id 14.01.0255.000; Tue, 26 Apr 2011 09:35:04 -0700 From: "Michael K. Smith - Adhost" To: "fbsdmail@dnswatch.com" , "freebsd-net@freebsd.org" Thread-Topic: two /24's and only one gateway - is routing still possible? Thread-Index: AQHMA3meV9Z7xNI95Uu1bMyEJLF0EZRvZ62AgAA1lgCAALtbsA== Date: Tue, 26 Apr 2011 16:35:02 +0000 Message-ID: References: <2b2485288a6e492b3c5c94cc21c79949.dnswclient@www.dnswatch.com> <4DB5C77B.5000605@freebsd.org> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.142.1.52] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: Subject: RE: two /24's and only one gateway - is routing still possible? X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Apr 2011 16:35:10 -0000 > -----Original Message----- > From: owner-freebsd-net@freebsd.org [mailto:owner-freebsd- > net@freebsd.org] On Behalf Of fbsdmail@dnswatch.com > Sent: Monday, April 25, 2011 3:24 PM > To: freebsd-net@freebsd.org > Subject: Re: two /24's and only one gateway - is routing still possible? >=20 >=20 > On Mon, April 25, 2011 12:11 pm, Julian Elischer wrote: > > On 4/25/11 11:47 AM, fbsdmail@dnswatch.com wrote: > > > >> Greetings, > >> I've been trying to figure an ideal solution to this for some time, > >> and thought I'd post the question here to see if anyone else is workin= g > >> with this situation. Here's my scenario; > >> I have a /24 with a prefix of 168.103.150.xxx with a gateway on this > >> prefix (DSLmodem). > >> I also have a /24 with a prefix of 75.160.109.xxx > >> My question(s) is/are: > >> 1) is it possible to route both of these across the same GW? > >> 2) if answer to 1) =3D=3D NO, what might I do? > >> > > > > you probably need to make a routing request to your ISP to ask them to > > advertise that 75.160.109.xxx is available via 168.103.150.x > > they may charge you $$ to do so or may not even want to do it. They may > > also require proof that you own them. this may be a problem as they are > > owed by cox communications and Quest. you'd thus have to get permission > > from each ISP to route teh other.. >=20 > Hello, and thank you for your reply. > They're actually owned by US West Communications (now Qwest), and > CenturyTEL (now CenturyLink), which recently bought all QWest DSL > related business. > I lease both blocks, and have ASN's for both. > My intention/goal is to route both blocks over the same GW (the 168) > The only solution I could come up with was to create a FreeBSD box to > serve as a Gateway, having it connected directly to the DSLmodem > (external), > and simply have it assigned both an IP out of the 168 block, as well > as one from the 75 block. Problem is, I'll burn 2 additional addresses, > and create an extra hop to & from the network(s). :( >=20 Why don't you get them to assign you a /30 on your DSL link and route the t= wo /24's to you?=20 Mike From owner-freebsd-net@FreeBSD.ORG Wed Apr 27 15:58:43 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2D300106564A for ; Wed, 27 Apr 2011 15:58:43 +0000 (UTC) (envelope-from ticso@cicely7.cicely.de) Received: from raven.bwct.de (raven.bwct.de [85.159.14.73]) by mx1.freebsd.org (Postfix) with ESMTP id 964F98FC13 for ; Wed, 27 Apr 2011 15:58:42 +0000 (UTC) Received: from mail.cicely.de ([10.1.1.37]) by raven.bwct.de (8.13.4/8.13.4) with ESMTP id p3RFwfHo020281 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK) for ; Wed, 27 Apr 2011 17:58:41 +0200 (CEST) (envelope-from ticso@cicely7.cicely.de) Received: from cicely7.cicely.de (cicely7.cicely.de [10.1.1.9]) by mail.cicely.de (8.14.4/8.14.4) with ESMTP id p3RFwcbZ001783 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Wed, 27 Apr 2011 17:58:38 +0200 (CEST) (envelope-from ticso@cicely7.cicely.de) Received: from cicely7.cicely.de (localhost [127.0.0.1]) by cicely7.cicely.de (8.14.2/8.14.2) with ESMTP id p3RFwcd6009311; Wed, 27 Apr 2011 17:58:38 +0200 (CEST) (envelope-from ticso@cicely7.cicely.de) Received: (from ticso@localhost) by cicely7.cicely.de (8.14.2/8.14.2/Submit) id p3RFwcAi009310; Wed, 27 Apr 2011 17:58:38 +0200 (CEST) (envelope-from ticso) Date: Wed, 27 Apr 2011 17:58:38 +0200 From: Bernd Walter To: freebsd-net@freebsd.org Message-ID: <20110427155838.GI3101@cicely7.cicely.de> References: <20110427153235.GH3101@cicely7.cicely.de> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20110427153235.GH3101@cicely7.cicely.de> X-Operating-System: FreeBSD cicely7.cicely.de 7.0-STABLE i386 User-Agent: Mutt/1.5.11 X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED=-1, BAYES_00=-1.9, T_RP_MATCHES_RCVD=-0.01 autolearn=ham version=3.3.0 X-Spam-Checker-Version: SpamAssassin 3.3.0 (2010-01-18) on spamd.cicely.de Cc: Bernd Walter Subject: Re: Multicast questions X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: ticso@cicely.de List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Apr 2011 15:58:43 -0000 On Wed, Apr 27, 2011 at 05:32:36PM +0200, Bernd Walter wrote: > I have some strange problems with multicast. > Tested host is running FreeBSD 8.1-RELEASE. > System is a jailed environment. > > Outside of the jail I can start a multicast reader: > [54]host# mcastread -v6 lo0 ff35::fe00:1 5356 > mcastread: trying ff35::fe00:1 > mcastread: using ff35::fe00:1 > > Inside the jail however it fails on binding to the address: > [85]jail# mcastread -v6 lo0 ff35::fe00:1 5356 > mcastread: trying ff35::fe00:1 > mcastread: bind: Can't assign requested address > mcastread: can't allocate socket Ok - adding the multicast-IP to the jail list helps. This leaves the interface problem. > Is there any workaround for this problem? > I've read about vimage, but I would like to live without it. > > Sending to the multicast group works more or less: > [94]jail# echo test | mcastsend ff35::fe00:1 5356 > mcastsend: send: No route to host > Exit 1 > [95]jail# echo test | mcastsend -i lo0 ff35::fe00:1 5356 > The last one is received with the reader running on the host. > But why do I get a no route to host error without using an > interface for a site local address? > > With the only anycast address configured to lo0 using another interface > fails inside the jail: > [99]jail# echo test | mcastsend -i em0 ff35::fe00:1 5356 > mcastsend: Failed to bind source address. > Exit 1 > Do I really need to configure the address to the LAN interface? > > -- > B.Walter http://www.bwct.de > Modbus/TCP Ethernet I/O Baugruppen, ARM basierte FreeBSD Rechner uvm. -- B.Walter http://www.bwct.de Modbus/TCP Ethernet I/O Baugruppen, ARM basierte FreeBSD Rechner uvm. From owner-freebsd-net@FreeBSD.ORG Wed Apr 27 16:07:41 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1EBC2106566C for ; Wed, 27 Apr 2011 16:07:41 +0000 (UTC) (envelope-from ticso@cicely7.cicely.de) Received: from raven.bwct.de (raven.bwct.de [85.159.14.73]) by mx1.freebsd.org (Postfix) with ESMTP id 89DC58FC14 for ; Wed, 27 Apr 2011 16:07:40 +0000 (UTC) Received: from mail.cicely.de ([10.1.1.37]) by raven.bwct.de (8.13.4/8.13.4) with ESMTP id p3RFWm9f019909 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK) for ; Wed, 27 Apr 2011 17:32:48 +0200 (CEST) (envelope-from ticso@cicely7.cicely.de) Received: from cicely7.cicely.de (cicely7.cicely.de [10.1.1.9]) by mail.cicely.de (8.14.4/8.14.4) with ESMTP id p3RFWaBp091149 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Wed, 27 Apr 2011 17:32:36 +0200 (CEST) (envelope-from ticso@cicely7.cicely.de) Received: from cicely7.cicely.de (localhost [127.0.0.1]) by cicely7.cicely.de (8.14.2/8.14.2) with ESMTP id p3RFWaZa009187; Wed, 27 Apr 2011 17:32:36 +0200 (CEST) (envelope-from ticso@cicely7.cicely.de) Received: (from ticso@localhost) by cicely7.cicely.de (8.14.2/8.14.2/Submit) id p3RFWaxF009186; Wed, 27 Apr 2011 17:32:36 +0200 (CEST) (envelope-from ticso) Date: Wed, 27 Apr 2011 17:32:36 +0200 From: Bernd Walter To: freebsd-net@freebsd.org Message-ID: <20110427153235.GH3101@cicely7.cicely.de> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Operating-System: FreeBSD cicely7.cicely.de 7.0-STABLE i386 User-Agent: Mutt/1.5.11 X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED=-1, BAYES_00=-1.9, T_RP_MATCHES_RCVD=-0.01 autolearn=unavailable version=3.3.0 X-Spam-Checker-Version: SpamAssassin 3.3.0 (2010-01-18) on spamd.cicely.de Cc: Bernd Walter Subject: Multicast questions X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: ticso@cicely.de List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Apr 2011 16:07:41 -0000 I have some strange problems with multicast. Tested host is running FreeBSD 8.1-RELEASE. System is a jailed environment. Outside of the jail I can start a multicast reader: [54]host# mcastread -v6 lo0 ff35::fe00:1 5356 mcastread: trying ff35::fe00:1 mcastread: using ff35::fe00:1 Inside the jail however it fails on binding to the address: [85]jail# mcastread -v6 lo0 ff35::fe00:1 5356 mcastread: trying ff35::fe00:1 mcastread: bind: Can't assign requested address mcastread: can't allocate socket Is there any workaround for this problem? I've read about vimage, but I would like to live without it. Sending to the multicast group works more or less: [94]jail# echo test | mcastsend ff35::fe00:1 5356 mcastsend: send: No route to host Exit 1 [95]jail# echo test | mcastsend -i lo0 ff35::fe00:1 5356 The last one is received with the reader running on the host. But why do I get a no route to host error without using an interface for a site local address? With the only anycast address configured to lo0 using another interface fails inside the jail: [99]jail# echo test | mcastsend -i em0 ff35::fe00:1 5356 mcastsend: Failed to bind source address. Exit 1 Do I really need to configure the address to the LAN interface? -- B.Walter http://www.bwct.de Modbus/TCP Ethernet I/O Baugruppen, ARM basierte FreeBSD Rechner uvm. From owner-freebsd-net@FreeBSD.ORG Wed Apr 27 18:55:15 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7DBD11065673 for ; Wed, 27 Apr 2011 18:55:15 +0000 (UTC) (envelope-from scrappy@hub.org) Received: from hub.org (hub.org [200.46.204.220]) by mx1.freebsd.org (Postfix) with ESMTP id 308CA8FC15 for ; Wed, 27 Apr 2011 18:55:13 +0000 (UTC) Received: from maia.hub.org (maia-3.hub.org [200.46.204.243]) by hub.org (Postfix) with ESMTP id 6EB6832526A6 for ; Wed, 27 Apr 2011 15:55:11 -0300 (ADT) Received: from hub.org ([200.46.204.220]) by maia.hub.org (mx1.hub.org [200.46.204.243]) (amavisd-maia, port 10024) with ESMTP id 61161-06 for ; Wed, 27 Apr 2011 18:55:11 +0000 (UTC) Received: by hub.org (Postfix, from userid 1002) id 3F200325269C; Wed, 27 Apr 2011 15:55:11 -0300 (ADT) Received: from localhost (localhost [127.0.0.1]) by hub.org (Postfix) with ESMTP id 221013252695 for ; Wed, 27 Apr 2011 15:55:11 -0300 (ADT) Date: Wed, 27 Apr 2011 15:55:11 -0300 (ADT) From: "Marc G. Fournier" To: freebsd-net@freebsd.org Message-ID: User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; format=flowed; charset=US-ASCII Subject: SNMP Network Auto Discovery software ... ? X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Apr 2011 18:55:15 -0000 Would like to find something that runs on FreeBSD that I can use to map our network, preferrably dumping to a database, and grabbing information like: interface / ip / cpus / hostname, etc ... Server needs to run on FreeBSD ... needs to be able to commuicate, via SNMP, with Windows, Cisco, Linux, FreeBSD, NetApp Filers, etc ... Would like it to be able to generate an overall map of our network, but, also, be able to use it as a basis for keeping stuff liek nagios / cacti up to date ... Web based interface into the database would be nice ... Is there anything like this available that runs on FreeBSD that ppl are happily using? Thx ... ---- Marc G. Fournier Hub.Org Hosting Solutions S.A. scrappy@hub.org http://www.hub.org Yahoo:yscrappy Skype: hub.org ICQ:7615664 MSN:scrappy@hub.org From owner-freebsd-net@FreeBSD.ORG Wed Apr 27 22:05:02 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0565A1065672 for ; Wed, 27 Apr 2011 22:05:01 +0000 (UTC) (envelope-from kurt.buff@gmail.com) Received: from mail-vw0-f54.google.com (mail-vw0-f54.google.com [209.85.212.54]) by mx1.freebsd.org (Postfix) with ESMTP id A40988FC17 for ; Wed, 27 Apr 2011 22:05:01 +0000 (UTC) Received: by vws18 with SMTP id 18so2164689vws.13 for ; Wed, 27 Apr 2011 15:05:00 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type:content-transfer-encoding; bh=f1I/cQxi5ox1l/MoM5w56vkWPzYrFsKPprfTCRSh1A0=; b=YT1OILs/3GWEaAZVV9ZTod6VSb/1+BOBjNsKwVMAnDY8wQeFQeTbdMpQcOZQfx0L+V lf5BOc/cEwju/PvPrV55s4yXvnsBCFDe4+G5cjA+9MXZHYV7DwX1xDa1IFWPdFk8WGia 08Eeubu5upKUdCdU3a6uK4iO8YNWliiDYoolY= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=Jy/8Q8blJgRqjE3jyp1T695iNcCn+fr4TcgpBORYBLB+2BbNIiU8L12NgxrOlpQ4/F NvnBaTIkfc1QBkC4oJkj/aDXrMmivw6vAFGtZVfNuLlH2v04eCwPTXTo5oD0uzo8on5+ JEZELBBLshag+20OSfKqPSMn3Ay7fQUW91Fb8= MIME-Version: 1.0 Received: by 10.52.99.193 with SMTP id es1mr4014034vdb.85.1303940235720; Wed, 27 Apr 2011 14:37:15 -0700 (PDT) Received: by 10.52.101.234 with HTTP; Wed, 27 Apr 2011 14:37:15 -0700 (PDT) In-Reply-To: References: Date: Wed, 27 Apr 2011 14:37:15 -0700 Message-ID: From: Kurt Buff To: freebsd-net@freebsd.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Subject: Re: SNMP Network Auto Discovery software ... ? X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Apr 2011 22:05:02 -0000 The closest thing I know of is netdisco, which is in ports. I'm sure it would be a fair amount of work to do all you want, as it's mainly for discovering, mapping and maintaining network equipment such as switches and routers, but it's pretty darn cool for that. Kurt On Wed, Apr 27, 2011 at 11:55, Marc G. Fournier wrote: > > Would like to find something that runs on FreeBSD that I can use to map o= ur > network, preferrably dumping to a database, and grabbing information like= : > interface / ip / cpus / hostname, etc ... > > Server needs to run on FreeBSD ... needs to be able to commuicate, via SN= MP, > with Windows, Cisco, Linux, FreeBSD, NetApp Filers, etc ... > > Would like it to be able to generate an overall map of our network, but, > also, be able to use it as a basis for keeping stuff liek nagios / cacti = up > to date ... > > Web based interface into the database would be nice ... > > Is there anything like this available that runs on FreeBSD that ppl are > happily using? > > Thx ... > > ---- > Marc G. Fournier =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0Hub.Org Hosting Solutions S.A. > scrappy@hub.org =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 http:= //www.hub.org > > Yahoo:yscrappy =C2=A0 =C2=A0Skype: hub.org =C2=A0 =C2=A0ICQ:7615664 =C2= =A0 =C2=A0MSN:scrappy@hub.org > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" > From owner-freebsd-net@FreeBSD.ORG Thu Apr 28 07:30:28 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2A8C6106564A for ; Thu, 28 Apr 2011 07:30:28 +0000 (UTC) (envelope-from kungfujesus06@gmail.com) Received: from mail-iy0-f182.google.com (mail-iy0-f182.google.com [209.85.210.182]) by mx1.freebsd.org (Postfix) with ESMTP id E302D8FC1B for ; Thu, 28 Apr 2011 07:30:27 +0000 (UTC) Received: by iyj12 with SMTP id 12so2814858iyj.13 for ; Thu, 28 Apr 2011 00:30:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:date:from:to:subject:message-id:mime-version :content-type:content-disposition:user-agent; bh=G1Kee/6QvVql18mhNLTWMjL07yCZEAynsdsWPUyil8U=; b=PS1W8ocxJEgMlQhe+J0+xKPc3EX48CA7aQ9DBknJGwNccjyyy7SQjor6MF/nD0BIVC nwyF+HRsCEnS3DnHIeVyD0zqu9w5qa14cDwl0fsHmFrUgJ2KQH9NRBkPULydb/dr9OSd Q0xqsTBbPVX9cB+ADlC+oNz9KT4ntAeBS3e/k= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=date:from:to:subject:message-id:mime-version:content-type :content-disposition:user-agent; b=pV80Mh8r5ofs5seWp3ZTpxV987WdslCD+o9SZo/XSgw7r7017fLliuXQiBbFVxcOqN exeAzPs5Lr8Sfld5MXTACXEtzqWaNC4ssqrh9nTDOFYlfdfhPD4FbZimnN16Wo+/iHDW 1LrczUP9n8VS9FboX6vdPA8lSvGV8mSdoVcFo= Received: by 10.42.157.199 with SMTP id e7mr4057430icx.278.1303975827170; Thu, 28 Apr 2011 00:30:27 -0700 (PDT) Received: from zephyr.adamsnet ([72.49.234.31]) by mx.google.com with ESMTPS id y10sm622249iba.12.2011.04.28.00.30.25 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 28 Apr 2011 00:30:26 -0700 (PDT) Date: Thu, 28 Apr 2011 03:29:46 -0400 From: Adam Stylinski To: freebsd-net@freebsd.org Message-ID: <20110428072946.GA11391@zephyr.adamsnet> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="qDbXVdCdHGoSgWSk" Content-Disposition: inline User-Agent: Mutt/1.5.21 (2010-09-15) Subject: em0 performance subpar X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2011 07:30:28 -0000 --qDbXVdCdHGoSgWSk Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hello, I have an intel gigabit network adapter (the 1000 GT w/chipset 82541PI) whi= ch performs poorly in Freebsd compared to the same card in Linux. I've tri= ed this card in two different freebsd boxes and for whatever reason I get p= oor transmit performance. I've done all of the tweaking specified in just = about every guide out there (the usual TCP window scaling, larger nmbcluste= rs, delayed acks, etc) and still I get only around 600mbps. I'm using jumb= o frames, with an MTU of 9000. I'm testing this with iperf. While I reali= ze that this may not be the most realistic test, linux hosts with the same = card can achieve 995Mbit/s to another host running this. When the Freebsd = box is the server, Linux hosts can transmit to it at around 800 something M= bit/s. I've increased the transmit descriptors as specified in the if_em m= an page, and while that gave me 20 or 30 more mbit/s, my transmit performan= ce is still below normal. =20 sysctl stats report that the card is trigger a lot of tx_desc_fail2: dev.em.0.tx_desc_fail2: 3431 Looking at a comment in the source code this indicates that the card was no= t able to obtain enough transmit descriptors (but I've given the card the m= aximum of 4096 in my loader.conf tunable). Is this a bug or a performance = regression of some kind? Does anybody have a fix for this? I tried anothe= r card with the same chip in a different box on 8-STABLE to no avail (the b= ox I'm trying to improve performance on is on 8.2-RELEASE-p1). Anybody manage to make this card push above 600mbps in ideal network benchm= arks? Any help would be gladly appreciated. --=20 Adam Stylinski PGP Key: http://pohl.ececs.uc.edu/~adam/publickey.pub Blog: http://technicallyliving.blogspot.com --qDbXVdCdHGoSgWSk Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (FreeBSD) iQIcBAEBAgAGBQJNuRdpAAoJED6sRHE6TvmnhSwP/RncWw07PGrukndXs+/VVDLa SBPC8V1GUUW3zoisNEKORYQQ4qYM97Ql94zNB11tFR9MxjcmqJjZv2GqmVSiMGHR 5px/UOuoQjiGYxcFfqVyaN6EhaZaSGLmiYlVfNdSAFYwZ1jNcl1AsmD+zKgl6BRw UfmVui8UlmmakggQJ2qir2yr+6cmi6VV6MCaJNelHnVJ7ggHB85Qha1UdaoFqb2e UzDsAMnU6RDeEhQxvRvlv+ch0cAciTnVm/ipmR+5PQEJ4Wht4rhjTEodK/IZ8O/Z fEYapcS11HTZal6T4FMjImB3bf0YpT2tV//H5SycGDsGUNgNysbOBnuP/rway7x0 Qhp5XR1gKW7YNCzREe9dK7QtmUIcjHIFw9/qSWt4tRaEerpDR8sH9JUq71Hvc2QC pws9SHFBzYjV4zKZg597TJuuSY0gWPKpRZmPmY3mZ0aR0LnbVQgO29ay0lgCuyxF owhdUUb5JKmn9H7vcOacTQYYP//GyWMMYnVMmDCecz5jOWAQuN5xx4htQKhDu1I5 bV3qG1+j2F6iIEP+7DKWogIEF3QcbF3vecboeehc5MouoIpEyLm6jyA3GQnW/gE4 RNuqKVuoMFgqK06QdBNNgysNkfj3oY4WrkDPoNAJFvE2PYeIZxFzr7Cve5Cm+Bgt 8lL3b3dFM7OkIzx5CUAh =hke5 -----END PGP SIGNATURE----- --qDbXVdCdHGoSgWSk-- From owner-freebsd-net@FreeBSD.ORG Thu Apr 28 08:25:20 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C6F9D106566B for ; Thu, 28 Apr 2011 08:25:20 +0000 (UTC) (envelope-from amvandemore@gmail.com) Received: from mail-fx0-f54.google.com (mail-fx0-f54.google.com [209.85.161.54]) by mx1.freebsd.org (Postfix) with ESMTP id 5A1998FC0A for ; Thu, 28 Apr 2011 08:25:19 +0000 (UTC) Received: by fxm11 with SMTP id 11so2374458fxm.13 for ; Thu, 28 Apr 2011 01:25:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=UbHSBhGgA8CkM/VdqMGw04Sab3aRRxQt4CCqudkguh0=; b=Nx1iQPLPUyV3Y1ZNIaPNNYrleKD0jyC78OgnIDWHgakU+k3KhWY0An5kHzE4fi+hfP gH1U3/ikS42AurGyCLUWt5MuRxKL1EmlnVHApK4ncaLLB24923T4bRhWsmldshu5ThuO JuYzyGWJCMerD6rkgp5FueLhivWY3Q4z13vWc= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=TsmPXL9ylVs0JyNcEAuHzGHnoutd+VWbYY8qve9/SlBeXq9AuSHlL3CmHlmY/c1COE xeD9T/iJemNZO5+u76G1GFYzr9QiEGuyKQxuenDsOJ9L3r1styjbVGJOy9KH6MTYkZIh /Ps/HmuOpACGQ9BDDeGEHQoApjL3RgF1orD2E= MIME-Version: 1.0 Received: by 10.223.97.142 with SMTP id l14mr152808fan.111.1303977591183; Thu, 28 Apr 2011 00:59:51 -0700 (PDT) Received: by 10.223.20.145 with HTTP; Thu, 28 Apr 2011 00:59:51 -0700 (PDT) In-Reply-To: <20110428072946.GA11391@zephyr.adamsnet> References: <20110428072946.GA11391@zephyr.adamsnet> Date: Thu, 28 Apr 2011 02:59:51 -0500 Message-ID: From: Adam Vande More To: Adam Stylinski Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-net@freebsd.org Subject: Re: em0 performance subpar X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2011 08:25:21 -0000 On Thu, Apr 28, 2011 at 2:29 AM, Adam Stylinski wrote: > Hello, > > I have an intel gigabit network adapter (the 1000 GT w/chipset 82541PI) > which performs poorly in Freebsd compared to the same card in Linux. I've > tried this card in two different freebsd boxes and for whatever reason I get > poor transmit performance. I've done all of the tweaking specified in just > about every guide out there (the usual TCP window scaling, larger > nmbclusters, delayed acks, etc) and still I get only around 600mbps. I'm > using jumbo frames, with an MTU of 9000. I'm testing this with iperf. > While I realize that this may not be the most realistic test, linux hosts > with the same card can achieve 995Mbit/s to another host running this. When > the Freebsd box is the server, Linux hosts can transmit to it at around 800 > something Mbit/s. I've increased the transmit descriptors as specified in > the if_em man page, and while that gave me 20 or 30 more mbit/s, my transmit > performance is still below normal. > > sysctl stats report that the card is trigger a lot of tx_desc_fail2: > dev.em.0.tx_desc_fail2: 3431 > > Maybe try EM_MULTIQUEUE? http://lists.freebsd.org/pipermail/freebsd-net/2011-April/028664.html -- Adam Vande More From owner-freebsd-net@FreeBSD.ORG Thu Apr 28 10:52:08 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7B4F51065670 for ; Thu, 28 Apr 2011 10:52:08 +0000 (UTC) (envelope-from egrosbein@rdtc.ru) Received: from eg.sd.rdtc.ru (unknown [IPv6:2a03:3100:c:13::5]) by mx1.freebsd.org (Postfix) with ESMTP id C5DE38FC14 for ; Thu, 28 Apr 2011 10:52:07 +0000 (UTC) Received: from eg.sd.rdtc.ru (localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.14.4/8.14.4) with ESMTP id p3SAq31V098686; Thu, 28 Apr 2011 17:52:03 +0700 (NOVST) (envelope-from egrosbein@rdtc.ru) Message-ID: <4DB946CE.4030901@rdtc.ru> Date: Thu, 28 Apr 2011 17:51:58 +0700 From: Eugene Grosbein User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; ru-RU; rv:1.9.2.13) Gecko/20110112 Thunderbird/3.1.7 MIME-Version: 1.0 To: Adam Stylinski References: <20110428072946.GA11391@zephyr.adamsnet> In-Reply-To: <20110428072946.GA11391@zephyr.adamsnet> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Cc: freebsd-net@freebsd.org Subject: Re: em0 performance subpar X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2011 10:52:08 -0000 On 28.04.2011 14:29, Adam Stylinski wrote: > Hello, > > I have an intel gigabit network adapter (the 1000 GT w/chipset 82541PI) which performs poorly in Freebsd compared to the same card in Linux. I've tried this card in two different freebsd boxes and for whatever reason I get poor transmit performance. I've done all of the tweaking specified in just about every guide out there (the usual TCP window scaling, larger nmbclusters, delayed acks, etc) and still I get only around 600mbps. I'm using jumbo frames, with an MTU of 9000. I'm testing this with iperf. While I realize that this may not be the most realistic test, linux hosts with the same card can achieve 995Mbit/s to another host running this. When the Freebsd box is the server, Linux hosts can transmit to it at around 800 something Mbit/s. I've increased the transmit descriptors as specified in the if_em man page, and while that gave me 20 or 30 more mbit/s, my transmit performance is still below normal. > > sysctl stats report that the card is trigger a lot of tx_desc_fail2: > dev.em.0.tx_desc_fail2: 3431 > > Looking at a comment in the source code this indicates that the card was not able to obtain enough transmit descriptors (but I've given the card the maximum of 4096 in my loader.conf tunable). Is this a bug or a performance regression of some kind? Does anybody have a fix for this? I tried another card with the same chip in a different box on 8-STABLE to no avail (the box I'm trying to improve performance on is on 8.2-RELEASE-p1). > > Anybody manage to make this card push above 600mbps in ideal network benchmarks? Any help would be gladly appreciated. Please show output of "vmstat -z|egrep 'ITEM|mbuf'" command after the test. Eugene Grosbein From owner-freebsd-net@FreeBSD.ORG Thu Apr 28 12:40:00 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 345D61065675 for ; Thu, 28 Apr 2011 12:40:00 +0000 (UTC) (envelope-from kungfujesus06@gmail.com) Received: from mail-fx0-f54.google.com (mail-fx0-f54.google.com [209.85.161.54]) by mx1.freebsd.org (Postfix) with ESMTP id AE6208FC18 for ; Thu, 28 Apr 2011 12:39:59 +0000 (UTC) Received: by fxm11 with SMTP id 11so2544999fxm.13 for ; Thu, 28 Apr 2011 05:39:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=FpGzptJdBCknLSv4VjoLg1FFcyI/JEAoyroAuWA7rTM=; b=MMFbZ1ben7fIKqeAuPX115fuvBTCZXx7d4n9NJvquVy5bTo2kaGxAqkenXGzC8le16 1O190AKgDY8I00Z2r36XSCglMiJIwjzLtBgePjOPP41ykC/qKAyyiS6KnrS+iFdMcI/6 WWTA2baUGZkP2Wmnc3MyM2Mv7AuW5w2NUn20M= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=iCNs5SifaaiRyGp0iIdPJDZd1DXxEcwOYYYKo2ebFtJ1yYxR0LiHVZQYS80yt/IJLp xNtMqA3VkP47AuUT4pb7ZDxiCsb4L6Gzc03QWBVXnACDyGHWRs4mzaFGFGBTtsPeDUS1 odKZ6IyTbDTiSE0ULosg60oZcdbNOextKWSEk= MIME-Version: 1.0 Received: by 10.223.48.139 with SMTP id r11mr2185035faf.63.1303994397276; Thu, 28 Apr 2011 05:39:57 -0700 (PDT) Received: by 10.223.104.3 with HTTP; Thu, 28 Apr 2011 05:39:57 -0700 (PDT) In-Reply-To: <20110428123847.GA85701@freebsdbox.adamsnet> References: <20110428072946.GA11391@zephyr.adamsnet> <4DB946CE.4030901@rdtc.ru> <20110428123847.GA85701@freebsdbox.adamsnet> Date: Thu, 28 Apr 2011 08:39:57 -0400 Message-ID: From: Adam Stylinski To: freebsd-net@freebsd.org Content-Type: multipart/mixed; boundary=00151747b8d8d6bba204a1f9da06 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: Re: em0 performance subpar X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2011 12:40:00 -0000 --00151747b8d8d6bba204a1f9da06 Content-Type: text/plain; charset=ISO-8859-1 ---------- Forwarded message ---------- From: Adam Stylinski Date: Thu, Apr 28, 2011 at 8:38 AM Subject: Re: em0 performance subpar To: Eugene Grosbein On Thu, Apr 28, 2011 at 05:51:58PM +0700, Eugene Grosbein wrote: > On 28.04.2011 14:29, Adam Stylinski wrote: > > Hello, > > > > I have an intel gigabit network adapter (the 1000 GT w/chipset 82541PI) which performs poorly in Freebsd compared to the same card in Linux. I've tried this card in two different freebsd boxes and for whatever reason I get poor transmit performance. I've done all of the tweaking specified in just about every guide out there (the usual TCP window scaling, larger nmbclusters, delayed acks, etc) and still I get only around 600mbps. I'm using jumbo frames, with an MTU of 9000. I'm testing this with iperf. While I realize that this may not be the most realistic test, linux hosts with the same card can achieve 995Mbit/s to another host running this. When the Freebsd box is the server, Linux hosts can transmit to it at around 800 something Mbit/s. I've increased the transmit descriptors as specified in the if_em man page, and while that gave me 20 or 30 more mbit/s, my transmit performance is still below normal. > > > > sysctl stats report that the card is trigger a lot of tx_desc_fail2: > > dev.em.0.tx_desc_fail2: 3431 > > > > Looking at a comment in the source code this indicates that the card was not able to obtain enough transmit descriptors (but I've given the card the maximum of 4096 in my loader.conf tunable). Is this a bug or a performance regression of some kind? Does anybody have a fix for this? I tried another card with the same chip in a different box on 8-STABLE to no avail (the box I'm trying to improve performance on is on 8.2-RELEASE-p1). > > > > Anybody manage to make this card push above 600mbps in ideal network benchmarks? Any help would be gladly appreciated. > > Please show output of "vmstat -z|egrep 'ITEM|mbuf'" command after the test. > > Eugene Grosbein ITEM SIZE LIMIT USED FREE REQUESTS FAILURES mbuf_packet: 256, 0, 4096, 896, 531481, 0 mbuf: 256, 0, 1026, 10497, 3882824, 0 mbuf_cluster: 2048, 65768, 4992, 2998, 105908, 0 mbuf_jumbo_page: 4096, 12800, 0, 4462, 1261679, 0 mbuf_jumbo_9k: 9216, 6400, 0, 0, 0, 0 mbuf_jumbo_16k: 16384, 3200, 0, 0, 0, 0 mbuf_ext_refcnt: 4, 0, 0, 168, 1, 0 I'm willing to try compiling the module with EM_MULTIQUEUE on the test box to see if it makes a difference, but I read it can have issues with UDP traffic. -- Adam Stylinski PGP Key: http://pohl.ececs.uc.edu/~adam/publickey.pub Blog: http://technicallyliving.blogspot.com --00151747b8d8d6bba204a1f9da06 Content-Type: application/pgp-signature Content-Disposition: attachment Content-Transfer-Encoding: base64 X-Attachment-Id: d83242f6e3f9e33_0.1 LS0tLS1CRUdJTiBQR1AgU0lHTkFUVVJFLS0tLS0KVmVyc2lvbjogR251UEcgdjIuMC4xNyAoRnJl ZUJTRCkKCmlRSWNCQUVCQWdBR0JRSk51Vi9QQUFvSkVENnNSSEU2VHZtbmRZOFFBSzVvNWFXdlY1 VVJlWkluU1dRTWR6MmEKWmpOb2d3R3I2eEVCV3Z3dmZmYllhWHljSkgxTnhDU0dYWGFVRVpIbFRs RFk0R240dEs2eWhkaDhpa0VuN28wYwpjRGsrSy9ONUhXMlFqQnVvNTIxY2pPOG52MElSWnpmNk82 ZnRyamQvM0FtVFViSXhTdU9LNHFHdXZycE55UXpTCm5rQVVmUmJnaDMxcElINEpMN0JqaTNZczBH ZHdWUm1PSEl5b3k4cWVDQTlyQ3p2WDRSYS9CVDFycG5oWjgwdHMKMnpjWXdQc3lYd0JrZy9qUDZM VGh5bSt6Qlp1QTBPcW1EN1RERnRWYTlaYzRMcENVb2xoZDZjN3dXTTdxZjBoVQplOU1ULzNFVHkr UXBUaDVkRCtaOU9HcmdqbGxlWXZKUm1CVWNPQmtuVW51ZHF4SVJqQlM4N1FzSmN4eFhpOHAvCk94 b21MTFVoR244eTNCUnV0R2lhdXdncmpyOEd3bWxHN0JYV1NXV0hsQUducVdnSkxKQWJ4SkNPN3Rj d2ZkcXgKcGd3VWx6eW1wYVFKcFI2UHpuMTlXVDBZOENFektPMCtUSHg0NzBxbVV1RHpnbkJUNFRQ bWVDSnQxVkdBLzkyWQplZnYzMGFYM2VUcXlDdDE0RU1OaGx0S0VyajVQVW1raGdUYWVWOGRwNlR6 Q0phYmUvWWRPU3V6M3pnS0lIckE5ClNFUWtIYVZiOEJaSFUvWHFTYWhFUVB1c3gxYzVsMnhZcVND WGQrUytsWk91Lzl1cDdBSnlmYTBJc2ZGTTlkaTgKb2VPcDRYN2tRM0pOU0N5OVJLeVVsdHM2allo c0cvTlJYV3kwRnI4SnFwTGRDR2MvVWRndGxBMFExanVNeGR2SgprUURubnJXcnVRbHdLd3VVN1M0 SQo9NWV1WAotLS0tLUVORCBQR1AgU0lHTkFUVVJFLS0tLS0K --00151747b8d8d6bba204a1f9da06-- From owner-freebsd-net@FreeBSD.ORG Thu Apr 28 13:04:52 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0B7E0106564A for ; Thu, 28 Apr 2011 13:04:52 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1-6.sentex.ca [IPv6:2607:f3e0:0:1::12]) by mx1.freebsd.org (Postfix) with ESMTP id BC37F8FC08 for ; Thu, 28 Apr 2011 13:04:51 +0000 (UTC) Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a]) by smarthost1.sentex.ca (8.14.4/8.14.4) with ESMTP id p3SD4mLS052976 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Thu, 28 Apr 2011 09:04:49 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <4DB965D8.7090906@sentex.net> Date: Thu, 28 Apr 2011 09:04:24 -0400 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.13) Gecko/20101207 Thunderbird/3.1.7 MIME-Version: 1.0 To: Adam Stylinski References: <20110428072946.GA11391@zephyr.adamsnet> In-Reply-To: <20110428072946.GA11391@zephyr.adamsnet> X-Enigmail-Version: 1.1.1 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.67 on IPv6:2607:f3e0:0:1::12 Cc: freebsd-net@freebsd.org Subject: Re: em0 performance subpar X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2011 13:04:52 -0000 On 4/28/2011 3:29 AM, Adam Stylinski wrote: > Hello, > > I have an intel gigabit network adapter (the 1000 GT w/chipset 82541PI) which performs poorly in Freebsd compared to the same card in Linux. I've tried this card in two different freebsd boxes and for whatever reason I get poor transmit performance. I've done all of the tweaking specified in just about every guide out there (the usual TCP window scaling, larger nmbclusters, delayed acks, etc) and still I get only around 600mbps. I'm using jumbo frames, with an MTU of 9000. I'm testing this with iperf. While I realize that this may not be the most realistic test, linux hosts with the same card can achieve 995Mbit/s to another host running this. When the Freebsd box is the server, Linux hosts can transmit to it at around 800 something Mbit/s. I've increased the transmit descriptors as specified in the if_em man page, and while that gave me 20 or 30 more mbit/s, my transmit performance is still below normal. > > sysctl stats report that the card is trigger a lot of tx_desc_fail2: > dev.em.0.tx_desc_fail2: 3431 Try the tests using the tools in /usr/src/tools/tools/netperf to generate / test udp traffic. Perhaps give the driver from HEAD a try. There are a few fixes to it. I back ported it to RELENG_8, but it should work on 8.2R as well. http://www.tancsa.com/em-723.tgz what does pciconf -lvc for your em NIC show ? also, vmstat -i ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-net@FreeBSD.ORG Thu Apr 28 13:25:03 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 018E71065673 for ; Thu, 28 Apr 2011 13:25:02 +0000 (UTC) (envelope-from kungfujesus06@gmail.com) Received: from mail-iw0-f182.google.com (mail-iw0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id ADE9F8FC0A for ; Thu, 28 Apr 2011 13:25:02 +0000 (UTC) Received: by iwn33 with SMTP id 33so3073421iwn.13 for ; Thu, 28 Apr 2011 06:25:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:date:from:to:cc:subject:message-id:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=LOveyBuNxhfGBHoDybw31HCHbqUMyxTaTv/KX2/be1s=; b=VbPzF2nduAnhoOIzxsGuxOIjjsXpYtdvuj0sc3/JEZT89ziHoQzoZGSOWJPuWTbpNH XY0jIP9nnnkHO8WTN1ELhT5PiIqBq5O7N2r4LUs4tP4u2bq7EN2gDwM4tshhWm0AWhhf 3x0uFwMYCI9l30sraxWOZ9BiFFKG0WuIKGK+E= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; b=OSKRMZk5IgrwnfqMWHa9cUDZU4g76sf+IOQvb2sgmpLQoh8ZXrijnXaynHYUJWmGOW N4sGLgh85HR2Hvzg9ViR5o0PnCAzDuK53x9IZaGmcK22e4Endy7xmdp7xgf0rwgOG0Ii JJvPBgK2GomXR87TwJLkcjIYjwDfJpUxfW3g4= Received: by 10.43.65.197 with SMTP id xn5mr4620668icb.87.1303997101907; Thu, 28 Apr 2011 06:25:01 -0700 (PDT) Received: from ossumpossum.geop.uc.edu ([129.137.163.68]) by mx.google.com with ESMTPS id y10sm720558iba.12.2011.04.28.06.24.57 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 28 Apr 2011 06:24:58 -0700 (PDT) Date: Thu, 28 Apr 2011 09:25:13 -0400 From: Adam Stylinski To: Pierre Lamy Message-ID: <20110428132513.GB2800@ossumpossum.geop.uc.edu> References: <20110428072946.GA11391@zephyr.adamsnet> <4DB961EA.4080407@userid.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="1LKvkjL3sHcu1TtY" Content-Disposition: inline In-Reply-To: <4DB961EA.4080407@userid.org> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-net@freebsd.org Subject: Re: em0 performance subpar X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2011 13:25:03 -0000 --1LKvkjL3sHcu1TtY Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Apr 28, 2011 at 08:47:38AM -0400, Pierre Lamy wrote: > Try using netblast on FreeBSD instead of iperf, there have been a lot of= =20 > discussions about this on this list. >=20 > Is it possible you're maxing out the system's PCI-xxx bus? Did you tune= =20 > up the system buffers? Data doesn't just get queued up on the NIC=20 > driver, it also queues within the system's kernel buffers. Try these, I= =20 > have no idea if it will help: >=20 > sysctl -w net.inet.tcp.sendspace=3D373760 > sysctl -w net.inet.tcp.recvspace=3D373760 > sysctl -w net.local.stream.sendspace=3D82320 > sysctl -w net.local.stream.recvspace=3D82320 > sysctl -w net.local.stream.recvspace=3D373760 > sysctl -w net.local.stream.sendspace=3D373760 > sysctl -w net.raw.recvspace=3D373760 > sysctl -w net.raw.sendspace=3D373760 > sysctl -w net.inet.tcp.local_slowstart_flightsize=3D10 > sysctl -a net.inet.tcp.delayed_ack=3D0 > sysctl -w kern.maxvnodes=3D600000 > sysctl -w net.local.dgram.recvspace=3D8192 > sysctl -w net.local.dgram.maxdgram=3D8192 > sysctl -w net.inet.tcp.slowstart_flightsize=3D10 > sysctl -w net.inet.tcp.path_mtu_discovery=3D0 >=20 > They're all tunable while system is running. >=20 > -Pierre >=20 > On 4/28/2011 3:29 AM, Adam Stylinski wrote: > > Hello, > > > > I have an intel gigabit network adapter (the 1000 GT w/chipset 82541PI)= which performs poorly in Freebsd compared to the same card in Linux. I've= tried this card in two different freebsd boxes and for whatever reason I g= et poor transmit performance. I've done all of the tweaking specified in j= ust about every guide out there (the usual TCP window scaling, larger nmbcl= usters, delayed acks, etc) and still I get only around 600mbps. I'm using = jumbo frames, with an MTU of 9000. I'm testing this with iperf. While I r= ealize that this may not be the most realistic test, linux hosts with the s= ame card can achieve 995Mbit/s to another host running this. When the Free= bsd box is the server, Linux hosts can transmit to it at around 800 somethi= ng Mbit/s. I've increased the transmit descriptors as specified in the if_= em man page, and while that gave me 20 or 30 more mbit/s, my transmit perfo= rmance is still below normal. > > > > sysctl stats report that the card is trigger a lot of tx_desc_fail2: > > dev.em.0.tx_desc_fail2: 3431 > > > > Looking at a comment in the source code this indicates that the card wa= s not able to obtain enough transmit descriptors (but I've given the card t= he maximum of 4096 in my loader.conf tunable). Is this a bug or a performa= nce regression of some kind? Does anybody have a fix for this? I tried an= other card with the same chip in a different box on 8-STABLE to no avail (t= he box I'm trying to improve performance on is on 8.2-RELEASE-p1). > > > > Anybody manage to make this card push above 600mbps in ideal network be= nchmarks? Any help would be gladly appreciated. >=20 >=20 >=20 I doubt I'm saturating the PCI bus, the only other thing on the bus is a re= ally really crappy PCI video card. The same card on lesser powerful machin= es with Linux (Pentium 4) are able to achieve much more throughput, so it's= not likely a bus limitation. I adjusted the listed sysctl live tunables which I hadn't already compensat= ed for and it didn't seem to have an effect. --=20 Adam Stylinski PGP Key: http://pohl.ececs.uc.edu/~adam/publickey.pub Blog: http://technicallyliving.blogspot.com --1LKvkjL3sHcu1TtY Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.17 (FreeBSD) iQIcBAEBAgAGBQJNuWq5AAoJED6sRHE6Tvmnmm4P/19McIX8pZAIfBAvWU9WzIBi iEsbkyKMgTjRTxbWR1fvEw6XYqcqDkialypiQH66AdIppCFs4bli1APG7Urw+XAE LY01qgcWWWsFIxZgxADlMHmrVPtBH+rCsdNlnhFmyhS85Mq8sxfyBqbB5h6OjUJW mOBdacpfDb2BAkaMxni4B5yjJoLZu9R2iS+ttnNtp2x6ccfgtgEWW1G3jaUY6qpW SUM7MXh5hiQzpmHnl1VQoFcW31CeCwgeK6xsscl2rlQM5+FFD5+sLnBl5M0vsyGt 4gOe3DmzP7+v+Ul3TYW9VvIYPE+p6fFn1ZgM65ry4nTkABR0AvAyKfiP2ebTzCyR Y81Q6aXP5LPUWxwJPSMqFKZkGP+KwtgO3ZMkScz4EBGE8b163+DmJFT1rnKrX6io f55JYsoh2OeLFRstmSnu5HalhtcTSQZVAUFWpQIPogmgc76g3Sov9s51RCsU7RYo 5u0qTTmphACs4UvHc5NFV6znu/5MJcJdZSDa3kzmffhmBg8ViL2yVuW1e20KSKmG /8F4kJycvuJ+QesYC82umyR1wYRj6uWJOvSbA2Jkr4+RfNMiTw++bnJ+rWr49yBj Xo5lB5jLhaXU/tq3sIwaNBjm9MgglgIylCLMS4ZpuHxpG4dR3t/wwI6D3Y1NqUZ/ yYDQB0yb6hf6tOMZekg6 =/JUS -----END PGP SIGNATURE----- --1LKvkjL3sHcu1TtY-- From owner-freebsd-net@FreeBSD.ORG Thu Apr 28 13:29:08 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EBAF71065670 for ; Thu, 28 Apr 2011 13:29:08 +0000 (UTC) (envelope-from kungfujesus06@gmail.com) Received: from mail-iw0-f182.google.com (mail-iw0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id AAFF28FC0C for ; Thu, 28 Apr 2011 13:29:08 +0000 (UTC) Received: by iwn33 with SMTP id 33so3077624iwn.13 for ; Thu, 28 Apr 2011 06:29:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:date:from:to:cc:subject:message-id:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=sLcL29tdE9/XXxnIDkROkDEsesbpETqdb/moRA3K9dg=; b=FiFAXWFIfiLEMqgMFfDzD0fpMOHGGeXxloZKHLlNxVa7V35adAHJGnU8ldjaMHf9iC 9PzA0ZigvDkHFXw0CQolKdcehQTnwivS+3pU+OZoSsvL719Mr1m03qCRFxg10A61elc7 gzV0pM+0Wd6lrkedybYTFIRFnDzLfWtjM1Fe4= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; b=klAtrCJvgHbGVyf3weslXIP39LKs/FbyyRzKoBAO4qF2Xg2ZU49SmdQyto8BgRAeSc R6ZY9mvKe4Obt2LAtp3GRogDtdGdMlQv3cYlpTBlEOqzd8Z1n8Y4+zeUw8Kesivf9gLS yomWnoSzlQh5S++KesTMV/IWtmUv52HVc36h4= Received: by 10.43.60.148 with SMTP id ws20mr3888206icb.264.1303997348036; Thu, 28 Apr 2011 06:29:08 -0700 (PDT) Received: from ossumpossum.geop.uc.edu ([129.137.163.68]) by mx.google.com with ESMTPS id 13sm717343ibo.59.2011.04.28.06.29.06 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 28 Apr 2011 06:29:06 -0700 (PDT) Date: Thu, 28 Apr 2011 09:29:22 -0400 From: Adam Stylinski To: Mike Tancsa Message-ID: <20110428132922.GC2800@ossumpossum.geop.uc.edu> References: <20110428072946.GA11391@zephyr.adamsnet> <4DB965D8.7090906@sentex.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="tqI+Z3u+9OQ7kwn0" Content-Disposition: inline In-Reply-To: <4DB965D8.7090906@sentex.net> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-net@freebsd.org Subject: Re: em0 performance subpar X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2011 13:29:09 -0000 --tqI+Z3u+9OQ7kwn0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Apr 28, 2011 at 09:04:24AM -0400, Mike Tancsa wrote: > On 4/28/2011 3:29 AM, Adam Stylinski wrote: > > Hello, > >=20 > > I have an intel gigabit network adapter (the 1000 GT w/chipset 82541PI)= which performs poorly in Freebsd compared to the same card in Linux. I've= tried this card in two different freebsd boxes and for whatever reason I g= et poor transmit performance. I've done all of the tweaking specified in j= ust about every guide out there (the usual TCP window scaling, larger nmbcl= usters, delayed acks, etc) and still I get only around 600mbps. I'm using = jumbo frames, with an MTU of 9000. I'm testing this with iperf. While I r= ealize that this may not be the most realistic test, linux hosts with the s= ame card can achieve 995Mbit/s to another host running this. When the Free= bsd box is the server, Linux hosts can transmit to it at around 800 somethi= ng Mbit/s. I've increased the transmit descriptors as specified in the if_= em man page, and while that gave me 20 or 30 more mbit/s, my transmit perfo= rmance is still below normal. =20 > >=20 > > sysctl stats report that the card is trigger a lot of tx_desc_fail2: > > dev.em.0.tx_desc_fail2: 3431 >=20 > Try the tests using the tools in /usr/src/tools/tools/netperf to > generate / test udp traffic. >=20 > Perhaps give the driver from HEAD a try. There are a few fixes to it. I > back ported it to RELENG_8, but it should work on 8.2R as well. >=20 > http://www.tancsa.com/em-723.tgz >=20 > what does pciconf -lvc for your em NIC show ? > also, vmstat -i >=20 > ---Mike >=20 >=20 >=20 > --=20 > ------------------- > Mike Tancsa, tel +1 519 651 3400 > Sentex Communications, mike@sentex.net > Providing Internet services since 1994 www.sentex.net > Cambridge, Ontario Canada http://www.tancsa.com/ lspci -lvc: em0@pci0:7:5:0: class=3D0x020000 card=3D0x13768086 chip=3D0x107c8086 rev=3D= 0x05 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'Gigabit Ethernet Controller (Copper) rev 5 (82541PI)' class =3D network subclass =3D ethernet cap 01[dc] =3D powerspec 2 supports D0 D3 current D0 cap 07[e4] =3D PCI-X supports 2048 burst read, 1 split transaction vmstat -i: interrupt total rate irq1: atkbd0 6 0 irq14: ata0 30306 1 irq18: ohci0 ohci1* 5 0 irq20: em0 994488 43 irq24: aac0 107044 4 irq40: hptrr0 89761 3 irq48: fwohci0+ 5047 0 cpu0: timer 45466809 1999 irq256: ahci1 83842 3 cpu2: timer 45458298 1999 cpu3: timer 45458296 1999 cpu1: timer 45458295 1999 Total 183152197 8055 --=20 Adam Stylinski PGP Key: http://pohl.ececs.uc.edu/~adam/publickey.pub Blog: http://technicallyliving.blogspot.com --tqI+Z3u+9OQ7kwn0 Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.17 (FreeBSD) iQIcBAEBAgAGBQJNuWuyAAoJED6sRHE6TvmnnlAQANSHsX5yLRf5d3pcFTKRnNxw u039V0m3bdkIk0/3TuBJDpqW5J9jf9VwaRAoDPNJOvnkkDGmxUKhigadWQ2YVphO UgzrFo0kdXuEKEYK2bn89ITJrQKJmqUUWlhqsCRZ0+LRjspO1EKJKtfyJK362QGl yMtDxKn+P7sgFPOy2qFnI5dBNDM16E6fxhZWFWNr6IEOkezwhxizwhqD20cvh9CW 9Wom9iauRQbqIlS9ttTkYkIWbRZ+Sxl0xn7dXTUEzVJrk19EuU2ILWSXJHw+Eb6p HdRnIdvllWa/fVvkEt+4gw6BKWy2HvWAGH19fcHqFEeT8hn97qCDXpV4h7McrJ0W cjmqrx8lSU3vBhe2I54vzgq1u0tYyAAIiH7dDoF/siOtZlFa2gGeHv+9X6iu2zTQ zVzv33rWa6CRo0qsOFXWmrx5tsqNZ/y0K7a/6U/lARSpjqc1GeKuz+3TTLTuH6mG 0nNjIAQU9tW3FsqQ6x8Ocq+zBva0S/oUE+kSuL53KJXu7klHzMYpKZLiQdQoccAf dV/vRSHK+1Jcq5cLRd1DexNBcFJ8oBVwhM4HxQF2klzZD6Ww4u/WQxVEymHALS2q pkZ4+2UKdRsXLQD98WDL1j06B335PolXSgkBGDMTaTOO/5zggDUfO04ETmI9nkLy CIFyUkZKUoAOAdW5gXt/ =G+64 -----END PGP SIGNATURE----- --tqI+Z3u+9OQ7kwn0-- From owner-freebsd-net@FreeBSD.ORG Thu Apr 28 14:04:16 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 32FBE106564A for ; Thu, 28 Apr 2011 14:04:16 +0000 (UTC) (envelope-from prvs=10995192f0=killing@multiplay.co.uk) Received: from mail1.multiplay.co.uk (mail1.multiplay.co.uk [85.236.96.23]) by mx1.freebsd.org (Postfix) with ESMTP id AFC358FC0A for ; Thu, 28 Apr 2011 14:04:15 +0000 (UTC) X-MDAV-Processed: mail1.multiplay.co.uk, Thu, 28 Apr 2011 14:52:51 +0100 X-Spam-Processed: mail1.multiplay.co.uk, Thu, 28 Apr 2011 14:52:51 +0100 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on mail1.multiplay.co.uk X-Spam-Level: X-Spam-Status: No, score=-5.0 required=6.0 tests=USER_IN_WHITELIST shortcircuit=ham autolearn=disabled version=3.2.5 Received: from r2d2 ([188.220.16.49]) by mail1.multiplay.co.uk (mail1.multiplay.co.uk [85.236.96.23]) (MDaemon PRO v10.0.4) with ESMTP id md50013096532.msg for ; Thu, 28 Apr 2011 14:52:49 +0100 X-MDRemoteIP: 188.220.16.49 X-Return-Path: prvs=10995192f0=killing@multiplay.co.uk X-Envelope-From: killing@multiplay.co.uk X-MDaemon-Deliver-To: freebsd-net@freebsd.org Message-ID: From: "Steven Hartland" To: "Mike Tancsa" , "Adam Stylinski" References: <20110428072946.GA11391@zephyr.adamsnet> <4DB965D8.7090906@sentex.net> Date: Thu, 28 Apr 2011 14:52:59 +0100 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="iso-8859-1"; reply-type=original Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.5931 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.6090 Cc: freebsd-net@freebsd.org Subject: Re: em0 performance subpar X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2011 14:04:16 -0000 Running em's here we regularly see them hitting pretty much line rate although there are a lot of different em's Here we have the following under 8.0+ em0@pci0:6:0:0: class=0x020000 card=0x000015d9 chip=0x10968086 rev=0x01 hdr=0x00 vendor = 'Intel Corporation' device = 'Intel PRO/1000 EB (Intel PRO/1000 EB)' class = network subclass = ethernet You don't say which OS version your running? Regards Steve ----- Original Message ----- From: "Mike Tancsa" To: "Adam Stylinski" Cc: Sent: Thursday, April 28, 2011 2:04 PM Subject: Re: em0 performance subpar > On 4/28/2011 3:29 AM, Adam Stylinski wrote: >> Hello, >> >> I have an intel gigabit network adapter (the 1000 GT w/chipset 82541PI) which performs poorly in Freebsd compared to the same >> card in Linux. I've tried this card in two different freebsd boxes and for whatever reason I get poor transmit performance. >> I've done all of the tweaking specified in just about every guide out there (the usual TCP window scaling, larger nmbclusters, >> delayed acks, etc) and still I get only around 600mbps. I'm using jumbo frames, with an MTU of 9000. I'm testing this with >> iperf. While I realize that this may not be the most realistic test, linux hosts with the same card can achieve 995Mbit/s to >> another host running this. When the Freebsd box is the server, Linux hosts can transmit to it at around 800 something Mbit/s. >> I've increased the transmit descriptors as specified in the if_em man page, and while that gave me 20 or 30 more mbit/s, my >> transmit performance is still below normal. >> >> sysctl stats report that the card is trigger a lot of tx_desc_fail2: >> dev.em.0.tx_desc_fail2: 3431 > > Try the tests using the tools in /usr/src/tools/tools/netperf to > generate / test udp traffic. > > Perhaps give the driver from HEAD a try. There are a few fixes to it. I > back ported it to RELENG_8, but it should work on 8.2R as well. > > http://www.tancsa.com/em-723.tgz > > what does pciconf -lvc for your em NIC show ? > also, vmstat -i > > ---Mike > > > > -- > ------------------- > Mike Tancsa, tel +1 519 651 3400 > Sentex Communications, mike@sentex.net > Providing Internet services since 1994 www.sentex.net > Cambridge, Ontario Canada http://www.tancsa.com/ > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" > ================================================ This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337 or return the E.mail to postmaster@multiplay.co.uk. From owner-freebsd-net@FreeBSD.ORG Thu Apr 28 14:13:26 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4192C1065675 for ; Thu, 28 Apr 2011 14:13:26 +0000 (UTC) (envelope-from kungfujesus06@gmail.com) Received: from mail-iw0-f182.google.com (mail-iw0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id F3A768FC15 for ; Thu, 28 Apr 2011 14:13:25 +0000 (UTC) Received: by iwn33 with SMTP id 33so3126791iwn.13 for ; Thu, 28 Apr 2011 07:13:25 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:date:from:to:cc:subject:message-id:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=ZV87PZ+NhELx3Pq31gTjzy5E1bjJ+aSM07ODOjASc9k=; b=un1QO0Y2yP2XMJs1G2t/H0u6J8xguhEtCPqImScHbO/RkY86JugQhRZMjFGjcCOJ+8 DTgjO9iNEctsFrHtK2TLzt/ApOdeodsRCvigOtDXIXhtVeCTCztRBrpydEsBocHWWQqt oKHTkCaX3l7X/FyB+njza1PWQmsRz/TMbjOGc= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; b=Ur8TGbXM9j7nVQcsYH1sKeN8K014auEmC048FrykR0HccnQqd6svynsgshARmVUOZI t8brUXyWy9obt3ptzbjQRJcjPQ84btjULlqeddc17wgNwBM8a7W1s4nW6/JgGC9EX0br ZdnZuWCfMgulqvB02xSEXUqJ1BB8/qky2++ps= Received: by 10.42.221.70 with SMTP id ib6mr3333843icb.355.1304000004892; Thu, 28 Apr 2011 07:13:24 -0700 (PDT) Received: from ossumpossum.geop.uc.edu ([129.137.163.68]) by mx.google.com with ESMTPS id 13sm733095ibo.8.2011.04.28.07.13.22 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 28 Apr 2011 07:13:23 -0700 (PDT) Date: Thu, 28 Apr 2011 10:13:39 -0400 From: Adam Stylinski To: Steven Hartland Message-ID: <20110428141339.GD2800@ossumpossum.geop.uc.edu> References: <20110428072946.GA11391@zephyr.adamsnet> <4DB965D8.7090906@sentex.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="NtwzykIc2mflq5ck" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-net@freebsd.org Subject: Re: em0 performance subpar X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2011 14:13:26 -0000 --NtwzykIc2mflq5ck Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Apr 28, 2011 at 02:52:59PM +0100, Steven Hartland wrote: > Running em's here we regularly see them hitting pretty much line rate > although there are a lot of different em's >=20 > Here we have the following under 8.0+ > em0@pci0:6:0:0: class=3D0x020000 card=3D0x000015d9 chip=3D0x10968086 rev= =3D0x01 hdr=3D0x00 > vendor =3D 'Intel Corporation' > device =3D 'Intel PRO/1000 EB (Intel PRO/1000 EB)' > class =3D network > subclass =3D ethernet >=20 > You don't say which OS version your running? >=20 > Regards > Steve >=20 > ----- Original Message -----=20 > From: "Mike Tancsa" > To: "Adam Stylinski" > Cc: > Sent: Thursday, April 28, 2011 2:04 PM > Subject: Re: em0 performance subpar >=20 >=20 > > On 4/28/2011 3:29 AM, Adam Stylinski wrote: > >> Hello, > >> > >> I have an intel gigabit network adapter (the 1000 GT w/chipset 82541PI= ) which performs poorly in Freebsd compared to the same=20 > >> card in Linux. I've tried this card in two different freebsd boxes an= d for whatever reason I get poor transmit performance.=20 > >> I've done all of the tweaking specified in just about every guide out = there (the usual TCP window scaling, larger nmbclusters,=20 > >> delayed acks, etc) and still I get only around 600mbps. I'm using jum= bo frames, with an MTU of 9000. I'm testing this with=20 > >> iperf. While I realize that this may not be the most realistic test, = linux hosts with the same card can achieve 995Mbit/s to=20 > >> another host running this. When the Freebsd box is the server, Linux = hosts can transmit to it at around 800 something Mbit/s.=20 > >> I've increased the transmit descriptors as specified in the if_em man = page, and while that gave me 20 or 30 more mbit/s, my=20 > >> transmit performance is still below normal. > >> > >> sysctl stats report that the card is trigger a lot of tx_desc_fail2: > >> dev.em.0.tx_desc_fail2: 3431 > > > > Try the tests using the tools in /usr/src/tools/tools/netperf to > > generate / test udp traffic. > > > > Perhaps give the driver from HEAD a try. There are a few fixes to it. I > > back ported it to RELENG_8, but it should work on 8.2R as well. > > > > http://www.tancsa.com/em-723.tgz > > > > what does pciconf -lvc for your em NIC show ? > > also, vmstat -i > > > > ---Mike > > > > > > > > --=20 > > ------------------- > > Mike Tancsa, tel +1 519 651 3400 > > Sentex Communications, mike@sentex.net > > Providing Internet services since 1994 www.sentex.net > > Cambridge, Ontario Canada http://www.tancsa.com/ > > _______________________________________________ > > freebsd-net@freebsd.org mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-net > > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" > >=20 >=20 >=20 > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > This e.mail is private and confidential between Multiplay (UK) Ltd. and t= he person or entity to whom it is addressed. In the event of misdirection, = the recipient is prohibited from using, copying, printing or otherwise diss= eminating it or any information contained in it.=20 >=20 > In the event of misdirection, illegible or incomplete transmission please= telephone +44 845 868 1337 > or return the E.mail to postmaster@multiplay.co.uk. >=20 I am running FreeBSD 8.2-RELEASE on one of the boxes with the issues, and t= he other box which has the same issue is 8-STABLE. The issue doesn't seem = isolated to one box though and like I said, Linux seems to not have this is= sue. --=20 Adam Stylinski PGP Key: http://pohl.ececs.uc.edu/~adam/publickey.pub Blog: http://technicallyliving.blogspot.com --NtwzykIc2mflq5ck Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.17 (FreeBSD) iQIcBAEBAgAGBQJNuXYSAAoJED6sRHE6TvmnVyYP/1hIzq7S7JMvNPPqbt2eN+yN cN9e4qKnrjRpui5fbufI4WPlTGzKCtN69vhgkXq1k5oKTF9We48UN+eWiLmi4QP+ tGbyHmA6GQMLhohq8iPOiPLJnigIyk5kXxlIMlA5Wf6toKwmQHugtUv1FLHX3ml2 pYO+eZ7xkqHTjy2QwtBkq4TqiSAxi6WG5HMPA5pBEHe0TOgPyGDq4mNK0FXpama4 lOSLpnV/wCSXIscCfJ+HrcVIsCfgWpsC0sjroowm8jSmjuXQweOn0hHvut8puD54 9zeRlLiy6WLhP3BQo2ByJ9FBMJpoDjoh08Bm4/2uXUgcg5aFByNR6YTjuEtl+bfU 8FLKMg0LIEmexgYfWRSJ9RZ8eHmVCmI3bh+5bGaxcYfGRFYd/DLWaeNaosdQs5Sa e7CmaQaHhylIG/NsagQJo+pcbxtLF+4sY7atEiijidS0Yb1DnZlFpgU/G/l/PFKm 6J4S8wPq0COmZgOWJHcIJvHOXxKYTY5jwDL5fhlmwjHQgKGh6ZLF+HSAR9UmRr/X YZGbTpONcc9oZ2A/LSQi3zPNNCCZpMIbEyH/CpWfBgYIyujdJpf/nQ/0PhZmZa9l 1T2FduEjtBNdlz+bQULmxnKtf57sf+ocK76iqJ3tXfSZiLTaKkEOWCfmc9sbRFsO JbyLK9BMcHZ0rYWZELtn =/b2b -----END PGP SIGNATURE----- --NtwzykIc2mflq5ck-- From owner-freebsd-net@FreeBSD.ORG Thu Apr 28 14:14:47 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 69BA0106564A for ; Thu, 28 Apr 2011 14:14:47 +0000 (UTC) (envelope-from kungfujesus06@gmail.com) Received: from mail-iw0-f182.google.com (mail-iw0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id 2899B8FC13 for ; Thu, 28 Apr 2011 14:14:47 +0000 (UTC) Received: by iwn33 with SMTP id 33so3128262iwn.13 for ; Thu, 28 Apr 2011 07:14:46 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:date:from:to:cc:subject:message-id:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=rs+0osIy+r8mZSwaxDR9zeotK8E8VlJTbESY159Q570=; b=t+30RKMLsAKXrfIUEG7cMwMvOBdQ18XPsiatNmapBg5yZ8Oc2Kq3MYFMnvnjsDqdgO /FFZvA0TN73G7DuT9tWojSNDQg8bMhcE4aYkka65a03gXTb/X4isdewLhvRbWOo2YW4Q dgypvKYn83LESECAdJM0cLckPLpoxrml2IZJo= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; b=gyw5lbYfUeIOv9tLWQVtMhsHgKn7OAvmJslbIX/+4aX8lsR0MNMsDrAl1jDrKFmO4P 2SZ+NV2d0pPb+wqclSeVRrwz1qPHAsqzmDudy+fygtnEoip7QEblwFo0+EdI/xvtw7bl XpHivPEaQrrdatgQqqaEjtBERhgolEl9zKITM= Received: by 10.42.74.195 with SMTP id x3mr4494244icj.79.1304000086272; Thu, 28 Apr 2011 07:14:46 -0700 (PDT) Received: from ossumpossum.geop.uc.edu ([129.137.163.68]) by mx.google.com with ESMTPS id d9sm733644ibb.2.2011.04.28.07.14.44 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 28 Apr 2011 07:14:45 -0700 (PDT) Date: Thu, 28 Apr 2011 10:15:00 -0400 From: Adam Stylinski To: Mike Tancsa Message-ID: <20110428141500.GE2800@ossumpossum.geop.uc.edu> References: <20110428072946.GA11391@zephyr.adamsnet> <4DB965D8.7090906@sentex.net> <20110428132922.GC2800@ossumpossum.geop.uc.edu> <4DB96DDD.4070801@sentex.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="84ND8YJRMFlzkrP4" Content-Disposition: inline In-Reply-To: <4DB96DDD.4070801@sentex.net> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-net@freebsd.org Subject: Re: em0 performance subpar X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2011 14:14:47 -0000 --84ND8YJRMFlzkrP4 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Apr 28, 2011 at 09:38:37AM -0400, Mike Tancsa wrote: > On 4/28/2011 9:29 AM, Adam Stylinski wrote: > > lspci -lvc: > >=20 > > em0@pci0:7:5:0: class=3D0x020000 card=3D0x13768086 chip=3D0x107c8086 re= v=3D0x05 hdr=3D0x00 > > vendor =3D 'Intel Corporation' > > device =3D 'Gigabit Ethernet Controller (Copper) rev 5 (82541PI= )' > > class =3D network > > subclass =3D ethernet > > cap 01[dc] =3D powerspec 2 supports D0 D3 current D0 > > cap 07[e4] =3D PCI-X supports 2048 burst read, 1 split transaction > >=20 >=20 >=20 > Does this card attach via the legacy driver ? What does > grep ^em /var/run/dmesg.boot > show ? >=20 >=20 > --=20 > ------------------- > Mike Tancsa, tel +1 519 651 3400 > Sentex Communications, mike@sentex.net > Providing Internet services since 1994 www.sentex.net > Cambridge, Ontario Canada http://www.tancsa.com/ dmesg.boot:=20 em0: port 0xe800-0xe83f= mem 0xfe9e0000-0xfe9fffff,0xfe9c0000-0xfe9dffff irq 20 at device 5.0 on pc= i7 em0: [FILTER] em0: Ethernet address: 00:1b:21:1c:d2:f0 em0: link state changed to UP em0: link state changed to DOWN em0: link state changed to UP em0: link state changed to DOWN em0: link state changed to UP em0: port 0xe800-0xe83f= mem 0xfe9e0000-0xfe9fffff,0xfe9c0000-0xfe9dffff irq 20 at device 5.0 on pc= i7 em0: [FILTER] em0: Ethernet address: 00:1b:21:1c:d2:f0 em0: link state changed to UP em0: port 0xe800-0xe83f= mem 0xfe9e0000-0xfe9fffff,0xfe9c0000-0xfe9dffff irq 20 at device 5.0 on pc= i7 em0: [FILTER] em0: Ethernet address: 00:1b:21:1c:d2:f0 em0: link state changed to UP em0: port 0xe800-0xe83f= mem 0xfe9e0000-0xfe9fffff,0xfe9c0000-0xfe9dffff irq 20 at device 5.0 on pc= i7 em0: [FILTER] em0: Ethernet address: 00:1b:21:1c:d2:f0 em0: link state changed to UP --=20 Adam Stylinski PGP Key: http://pohl.ececs.uc.edu/~adam/publickey.pub Blog: http://technicallyliving.blogspot.com --84ND8YJRMFlzkrP4 Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.17 (FreeBSD) iQIcBAEBAgAGBQJNuXZkAAoJED6sRHE6TvmnNN4P/3xGiggvlWX8Z3o7GcDgOlTu ZriPp5yshiaaQhmzMvHnrp5r6QvfmYO4GKL80DDcaMeIKjhgtIaj71CZmKtpWD/N GzxaX5FngaCoHFxQ7yQ7zlEHHzB2WAsRR4raOow4Yd1LA10N16cLPuP9j3QMjbDR /sp7FhWK8KfZx4Eh/GylrwS8w0X5+4xrm2WiKXS6zMxuhqIr5dr+4B6SBmrzEFZV aUvXm1mTbA8vkNM3gxB1+M+oAfrbO1h9bjfYZWYDc8w2UItXS6CIfJZveMg9yRTK grNPVnn+qwKnOtSSWRz6meE1isvvYWGKTceJlLWkOsf9hzuzhmnOwkiF4yUL07s0 bpGrivIm1f5yH1/c2YUwqWrAsnq4/8OdQKqqw8DjOwfpKiOGsrucc2jwrXTl6NcV 9rY/noCrNlLtIpi2DGacN4KETP3nXgx+4Ra5kJiXsrHNSwzToKMy6VpkhEHFIs4+ 752LJpMCQwf+gfaRFn5s07LZeQ9FUxQWqmtlUTocTFp3bsUCEgqOpvs+LXrMVJdS AGBI1mCHO07OhXvrZU+x+SXS7rEq5DoT3FNF+bRWubjPrTAXs8KVsJBO6Vr2sTvr AuNvdSI5jz7DZ55ns11+S6TIT3INj6eO6e3WLzcxUzs3jOejb6FtD6nReLiJyMD+ Cj/w6gnlvGZvldxDUhto =oYQu -----END PGP SIGNATURE----- --84ND8YJRMFlzkrP4-- From owner-freebsd-net@FreeBSD.ORG Thu Apr 28 14:27:09 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CAAAC106564A for ; Thu, 28 Apr 2011 14:27:09 +0000 (UTC) (envelope-from prvs=10995192f0=killing@multiplay.co.uk) Received: from mail1.multiplay.co.uk (mail1.multiplay.co.uk [85.236.96.23]) by mx1.freebsd.org (Postfix) with ESMTP id 602938FC0C for ; Thu, 28 Apr 2011 14:27:08 +0000 (UTC) X-MDAV-Processed: mail1.multiplay.co.uk, Thu, 28 Apr 2011 15:26:45 +0100 X-Spam-Processed: mail1.multiplay.co.uk, Thu, 28 Apr 2011 15:26:42 +0100 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on mail1.multiplay.co.uk X-Spam-Level: X-Spam-Status: No, score=-5.0 required=6.0 tests=USER_IN_WHITELIST shortcircuit=ham autolearn=disabled version=3.2.5 Received: from r2d2 ([188.220.16.49]) by mail1.multiplay.co.uk (mail1.multiplay.co.uk [85.236.96.23]) (MDaemon PRO v10.0.4) with ESMTP id md50013096920.msg for ; Thu, 28 Apr 2011 15:26:40 +0100 X-MDRemoteIP: 188.220.16.49 X-Return-Path: prvs=10995192f0=killing@multiplay.co.uk X-Envelope-From: killing@multiplay.co.uk X-MDaemon-Deliver-To: freebsd-net@freebsd.org Message-ID: From: "Steven Hartland" To: "Adam Stylinski" References: <20110428072946.GA11391@zephyr.adamsnet> <4DB965D8.7090906@sentex.net> <20110428141339.GD2800@ossumpossum.geop.uc.edu> Date: Thu, 28 Apr 2011 15:25:53 +0100 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="iso-8859-1"; reply-type=original Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.5931 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.6090 Cc: freebsd-net@freebsd.org Subject: Re: em0 performance subpar X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2011 14:27:09 -0000 * What's your traffic like? e.g. http, large tcp files, tiny udp etc... * Is it all on a local switch, if so what switch? * Is flow control enabled? * Are you seeing high interrupts? * Are you disk bound? * Are you memory bound? * Are you cpu bound? Some basic settings we have here:- net.inet.tcp.inflight.enable=0 net.inet.tcp.sendspace=65536 kern.ipc.nmbclusters=262144 kern.ipc.maxsockets=204800 net.inet.tcp.msl=20000 kern.ipc.maxsockbuf=524288 net.inet.tcp.sendbuf_max=16777216 net.inet.tcp.recvbuf_max=16777216 Note: Large values for kern.ipc.maxsockbuf can hurt performance under 8.x but work well under 7.x (never got to the bottom of that) Regards Steve ================================================ This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337 or return the E.mail to postmaster@multiplay.co.uk. From owner-freebsd-net@FreeBSD.ORG Thu Apr 28 14:30:59 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AD42B1065670 for ; Thu, 28 Apr 2011 14:30:59 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1-6.sentex.ca [IPv6:2607:f3e0:0:1::12]) by mx1.freebsd.org (Postfix) with ESMTP id 691A38FC19 for ; Thu, 28 Apr 2011 14:30:59 +0000 (UTC) Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a]) by smarthost1.sentex.ca (8.14.4/8.14.4) with ESMTP id p3SEUu9H070523 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Thu, 28 Apr 2011 10:30:56 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <4DB97A07.2020606@sentex.net> Date: Thu, 28 Apr 2011 10:30:31 -0400 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.13) Gecko/20101207 Thunderbird/3.1.7 MIME-Version: 1.0 To: Adam Stylinski References: <20110428072946.GA11391@zephyr.adamsnet> <4DB965D8.7090906@sentex.net> <20110428132922.GC2800@ossumpossum.geop.uc.edu> <4DB96DDD.4070801@sentex.net> <20110428141500.GE2800@ossumpossum.geop.uc.edu> In-Reply-To: <20110428141500.GE2800@ossumpossum.geop.uc.edu> X-Enigmail-Version: 1.1.1 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.67 on IPv6:2607:f3e0:0:1::12 Cc: freebsd-net@freebsd.org Subject: Re: em0 performance subpar X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2011 14:30:59 -0000 On 4/28/2011 10:15 AM, Adam Stylinski wrote: > > em0: port 0xe800-0xe83f mem 0xfe9e0000-0xfe9fffff,0xfe9c0000-0xfe9dffff irq 20 at device 5.0 on pci7 > em0: [FILTER] I am not sure the newer driver will help performance wise. It might fix that bug you saw at least. Jack from intel might be able to shed some light on it. In the mean time, try generating traffic via netblast. Another tool I find helpful in narrowing down tcp performance differences is netperf ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-net@FreeBSD.ORG Thu Apr 28 14:45:02 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0FCA41065672 for ; Thu, 28 Apr 2011 14:45:02 +0000 (UTC) (envelope-from kungfujesus06@gmail.com) Received: from mail-iw0-f182.google.com (mail-iw0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id BA4308FC1B for ; Thu, 28 Apr 2011 14:45:01 +0000 (UTC) Received: by iwn33 with SMTP id 33so3163278iwn.13 for ; Thu, 28 Apr 2011 07:45:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:date:from:to:cc:subject:message-id:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=oo/F3lXS+3Lp8ICh+bZBx5jl8EtFrxBn5Zuip40X84w=; b=M32rthSUNWqVUN0TJ+3vHBW7i4f2kKMWaIl2Si33UlXx6JEyO3MoxUfgO8ils2UCIT 9AcD7VA/gLxUshHI2LjvQaMVJeDPcuZjWZ5Pveohapcos1XRqx+qZRUHLXNtRIyVY7vT TSU4k1CAUdGeRMLj1CetQzAuFUMSdtPJUeUZU= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; b=C3Ncmz9PPGDHBqZ9HClMRv4lkxyVCOVEv6296Fbu0KQt5d7vq8TAN0/J5GdRHkx3rl cxX05ecnlHrvazbpZ/fMXhh0YBznlBvPWKEflvTzmytHorT9AgUxp1s6ELUm1wBUlHY6 l8IKVBzBflzW4Bj6ZOTkLZtD12pwNmzbv7Gf0= Received: by 10.42.217.137 with SMTP id hm9mr4606953icb.196.1304001899392; Thu, 28 Apr 2011 07:44:59 -0700 (PDT) Received: from ossumpossum.geop.uc.edu ([129.137.163.68]) by mx.google.com with ESMTPS id ww2sm671227icb.3.2011.04.28.07.44.56 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 28 Apr 2011 07:44:57 -0700 (PDT) Date: Thu, 28 Apr 2011 10:45:13 -0400 From: Adam Stylinski To: Steven Hartland Message-ID: <20110428144513.GF2800@ossumpossum.geop.uc.edu> References: <20110428072946.GA11391@zephyr.adamsnet> <4DB965D8.7090906@sentex.net> <20110428141339.GD2800@ossumpossum.geop.uc.edu> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="/QKKmeG/X/bPShih" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-net@freebsd.org Subject: Re: em0 performance subpar X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2011 14:45:02 -0000 --/QKKmeG/X/bPShih Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Apr 28, 2011 at 03:25:53PM +0100, Steven Hartland wrote: > * What's your traffic like? e.g. http, large tcp files, tiny udp etc... > * Is it all on a local switch, if so what switch? > * Is flow control enabled? > * Are you seeing high interrupts? > * Are you disk bound? > * Are you memory bound? > * Are you cpu bound? >=20 > Some basic settings we have here:- > net.inet.tcp.inflight.enable=3D0 > net.inet.tcp.sendspace=3D65536 > kern.ipc.nmbclusters=3D262144 > kern.ipc.maxsockets=3D204800 > net.inet.tcp.msl=3D20000 > kern.ipc.maxsockbuf=3D524288 > net.inet.tcp.sendbuf_max=3D16777216 > net.inet.tcp.recvbuf_max=3D16777216 >=20 > Note: Large values for kern.ipc.maxsockbuf can hurt performance under > 8.x but work well under 7.x (never got to the bottom of that) >=20 > Regards > Steve >=20 >=20 > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > This e.mail is private and confidential between Multiplay (UK) Ltd. and t= he person or entity to whom it is addressed. In the event of misdirection, = the recipient is prohibited from using, copying, printing or otherwise diss= eminating it or any information contained in it.=20 >=20 > In the event of misdirection, illegible or incomplete transmission please= telephone +44 845 868 1337 > or return the E.mail to postmaster@multiplay.co.uk. >=20 I was using the default value for maxsockbuf, doesn't seem to hurt or help.= The only value you've listed that I didn't have tweaked to a comparable v= alue already was the nmbclusters, changing it seems to have no effect, thou= gh. vmstat -i should display my interrupts, which I don't think are partic= ularly high. I am most definitely not CPU bound (utilization shows no hot = CPUs), I have 16GB of memory and plenty allocated to the kernel, and I beli= eve flow control is enabled (should it not be?): net.inet.flowtable.enable: 1 It's a 16 port netgear gigabit prosafe switch, and it's not likely to be th= e problem (like I said, the Linux hosts have no issues with the same card).= =20 --=20 Adam Stylinski PGP Key: http://pohl.ececs.uc.edu/~adam/publickey.pub Blog: http://technicallyliving.blogspot.com --/QKKmeG/X/bPShih Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.17 (FreeBSD) iQIcBAEBAgAGBQJNuX14AAoJED6sRHE6TvmnVT0QAIXzCh4bJKFeskLqhkAg5sP0 Kn8qivwPBSD4fu4LG/3cM2coaSpdOlS4o3HrwfNtfRyeYJVpGLra5LVTqJD4Yjph Oyi9rn4Dggbcc0gZTZC8uT9W7T4iEbHh6dkmPnserH6iEi1nxeQpQ3PGme4vQ7Eu XhtfjLLm056Mm2bHFqac5eHCpPQI0H2PDK4GazAlGnlI2HS6zEzLooG7xO4yHSNA Hs0S2K3cP+6yjxBIZJ1N2tG4DwRy6jVeRXvmj4nNGS7vbbGhX+mWWo/oI8gOOSgf CpuGNpiWWqBWnE/ARshRm89GCbXWoX/km+8G6/7063Lkm7Ib9qxa9Na04EF+0k4j 4OeF8ixQi0WEZrWp1HlA4wknWyQua0z9fTbtTBOFLKI8QFnUkJfeoh9h4d0ujd5x m7Zg9XU1zUeEKuQdb2BohSaTS54wv+z2YGMbBVnhSxmH3NyXiQyJZDcplzatq7HU D5UXh6gYeLNAYjFgM3rM4mbw82avQmzQxLbYGg1T24y2yO1VhvVVNMoTwyLDyM+E CFGzdtt2PlZsR9pOcuD3u2lNOETb78KzIEeW0VXpeZn6sS9LeRA5pomriwsDK4nn Nu6YQg7YmvsQtJlXia0o4HSz7XkQ1Y6d86n7/g3GrqpQard+RPbwKFJpqfqDGg4P KDV9zgDRlYQXv6tj+pcz =+T9i -----END PGP SIGNATURE----- --/QKKmeG/X/bPShih-- From owner-freebsd-net@FreeBSD.ORG Thu Apr 28 15:01:06 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 09B041065672 for ; Thu, 28 Apr 2011 15:01:06 +0000 (UTC) (envelope-from kungfujesus06@gmail.com) Received: from mail-iw0-f182.google.com (mail-iw0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id BC0A88FC0C for ; Thu, 28 Apr 2011 15:01:05 +0000 (UTC) Received: by iwn33 with SMTP id 33so3181380iwn.13 for ; Thu, 28 Apr 2011 08:01:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:date:from:to:cc:subject:message-id:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=kUEERUX0MX2B7614uAHjFYapSIDssDkEm9TYGj1WU90=; b=T7ik05Uo5IkGRmEEAtmD41ybn2Qrhd6Kx7b3Txe7XlZ+6S/30k8oTGD3heTKoni0Oc n2W530RDAf8LQd0uIHvOrU3tGMjY/ddgXvj8WlW18+GGd0X2ujE9GB658eM6tB1cfvDk O4roeq/WMN0F5cOT805gg1VRqPk/artDWL46E= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; b=QfzE6VnfbiZyh+YpAfprumlLKlrJWqpyad2C7acAP1NGw9AznqTWboT1NV/JPFjgRr zCY4QaTnfhzo8CSUOrLK8tr2nI/2DiIK2M3A4pS0hmQuoAghpxOmbbqb7Ly1KpYoFWYR yEJw+WKm6veMuh91Dum4bnKz7M1y699vy2kEc= Received: by 10.42.82.81 with SMTP id c17mr1346359icl.34.1304002856548; Thu, 28 Apr 2011 08:00:56 -0700 (PDT) Received: from ossumpossum.geop.uc.edu ([129.137.163.68]) by mx.google.com with ESMTPS id vr5sm669293icb.12.2011.04.28.08.00.54 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 28 Apr 2011 08:00:55 -0700 (PDT) Date: Thu, 28 Apr 2011 11:01:10 -0400 From: Adam Stylinski To: Mike Tancsa Message-ID: <20110428150110.GG2800@ossumpossum.geop.uc.edu> References: <20110428072946.GA11391@zephyr.adamsnet> <4DB965D8.7090906@sentex.net> <20110428132922.GC2800@ossumpossum.geop.uc.edu> <4DB96DDD.4070801@sentex.net> <20110428141500.GE2800@ossumpossum.geop.uc.edu> <4DB97A07.2020606@sentex.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="/Zw+/jwnNHcBRYYu" Content-Disposition: inline In-Reply-To: <4DB97A07.2020606@sentex.net> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-net@freebsd.org Subject: Re: em0 performance subpar X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2011 15:01:06 -0000 --/Zw+/jwnNHcBRYYu Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Apr 28, 2011 at 10:30:31AM -0400, Mike Tancsa wrote: > On 4/28/2011 10:15 AM, Adam Stylinski wrote: >=20 > >=20 > > em0: port 0xe800-0x= e83f mem 0xfe9e0000-0xfe9fffff,0xfe9c0000-0xfe9dffff irq 20 at device 5.0 o= n pci7 > > em0: [FILTER] >=20 > I am not sure the newer driver will help performance wise. It might fix > that bug you saw at least. Jack from intel might be able to shed some > light on it. In the mean time, try generating traffic via netblast. > Another tool I find helpful in narrowing down tcp performance > differences is netperf >=20 > ---Mike >=20 >=20 > --=20 > ------------------- > Mike Tancsa, tel +1 519 651 3400 > Sentex Communications, mike@sentex.net > Providing Internet services since 1994 www.sentex.net > Cambridge, Ontario Canada http://www.tancsa.com/ =2E/netblast 192.168.0.121 5001 32768 30 start: 1304002549.184689025 finish: 1304002579.187555311 send calls: 2163162 send errors: 2095950 approx send rate: 2240 approx error rate: 0 ? This output is a bit cryptic but from what I think I understand from the = source code it's the number of successful sends of the payload size in 30 s= econds. =20 So to do the math:=20 (32768*2210)/(1024*1024) 69.06250000000000000000MB/sec? This is still only saturating about half th= e link speed. --=20 Adam Stylinski PGP Key: http://pohl.ececs.uc.edu/~adam/publickey.pub Blog: http://technicallyliving.blogspot.com --/Zw+/jwnNHcBRYYu Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.17 (FreeBSD) iQIcBAEBAgAGBQJNuYE2AAoJED6sRHE6TvmnndsP/1hPqPDI8TjXXEpndGX3ozIi 5rIerbED/+WpoIsj0cR45/aOl34X2F0UQLrOd/i15i5glCvQqo08ZzX0XNX3A1Db lKDIq/HLcndu5YH+UNkuhnwufj204c2zcTmvAnFd0PrZhTgpMN+I+hFDbnFbcy59 rqyGqdUUSaBEIPWJyiv8GT/jT7/gdGShyrqZPxQcg63xOUiFVcN2JzWXtA8mJWfS 8GvEchSHVc3iLeKUMhLkMpnE9C2dRRNdhFdJUV2c5uVlDxCKx1nj2fPAiVSkCLT6 HCJBjxL6oM8Whi830jabMCXgPVJCPavDI1f8JlzsH1GXl+ebz2fej+aPmwZ3PHDy S2p40x6egTfTzu2eEfX8+VovFJrEe8fxc8agEB/jvmvShiHgHgYjuSmcocFaUgR4 HGKxJj9Vq1T9QjNRt8tEJg9madxhoD3rf3apouDJaoMC6GrQBwhWiKF278HKSLR3 TX35KIrV5nAwbcKsdvwcsaUg7egP18xpl4QeHZaqDwkWRm7AMQA6sHKMoBHP8qwu KbpyZqjzYsPM7mV2Li3yCBbhVEVDmpMY5b/29ck/Chqi3ArAIFABbKzR1RT6vPyp s0FhEabm+oJkdX+YzyIKNBfRaKN14mUq28UjoGMVHjwA0rBN0IwYVE7Bg4nOgCQH ZofFmQ6Gmx6nPPUZZVKB =kgnd -----END PGP SIGNATURE----- --/Zw+/jwnNHcBRYYu-- From owner-freebsd-net@FreeBSD.ORG Thu Apr 28 15:11:00 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D3E46106566C for ; Thu, 28 Apr 2011 15:11:00 +0000 (UTC) (envelope-from prvs=10995192f0=killing@multiplay.co.uk) Received: from mail1.multiplay.co.uk (mail1.multiplay.co.uk [85.236.96.23]) by mx1.freebsd.org (Postfix) with ESMTP id 688538FC12 for ; Thu, 28 Apr 2011 15:11:00 +0000 (UTC) X-MDAV-Processed: mail1.multiplay.co.uk, Thu, 28 Apr 2011 16:10:36 +0100 X-Spam-Processed: mail1.multiplay.co.uk, Thu, 28 Apr 2011 16:10:36 +0100 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on mail1.multiplay.co.uk X-Spam-Level: X-Spam-Status: No, score=-5.0 required=6.0 tests=USER_IN_WHITELIST shortcircuit=ham autolearn=disabled version=3.2.5 Received: from r2d2 ([188.220.16.49]) by mail1.multiplay.co.uk (mail1.multiplay.co.uk [85.236.96.23]) (MDaemon PRO v10.0.4) with ESMTP id md50013097438.msg for ; Thu, 28 Apr 2011 16:10:35 +0100 X-MDRemoteIP: 188.220.16.49 X-Return-Path: prvs=10995192f0=killing@multiplay.co.uk X-Envelope-From: killing@multiplay.co.uk X-MDaemon-Deliver-To: freebsd-net@freebsd.org Message-ID: <41EE7AB832F24194AC8730544E1C2EB7@multiplay.co.uk> From: "Steven Hartland" To: "Adam Stylinski" References: <20110428072946.GA11391@zephyr.adamsnet> <4DB965D8.7090906@sentex.net> <20110428141339.GD2800@ossumpossum.geop.uc.edu> <20110428144513.GF2800@ossumpossum.geop.uc.edu> Date: Thu, 28 Apr 2011 16:08:31 +0100 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="iso-8859-1"; reply-type=original Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.5931 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.6090 Cc: freebsd-net@freebsd.org Subject: Re: em0 performance subpar X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2011 15:11:00 -0000 You said your testing with iperf, what settings are you using? Flow control is not flowtable no, which could still result in a switch "issue" if linux and freebsd are setting different values by default, similarly with duplex / speed, I would recommend autoneg if your not already using. Have you tried without tso, rxcsum, txcsum & lro disabled? ----- Original Message ----- From: "Adam Stylinski" To: "Steven Hartland" Cc: Sent: Thursday, April 28, 2011 3:45 PM Subject: Re: em0 performance subpar I was using the default value for maxsockbuf, doesn't seem to hurt or help. The only value you've listed that I didn't have tweaked to a comparable value already was the nmbclusters, changing it seems to have no effect, though. vmstat -i should display my interrupts, which I don't think are particularly high. I am most definitely not CPU bound (utilization shows no hot CPUs), I have 16GB of memory and plenty allocated to the kernel, and I believe flow control is enabled (should it not be?): net.inet.flowtable.enable: 1 It's a 16 port netgear gigabit prosafe switch, and it's not likely to be the problem (like I said, the Linux hosts have no issues with the same card). ================================================ This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337 or return the E.mail to postmaster@multiplay.co.uk. From owner-freebsd-net@FreeBSD.ORG Thu Apr 28 15:21:58 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BC30E106564A for ; Thu, 28 Apr 2011 15:21:58 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1-6.sentex.ca [IPv6:2607:f3e0:0:1::12]) by mx1.freebsd.org (Postfix) with ESMTP id 5D6E98FC16 for ; Thu, 28 Apr 2011 15:21:58 +0000 (UTC) Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a]) by smarthost1.sentex.ca (8.14.4/8.14.4) with ESMTP id p3SFLu1C081145 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Thu, 28 Apr 2011 11:21:56 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <4DB985FC.4000704@sentex.net> Date: Thu, 28 Apr 2011 11:21:32 -0400 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.13) Gecko/20101207 Thunderbird/3.1.7 MIME-Version: 1.0 To: Adam Stylinski References: <20110428072946.GA11391@zephyr.adamsnet> <4DB965D8.7090906@sentex.net> <20110428132922.GC2800@ossumpossum.geop.uc.edu> <4DB96DDD.4070801@sentex.net> <20110428141500.GE2800@ossumpossum.geop.uc.edu> <4DB97A07.2020606@sentex.net> <20110428150110.GG2800@ossumpossum.geop.uc.edu> In-Reply-To: <20110428150110.GG2800@ossumpossum.geop.uc.edu> X-Enigmail-Version: 1.1.1 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.67 on IPv6:2607:f3e0:0:1::12 Cc: freebsd-net@freebsd.org Subject: Re: em0 performance subpar X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2011 15:21:58 -0000 On 4/28/2011 11:01 AM, Adam Stylinski wrote: > > ./netblast 192.168.0.121 5001 32768 30 > > start: 1304002549.184689025 > finish: 1304002579.187555311 > send calls: 2163162 > send errors: 2095950 > approx send rate: 2240 > approx error rate: 0 > > ? This output is a bit cryptic but from what I think I understand from the source code it's the number of successful sends of the payload size in 30 seconds. > > So to do the math: > (32768*2210)/(1024*1024) > 69.06250000000000000000MB/sec? This is still only saturating about half the link speed. Just to be clear, you have something listening on the other side on port 5001 right ? ie on 192.168.0.121, you did a ./netreceive 5001... And the payload is.... 32768 ?!? Try something that does not need fragmentation and is within your max MTU. e.g. 500 byte frames should saturate a gigabit link. Watch it in real time with something like ifstat ./netblast 192.168.0.121 5001 500 5 ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-net@FreeBSD.ORG Thu Apr 28 15:23:45 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0A3821065676 for ; Thu, 28 Apr 2011 15:23:45 +0000 (UTC) (envelope-from kungfujesus06@gmail.com) Received: from mail-fx0-f54.google.com (mail-fx0-f54.google.com [209.85.161.54]) by mx1.freebsd.org (Postfix) with ESMTP id 856688FC1D for ; Thu, 28 Apr 2011 15:23:44 +0000 (UTC) Received: by fxm11 with SMTP id 11so2711246fxm.13 for ; Thu, 28 Apr 2011 08:23:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=lBE++23NUknDpEYIoznIDC/Z/Flf12tZy8pwXwzKYoE=; b=HLVutzeztbhO4U6JzBEzJK57REtYHiDzYxv8xpDviGdEIdmkes3Iq3bL83Mk+NKMoo mvfkyLKhe4STDvTzv4+8X6Pl7QtKh2N8JrL78Jlcl1KCjk8cvP3EBlucMePBCzngDCA2 1sYz3CMHjop6vwm4PYSYYObRDWsqfFogto728= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=GkCNn1NjKCD8+29MBj7Uv7t5UOabPKR/OOz75NtN0jN6SQN17Wi2XJl47OBTxeRVyN 0FGsyYcO1m/VucrW2yRZaRQnPQbOTRNYP4WOSWpP6lFRae+u4svrSIhBJidVeAeIZZoH ezumXavXNa07EgW24k10RzRHF43N9CO7jc97I= MIME-Version: 1.0 Received: by 10.223.48.139 with SMTP id r11mr2397045faf.63.1304004223437; Thu, 28 Apr 2011 08:23:43 -0700 (PDT) Received: by 10.223.104.3 with HTTP; Thu, 28 Apr 2011 08:23:43 -0700 (PDT) In-Reply-To: <20110428152141.GA19362@ossumpossum.geop.uc.edu> References: <20110428072946.GA11391@zephyr.adamsnet> <4DB965D8.7090906@sentex.net> <20110428141339.GD2800@ossumpossum.geop.uc.edu> <20110428144513.GF2800@ossumpossum.geop.uc.edu> <41EE7AB832F24194AC8730544E1C2EB7@multiplay.co.uk> <20110428152141.GA19362@ossumpossum.geop.uc.edu> Date: Thu, 28 Apr 2011 11:23:43 -0400 Message-ID: From: Adam Stylinski To: freebsd-net@freebsd.org Content-Type: multipart/mixed; boundary=00151747b8d8860d8404a1fc24e6 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: Fwd: em0 performance subpar X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2011 15:23:45 -0000 --00151747b8d8860d8404a1fc24e6 Content-Type: text/plain; charset=ISO-8859-1 ---------- Forwarded message ---------- From: Adam Stylinski Date: Thu, Apr 28, 2011 at 11:21 AM Subject: Re: em0 performance subpar To: Steven Hartland On Thu, Apr 28, 2011 at 04:08:31PM +0100, Steven Hartland wrote: > You said your testing with iperf, what settings are you using? > > Flow control is not flowtable no, which could still result in > a switch "issue" if linux and freebsd are setting different > values by default, similarly with duplex / speed, I would recommend > autoneg if your not already using. > > Have you tried without tso, rxcsum, txcsum & lro disabled? > > > ----- Original Message ----- > From: "Adam Stylinski" > To: "Steven Hartland" > Cc: > Sent: Thursday, April 28, 2011 3:45 PM > Subject: Re: em0 performance subpar > > I was using the default value for maxsockbuf, doesn't seem to hurt or help. The only value you've listed that I didn't have > tweaked to a comparable value already was the nmbclusters, changing it seems to have no effect, though. vmstat -i should display > my interrupts, which I don't think are particularly high. I am most definitely not CPU bound (utilization shows no hot CPUs), I > have 16GB of memory and plenty allocated to the kernel, and I believe flow control is enabled (should it not be?): > net.inet.flowtable.enable: 1 > > It's a 16 port netgear gigabit prosafe switch, and it's not likely to be the problem (like I said, the Linux hosts have no issues > with the same card). > > > ================================================ > This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. > > In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337 > or return the E.mail to postmaster@multiplay.co.uk. > Just using the default settings with iperf. Netblast is giving me similar results. Disabling TCP checksum offloading (transmit and receive) and large receive offload have zero effect. -- Adam Stylinski PGP Key: http://pohl.ececs.uc.edu/~adam/publickey.pub Blog: http://technicallyliving.blogspot.com --00151747b8d8860d8404a1fc24e6 Content-Type: application/pgp-signature Content-Disposition: attachment Content-Transfer-Encoding: base64 X-Attachment-Id: 256c4d377f3bd414_0.1 LS0tLS1CRUdJTiBQR1AgU0lHTkFUVVJFLS0tLS0KVmVyc2lvbjogR251UEcgdjIuMC4xNyAoRnJl ZUJTRCkKCmlRSWNCQUVCQWdBR0JRSk51WVlGQUFvSkVENnNSSEU2VHZtbkppWVFBTXlHMytFZ0s2 UWtpdlpzNFlJUnJGTHMKNTRDbGpOWnJya3M3aHUyRWFUWUt3Wko0dGRpUEtadlg4eE0yWEU3NXZp Zzh3ZzBnV3htMEpvQ3lOaW9uM25pYgo3UVFUeGE4bUJnZkE5NGlxTTRoaFhhU05QRXFMRUF3eG1H NGgzMlovODM4ZGlUN3o2ZUI1aWJQTjYzMURJNTJ0CkRwMytJZHhTdjNnZTdNZjM1aTRJTXdaRzJX eWc3L1UzUFFoOHJ6K2Flayt6K2ZLZmtHa3lVSDBHVVNxVHpDY2QKNTZEak1YZkdoUFllcVdzQ3Fp ZHNIWFE3WVRVb1RPcTl1REJnRmVMQ3JTUjlCMW1ELzBhU0VIVzdocUhwVGJ1UQp3SGQ4eU95enA1 Z1J3Z3FCSUZRYUxPZHJPRy90M1g5VGZTVzQvOEhpUjZXUFByYjhydTF4UG5JTDJndE9OQVpiClNU VFBtTUdDSzVPTWJ5djB1YVNTaFI0WkZQbk13cVptcEFVYWkyRWhQdVpXZTNDMms2R1FBR1ExZkV6 eDhDSzUKRUpEWFpQakVlR1RXclgzQXlTT2tEclF5QTdTQ2RxVHQ2TVFxMlkyZ3F2TUNRM0I2UmlP RnJmRStRTlIwenhVMwowZk9SMmFlK3Y5N1ZuTUlOSTFNUk1lTmxwRmZ5S2p1djFNRThEb0hXb1Bv aUs3Z3p3K3VlYjhnUUN3eTNWbUlzCkpjRThqNGZyeEZ3blRnMUJKbmRUWXpZeXFtZTFCQkpibjcy QW5BMnlZTWtpU3g0ZW9KM0hKNVlLa1VJYThGYmcKYTU5elVxUFNhNUJ0c05sZkNhVnd2TGtmWGNo MXhzUWpZK1ZETFRFbXZZSUNDUGNrYllBdHAyUUozTHk3YlhsaQpURHVOS0h1SG9KSW5kYlJQZElX Tgo9RHR4bwotLS0tLUVORCBQR1AgU0lHTkFUVVJFLS0tLS0K --00151747b8d8860d8404a1fc24e6-- From owner-freebsd-net@FreeBSD.ORG Thu Apr 28 15:27:27 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 675A6106566B for ; Thu, 28 Apr 2011 15:27:27 +0000 (UTC) (envelope-from kungfujesus06@gmail.com) Received: from mail-iw0-f182.google.com (mail-iw0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id 251678FC12 for ; Thu, 28 Apr 2011 15:27:26 +0000 (UTC) Received: by iwn33 with SMTP id 33so3210685iwn.13 for ; Thu, 28 Apr 2011 08:27:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:date:from:to:cc:subject:message-id:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=yh5EdQS+KnjNGniRRD+P5vv6LtiABzlZd5ypyvI1r30=; b=RnKsuPsd9tRigZwJZVyT5fcG4y/0X3lEIIi+WM6ADsrTzQFxk8KdHYGk5TsOiT7URn 3nv+QAROATr1/GjI4R60lFevF+2u4kDxmO8D3trhw+y1I8dZvIQwFzkKvOVWolV9/bDJ NjSe2FVVFuXMi0C7LKQNEzFlUXtJiwFRE7V+w= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; b=kLsuVMVKaSNhDAh7HmELVp8s9Xs4qdleVbPb845nkQ1TOaaEUGzlunqlPwmHc7sdOo 9xWKeO1aloRPIhYCkB+0VzA7XnmC7Sw1e1z8Y9VTg7irf4FSqSoTF/hH/o35wUDKQ009 sUfa6Faln+2Ot0yghhvIIkuKeawYE+pnDUHCw= Received: by 10.42.40.211 with SMTP id m19mr4316629ice.190.1304004446459; Thu, 28 Apr 2011 08:27:26 -0700 (PDT) Received: from ossumpossum.geop.uc.edu ([129.137.163.68]) by mx.google.com with ESMTPS id f28sm751365ibh.16.2011.04.28.08.27.24 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 28 Apr 2011 08:27:25 -0700 (PDT) Date: Thu, 28 Apr 2011 11:27:40 -0400 From: Adam Stylinski To: Mike Tancsa Message-ID: <20110428152740.GB19362@ossumpossum.geop.uc.edu> References: <20110428072946.GA11391@zephyr.adamsnet> <4DB965D8.7090906@sentex.net> <20110428132922.GC2800@ossumpossum.geop.uc.edu> <4DB96DDD.4070801@sentex.net> <20110428141500.GE2800@ossumpossum.geop.uc.edu> <4DB97A07.2020606@sentex.net> <20110428150110.GG2800@ossumpossum.geop.uc.edu> <4DB985FC.4000704@sentex.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="tjCHc7DPkfUGtrlw" Content-Disposition: inline In-Reply-To: <4DB985FC.4000704@sentex.net> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-net@freebsd.org Subject: Re: em0 performance subpar X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2011 15:27:27 -0000 --tjCHc7DPkfUGtrlw Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Apr 28, 2011 at 11:21:32AM -0400, Mike Tancsa wrote: > On 4/28/2011 11:01 AM, Adam Stylinski wrote: > >=20 > > ./netblast 192.168.0.121 5001 32768 30 > >=20 > > start: 1304002549.184689025 > > finish: 1304002579.187555311 > > send calls: 2163162 > > send errors: 2095950 > > approx send rate: 2240 > > approx error rate: 0 > >=20 > > ? This output is a bit cryptic but from what I think I understand from = the source code it's the number of successful sends of the payload size in = 30 seconds. =20 > >=20 > > So to do the math:=20 > > (32768*2210)/(1024*1024) > > 69.06250000000000000000MB/sec? This is still only saturating about hal= f the link speed. >=20 > Just to be clear, you have something listening on the other side on port > 5001 right ? ie on 192.168.0.121, you did a ./netreceive 5001... And > the payload is.... 32768 ?!? Try something that does not need > fragmentation and is within your max MTU. e.g. 500 byte frames should > saturate a gigabit link. >=20 > Watch it in real time with something like ifstat >=20 > ./netblast 192.168.0.121 5001 500 5 >=20 > ---Mike >=20 >=20 >=20 >=20 > --=20 > ------------------- > Mike Tancsa, tel +1 519 651 3400 > Sentex Communications, mike@sentex.net > Providing Internet services since 1994 www.sentex.net > Cambridge, Ontario Canada http://www.tancsa.com/ Listening with iperf on the other end. The receiving end is a Linux machin= e, but the code looks to be mainly portable socket code so let me compile n= etreceive on the linux box and give you the results. --=20 Adam Stylinski PGP Key: http://pohl.ececs.uc.edu/~adam/publickey.pub Blog: http://technicallyliving.blogspot.com --tjCHc7DPkfUGtrlw Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.17 (FreeBSD) iQIcBAEBAgAGBQJNuYdsAAoJED6sRHE6TvmnbAgQAM3Cp2FgAc2EQW1ZKBSNOOiK a6srQTqT8E+ajW9vYbL3ZVMSJ0NHGlVHH4VBJaAIB2yvLmbmELqIMp7Ko4Huww6U bppjOH81gnn4nlPFR31e4OpxeLP+Er0aZMZ6BdB54TvpG6SrdatZJN9MXoynjkCd QtjA8BwVDwR7okA2XGQQfCGAKVZTOTCoEo/1BezizLe2cdKo3SR3gOojJCPUQBDF wKP05KL8l5SsQN+gARnEPM9MbpsXR8Ye2qeKCT8lwlns27LJNSnq/A3YzTJQjT/R Ez+2DAL2bcvzQshesVIgr8qpaB0Min5hYcQvnm4RmDl78SUhvMtWliE2ms0AIoVm /4jhcojCqvKiTmLPRooTgjjUerLz6c3beKb/KDI4SnfuP6iqOaXJ+TLJa8H0ZAZV wfpXvP1eCa2cygMW2HpuirkPL7a+oZwmCJ6gj8y57LTbJ1fmvdYn1dhm2AuGibrx d1mD/LHfGPAswIHPreH93NhFdyeV/6IfhlslDn2nhgfkFqMbAFpTx4x5VEiU+lil vCoLAsZMQ13HSZTtaG/ehNyHvsn5nMPZ17OilDu7dqTHLY2Iv2GcnJ1Yva/xyo9M q6kzJc/GewkWKTsMzJHuQZzWXY2YmjCwaaOH6FLp3H1sHJFunsFRCrDL12RvqVf2 5XzZlP7DbD222aSdDpLr =5jgC -----END PGP SIGNATURE----- --tjCHc7DPkfUGtrlw-- From owner-freebsd-net@FreeBSD.ORG Thu Apr 28 15:35:26 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3A7FA106564A for ; Thu, 28 Apr 2011 15:35:26 +0000 (UTC) (envelope-from kungfujesus06@gmail.com) Received: from mail-iw0-f182.google.com (mail-iw0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id EC6658FC1A for ; Thu, 28 Apr 2011 15:35:25 +0000 (UTC) Received: by iwn33 with SMTP id 33so3219614iwn.13 for ; Thu, 28 Apr 2011 08:35:25 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:date:from:to:cc:subject:message-id:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=bjoZzvuF9jC/9UEDNAvSTgtx+q01L1iKeVdmUP4cGdk=; b=ax5ZUuawre2Q+IUBLDYpCJcXGiOfkXRYq2x/mdbO7NTy79cSqwlT7wQGkxBLWiDeAH //V2nCJHCbkf7Ag9D99cGqz+7tG2WuL1gwqrbfKWm59oK56Aqu63iS93E51Ch4Ynm3KH tyM8qZtbQusb8594L+Am31Y5rTQIbyNzrNcyU= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; b=ChkvdTDv5Kfl9HaEVYrcDS9O6Yqlq1phkDr8BOoltA27KcJ4K9KD4yWnqS/tP3mtsO 5DTnWsm6/+SpNQfYri6ahcuyD/2e0EZItEf3KaAeHvt1as0OMI03hRPnxLnHuXFWXIys Xdzajmk8uojYoTdVkdoM+s5dQ+K8zIW/q/9I4= Received: by 10.42.115.199 with SMTP id l7mr4246883icq.308.1304004925173; Thu, 28 Apr 2011 08:35:25 -0700 (PDT) Received: from ossumpossum.geop.uc.edu ([129.137.163.68]) by mx.google.com with ESMTPS id 19sm754796ibx.1.2011.04.28.08.35.22 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 28 Apr 2011 08:35:23 -0700 (PDT) Date: Thu, 28 Apr 2011 11:35:39 -0400 From: Adam Stylinski To: Mike Tancsa Message-ID: <20110428153539.GC19362@ossumpossum.geop.uc.edu> References: <20110428072946.GA11391@zephyr.adamsnet> <4DB965D8.7090906@sentex.net> <20110428132922.GC2800@ossumpossum.geop.uc.edu> <4DB96DDD.4070801@sentex.net> <20110428141500.GE2800@ossumpossum.geop.uc.edu> <4DB97A07.2020606@sentex.net> <20110428150110.GG2800@ossumpossum.geop.uc.edu> <4DB985FC.4000704@sentex.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="lCAWRPmW1mITcIfM" Content-Disposition: inline In-Reply-To: <4DB985FC.4000704@sentex.net> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-net@freebsd.org Subject: Re: em0 performance subpar X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2011 15:35:26 -0000 --lCAWRPmW1mITcIfM Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Apr 28, 2011 at 11:21:32AM -0400, Mike Tancsa wrote: > On 4/28/2011 11:01 AM, Adam Stylinski wrote: > >=20 > > ./netblast 192.168.0.121 5001 32768 30 > >=20 > > start: 1304002549.184689025 > > finish: 1304002579.187555311 > > send calls: 2163162 > > send errors: 2095950 > > approx send rate: 2240 > > approx error rate: 0 > >=20 > > ? This output is a bit cryptic but from what I think I understand from = the source code it's the number of successful sends of the payload size in = 30 seconds. =20 > >=20 > > So to do the math:=20 > > (32768*2210)/(1024*1024) > > 69.06250000000000000000MB/sec? This is still only saturating about hal= f the link speed. >=20 > Just to be clear, you have something listening on the other side on port > 5001 right ? ie on 192.168.0.121, you did a ./netreceive 5001... And > the payload is.... 32768 ?!? Try something that does not need > fragmentation and is within your max MTU. e.g. 500 byte frames should > saturate a gigabit link. >=20 > Watch it in real time with something like ifstat >=20 > ./netblast 192.168.0.121 5001 500 5 >=20 > ---Mike >=20 >=20 >=20 >=20 > --=20 > ------------------- > Mike Tancsa, tel +1 519 651 3400 > Sentex Communications, mike@sentex.net > Providing Internet services since 1994 www.sentex.net > Cambridge, Ontario Canada http://www.tancsa.com/ k so during the transmission ifstat reported: 0.53 44266.87 0.23 62788.56 0.06 62774.17 0.00 62774.26 0.00 62774.95 0.40 19482.25 And the rate output of netblast (using as suggested the parameters above): 119091 This is about 454mbps. Still way slower than it ought to be. --=20 Adam Stylinski PGP Key: http://pohl.ececs.uc.edu/~adam/publickey.pub Blog: http://technicallyliving.blogspot.com --lCAWRPmW1mITcIfM Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.17 (FreeBSD) iQIcBAEBAgAGBQJNuYlKAAoJED6sRHE6TvmnCmwQAI3OnXy4q1x+dzxDGOrbSbcG D2nz9rEn94nsud+k+8CvNB/1GAlQ5HU+IgASeUISRbMQ6ewzVcOTT/eECtCiZF8g azuFS0Feliq0x5VsVs3iydX4i0uUIQt824y9m+1B32pupB0PABhoWyEzxCGVXzo/ tfIBNVohPR7i1g1+LfKKb3DfNQAJh2ZndCdZ3LvFfRFa+VtesBucAKy6W/EbclHR 3AlFHCcZLYhGCCrcH6h6xAgyTaG2kXY7GKmBZUJwu89FswwAQbBPJBrznDE8R3hm ZVq7xAf/v/x06DuezR4HKxCCmBuN7FD0XTXJWPm/de0ZFSAdbr9GLI9vpRg8NX7a OxopCYQy9mMt9afxyZPosVQgN+698i75MxgCQKK2ZrGW1zM/fe09sJlJ9JVpPDyJ wUekYYF/1pvA9iqSiIdASv/0GB0k04filrryiirWEiu36rDy5InJca+49614xg3T T0jwYcBgkmwuV2NVjZqYD8rvnAiANOTohKhmGJqp48Lypkpd8MVyzZzCZFR50qg1 M9Z6ccTFymn5Uap+K3LBS5v8jmJwFl+1nitHnfl/UVpzm1vrXCWy2US1Gi2yoRVV WI69lx0kOlMhGw41eP25lSGa+XBpUaDMgjJM9lvrR5jdQqwWKsAyrir3W0EeCQzL f4RH1Oj7gL3r4jZoc9ij =ake4 -----END PGP SIGNATURE----- --lCAWRPmW1mITcIfM-- From owner-freebsd-net@FreeBSD.ORG Thu Apr 28 15:41:22 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 86BF5106564A for ; Thu, 28 Apr 2011 15:41:22 +0000 (UTC) (envelope-from jfvogel@gmail.com) Received: from mail-gw0-f54.google.com (mail-gw0-f54.google.com [74.125.83.54]) by mx1.freebsd.org (Postfix) with ESMTP id 3BF208FC13 for ; Thu, 28 Apr 2011 15:41:21 +0000 (UTC) Received: by gwb15 with SMTP id 15so1407725gwb.13 for ; Thu, 28 Apr 2011 08:41:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=Pbm2S4+f761ULFDWaR2xeV+LHjkPDOa/ifo+OPl+Vpw=; b=nFopXahYWzauIx4FJt9JwOx98/J5pzF3njNP94VsXbvA7IH7yguPR1k8l7BE5qjGTe 7h0SY7W6bIwASj5spXIroTPt3gz5ZD1hdwS7pbyIrx+YDfJrUf6ojlKfN4dFYHqf0CKK FhkH9KnYKfEw2agm65zrWStml7wQBqr4IITFI= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=jo9527kSsliZuLbtllQ63Fpk+IHNjXD3FtCLM0eeLs5WVotT+LGofnVh0uCG7UbspA E27WDV+E8SGmIfWcgztGlRJ1W5+WndVVDHujaY33ySrl35sUzMrOU3Duct3JHU3MxdMG qqOGjjRF2f6/KTa6w5hZ02g04OtwnQPntRf7A= MIME-Version: 1.0 Received: by 10.150.230.2 with SMTP id c2mr630655ybh.268.1304005281390; Thu, 28 Apr 2011 08:41:21 -0700 (PDT) Received: by 10.150.133.13 with HTTP; Thu, 28 Apr 2011 08:41:21 -0700 (PDT) In-Reply-To: <20110428153539.GC19362@ossumpossum.geop.uc.edu> References: <20110428072946.GA11391@zephyr.adamsnet> <4DB965D8.7090906@sentex.net> <20110428132922.GC2800@ossumpossum.geop.uc.edu> <4DB96DDD.4070801@sentex.net> <20110428141500.GE2800@ossumpossum.geop.uc.edu> <4DB97A07.2020606@sentex.net> <20110428150110.GG2800@ossumpossum.geop.uc.edu> <4DB985FC.4000704@sentex.net> <20110428153539.GC19362@ossumpossum.geop.uc.edu> Date: Thu, 28 Apr 2011 08:41:21 -0700 Message-ID: From: Jack Vogel To: Adam Stylinski Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-net@freebsd.org, Mike Tancsa Subject: Re: em0 performance subpar X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2011 15:41:22 -0000 Just in case anyone did not notice, this adapter is actually using the legacy subdevice, ie lem, there has been little focus on that code, things that are not even PCI Express are becoming pretty elderly. Let me look this thread over in a bit more detail after I get into the office in a bit... Jack On Thu, Apr 28, 2011 at 8:35 AM, Adam Stylinski wrote: > On Thu, Apr 28, 2011 at 11:21:32AM -0400, Mike Tancsa wrote: > > On 4/28/2011 11:01 AM, Adam Stylinski wrote: > > > > > > ./netblast 192.168.0.121 5001 32768 30 > > > > > > start: 1304002549.184689025 > > > finish: 1304002579.187555311 > > > send calls: 2163162 > > > send errors: 2095950 > > > approx send rate: 2240 > > > approx error rate: 0 > > > > > > ? This output is a bit cryptic but from what I think I understand from > the source code it's the number of successful sends of the payload size in > 30 seconds. > > > > > > So to do the math: > > > (32768*2210)/(1024*1024) > > > 69.06250000000000000000MB/sec? This is still only saturating about > half the link speed. > > > > Just to be clear, you have something listening on the other side on port > > 5001 right ? ie on 192.168.0.121, you did a ./netreceive 5001... And > > the payload is.... 32768 ?!? Try something that does not need > > fragmentation and is within your max MTU. e.g. 500 byte frames should > > saturate a gigabit link. > > > > Watch it in real time with something like ifstat > > > > ./netblast 192.168.0.121 5001 500 5 > > > > ---Mike > > > > > > > > > > -- > > ------------------- > > Mike Tancsa, tel +1 519 651 3400 > > Sentex Communications, mike@sentex.net > > Providing Internet services since 1994 www.sentex.net > > Cambridge, Ontario Canada http://www.tancsa.com/ > > k so during the transmission ifstat reported: > > 0.53 44266.87 > 0.23 62788.56 > 0.06 62774.17 > 0.00 62774.26 > 0.00 62774.95 > 0.40 19482.25 > > And the rate output of netblast (using as suggested the parameters above): > 119091 > > This is about 454mbps. Still way slower than it ought to be. > > -- > Adam Stylinski > PGP Key: http://pohl.ececs.uc.edu/~adam/publickey.pub > Blog: http://technicallyliving.blogspot.com > From owner-freebsd-net@FreeBSD.ORG Thu Apr 28 15:51:11 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 18863106564A for ; Thu, 28 Apr 2011 15:51:11 +0000 (UTC) (envelope-from kungfujesus06@gmail.com) Received: from mail-iw0-f182.google.com (mail-iw0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id CCFE28FC12 for ; Thu, 28 Apr 2011 15:51:10 +0000 (UTC) Received: by iwn33 with SMTP id 33so3238733iwn.13 for ; Thu, 28 Apr 2011 08:51:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:date:from:to:cc:subject:message-id:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=wMeGT/h6izQBIrtA15dV6AwZGwmKcOO4Cmz/D3NG9qQ=; b=HTHXMjn0/IY7cg9AbOKYvj8v6NzdGIgMRW1FIAc2ih4t9RJLYzz9leKlpKU3yMtJXu IkAnaLkrZXX7dnD93Ry+iAod1hbVGRNSSv1VQSgDgIr3QJgw+oECwxobLkvdTSrjFZAw ttG1y3TtqVvNQp37503uMCeHI0Qvc4pF2RgKw= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; b=AZzRUJlse4MjBtEqdWiBd/f8dWfR/i6QmK2r/jnp70uWQ47Yh39qKa+zTL8jkL8m4d J1bMBo2v/jOAjGWDhtnF6z19BKa/u0DcR2KcZG+3XpiiPuj7meSV4LVpvOpiFUoFibS5 gM0vJNEToVWcdbPRb95QpJ512ZLKETxKtB1Y4= Received: by 10.42.100.204 with SMTP id b12mr4423020ico.18.1304005869976; Thu, 28 Apr 2011 08:51:09 -0700 (PDT) Received: from ossumpossum.geop.uc.edu ([129.137.163.68]) by mx.google.com with ESMTPS id uf10sm685870icb.5.2011.04.28.08.51.08 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 28 Apr 2011 08:51:09 -0700 (PDT) Date: Thu, 28 Apr 2011 11:51:24 -0400 From: Adam Stylinski To: Pierre Lamy Message-ID: <20110428155124.GD19362@ossumpossum.geop.uc.edu> References: <20110428072946.GA11391@zephyr.adamsnet> <4DB961EA.4080407@userid.org> <20110428132513.GB2800@ossumpossum.geop.uc.edu> <4DB994E7.9060805@userid.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="FFoLq8A0u+X9iRU8" Content-Disposition: inline In-Reply-To: <4DB994E7.9060805@userid.org> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-net@freebsd.org Subject: Re: em0 performance subpar X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2011 15:51:11 -0000 --FFoLq8A0u+X9iRU8 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Apr 28, 2011 at 11:25:11AM -0500, Pierre Lamy wrote: > Someone mentioned on freebsd-current: >=20 > With the 7.2.2 driver you also will use different mbuf pools depending on > > the MTU you are using. If you use jumbo frames it will use 4K clusters, > > if you go to 9K jumbos it will use 9K mbuf clusters. *The number of the= se > > allocated by default is small (like 6400 small :) .* > > > > I would use 'netstat -m' to see what the pools look like. >=20 > Hope this helps. Check the perf with 1500 byte frames. >=20 > Adam Stylinski wrote: > > On Thu, Apr 28, 2011 at 08:47:38AM -0400, Pierre Lamy wrote: > > =20 > >> Try using netblast on FreeBSD instead of iperf, there have been a lot = of=20 > >> discussions about this on this list. > >> > >> Is it possible you're maxing out the system's PCI-xxx bus? Did you tun= e=20 > >> up the system buffers? Data doesn't just get queued up on the NIC=20 > >> driver, it also queues within the system's kernel buffers. Try these, = I=20 > >> have no idea if it will help: > >> > >> sysctl -w net.inet.tcp.sendspace=3D373760 > >> sysctl -w net.inet.tcp.recvspace=3D373760 > >> sysctl -w net.local.stream.sendspace=3D82320 > >> sysctl -w net.local.stream.recvspace=3D82320 > >> sysctl -w net.local.stream.recvspace=3D373760 > >> sysctl -w net.local.stream.sendspace=3D373760 > >> sysctl -w net.raw.recvspace=3D373760 > >> sysctl -w net.raw.sendspace=3D373760 > >> sysctl -w net.inet.tcp.local_slowstart_flightsize=3D10 > >> sysctl -a net.inet.tcp.delayed_ack=3D0 > >> sysctl -w kern.maxvnodes=3D600000 > >> sysctl -w net.local.dgram.recvspace=3D8192 > >> sysctl -w net.local.dgram.maxdgram=3D8192 > >> sysctl -w net.inet.tcp.slowstart_flightsize=3D10 > >> sysctl -w net.inet.tcp.path_mtu_discovery=3D0 > >> > >> They're all tunable while system is running. > >> > >> -Pierre > >> > >> On 4/28/2011 3:29 AM, Adam Stylinski wrote: > >> =20 > >>> Hello, > >>> > >>> I have an intel gigabit network adapter (the 1000 GT w/chipset 82541P= I) which performs poorly in Freebsd compared to the same card in Linux. I'= ve tried this card in two different freebsd boxes and for whatever reason I= get poor transmit performance. I've done all of the tweaking specified in= just about every guide out there (the usual TCP window scaling, larger nmb= clusters, delayed acks, etc) and still I get only around 600mbps. I'm usin= g jumbo frames, with an MTU of 9000. I'm testing this with iperf. While I= realize that this may not be the most realistic test, linux hosts with the= same card can achieve 995Mbit/s to another host running this. When the Fr= eebsd box is the server, Linux hosts can transmit to it at around 800 somet= hing Mbit/s. I've increased the transmit descriptors as specified in the i= f_em man page, and while that gave me 20 or 30 more mbit/s, my transmit per= formance is still below normal. > >>> > >>> sysctl stats report that the card is trigger a lot of tx_desc_fail2: > >>> dev.em.0.tx_desc_fail2: 3431 > >>> > >>> Looking at a comment in the source code this indicates that the card = was not able to obtain enough transmit descriptors (but I've given the card= the maximum of 4096 in my loader.conf tunable). Is this a bug or a perfor= mance regression of some kind? Does anybody have a fix for this? I tried = another card with the same chip in a different box on 8-STABLE to no avail = (the box I'm trying to improve performance on is on 8.2-RELEASE-p1). > >>> > >>> Anybody manage to make this card push above 600mbps in ideal network = benchmarks? Any help would be gladly appreciated. > >>> =20 > >> > >> =20 > > > > I doubt I'm saturating the PCI bus, the only other thing on the bus is = a really really crappy PCI video card. The same card on lesser powerful ma= chines with Linux (Pentium 4) are able to achieve much more throughput, so = it's not likely a bus limitation. > > > > I adjusted the listed sysctl live tunables which I hadn't already compe= nsated for and it didn't seem to have an effect. > > > > =20 >=20 >=20 >=20 I tweaked that, doesn't seem to help. I'd rather not go down to a 1500 byt= e MTU just yet. I may try this later, but most of my network is configured= for jumbo frames. [adam@nasbox ~]$ sysctl kern.ipc.nmbjumbo9 kern.ipc.nmbjumbo9: 12800 --=20 Adam Stylinski PGP Key: http://pohl.ececs.uc.edu/~adam/publickey.pub Blog: http://technicallyliving.blogspot.com --FFoLq8A0u+X9iRU8 Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.17 (FreeBSD) iQIcBAEBAgAGBQJNuYz7AAoJED6sRHE6TvmnoZUP/02iM1WELL0XtWFBu++CHH42 NCjLH3LUVsQW/ief/XoqXt3zvfaPIemRZEi50jAKPbXDcq9t+PCG8vbvE2d+Q2i+ h1zmwbdIgT/x0lqm9U9aaTNpcIXjFUqVS1Qs36HcA31DOMcP4bSakJt+iSZQp9tl TfwLpuH8NojyLDMvZkkEpzX8Rgvc3NmmjSysCLfhnSortjQhiyxCBP0u5IyDHC38 KTB3PPkTeFm3jvXzCRtwRWqeLG/Wzp8I9PdpmoU1cXuVlMqUukEqWjd0NL85dbHL T3QFQChe4KsZ7s/WLF654WZR9QDXDgDmi06i3mD5kWfJf/hhUn05aAbFy8etcYwf gizKccgip4TegIzuIVbkk5Kb/KCI0WsSFQkGBQeQv+YMVXww6N0nnK9GDgxIUtJu cbWNwrOt+RWMCBahZbFvAqB5ffDnD0MLjuRTlWYVlCkjsi6gL+a1sdyYtHqfB+J0 wF1eGmImVHrQqmQo8QTBXn6smaSktGrnByhkwS1TeYigT5RXYtk12tFUCZ5Z6hCV gDSUWsZG38DlXldocRvHv4OEpIA5eGXGr7X7V9n+52qRO6YG6QLumpzOPxpofmhy mImjUaGyzdRk7eHXM8V9DaG5J3DZQkEpMBjRbjftyw0AdlsXByodyDF6tCnrETzI +3QUGoIXfP5Pw0qUq016 =+gSG -----END PGP SIGNATURE----- --FFoLq8A0u+X9iRU8-- From owner-freebsd-net@FreeBSD.ORG Thu Apr 28 16:09:07 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AE6BC106564A for ; Thu, 28 Apr 2011 16:09:07 +0000 (UTC) (envelope-from kungfujesus06@gmail.com) Received: from mail-iy0-f182.google.com (mail-iy0-f182.google.com [209.85.210.182]) by mx1.freebsd.org (Postfix) with ESMTP id 6922D8FC0A for ; Thu, 28 Apr 2011 16:09:07 +0000 (UTC) Received: by iyj12 with SMTP id 12so3288062iyj.13 for ; Thu, 28 Apr 2011 09:09:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:date:from:to:cc:subject:message-id:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=IJ27hXqns60geUMM9Kei6irpFXkotkobH05WUkgEEuM=; b=HyKuTsm4g1m7iK6FOZJnHRNrT88hHFFyFdAVzI+BpUrUJWeHRJCkFUeIDNIn83nBA8 WvHxRSbITXXpi51XlHb3AF+AFUDnPikOla4wa4Vg9mN8NnQoW0jEgFY6sNAOwbOsu9hJ rDYl2huxDvygjqGOs5hpnTOLYU9agidtFpibc= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; b=qAenyTZ+3qiZcPm0+n+D7WTGJnysTtjQ8Wrpztm/kb6wYI6FMcvkMYv3vvQxeDef2p IiYva+kjy3MWSFYubOam4b4QinahaO9nI9b3lGPBUD+ien8RqGbbXX7EkFhbNLWhQBG5 HJyZVCBhro7KYYqYbOBGTvufbBzyQnsFpAaTs= Received: by 10.42.97.66 with SMTP id m2mr4843822icn.515.1304006945290; Thu, 28 Apr 2011 09:09:05 -0700 (PDT) Received: from ossumpossum.geop.uc.edu ([129.137.163.68]) by mx.google.com with ESMTPS id gx2sm763086ibb.9.2011.04.28.09.09.03 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 28 Apr 2011 09:09:03 -0700 (PDT) Date: Thu, 28 Apr 2011 12:09:19 -0400 From: Adam Stylinski To: Steven Hartland Message-ID: <20110428160919.GE19362@ossumpossum.geop.uc.edu> References: <20110428072946.GA11391@zephyr.adamsnet> <4DB965D8.7090906@sentex.net> <20110428141339.GD2800@ossumpossum.geop.uc.edu> <20110428144513.GF2800@ossumpossum.geop.uc.edu> <41EE7AB832F24194AC8730544E1C2EB7@multiplay.co.uk> <20110428152141.GA19362@ossumpossum.geop.uc.edu> <11659E32824B4B1E91B6B219BDEF1234@multiplay.co.uk> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="0QFb0wBpEddLcDHQ" Content-Disposition: inline In-Reply-To: <11659E32824B4B1E91B6B219BDEF1234@multiplay.co.uk> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-net@freebsd.org Subject: Re: em0 performance subpar X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2011 16:09:07 -0000 --0QFb0wBpEddLcDHQ Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Apr 28, 2011 at 04:29:42PM +0100, Steven Hartland wrote: > Try using a large buffer size on iperf and check the flow control options= on the switch. >=20 > ----- Original Message -----=20 > From: "Adam Stylinski" > Just using the default settings with iperf. Netblast is giving me simila= r results. Disabling TCP checksum offloading (transmit=20 > and receive) and large receive offload have zero effect. >=20 > --=20 > Adam Stylinski > PGP Key: http://pohl.ececs.uc.edu/~adam/publickey.pub > Blog: http://technicallyliving.blogspot.com >=20 >=20 >=20 >=20 > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > This e.mail is private and confidential between Multiplay (UK) Ltd. and t= he person or entity to whom it is addressed. In the event of misdirection, = the recipient is prohibited from using, copying, printing or otherwise diss= eminating it or any information contained in it.=20 >=20 > In the event of misdirection, illegible or incomplete transmission please= telephone +44 845 868 1337 > or return the E.mail to postmaster@multiplay.co.uk. >=20 [adam@nasbox ~]$ iperf -m -w 1677216 -l1M -c 192.168.0.121 ------------------------------------------------------------ Client connecting to 192.168.0.121, TCP port 5001 TCP window size: 1.60 MByte (WARNING: requested 1.60 MByte) ------------------------------------------------------------ [ 3] local 192.168.0.60 port 24761 connected with 192.168.0.121 port 5001 [ ID] Interval Transfer Bandwidth [ 3] 0.0-10.0 sec 694 MBytes 581 Mbits/sec [ 3] MSS size 8192 bytes (MTU 8232 bytes, unknown interface) Switch is unmanaged, options are non-existent. --=20 Adam Stylinski PGP Key: http://pohl.ececs.uc.edu/~adam/publickey.pub Blog: http://technicallyliving.blogspot.com --0QFb0wBpEddLcDHQ Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.17 (FreeBSD) iQIcBAEBAgAGBQJNuZEvAAoJED6sRHE6TvmnK7cP/3W64kjIRgi9VHhdTql0dBck ifTEwRb2GoPqJOZbFMwxFkKHI3lWsxGXDldMFuiN6bS0+73SDd7fCho/g3RC/KZg Cx4JoRtpm+vIRPHOWh8iYFMtOWCF1Fof3L8KFX1y1IQB1qvg3jZAFse3IoZgoaK8 s9vEdVCQ/kGApulNmk9mZar7FjyZlOwAL4T1Y6HszAxidrmJDaB6qUhEUnNZVG4o luMs0CzmJYFlGP9dl+MQY9UF5fdJ3qVAtPjQhqHKUKVIBEzo3yEqZa0gHilcAYKq JEBwRYh/dfZbRY6/wRzEVxAU48W/pBaMWPyYo2H4g4rYcuerCHgDnTqL0h8QsB0m 76k1JBTNhQ4JtNEy7txFUmv03f1HxGMAxvgPYFitNJETTMsJ3JlfghicoS3hwh80 gmOgIma+DDvf5o4jsG3B4KvmHeTyDjKrhOJKvzx5CaS+WtfhVmr2sqJGyTJu6Zfa wjWA2KTHwHj49tkD6heEuLsTVmyLtuxm4O+m/HEeEzcYa+Z1pfdGYAJm2cLT9Rs4 ISF78WsXTYbaH4EulHnz5plX3IFxnBIYAfh8ZrZRrQCPIx7VHVY3H2Zis5WcHFUp OhKUxyWQvOvEDKnGrwqAItD6UjDI9ocNMRVAFyvbK2CrurL1ei5FTu7Ouu88nM34 5+6ZOYcyq2aR7+4joPXi =gCvp -----END PGP SIGNATURE----- --0QFb0wBpEddLcDHQ-- From owner-freebsd-net@FreeBSD.ORG Thu Apr 28 16:20:05 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 170BE106566B for ; Thu, 28 Apr 2011 16:20:05 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1-6.sentex.ca [IPv6:2607:f3e0:0:1::12]) by mx1.freebsd.org (Postfix) with ESMTP id A66FF8FC08 for ; Thu, 28 Apr 2011 16:20:04 +0000 (UTC) Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a]) by smarthost1.sentex.ca (8.14.4/8.14.4) with ESMTP id p3SGK3EP093053 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Thu, 28 Apr 2011 12:20:03 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <4DB9939A.3070307@sentex.net> Date: Thu, 28 Apr 2011 12:19:38 -0400 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.13) Gecko/20101207 Thunderbird/3.1.7 MIME-Version: 1.0 To: Adam Stylinski References: <20110428072946.GA11391@zephyr.adamsnet> <4DB965D8.7090906@sentex.net> <20110428132922.GC2800@ossumpossum.geop.uc.edu> <4DB96DDD.4070801@sentex.net> <20110428141500.GE2800@ossumpossum.geop.uc.edu> <4DB97A07.2020606@sentex.net> <20110428150110.GG2800@ossumpossum.geop.uc.edu> <4DB985FC.4000704@sentex.net> <20110428153539.GC19362@ossumpossum.geop.uc.edu> In-Reply-To: <20110428153539.GC19362@ossumpossum.geop.uc.edu> X-Enigmail-Version: 1.1.1 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.67 on IPv6:2607:f3e0:0:1::12 Cc: freebsd-net@freebsd.org Subject: Re: em0 performance subpar X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2011 16:20:05 -0000 On 4/28/2011 11:35 AM, Adam Stylinski wrote: > > And the rate output of netblast (using as suggested the parameters above): > 119091 > > This is about 454mbps. Still way slower than it ought to be. > Yes, it should do way better than that. I just tried on a couple of 8.2R boxes, E5320 @ 1.86GHz (1866.74-MHz K8-class CPU). Different em nic. Sending side netblast 192.168.5.110 500 450 6 start: 1304007166.789433976 finish: 1304007172.789605227 send calls: 2829340 send errors: 1374103 approx send rate: 242539 approx error rate: 0 em0: port 0x2000-0x201f mem 0xd8a00000-0xd8a1ffff irq 18 at device 0.0 on pci4 em0: Using an MSI interrupt em0: [FILTER] em0: Ethernet address: 00:30:48:33:53:cc The receiving side sees em0 Kbps in Kbps out 0.00 0.52 499822.2 0.00 931129.2 0.00 931126.8 0.00 931166.7 0.00 931064.4 0.00 931219.5 0.00 432451.5 0.00 0.47 0.00 -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-net@FreeBSD.ORG Thu Apr 28 16:31:21 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 752E21065672 for ; Thu, 28 Apr 2011 16:31:21 +0000 (UTC) (envelope-from pyunyh@gmail.com) Received: from mail-pw0-f54.google.com (mail-pw0-f54.google.com [209.85.160.54]) by mx1.freebsd.org (Postfix) with ESMTP id 434BE8FC26 for ; Thu, 28 Apr 2011 16:31:21 +0000 (UTC) Received: by pwj8 with SMTP id 8so1807616pwj.13 for ; Thu, 28 Apr 2011 09:31:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:from:date:to:cc:subject:message-id:reply-to :references:mime-version:content-type:content-disposition :in-reply-to:user-agent; bh=ov0uixBBE/y2swuVVqglQEWBsNxF9Ns5E8GpmB2Ataw=; b=OykY6xH3NJy3Rmrz7zOuEIG59dT+V88ynIyUSBUQDMp1yAYtt8Jl5VwiRhhOPIW8If HXagovOW5e3GR3S3iHwEEnMLYsC7bLWVXSYtogni5dXfxM3tkWstLMiOw8scIL9rvAXY vPIYhFC+EeD3Djc1sJFU+UuPMEJEYzB3MpKRI= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:date:to:cc:subject:message-id:reply-to:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; b=JsTGeIth+HN/bJrrQrAvWHjKNOoLw/bF4GLzeNDuBYy0Yd1G/+z9i+SN1mZgRgkafC rgYjXj7yi/qYEl3aQztHbHRqJdMU3z90bUCifNezOZSrSa27fDDHRKVbz6DX56ZhrJTU omjVusSNrg6LdyQQ1r9eBPCAdkewPZZZM2+ts= Received: by 10.68.17.168 with SMTP id p8mr1843791pbd.274.1304008280788; Thu, 28 Apr 2011 09:31:20 -0700 (PDT) Received: from pyunyh@gmail.com ([174.35.1.224]) by mx.google.com with ESMTPS id v4sm1304709pbe.100.2011.04.28.09.31.12 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 28 Apr 2011 09:31:14 -0700 (PDT) Received: by pyunyh@gmail.com (sSMTP sendmail emulation); Thu, 28 Apr 2011 09:30:27 -0700 From: YongHyeon PYUN Date: Thu, 28 Apr 2011 09:30:27 -0700 To: Adam Stylinski Message-ID: <20110428163027.GA17185@michelle.cdnetworks.com> References: <20110428072946.GA11391@zephyr.adamsnet> <4DB961EA.4080407@userid.org> <20110428132513.GB2800@ossumpossum.geop.uc.edu> <4DB994E7.9060805@userid.org> <20110428155124.GD19362@ossumpossum.geop.uc.edu> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20110428155124.GD19362@ossumpossum.geop.uc.edu> User-Agent: Mutt/1.4.2.3i Cc: freebsd-net@freebsd.org, Pierre Lamy Subject: Re: em0 performance subpar X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: pyunyh@gmail.com List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2011 16:31:21 -0000 On Thu, Apr 28, 2011 at 11:51:24AM -0400, Adam Stylinski wrote: > On Thu, Apr 28, 2011 at 11:25:11AM -0500, Pierre Lamy wrote: > > Someone mentioned on freebsd-current: > > > > With the 7.2.2 driver you also will use different mbuf pools depending on > > > the MTU you are using. If you use jumbo frames it will use 4K clusters, > > > if you go to 9K jumbos it will use 9K mbuf clusters. *The number of these > > > allocated by default is small (like 6400 small :) .* > > > > > > I would use 'netstat -m' to see what the pools look like. > > > > Hope this helps. Check the perf with 1500 byte frames. > > > > Adam Stylinski wrote: > > > On Thu, Apr 28, 2011 at 08:47:38AM -0400, Pierre Lamy wrote: > > > > > >> Try using netblast on FreeBSD instead of iperf, there have been a lot of > > >> discussions about this on this list. > > >> > > >> Is it possible you're maxing out the system's PCI-xxx bus? Did you tune > > >> up the system buffers? Data doesn't just get queued up on the NIC > > >> driver, it also queues within the system's kernel buffers. Try these, I > > >> have no idea if it will help: > > >> > > >> sysctl -w net.inet.tcp.sendspace=373760 > > >> sysctl -w net.inet.tcp.recvspace=373760 > > >> sysctl -w net.local.stream.sendspace=82320 > > >> sysctl -w net.local.stream.recvspace=82320 > > >> sysctl -w net.local.stream.recvspace=373760 > > >> sysctl -w net.local.stream.sendspace=373760 > > >> sysctl -w net.raw.recvspace=373760 > > >> sysctl -w net.raw.sendspace=373760 > > >> sysctl -w net.inet.tcp.local_slowstart_flightsize=10 > > >> sysctl -a net.inet.tcp.delayed_ack=0 > > >> sysctl -w kern.maxvnodes=600000 > > >> sysctl -w net.local.dgram.recvspace=8192 > > >> sysctl -w net.local.dgram.maxdgram=8192 > > >> sysctl -w net.inet.tcp.slowstart_flightsize=10 > > >> sysctl -w net.inet.tcp.path_mtu_discovery=0 > > >> > > >> They're all tunable while system is running. > > >> > > >> -Pierre > > >> > > >> On 4/28/2011 3:29 AM, Adam Stylinski wrote: > > >> > > >>> Hello, > > >>> > > >>> I have an intel gigabit network adapter (the 1000 GT w/chipset 82541PI) which performs poorly in Freebsd compared to the same card in Linux. I've tried this card in two different freebsd boxes and for whatever reason I get poor transmit performance. I've done all of the tweaking specified in just about every guide out there (the usual TCP window scaling, larger nmbclusters, delayed acks, etc) and still I get only around 600mbps. I'm using jumbo frames, with an MTU of 9000. I'm testing this with iperf. While I realize that this may not be the most realistic test, linux hosts with the same card can achieve 995Mbit/s to another host running this. When the Freebsd box is the server, Linux hosts can transmit to it at around 800 something Mbit/s. I've increased the transmit descriptors as specified in the if_em man page, and while that gave me 20 or 30 more mbit/s, my transmit performance is still below normal. > > >>> > > >>> sysctl stats report that the card is trigger a lot of tx_desc_fail2: > > >>> dev.em.0.tx_desc_fail2: 3431 > > >>> > > >>> Looking at a comment in the source code this indicates that the card was not able to obtain enough transmit descriptors (but I've given the card the maximum of 4096 in my loader.conf tunable). Is this a bug or a performance regression of some kind? Does anybody have a fix for this? I tried another card with the same chip in a different box on 8-STABLE to no avail (the box I'm trying to improve performance on is on 8.2-RELEASE-p1). > > >>> > > >>> Anybody manage to make this card push above 600mbps in ideal network benchmarks? Any help would be gladly appreciated. > > >>> > > >> > > >> > > > > > > I doubt I'm saturating the PCI bus, the only other thing on the bus is a really really crappy PCI video card. The same card on lesser powerful machines with Linux (Pentium 4) are able to achieve much more throughput, so it's not likely a bus limitation. > > > > > > I adjusted the listed sysctl live tunables which I hadn't already compensated for and it didn't seem to have an effect. > > > > > > > > > > > > > I tweaked that, doesn't seem to help. I'd rather not go down to a 1500 byte MTU just yet. I may try this later, but most of my network is configured for jumbo frames. > Do you get reasonable performance numbers with standard MTU but see poor performance with jumbo frame? If yes, it indicates driver poorly configured PBA for jumbo frame. The data sheet does not give detailed information about PBA. It seems each controller has different PBA size so correct configuration is very important to get best performance. I don't a have 82541 controller that show this problem but Jack may be able to experiment various PBA configuration for jumbo frame in lab. > [adam@nasbox ~]$ sysctl kern.ipc.nmbjumbo9 > kern.ipc.nmbjumbo9: 12800 > From owner-freebsd-net@FreeBSD.ORG Thu Apr 28 16:52:16 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8C91C106564A for ; Thu, 28 Apr 2011 16:52:16 +0000 (UTC) (envelope-from jfvogel@gmail.com) Received: from mail-yx0-f182.google.com (mail-yx0-f182.google.com [209.85.213.182]) by mx1.freebsd.org (Postfix) with ESMTP id 464A58FC12 for ; Thu, 28 Apr 2011 16:52:15 +0000 (UTC) Received: by yxl31 with SMTP id 31so1240131yxl.13 for ; Thu, 28 Apr 2011 09:52:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=Xj/8m2muhWFw7tDqG9ZnCKV8FSpF5BcGrSxYhdE61Ak=; b=Rw3/finZW8tGk07utjyzM4ubO5udQDed1D+l0ivySGZ71jY51Vk3caSm7JlW87dZxT rU0KmnTwrfPtVyhkhyLJKJfAPmSWNM8sd14ivbEiHdwQ5GCUQK4Cp8BGESwwxzyaEyUB l7o/xG6e4l3MjNtdMnoMBXzdjZe8LXbWPIT28= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=oYYi4+VfqhRcaKXQ56T8Yb22Ubd4kxdRzXDn89GB8Y1vvRt16fjcBnXaLRy2uZVrwg FyJC514lzmxsVkTVbD5cbyA/3LtKsjAypBihP4RSfSisuadqeb2wn0sNzWPOW1J2zuOQ o9hEWtP4ZPkzLXX12CQrZClh0fUOLjCMo1D2s= MIME-Version: 1.0 Received: by 10.150.166.17 with SMTP id o17mr3298078ybe.40.1304009535000; Thu, 28 Apr 2011 09:52:15 -0700 (PDT) Received: by 10.150.133.13 with HTTP; Thu, 28 Apr 2011 09:52:14 -0700 (PDT) In-Reply-To: <20110428160919.GE19362@ossumpossum.geop.uc.edu> References: <20110428072946.GA11391@zephyr.adamsnet> <4DB965D8.7090906@sentex.net> <20110428141339.GD2800@ossumpossum.geop.uc.edu> <20110428144513.GF2800@ossumpossum.geop.uc.edu> <41EE7AB832F24194AC8730544E1C2EB7@multiplay.co.uk> <20110428152141.GA19362@ossumpossum.geop.uc.edu> <11659E32824B4B1E91B6B219BDEF1234@multiplay.co.uk> <20110428160919.GE19362@ossumpossum.geop.uc.edu> Date: Thu, 28 Apr 2011 09:52:14 -0700 Message-ID: From: Jack Vogel To: Adam Stylinski Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-net@freebsd.org, Steven Hartland Subject: Re: em0 performance subpar X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2011 16:52:16 -0000 Adam, The TX ring for the legacy driver is small right now compared to em, try this experiment, edit if_lem.c, search for "lem_txd" and change EM_DEFAULT_TXD to 1024, see what that does, then 2048. My real strategy with the legacy code was that it should stable, meaning not getting a lot of changes... that really hasn't worked out over time. I suppose I'll have to try and give it some tweaks and let you try it. The problem with this code is it technically supports a huge range of old stuff we don't test any more, things I do might cause other regressions :( Oh well, let me know if increasing the TX descriptors helps. Jack From owner-freebsd-net@FreeBSD.ORG Thu Apr 28 18:01:24 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8907B1065674 for ; Thu, 28 Apr 2011 18:01:24 +0000 (UTC) (envelope-from kungfujesus06@gmail.com) Received: from mail-iw0-f182.google.com (mail-iw0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id 4407F8FC16 for ; Thu, 28 Apr 2011 18:01:22 +0000 (UTC) Received: by iwn33 with SMTP id 33so3382622iwn.13 for ; Thu, 28 Apr 2011 11:01:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:date:from:to:cc:subject:message-id:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=tgu3wCnhxpct178flGj7ux1DwNWbQlyWoOzjUpVvR+Y=; b=rw2izemOO9arYkpwlNrD1JUAHpphKUi3Hs0Sgw68jQT9pLjA1XMtiQ1UeCZpfaIoiM 2aB3oDju9qT071sa7UnzC2DMXu5HuzcAApsnO4/JmrlpU9BZdYmtlB0TdhLCJq5hdN6x PzKl5k1d3B9w8gKA/xxQ+CHsr5pBdff0TvHUI= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; b=pW6Lp1e3AaDNYrVHKN5OhgWi9dmK042eI5PBqtrHdUg+UQ6fK9/kamMx3CxJrVKKCq OHz1vIpH+YoI2AxiUeczCRYZ3bMzUB7QzXtNpW2TnmPaegUHwJMEknNQng/pHMmE/KaJ lYgRE/pZlcDK+dTnwd9lfKIC+Wt5cR7wvqjZI= Received: by 10.42.163.130 with SMTP id c2mr4526987icy.522.1304013679944; Thu, 28 Apr 2011 11:01:19 -0700 (PDT) Received: from zephyr.snd-wireless.uc.edu ([129.137.116.23]) by mx.google.com with ESMTPS id ww2sm718652icb.3.2011.04.28.11.01.17 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 28 Apr 2011 11:01:18 -0700 (PDT) Date: Thu, 28 Apr 2011 14:00:37 -0400 From: Adam Stylinski To: Jack Vogel Message-ID: <20110428180037.GA1889@zephyr.snd-wireless.uc.edu> References: <4DB965D8.7090906@sentex.net> <20110428141339.GD2800@ossumpossum.geop.uc.edu> <20110428144513.GF2800@ossumpossum.geop.uc.edu> <41EE7AB832F24194AC8730544E1C2EB7@multiplay.co.uk> <20110428152141.GA19362@ossumpossum.geop.uc.edu> <11659E32824B4B1E91B6B219BDEF1234@multiplay.co.uk> <20110428160919.GE19362@ossumpossum.geop.uc.edu> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="KsGdsel6WgEHnImy" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-net@freebsd.org Subject: Re: em0 performance subpar X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2011 18:01:24 -0000 --KsGdsel6WgEHnImy Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Apr 28, 2011 at 09:52:14AM -0700, Jack Vogel wrote: > Adam, >=20 > The TX ring for the legacy driver is small right now compared to em, try > this experiment, > edit if_lem.c, search for "lem_txd" and change EM_DEFAULT_TXD to 1024, see > what > that does, then 2048. >=20 > My real strategy with the legacy code was that it should stable, meaning = not > getting > a lot of changes... that really hasn't worked out over time. I suppose I'= ll > have to try and > give it some tweaks and let you try it. The problem with this code is it > technically supports > a huge range of old stuff we don't test any more, things I do might cause > other regressions :( >=20 > Oh well, let me know if increasing the TX descriptors helps. >=20 > Jack Jack, Is this the same thing as adjusting these values?: hw.em.rxd=3D4096 hw.em.txd=3D4096 If so I've maxed this out and it's not helping. I'll give it a shot on my = 8-STABLE box as it has a kernel I can play with. Setting the MTU to 1500 gave lower throughput. --=20 Adam Stylinski PGP Key: http://pohl.ececs.uc.edu/~adam/publickey.pub Blog: http://technicallyliving.blogspot.com --KsGdsel6WgEHnImy Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (FreeBSD) iQIcBAEBAgAGBQJNuatEAAoJED6sRHE6TvmnyGEP+QHVsRPiqYWC+R/2gm2c3v21 m3Jmrmx0V7LV34G2Cr4RUvNS4EEOsydhLl6TR+bQTB89ClHuYCgKoYV22a2dUxIT igKRyrq4rvCyz6CBwVM5iEdHA5iTt1Luv8kg2Y5NyCo71qij2Hz2Hc/3Q3hR6Su4 5eLJse0hzAvlw9ADEOPq+PejvXYlVRVck1ShnyA4mOvK/HFTtiW2gGHmHrJwDaKK CKywwJBI5uN4+0vMdHZU2y2HHbRJNXawnlGcdX7zmScZnNybIPxujVQ1jhGGPTiB jQl2LoiOcoasiOXf7F+aMsAMEbHHHKdYoe6N04ZBLwLVPd/rsWdsyzINnhCPyCO+ nqfn50ORTMJeGXtfvvyVrDsoHrXVg/z2GvnAVIYW8ukQNpOXPmCmGdK0jlyVjmE/ vSrstXLFcaPJbquvhVzkhxz4W6pnzgT50P4jZ9GxCgL7MC0RSG+TRR0UudnZlQ0P 7Hhw1OedPZpfTXConi33/X6z3g4JORqhSkV7zO9ZsmZIFMQt7/Ut2RqXhVzUvKZ+ +/np0KtZjaL17xarXlQ8k1ujpTtpbpbqv2tAkEF54pj5/4lN/iJfzVwh4PhQgFT5 GL1SafGfNvdY6tvNQjhBYpzNqg4PUyd41YRH6fvXOHISn3Tz7ehvOcmqHSKodqRp AAsMmTHjYl9LJn33XIZc =88yh -----END PGP SIGNATURE----- --KsGdsel6WgEHnImy-- From owner-freebsd-net@FreeBSD.ORG Thu Apr 28 20:44:41 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 863B3106564A for ; Thu, 28 Apr 2011 20:44:41 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.friendlyhosting.spb.ru (onlyone.friendlyhosting.spb.ru [IPv6:2a01:4f8:131:60a2::2]) by mx1.freebsd.org (Postfix) with ESMTP id 169638FC17 for ; Thu, 28 Apr 2011 20:44:41 +0000 (UTC) Received: from lion.home.serebryakov.spb.ru (unknown [IPv6:2001:470:923f:1:c9d:ce4b:69a5:29c1]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.friendlyhosting.spb.ru (Postfix) with ESMTPA id 597A24AC1C for ; Fri, 29 Apr 2011 00:44:40 +0400 (MSD) Date: Fri, 29 Apr 2011 00:44:33 +0400 From: Lev Serebryakov Organization: FreeBSD X-Priority: 3 (Normal) Message-ID: <47517681.20110429004433@serebryakov.spb.ru> To: freebsd-net@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=windows-1251 Content-Transfer-Encoding: quoted-printable Subject: dummynet, flowmask and IPv6 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: lev@FreeBSD.org List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2011 20:44:41 -0000 Hello, Freebsd-net. Does queue/sched masks work with IPv6 addresses? I can not find any examples for this, all examples are with 32-bit masks only... --=20 // Black Lion AKA Lev Serebryakov From owner-freebsd-net@FreeBSD.ORG Thu Apr 28 21:22:31 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2B02D106566B for ; Thu, 28 Apr 2011 21:22:31 +0000 (UTC) (envelope-from jfvogel@gmail.com) Received: from mail-yx0-f182.google.com (mail-yx0-f182.google.com [209.85.213.182]) by mx1.freebsd.org (Postfix) with ESMTP id D33528FC19 for ; Thu, 28 Apr 2011 21:22:30 +0000 (UTC) Received: by yxl31 with SMTP id 31so1379919yxl.13 for ; Thu, 28 Apr 2011 14:22:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=E7nN9mvi7HmPfmjxBSV8h0F6neW9avxMPzD6gsBVbzQ=; b=muJDcb2eyhtIf5XGytaZjmYKQyOKDIntBZ+P1HY6yMek5fQPT2TU/Z5ceZt1KvmQKJ VXpkN4yaJcDyKKtbf3BW8rh1DqbXVdjuoPYef8kH/WOXW2K/XknLOI9L+4l9IbvZg/L9 BAJOjHD7wswpnnUr8sIcvDD4DOrQJBD1JMnOo= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=pSw32PrK9FuGmjdrJf1o7d37v6v4OjEoiAeB7vT/dnDBWVuqCUbfVaK3gSfe5+jLeW g1o02K41ZHX/Nhl/Gj2juAQWne65fD++fS1xvlG9l7YogWMzU8y0lBlGfL3XZukSi4Ye 8KLWGdPZ+nVWHJVKIE1ccxur3LaGfRXgpVJhQ= MIME-Version: 1.0 Received: by 10.150.103.12 with SMTP id a12mr3889645ybc.325.1304025749903; Thu, 28 Apr 2011 14:22:29 -0700 (PDT) Received: by 10.150.133.13 with HTTP; Thu, 28 Apr 2011 14:22:29 -0700 (PDT) In-Reply-To: <20110428180037.GA1889@zephyr.snd-wireless.uc.edu> References: <4DB965D8.7090906@sentex.net> <20110428141339.GD2800@ossumpossum.geop.uc.edu> <20110428144513.GF2800@ossumpossum.geop.uc.edu> <41EE7AB832F24194AC8730544E1C2EB7@multiplay.co.uk> <20110428152141.GA19362@ossumpossum.geop.uc.edu> <11659E32824B4B1E91B6B219BDEF1234@multiplay.co.uk> <20110428160919.GE19362@ossumpossum.geop.uc.edu> <20110428180037.GA1889@zephyr.snd-wireless.uc.edu> Date: Thu, 28 Apr 2011 14:22:29 -0700 Message-ID: From: Jack Vogel To: Adam Stylinski Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-net@freebsd.org Subject: Re: em0 performance subpar X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2011 21:22:31 -0000 My validation engineer set things up on an 8.2 REL system, testing the equivalent of HEAD, and he reports performance is fine. This is without any tweaks from what's checked in. Increasing the descriptors to 4K is way overkill and might actually cause problems, go back to default. He has a Linux test client, what are you transmitting to? Jack On Thu, Apr 28, 2011 at 11:00 AM, Adam Stylinski wrote: > On Thu, Apr 28, 2011 at 09:52:14AM -0700, Jack Vogel wrote: > > Adam, > > > > The TX ring for the legacy driver is small right now compared to em, try > > this experiment, > > edit if_lem.c, search for "lem_txd" and change EM_DEFAULT_TXD to 1024, > see > > what > > that does, then 2048. > > > > My real strategy with the legacy code was that it should stable, meaning > not > > getting > > a lot of changes... that really hasn't worked out over time. I suppose > I'll > > have to try and > > give it some tweaks and let you try it. The problem with this code is it > > technically supports > > a huge range of old stuff we don't test any more, things I do might cause > > other regressions :( > > > > Oh well, let me know if increasing the TX descriptors helps. > > > > Jack > Jack, > > Is this the same thing as adjusting these values?: > > hw.em.rxd=4096 > hw.em.txd=4096 > > If so I've maxed this out and it's not helping. I'll give it a shot on my > 8-STABLE box as it has a kernel I can play with. > > Setting the MTU to 1500 gave lower throughput. > > -- > Adam Stylinski > PGP Key: http://pohl.ececs.uc.edu/~adam/publickey.pub > Blog: http://technicallyliving.blogspot.com > From owner-freebsd-net@FreeBSD.ORG Thu Apr 28 22:47:54 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A27D8106564A for ; Thu, 28 Apr 2011 22:47:54 +0000 (UTC) (envelope-from kungfujesus06@gmail.com) Received: from mail-iw0-f182.google.com (mail-iw0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id 5E9E48FC0A for ; Thu, 28 Apr 2011 22:47:54 +0000 (UTC) Received: by iwn33 with SMTP id 33so3654971iwn.13 for ; Thu, 28 Apr 2011 15:47:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:date:from:to:cc:subject:message-id:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=NW1A/9P0wOe2G1HZ1NnHUhMtB2hFCOKA5LcsxquQTZU=; b=Qt/sHkkhgIonm0YVjyS555puLjMG4cU46/F5imUShUuvRhq1E9OYw7mcrHW0h8pyZq RZF/udso+WfnsHpIGn2iijwlHTBhiGlSf3AtsPenJnX8JOI4Se8qKUN+CzMRgxzNq6+a 3ZxiyFu/H/96gbXJ0nGEBNFrFAIMEiaKOoU74= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; b=BrbL91Z+F1mmSV3B8KxEe4KezGhLTjXERzYzrdF2Eic8FlTjTic7VcchDGbrcPb8/P fIjOCpcLN1RPIv//JEKe2aycXtmDTCJlCoWcgISMl5VzVprkSYndJH4cTlCmRmp2gcIK pHcHqb7evtADwx7NPx6eeoxPtmnx7hrII0huc= Received: by 10.42.140.134 with SMTP id k6mr5439832icu.257.1304030873614; Thu, 28 Apr 2011 15:47:53 -0700 (PDT) Received: from freebsdbox.adamsnet ([72.49.234.31]) by mx.google.com with ESMTPS id gy41sm866804ibb.39.2011.04.28.15.47.51 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 28 Apr 2011 15:47:52 -0700 (PDT) Date: Thu, 28 Apr 2011 18:47:49 -0400 From: Adam Stylinski To: Jack Vogel Message-ID: <20110428224749.GA47010@freebsdbox.adamsnet> References: <20110428141339.GD2800@ossumpossum.geop.uc.edu> <20110428144513.GF2800@ossumpossum.geop.uc.edu> <41EE7AB832F24194AC8730544E1C2EB7@multiplay.co.uk> <20110428152141.GA19362@ossumpossum.geop.uc.edu> <11659E32824B4B1E91B6B219BDEF1234@multiplay.co.uk> <20110428160919.GE19362@ossumpossum.geop.uc.edu> <20110428180037.GA1889@zephyr.snd-wireless.uc.edu> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="LQksG6bCIzRHxTLp" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-net@freebsd.org Subject: Re: em0 performance subpar X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Apr 2011 22:47:54 -0000 --LQksG6bCIzRHxTLp Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Apr 28, 2011 at 02:22:29PM -0700, Jack Vogel wrote: > My validation engineer set things up on an 8.2 REL system, testing the > equivalent of > HEAD, and he reports performance is fine. This is without any tweaks from > what's > checked in. >=20 > Increasing the descriptors to 4K is way overkill and might actually cause > problems, > go back to default. >=20 > He has a Linux test client, what are you transmitting to? >=20 > Jack >=20 >=20 > On Thu, Apr 28, 2011 at 11:00 AM, Adam Stylinski wrote: >=20 > > On Thu, Apr 28, 2011 at 09:52:14AM -0700, Jack Vogel wrote: > > > Adam, > > > > > > The TX ring for the legacy driver is small right now compared to em, = try > > > this experiment, > > > edit if_lem.c, search for "lem_txd" and change EM_DEFAULT_TXD to 1024, > > see > > > what > > > that does, then 2048. > > > > > > My real strategy with the legacy code was that it should stable, mean= ing > > not > > > getting > > > a lot of changes... that really hasn't worked out over time. I suppose > > I'll > > > have to try and > > > give it some tweaks and let you try it. The problem with this code is= it > > > technically supports > > > a huge range of old stuff we don't test any more, things I do might c= ause > > > other regressions :( > > > > > > Oh well, let me know if increasing the TX descriptors helps. > > > > > > Jack > > Jack, > > > > Is this the same thing as adjusting these values?: > > > > hw.em.rxd=3D4096 > > hw.em.txd=3D4096 > > > > If so I've maxed this out and it's not helping. I'll give it a shot on= my > > 8-STABLE box as it has a kernel I can play with. > > > > Setting the MTU to 1500 gave lower throughput. > > > > -- > > Adam Stylinski > > PGP Key: http://pohl.ececs.uc.edu/~adam/publickey.pub > > Blog: http://technicallyliving.blogspot.com > > I am transmitting to a linux client (kernel 2.6.38, 9000 byte MTU, PCI-Ex b= ased card). My sysctl's on the Linux client (apart from the default) look = like so: net.ipv4.ip_forward =3D 0 # Enables source route verification net.ipv4.conf.default.rp_filter =3D 1 # Enable reverse path net.ipv4.conf.all.rp_filter =3D 1 net.core.rmem_max =3D 16777216 net.core.wmem_max =3D 16777216 net.ipv4.tcp_rmem =3D 4096 87380 16777216 net.ipv4.tcp_wmem =3D 4096 87380 16777216 net.core.wmem_default =3D 87380 net.core.rmem_default =3D 87380 net.ipv4.tcp_mem =3D 98304 131072 196608 net.ipv4.tcp_no_metrics_save =3D 1 net.ipv4.tcp_window_scaling =3D 1 dev.rtc.max-user-freq =3D 1024 The exact troublesome device (as reported by pciconf):=20 em0@pci0:7:5:0: class=3D0x020000 card=3D0x13768086 chip=3D0x107c8086 rev=3D= 0x05 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'Gigabit Ethernet Controller (Copper) rev 5 (82541PI)' class =3D network subclass =3D ethernet Apart from bus saturation (which I don't suspect is the problem) I'm not su= re what the issue could be. What should I try next? --=20 Adam Stylinski PGP Key: http://pohl.ececs.uc.edu/~adam/publickey.pub Blog: http://technicallyliving.blogspot.com --LQksG6bCIzRHxTLp Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.17 (FreeBSD) iQIcBAEBAgAGBQJNue6UAAoJED6sRHE6TvmnZKwQAK5xSsMFsuIA12imVJx8RLAs bPmk9mMzohYvYSYZb7O7YASEV3tXdt7c+QABy5WiGykit+gvK1zgZ092p2aObvn3 TV7m0nnajawfAr/Dtoxve/hs/VPDEF4ldkmtc14aM0bv1uPAaAKJ7IVovd0fzdG7 UC1DSHOfv2zJ9oEHHcrZtOqm5xfNzJ29nn26GzqyDVLvLY+V0UuzS5EQXS0AzKmw GjGQzsKyU73WGVaYKySM39v6eNNeIY9RRuNlLUpHNpYBEdU7Yl8Nn+BWPV1ERFU3 Syyt6atIQ37G0/AaFpQjMeinO+1Gg3fRQ2xNpzy5nvvKLUs4YN+aaKLDsg9SIczL UcE7m88ErR2xR96Jm4bVl5Q1V+8v/qbSOfwSo0ZGkThbnO0kspRZ7KkZbeepAxIG z3PY4nF5uY0HC3zV4UtmkwDyRDexFns4Y/8yRJmobf+UpxmakgDqNEIhuF59XH0r PbOFXzhF1meX4O7AJ/HG2KZkiyzD8TSgGLZ3XbwUkuFK7mFcmASnVeVOaCG7IagC 3vLpv/vZSYBtM7nl0+UVmYJtv+2eCzPs2ObdZQz6DO/SOJLEIyOOBQmqqp4k0FtZ rU7jXup7kdi0nzbDaY2xZ7/NJaA2Lg81yI5g3UhbyVUoxu2zKpK6WtBBKUxctKWD 3JloE192P62CHYIFf1sQ =LzTp -----END PGP SIGNATURE----- --LQksG6bCIzRHxTLp-- From owner-freebsd-net@FreeBSD.ORG Fri Apr 29 00:17:02 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3F6F21065670 for ; Fri, 29 Apr 2011 00:17:02 +0000 (UTC) (envelope-from bsd@xerq.net) Received: from cartman.xerq.net (cartman.xerq.net [67.52.126.46]) by mx1.freebsd.org (Postfix) with ESMTP id 0C70C8FC1B for ; Fri, 29 Apr 2011 00:17:01 +0000 (UTC) Received: from cartman.xerq.net (unknown [127.52.126.46]) by cartman.xerq.net (Postfix) with ESMTP id 53E045F662 for ; Thu, 28 Apr 2011 17:11:28 -0700 (PDT) Received: from cartman.xerq.net ([127.52.126.46]) by cartman.xerq.net (cartman.xerq.net [127.52.126.46]) (amavisd-new, port 10024) with ESMTP id znuiADzH97a5 for ; Thu, 28 Apr 2011 17:11:28 -0700 (PDT) Received: by cartman.xerq.net (Postfix, from userid 125) id 09A465F65C; Thu, 28 Apr 2011 17:10:28 -0700 (PDT) Received: from cartman.xerq.net (unknown [127.52.126.46]) by cartman.xerq.net (Postfix) with ESMTP id BE9325F28C for ; Thu, 28 Apr 2011 17:02:33 -0700 (PDT) Received: from cartman.xerq.net ([127.52.126.46]) by cartman.xerq.net (cartman.xerq.net [127.52.126.46]) (amavisd-new, port 10024) with ESMTP id FpiuMFnXpvtJ for ; Thu, 28 Apr 2011 17:02:29 -0700 (PDT) Received: from www1.xerq.net (localhost [127.52.126.46]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by cartman.xerq.net (Postfix) with ESMTPSA id 1447F5F252 for ; Thu, 28 Apr 2011 17:02:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=xerq.net; s=dkimlol; t=1304035349; bh=43zcWazQ/8b8np/ixPS9EQIoOCrRNqC5y0KqPUtB/2Y=; h=MIME-Version:Content-Type:Content-Transfer-Encoding:Date:From:To: Subject:In-Reply-To:References:Message-ID; b=Oy0vCHTVW5asTMNEeFmCpzw3DjQpUgScmjgOxES6UdRWjBTGIFDIUk/8AYZLPPNcp jKcWlWEjfbEB1SxMFoJkTo2rFmlYdvy8eHIdj0opfLXGzdAt2o/+78AQZrJ8MHsGa2 Ha7JDHRuJXWS19aMzAMbrcka6C1CWAi6Sgh998Co= DomainKey-Signature: a=rsa-sha1; s=default; d=xerq.net; c=nofws; q=dns; h=mime-version:content-type: content-transfer-encoding:date:from:to:subject:in-reply-to:references:message-id: x-sender:user-agent; b=MCOmQm3q8Y+8NPick+j4y4N3dE8IsfFdoFxC2KpsYX6clxdDaajGM9g16tbc/EumA V7n0dndlBIMsLAM6wex9w== MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Date: Thu, 28 Apr 2011 17:02:28 -0700 From: Matt Connor To: In-Reply-To: <20110428072946.GA11391@zephyr.adamsnet> References: <20110428072946.GA11391@zephyr.adamsnet> Message-ID: <2290ea840693c579fef9ac04ab58ee3c@www1.xerq.net> X-Sender: bsd@xerq.net User-Agent: XERQ Webmail/0.5.2 Subject: Re: em0 performance subpar X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 Apr 2011 00:17:02 -0000 On Thu, 28 Apr 2011 03:29:46 -0400, Adam Stylinski wrote: > Hello, > > I have an intel gigabit network adapter (the 1000 GT w/chipset > 82541PI) which performs poorly in Freebsd compared to the same card > in > Linux. I've tried this card in two different freebsd boxes and for > whatever reason I get poor transmit performance. I've done all of > the > tweaking specified in just about every guide out there (the usual TCP > window scaling, larger nmbclusters, delayed acks, etc) and still I > get > only around 600mbps. I'm using jumbo frames, with an MTU of 9000. > I'm testing this with iperf. While I realize that this may not be > the > most realistic test, linux hosts with the same card can achieve > 995Mbit/s to another host running this. When the Freebsd box is the > server, Linux hosts can transmit to it at around 800 something > Mbit/s. > I've increased the transmit descriptors as specified in the if_em man > page, and while that gave me 20 or 30 more mbit/s, my transmit > performance is still below normal. > > sysctl stats report that the card is trigger a lot of tx_desc_fail2: > dev.em.0.tx_desc_fail2: 3431 > > Looking at a comment in the source code this indicates that the card > was not able to obtain enough transmit descriptors (but I've given > the > card the maximum of 4096 in my loader.conf tunable). Is this a bug > or > a performance regression of some kind? Does anybody have a fix for > this? I tried another card with the same chip in a different box on > 8-STABLE to no avail (the box I'm trying to improve performance on is > on 8.2-RELEASE-p1). > > Anybody manage to make this card push above 600mbps in ideal network > benchmarks? Any help would be gladly appreciated. We've had this issue with Intel in the past, and these were the changes made. Let me know if this helps or makes things worse. # dmesg | grep Intel CPU: Intel(R) Xeon(R) CPU E31270 @ 3.40GHz (3392.31-MHz K8-class CPU) Origin = "GenuineIntel" Id = 0x206a7 Family = 6 Model = 2a Stepping = 7 em0: port 0xe000-0xe01f mem 0xfbc00000-0xfbc1ffff,0xfbc20000-0xfbc23fff irq 16 at device 0.0 on pci4 em1: port 0xd000-0xd01f mem 0xfbb00000-0xfbb1ffff,0xfbb20000-0xfbb23fff irq 17 at device 0.0 on pci5 em2: port 0xc000-0xc01f mem 0xfba00000-0xfba1ffff,0xfba20000-0xfba23fff irq 18 at device 0.0 on pci6 em3: port 0xb000-0xb01f mem 0xfb900000-0xfb91ffff,0xfb920000-0xfb923fff irq 19 at device 0.0 on pci7 # vmstat -z | egrep 'ITEM|mbuf' ITEM SIZE LIMIT USED FREE REQUESTS FAILURES mbuf_packet: 256, 0, 2048, 1409, 19787794, 0 mbuf: 256, 0, 2, 2166, 45417342, 0 mbuf_cluster: 2048, 32768, 3457, 1397, 14464, 0 mbuf_jumbo_page: 4096, 12800, 0, 715, 466607, 0 mbuf_jumbo_9k: 9216, 6400, 0, 0, 0, 0 mbuf_jumbo_16k: 16384, 3200, 0, 0, 0, 0 mbuf_ext_refcnt: 4, 0, 0, 1680, 7596019, 0 # pciconf -lvc em1@pci0:5:0:0: class=0x020000 card=0x10d315d9 chip=0x10d38086 rev=0x00 hdr=0x00 vendor = 'Intel Corporation' device = 'Intel 82574L Gigabit Ethernet Controller (82574L)' class = network subclass = ethernet cap 01[c8] = powerspec 2 supports D0 D3 current D0 cap 05[d0] = MSI supports 1 message, 64 bit cap 10[e0] = PCI-Express 1 endpoint max data 128(256) link x1(x1) cap 11[a0] = MSI-X supports 5 messages in map 0x1c enabled ecap 0001[100] = AER 1 0 fatal 0 non-fatal 1 corrected ecap 0003[140] = Serial 1 002590ffff247fef # vmstat -i interrupt total rate irq1: atkbd0 6 0 irq0: 1 0 stray irq0 1 0 irq16: ehci0 292820 1 irq19: atapci0 3473449 17 irq23: ehci1 293594 1 cpu0: timer 389382023 1999 irq256: em0:rx 0 150420 0 irq257: em0:tx 0 131374 0 irq258: em0:link 2 0 irq259: em1:rx 0 17554401 90 irq260: em1:tx 0 13141176 67 irq261: em1:link 3 0 cpu1: timer 389381624 1999 cpu4: timer 389381747 1999 cpu5: timer 389381781 1999 cpu3: timer 389381685 1999 cpu2: timer 389381724 1999 cpu6: timer 389381781 1999 cpu7: timer 389381587 1999 Total 3150091199 16179 -/etc/sysctl.conf net.inet.tcp.msl=7500 ##added by SoftLayer kern.ipc.maxsockbuf=16777216 net.inet.tcp.rfc1323=1 # Disk Speed tweaks #vfs.ufs.dirhash_maxmem=64777216 vfs.write_behind=1 # Kernel Tuning kern.ipc.somaxconn=2048 kern.ipc.nmbclusters=32768 # Experimental kern.maxfilesperproc=32768 kern.maxvnodes=400000 net.local.stream.recvspace=65536 kern.maxfiles=65536 net.inet.udp.maxdgram=57344 net.inet.tcp.mssdflt=1460 net.inet.tcp.sendbuf_max=67108864 net.inet.tcp.recvbuf_max=67108864 net.inet.tcp.inflight.enable=0 net.inet.tcp.sendspace=262144 net.inet.tcp.recvspace=262144 net.inet.udp.recvspace=262144 net.inet.tcp.sack.enable=1 net.inet.tcp.path_mtu_discovery=1 net.inet.tcp.sendbuf_auto=1 net.inet.tcp.sendbuf_inc=16384 net.inet.tcp.recvbuf_auto=1 net.inet.tcp.recvbuf_inc=524288 net.inet.tcp.hostcache.expire=1 From owner-freebsd-net@FreeBSD.ORG Fri Apr 29 06:28:51 2011 Return-Path: Delivered-To: freebsd-net@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 540271065674; Fri, 29 Apr 2011 06:28:51 +0000 (UTC) (envelope-from kevlo@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 2A25E8FC1C; Fri, 29 Apr 2011 06:28:51 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.4/8.14.4) with ESMTP id p3T6SpxS055119; Fri, 29 Apr 2011 06:28:51 GMT (envelope-from kevlo@freefall.freebsd.org) Received: (from kevlo@localhost) by freefall.freebsd.org (8.14.4/8.14.4/Submit) id p3T6SoHY055115; Fri, 29 Apr 2011 06:28:50 GMT (envelope-from kevlo) Date: Fri, 29 Apr 2011 06:28:50 GMT Message-Id: <201104290628.p3T6SoHY055115@freefall.freebsd.org> To: a_hartwig@fastmail.fm, kevlo@FreeBSD.org, freebsd-net@FreeBSD.org From: kevlo@FreeBSD.org Cc: Subject: Re: kern/144642: [rum] [panic] Enabling rum interface causes panic X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 Apr 2011 06:28:51 -0000 Synopsis: [rum] [panic] Enabling rum interface causes panic State-Changed-From-To: open->closed State-Changed-By: kevlo State-Changed-When: Fri Apr 29 06:28:36 UTC 2011 State-Changed-Why: Committed, thanks! http://www.freebsd.org/cgi/query-pr.cgi?pr=144642 From owner-freebsd-net@FreeBSD.ORG Fri Apr 29 06:30:18 2011 Return-Path: Delivered-To: freebsd-net@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 97EEA1065674 for ; Fri, 29 Apr 2011 06:30:18 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 6BE278FC23 for ; Fri, 29 Apr 2011 06:30:18 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.4/8.14.4) with ESMTP id p3T6UI7X055397 for ; Fri, 29 Apr 2011 06:30:18 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.4/8.14.4/Submit) id p3T6UIFN055389; Fri, 29 Apr 2011 06:30:18 GMT (envelope-from gnats) Date: Fri, 29 Apr 2011 06:30:18 GMT Message-Id: <201104290630.p3T6UIFN055389@freefall.freebsd.org> To: freebsd-net@FreeBSD.org From: dfilter@FreeBSD.ORG (dfilter service) Cc: Subject: Re: kern/144642: commit references a PR X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: dfilter service List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 Apr 2011 06:30:18 -0000 The following reply was made to PR kern/144642; it has been noted by GNATS. From: dfilter@FreeBSD.ORG (dfilter service) To: bug-followup@FreeBSD.org Cc: Subject: Re: kern/144642: commit references a PR Date: Fri, 29 Apr 2011 06:28:45 +0000 (UTC) Author: kevlo Date: Fri Apr 29 06:28:29 2011 New Revision: 221199 URL: http://svn.freebsd.org/changeset/base/221199 Log: Guard against default ni_chan PR: kern/144642 Submitted by: Arthur Hartwig Modified: head/sys/dev/usb/wlan/if_rum.c Modified: head/sys/dev/usb/wlan/if_rum.c ============================================================================== --- head/sys/dev/usb/wlan/if_rum.c Fri Apr 29 06:25:11 2011 (r221198) +++ head/sys/dev/usb/wlan/if_rum.c Fri Apr 29 06:28:29 2011 (r221199) @@ -208,7 +208,7 @@ static void rum_init(void *); static void rum_stop(struct rum_softc *); static void rum_load_microcode(struct rum_softc *, const uint8_t *, size_t); -static int rum_prepare_beacon(struct rum_softc *, +static void rum_prepare_beacon(struct rum_softc *, struct ieee80211vap *); static int rum_raw_xmit(struct ieee80211_node *, struct mbuf *, const struct ieee80211_bpf_params *); @@ -2119,7 +2119,7 @@ rum_load_microcode(struct rum_softc *sc, rum_pause(sc, hz / 8); } -static int +static void rum_prepare_beacon(struct rum_softc *sc, struct ieee80211vap *vap) { struct ieee80211com *ic = vap->iv_ic; @@ -2127,9 +2127,12 @@ rum_prepare_beacon(struct rum_softc *sc, struct rum_tx_desc desc; struct mbuf *m0; + if (vap->iv_bss->ni_chan == IEEE80211_CHAN_ANYC) + return; + m0 = ieee80211_beacon_alloc(vap->iv_bss, &RUM_VAP(vap)->bo); if (m0 == NULL) { - return ENOBUFS; + return; } tp = &vap->iv_txparms[ieee80211_chan2mode(ic->ic_bsschan)]; @@ -2144,8 +2147,6 @@ rum_prepare_beacon(struct rum_softc *sc, m0->m_pkthdr.len); m_freem(m0); - - return 0; } static int _______________________________________________ svn-src-all@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/svn-src-all To unsubscribe, send any mail to "svn-src-all-unsubscribe@freebsd.org" From owner-freebsd-net@FreeBSD.ORG Fri Apr 29 08:20:18 2011 Return-Path: Delivered-To: freebsd-net@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0FEAC106564A for ; Fri, 29 Apr 2011 08:20:18 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id D8C8F8FC13 for ; Fri, 29 Apr 2011 08:20:17 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.4/8.14.4) with ESMTP id p3T8KHTC083730 for ; Fri, 29 Apr 2011 08:20:17 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.4/8.14.4/Submit) id p3T8KHLo083721; Fri, 29 Apr 2011 08:20:17 GMT (envelope-from gnats) Date: Fri, 29 Apr 2011 08:20:17 GMT Message-Id: <201104290820.p3T8KHLo083721@freefall.freebsd.org> To: freebsd-net@FreeBSD.org From: Eugene Grosbein Cc: Subject: Re: kern/153671: [em] [panic] 8.2-PRERELEASE repeatable kernel in if_em(4) X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Eugene Grosbein List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 Apr 2011 08:20:18 -0000 The following reply was made to PR kern/153671; it has been noted by GNATS. From: Eugene Grosbein To: bug-followup@FreeBSD.ORG Cc: Subject: Re: kern/153671: [em] [panic] 8.2-PRERELEASE repeatable kernel in if_em(4) Date: Fri, 29 Apr 2011 15:17:55 +0700 Hi! All needed changes were MFC'd and I run my boxes with recent RELENG_8 without a problem. This PR should be closed as resolved. Eugene Grosbein From owner-freebsd-net@FreeBSD.ORG Fri Apr 29 08:40:13 2011 Return-Path: Delivered-To: freebsd-net@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BFCD8106564A for ; Fri, 29 Apr 2011 08:40:13 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 94FC38FC1D for ; Fri, 29 Apr 2011 08:40:13 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.4/8.14.4) with ESMTP id p3T8eDD5003960 for ; Fri, 29 Apr 2011 08:40:13 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.4/8.14.4/Submit) id p3T8eD5s003959; Fri, 29 Apr 2011 08:40:13 GMT (envelope-from gnats) Date: Fri, 29 Apr 2011 08:40:13 GMT Message-Id: <201104290840.p3T8eD5s003959@freefall.freebsd.org> To: freebsd-net@FreeBSD.org From: Eugene Grosbein Cc: Subject: Re: kern/153255: [panic] 8.2-PRERELEASE repeatable kernel panic under heavy network load X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Eugene Grosbein List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 Apr 2011 08:40:13 -0000 The following reply was made to PR kern/153255; it has been noted by GNATS. From: Eugene Grosbein To: bug-followup@FreeBSD.ORG Cc: Subject: Re: kern/153255: [panic] 8.2-PRERELEASE repeatable kernel panic under heavy network load Date: Fri, 29 Apr 2011 15:32:37 +0700 Hi! All needed changes were MFC'd and I run my boxes with recent RELENG_8 without a problem. This PR should be closed as resolved. Eugene Grosbein From owner-freebsd-net@FreeBSD.ORG Fri Apr 29 09:38:16 2011 Return-Path: Delivered-To: freebsd-net@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DA1551065673; Fri, 29 Apr 2011 09:38:16 +0000 (UTC) (envelope-from vwe@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id B127C8FC1F; Fri, 29 Apr 2011 09:38:16 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.4/8.14.4) with ESMTP id p3T9cGHN057886; Fri, 29 Apr 2011 09:38:16 GMT (envelope-from vwe@freefall.freebsd.org) Received: (from vwe@localhost) by freefall.freebsd.org (8.14.4/8.14.4/Submit) id p3T9cGgs057882; Fri, 29 Apr 2011 09:38:16 GMT (envelope-from vwe) Date: Fri, 29 Apr 2011 09:38:16 GMT Message-Id: <201104290938.p3T9cGgs057882@freefall.freebsd.org> To: egrosbein@rdtc.ru, vwe@FreeBSD.org, freebsd-net@FreeBSD.org From: vwe@FreeBSD.org Cc: Subject: Re: kern/153255: [panic] 8.2-PRERELEASE repeatable kernel panic under heavy network load X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 Apr 2011 09:38:16 -0000 Synopsis: [panic] 8.2-PRERELEASE repeatable kernel panic under heavy network load State-Changed-From-To: open->closed State-Changed-By: vwe State-Changed-When: Fri Apr 29 09:37:09 UTC 2011 State-Changed-Why: issue reported to be fixed and MFC'ed already. Thank you for reporting, Eugene! http://www.freebsd.org/cgi/query-pr.cgi?pr=153255 From owner-freebsd-net@FreeBSD.ORG Fri Apr 29 10:05:03 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0EFBE106564A for ; Fri, 29 Apr 2011 10:05:03 +0000 (UTC) (envelope-from zeus@relay.ibs.dn.ua) Received: from relay.ibs.dn.ua (relay.ibs.dn.ua [91.216.196.25]) by mx1.freebsd.org (Postfix) with ESMTP id 5E8B68FC08 for ; Fri, 29 Apr 2011 10:05:01 +0000 (UTC) Received: from relay.ibs.dn.ua (localhost [127.0.0.1]) by relay.ibs.dn.ua with ESMTP id p3T9qVBP018690 for ; Fri, 29 Apr 2011 12:52:31 +0300 (EEST) Received: (from zeus@localhost) by relay.ibs.dn.ua (8.14.4/8.14.4/Submit) id p3T9qV9r018689 for freebsd-net@freebsd.org; Fri, 29 Apr 2011 12:52:31 +0300 (EEST) Date: Fri, 29 Apr 2011 12:52:31 +0300 From: Zeus V Panchenko To: freebsd-net@freebsd.org Message-ID: <20110429095231.GA17786@relay.ibs.dn.ua> Mail-Followup-To: freebsd-net@freebsd.org References: <201104290001.p3T01EvQ082443@artema.vpn.ibs> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline In-Reply-To: <201104290001.p3T01EvQ082443@artema.vpn.ibs> User-Agent: Mutt/1.4.2.3i X-Operating-System: FreeBSD 8.1-RELEASE X-Editor: GNU Emacs 23.2.1 X-Face: iVBORw0KGgoAAAANSUhEUgAAACoAAAAqBAMAAAA37dRoAAAAFVBMVEWjjoiZhHDWzcZuW1U wOT+RcGxziJxEN0lIAAABrklEQVQokV2STXLbMAyFQaraE3a5dzSTfR1IF7CQrM3QuECn9z9DH0 gxzgSyFvr88PBD0uJxoR6BE+e8LtRgohE5ZB50sODP/REbfUnte/z12+llCekLUSKenFIMke6Be WinE8H0RJHSN71rUQp64gFDmtDDhRk0zam3FzpNVFprhwPGaFo6oY9wDBJQ9Qz6EuKyROJjDGa+ uza4VOTa8iHlN58Yv5BF9+4BGl0LA5pUD5xKXg4aQlVZm0co3NKxCGxQpu3aC352Gv3DZONmwQd tkrlaylV3YSew7bWtwAZF/zi9jblmprPoL7ktzeFSxmarVNmWRi+Bmxg7Y7tbGtR8XZUxLTo86G thANsssetjp3POuBvMBRlw6jRa5pKN7yVlP+F2lyiZGSMf5hnSU6eAVupmtfjRcxy0momwpxDnz 06hwnOWvBnUdR8U2/KX7cq26u1Jy5xFZMPOVONRbRUrwey8Qar6cWgf12xSymQuVX0DfYd4R8kN Hg0qCtLeaYZcj8B90M2N0cEX1P0vKSxw7NLy/3X8Qeriusu66jNA37P4Mn5QRTG2hz4d9D/6E3a EX852nwAAAABJRU5ErkJggg== Subject: collisions on tun interfaces ... X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: zeus@ibs.dn.ua List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 Apr 2011 10:05:03 -0000 Hi, may somebody epxplain it for me, what can cause collisions on tun interfaces created by ppp(8) and openvpn? > uname -a FreeBSD 8.2-STABLE #0 i386 > netstat -i Name Mtu Network Address Ipkts Ierrs Idrop Opkts Oerrs Coll tun0 1492 18940349 0 0 15737760 0 45668 tun0 1492 A.B.C.D A-B-C-D.domain 15623965 - - 12429351 - - tun1 1500 12721670 0 0 9957662 0 11161 tun1 1500 E.F.G.H E-F-G-H.vpn 6454 - - 445751 - - rl0: flags=8843 metric 0 mtu 1500 options=3808 ether 00:30:4f:67:cf:81 media: Ethernet autoselect (100baseTX ) status: active tun0: flags=8051 metric 0 mtu 1492 options=80000 inet A.B.C.D --> A1.B1.C1.D1 netmask 0xffffffff Opened by PID 3943 tun1: flags=8051 metric 0 mtu 1500 options=80000 inet E.F.G.H --> E1.F1.G1.H1 netmask 0xffffffff Opened by PID 1387 tun0 is created by ppp(8) in /etc/ppp.conf is: default: set log Phase Chat LCP IPCP CCP tun command set server /var/run/ppp/internet "" 0177 set device PPPoE:rl0 set speed sync enable lqr echo set lqrperiod 30 set login set ctsrts off add default HISADDR set timeout 0 set redial 0 0 set cd 5 tun1 is created by OpenVPN with configuration: client dev tun1 proto udp ... so, what can cause the collisions and can i fix them? -- Zeus V. Panchenko IT Dpt., IBS ltd GMT+2 (EET) From owner-freebsd-net@FreeBSD.ORG Fri Apr 29 10:45:11 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx2.freebsd.org (mx2.freebsd.org [IPv6:2001:4f8:fff6::35]) by hub.freebsd.org (Postfix) with ESMTP id 6680E1065672; Fri, 29 Apr 2011 10:45:11 +0000 (UTC) (envelope-from ae@FreeBSD.org) Received: from [127.0.0.1] (hub.freebsd.org [IPv6:2001:4f8:fff6::36]) by mx2.freebsd.org (Postfix) with ESMTP id 7E387150205; Fri, 29 Apr 2011 10:45:10 +0000 (UTC) Message-ID: <4DBA96AD.6090907@FreeBSD.org> Date: Fri, 29 Apr 2011 14:45:01 +0400 From: "Andrey V. Elsukov" User-Agent: Mozilla/5.0 (X11; U; FreeBSD amd64; en-US; rv:1.9.2.15) Gecko/20110309 Thunderbird/3.1.9 MIME-Version: 1.0 To: lev@FreeBSD.org References: <47517681.20110429004433@serebryakov.spb.ru> In-Reply-To: <47517681.20110429004433@serebryakov.spb.ru> X-Enigmail-Version: 1.1.2 OpenPGP: id=10C8A17A Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig2271D7AE40F10942305D93D4" Cc: freebsd-net@freebsd.org Subject: Re: dummynet, flowmask and IPv6 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 Apr 2011 10:45:11 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig2271D7AE40F10942305D93D4 Content-Type: text/plain; charset=KOI8-R Content-Transfer-Encoding: quoted-printable On 29.04.2011 00:44, Lev Serebryakov wrote: > Hello, Freebsd-net. >=20 > Does queue/sched masks work with IPv6 addresses? I can not find any > examples for this, all examples are with 32-bit masks only... Hi, it should work, just try use bigger masks values and ipv6 specifiers. --=20 WBR, Andrey V. Elsukov --------------enig2271D7AE40F10942305D93D4 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.17 (FreeBSD) iQEcBAEBAgAGBQJNupaxAAoJEAHF6gQQyKF6j9YIAI9BtgdAo+vueB1A+8mdNkGt xfYzutvmooZ5Q34Ww21546GoFCHsSH0U5JNHKQAi+2tVLKCQlX0hWBCTv9gZAW70 tmMPv16O327osVE6poJChiKG5/o8EPy4CS6ac68RnI3VQwPdjmRto0z3FwF4+218 oexRh6gXx7A2TmDV749TPWGvk6WquCAloMsAjgFXfGuvbpsDX+gIhtGb/P5zYROW r+j6IcIa1MSZUm2yopPpStlspxURVf2K19EbB5a9NNsNMOrr7kap4uCcGZncfhE8 zlWZspRiWaKNLFnOZL2A20xRKkjGNo54FANVlcE8mRf3Y9rwcqUvdHqt115frAA= =dhIL -----END PGP SIGNATURE----- --------------enig2271D7AE40F10942305D93D4-- From owner-freebsd-net@FreeBSD.ORG Fri Apr 29 11:00:24 2011 Return-Path: Delivered-To: freebsd-net@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A4BB71065677; Fri, 29 Apr 2011 11:00:24 +0000 (UTC) (envelope-from vwe@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 9AB0B8FC0A; Fri, 29 Apr 2011 11:00:21 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.4/8.14.4) with ESMTP id p3TB0LV2030649; Fri, 29 Apr 2011 11:00:21 GMT (envelope-from vwe@freefall.freebsd.org) Received: (from vwe@localhost) by freefall.freebsd.org (8.14.4/8.14.4/Submit) id p3TB0K9j030597; Fri, 29 Apr 2011 11:00:20 GMT (envelope-from vwe) Date: Fri, 29 Apr 2011 11:00:20 GMT Message-Id: <201104291100.p3TB0K9j030597@freefall.freebsd.org> To: egrosbein@rdtc.ru, eugen@k-45-pc-1.sd.rdtc.ru, vwe@FreeBSD.org, freebsd-net@FreeBSD.org From: vwe@FreeBSD.org Cc: Subject: Re: kern/153671: [em] [panic] 8.2-PRERELEASE repeatable kernel in if_em(4) X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 Apr 2011 11:00:24 -0000 Synopsis: [em] [panic] 8.2-PRERELEASE repeatable kernel in if_em(4) State-Changed-From-To: open->closed State-Changed-By: vwe State-Changed-When: Fri Apr 29 10:58:06 UTC 2011 State-Changed-Why: Eugene reported this issue has been solved and all changes are MFC'd to 8-STABLE. Thank you for reporting. http://www.freebsd.org/cgi/query-pr.cgi?pr=153671 From owner-freebsd-net@FreeBSD.ORG Fri Apr 29 15:12:44 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 63960106564A for ; Fri, 29 Apr 2011 15:12:44 +0000 (UTC) (envelope-from kungfujesus06@gmail.com) Received: from mail-iw0-f182.google.com (mail-iw0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id 1A0328FC15 for ; Fri, 29 Apr 2011 15:12:43 +0000 (UTC) Received: by iwn33 with SMTP id 33so4366937iwn.13 for ; Fri, 29 Apr 2011 08:12:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:date:from:to:cc:subject:message-id:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=vo4Qy+06+cACUNH/erPuJNUm/7xgimvkgPE7EP7vFUI=; b=X+kQ0ti+Lhj6hZqH0rECLI0x5xA/fyZRglLXen9SDkuyTah+0/DcqGRsbmPMfCauRA a4T/g9iqhv6qMSCwOGxyReV1OCvdMvU60+ws5QMkKmAaHg22yPRzFvm4FV0c60Ji7geV 2TvQybXu76c+CExDE6F9ld7GPET7F0Rs9pOmY= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; b=vuPhAG1h9OCSYpoU0QPMI7dim2loW5fghr51r9mnlX2E64TDWKuXy/MHJuc0DOwjsL elAMTB+E+AigfISMmlayRiehM7FHcYLSG/8ncRad4Bd3zByHx26uGqh28yHriX6TAd4/ ZHGCyu+c1z8uyOMWSNI2r5aBSo/RzPA7lHkoU= Received: by 10.42.228.68 with SMTP id jd4mr6022487icb.142.1304089963209; Fri, 29 Apr 2011 08:12:43 -0700 (PDT) Received: from ossumpossum.geop.uc.edu ([129.137.163.68]) by mx.google.com with ESMTPS id e12sm666371ics.19.2011.04.29.08.12.40 (version=TLSv1/SSLv3 cipher=OTHER); Fri, 29 Apr 2011 08:12:41 -0700 (PDT) Date: Fri, 29 Apr 2011 11:12:59 -0400 From: Adam Stylinski To: Jack Vogel Message-ID: <20110429151259.GA96064@ossumpossum.geop.uc.edu> References: <41EE7AB832F24194AC8730544E1C2EB7@multiplay.co.uk> <20110428152141.GA19362@ossumpossum.geop.uc.edu> <11659E32824B4B1E91B6B219BDEF1234@multiplay.co.uk> <20110428160919.GE19362@ossumpossum.geop.uc.edu> <20110428180037.GA1889@zephyr.snd-wireless.uc.edu> <20110428224749.GA47010@freebsdbox.adamsnet> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="45Z9DzgjV8m4Oswq" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-net@freebsd.org Subject: Re: em0 performance subpar X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 Apr 2011 15:12:44 -0000 --45Z9DzgjV8m4Oswq Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Apr 28, 2011 at 09:41:01PM -0700, Jack Vogel wrote: > We rarely test 32bit any more, the only time we would is because of a > problem, > so 99% is amd64, so that's not the problem. >=20 > Running netperf without any special arguments, using TCP_STREAM and > TCP_MAERTS tests what numbers are you seeing? >=20 > Jack >=20 >=20 > On Thu, Apr 28, 2011 at 5:34 PM, Adam Stylinski = wrote: >=20 > > On Thu, Apr 28, 2011 at 6:47 PM, Adam Stylinski wrote: > > > >> On Thu, Apr 28, 2011 at 02:22:29PM -0700, Jack Vogel wrote: > >> > My validation engineer set things up on an 8.2 REL system, testing t= he > >> > equivalent of > >> > HEAD, and he reports performance is fine. This is without any tweaks > >> from > >> > what's > >> > checked in. > >> > > >> > Increasing the descriptors to 4K is way overkill and might actually > >> cause > >> > problems, > >> > go back to default. > >> > > >> > He has a Linux test client, what are you transmitting to? > >> > > >> > Jack > >> > > >> > > >> > On Thu, Apr 28, 2011 at 11:00 AM, Adam Stylinski < > >> kungfujesus06@gmail.com>wrote: > >> > > >> > > On Thu, Apr 28, 2011 at 09:52:14AM -0700, Jack Vogel wrote: > >> > > > Adam, > >> > > > > >> > > > The TX ring for the legacy driver is small right now compared to= em, > >> try > >> > > > this experiment, > >> > > > edit if_lem.c, search for "lem_txd" and change EM_DEFAULT_TXD to > >> 1024, > >> > > see > >> > > > what > >> > > > that does, then 2048. > >> > > > > >> > > > My real strategy with the legacy code was that it should stable, > >> meaning > >> > > not > >> > > > getting > >> > > > a lot of changes... that really hasn't worked out over time. I > >> suppose > >> > > I'll > >> > > > have to try and > >> > > > give it some tweaks and let you try it. The problem with this co= de > >> is it > >> > > > technically supports > >> > > > a huge range of old stuff we don't test any more, things I do mi= ght > >> cause > >> > > > other regressions :( > >> > > > > >> > > > Oh well, let me know if increasing the TX descriptors helps. > >> > > > > >> > > > Jack > >> > > Jack, > >> > > > >> > > Is this the same thing as adjusting these values?: > >> > > > >> > > hw.em.rxd=3D4096 > >> > > hw.em.txd=3D4096 > >> > > > >> > > If so I've maxed this out and it's not helping. I'll give it a sh= ot > >> on my > >> > > 8-STABLE box as it has a kernel I can play with. > >> > > > >> > > Setting the MTU to 1500 gave lower throughput. > >> > > > >> > > -- > >> > > Adam Stylinski > >> > > PGP Key: http://pohl.ececs.uc.edu/~adam/publickey.pub > >> > > Blog: http://technicallyliving.blogspot.com > >> > > > >> > >> I am transmitting to a linux client (kernel 2.6.38, 9000 byte MTU, PCI= -Ex > >> based card). My sysctl's on the Linux client (apart from the default)= look > >> like so: > >> > >> net.ipv4.ip_forward =3D 0 > >> # Enables source route verification > >> net.ipv4.conf.default.rp_filter =3D 1 > >> # Enable reverse path > >> net.ipv4.conf.all.rp_filter =3D 1 > >> net.core.rmem_max =3D 16777216 > >> net.core.wmem_max =3D 16777216 > >> net.ipv4.tcp_rmem =3D 4096 87380 16777216 > >> net.ipv4.tcp_wmem =3D 4096 87380 16777216 > >> net.core.wmem_default =3D 87380 > >> net.core.rmem_default =3D 87380 > >> net.ipv4.tcp_mem =3D 98304 131072 196608 > >> net.ipv4.tcp_no_metrics_save =3D 1 > >> net.ipv4.tcp_window_scaling =3D 1 > >> dev.rtc.max-user-freq =3D 1024 > >> > >> The exact troublesome device (as reported by pciconf): > >> > >> em0@pci0:7:5:0: class=3D0x020000 card=3D0x13768086 chip=3D0x107c8086 r= ev=3D0x05 > >> hdr=3D0x00 > >> vendor =3D 'Intel Corporation' > >> device =3D 'Gigabit Ethernet Controller (Copper) rev 5 (82541P= I)' > >> class =3D network > >> subclass =3D ethernet > >> Apart from bus saturation (which I don't suspect is the problem) I'm n= ot > >> sure what the issue could be. What should I try next? > >> > >> -- > >> Adam Stylinski > >> PGP Key: http://pohl.ececs.uc.edu/~adam/publickey.pub > >> Blog: http://technicallyliving.blogspot.com > >> > > > > One detail that I didn't mention which may or may not matter is that the > > issues I'm having this with are on amd64 distributions. I have the same > > card in an x86 system and iperf with nearly default settings managed to= do > > 850ish Mbits. Did your lab tests consist of amd64 machines? > > TCP_STREAM: TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 192.168.0.121 (192= =2E168.0.121) port 0 AF_INET Recv Send Send =20 Socket Socket Message Elapsed =20 Size Size Size Time Throughput =20 bytes bytes bytes secs. 10^6bits/sec =20 87380 87380 87380 10.00 578.77 =20 TCP_MAERTS: TCP MAERTS TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 192.168.0.121 (192= =2E168.0.121) port 0 AF_INET Recv Send Send =20 Socket Socket Message Elapsed =20 Size Size Size Time Throughput =20 bytes bytes bytes secs. 10^6bits/sec =20 87380 87380 87380 10.00 836.91 interesting, so TCP_STREAM specifically has the issue. I suppose I could r= ead documentation on what the tests do but what does this tell? --=20 Adam Stylinski PGP Key: http://pohl.ececs.uc.edu/~adam/publickey.pub Blog: http://technicallyliving.blogspot.com --45Z9DzgjV8m4Oswq Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.17 (FreeBSD) iQIcBAEBAgAGBQJNutV7AAoJED6sRHE6Tvmne0EP+wblTPZyO6MOL7DYCdLbZ682 M2rnSztohrJkiGw4V7R5GB/fHLTbUgtO7/KwHVuc8ZeV/+RXd1iVGdxEK0MeV2a6 xEtosGqktyVTGAxhuEKRE69BckZ4uAMWBRycsZbT4DUrvv29b91ssAvr7uJGotbT kQS/Ask2qyvSLGyrhn8JcTx+vkkcpnF87xQajzMkzFSQ9jyhdmwFoYjMOuNSTWTe R5JOywe4+dAJ/c1ZTH5YlzllR3z4RTcxd4KGoP2yqowuLx1xL2mNgOCntBaLh3wQ NRqNOTw4jORC3p2tPOjywvy4H26F5gngpVoxs8Yh/vfaOsH2hm99FD1iHR3xTwoE AyEz3EkD6+ZEK9OvvOhPjbpdv5yKJl2iY9Hhf6YjpauEbnjLl/HOhTvTi1WhghJJ iFXceiMBxZ5QRgfNt/4TbGjC6i/bx4P/3/5XhDayl4lhNmBGNFHxTvx9ilEldoK8 5OmIy+gyqSTw2ap0gW9+aEDhLUruZIe/S5/RTEZ+9VlWhUgyC9Ihwu8WAMMpOPZW 9p0COJIi5ilS1VTisI+/pBHPFkwNDlzYWT3lnCYiQQFbq3pkqFZpOo4rsgP/ZWTw /NgIxqcMfNPz6STwIP0SS4YbijcP/OrMC3RnB/oyT94sCbpM25PtNcWwquN+Lztr WW+jAuofYN4GG+WqeB/0 =92UI -----END PGP SIGNATURE----- --45Z9DzgjV8m4Oswq-- From owner-freebsd-net@FreeBSD.ORG Fri Apr 29 18:28:56 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 814CF1065672 for ; Fri, 29 Apr 2011 18:28:56 +0000 (UTC) (envelope-from pyunyh@gmail.com) Received: from mail-pv0-f182.google.com (mail-pv0-f182.google.com [74.125.83.182]) by mx1.freebsd.org (Postfix) with ESMTP id 502658FC1A for ; Fri, 29 Apr 2011 18:28:56 +0000 (UTC) Received: by pvg11 with SMTP id 11so3170970pvg.13 for ; Fri, 29 Apr 2011 11:28:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:from:date:to:subject:message-id:reply-to :references:mime-version:content-type:content-disposition :in-reply-to:user-agent; bh=+nJaCvgFP+GAk3dfMu5ZK2gu8Tayzc3vSxuSpscfH0g=; b=wRMi0bVpu0HiIsxwxy6Vzq0SFbANeU6hVlwYjRIeYr3WOycVHv+jXlAn/wfwPeuihf jo2YOWs7plv/UB1Njp49XHnpi6KAiGS+xtBBeeP4GvNpGjyNsE8dWPdDbSCMV92tR/ML AXYBE6SbgYHvpYIVJ5AsLa8aVeWUcQFtnbqno= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:date:to:subject:message-id:reply-to:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; b=SSukikhR8CwO2ZDxfAbKf6SMtJRepNaDGNzevFb6aN4SQvhV+uDMr/pq7m1ORGdh1v 7NdWWPR+Nsizx1Iz/bp6/zy0zxPy29sHOKqhHbSxqOwTuNtAc4j6WPsw3zgcfR1GZWDI WT6f26heHjUIqKEqr/PYBB5SyUt0khggW7afU= Received: by 10.142.117.5 with SMTP id p5mr1934612wfc.246.1304101735789; Fri, 29 Apr 2011 11:28:55 -0700 (PDT) Received: from pyunyh@gmail.com ([174.35.1.224]) by mx.google.com with ESMTPS id p40sm3490216wfc.7.2011.04.29.11.28.52 (version=TLSv1/SSLv3 cipher=OTHER); Fri, 29 Apr 2011 11:28:53 -0700 (PDT) Received: by pyunyh@gmail.com (sSMTP sendmail emulation); Fri, 29 Apr 2011 11:28:07 -0700 From: YongHyeon PYUN Date: Fri, 29 Apr 2011 11:28:07 -0700 To: freebsd-net@freebsd.org Message-ID: <20110429182807.GA21084@michelle.cdnetworks.com> References: <201104290001.p3T01EvQ082443@artema.vpn.ibs> <20110429095231.GA17786@relay.ibs.dn.ua> Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="fUYQa+Pmc3FrFX/N" Content-Disposition: inline In-Reply-To: <20110429095231.GA17786@relay.ibs.dn.ua> User-Agent: Mutt/1.4.2.3i Subject: Re: collisions on tun interfaces ... X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: pyunyh@gmail.com List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 Apr 2011 18:28:56 -0000 --fUYQa+Pmc3FrFX/N Content-Type: text/plain; charset=us-ascii Content-Disposition: inline On Fri, Apr 29, 2011 at 12:52:31PM +0300, Zeus V Panchenko wrote: > Hi, > > may somebody epxplain it for me, what can cause collisions on tun > interfaces created by ppp(8) and openvpn? > > > uname -a > FreeBSD 8.2-STABLE #0 i386 > > > netstat -i > Name Mtu Network Address Ipkts Ierrs Idrop Opkts Oerrs Coll > tun0 1492 18940349 0 0 15737760 0 45668 > tun0 1492 A.B.C.D A-B-C-D.domain 15623965 - - 12429351 - - > tun1 1500 12721670 0 0 9957662 0 11161 > tun1 1500 E.F.G.H E-F-G-H.vpn 6454 - - 445751 - - > > > rl0: flags=8843 metric 0 mtu 1500 > options=3808 > ether 00:30:4f:67:cf:81 > media: Ethernet autoselect (100baseTX ) > status: active > tun0: flags=8051 metric 0 mtu 1492 > options=80000 > inet A.B.C.D --> A1.B1.C1.D1 netmask 0xffffffff > Opened by PID 3943 > tun1: flags=8051 metric 0 mtu 1500 > options=80000 > inet E.F.G.H --> E1.F1.G1.H1 netmask 0xffffffff > Opened by PID 1387 > > tun0 is created by ppp(8) > > in /etc/ppp.conf is: > default: > set log Phase Chat LCP IPCP CCP tun command > set server /var/run/ppp/internet "" 0177 > set device PPPoE:rl0 > set speed sync > enable lqr echo > set lqrperiod 30 > set login > set ctsrts off > add default HISADDR > set timeout 0 > set redial 0 0 > set cd 5 > > tun1 is created by OpenVPN with configuration: > client > dev tun1 > proto udp > ... > > so, what can cause the collisions and can i fix them? > It seems tun(4) just increments collision counter whenever it can't enqueue packet. Because it's not collision at all I think it's a bug that had been there from day 1. Just nuking updating the counter will address the issue. You still can get the previous collision counter of tun(4) with d option of netstat which shows number of packets dropped due to send queue full. --fUYQa+Pmc3FrFX/N Content-Type: text/x-diff; charset=us-ascii Content-Disposition: attachment; filename="tun.diff" Index: sys/net/if_tun.c =================================================================== --- sys/net/if_tun.c (revision 221175) +++ sys/net/if_tun.c (working copy) @@ -661,10 +661,8 @@ } error = (ifp->if_transmit)(ifp, m0); - if (error) { - ifp->if_collisions++; + if (error) return (ENOBUFS); - } ifp->if_opackets++; return (0); } --fUYQa+Pmc3FrFX/N-- From owner-freebsd-net@FreeBSD.ORG Fri Apr 29 18:46:36 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7DE94106564A for ; Fri, 29 Apr 2011 18:46:36 +0000 (UTC) (envelope-from zeus@relay.ibs.dn.ua) Received: from relay.ibs.dn.ua (relay.ibs.dn.ua [91.216.196.25]) by mx1.freebsd.org (Postfix) with ESMTP id 157238FC0A for ; Fri, 29 Apr 2011 18:46:35 +0000 (UTC) Received: from relay.ibs.dn.ua (localhost [127.0.0.1]) by relay.ibs.dn.ua with ESMTP id p3TIkYtH042146 for ; Fri, 29 Apr 2011 21:46:34 +0300 (EEST) Received: (from zeus@localhost) by relay.ibs.dn.ua (8.14.4/8.14.4/Submit) id p3TIkYLi042145 for freebsd-net@freebsd.org; Fri, 29 Apr 2011 21:46:34 +0300 (EEST) Date: Fri, 29 Apr 2011 21:46:34 +0300 From: Zeus V Panchenko To: freebsd-net@freebsd.org Message-ID: <20110429184634.GA34176@relay.ibs.dn.ua> Mail-Followup-To: freebsd-net@freebsd.org References: <201104290001.p3T01EvQ082443@artema.vpn.ibs> <20110429095231.GA17786@relay.ibs.dn.ua> <20110429182807.GA21084@michelle.cdnetworks.com> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline In-Reply-To: <20110429182807.GA21084@michelle.cdnetworks.com> User-Agent: Mutt/1.4.2.3i X-Operating-System: FreeBSD 8.1-RELEASE X-Editor: GNU Emacs 23.2.1 X-Face: iVBORw0KGgoAAAANSUhEUgAAACoAAAAqBAMAAAA37dRoAAAAFVBMVEWjjoiZhHDWzcZuW1U wOT+RcGxziJxEN0lIAAABrklEQVQokV2STXLbMAyFQaraE3a5dzSTfR1IF7CQrM3QuECn9z9DH0 gxzgSyFvr88PBD0uJxoR6BE+e8LtRgohE5ZB50sODP/REbfUnte/z12+llCekLUSKenFIMke6Be WinE8H0RJHSN71rUQp64gFDmtDDhRk0zam3FzpNVFprhwPGaFo6oY9wDBJQ9Qz6EuKyROJjDGa+ uza4VOTa8iHlN58Yv5BF9+4BGl0LA5pUD5xKXg4aQlVZm0co3NKxCGxQpu3aC352Gv3DZONmwQd tkrlaylV3YSew7bWtwAZF/zi9jblmprPoL7ktzeFSxmarVNmWRi+Bmxg7Y7tbGtR8XZUxLTo86G thANsssetjp3POuBvMBRlw6jRa5pKN7yVlP+F2lyiZGSMf5hnSU6eAVupmtfjRcxy0momwpxDnz 06hwnOWvBnUdR8U2/KX7cq26u1Jy5xFZMPOVONRbRUrwey8Qar6cWgf12xSymQuVX0DfYd4R8kN Hg0qCtLeaYZcj8B90M2N0cEX1P0vKSxw7NLy/3X8Qeriusu66jNA37P4Mn5QRTG2hz4d9D/6E3a EX852nwAAAABJRU5ErkJggg== Subject: Re: collisions on tun interfaces ... X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: zeus@ibs.dn.ua List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 Apr 2011 18:46:36 -0000 YongHyeon PYUN (pyunyh@gmail.com) [11.04.29 21:29] wrote: > On Fri, Apr 29, 2011 at 12:52:31PM +0300, Zeus V Panchenko wrote: > > Hi, > > > > may somebody epxplain it for me, what can cause collisions on tun > > interfaces created by ppp(8) and openvpn? > > > > > uname -a > > FreeBSD 8.2-STABLE #0 i386 > > > > > netstat -i > > Name Mtu Network Address Ipkts Ierrs Idrop Opkts Oerrs Coll > > tun0 1492 18940349 0 0 15737760 0 45668 > > tun0 1492 A.B.C.D A-B-C-D.domain 15623965 - - 12429351 - - > > tun1 1500 12721670 0 0 9957662 0 11161 > > tun1 1500 E.F.G.H E-F-G-H.vpn 6454 - - 445751 - - > > > > > > rl0: flags=8843 metric 0 mtu 1500 > > options=3808 > > ether 00:30:4f:67:cf:81 > > media: Ethernet autoselect (100baseTX ) > > status: active > > tun0: flags=8051 metric 0 mtu 1492 > > options=80000 > > inet A.B.C.D --> A1.B1.C1.D1 netmask 0xffffffff > > Opened by PID 3943 > > tun1: flags=8051 metric 0 mtu 1500 > > options=80000 > > inet E.F.G.H --> E1.F1.G1.H1 netmask 0xffffffff > > Opened by PID 1387 > > > > tun0 is created by ppp(8) > > > > in /etc/ppp.conf is: > > default: > > set log Phase Chat LCP IPCP CCP tun command > > set server /var/run/ppp/internet "" 0177 > > set device PPPoE:rl0 > > set speed sync > > enable lqr echo > > set lqrperiod 30 > > set login > > set ctsrts off > > add default HISADDR > > set timeout 0 > > set redial 0 0 > > set cd 5 > > > > tun1 is created by OpenVPN with configuration: > > client > > dev tun1 > > proto udp > > ... > > > > so, what can cause the collisions and can i fix them? > > > > It seems tun(4) just increments collision counter whenever it > can't enqueue packet. Because it's not collision at all I think > it's a bug that had been there from day 1. Just nuking updating the > counter will address the issue. You still can get the previous > collision counter of tun(4) with d option of netstat which shows > number of packets dropped due to send queue full. thanks, and is there way to influence that? -- Zeus V. Panchenko IT Dpt., IBS ltd GMT+2 (EET) From owner-freebsd-net@FreeBSD.ORG Fri Apr 29 18:56:53 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EE731106566C for ; Fri, 29 Apr 2011 18:56:52 +0000 (UTC) (envelope-from pyunyh@gmail.com) Received: from mail-pv0-f182.google.com (mail-pv0-f182.google.com [74.125.83.182]) by mx1.freebsd.org (Postfix) with ESMTP id BF4778FC08 for ; Fri, 29 Apr 2011 18:56:52 +0000 (UTC) Received: by pvg11 with SMTP id 11so3183301pvg.13 for ; Fri, 29 Apr 2011 11:56:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:from:date:to:subject:message-id:reply-to :references:mime-version:content-type:content-disposition :in-reply-to:user-agent; bh=P1pKVcnaAkTg5LgW2Ky4lddZnzl3RJRT3gL/3tF2NxU=; b=x5V6QNeIyvlG5ZlSuw0rJcFWvAAk3hR0941N+t9smPoCQosOHjCgoaPa2NBa1v/jHF XICxA9MYLe1Ie7D34wFWK5hhhH2DzS460N826xVL8I62S+0PzorJs+I5H9h69h0kFZSZ MjluzQOltViOHp6YrfmrhNAeO6UofjHh/Faz4= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:date:to:subject:message-id:reply-to:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; b=kvK0V7tXuJqOSsnunxFl19B+pxMf7WzKYrzySqho6XrUSodP6elTt9DA7cgshi9dke 11ZUkwdzxeEmzkSF2G7T1jO0F7gPfR2ytyRog5mdQtE/jvYtngxXcLvDq9w/9Z0YovrP dXM9wEbEjrhMyoLcSWzqcXFHX0qPEpvTau9Hc= Received: by 10.68.19.136 with SMTP id f8mr96406pbe.173.1304103412325; Fri, 29 Apr 2011 11:56:52 -0700 (PDT) Received: from pyunyh@gmail.com ([174.35.1.224]) by mx.google.com with ESMTPS id q20sm2070143pbt.72.2011.04.29.11.56.50 (version=TLSv1/SSLv3 cipher=OTHER); Fri, 29 Apr 2011 11:56:51 -0700 (PDT) Received: by pyunyh@gmail.com (sSMTP sendmail emulation); Fri, 29 Apr 2011 11:56:05 -0700 From: YongHyeon PYUN Date: Fri, 29 Apr 2011 11:56:05 -0700 To: freebsd-net@freebsd.org Message-ID: <20110429185605.GB21084@michelle.cdnetworks.com> References: <201104290001.p3T01EvQ082443@artema.vpn.ibs> <20110429095231.GA17786@relay.ibs.dn.ua> <20110429182807.GA21084@michelle.cdnetworks.com> <20110429184634.GA34176@relay.ibs.dn.ua> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20110429184634.GA34176@relay.ibs.dn.ua> User-Agent: Mutt/1.4.2.3i Subject: Re: collisions on tun interfaces ... X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: pyunyh@gmail.com List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 Apr 2011 18:56:53 -0000 On Fri, Apr 29, 2011 at 09:46:34PM +0300, Zeus V Panchenko wrote: > YongHyeon PYUN (pyunyh@gmail.com) [11.04.29 21:29] wrote: > > On Fri, Apr 29, 2011 at 12:52:31PM +0300, Zeus V Panchenko wrote: > > > Hi, > > > > > > may somebody epxplain it for me, what can cause collisions on tun > > > interfaces created by ppp(8) and openvpn? > > > > > > > uname -a > > > FreeBSD 8.2-STABLE #0 i386 > > > > > > > netstat -i > > > Name Mtu Network Address Ipkts Ierrs Idrop Opkts Oerrs Coll > > > tun0 1492 18940349 0 0 15737760 0 45668 > > > tun0 1492 A.B.C.D A-B-C-D.domain 15623965 - - 12429351 - - > > > tun1 1500 12721670 0 0 9957662 0 11161 > > > tun1 1500 E.F.G.H E-F-G-H.vpn 6454 - - 445751 - - > > > > > > > > > rl0: flags=8843 metric 0 mtu 1500 > > > options=3808 > > > ether 00:30:4f:67:cf:81 > > > media: Ethernet autoselect (100baseTX ) > > > status: active > > > tun0: flags=8051 metric 0 mtu 1492 > > > options=80000 > > > inet A.B.C.D --> A1.B1.C1.D1 netmask 0xffffffff > > > Opened by PID 3943 > > > tun1: flags=8051 metric 0 mtu 1500 > > > options=80000 > > > inet E.F.G.H --> E1.F1.G1.H1 netmask 0xffffffff > > > Opened by PID 1387 > > > > > > tun0 is created by ppp(8) > > > > > > in /etc/ppp.conf is: > > > default: > > > set log Phase Chat LCP IPCP CCP tun command > > > set server /var/run/ppp/internet "" 0177 > > > set device PPPoE:rl0 > > > set speed sync > > > enable lqr echo > > > set lqrperiod 30 > > > set login > > > set ctsrts off > > > add default HISADDR > > > set timeout 0 > > > set redial 0 0 > > > set cd 5 > > > > > > tun1 is created by OpenVPN with configuration: > > > client > > > dev tun1 > > > proto udp > > > ... > > > > > > so, what can cause the collisions and can i fix them? > > > > > > > It seems tun(4) just increments collision counter whenever it > > can't enqueue packet. Because it's not collision at all I think > > it's a bug that had been there from day 1. Just nuking updating the > > counter will address the issue. You still can get the previous > > collision counter of tun(4) with d option of netstat which shows > > number of packets dropped due to send queue full. > > thanks, and is there way to influence that? > Sending lots of packets within short interval may overflow interface's send queue. Try sending UDP packets with netperf and see what counters are changed during the test with something like "netstat -ndI tun0 -w 1". From owner-freebsd-net@FreeBSD.ORG Fri Apr 29 21:08:52 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6FF9B1065674; Fri, 29 Apr 2011 21:08:52 +0000 (UTC) (envelope-from weongyo.jeong@gmail.com) Received: from mail-pz0-f54.google.com (mail-pz0-f54.google.com [209.85.210.54]) by mx1.freebsd.org (Postfix) with ESMTP id 391F08FC0C; Fri, 29 Apr 2011 21:08:51 +0000 (UTC) Received: by pzk27 with SMTP id 27so3042479pzk.13 for ; Fri, 29 Apr 2011 14:08:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:from:date:to:cc:subject:message-id:reply-to :mail-followup-to:mime-version:content-type:content-disposition :user-agent:organization:x-operation-sytem; bh=zp7uIp4YRZQ53uHNOkUZ969CE7U67ct+0nT3El142XQ=; b=k43avymGLKyRAk6sgxnuiY0vSBsHRxga4mLelE++hE+e6W4skUF2K2bjC1UDwIr1IR b+ykJbNKYPV3kt+kht9+dCKNYPPmQ0S0B8u6XFAC0iVHs1E4Lj2IFPKo1ulvrzCsY3gI QsVSJWgwf+86+UKai+VkiSIooF5pKGrKIuvng= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:date:to:cc:subject:message-id:reply-to:mail-followup-to :mime-version:content-type:content-disposition:user-agent :organization:x-operation-sytem; b=kPHPX7/LgTUBgKZC1Eeq2NqN3E0zNCP+noTS1Zk9WwaS5HdNIIaumKLA5TfzH11PFX wXiZSMrUPlDRk2c7ZC0ULMawowRjRLc2Scne273eaKcHjWqptEAnXIQQMKu7JX1ISCEc gxdK8e11mayAlGn9Pt5jj3rv9H90Bi8Wq8bGM= Received: by 10.68.23.133 with SMTP id m5mr5533127pbf.73.1304109958035; Fri, 29 Apr 2011 13:45:58 -0700 (PDT) Received: from weongyo ([174.35.1.224]) by mx.google.com with ESMTPS id x4sm2119055pbr.71.2011.04.29.13.45.55 (version=SSLv3 cipher=OTHER); Fri, 29 Apr 2011 13:45:57 -0700 (PDT) Received: by weongyo (sSMTP sendmail emulation); Fri, 29 Apr 2011 13:46:02 -0700 From: Weongyo Jeong Date: Fri, 29 Apr 2011 13:46:02 -0700 To: freebsd-current@freebsd.org Message-ID: <20110429204602.GA36896@weongyo> Mail-Followup-To: freebsd-current@freebsd.org, freebsd-net@freebsd.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.2.3i Organization: CDNetworks. X-Operation-Sytem: FreeBSD Cc: freebsd-net@freebsd.org Subject: [CFT] Forward RTO recovery algorithm (rfc5682) patch X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Weongyo Jeong List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 Apr 2011 21:08:52 -0000 Hello, I sent a email to current@ two months ago about F-RTO patch CFR but didn't get proper feedbacks from yours. And at now two months later, I have prepared my final code for F-RTO patch and checked it's working for SACK enabled and disabled environments: http://people.freebsd.org/~weongyo/rfc5682/ The above links include some graphs before and after applying RFC5682 patch and a patch I prepared. If no objections I'd like to commit it into HEAD and still welcomes your opinions and reviews. If you have any concerns and questions please let me know. regards, Weongyo Jeong From owner-freebsd-net@FreeBSD.ORG Sat Apr 30 07:27:01 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2C3E8106564A for ; Sat, 30 Apr 2011 07:27:01 +0000 (UTC) (envelope-from e0326715@student.tuwien.ac.at) Received: from mr.tuwien.ac.at (mr1-n.kom.tuwien.ac.at [128.130.2.109]) by mx1.freebsd.org (Postfix) with ESMTP id B0AE38FC12 for ; Sat, 30 Apr 2011 07:27:00 +0000 (UTC) Received: from webmail1.zserv.tuwien.ac.at (webmail1.zserv.tuwien.ac.at [128.130.35.11]) by mr.tuwien.ac.at (8.13.7/8.13.7) with ESMTP id p3U7BmNw010117 for ; Sat, 30 Apr 2011 09:11:48 +0200 (MEST) Received: from webmail1.zserv.tuwien.ac.at (localhost.localdomain [127.0.0.1]) by webmail1.zserv.tuwien.ac.at (8.13.8/8.13.8) with ESMTP id p3U7BmQK017254 for ; Sat, 30 Apr 2011 09:11:48 +0200 Received: (from apache@localhost) by webmail1.zserv.tuwien.ac.at (8.13.8/8.13.8/Submit) id p3U7BmNo017253 for freebsd-net@freebsd.org; Sat, 30 Apr 2011 09:11:48 +0200 Received: from 109-126-89-057.dyn.orange.at (109-126-89-057.dyn.orange.at [109.126.89.57]) by webmail.tuwien.ac.at (Horde Framework) with HTTP; Sat, 30 Apr 2011 09:11:48 +0200 Message-ID: <20110430091148.31393q3py4j4bg38@webmail.tuwien.ac.at> Date: Sat, 30 Apr 2011 09:11:48 +0200 From: Schoch Christian To: freebsd-net@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; DelSp="Yes"; format="flowed" Content-Disposition: inline Content-Transfer-Encoding: 7bit User-Agent: Internet Messaging Program (IMP) H3 (4.3.9) X-Virus-Scanned: by amavisd-new Subject: [SCTP] ICMP unreachable message reenables data transmit X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 30 Apr 2011 07:27:01 -0000 During a measurement with CMT-SCTP and PF i figured out, that sometimes a ICMP Destination unreachable message triggers a message transmission on an inactive data path that has been primary before. It looks as the ICMP message is reseting the inactive state back to active without reseting RTO. This behavior is triggered by a returning heartbeat message when no ICMP unreachable by data is sent quite before. Test system are two multi-homed hosts with FreeBSD8.1 and a WANem host between. A wireshark log can be provided on demand (quite large). Regards, Schoch Christian From owner-freebsd-net@FreeBSD.ORG Sat Apr 30 09:03:00 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DE4BF106566C for ; Sat, 30 Apr 2011 09:03:00 +0000 (UTC) (envelope-from Michael.Tuexen@lurchi.franken.de) Received: from mail-n.franken.de (drew.ipv6.franken.de [IPv6:2001:638:a02:a001:20e:cff:fe4a:feaa]) by mx1.freebsd.org (Postfix) with ESMTP id 488A28FC08 for ; Sat, 30 Apr 2011 09:03:00 +0000 (UTC) Received: from [192.168.1.192] (p508FBA66.dip.t-dialin.net [80.143.186.102]) (Authenticated sender: macmic) by mail-n.franken.de (Postfix) with ESMTP id 023061C0C0BE9; Sat, 30 Apr 2011 11:02:57 +0200 (CEST) Mime-Version: 1.0 (Apple Message framework v1084) Content-Type: text/plain; charset=us-ascii From: =?iso-8859-1?Q?Michael_T=FCxen?= In-Reply-To: <20110430091148.31393q3py4j4bg38@webmail.tuwien.ac.at> Date: Sat, 30 Apr 2011 11:02:55 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: References: <20110430091148.31393q3py4j4bg38@webmail.tuwien.ac.at> To: Schoch Christian X-Mailer: Apple Mail (2.1084) Cc: freebsd-net@freebsd.org Subject: Re: [SCTP] ICMP unreachable message reenables data transmit X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 30 Apr 2011 09:03:00 -0000 On Apr 30, 2011, at 9:11 AM, Schoch Christian wrote: > During a measurement with CMT-SCTP and PF i figured out, that = sometimes a ICMP Destination unreachable message triggers a message = transmission on an inactive data path that has been primary before. >=20 > It looks as the ICMP message is reseting the inactive state back to = active without reseting RTO. >=20 > This behavior is triggered by a returning heartbeat message when no = ICMP unreachable by data is sent quite before. >=20 > Test system are two multi-homed hosts with FreeBSD8.1 and a WANem host = between. >=20 > A wireshark log can be provided on demand (quite large). Hi Christian, any chance to upgrade the FreeBSD machines to head or to use newer SCTP sources, which I could provide? It would require a recompilation of the kernel... Are you using IPv4 or IPv6? Best regards Michael >=20 > Regards, > Schoch Christian > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >=20 From owner-freebsd-net@FreeBSD.ORG Sat Apr 30 10:15:22 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 490F4106564A for ; Sat, 30 Apr 2011 10:15:22 +0000 (UTC) (envelope-from e0326715@student.tuwien.ac.at) Received: from mr.tuwien.ac.at (mr2-n.kom.tuwien.ac.at [128.130.2.110]) by mx1.freebsd.org (Postfix) with ESMTP id AE8FD8FC12 for ; Sat, 30 Apr 2011 10:15:21 +0000 (UTC) Received: from webmail1.zserv.tuwien.ac.at (webmail1.zserv.tuwien.ac.at [128.130.35.11]) by mr.tuwien.ac.at (8.13.7/8.13.7) with ESMTP id p3UAFI4j016495; Sat, 30 Apr 2011 12:15:19 +0200 (MEST) Received: from webmail1.zserv.tuwien.ac.at (localhost.localdomain [127.0.0.1]) by webmail1.zserv.tuwien.ac.at (8.13.8/8.13.8) with ESMTP id p3UAFIng030296; Sat, 30 Apr 2011 12:15:18 +0200 Received: (from apache@localhost) by webmail1.zserv.tuwien.ac.at (8.13.8/8.13.8/Submit) id p3UAFI54030295; Sat, 30 Apr 2011 12:15:18 +0200 Received: from 46-57-60-170.dyn.orange.at (46-57-60-170.dyn.orange.at [46.57.60.170]) by webmail.tuwien.ac.at (Horde Framework) with HTTP; Sat, 30 Apr 2011 12:15:18 +0200 Message-ID: <20110430121518.25761cpmtrp0jtpy@webmail.tuwien.ac.at> Date: Sat, 30 Apr 2011 12:15:18 +0200 From: Schoch Christian To: Michael =?iso-8859-1?b?VPx4ZW4=?= References: <20110430091148.31393q3py4j4bg38@webmail.tuwien.ac.at> In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; DelSp="Yes"; format="flowed" Content-Disposition: inline Content-Transfer-Encoding: quoted-printable User-Agent: Dynamic Internet Messaging Program (DIMP) H3 (1.1.6) X-Virus-Scanned: by amavisd-new Cc: freebsd-net@freebsd.org Subject: Re: [SCTP] ICMP unreachable message reenables data transmit X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 30 Apr 2011 10:15:22 -0000 Zitat von Michael T=FCxen : > On Apr 30, 2011, at 9:11 AM, Schoch Christian wrote: > >> During a measurement with CMT-SCTP and PF i figured out, that =20 >> sometimes a ICMP Destination unreachable message triggers a message =20 >> transmission on an inactive data path that has been primary before. >> >> It looks as the ICMP message is reseting the inactive state back to =20 >> active without reseting RTO. >> >> This behavior is triggered by a returning heartbeat message when no =20 >> ICMP unreachable by data is sent quite before. >> >> Test system are two multi-homed hosts with FreeBSD8.1 and a WANem =20 >> host between. >> >> A wireshark log can be provided on demand (quite large). > Hi Christian, > > any chance to upgrade the FreeBSD machines to head or to use newer > SCTP sources, which I could provide? It would require a recompilation > of the kernel... It is possible, but the results could be provided not until next week if a reboot is necessary. I can use any sources you could provide me since nothing else is done =20 at this systems. > > Are you using IPv4 or IPv6? > IPv4 > Best regards > Michael >> >> Regards, >> Schoch Christian >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >> > > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" > From owner-freebsd-net@FreeBSD.ORG Sat Apr 30 10:32:29 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BCD511065672 for ; Sat, 30 Apr 2011 10:32:29 +0000 (UTC) (envelope-from Michael.Tuexen@lurchi.franken.de) Received: from mail-n.franken.de (drew.ipv6.franken.de [IPv6:2001:638:a02:a001:20e:cff:fe4a:feaa]) by mx1.freebsd.org (Postfix) with ESMTP id A00998FC18 for ; Sat, 30 Apr 2011 10:32:28 +0000 (UTC) Received: from [192.168.1.192] (p508FBA66.dip.t-dialin.net [80.143.186.102]) (Authenticated sender: macmic) by mail-n.franken.de (Postfix) with ESMTP id 99A181C0C0BE9; Sat, 30 Apr 2011 12:32:27 +0200 (CEST) Mime-Version: 1.0 (Apple Message framework v1084) Content-Type: text/plain; charset=iso-8859-1 From: =?iso-8859-1?Q?Michael_T=FCxen?= In-Reply-To: <20110430121518.25761cpmtrp0jtpy@webmail.tuwien.ac.at> Date: Sat, 30 Apr 2011 12:32:26 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: References: <20110430091148.31393q3py4j4bg38@webmail.tuwien.ac.at> <20110430121518.25761cpmtrp0jtpy@webmail.tuwien.ac.at> To: Schoch Christian X-Mailer: Apple Mail (2.1084) Cc: freebsd-net@freebsd.org Subject: Re: [SCTP] ICMP unreachable message reenables data transmit X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 30 Apr 2011 10:32:29 -0000 On Apr 30, 2011, at 12:15 PM, Schoch Christian wrote: >=20 > Zitat von Michael T=FCxen : >=20 >> On Apr 30, 2011, at 9:11 AM, Schoch Christian wrote: >>=20 >>> During a measurement with CMT-SCTP and PF i figured out, that = sometimes a ICMP Destination unreachable message triggers a message = transmission on an inactive data path that has been primary before. >>>=20 >>> It looks as the ICMP message is reseting the inactive state back to = active without reseting RTO. >>>=20 >>> This behavior is triggered by a returning heartbeat message when no = ICMP unreachable by data is sent quite before. >>>=20 >>> Test system are two multi-homed hosts with FreeBSD8.1 and a WANem = host between. >>>=20 >>> A wireshark log can be provided on demand (quite large). >> Hi Christian, >>=20 >> any chance to upgrade the FreeBSD machines to head or to use newer >> SCTP sources, which I could provide? It would require a recompilation >> of the kernel... >=20 > It is possible, but the results could be provided not until next week > if a reboot is necessary. > I can use any sources you could provide me since nothing else is done = at this systems. OK, but maybe I can try to understand what is going on. How many paths do you have? One is inactive, but was primary, so it is confirmed. On another one, you get an ICMP (which one? Port = unreachable, host unreachable, ...). Do you have more than two paths? The ICMP message would not reset the RTO, since you need an ACKed TSN or a HB-ACK to to that. Since it is inactive, it is missing these. Sending on an inactive path is OK, as soon as you enter the dormant state, which means all your paths are inactive. Are you using the PF support for CMT? Best regards Michael >=20 >>=20 >> Are you using IPv4 or IPv6? >>=20 >=20 > IPv4 >=20 >=20 >> Best regards >> Michael >>>=20 >>> Regards, >>> Schoch Christian >>> _______________________________________________ >>> freebsd-net@freebsd.org mailing list >>> http://lists.freebsd.org/mailman/listinfo/freebsd-net >>> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >>>=20 >>=20 >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to = "freebsd-net-unsubscribe@freebsd.org" >>=20 >=20 >=20 From owner-freebsd-net@FreeBSD.ORG Sat Apr 30 10:44:51 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 36E8A106566B for ; Sat, 30 Apr 2011 10:44:51 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.friendlyhosting.spb.ru (onlyone.friendlyhosting.spb.ru [IPv6:2a01:4f8:131:60a2::2]) by mx1.freebsd.org (Postfix) with ESMTP id CB1E88FC14 for ; Sat, 30 Apr 2011 10:44:50 +0000 (UTC) Received: from lion.home.serebryakov.spb.ru (unknown [IPv6:2001:470:923f:1:c9d:ce4b:69a5:29c1]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.friendlyhosting.spb.ru (Postfix) with ESMTPA id 06D824AC2D for ; Sat, 30 Apr 2011 14:44:48 +0400 (MSD) Date: Sat, 30 Apr 2011 14:44:40 +0400 From: Lev Serebryakov Organization: FreeBSD X-Priority: 3 (Normal) Message-ID: <278293310.20110430144440@serebryakov.spb.ru> To: freebsd-net@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=windows-1251 Content-Transfer-Encoding: quoted-printable Subject: gif interface uses IPv4 address before it is assigned to "real" interface. Is it ok? X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: lev@FreeBSD.org List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 30 Apr 2011 10:44:51 -0000 Hello, Freebsd-net. It seems, gif, configured with "tunnel my-IPv4 other-IPv4" starts to send IPv4 packages BEFORE "my-IPv4" is assigned to any interface in system. I have system, which connected to IPv4-internet via PPPoE with mpd5. Also, it is connected to IPv6-internet with tunnel from Hurricane Electric. gif0 is configured before mpd5 starts, so, my real IPv4 address is not present in system when gif0 is configured. But gif0 sends packets BEFORE mpd5 start into physical interface, which connects me with ISP. It has 10/8 address, and NAT on it to allow to communicate with ISP's local network. NAT and firewall is stateful, so NAT "from my-IPv4 to 10/8" works and remember this state. After that, all incoming packets from tunnel are de-NATed to 10/8 address, which is complete madness :) Why gif0 uses address which is not configured on any underlying interface yet? Is here any way to reset state of only ONE stateful ipfw rule from command line, which could be work-around for me? --=20 // Black Lion AKA Lev Serebryakov From owner-freebsd-net@FreeBSD.ORG Sat Apr 30 15:35:24 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 28E89106566B for ; Sat, 30 Apr 2011 15:35:24 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-vx0-f182.google.com (mail-vx0-f182.google.com [209.85.220.182]) by mx1.freebsd.org (Postfix) with ESMTP id D22328FC16 for ; Sat, 30 Apr 2011 15:35:23 +0000 (UTC) Received: by vxc34 with SMTP id 34so4557447vxc.13 for ; Sat, 30 Apr 2011 08:35:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; bh=eSSAQJzZrk2kIBRl1JwK+ehyVFMuovC3YrHs1qF5AEc=; b=rFS8uIkc+a3Jqaf0SELZtou2HRhJjqET4CkQvUw2hB27mWh9bPQ4pg7wQ66grFVDly S28kWoF1RsVuRC5eD/RX26wyWLSWa+NkLzGxIfj/0hiVKyasCos3f4AliPBpaBRZcwVR kId3GG8I/ohOKMg/o257B22AfUFEsjAyLC7Ok= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; b=tvmS6gDA237cSwdSVCTB7KEzxpzR9eRlatpPKfEA9hvxvcF7uJry7f/4fm1lFDfGS+ /To25pAOTuL7yTqZs9pg7tkraiLlPlJopTFvEcJ4dC9MbXDBeS4dS51ZuKAiVegX8eE0 IqHrlgFqRp5HClsbSU1YBRojvP0lETRa0v+UY= MIME-Version: 1.0 Received: by 10.52.74.37 with SMTP id q5mr1482902vdv.182.1304177722964; Sat, 30 Apr 2011 08:35:22 -0700 (PDT) Sender: adrian.chadd@gmail.com Received: by 10.52.157.202 with HTTP; Sat, 30 Apr 2011 08:35:22 -0700 (PDT) In-Reply-To: <20110429185605.GB21084@michelle.cdnetworks.com> References: <201104290001.p3T01EvQ082443@artema.vpn.ibs> <20110429095231.GA17786@relay.ibs.dn.ua> <20110429182807.GA21084@michelle.cdnetworks.com> <20110429184634.GA34176@relay.ibs.dn.ua> <20110429185605.GB21084@michelle.cdnetworks.com> Date: Sat, 30 Apr 2011 23:35:22 +0800 X-Google-Sender-Auth: 2CkWynFXkQlhBptftCbhM9B8yFs Message-ID: From: Adrian Chadd To: pyunyh@gmail.com Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-net@freebsd.org Subject: Re: collisions on tun interfaces ... X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 30 Apr 2011 15:35:24 -0000 On 30 April 2011 02:56, YongHyeon PYUN wrote: > Sending lots of packets within short interval may overflow > interface's send queue. Try sending UDP packets with netperf and > see what counters are changed during the test with something like > "netstat -ndI tun0 -w 1". The default sendq is 50. What about considering bumping that? Adrian From owner-freebsd-net@FreeBSD.ORG Sat Apr 30 20:44:27 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C02B4106566B; Sat, 30 Apr 2011 20:44:27 +0000 (UTC) (envelope-from pyunyh@gmail.com) Received: from mail-pz0-f54.google.com (mail-pz0-f54.google.com [209.85.210.54]) by mx1.freebsd.org (Postfix) with ESMTP id 84B9A8FC12; Sat, 30 Apr 2011 20:44:27 +0000 (UTC) Received: by pzk27 with SMTP id 27so3406452pzk.13 for ; Sat, 30 Apr 2011 13:44:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:from:date:to:cc:subject:message-id:reply-to :references:mime-version:content-type:content-disposition :in-reply-to:user-agent; bh=vitaDuskXSUoHe1qzDRrlYi2gap/Eph54ak2FxzoaAg=; b=uNoN1YMC5+5KrjK3//0XKEOdCA53i1u5zs8ccUPYM8ZUMilMJp/t9rGsQ9ijZ/zjKI zuxz3e6KJYjr0958+tmuHbSzcnWoY4dnJFVDFtY8LCkoYL3dAl0D7I9hE/WR3ftJTHa2 +JHYZ3KTdlCauql+08KiQoitWs60pcPxX4K/M= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:date:to:cc:subject:message-id:reply-to:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; b=ebPcYPR1QpDsHdS4vZL3c71L7uFDN2uAXGBFeuqRYiYu7piOxXmZwMsy2e88Ttd6MS suzzflmzRYKT8J/j4EQqrsqxusGvU4DJplR+p/Uo8PyPXfl6wYL/lZMD+Y+ruINnar9L e7HBPs6gnWt1voErq6gqKsl6TCG0Ajx91bYDU= Received: by 10.143.78.14 with SMTP id f14mr2469955wfl.110.1304196267009; Sat, 30 Apr 2011 13:44:27 -0700 (PDT) Received: from pyunyh@gmail.com ([174.35.1.224]) by mx.google.com with ESMTPS id x11sm4903427wfd.1.2011.04.30.13.44.24 (version=TLSv1/SSLv3 cipher=OTHER); Sat, 30 Apr 2011 13:44:25 -0700 (PDT) Received: by pyunyh@gmail.com (sSMTP sendmail emulation); Sat, 30 Apr 2011 13:43:39 -0700 From: YongHyeon PYUN Date: Sat, 30 Apr 2011 13:43:39 -0700 To: Adrian Chadd Message-ID: <20110430204339.GA25769@michelle.cdnetworks.com> References: <201104290001.p3T01EvQ082443@artema.vpn.ibs> <20110429095231.GA17786@relay.ibs.dn.ua> <20110429182807.GA21084@michelle.cdnetworks.com> <20110429184634.GA34176@relay.ibs.dn.ua> <20110429185605.GB21084@michelle.cdnetworks.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.3i Cc: freebsd-net@freebsd.org Subject: Re: collisions on tun interfaces ... X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: pyunyh@gmail.com List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 30 Apr 2011 20:44:27 -0000 On Sat, Apr 30, 2011 at 11:35:22PM +0800, Adrian Chadd wrote: > On 30 April 2011 02:56, YongHyeon PYUN wrote: > > > Sending lots of packets within short interval may overflow > > interface's send queue. Try sending UDP packets with netperf and > > see what counters are changed during the test with something like > > "netstat -ndI tun0 -w 1". > > The default sendq is 50. What about considering bumping that? > It's tunable. Set net.link.ifqmaxlen. > > Adrian