From owner-freebsd-net@FreeBSD.ORG Mon Sep 24 17:00:10 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B95651065678 for ; Mon, 24 Sep 2012 17:00:08 +0000 (UTC) (envelope-from crapsh@monkeybrains.net) Received: from lavash.monkeybrains.net (mail.monkeybrains.net [208.69.40.9]) by mx1.freebsd.org (Postfix) with ESMTP id C200F8FC16 for ; Mon, 24 Sep 2012 17:00:08 +0000 (UTC) Received: from invalid-dns.RFC1918.monkeybrains.net (199-116-74-151-v301.PUBLIC.monkeybrains.net [199.116.74.151]) (authenticated bits=0) by lavash.monkeybrains.net (8.14.4/8.14.4) with ESMTP id q8OGKYJQ094435 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO) for ; Mon, 24 Sep 2012 09:20:34 -0700 (PDT) (envelope-from crapsh@monkeybrains.net) Message-ID: <5060884C.3050709@monkeybrains.net> Date: Mon, 24 Sep 2012 09:20:28 -0700 From: "Rudy (bulk)" User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.5; rv:15.0) Gecko/20120907 Thunderbird/15.0.1 MIME-Version: 1.0 To: freebsd-net Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: clamav-milter 0.97.5 at lavash.monkeybrains.net X-Virus-Status: Clean Subject: ping: sendto: No buffer space available X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Sep 2012 17:00:10 -0000 Sometimes when I try to ping a neighbor machine (plugged directly in with no switch involved), I get: ping: sendto: No buffer space available ping: sendto: No buffer space available If I reset the interface 'ifconfig em1 down; ifconfig em1 up' the problem goes away. The pings are: FreeBSD 8.3 em1 --> FreeBSD 9.0 em2 and I am seeing the issue on the FreeBSD 8.3 machine. The box has 6GB of free ram and is a quagga router. What do I need to tune? Thanks! Rudy # netstat -m 10236/8454/18690 mbufs in use (current/cache/total) 10234/5388/15622/262144 mbuf clusters in use (current/cache/total/max) 10234/5382 mbuf+clusters out of packet secondary zone in use (current/cache) 0/327/327/12800 4k (page size) jumbo clusters in use (current/cache/total/max) 0/3070/3070/6400 9k jumbo clusters in use (current/cache/total/max) 0/0/0/3200 16k jumbo clusters in use (current/cache/total/max) 23027K/41827K/64854K bytes allocated to network (current/cache/total) 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters) 0/0/0 requests for jumbo clusters denied (4k/9k/16k) 0/0/0 sfbufs in use (current/peak/max) 0 requests for sfbufs denied 0 requests for sfbufs delayed 0 requests for I/O initiated by sendfile 0 calls to protocol drain routines # ifconfig em1 em1: flags=8843 metric 0 mtu 1500 options=4219b ether 00:25:90:56:60:7f inet 10.1.1.1 netmask 0xfffffffc broadcast 10.1.1.3 media: Ethernet autoselect (1000baseT ) status: active FreeBSD 8.3 ### loader.conf: net.link.ifqmaxlen=1024 hw.em.rxd=1024 hw.em.txd=1024 ### sysctl.conf: kern.timecounter.hardware=HPET net.route.netisr_maxqlen=2048 net.inet.ip.intr_queue_maxlen=1024 kern.ipc.somaxconn=256 kern.random.sys.harvest.interrupt=0 kern.random.sys.harvest.ethernet=0 net.inet.raw.maxdgram=16384 net.inet.raw.recvspace=16384 net.inet.icmp.icmplim=1000 net.inet.ip.fastforwarding=1 kern.ipc.nmbclusters=262144 net.inet.icmp.drop_redirect=1 dev.em.0.rx_processing_limit=200 dev.em.1.rx_processing_limit=200 dev.em.2.rx_processing_limit=200 dev.em.3.rx_processing_limit=200 net.link.ether.inet.max_age=300 hw.intr_storm_threshold=9000 # Security net.inet.ip.redirect=0 net.inet.ip.sourceroute=0 net.inet.ip.accept_sourceroute=0 net.inet.icmp.maskrepl=0 Not sure if it matters, but here are the tunings on the other box: FreeBSD 9.0 ### loader.conf: net.link.ifqmaxlen="512" ### sysctl.conf: net.inet.ip.fastforwarding=1 kern.ipc.nmbclusters=262144 kern.timecounter.hardware=HPET net.inet.ip.rtminexpire=2 net.inet.ip.rtmaxcache=1024 dev.igb.0.rx_processing_limit=480 dev.igb.1.rx_processing_limit=480 net.inet.icmp.icmplim=1000 kern.random.sys.harvest.interrupt=0 kern.random.sys.harvest.ethernet=0 net.link.ether.inet.max_age=300 ##Sat Apr 21 00:06:48 PDT 2012 net.inet.ip.redirect=0 net.route.netisr_maxqlen=2048