From owner-freebsd-net@FreeBSD.ORG Tue Sep 25 06:53:09 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1A24B106564A for ; Tue, 25 Sep 2012 06:53:09 +0000 (UTC) (envelope-from hoomanfazaeli@gmail.com) Received: from mail-pb0-f54.google.com (mail-pb0-f54.google.com [209.85.160.54]) by mx1.freebsd.org (Postfix) with ESMTP id DE24A8FC08 for ; Tue, 25 Sep 2012 06:53:08 +0000 (UTC) Received: by pbbrp8 with SMTP id rp8so4683982pbb.13 for ; Mon, 24 Sep 2012 23:53:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=keG1noiku23XRAdW0MQ4BDa25pskgMt9QZPxDeLJ0sg=; b=MUD5FCo3bfXv8w32Xo0e5447D2dyPAYnk6udP7PU/p0zOF4CXaW/qvtJzsgxSPiSXq Qp9jVKznmnxZzN2GEq8D2bRCf36V1flF2N8BCcMwC6TbXeIda3WUPDb5f0Wmr1mwCtQL CPAuPaJHV5sYPS7i3fRAKFhxy349GO9DkAkJ+d5o3jsfWr14unQbgk2jZyVasoEgEZq3 enfP3F3QkhkjdZ+MKI7EnpY1deQvE7EOv543cc3FTDeQ7vDubXQkkRPRckc3SW6ta6Zj Qj0/dBlqrpJHtamIe20Zz5XFECblr0vonXzcnSAJSneNJa82gHCTRe4EN6jELjlyRXVA sLZg== Received: by 10.68.225.3 with SMTP id rg3mr39474558pbc.27.1348555988293; Mon, 24 Sep 2012 23:53:08 -0700 (PDT) Received: from [127.0.0.1] ([213.217.59.99]) by mx.google.com with ESMTPS id b9sm10018959pay.22.2012.09.24.23.53.05 (version=TLSv1/SSLv3 cipher=OTHER); Mon, 24 Sep 2012 23:53:07 -0700 (PDT) Message-ID: <506154DB.3050103@gmail.com> Date: Tue, 25 Sep 2012 10:23:15 +0330 From: Hooman Fazaeli User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.28) Gecko/20120306 Thunderbird/3.1.20 MIME-Version: 1.0 To: "Rudy (bulk)" References: <5060884C.3050709@monkeybrains.net> In-Reply-To: <5060884C.3050709@monkeybrains.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-net Subject: Re: ping: sendto: No buffer space available X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 25 Sep 2012 06:53:09 -0000 On 9/24/2012 7:50 PM, Rudy (bulk) wrote: > > Sometimes when I try to ping a neighbor machine (plugged directly in with no switch involved), I get: > > ping: sendto: No buffer space available > ping: sendto: No buffer space available > > If I reset the interface 'ifconfig em1 down; ifconfig em1 up' the problem goes away. > > The pings are: > FreeBSD 8.3 em1 --> FreeBSD 9.0 em2 > and I am seeing the issue on the FreeBSD 8.3 machine. The box has 6GB of free ram and is a quagga router. > > What do I need to tune? > > Thanks! > > Rudy > > > > > # netstat -m > 10236/8454/18690 mbufs in use (current/cache/total) > 10234/5388/15622/262144 mbuf clusters in use (current/cache/total/max) > 10234/5382 mbuf+clusters out of packet secondary zone in use (current/cache) > 0/327/327/12800 4k (page size) jumbo clusters in use (current/cache/total/max) > 0/3070/3070/6400 9k jumbo clusters in use (current/cache/total/max) > 0/0/0/3200 16k jumbo clusters in use (current/cache/total/max) > 23027K/41827K/64854K bytes allocated to network (current/cache/total) > 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters) > 0/0/0 requests for jumbo clusters denied (4k/9k/16k) > 0/0/0 sfbufs in use (current/peak/max) > 0 requests for sfbufs denied > 0 requests for sfbufs delayed > 0 requests for I/O initiated by sendfile > 0 calls to protocol drain routines > > # ifconfig em1 > em1: flags=8843 metric 0 mtu 1500 > options=4219b > ether 00:25:90:56:60:7f > inet 10.1.1.1 netmask 0xfffffffc broadcast 10.1.1.3 > media: Ethernet autoselect (1000baseT ) > status: active > > > > FreeBSD 8.3 > ### loader.conf: > net.link.ifqmaxlen=1024 > hw.em.rxd=1024 > hw.em.txd=1024 > > > ### sysctl.conf: > kern.timecounter.hardware=HPET > > net.route.netisr_maxqlen=2048 > net.inet.ip.intr_queue_maxlen=1024 > > kern.ipc.somaxconn=256 > kern.random.sys.harvest.interrupt=0 > kern.random.sys.harvest.ethernet=0 > > net.inet.raw.maxdgram=16384 > net.inet.raw.recvspace=16384 > > net.inet.icmp.icmplim=1000 > net.inet.ip.fastforwarding=1 > kern.ipc.nmbclusters=262144 > net.inet.icmp.drop_redirect=1 > > dev.em.0.rx_processing_limit=200 > dev.em.1.rx_processing_limit=200 > dev.em.2.rx_processing_limit=200 > dev.em.3.rx_processing_limit=200 > > net.link.ether.inet.max_age=300 > hw.intr_storm_threshold=9000 > > # Security > net.inet.ip.redirect=0 > net.inet.ip.sourceroute=0 > net.inet.ip.accept_sourceroute=0 > net.inet.icmp.maskrepl=0 > > > > > Not sure if it matters, but here are the tunings on the other box: > > FreeBSD 9.0 > ### loader.conf: > net.link.ifqmaxlen="512" > > ### sysctl.conf: > net.inet.ip.fastforwarding=1 > kern.ipc.nmbclusters=262144 > kern.timecounter.hardware=HPET > net.inet.ip.rtminexpire=2 > net.inet.ip.rtmaxcache=1024 > > > dev.igb.0.rx_processing_limit=480 > dev.igb.1.rx_processing_limit=480 > > net.inet.icmp.icmplim=1000 > kern.random.sys.harvest.interrupt=0 > kern.random.sys.harvest.ethernet=0 > > net.link.ether.inet.max_age=300 > > ##Sat Apr 21 00:06:48 PDT 2012 > net.inet.ip.redirect=0 > net.route.netisr_maxqlen=2048 > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" > The most likely cause is that the interface send queue has become full and stayed in that condition. What type of NIC is at the other end of link? can you post the output of: # sysctl dev.em.1