From owner-freebsd-stable@FreeBSD.ORG Mon Mar 27 03:34:25 2006 Return-Path: X-Original-To: stable@freebsd.org Delivered-To: freebsd-stable@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D44FA16A401 for ; Mon, 27 Mar 2006 03:34:25 +0000 (UTC) (envelope-from Stephen.Clark@seclark.us) Received: from smtpout04-04.prod.mesa1.secureserver.net (smtpout04-04.prod.mesa1.secureserver.net [64.202.165.199]) by mx1.FreeBSD.org (Postfix) with SMTP id 6DFAB43D45 for ; Mon, 27 Mar 2006 03:34:24 +0000 (GMT) (envelope-from Stephen.Clark@seclark.us) Received: (qmail 6599 invoked from network); 27 Mar 2006 03:34:23 -0000 Received: from unknown (24.144.77.138) by smtpout04-04.prod.mesa1.secureserver.net (64.202.165.199) with ESMTP; 27 Mar 2006 03:34:23 -0000 Message-ID: <44275D3E.6080808@seclark.us> Date: Sun, 26 Mar 2006 22:34:22 -0500 From: Stephen Clark User-Agent: Mozilla/5.0 (X11; U; Linux 2.2.16-22smp i686; en-US; m18) Gecko/20010110 Netscape6/6.5 X-Accept-Language: en-us, en MIME-Version: 1.0 To: stable@freebsd.org References: <44275456.7040901@seclark.us> In-Reply-To: <44275456.7040901@seclark.us> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Cc: Subject: Re: 4.9-4.11 receive network stack lockup X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Stephen.Clark@seclark.us List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Mar 2006 03:34:25 -0000 Stephen Clark wrote: >Hi List, > >I am benchmarking freebsd 4.9, (also tried 4.11), two systems using >nttcp 1.47 from ports >thru a 100mb switch with two realtek 10/100 nics. >I have 50 gre tunnels going thru 50 vpn tunnels between the two machines >as well as >quagga/ospfd with all addresses as neighbors. >Using the following script I occasionally get in a state on the sending >machine where it can send data but not receive it. I have a console that >I run tcpdump on and I see packets go out but none come back, where on >the other machine I see the packets come an a response go back. >Any ideas as to what could be happening? > >for ((i=1;i<51;i++ )); do nttcp -T -w48 -n 32768 10.1.1.$((i*2))& done > >TIA, >Steve >_______________________________________________ >freebsd-stable@freebsd.org mailing list >http://lists.freebsd.org/mailman/listinfo/freebsd-stable >To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > > > Hi List, I am replying to my own message - I've discovered the following if I try to ping localhost I get the following: bash-2.05b# ping localhost PING localhost (127.0.0.1): 56 data bytes ping: sendto: No buffer space available ping: sendto: No buffer space available ^C --- localhost ping statistics --- 2 packets transmitted, 0 packets received, 100% packet loss bash-2.05b# netstat -m 72/1312/5760 mbufs in use (current/peak/max): 72 mbufs allocated to data 0/1214/1440 mbuf clusters in use (current/peak/max) 2756 Kbytes allocated to network (63% of mb_map in use) 0 requests for memory denied 0 requests for memory delayed 0 calls to protocol drain routines but if i ping another machine: bash-2.05b# ping 10.254.254.1 PING 10.254.254.1 (10.254.254.1): 56 data bytes ^C --- 10.254.254.1 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss But if I tcpdump on 10.254.254.1 I see: $ sudo tcpdump -nli rl0 tcpdump: listening on rl0 22:30:29.701849 10.254.254.3 > 10.254.254.1: icmp: echo request 22:30:29.701888 10.254.254.1 > 10.254.254.3: icmp: echo reply 22:30:30.702799 10.254.254.3 > 10.254.254.1: icmp: echo request 22:30:30.702833 10.254.254.1 > 10.254.254.3: icmp: echo reply 22:30:31.703541 10.254.254.3 > 10.254.254.1: icmp: echo request 22:30:31.703578 10.254.254.1 > 10.254.254.3: icmp: echo reply 22:30:32.704331 10.254.254.3 > 10.254.254.1: icmp: echo request 22:30:32.704365 10.254.254.1 > 10.254.254.3: icmp: echo reply 22:30:33.183196 10.254.254.2.500 > 10.254.254.1.500: isakmp: phase 1 I ident: [|sa] ^C 11 packets received by filter 0 packets dropped by kernel The packet were going out on the wire - but the system was unable to get the response - I am assuming because it was out of buffer space? Are mbufs getting lost somewhere? Is this a known problem?