From owner-freebsd-current@FreeBSD.ORG Mon Nov 30 08:50:06 2009 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 489981065694; Mon, 30 Nov 2009 08:50:06 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-iw0-f198.google.com (mail-iw0-f198.google.com [209.85.223.198]) by mx1.freebsd.org (Postfix) with ESMTP id E0E598FC1E; Mon, 30 Nov 2009 08:50:05 +0000 (UTC) Received: by iwn36 with SMTP id 36so1895330iwn.3 for ; Mon, 30 Nov 2009 00:50:05 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:received:in-reply-to :references:date:x-google-sender-auth:message-id:subject:from:to:cc :content-type:content-transfer-encoding; bh=YCqV1/0/m+iMf3fu0L736aimWhdn3UKfN0VWzn4qYnI=; b=sbv5p9kMcR9o/RWl3fnx4GOhU91g5f7P2bKWC6hvZsZpvBQGQAI/tVjlXHveG6Wf5O SKh/3mhcgRoXBvsE8jmdfSPhnH2nO5wc62lUfynhbAf1C9E1d8mZAiOzlKyAzBmoWMDC xILLzo2ZvsL+7J/U6RH1QXE7KxeQUmSTUW4Ls= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type :content-transfer-encoding; b=f8RBDsTcw5tnY6xYpruDlQ7BrGsMiobgdM/s65lNTKO+WYwt/ImOBiafMcvnL+uIGg H3lHantrvw3w/i2xJybOruw6gnwVHQL0DIhvCaitQ5oaGUlmz4qT9Cc/7OwuEMHikLcT 17/tenoreYV1Fv9x7W3rHgZEPvVYmdIvKOd/0= MIME-Version: 1.0 Sender: adrian.chadd@gmail.com Received: by 10.231.20.230 with SMTP id g38mr10522612ibb.49.1259571004909; Mon, 30 Nov 2009 00:50:04 -0800 (PST) In-Reply-To: References: <20091129013026.GA1355@michelle.cdnetworks.com> <74BFE523-4BB3-4748-98BA-71FBD9829CD5@anduin.net> Date: Mon, 30 Nov 2009 16:50:04 +0800 X-Google-Sender-Auth: 5b284b2a0871608c Message-ID: From: Adrian Chadd To: =?ISO-8859-1?Q?Eirik_=D8verby?= Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: pyunyh@gmail.com, weldon@excelsusphoto.com, freebsd-current@freebsd.org, Robert Watson , Gavin Atkinson Subject: Re: FreeBSD 8.0 - network stack crashes? X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 30 Nov 2009 08:50:06 -0000 2009/11/30 Eirik =D8verby : >> That URL works for me. So how much traffic is this box handling during >> peak times? > > Depends how you define load. It's a storage box (14TB ZFS) with a small h= andful of NFS clients pushing backup data to it .. So lots of traffic in by= tes/sec, but not many clients. Ok. > If you're referring to the Send-Q and Recv-Q values, they are zero everyw= here I can tell. Hm, I was. Ok. >> See if you have full socket buffers showing up in netstat -an. Have >> you tweaked the socket/TCP send/receive sizes? I typically lock mine >> down to something small (32k-64k for the most part) so I don't hit >> mbuf exhaustion on very busy proxies. > I haven't touched any defaults except the mbuf clusters. What does your s= ysctl.conf look like? I just set these: net.inet.tcp.sendspace=3D65536 net.inet.tcp.recvspace=3D65536 I tweak a lot of other TCP stack stuff to deal with satellite latencies; its not relevant here. I'd love to see where those mbufs are hiding and whether they're a leak, or whether the NFS server is just pushing too much data out for whatever reason. Actually, something I also set was this: # Handle slightly more packets per interrupt tick net.inet.ip.intr_queue_maxlen=3D512 It was defaulting to 50 which wasn't fast enough for small packet loads. Adrian