From owner-freebsd-stable@FreeBSD.ORG Tue Oct 30 16:05:34 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id BE79A91B for ; Tue, 30 Oct 2012 16:05:34 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-da0-f54.google.com (mail-da0-f54.google.com [209.85.210.54]) by mx1.freebsd.org (Postfix) with ESMTP id 8B1B58FC08 for ; Tue, 30 Oct 2012 16:05:34 +0000 (UTC) Received: by mail-da0-f54.google.com with SMTP id z9so195828dad.13 for ; Tue, 30 Oct 2012 09:05:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; bh=dur03HZb/VDxzJdumhoWM2wDpLXDbAuZB4isHMdNf7U=; b=xXg8nCCV70BQ9Yaea41d713uSZ3ItlngOqXeC3jioy4smc0vh7ELGE2N73vBUGAVrg MdKCQ+Z43rh8QVw3swUv0DEbUTpG58p9RTwRmlf6L/GmjGmuXy0Z5CsIQSIcwm2S8+Ce 4L3vqpitfJrGqQ9INySv/+qE5l0uWe2vyN1CF+v3neatVynF6iMMhIVAnYkLDsiTZGn8 TTjq7pUkfiPug+ec+aj5jihyXk03gWqAD8l3xOMu/h42a3EE3I6yPYbipWgB5/Ip6nGh 1/8B2wMNbQiE8qG7ieQ4nmx2s+VlP9wvLlkYfsK6dYM9nqNSypOb3r1G5PzhMjW+t22i l/tQ== MIME-Version: 1.0 Received: by 10.66.80.133 with SMTP id r5mr94223745pax.24.1351613134332; Tue, 30 Oct 2012 09:05:34 -0700 (PDT) Sender: adrian.chadd@gmail.com Received: by 10.68.146.233 with HTTP; Tue, 30 Oct 2012 09:05:34 -0700 (PDT) In-Reply-To: <508FD46D.3040608@ateamsystems.com> References: <508FD46D.3040608@ateamsystems.com> Date: Tue, 30 Oct 2012 09:05:34 -0700 X-Google-Sender-Auth: novXZYIbE72yJWVGi88rsthFfxo Message-ID: Subject: Re: No buffer space available / tcp_inpcb value From: Adrian Chadd To: Adam Strohl Content-Type: text/plain; charset=ISO-8859-1 Cc: FreeBSD-Stable ML X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 30 Oct 2012 16:05:35 -0000 Check the output of 'netstat -mb', maybe you're also running out of mbufs? Adrian On 30 October 2012 06:21, Adam Strohl wrote: > Hey -STABLE, > > I've got a client who we've setup a FreeBSD cluster for with about a dozens > servers, all behind two front end proxies/LBs/firewalls which also act as > NAT gateways for the internal servers. > > On the active front end proxy we've started seeing "fatal: socket: No buffer > space available" errors during high-peak times. I can see in vmstat -z > that this is what is getting denied: > > ITEM SIZE LIMIT USED FREE REQ FAIL SLEEP > tcp_inpcb: 392, 32770, 19398, 13372,1449734621,6312858, 0 > > We've got a lot of the other values bumped, and it appears to be this input > limit that is getting hit. There are no other non-zero FAILed counters > except 64 and 128 buckets which I believe are normal. > > I cannot seem to find the sysctl (or equiv) that controls this limit though, > or even what it is. Anyone know? > > I'm obviously in need of this specific answer, but overall is there a codex > of vmstat -z's items that explains this that I have just not found in my > searches? This isn't the first time I've had to dig into a value like this > to increase it's limit, but this time I'm not turning anything up. > > Any thoughts/ideas appreciated! > > -- > Adam Strohl > http://www.ateamsystems.com/ > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org"