From owner-freebsd-stable@FreeBSD.ORG  Tue Oct 30 17:44:40 2012
Return-Path: <owner-freebsd-stable@FreeBSD.ORG>
Delivered-To: freebsd-stable@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52])
 by hub.freebsd.org (Postfix) with ESMTP id 2D984FB0;
 Tue, 30 Oct 2012 17:44:40 +0000 (UTC) (envelope-from bright@mu.org)
Received: from elvis.mu.org (elvis.mu.org [192.203.228.196])
 by mx1.freebsd.org (Postfix) with ESMTP id 0E6508FC08;
 Tue, 30 Oct 2012 17:44:39 +0000 (UTC)
Received: from kruse-124.4.ixsystems.com (drawbridge.ixsystems.com
 [206.40.55.65])
 by elvis.mu.org (Postfix) with ESMTPSA id D3D651A3C1C;
 Tue, 30 Oct 2012 10:44:38 -0700 (PDT)
Message-ID: <5090123F.90105@mu.org>
Date: Tue, 30 Oct 2012 10:45:35 -0700
From: Alfred Perlstein <bright@mu.org>
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7;
 rv:16.0) Gecko/20121010 Thunderbird/16.0.1
MIME-Version: 1.0
To: Navdeep Parhar <np@FreeBSD.org>
Subject: Re: No buffer space available / tcp_inpcb value
References: <508FD46D.3040608@ateamsystems.com> <509008D9.2090006@FreeBSD.org>
In-Reply-To: <509008D9.2090006@FreeBSD.org>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Cc: FreeBSD-Stable ML <freebsd-stable@freebsd.org>,
 Adam Strohl <adams-freebsd@ateamsystems.com>
X-BeenThere: freebsd-stable@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Production branch of FreeBSD source code <freebsd-stable.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-stable>,
 <mailto:freebsd-stable-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-stable>
List-Post: <mailto:freebsd-stable@freebsd.org>
List-Help: <mailto:freebsd-stable-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-stable>,
 <mailto:freebsd-stable-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 30 Oct 2012 17:44:40 -0000


How much memory is in this machine?

maxsockets is in turn clipped by "nmbclusters" which is in turn clipped 
by "maxusers" which is limited to 384 MAXIMUM unless you're running 
-CURRENT.




On 10/30/12 10:05 AM, Navdeep Parhar wrote:
> On 10/30/12 06:21, Adam Strohl wrote:
>> Hey -STABLE,
>>
>> I've got a client who we've setup a FreeBSD cluster for with about a
>> dozens servers, all behind two front end proxies/LBs/firewalls which
>> also act as NAT gateways for the internal servers.
>>
>> On the active front end proxy we've started seeing "fatal: socket: No
>> buffer space available" errors during high-peak times.   I can see in
>> vmstat -z that this is what is getting denied:
>>
>> ITEM                   SIZE  LIMIT     USED     FREE      REQ FAIL SLEEP
>> tcp_inpcb:              392,  32770,   19398, 
>> 13372,1449734621,6312858,   0
>>
>> We've got a lot of the other values bumped, and it appears to be this
>> input limit that is getting hit.  There are no other non-zero FAILed
>> counters except 64 and 128 buckets which I believe are normal.
>>
>> I cannot seem to find the sysctl (or equiv) that controls this limit
>> though, or even what it is.  Anyone know?
>
> kern.ipc.maxsockets controls this limit.  See in_pcbinfo_init() for 
> details.
>
> Regards,
> Navdeep
> _______________________________________________
> freebsd-stable@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-stable
> To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org"