From owner-freebsd-current@FreeBSD.ORG  Mon Oct 22 13:55:43 2012
Return-Path: <owner-freebsd-current@FreeBSD.ORG>
Delivered-To: freebsd-current@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52])
 by hub.freebsd.org (Postfix) with ESMTP id 839F485B
 for <freebsd-current@freebsd.org>; Mon, 22 Oct 2012 13:55:43 +0000 (UTC)
 (envelope-from andre@freebsd.org)
Received: from c00l3r.networx.ch (c00l3r.networx.ch [62.48.2.2])
 by mx1.freebsd.org (Postfix) with ESMTP id D169A8FC1E
 for <freebsd-current@freebsd.org>; Mon, 22 Oct 2012 13:55:42 +0000 (UTC)
Received: (qmail 72954 invoked from network); 22 Oct 2012 15:33:53 -0000
Received: from unknown (HELO [62.48.0.94]) ([62.48.0.94])
 (envelope-sender <andre@freebsd.org>)
 by c00l3r.networx.ch (qmail-ldap-1.03) with SMTP
 for <universite@ukr.net>; 22 Oct 2012 15:33:53 -0000
Message-ID: <508550AA.5080106@freebsd.org>
Date: Mon, 22 Oct 2012 15:56:58 +0200
From: Andre Oppermann <andre@freebsd.org>
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64;
 rv:15.0) Gecko/20120907 Thunderbird/15.0.1
MIME-Version: 1.0
To: Vladislav Prodan <universite@ukr.net>
Subject: Re: [ZFS] Server periodically become unavailable
References: <86879.1350738692.82582785788739584@ffe8.ukr.net>
In-Reply-To: <86879.1350738692.82582785788739584@ffe8.ukr.net>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Cc: freebsd-current@freebsd.org, freebsd-stable@freebsd.org
X-BeenThere: freebsd-current@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Discussions about the use of FreeBSD-current
 <freebsd-current.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-current>, 
 <mailto:freebsd-current-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-current>
List-Post: <mailto:freebsd-current@freebsd.org>
List-Help: <mailto:freebsd-current-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-current>,
 <mailto:freebsd-current-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Mon, 22 Oct 2012 13:55:43 -0000

On 20.10.2012 15:11, Vladislav Prodan wrote:
>
>> FreeBSD 9.1-PRERELEASE #0: Wed Jul 25 01:40:56 EEST 2012
>
> I have the server: 8 cores AMD, 16GB RAM, 4x3TB HDD in RAID10 for ZFS.
> Sometime wheels fall off the server and the network.
> Can this clean-up memory for ZFS cache?
> I enclose a picture with the monitoring system at the time lags.
>
> http://imageshack.us/a/img341/9643/memoryusage.png
> http://imageshack.us/a/img22/6935/nginxclientstat.png
> http://imageshack.us/a/img19/8817/realmemory.png
>
> #cat /etc/sysctl.conf
> kern.ipc.somaxconn=65535

Remove this. It doesn't do what you think it does.

> kern.ipc.maxsockets=204800
> net.inet.ip.portrange.first=1024
> net.inet.ip.portrange.last=65535
> kern.ipc.shmmax=67108864
> kern.ipc.shmall=67108864
> net.inet.tcp.rfc3465=0

Any particular reason why you turn this off?

> net.graph.maxdgram=8388608
> net.graph.recvspace=8388608
> net.route.netisr_maxqlen=4096
> kern.ipc.nmbclusters=400000
> kern.ipc.maxsockbuf=83886080

83MB for a socket buffer is too much unless you're doing some HPC stuff.
The default should be fine.

> net.inet.tcp.recvbuf_inc=524288

Again, this should be left at default unless you have a very specific
reason to increment it.

> net.inet.tcp.recvbuf_max=16777216

ditto.

> net.inet.tcp.sendbuf_inc=524288

ditto.

> net.inet.tcp.sendbuf_max=16777216

ditto.

> net.inet.tcp.sendspace=65536

This is the default setting.

> net.inet.tcp.keepidle=300000
> net.inet.tcp.keepintvl=60000
> net.inet.ip.fw.dyn_max=65535
> net.inet.ip.fw.dyn_buckets=65536
> net.inet.ip.fw.dyn_ack_lifetime=120
> net.inet.ip.fw.dyn_syn_lifetime=10
> net.inet.tcp.nolocaltimewait=1
> security.bsd.hardlink_check_uid=1
> security.bsd.hardlink_check_gid=1
> security.bsd.see_other_uids=0
> security.bsd.see_other_gids=0

-- 
Andre