From owner-freebsd-fs@FreeBSD.ORG  Fri Feb 28 20:30:18 2014
Return-Path: <owner-freebsd-fs@FreeBSD.ORG>
Delivered-To: freebsd-fs@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 0DDFC7A1
 for <freebsd-fs@freebsd.org>; Fri, 28 Feb 2014 20:30:18 +0000 (UTC)
Received: from mario.brtsvcs.net (mario.brtsvcs.net [IPv6:2607:fc50:0:a400::2])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (No client certificate requested)
 by mx1.freebsd.org (Postfix) with ESMTPS id D0C36149F
 for <freebsd-fs@freebsd.org>; Fri, 28 Feb 2014 20:30:17 +0000 (UTC)
Received: from chombo.houseloki.net (c-76-115-19-22.hsd1.or.comcast.net
 [76.115.19.22])
 by mario.brtsvcs.net (Postfix) with ESMTPSA id D53022C1622;
 Fri, 28 Feb 2014 12:30:14 -0800 (PST)
Received: from [IPv6:2601:7:880:bd0:957a:b9e2:b4c0:512a] (unknown
 [IPv6:2601:7:880:bd0:957a:b9e2:b4c0:512a])
 by chombo.houseloki.net (Postfix) with ESMTPSA id C016AEDB;
 Fri, 28 Feb 2014 12:30:12 -0800 (PST)
Message-ID: <5310F1D3.9020908@bluerosetech.com>
Date: Fri, 28 Feb 2014 12:30:11 -0800
From: Darren Pilgrim <list_freebsd@bluerosetech.com>
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64;
 rv:24.0) Gecko/20100101 Thunderbird/24.3.0
MIME-Version: 1.0
To: Anton Sayetsky <vsjcfm@gmail.com>
Subject: Re: ZFS and Wired memory, again
References: <CAFG2KC+ZSHEVFbpPD9e1QHRdY=Sd6EuAD80vyDLDDQcpgCQNhA@mail.gmail.com>
 <530F6475.4090508@gmail.com>
 <CA+D9QhtVkYNoEGwhx-EJi9X1jr_UN2rgYxbZtA99qcT4UA-8kA@mail.gmail.com>
 <CAFG2KCLSSBwR5JbLdnVPy6E8UeGiWWCGsFcEjeU+eU5F2Xm+Sw@mail.gmail.com>
 <f6dfa6229d7707dd5657fae427f79ba2@webmail.lerctr.org>
 <CAFG2KCLeaucA=3aJ+_NzsfzOfVNXtiCnrRWwCMhW==-JT7wkCA@mail.gmail.com>
 <CA+tpaK3aQ60CrrVksb69muUXGhTD5Vtn+pu6G7g=4E9eCLC_OQ@mail.gmail.com>
 <1393616123.28153.89089441.54713282@webmail.messagingengine.com>
 <CA+tpaK246eKwjvPXgzcxt_e5+=udietjPQKSdDV+iLRG-T2RDQ@mail.gmail.com>
 <CAFG2KCKHCzoRg581obAig0cDKDcoRoi0vo0dO1mbR-x-J_TTtg@mail.gmail.com>
In-Reply-To: <CAFG2KCKHCzoRg581obAig0cDKDcoRoi0vo0dO1mbR-x-J_TTtg@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Cc: freebsd-fs <freebsd-fs@freebsd.org>
X-BeenThere: freebsd-fs@freebsd.org
X-Mailman-Version: 2.1.17
Precedence: list
Reply-To: freebsd-fs <freebsd-fs@freebsd.org>
List-Id: Filesystems <freebsd-fs.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-fs>,
 <mailto:freebsd-fs-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-fs/>
List-Post: <mailto:freebsd-fs@freebsd.org>
List-Help: <mailto:freebsd-fs-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
 <mailto:freebsd-fs-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 28 Feb 2014 20:30:18 -0000

On 2/28/2014 11:48 AM, Anton Sayetsky wrote:
> And again - read _carefully_. System with 3G RAM is only test system
> with single disk.

Sorry for Adam and Mark not reading and completely missing the point.

You can use the -m and -z flags to vmstat to get a listing of the 
various things using memory.  A comparison between the "just booted" 
listing and one after wired memory has grown to hundreds of MB more than 
ARC may help indicate what's using memory.  FWIW, on a production 
mailbox server with 32 GiB of memory and 8 TB of mirrored disk:

Mem: 30M Active, 265M Inact, 22G Wired, 2032K Cache, 9366M Free
ARC: 20G Total, 5081M MFU, 15G MRU, 1554K Anon, 260M Header, 577M Other

IIRC, wired memory is just kernel pages and there is quite a bit of 
other stuff using kernel memory in the modern FreeBSD.  A few GB of 
kernel memory plus ARC is normal on a modern system with lots of memory.