From owner-freebsd-stable@FreeBSD.ORG Thu Nov 29 17:16:59 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id B9B01DEC for ; Thu, 29 Nov 2012 17:16:59 +0000 (UTC) (envelope-from ndenev@gmail.com) Received: from mail-ee0-f54.google.com (mail-ee0-f54.google.com [74.125.83.54]) by mx1.freebsd.org (Postfix) with ESMTP id 416028FC17 for ; Thu, 29 Nov 2012 17:16:58 +0000 (UTC) Received: by mail-ee0-f54.google.com with SMTP id c13so10385001eek.13 for ; Thu, 29 Nov 2012 09:16:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:mime-version:content-type:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to:x-mailer; bh=3oe1M92LKdaBWRWsn43/ffe5El6Givj8qmwsGzhUixE=; b=s2bL179GeJov8EKNNxqeC+t1ohJ/yaAbBeqSDTXnlzYsHXqQIPzdqKoivw07HFVdLf 8PSZO0T8ZFylryHklFyfCG5M/aBMQZAXeuPhm7q89zzpYbVtaXe6X//zqRGHTm6PnZlJ 5B8fUMf+eK3ouAtMfcc/Y3MT036PvMOXJcB1J3eQLExN4oY+OndwDaK0qL1q6O8HQ8cQ xzJiHT+454jnQWNikgoWXs0o/dWwQbtFnwNTCUJm7bsIkNEr4JublTslTgeqdBaSH2Dd WGdraWth0Afo8ZoVQxwapUZWLSmoMW+0AWX+ryqeeC/NfkUM/1s9WZUqvbkYf3NKHR7q X0MA== Received: by 10.14.213.134 with SMTP id a6mr84225068eep.45.1354209418074; Thu, 29 Nov 2012 09:16:58 -0800 (PST) Received: from [10.0.0.86] ([93.152.184.10]) by mx.google.com with ESMTPS id w3sm4752759eel.17.2012.11.29.09.16.55 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 29 Nov 2012 09:16:57 -0800 (PST) Subject: Re: ZFS memory management Mime-Version: 1.0 (Mac OS X Mail 6.2 \(1499\)) Content-Type: text/plain; charset=iso-8859-1 From: Nikolay Denev In-Reply-To: Date: Thu, 29 Nov 2012 19:16:54 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: References: <7A88B836-C985-446C-A992-A295A2474A38@gmail.com> To: Olivier Smedts X-Mailer: Apple Mail (2.1499) Cc: "freebsd-stable@freebsd.org" X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Nov 2012 17:16:59 -0000 On Nov 29, 2012, at 4:53 PM, Olivier Smedts wrote: > 2012/11/27 Freddie Cash : >> Read any ZFS tuning manual on the web, including the ones direct from >> SUN/Oracle, and they all list: >> - if you are running processes that need a lot of memory, then limit = the >> ARC to allow the apps to have access to that memory >=20 > Or you could have at least a little swap (good practice) to allow ARC > take the time to evict some memory when under pressure. >=20 Yes, this was already suggested off-list, and it seems like a solution. Thanks to all for the input! >>=20 >> :) >>=20 >>=20 >> On Tue, Nov 27, 2012 at 12:10 PM, Nikolay Denev = wrote: >>=20 >>> Hello list, >>>=20 >>> I have the following question : I have several machines with 196G of = RAM >>> that are using >>> RELENG_9 with ZFS, and are running a very memory intensive java >>> applications - ElasticSearch >>> The machines are without swap configured and have = "vm.swap_enabled=3D0" in >>> /etc/sysctl.conf. >>> The ElasticSearch processes are using mlockall(2) to pin down their = memory >>> (configured at 40G). >>> And at this point I thought that there would be no problems, but = from time >>> to time, when the machine grows it's >>> ARC memory and there are some other running processes like nginx = with >>> passenger and uwsgi the ElasticSearch >>> process would get killed by the kernel OOM killer with reason "no = swap >>> space available" >>>=20 >>> Of course, I've now tuned down arc_max in /boot/loader.conf, but = isn't >>> this supposed to work automatically? Like >>> ZFS releasing some memory when there is a pressure, instead of the = OOM >>> killer going postal? (at the moment when >>> the process was killed the ZFS ARC was 132G). >>>=20 >>> I understand that this might be problematic as AFAIK ZFS releases = memory >>> asynchronously when the arc_reclaim_thread() is run, >>> which might take some time to be scheduled and complete. >>>=20 >>> Cheers, >>> Nikolay >>>=20 >>>=20 >>> _______________________________________________ >>> freebsd-stable@freebsd.org mailing list >>> http://lists.freebsd.org/mailman/listinfo/freebsd-stable >>> To unsubscribe, send any mail to = "freebsd-stable-unsubscribe@freebsd.org" >>>=20 >>=20 >>=20 >>=20 >> -- >> Freddie Cash >> fjwcash@gmail.com >> _______________________________________________ >> freebsd-stable@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-stable >> To unsubscribe, send any mail to = "freebsd-stable-unsubscribe@freebsd.org" >=20 >=20 >=20 > --=20 > Olivier Smedts _ > ASCII ribbon campaign ( ) > e-mail: olivier@gid0.org - against HTML email & vCards X > www: http://www.gid0.org - against proprietary attachments / \ >=20 > "Il y a seulement 10 sortes de gens dans le monde : > ceux qui comprennent le binaire, > et ceux qui ne le comprennent pas."