From owner-freebsd-fs@FreeBSD.ORG  Wed Sep 29 07:25:09 2010
Return-Path: <owner-freebsd-fs@FreeBSD.ORG>
Delivered-To: fs@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id E4C321065670;
	Wed, 29 Sep 2010 07:25:09 +0000 (UTC) (envelope-from avg@icyb.net.ua)
Received: from citadel.icyb.net.ua (citadel.icyb.net.ua [212.40.38.140])
	by mx1.freebsd.org (Postfix) with ESMTP id EFA738FC0A;
	Wed, 29 Sep 2010 07:25:08 +0000 (UTC)
Received: from porto.topspin.kiev.ua (porto-e.starpoint.kiev.ua
	[212.40.38.100])
	by citadel.icyb.net.ua (8.8.8p3/ICyb-2.3exp) with ESMTP id KAA19592;
	Wed, 29 Sep 2010 10:24:51 +0300 (EEST)
	(envelope-from avg@icyb.net.ua)
Received: from localhost.topspin.kiev.ua ([127.0.0.1])
	by porto.topspin.kiev.ua with esmtp (Exim 4.34 (FreeBSD))
	id 1P0r23-00037A-0A; Wed, 29 Sep 2010 10:24:51 +0300
Message-ID: <4CA2E9C2.3030806@icyb.net.ua>
Date: Wed, 29 Sep 2010 10:24:50 +0300
From: Andriy Gapon <avg@icyb.net.ua>
User-Agent: Mozilla/5.0 (X11; U; FreeBSD amd64; en-US;
	rv:1.9.2.9) Gecko/20100918 Lightning/1.0b2 Thunderbird/3.1.4
MIME-Version: 1.0
To: Artem Belevich <fbsdlist@src.cx>
References: <4CA1D06C.9050305@digiware.nl>	<20100928115047.GA62142__15392.0458550148$1285675457$gmane$org@icarus.home.lan>	<4CA1DDE9.8090107@icyb.net.ua>	<20100928132355.GA63149@icarus.home.lan>	<4CA1EF69.4040402@icyb.net.ua>	<FE116FEC-714D-4BF5-86D8-E29BFA713C69@wanderview.com>	<4CA21809.7090504@icyb.net.ua>	<71D54408-4B97-4F7A-BD83-692D8D23461A@wanderview.com>	<4CA22337.2010900@icyb.net.ua>	<F244BA6D-3347-4D76-BAFB-D8B975783877@wanderview.com>	<4CA25E92.4060904@icyb.net.ua>	<5BD33772-C0EA-48A9-BE9A-C8FBAF0008D7@wanderview.com>	<4CA26AB4.3050108@icyb.net.ua>
	<AANLkTi=aZp=46pHn9NtYsKBbMq1JwxPKb1D3o3Wngy1V@mail.gmail.com>
In-Reply-To: <AANLkTi=aZp=46pHn9NtYsKBbMq1JwxPKb1D3o3Wngy1V@mail.gmail.com>
X-Enigmail-Version: 1.1.2
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Cc: stable@freebsd.org, fs@freebsd.org, Ben Kelly <ben@wanderview.com>
Subject: Re: Still getting kmem exhausted panic
X-BeenThere: freebsd-fs@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Filesystems <freebsd-fs.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
	<mailto:freebsd-fs-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-fs>
List-Post: <mailto:freebsd-fs@freebsd.org>
List-Help: <mailto:freebsd-fs-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
	<mailto:freebsd-fs-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 29 Sep 2010 07:25:10 -0000

on 29/09/2010 03:38 Artem Belevich said the following:
> On Tue, Sep 28, 2010 at 3:22 PM, Andriy Gapon <avg@icyb.net.ua> wrote:
>> BTW, have you seen my posts about UMA and ZFS on hackers@ ?
>> I found it advantageous to use UMA for ZFS I/O buffers, but only after reducing
>> size of per-CPU caches for the zones with large-sized items.
>> I further modified the code in my local tree to completely disable per-CPU
>> caches for items > 32KB.
> 
> Do you have updated patch disabling per-cpu caches for large items?
> I've just rebuilt FreeBSD-8 with your uma-2.diff (it needed r209050
> from -head to compile) and so far things look good. I'll re-enable UMA
> for ZFS and see how it flies in a couple of days.

I've just uploaded uma-3.diff.
It implements what uma-1.diff did, plus totally skips per-CPU caches for items >
32KB, and also has code from uma-2.diff for flushing per-CPU caches on
significant memory shortage.

Will appreciate your feedback.
Thank you for testing!

-- 
Andriy Gapon