From owner-freebsd-fs@FreeBSD.ORG Mon Oct 12 08:55:18 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A9519106568F for ; Mon, 12 Oct 2009 08:55:18 +0000 (UTC) (envelope-from kmatthew.macy@gmail.com) Received: from mail-yw0-f197.google.com (mail-yw0-f197.google.com [209.85.211.197]) by mx1.freebsd.org (Postfix) with ESMTP id 4E8E58FC13 for ; Mon, 12 Oct 2009 08:55:18 +0000 (UTC) Received: by ywh35 with SMTP id 35so28664097ywh.7 for ; Mon, 12 Oct 2009 01:55:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:sender:subject:mime-version :content-type:from:in-reply-to:date:cc:message-id:references:to :x-mailer; bh=a2u5Ixb1owJ0ErCPIGKIKLX4nAjDlKMgGSm5bDYpvv4=; b=eYnacw389WQzmHettyLnm4/TgAz+mk1wQ11xJhmi2FB/1FCoO/97ZRc8LDoN6sma2y oOk4pwF2uybvoQSPa0PMorzRN7Oyelx/UXxCU6sxcwjCpvTDQZNtHZx7rKho7MhdybcJ 23b8sXaU+xqgxx7UfRkMbzhnIgGzkQ0V0hy5w= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=sender:subject:mime-version:content-type:from:in-reply-to:date:cc :message-id:references:to:x-mailer; b=DmsNggXP8pfvU5dTD5rqaX0MKHv/QBNDbBmVc8mnKoKnx7o3h+RiYTJnT89nE8iuTl Z/Zj77YCmXYhcR/EwRuzHJHXif76CMTzSwZsaBqFGvFMv+oUB2pkFHeg2H73fmmLgMRD 2iJvpaUEfeTqXLYsY0hlCDzUxZ+Zt0P4FZKxY= Received: by 10.101.34.10 with SMTP id m10mr5176023anj.32.1255335808555; Mon, 12 Oct 2009 01:23:28 -0700 (PDT) Received: from ?192.168.1.113? ([76.102.48.254]) by mx.google.com with ESMTPS id 22sm2189262yxe.3.2009.10.12.01.23.26 (version=TLSv1/SSLv3 cipher=RC4-MD5); Mon, 12 Oct 2009 01:23:27 -0700 (PDT) Sender: Matthew Macy Mime-Version: 1.0 (Apple Message framework v1076) From: "K. Macy" In-Reply-To: <4AD2E118.2050202@fsn.hu> Date: Mon, 12 Oct 2009 01:23:25 -0700 Message-Id: <47C0A3F4-6431-49E5-B780-FA162946C288@freebsd.org> References: <4AC1E540.9070001@fsn.hu> <4AC5B2C7.2000200@fsn.hu> <20091002184526.GA1660@garage.freebsd.pl> <4ACDA5EA.2010600@fsn.hu> <4ACDDED0.2070707@fsn.hu> <20091008160718.GB2134@garage.freebsd.pl> <4AD2E118.2050202@fsn.hu> To: Attila Nagy X-Mailer: Apple Mail (2.1076) Content-Type: text/plain; charset=us-ascii; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-fs@FreeBSD.org, Pawel Jakub Dawidek Subject: Re: ARC size constantly shrinks, then ZFS slows down extremely X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 12 Oct 2009 08:55:18 -0000 > > The amd64 machine started to loose ARC memory again. See these: > http://people.fsn.hu/~bra/freebsd/20091012-zfs-arcsize/zfs_mem- > week.png > http://people.fsn.hu/~bra/freebsd/20091012-zfs-arcsize/memory-week.png > > Your patch was active between 7 and 9. You can see that the ARC size > was somewhat constant. > On october 9, I installed Kip's modification, and ARC size started > to decrease. > BTW, previously (before october 7) I set the arc min size to 10-15GB > (can't remember the exact value), but now it runs with the defaults > (only the max size is set): > vfs.zfs.arc_min: 3623878656 > vfs.zfs.arc_max: 28991029248 > > As you can see, there are plenty of memory. This machine uses UFS as > well (and writes it heavily), maybe that's what affects ZFS size, by > caching a lot of stuff? > Currently, the inactive page queue will grow until ARC is shrunk to arc_min. I think I'll probably spend some time making the ARC play better with the page cache this week. Unfortunately, under heavy memory pressure when competing with UFS the ARC will degrade to LRU, but I think that is still an improvement over the current static sizing with low and high water marks. -Kip