From owner-freebsd-fs@FreeBSD.ORG Fri Feb 28 14:11:11 2014 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id CEAEF3E0 for ; Fri, 28 Feb 2014 14:11:11 +0000 (UTC) Received: from mail-la0-x229.google.com (mail-la0-x229.google.com [IPv6:2a00:1450:4010:c03::229]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 538891047 for ; Fri, 28 Feb 2014 14:11:11 +0000 (UTC) Received: by mail-la0-f41.google.com with SMTP id gl10so2769460lab.0 for ; Fri, 28 Feb 2014 06:11:09 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=ihhTnZjc205kPUocQyOqZjayYiFk5BprFrWSSU1AzVU=; b=wyfh/brW7EPlXjwTN8D5FC3zesiw5k/k284q3jtlIy2Fu/1HFfEw7Jd2sm5HDUSpWu 8wDk5Xvtvle6dKkb/x4yz0bls4EH00WPG9S2vI/GJc4YZwhzSPaT572pj3mrHBEU6n2W PYMLJ7jLZMqNoH2sfIw7x4CkpbILQMWOslKkGPs5PIfwoPvLAjre6y2NM3K8NNrC8Te2 9DKOejvdxtA4rczd3bjKQ2K+opULj9xfzQ6fd32wEgGBKD960KJHpbRbN5AhKcSFeDwh fdEIxMcL/XkfqI9NTjA08zew8onVCBVpH+4AAE8yw2M1lHkgbsFcUTWkNrg5eEJaCje0 h3xg== X-Received: by 10.153.8.194 with SMTP id dm2mr2006427lad.54.1393596669505; Fri, 28 Feb 2014 06:11:09 -0800 (PST) Received: from [192.168.1.129] (mau.donbass.com. [92.242.127.250]) by mx.google.com with ESMTPSA id v5sm13817306laj.0.2014.02.28.06.11.08 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 28 Feb 2014 06:11:09 -0800 (PST) Message-ID: <531098FC.6090806@gmail.com> Date: Fri, 28 Feb 2014 16:11:08 +0200 From: Volodymyr Kostyrko User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:24.0) Gecko/20100101 Thunderbird/24.3.0 MIME-Version: 1.0 To: Matthias Gamsjager Subject: Re: ZFS and Wired memory, again References: <530F6475.4090508@gmail.com> In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-fs@freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 28 Feb 2014 14:11:11 -0000 28.02.2014 13:47, Matthias Gamsjager wrote: > > > +1 from me, FreeBSD 10, uma=0 > > 52 processes: 2 running, 49 sleeping, 1 zombie > CPU: 0.0% user, 0.0% nice, 0.0% system, 0.4% interrupt, 99.6% idle > Mem: 31M Active, 16K Inact, 3352M Wired, 17M Cache, 48M Free > ARC: 1838M Total, 110M MFU, 18M MRU, 548K Anon, 1876M Header, 75M Other > Swap: 4096M Total, 126M Used, 3969M Free, 3% Inuse > > Machine is plain dead. Running database or squid or anything causes > excessive swapping. This is the state when I disabled all payload, > with everything started swap goes to 500M and machine is burning disks. > > > I wonder do you use any zfs tuning? Like max arc size? Wonder if setting > that to a reasonable amount would help. The previous sample was taken without any tunables. After that I enabled vfs.zfs.zio.use_uma in /boot/loader.conf and now everything looks like: 103 processes: 1 running, 101 sleeping, 1 zombie CPU: 0.0% user, 0.0% nice, 1.2% system, 2.0% interrupt, 96.9% idle Mem: 137M Active, 13M Inact, 3176M Wired, 14M Cache, 111M Free ARC: 2026M Total, 781M MFU, 72M MRU, 414K Anon, 1221M Header, 98M Other Swap: 4096M Total, 263M Used, 3833M Free, 6% Inuse Currently wired memory grows and pushes inactive to swap. Sometimes wired memory retracts freeing 100MB or so. Machine is in working state currently. The major changes are: * less wired; * more arc; * a lot of header memory but less then before, I wonder whether it only grows or retracts... I'm also thinking about trying a patch to l2arc as this system uses external l2 cache. -- Sphinx of black quartz, judge my vow.