Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 05 Nov 2014 09:24:46 +0000
From:      Steven Hartland <killing@multiplay.co.uk>
To:        Marcus Reid <marcus@blazingdot.com>
Cc:        gibbs@freebsd.org, George Kola <george.kola@voxer.com>, freebsd-current@freebsd.org, Allan Jude <allanjude@freebsd.org>
Subject:   Re: r273165. ZFS ARC: possible memory leak to Inact
Message-ID:  <5459ECDE.6090102@multiplay.co.uk>
In-Reply-To: <20141105061540.GA14812@blazingdot.com>
References:  <1415098949.596412362.8vxee7kf@frv41.fwdcdn.com> <5458CCB6.7020602@multiplay.co.uk> <1415107358607-5962421.post@n5.nabble.com> <54590B55.3040206@freebsd.org> <54591758.7000909@multiplay.co.uk> <20141105061540.GA14812@blazingdot.com>

next in thread | previous in thread | raw e-mail | index | archive | help

On 05/11/2014 06:15, Marcus Reid wrote:
> On Tue, Nov 04, 2014 at 06:13:44PM +0000, Steven Hartland wrote:
>> On 04/11/2014 17:22, Allan Jude wrote:
>>> snip...
>>> Justin Gibbs and I were helping George from Voxer look at the same issue
>>> they are having. They had ~169GB in inact, and only ~60GB being used for
>>> ARC.
>>>
>>> Are there any further debugging steps we can recommend to him to help
>>> investigate this?
>> The various scripts attached to the ZS ARC behavior problem and fix PR
>> will help provide detail this.
>> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=187594
>>
>> I've seen it here where there's been bursts of ZFS I/O specifically
>> write bursts.
>>
>> What happens is that ZFS will consume large amounts of space in various
>> UMA zones to accommodate these bursts.
> If you push the vmstat -z that he provided through the arc summary
> script, you'll see that this is not what is happening.  His uma stats
> match up with his arc, and do not account for his inactive memory.
>
> uma script summary:
>
>      Totals
>      oused: 5.860GB, ofree: 1.547GB, ototal: 7.407GB
>      zused: 56.166GB, zfree: 3.918GB, ztotal: 60.084GB
>      used: 62.026GB, free: 5.465GB, total: 67.491GB
>
> His provided top stats:
>
>      Mem: 19G Active, 20G Inact, 81G Wired, 59M Cache, 3308M Buf, 4918M Free
>      ARC: 66G Total, 6926M MFU, 54G MRU, 8069K Anon, 899M Header, 5129M Other
>
>
> The big uma buckets (zio_buf_16384 and zio_data_buf_131072, 18.002GB and
> 28.802GB respectively) are nearly 0% free.
>
Still potentially accounts for 5.4GB of your 20GB inact.

The rest could be malloc backed allocations?

     Regards
     Steve



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?5459ECDE.6090102>