From owner-freebsd-stable@FreeBSD.ORG Sat Feb 21 19:58:05 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 024D5C5D for ; Sat, 21 Feb 2015 19:58:05 +0000 (UTC) Received: from j006.host001.searchy.nl (j006.host001.searchy.nl [79.143.214.199]) by mx1.freebsd.org (Postfix) with ESMTP id 8483CEE3 for ; Sat, 21 Feb 2015 19:58:03 +0000 (UTC) Received: from [192.168.5.21] (5418287B.cm-5-1a.dynamic.ziggo.nl [84.24.40.123]) (Authenticated sender: ppi@j006.host001.searchy.nl) by j006.host001.searchy.nl (Postfix) with ESMTPSA id 8E4871E8C08 for ; Sat, 21 Feb 2015 19:57:55 +0000 (UTC) Message-ID: <54E8E343.10600@searchy.net> Date: Sat, 21 Feb 2015 20:57:55 +0100 From: "Frank de Bot (lists)" User-Agent: Mozilla/5.0 (X11; Linux i686; rv:34.0) Gecko/20100101 Firefox/34.0 SeaMonkey/2.31 MIME-Version: 1.0 To: freebsd-stable@freebsd.org Subject: Re: ZFS L2arc 16.0E size References: <54E1388C.3060602@searchy.net> <54E13F41.7000703@multiplay.co.uk> <54E1B12E.9070809@searchy.net> In-Reply-To: <54E1B12E.9070809@searchy.net> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 21 Feb 2015 19:58:05 -0000 I've done some extra tests: I used a different ssd (samsung 840 pro), same result. I checkout the commitpoint '273060' and build another kernel, uname now says: 'FreeBSD nas 10.1-PRERELEASE FreeBSD 10.1-PRERELEASE #1 r273060: Sat Feb 21 18:42:08 UTC 2015 user@nas:/usr/obj/usr/src/sys/GENERIC amd64 Still same result. cache - - - - - - gpt/l2arc1 68.0G 16.0E 4 165 23.2K 19.3M gpt/l2arc2 68.0G 16.0E 5 162 24.8K 18.6M This already occures after 1 tot 2 hours when transferring a lot of data via rsync to the dataset. Is it worth to try hooking up the ssd to another controller (current on a LSI MegaRAID SAS 9211-4i) Regards, Frank de Bot Frank de Bot wrote: > I did remove and added devices again, with: > > 'zpool remove tank gpt/l2arc1 gpt/l2arc2' > and then > 'zpool add tank cache gpt/l2arc1 gpt/l2arc2' > > I left it running overnight and the same situation occured. > > cache - - - - - - > gpt/l2arc1 175G 16.0E 11 106 55.5K 9.75M > gpt/l2arc2 167G 16.0E 14 107 68.8K 9.81M > > For faster filling of the l2arc I also had 2 systcl's set: > > vfs.zfs.l2arc_write_max: 33554432 > vfs.zfs.l2arc_write_boost: 33554432 > > I do not plan to use this for production, only in testing. > > > Regards, > > Frank de Bot > Steven Hartland wrote: >> IIRC this was fixed by r273060, if your remove your cache device and >> then add it back I think you should be good. >> >> On 16/02/2015 00:23, Frank de Bot (lists) wrote: >>> Hello, >>> >>> I have a FreeBSD 10.1 system with a raidz2 zfs configuration with 2ssd's >>> for l2arc . It is running '10.1-STABLE FreeBSD 10.1-STABLE #0 r278805' >>> Currently I'm running tests before it can go to production, but I have >>> the following issue. After a while the l2arc devices indicate 16.0E free >>> space and it starts 'consuming' more than it can hold >>> >>> cache - - - - - - >>> gpt/l2arc1 107G 16.0E 0 2 0 92.7K >>> gpt/l2arc2 68.3G 16.0E 0 1 0 60.8K >>> >>> It ran good for a while, where data was removed from cache so it could >>> be filled with newer data. (Free space was always around 200/300Mbytes). >>> >>> I've read about similar issues, which should be fixed in different >>> commits, but I'm running the latest stable 10.1 kernel right now. (One >>> of the last similar issue is: >>> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=197164 ) >>> Another similar issue reported at FreeNAS >>> https://bugs.freenas.org/issues/5347 suggested it would be a hardware >>> issue, but I have 2 servers which experience the same problem. One has a >>> Crucial M500 drive and the other a M550. Both have a 64G partition voor >>> l2arc. >>> >>> What is really going on here? >>> >>> >>> Regards, >>> >>> >>> Frank de Bot >>> _______________________________________________ >>> freebsd-stable@freebsd.org mailing list >>> http://lists.freebsd.org/mailman/listinfo/freebsd-stable >>> To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" >> >> _______________________________________________ >> freebsd-stable@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-stable >> To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" >> > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" >