From owner-freebsd-fs@FreeBSD.ORG Mon Jan 12 21:42:04 2015 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 88BB16FC for ; Mon, 12 Jan 2015 21:42:04 +0000 (UTC) Received: from kerio.tuxis.nl (alcyone.saas.tuxis.net [31.3.111.19]) (using TLSv1.1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1A8BC1BB for ; Mon, 12 Jan 2015 21:42:03 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=tuxis.nl; s=mail; h=from:subject:date:message-id:to:mime-version:content-type: content-transfer-encoding:in-reply-to; bh=YGl43hc0868JYBP11PK0sX04BNIjCa/1dQs0apWtkIo=; b=XmJ2ZIIFBbhzPa6Rk1Kn+cC4vca6ofTczpNvkZ81zBINAP8um1+Bmhr2DtycK5gQfg/m6frXuCSv0 SGF8WZDp3Npai5VuLrWmrrEFLtg70/c55RXiDN5MJhI/S5iKn9Lk6iVI4JPdEUUk2yH1Tg7wTvcosK oQEb+fF/nt1fXvPuX/pwlsAuc5Idk9sdLMOKsj1J/GR+uzoFXSqGc+r/FRaCSp/dJV2seJYXBGmwgP SgyQ6KXW7l0jq+ORb4E1apFgrKN8ka2eYN3LXKFJM/RhPD3ep/nHTGjyP//FuqCdo5lE2eU9xE94MW GrRwve6W4NuMtp+bvr+BLhISq4IiknA== X-Footer: dHV4aXMubmw= Received: from [87.212.163.171] ([87.212.163.171]) by kerio.tuxis.nl (Kerio Connect 8.4.0); Mon, 12 Jan 2015 22:11:48 +0100 From: "Mark Schouten" Subject: Re: memory exhaustion on 10.1 AMD64 ZFS storage system To: "Joseph Mingrone" , freebsd-fs@freebsd.org Organization: Tuxis Internet Engineering In-Reply-To: <868uh7ydqy.fsf@gly.ftfl.ca> Message-ID: <20150112211148.15c1fe3c@kerio.tuxis.nl> Date: Mon, 12 Jan 2015 22:11:48 +0100 X-Mailer: Kerio Connect 8.4.0 WebMail X-User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.95 Safari/537.36 MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 12 Jan 2015 21:42:04 -0000 Hi, > We've had this storage system running 9.x without problems. After > upgrading to 10.1 we've seen "out of swap space" messages in the logs. >=20 > Dec 13 04:29:12 storage2 kernel: pid 723 (rpc.statd), uid 0, was kille= d: > out of swap space Do you have compression enabled and L2ARC=3F There's this bug that leaks= memory via L2ARC, causing all memory to run out, pushing out the ARC an= d (probably) causes crashes and lots of swap usage.. I think this is about that bug: https://github.com/freebsd/freebsd/commit/b98f85d480b770e34d5e08c66dbc66= 8bd5548bdc Mark