From owner-freebsd-fs@freebsd.org Tue Jul 14 09:26:33 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2A04899CDEC for ; Tue, 14 Jul 2015 09:26:33 +0000 (UTC) (envelope-from matthew@freebsd.org) Received: from smtp.infracaninophile.co.uk (smtp.infracaninophile.co.uk [IPv6:2001:8b0:151:1:3cd3:cd67:fafa:3d78]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.infracaninophile.co.uk", Issuer "infracaninophile.co.uk" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id BFF30A95 for ; Tue, 14 Jul 2015 09:26:32 +0000 (UTC) (envelope-from matthew@freebsd.org) Received: from ox-dell39.ox.adestra.com (no-reverse-dns.metronet-uk.com [85.199.232.226] (may be forged)) (authenticated bits=0) by smtp.infracaninophile.co.uk (8.15.1/8.15.1) with ESMTPSA id t6E9QMMl034358 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO) for ; Tue, 14 Jul 2015 10:26:23 +0100 (BST) (envelope-from matthew@freebsd.org) Authentication-Results: smtp.infracaninophile.co.uk; dmarc=none header.from=freebsd.org DKIM-Filter: OpenDKIM Filter v2.9.2 smtp.infracaninophile.co.uk t6E9QMMl034358 Authentication-Results: smtp.infracaninophile.co.uk/t6E9QMMl034358; dkim=none reason="no signature"; dkim-adsp=none; dkim-atps=neutral X-Authentication-Warning: lucid-nonsense.infracaninophile.co.uk: Host no-reverse-dns.metronet-uk.com [85.199.232.226] (may be forged) claimed to be ox-dell39.ox.adestra.com Message-ID: <55A4D5B7.2030603@freebsd.org> Date: Tue, 14 Jul 2015 10:26:15 +0100 From: Matthew Seaman User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:31.0) Gecko/20100101 Thunderbird/31.7.0 MIME-Version: 1.0 To: freebsd-fs@freebsd.org Subject: Re: FreeBSD 10.1 Memory Exhaustion References: <55A3A800.5060904@denninger.net> In-Reply-To: <55A3A800.5060904@denninger.net> Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="CnuH8DIVhwl4sPakXbhMRW56gHDDcql24" X-Virus-Scanned: clamav-milter 0.98.7 at lucid-nonsense.infracaninophile.co.uk X-Virus-Status: Clean X-Spam-Status: No, score=-2.8 required=5.0 tests=ALL_TRUSTED,AWL,BAYES_00 autolearn=ham autolearn_force=no version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on lucid-nonsense.infracaninophile.co.uk X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 14 Jul 2015 09:26:33 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --CnuH8DIVhwl4sPakXbhMRW56gHDDcql24 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable On 07/13/15 12:58, Karl Denninger wrote: > Put this on your box and see if the problem goes away.... :-) >=20 > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D187594 >=20 > The 2015-02-10 refactor will apply against 10.1-STABLE and 10.2-PRE (th= e > latter will give you a 10-line fuzz in one block but applies and works.= ) >=20 > I've been unable to provoke misbehavior with this patch in and I run a > cron job that does auto-snapshotting. There are others that have run > this patch with similarly positive results. I know that you, Karl, and a number of others have been advocating to get this patch set committed. Having now personally run into the sort of problems that this addresses I can say that I would very much like to see this go in. Conditional of course on this actually solving the problems I and others have been experiencing without introducing significant regressions elsewhere. It's only had a day's testing from me so far, but it's looking good. If it survives a week without the system locking up, I'll be convinced. I also know that some of the most experienced ZFS developers are cautious about applying this patchset, and I do not doubt that they have good reason to think so. What I wonder is could it be possible to generate some sort of regression tests where * The memory exhaustion effect or equivalent memory pressures can be triggered at will * The test doesn't require unfeasibly large resources to run * The behaviour provides a good model for real-world deployments Maybe these tests would be too large-scale to run every day in Jenkins, but having them available as part of, say, the release process, seems like a no-brainer to me. ZFS is one of FreeBSD's big selling points, and not having it work reliably at scale is an embarrassment, to say the least. Cheers, Matthew --CnuH8DIVhwl4sPakXbhMRW56gHDDcql24 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQIcBAEBCgAGBQJVpNW3AAoJEABRPxDgqeTnJ4oP/2J7iAvWZUXaQzESb0IBc91N ZKG1P9XtsEkN5FJOn963s2Vhc8HHdB3PGgKYbRVMu+WVUPXPrKSihxHVSD8QkWAt D1TGuDcPZ7oDiS/wfzROZi0zOxghot0NPY+LcLKaDVdNe9bv2HQYuTTCOKLKG/nm krOSK7jIRcng7Ll89TJxz2gEEDr+U+gcFZq5R9M/ljGin0mxK1HjrPiGP2tFCJ/F F+AGkxDPdSLRK/xgpRwcq7chhmftYlSxd95kH/eSckI9U4bufq2s2I9dNfs0qkT5 Uh1ODFa0/Ze+RTFH9Y0UHOOU2xxlqA1/ju1zI0RLMAfk4R+8LyHqJeQa2VhIlTvE MZPPTJaCzdokK73DYdRVMTIRrw6WIYWAx04pBZtzit/tak1B1JxkwCLItFM3E0H3 YgjdOKB7vb5LIZoTMTURS355mpa+OfhMcobmpZt4fTg1MprgF+9DHlacSE5azJmh 6yTA7qQfgihw74KPKrPsxCYcLz0Vsf28/UcXghH+zaO645Vplt5f8ZjwfEjE2xAO Q2xi+dhU/Oi40FjJNgNFTMEaWj3j+zGNNHgwfnv6tpvUei67UpqCXzbE+liypYoq OBfPwHdqv6a6NHhIvaqCZFkBmNwmFPoH+w9Kz3X5aJzmstOCVagsIxRw+tqHIpha uib2r6lYOjUZLFnogFp8 =3wyn -----END PGP SIGNATURE----- --CnuH8DIVhwl4sPakXbhMRW56gHDDcql24--