From owner-freebsd-stable@FreeBSD.ORG Tue Apr 7 06:37:59 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 98CF190B; Tue, 7 Apr 2015 06:37:59 +0000 (UTC) Received: from mail-pa0-x232.google.com (mail-pa0-x232.google.com [IPv6:2607:f8b0:400e:c03::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5FC968F7; Tue, 7 Apr 2015 06:37:59 +0000 (UTC) Received: by pacyx8 with SMTP id yx8so68350120pac.1; Mon, 06 Apr 2015 23:37:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:content-type:subject:date:message-id:cc:to:mime-version; bh=9U8rlICfZ/9c7Gh2I50G0ofQlTcuOL955nj4G6fyJ8w=; b=AgL5xYsHCmqdtpLLKQ8fC98YnufuYm4uwUXbw/01lxw7eCsuoud7hpAlOASXbX3dF0 rhleHRuO9oRnlcb7aoMdtU8FRejHFvcz0jX2My6RFAEmvQmZErsyF0neN3BzvW0JJ45B PxgcEP9OpC8MOd6iZgQnKUB0fQxZzw0oYrIgun9zXDRCPIcatCU2f98wKdrd0A3ObGFA PGYi2lI1HqtdjrwxgTsUswR1eSNNx/6a8uzig0QE2thFcgEV1yTkrNEr4NuD8QnWMJsB v5ICZCL25E3CYTeL2+BzlSSFrrga6cB7IHrhxWVQZ5iU68r9hRRslh0gzlEGHUgcl20f quig== X-Received: by 10.70.131.76 with SMTP id ok12mr33435205pdb.155.1428388678675; Mon, 06 Apr 2015 23:37:58 -0700 (PDT) Received: from ?IPv6:2601:8:ab80:7d6:578:9b2c:a252:4667? ([2601:8:ab80:7d6:578:9b2c:a252:4667]) by mx.google.com with ESMTPSA id pa6sm6883498pac.45.2015.04.06.23.37.57 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Mon, 06 Apr 2015 23:37:58 -0700 (PDT) From: Garrett Cooper Content-Type: multipart/signed; boundary="Apple-Mail=_C5F0CD32-23D7-44BA-8C8E-E252FF9CCF4C"; protocol="application/pgp-signature"; micalg=pgp-sha512 Subject: FreeBSD/ZFS on 9.3-RELEASE chews up memory with "wide" directories when calling readdir, etc; causes trap 12 panics Date: Mon, 6 Apr 2015 23:37:56 -0700 Message-Id: To: freebsd-fs@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) X-Mailer: Apple Mail (2.1878.6) Cc: freebsd-stable X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Apr 2015 06:37:59 -0000 --Apple-Mail=_C5F0CD32-23D7-44BA-8C8E-E252FF9CCF4C Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=windows-1252 Hi, Long story short, I had a lot of mail spooled up in /var/spool. = When I did ls /var/spool, ZFS chewed up almost all 12GB of my memory in = <10 mins (because there were enough files there) and the system = eventually panicked because [I assume that a memory allocation failed = and] a trap 12 panic was caught. I don=92t have the exact details, but = it should be relatively easy to repro (YMMV if you have a boatload of = RAM): repro_end=3D10000000000 for i in $(seq 1 $repro_end); do mktemp tmp.XXXXXXXXXXXX; done ls This might be ameliorated via r281026, but this change is only = available in CURRENT (so far), and I haven=92t tested it. Are there any comments about this scalability issue with = FreeBSD/ZFS? Thanks, --Apple-Mail=_C5F0CD32-23D7-44BA-8C8E-E252FF9CCF4C Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQEcBAEBCgAGBQJVI3tFAAoJEMZr5QU6S73eR6kH/A1XPCegxem49+98PdTl4NuY 95tQEbzANC8xbnOFueluyEk6/8/X0kIFvEwraQxJg9kPUuC1goWghzNVPp/iTXuv TOxv3jTUmg2GYP0nvkcP/0G7G/7QRthr59XYtZZQZZiw3XqjpnDLECJ37eGjAxyY QiQte9z7FnzUMAE/f+vPGTffwkEYh9+DcFwmoCfTAnS9vmt8UfyYbOyuPmP58Dyv OJkAa9WpIVUrGSlILnXi+H8A5S9BTLZb91g+pOsp1YTeXoE6X7v+JafoM6kHMZEM gV/xaHoJXeCecp1VDDt/yLXM6ZTu36GnuDBxVdtghLJPH1eRBQyOdEXJQUhEX3c= =nPfJ -----END PGP SIGNATURE----- --Apple-Mail=_C5F0CD32-23D7-44BA-8C8E-E252FF9CCF4C--