From owner-freebsd-bugs@freebsd.org Sat Sep 29 00:30:18 2018 Return-Path: Delivered-To: freebsd-bugs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DA37A10BCC24 for ; Sat, 29 Sep 2018 00:30:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 9B2EE88471 for ; Sat, 29 Sep 2018 00:30:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 5BA6010BCC1D; Sat, 29 Sep 2018 00:30:17 +0000 (UTC) Delivered-To: bugs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4A54310BCC1B for ; Sat, 29 Sep 2018 00:30:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0D4538846B for ; Sat, 29 Sep 2018 00:30:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 5311C12950 for ; Sat, 29 Sep 2018 00:30:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w8T0UG8n004281 for ; Sat, 29 Sep 2018 00:30:16 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w8T0UGKN004280 for bugs@FreeBSD.org; Sat, 29 Sep 2018 00:30:16 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: bugs@FreeBSD.org Subject: [Bug 231794] Panic in ZFS due to arc related memory exhaustion Date: Sat, 29 Sep 2018 00:30:16 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: davewrobison@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter attachments.created Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 29 Sep 2018 00:30:18 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D231794 Bug ID: 231794 Summary: Panic in ZFS due to arc related memory exhaustion Product: Base System Version: 11.2-RELEASE Hardware: amd64 OS: Any Status: New Severity: Affects Some People Priority: --- Component: kern Assignee: bugs@FreeBSD.org Reporter: davewrobison@gmail.com Created attachment 197582 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D197582&action= =3Dedit Photo of backtrace We are evaluating two servers based on the HP DL360 G10 (16 gigs RAM) and HP DL380 G10 (32 gigs RAM) motherboards. We can routinely panic these machines= by putting them under load while running ZFS. Running six instances of bonnie++ and six instances of memtester (testing 2g) is enough to panic the DL360 in around 15 minutes and the DL380 in 10-13 hours. Reducing ARC dramatically using vfs.zfs.arc_min and vfs.zfs.arc_max seems to mitigate this problem, at least after a day of testing under 12.0-A7. We are testing now on 11.2-RELEASE which we will use in production. Daiichi from Japan was here to help diagnose this problem, and has been in contact with core team members who requested this bugzilla submission. More panic photos available on request. --=20 You are receiving this mail because: You are the assignee for the bug.=