From owner-freebsd-bugs@freebsd.org Fri Jun 26 07:41:25 2020 Return-Path: Delivered-To: freebsd-bugs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 880A93505B6 for ; Fri, 26 Jun 2020 07:41:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49tTN537rPz4B3m for ; Fri, 26 Jun 2020 07:41:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 69459350646; Fri, 26 Jun 2020 07:41:25 +0000 (UTC) Delivered-To: bugs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 69009350645 for ; Fri, 26 Jun 2020 07:41:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49tTN52DYtz49yR for ; Fri, 26 Jun 2020 07:41:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4446510B35 for ; Fri, 26 Jun 2020 07:41:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 05Q7fPKp006877 for ; Fri, 26 Jun 2020 07:41:25 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 05Q7fPwb006865 for bugs@FreeBSD.org; Fri, 26 Jun 2020 07:41:25 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: bugs@FreeBSD.org Subject: [Bug 247557] ZFS History Unbounded Memory Usage Date: Fri, 26 Jun 2020 07:41:24 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: samjvaughan@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Jun 2020 07:41:25 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D247557 Bug ID: 247557 Summary: ZFS History Unbounded Memory Usage Product: Base System Version: 12.1-RELEASE Hardware: amd64 OS: Any Status: New Severity: Affects Many People Priority: --- Component: kern Assignee: bugs@FreeBSD.org Reporter: samjvaughan@gmail.com I have a production server running FreeBSD 11.3 amd64 that has been running= out of swap space occasionally at 3:01am. I went through all of the periodic d= aily scripts and discovered that it occurs when the /etc/periodic/daily/800.scrub-zfs script runs. Looking a bit closer, it appears that the `zfs history` command is using 3.= 7G of memory producing 353k lines of output. (this server has had many years = of regular snapshots) I have reproduced the issue on another server running FreeBSD 12.1 amd64. = It used about 1.2G of memory producing 104k lines of output. After a short search I uncovered an OpenZFS commit that addresses this issu= e by processing the history in chunks: https://github.com/openzfs/zfs/pull/9516/commits/d6156a01ba93e0eee6fec64c0a= dc8e4740673718 I then browsed the FreeBSD sources and saw that this commit has not made it= to the FreeBSD codebase yet. I don't know what the situation is with all the different ZFSes and merging= of changes but I'm wondering if one of the developers would be kind enough to = try merging this fix please? It would be awesome if this issue could be addressed because it has the potential to make production systems unstable over time as their ZFS history grows. --=20 You are receiving this mail because: You are the assignee for the bug.=