From owner-freebsd-bugs@freebsd.org Wed Sep 13 14:57:01 2017 Return-Path: Delivered-To: freebsd-bugs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 56C11E24E37 for ; Wed, 13 Sep 2017 14:57:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 45D26682A9 for ; Wed, 13 Sep 2017 14:57:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v8DEv0Yc094198 for ; Wed, 13 Sep 2017 14:57:01 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-bugs@FreeBSD.org Subject: [Bug 222288] g_bio leak after zfs ABD commit Date: Wed, 13 Sep 2017 14:57:00 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: dnelson@allantgroup.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 13 Sep 2017 14:57:01 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D222288 Bug ID: 222288 Summary: g_bio leak after zfs ABD commit Product: Base System Version: 11.1-STABLE Hardware: Any OS: Any Status: New Severity: Affects Many People Priority: --- Component: kern Assignee: freebsd-bugs@FreeBSD.org Reporter: dnelson@allantgroup.com It looks like the ABD commit may have introduced a leak of geom bio structs= .=20 It's a slow leak so it's not obvious, but after a few weeks of uptime, one = of my 8GB-RAM systems had accumulated a couple million g_bio objects according= to vmstat (over 2GB of RAM) and was starting to swap. I rebooted it, and afte= r 11 hours, I'm up to 310182: # uptime 9:55AM up 11:08, 11 users, load averages: 0.50, 0.54, 0.55 # vmstat -z | egrep 'ITEM|g_bio'=20 ITEM SIZE LIMIT USED FREE REQ FAIL SLEEP g_bio: 376, 0, 310182, 818, 38182778, 0, 0 Looking at base r321610 itself, it looks like there's a g_bio_destroy() call that got relocated from vdev_geom_io_intr() to vdev_geom_io_done(); maybe t= here are cases where vdev_geom_io_intr is called, but vdev_geom_io_done isn't? I don't know enough about ZFS internals to get any farther than this. Rolling the kernel back to r321609 makes the leak stop, and updating to r32= 1610 makes it appear again. --=20 You are receiving this mail because: You are the assignee for the bug.=