From owner-freebsd-fs@freebsd.org Fri Feb 1 23:52:09 2019 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 34DD014C5650 for ; Fri, 1 Feb 2019 23:52:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id BD7C289BA5 for ; Fri, 1 Feb 2019 23:52:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 760CE14C564F; Fri, 1 Feb 2019 23:52:08 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5140F14C564E for ; Fri, 1 Feb 2019 23:52:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E01DB89B9E for ; Fri, 1 Feb 2019 23:52:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 132D32A5 for ; Fri, 1 Feb 2019 23:52:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x11Nq6r9086290 for ; Fri, 1 Feb 2019 23:52:06 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x11Nq6iT086288 for fs@FreeBSD.org; Fri, 1 Feb 2019 23:52:06 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 229670] Too many vnodes causes ZFS ARC to exceed limit vfs.zfs.arc_max (high ARC "Other" usage) Date: Fri, 01 Feb 2019 23:52:06 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: leif@ofWilsonCreek.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 01 Feb 2019 23:52:09 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D229670 --- Comment #15 from Leif Pedersen --- (In reply to Allan Jude from comment #14) Sure! Actually, the only two systems I have right now on 12 are not overrun= ning it (but they also use the defaults for kern.maxvnodes and vfs.zfs.arc_max). Looks like most of those sysctls were introduced in 12. Still, here's what the 6GB system shows, which is still running 11.2. Maybe= I can upgrade it to 12 and see what it says after this weekend. It's using the defaults for kern.maxvnodes and vfs.zfs.arc_max, and it's overrunning arc_m= ax slightly. $ top Mem: 20M Active, 304M Inact, 5030M Wired, 541M Free ARC: 996M Total, 188M MFU, 242M MRU, 1376K Anon, 22M Header, 542M Other 94M Compressed, 337M Uncompressed, 3.57:1 Ratio $ sysctl kstat.zfs.misc.arcstats.other_size kstat.zfs.misc.arcstats.bonus_s= ize kstat.zfs.misc.arcstats.dnode_size kstat.zfs.misc.arcstats.dbuf_size kstat.zfs.misc.arcstats.metadata_size kstat.zfs.misc.arcstats.other_size: 567460432 sysctl: unknown oid 'kstat.zfs.misc.arcstats.bonus_size' sysctl: unknown oid 'kstat.zfs.misc.arcstats.dnode_size' sysctl: unknown oid 'kstat.zfs.misc.arcstats.dbuf_size' kstat.zfs.misc.arcstats.metadata_size: 443239936 $ sysctl kern.maxvnodes vfs.zfs.arc_max kern.maxvnodes: 179499 vfs.zfs.arc_max: 795726848 And just for fun, here's everything in kstat.zfs.misc.arcstats: $ sysctl kstat.zfs.misc.arcstats kstat.zfs.misc.arcstats.demand_hit_predictive_prefetch: 432799 kstat.zfs.misc.arcstats.sync_wait_for_async: 26963 kstat.zfs.misc.arcstats.arc_meta_min: 319189248 kstat.zfs.misc.arcstats.arc_meta_max: 1454089288 kstat.zfs.misc.arcstats.arc_meta_limit: 198931712 kstat.zfs.misc.arcstats.arc_meta_used: 1034141472 kstat.zfs.misc.arcstats.memory_throttle_count: 0 kstat.zfs.misc.arcstats.l2_write_buffer_list_null_iter: 0 kstat.zfs.misc.arcstats.l2_write_buffer_list_iter: 0 kstat.zfs.misc.arcstats.l2_write_buffer_bytes_scanned: 0 kstat.zfs.misc.arcstats.l2_write_pios: 0 kstat.zfs.misc.arcstats.l2_write_buffer_iter: 0 kstat.zfs.misc.arcstats.l2_write_full: 0 kstat.zfs.misc.arcstats.l2_write_not_cacheable: 1387042 kstat.zfs.misc.arcstats.l2_write_io_in_progress: 0 kstat.zfs.misc.arcstats.l2_write_in_l2: 0 kstat.zfs.misc.arcstats.l2_write_spa_mismatch: 0 kstat.zfs.misc.arcstats.l2_write_passed_headroom: 0 kstat.zfs.misc.arcstats.l2_write_trylock_fail: 0 kstat.zfs.misc.arcstats.l2_hdr_size: 0 kstat.zfs.misc.arcstats.l2_asize: 0 kstat.zfs.misc.arcstats.l2_size: 0 kstat.zfs.misc.arcstats.l2_io_error: 0 kstat.zfs.misc.arcstats.l2_cksum_bad: 0 kstat.zfs.misc.arcstats.l2_abort_lowmem: 0 kstat.zfs.misc.arcstats.l2_free_on_write: 0 kstat.zfs.misc.arcstats.l2_evict_l1cached: 0 kstat.zfs.misc.arcstats.l2_evict_reading: 0 kstat.zfs.misc.arcstats.l2_evict_lock_retry: 0 kstat.zfs.misc.arcstats.l2_writes_lock_retry: 0 kstat.zfs.misc.arcstats.l2_writes_error: 0 kstat.zfs.misc.arcstats.l2_writes_done: 0 kstat.zfs.misc.arcstats.l2_writes_sent: 0 kstat.zfs.misc.arcstats.l2_write_bytes: 0 kstat.zfs.misc.arcstats.l2_read_bytes: 0 kstat.zfs.misc.arcstats.l2_rw_clash: 0 kstat.zfs.misc.arcstats.l2_feeds: 0 kstat.zfs.misc.arcstats.l2_misses: 0 kstat.zfs.misc.arcstats.l2_hits: 0 kstat.zfs.misc.arcstats.mfu_ghost_evictable_metadata: 226059776 kstat.zfs.misc.arcstats.mfu_ghost_evictable_data: 0 kstat.zfs.misc.arcstats.mfu_ghost_size: 226059776 kstat.zfs.misc.arcstats.mfu_evictable_metadata: 0 kstat.zfs.misc.arcstats.mfu_evictable_data: 0 kstat.zfs.misc.arcstats.mfu_size: 196918784 kstat.zfs.misc.arcstats.mru_ghost_evictable_metadata: 540657664 kstat.zfs.misc.arcstats.mru_ghost_evictable_data: 0 kstat.zfs.misc.arcstats.mru_ghost_size: 540657664 kstat.zfs.misc.arcstats.mru_evictable_metadata: 0 kstat.zfs.misc.arcstats.mru_evictable_data: 0 kstat.zfs.misc.arcstats.mru_size: 254938624 kstat.zfs.misc.arcstats.anon_evictable_metadata: 0 kstat.zfs.misc.arcstats.anon_evictable_data: 0 kstat.zfs.misc.arcstats.anon_size: 1671680 kstat.zfs.misc.arcstats.other_size: 567378976 kstat.zfs.misc.arcstats.metadata_size: 443244032 kstat.zfs.misc.arcstats.data_size: 10285056 kstat.zfs.misc.arcstats.hdr_size: 23518464 kstat.zfs.misc.arcstats.overhead_size: 354117120 kstat.zfs.misc.arcstats.uncompressed_size: 353756672 kstat.zfs.misc.arcstats.compressed_size: 99411456 kstat.zfs.misc.arcstats.size: 1044426528 kstat.zfs.misc.arcstats.c_max: 795726848 kstat.zfs.misc.arcstats.c_min: 638378496 kstat.zfs.misc.arcstats.c: 795726848 kstat.zfs.misc.arcstats.p: 621214208 kstat.zfs.misc.arcstats.hash_chain_max: 4 kstat.zfs.misc.arcstats.hash_chains: 4222 kstat.zfs.misc.arcstats.hash_collisions: 840474 kstat.zfs.misc.arcstats.hash_elements_max: 142601 kstat.zfs.misc.arcstats.hash_elements: 96882 kstat.zfs.misc.arcstats.evict_l2_skip: 0 kstat.zfs.misc.arcstats.evict_l2_ineligible: 34269956096 kstat.zfs.misc.arcstats.evict_l2_eligible: 284770299904 kstat.zfs.misc.arcstats.evict_l2_cached: 0 kstat.zfs.misc.arcstats.evict_not_enough: 49123984 kstat.zfs.misc.arcstats.evict_skip: 6955603713 kstat.zfs.misc.arcstats.access_skip: 142705651 kstat.zfs.misc.arcstats.mutex_miss: 6864739 kstat.zfs.misc.arcstats.deleted: 7038134 kstat.zfs.misc.arcstats.allocated: 59387140 kstat.zfs.misc.arcstats.mfu_ghost_hits: 299078 kstat.zfs.misc.arcstats.mfu_hits: 245858368 kstat.zfs.misc.arcstats.mru_ghost_hits: 1625090 kstat.zfs.misc.arcstats.mru_hits: 105751966 kstat.zfs.misc.arcstats.prefetch_metadata_misses: 3148348 kstat.zfs.misc.arcstats.prefetch_metadata_hits: 8579968 kstat.zfs.misc.arcstats.prefetch_data_misses: 157488 kstat.zfs.misc.arcstats.prefetch_data_hits: 1039 kstat.zfs.misc.arcstats.demand_metadata_misses: 19827718 kstat.zfs.misc.arcstats.demand_metadata_hits: 348572671 kstat.zfs.misc.arcstats.demand_data_misses: 2626794 kstat.zfs.misc.arcstats.demand_data_hits: 2055456 kstat.zfs.misc.arcstats.misses: 25760348 kstat.zfs.misc.arcstats.hits: 359209134 --=20 You are receiving this mail because: You are the assignee for the bug.=