Date: Wed, 06 Apr 2022 13:15:35 +0200 From: egoitz@ramattack.net To: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org, freebsd-performance@freebsd.org Subject: Desperate with 870 QVO and ZFS Message-ID: <4e98275152e23141eae40dbe7ba5571f@ramattack.net>
next in thread | raw e-mail | index | archive | help
[-- Attachment #1 --] [-- Attachment #2 --] /tmp/zfs-stats -a ------------------------------------------------------------------------ ZFS Subsystem Report Wed Apr 6 11:58:18 2022 ------------------------------------------------------------------------ System Information: Kernel Version: 1202000 (osreldate) Hardware Platform: amd64 Processor Architecture: amd64 ZFS Storage pool Version: 5000 ZFS Filesystem Version: 5 FreeBSD 12.2-RELEASE-p6 r369855 GENERIC 11:58AM up 148 days, 20:29, 1 user, load averages: 2.11, 2.47, 2.26 ------------------------------------------------------------------------ System Memory: 3.24% 4.03 GiB Active, 71.50% 88.93 GiB Inact 22.78% 28.33 GiB Wired, 0.00% 0 Bytes Cache 2.25% 2.80 GiB Free, 0.23% 292.61 MiB Gap Real Installed: 128.00 GiB Real Available: 99.70% 127.62 GiB Real Managed: 97.47% 124.39 GiB Logical Total: 128.00 GiB Logical Used: 28.33% 36.26 GiB Logical Free: 71.67% 91.74 GiB Kernel Memory: 3.21 GiB Data: 98.82% 3.17 GiB Text: 1.18% 38.65 MiB Kernel Memory Map: 124.39 GiB Size: 22.34% 27.79 GiB Free: 77.66% 96.60 GiB ------------------------------------------------------------------------ ARC Summary: (HEALTHY) Memory Throttle Count: 0 ARC Misc: Deleted: 1.78 b Mutex Misses: 187.25 m Evict Skips: 87.35 b ARC Size: 29.25% 18.72 GiB Target Size: (Adaptive) 12.50% 8.00 GiB Min Size (Hard Limit): 12.50% 8.00 GiB Max Size (High Water): 8:1 64.00 GiB Decompressed Data Size: 9.52 GiB Compression Factor: 0.51 ARC Size Breakdown: Recently Used Cache Size: 2.67% 512.00 MiB Frequently Used Cache Size: 97.33% 18.22 GiB ARC Hash Breakdown: Elements Max: 3.11 m Elements Current: 19.21% 596.62 k Collisions: 203.64 m Chain Max: 5 Chains: 10.23 k ------------------------------------------------------------------------ ARC Efficiency: 188.06 b Cache Hit Ratio: 98.63% 185.48 b Cache Miss Ratio: 1.37% 2.58 b Actual Hit Ratio: 98.62% 185.46 b Data Demand Efficiency: 98.44% 57.36 b Data Prefetch Efficiency: 2.45% 859.03 m CACHE HITS BY CACHE LIST: Most Recently Used: 10.89% 20.20 b Most Frequently Used: 89.10% 165.26 b Most Recently Used Ghost: 0.07% 138.70 m Most Frequently Used Ghost: 0.16% 300.84 m CACHE HITS BY DATA TYPE: Demand Data: 30.44% 56.46 b Prefetch Data: 0.01% 21.01 m Demand Metadata: 69.54% 128.98 b Prefetch Metadata: 0.01% 16.09 m CACHE MISSES BY DATA TYPE: Demand Data: 34.75% 896.67 m Prefetch Data: 32.47% 838.02 m Demand Metadata: 31.18% 804.57 m Prefetch Metadata: 1.60% 41.27 m ------------------------------------------------------------------------ L2ARC is disabled ------------------------------------------------------------------------ Per dataset statistics are not available ------------------------------------------------------------------------ File-Level Prefetch: DMU Efficiency: 83.52 b Hit Ratio: 2.74% 2.29 b Miss Ratio: 97.26% 81.23 b ------------------------------------------------------------------------ VDEV cache is disabled ------------------------------------------------------------------------ ZFS Tunables (sysctl): kern.maxusers 8503 vm.kmem_size 133560307712 vm.kmem_size_scale 1 vm.kmem_size_min 0 vm.kmem_size_max 1319413950874 vfs.zfs.trim.max_interval 1 vfs.zfs.trim.timeout 30 vfs.zfs.trim.txg_delay 32 vfs.zfs.trim.enabled 1 vfs.zfs.vol.immediate_write_sz 32768 vfs.zfs.vol.unmap_sync_enabled 0 vfs.zfs.vol.unmap_enabled 1 vfs.zfs.vol.recursive 0 vfs.zfs.vol.mode 1 vfs.zfs.version.zpl 5 vfs.zfs.version.spa 5000 vfs.zfs.version.acl 1 vfs.zfs.version.ioctl 7 vfs.zfs.debug 0 vfs.zfs.super_owner 0 vfs.zfs.immediate_write_sz 32768 vfs.zfs.sync_pass_rewrite 2 vfs.zfs.sync_pass_dont_compress 5 vfs.zfs.sync_pass_deferred_free 2 vfs.zfs.zio.dva_throttle_enabled 1 vfs.zfs.zio.exclude_metadata 0 vfs.zfs.zio.use_uma 1 vfs.zfs.zio.taskq_batch_pct 75 vfs.zfs.zil_maxblocksize 131072 vfs.zfs.zil_slog_bulk 786432 vfs.zfs.zil_nocacheflush 0 vfs.zfs.zil_replay_disable 0 vfs.zfs.cache_flush_disable 0 vfs.zfs.standard_sm_blksz 131072 vfs.zfs.dtl_sm_blksz 4096 vfs.zfs.min_auto_ashift 12 vfs.zfs.max_auto_ashift 13 vfs.zfs.vdev.trim_max_pending 10000 vfs.zfs.vdev.bio_delete_disable 0 vfs.zfs.vdev.bio_flush_disable 0 vfs.zfs.vdev.def_queue_depth 32 vfs.zfs.vdev.queue_depth_pct 1000 vfs.zfs.vdev.write_gap_limit 4096 vfs.zfs.vdev.read_gap_limit 32768 vfs.zfs.vdev.aggregation_limit_non_rotating131072 vfs.zfs.vdev.aggregation_limit 1048576 vfs.zfs.vdev.initializing_max_active 1 vfs.zfs.vdev.initializing_min_active 1 vfs.zfs.vdev.removal_max_active 2 vfs.zfs.vdev.removal_min_active 1 vfs.zfs.vdev.trim_max_active 64 vfs.zfs.vdev.trim_min_active 1 vfs.zfs.vdev.scrub_max_active 2 vfs.zfs.vdev.scrub_min_active 1 vfs.zfs.vdev.async_write_max_active 10 vfs.zfs.vdev.async_write_min_active 1 vfs.zfs.vdev.async_read_max_active 3 vfs.zfs.vdev.async_read_min_active 1 vfs.zfs.vdev.sync_write_max_active 10 vfs.zfs.vdev.sync_write_min_active 10 vfs.zfs.vdev.sync_read_max_active 10 vfs.zfs.vdev.sync_read_min_active 10 vfs.zfs.vdev.max_active 1000 vfs.zfs.vdev.async_write_active_max_dirty_percent60 vfs.zfs.vdev.async_write_active_min_dirty_percent30 vfs.zfs.vdev.mirror.non_rotating_seek_inc1 vfs.zfs.vdev.mirror.non_rotating_inc 0 vfs.zfs.vdev.mirror.rotating_seek_offset1048576 vfs.zfs.vdev.mirror.rotating_seek_inc 5 vfs.zfs.vdev.mirror.rotating_inc 0 vfs.zfs.vdev.trim_on_init 1 vfs.zfs.vdev.cache.bshift 16 vfs.zfs.vdev.cache.size 0 vfs.zfs.vdev.cache.max 16384 vfs.zfs.vdev.validate_skip 0 vfs.zfs.vdev.max_ms_shift 34 vfs.zfs.vdev.default_ms_shift 29 vfs.zfs.vdev.max_ms_count_limit 131072 vfs.zfs.vdev.min_ms_count 16 vfs.zfs.vdev.default_ms_count 200 vfs.zfs.txg.timeout 5 vfs.zfs.space_map_ibs 14 vfs.zfs.special_class_metadata_reserve_pct25 vfs.zfs.user_indirect_is_special 1 vfs.zfs.ddt_data_is_special 1 vfs.zfs.spa_allocators 4 vfs.zfs.spa_min_slop 134217728 vfs.zfs.spa_slop_shift 5 vfs.zfs.spa_asize_inflation 24 vfs.zfs.deadman_enabled 1 vfs.zfs.deadman_checktime_ms 5000 vfs.zfs.deadman_synctime_ms 1000000 vfs.zfs.debugflags 0 vfs.zfs.recover 0 vfs.zfs.spa_load_verify_data 1 vfs.zfs.spa_load_verify_metadata 1 vfs.zfs.spa_load_verify_maxinflight 10000 vfs.zfs.max_missing_tvds_scan 0 vfs.zfs.max_missing_tvds_cachefile 2 vfs.zfs.max_missing_tvds 0 vfs.zfs.spa_load_print_vdev_tree 0 vfs.zfs.ccw_retry_interval 300 vfs.zfs.check_hostid 1 vfs.zfs.multihost_fail_intervals 10 vfs.zfs.multihost_import_intervals 20 vfs.zfs.multihost_interval 1000 vfs.zfs.mg_fragmentation_threshold 85 vfs.zfs.mg_noalloc_threshold 0 vfs.zfs.condense_pct 200 vfs.zfs.metaslab_sm_blksz 4096 vfs.zfs.metaslab.bias_enabled 1 vfs.zfs.metaslab.lba_weighting_enabled 1 vfs.zfs.metaslab.fragmentation_factor_enabled1 vfs.zfs.metaslab.preload_enabled 1 vfs.zfs.metaslab.preload_limit 3 vfs.zfs.metaslab.unload_delay 8 vfs.zfs.metaslab.load_pct 50 vfs.zfs.metaslab.min_alloc_size 33554432 vfs.zfs.metaslab.df_free_pct 4 vfs.zfs.metaslab.df_alloc_threshold 131072 vfs.zfs.metaslab.debug_unload 0 vfs.zfs.metaslab.debug_load 0 vfs.zfs.metaslab.fragmentation_threshold70 vfs.zfs.metaslab.force_ganging 16777217 vfs.zfs.free_bpobj_enabled 1 vfs.zfs.free_max_blocks -1 vfs.zfs.zfs_scan_checkpoint_interval 7200 vfs.zfs.zfs_scan_legacy 0 vfs.zfs.no_scrub_prefetch 0 vfs.zfs.no_scrub_io 0 vfs.zfs.resilver_min_time_ms 3000 vfs.zfs.free_min_time_ms 1000 vfs.zfs.scan_min_time_ms 1000 vfs.zfs.scan_idle 50 vfs.zfs.scrub_delay 4 vfs.zfs.resilver_delay 2 vfs.zfs.zfetch.array_rd_sz 1048576 vfs.zfs.zfetch.max_idistance 67108864 vfs.zfs.zfetch.max_distance 8388608 vfs.zfs.zfetch.min_sec_reap 2 vfs.zfs.zfetch.max_streams 8 vfs.zfs.prefetch_disable 0 vfs.zfs.delay_scale 500000 vfs.zfs.delay_min_dirty_percent 60 vfs.zfs.dirty_data_sync_pct 20 vfs.zfs.dirty_data_max_percent 10 vfs.zfs.dirty_data_max_max 4294967296 vfs.zfs.dirty_data_max 4294967296 vfs.zfs.max_recordsize 1048576 vfs.zfs.default_ibs 17 vfs.zfs.default_bs 9 vfs.zfs.send_holes_without_birth_time 1 vfs.zfs.mdcomp_disable 0 vfs.zfs.per_txg_dirty_frees_percent 5 vfs.zfs.nopwrite_enabled 1 vfs.zfs.dedup.prefetch 1 vfs.zfs.dbuf_cache_lowater_pct 10 vfs.zfs.dbuf_cache_hiwater_pct 10 vfs.zfs.dbuf_metadata_cache_overflow 0 vfs.zfs.dbuf_metadata_cache_shift 6 vfs.zfs.dbuf_cache_shift 5 vfs.zfs.dbuf_metadata_cache_max_bytes 1073741824 vfs.zfs.dbuf_cache_max_bytes 2147483648 vfs.zfs.arc_min_prescient_prefetch_ms 6 vfs.zfs.arc_min_prefetch_ms 1 vfs.zfs.l2c_only_size 0 vfs.zfs.mfu_ghost_data_esize 1466153472 vfs.zfs.mfu_ghost_metadata_esize 7072380416 vfs.zfs.mfu_ghost_size 8538533888 vfs.zfs.mfu_data_esize 0 vfs.zfs.mfu_metadata_esize 0 vfs.zfs.mfu_size 983127040 vfs.zfs.mru_ghost_data_esize 0 vfs.zfs.mru_ghost_metadata_esize 0 vfs.zfs.mru_ghost_size 0 vfs.zfs.mru_data_esize 0 vfs.zfs.mru_metadata_esize 0 vfs.zfs.mru_size 12903351296 vfs.zfs.anon_data_esize 0 vfs.zfs.anon_metadata_esize 0 vfs.zfs.anon_size 125122560 vfs.zfs.l2arc_norw 1 vfs.zfs.l2arc_feed_again 1 vfs.zfs.l2arc_noprefetch 1 vfs.zfs.l2arc_feed_min_ms 200 vfs.zfs.l2arc_feed_secs 1 vfs.zfs.l2arc_headroom 2 vfs.zfs.l2arc_write_boost 8388608 vfs.zfs.l2arc_write_max 8388608 vfs.zfs.arc_meta_strategy 0 vfs.zfs.arc_meta_limit 17179869184 vfs.zfs.arc_free_target 694724 vfs.zfs.arc_kmem_cache_reap_retry_ms 1000 vfs.zfs.compressed_arc_enabled 1 vfs.zfs.arc_grow_retry 60 vfs.zfs.arc_shrink_shift 7 vfs.zfs.arc_average_blocksize 8192 vfs.zfs.arc_no_grow_shift 5 vfs.zfs.arc_min 8589934592 vfs.zfs.arc_max 68719476736 vfs.zfs.abd_chunk_size 4096 vfs.zfs.abd_scatter_enabled 1 ------------------------------------------------------------------------
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4e98275152e23141eae40dbe7ba5571f>