From owner-freebsd-stable@freebsd.org Tue Sep 12 06:28:00 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 94008E1BD99 for ; Tue, 12 Sep 2017 06:28:00 +0000 (UTC) (envelope-from borjam@sarenet.es) Received: from cu1176c.smtpx.saremail.com (cu1176c.smtpx.saremail.com [195.16.148.151]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 02FE263E6A for ; Tue, 12 Sep 2017 06:27:59 +0000 (UTC) (envelope-from borjam@sarenet.es) Received: from [172.16.8.41] (unknown [192.148.167.11]) by proxypop02.sare.net (Postfix) with ESMTPA id 7AA4A9DD33A; Tue, 12 Sep 2017 08:27:55 +0200 (CEST) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: Re: Unusually high "Wired" memory From: Borja Marcos In-Reply-To: <280948FF-C17D-44FD-B57B-55EBD9848BDB@sarenet.es> Date: Tue, 12 Sep 2017 08:27:54 +0200 Cc: FreeBSD-STABLE Mailing List Content-Transfer-Encoding: quoted-printable Message-Id: <532F967A-A839-4789-953D-29BC8D3AC350@sarenet.es> References: <853D9198-6AB7-496F-B1C2-F8C5814114B6@sarenet.es> <280948FF-C17D-44FD-B57B-55EBD9848BDB@sarenet.es> To: Borja Marcos X-Mailer: Apple Mail (2.3273) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 Sep 2017 06:28:00 -0000 > On 11 Sep 2017, at 11:25, Borja Marcos wrote: >=20 >> Since I=E2=80=99ve updated a machine to 11.1-STABLE I am seeing a = rather unusual growth of Wired memory. >>=20 >> Any hints on what might have changed from 11-RELEASE to 11.1-RELEASE = and 11.1-STABLE? vmstat -z and vmstat -m follow % vmstat -z ITEM SIZE LIMIT USED FREE REQ FAIL SLEEP UMA Kegs: 384, 0, 126, 4, 126, 0, 0 UMA Zones: 4736, 0, 143, 0, 143, 0, 0 UMA Slabs: 80, 0, 89605, 70495,14041377, 0, 0 UMA Hash: 256, 0, 4, 11, 15, 0, 0 4 Bucket: 32, 0, 27, 2348, 4568149, 0, 0 6 Bucket: 48, 0, 0, 0, 470783, 0, 0 8 Bucket: 64, 0, 0, 0, 6493588, 13, 0 12 Bucket: 96, 0, 0, 0, 2905574, 2, 0 16 Bucket: 128, 0, 28, 747, 1375609, 0, 0 32 Bucket: 256, 0, 0, 0, 1342213,14372, = 0 64 Bucket: 512, 0, 0, 0, 4462146,120046, = 0 128 Bucket: 1024, 0, 0, 0, 846934,11702, = 0 256 Bucket: 2048, 0, 0, 0, 402301,3139, 0 vmem btag: 56, 0, 18945, 10875, 367860, 216, 0 VM OBJECT: 240, 0, 28017, 37279, 5670269, 0, 0 RADIX NODE: 144, 0, 27077, 26410,19244770, 0, 0 MAP: 240, 0, 3, 61, 3, 0, 0 KMAP ENTRY: 128, 0, 6, 87, 6, 0, 0 MAP ENTRY: 128, 0, 4327, 3454, 5294482, 0, 0 VMSPACE: 2504, 0, 28, 128, 3950, 0, 0 fakepg: 104, 0, 4, 148, 4, 0, 0 mt_zone: 16400, 0, 307, 0, 307, 0, 0 16: 16, 0, 40214, 36843,86753581, 0, 0 32: 32, 0, 29825, 43925,312018796, 0, = 0 64: 64, 0, 44824, 186002,119290303, 0, = 0 128: 128, 0, 14044, 17669,192809899, 0, = 0 256: 256, 0, 26953, 42242,139829494, 0, = 0 512: 512, 0, 169943, 212729,97319297, 0, 0 1024: 1024, 0, 2844, 240,113460194, 0, = 0 2048: 2048, 0, 204, 40,134422120, 0, = 0 4096: 4096, 0, 8295, 170,19109860, 0, 0 8192: 8192, 0, 157, 12, 5847918, 0, 0 16384: 16384, 0, 8091, 78, 5635701, 0, 0 32768: 32768, 0, 127, 13, 3738362, 0, 0 65536: 65536, 0, 67, 21, 4328503, 0, 0 64 pcpu: 8, 0, 1764, 796, 2125, 0, 0 SLEEPQUEUE: 80, 0, 1691, 975, 1691, 0, 0 Files: 80, 0, 1111, 4789,13481817, 0, 0 filedesc0: 1104, 0, 50, 34, 3971, 0, 0 TURNSTILE: 136, 0, 1691, 1009, 1691, 0, 0 rl_entry: 40, 0, 696, 3104, 696, 0, 0 umtx pi: 96, 0, 0, 0, 0, 0, 0 umtx_shm: 88, 0, 0, 0, 0, 0, 0 MAC labels: 40, 0, 0, 0, 0, 0, 0 PROC: 1416, 0, 49, 311, 3970, 0, 0 THREAD: 1456, 0, 1458, 232, 35807, 0, 0 cpuset: 96, 0, 933, 1199, 1985, 0, 0 audit_record: 1248, 0, 0, 0, 0, 0, 0 mbuf_packet: 256, 1677735, 16377, 0,14185830, 0, = 0 mbuf: 256, 1677735, 5, 2008,14156009, 0, = 0 mbuf_cluster: 2048, 262144, 16377, 451, 2251293, 0, 0 mbuf_jumbo_page: 4096, 131072, 1, 12, 601300, 0, 0 mbuf_jumbo_9k: 9216, 38836, 0, 0, 0, 0, 0 mbuf_jumbo_16k: 16384, 21845, 0, 0, 0, 0, 0 g_bio: 376, 0,15235172, 248,477839025, 0, = 0 ttyinq: 160, 0, 135, 190, 735, 0, 0 ttyoutq: 256, 0, 72, 93, 392, 0, 0 FPU_save_area: 832, 0, 0, 0, 0, 0, 0 CTL IO: 672, 0, 0, 0, 0, 0, 0 beio: 368, 0, 0, 0, 0, 0, 0 taskq_zone: 48, 0, 0, 83, 4883426, 0, 0 VNODE: 472, 0, 116663, 57169, 7020248, 0, 0 VNODEPOLL: 120, 0, 0, 0, 0, 0, 0 BUF TRIE: 144, 0, 85, 52619, 111, 0, 0 S VFS Cache: 108, 0, 97780, 129125,12378111, 0, 0 STS VFS Cache: 148, 0, 0, 0, 0, 0, 0 L VFS Cache: 328, 0, 26016, 1452, 94458, 0, 0 LTS VFS Cache: 368, 0, 0, 0, 0, 0, 0 NAMEI: 1024, 0, 0, 4,434993266, 0, = 0 rentr: 24, 0, 0, 0, 0, 0, 0 DIRHASH: 1024, 0, 0, 0, 1265, 0, 0 NCLNODE: 576, 0, 0, 0, 0, 0, 0 Mountpoints: 816, 0, 17, 153, 17, 0, 0 pipe: 760, 0, 196, 29, 2200, 0, 0 range_seg_cache: 64, 0, 75978, 45170,15585219, 0, 0 metaslab_alloc_trace_cache: 64, 0, 0, 248, 9182890, = 0, 0 zio_cache: 1040, 0, 74, 592,242729543, 0, = 0 zio_link_cache: 48, 0, 8, 656,157320326, 0, = 0 lz4_ctx: 16384, 0, 0, 16, 3997609, 0, 0 abd_chunk: 4096, 0, 14581, 0,152519233, 0, = 0 sa_cache: 144, 0, 96841, 100286, 7578526, 0, 0 dnode_t: 728, 0, 197018, 167132, 6128636, 0, 0 arc_buf_hdr_t_full: 224, 0, 11863, 21865,31209006, 0, 0 arc_buf_hdr_t_l2only: 88, 0, 0, 0, 0, 0, = 0 arc_buf_t: 64, 0, 8919, 32001,16054622, 0, 0 dmu_buf_impl_t: 232, 0, 177685, 251803,18010985, 0, 0 zil_lwb_cache: 200, 0, 75, 165, 3881459, 0, 0 zfs_znode_cache: 264, 0, 96841, 78884, 7000414, 0, 0 procdesc: 136, 0, 0, 0, 0, 0, 0 AIO: 224, 0, 0, 0, 0, 0, 0 AIOP: 32, 0, 0, 0, 0, 0, 0 AIOCB: 752, 0, 0, 0, 0, 0, 0 AIOL: 128, 0, 0, 0, 0, 0, 0 AIOLIO: 280, 0, 0, 0, 0, 0, 0 ksiginfo: 112, 0, 305, 3125, 70925, 0, 0 itimer: 352, 0, 0, 0, 0, 0, 0 KNOTE: 128, 0, 283, 399,14191220, 0, 0 socket: 864, 260128, 67, 389, 20761, 0, 0 ipq: 56, 8236, 0, 0, 0, 0, 0 udp_inpcb: 464, 260128, 9, 15, 15472, 0, 0 udpcb: 32, 260250, 9, 241, 15472, 0, 0 tcp_inpcb: 464, 260128, 43, 29, 431, 0, 0 tcpcb: 1040, 260130, 43, 2, 431, 0, 0 tcptw: 88, 27810, 0, 0, 221, 0, 0 syncache: 168, 15364, 0, 0, 85, 0, 0 hostcache: 128, 15376, 2, 60, 2, 0, 0 sackhole: 32, 0, 0, 0, 0, 0, 0 tcpreass: 40, 16400, 0, 300, 6, 0, 0 sctp_ep: 1488, 260128, 0, 0, 0, 0, 0 sctp_asoc: 2408, 40000, 0, 0, 0, 0, 0 sctp_laddr: 48, 80012, 0, 0, 4, 0, 0 sctp_raddr: 736, 80000, 0, 0, 0, 0, 0 sctp_chunk: 152, 400010, 0, 0, 0, 0, 0 sctp_readq: 152, 400010, 0, 0, 0, 0, 0 sctp_stream_msg_out: 112, 400015, 0, 0, 0, 0, 0 sctp_asconf: 40, 400000, 0, 0, 0, 0, 0 sctp_asconf_ack: 48, 400060, 0, 0, 0, 0, 0 udplite_inpcb: 464, 260128, 0, 0, 0, 0, 0 ripcb: 464, 260128, 0, 0, 14, 0, 0 unpcb: 240, 260128, 14, 114, 4837, 0, 0 rtentry: 208, 0, 12, 121, 14, 0, 0 IPFW counters: 16, 0, 12, 500, 12, 0, 0 IPFW dynamic rule: 128, 16399, 0, 0, 0, 0, 0 selfd: 64, 0, 203, 2401, 736707, 0, 0 SWAPMETA: 288, 1011972, 23270, 1326, 3620240, 0, = 0 FFS inode: 152, 0, 19743, 303, 19749, 0, 0 FFS1 dinode: 128, 0, 0, 0, 0, 0, 0 FFS2 dinode: 256, 0, 19743, 222, 19749, 0, % vmstat -m Type InUse MemUse HighUse Requests Size(s) CAM periph 18 5K - 40 16,32,64,128,256 CAM I/O Scheduler 8 1K - 8 128 pci_link 16 2K - 16 32,128 acpi_perf 32 8K - 32 256 kbdmux 6 22K - 6 16,512,1024,2048,16384 LED 8 1K - 8 16,128 mps 20 479K - 90 = 16,32,64,128,256,512,1024,4096,8192,65536 entropy 0 0K - 279 4096 UART 6 5K - 6 16,1024 CAM queue 15 130K - 52 16,32,64,128,512,16384 USB 56 111K - 68 = 16,32,128,256,512,1024,2048,4096,16384,32768 USBdev 48 15K - 48 32,64,128,256,512,4096 DEVFS3 154 39K - 158 256 DEVFS1 129 65K - 132 512 DEVFS_RULE 55 26K - 55 64,512 DEVFS 16 1K - 17 16,128 DEVFSP 2 1K - 2 64 NFSD V4client 1 1K - 1 256 NFSD lckfile 1 1K - 1 256 NFSD session 1 1K - 1 1024 pfs_nodes 21 6K - 21 256 pfs_vncache 4 1K - 4 64 GEOM 147 29K - 596441 = 16,32,64,128,256,512,1024,2048,16384 raid_data 0 0K - 102 32,128,256 isadev 6 1K - 6 128 ctlmem 9 193K - 9 16,32,128,65536 cdev 4 1K - 4 256 filedesc 7 221K - 39 = 32,64,128,256,4096,16384,32768,65536 sigio 1 1K - 1 64 filecaps 0 0K - 38 16,64 kdtrace 1241 302K - 43495 64,256 kenv 119 12K - 122 16,32,64,128,8192 kqueue 432 1153K - 4424 64,256,2048,4096,8192 proc-args 281 10K - 20977 16,32,64,128,256 Fail Points 0 0K - 40 1024 hhook 13 4K - 13 256 ithread 322 53K - 322 32,128,256 KTRACE 100 13K - 100 128 linker 93 27K - 102 = 16,32,64,128,256,512,1024,2048,4096,8192 lockf 201 25K - 28143 64,128 loginclass 2 1K - 3 64 cache 1 1K - 1 32 devbuf 3162 10181K - 3701 = 16,32,64,128,256,512,1024,2048,4096,8192,16384,32768,65536 temp 151 12K - 98598294 = 16,32,64,128,256,512,1024,2048,4096,8192,16384,65536 module 198 25K - 198 128 mtx_pool 2 16K - 2 8192 osd 64 2K - 356 16,32,64,128,256 pmchooks 1 1K - 1 128 pgrp 25 4K - 692 128 session 24 3K - 630 128 proc 2 4K - 2 2048 subproc 409 373K - 4350 512,4096 cred 41 11K - 6082 256 plimit 23 6K - 9420 256 uidinfo 5 1K - 578 128,512 CAM dev queue 4 1K - 4 64 sysctl 0 0K - 226317 16,32,64 sysctloid 11418 585K - 11643 16,32,64,128 sysctltmp 0 0K - 872 16,32,64,128,256,1024 scsi_da 1 1K - 137 16,32,64,512 tidhash 1 4K - 1 4096 callout 33 9352K - 33 =20 umtx 3380 423K - 3380 128 p1003.1b 1 1K - 1 16 SWAP 2 4373K - 2 64 bus 1136 135K - 7806 16,32,64,128,256,512,1024 bus-sc 208 418K - 2527 = 16,32,128,256,512,1024,2048,4096,16384,65536 devstat 8 17K - 8 32,4096 eventhandler 100 8K - 100 64,128 taskqueue 101 26K - 101 16,32,256,8192 kobj 92 368K - 261 4096 Per-cpu 1 1K - 1 32 rman 340 36K - 788 32,128 sbuf 1 1K - 14277479 = 16,32,64,128,256,512,1024,2048,4096,8192,16384,32768,65536 toponodes 84 11K - 84 128 stack 0 0K - 402 256 taskqueue 360 42K - 663 16,32,64,128,256 Unitno 28 2K - 68456 32,64 vmem 3 320K - 9 256,16384,32768,65536 ioctlops 0 0K - 1084 256,512,1024 select 174 22K - 174 128 iov 0 0K - 33365941 16,64,128,256,512 msg 4 30K - 4 2048,4096,8192,16384 sem 4 106K - 4 2048,4096 shm 1 32K - 1 32768 tty 21 21K - 25 1024,2048 pts 2 1K - 2 256 mbuf_tag 0 0K - 6 32 shmfd 1 8K - 1 8192 soname 4 1K - 43270 16,32,128 pcb 38 1175K - 13620 16,32,128,1024,2048,8192 acl 0 0K - 45 4096 vfscache 4 8833K - 5 512 vfs_hash 1 2048K - 2 =20 vnodes 1 1K - 1 256 mount 196 8K - 468 16,32,64,128,256 statfs 0 0K - 740359 512 vnodemarker 0 0K - 36693 512 fadvise 0 0K - 1 32 arc4random 1 16K - 1 16384 BPF 5 1K - 5 128 ifnet 6 11K - 6 128,2048 ifaddr 82 17K - 82 = 16,32,64,128,256,512,2048,4096 ether_multi 22 2K - 22 16,32,64 clone 6 1K - 6 128 lltable 24 7K - 36 256,512 routetbl 25 4K - 28 32,64,128,512 igmp 5 1K - 5 128 in_mfilter 2 2K - 2 1024 in_multi 3 1K - 3 256 ip_moptions 4 1K - 4 64,256 sctp_a_it 0 0K - 4 16 sctp_vrf 1 1K - 1 64 sctp_ifa 5 1K - 5 128 sctp_ifn 3 1K - 3 128 sctp_iter 0 0K - 4 256 hostcache 1 32K - 1 32768 tcpfunc 1 1K - 1 32 syncache 1 68K - 1 =20 in6_mfilter 1 1K - 1 1024 in6_multi 15 2K - 15 32,256 ip6_moptions 2 1K - 2 32,256 ip6opt 3 1K - 3 256 mld 5 1K - 5 128 ip6ndp 6 1K - 6 64,256 IpFw/IpAcct 33 52K - 50 = 16,32,64,128,256,512,1024,2048,4096,8192,16384 rpc 2 16K - 2 8192 audit_evclass 187 6K - 232 32 pagedep 1 256K - 7 256 inodedep 1 2048K - 17 512 bmsafemap 1 8K - 11 256,8192 newblk 1 2048K - 8 256 freeblks 0 0K - 7 128 freefile 0 0K - 6 64 diradd 0 0K - 12 128 dirrem 0 0K - 12 128 freework 1 1K - 8 128,256 jaddref 0 0K - 12 128 jremref 0 0K - 12 128 jnewblk 0 0K - 7 128 jseg 0 0K - 11 128 jsegdep 0 0K - 31 64 sbdep 0 0K - 5 64 jblocks 2 1K - 2 128,256 softdep 1 1K - 1 512 ufs_dirhash 37 19K - 113 = 16,32,64,128,256,512,1024,8192 ufs_mount 3 13K - 3 512,4096,8192 vm_pgdata 2 1025K - 2 128 UMAHash 11 4279K - 52 = 512,1024,2048,4096,8192,16384,32768,65536 acpiintr 1 1K - 1 64 acpica 2572 248K - 87354 = 16,32,64,128,256,512,1024,2048 acpitask 1 64K - 1 65536 memdesc 1 4K - 1 4096 acpisem 93 12K - 93 128 apmdev 1 1K - 1 128 madt_table 0 0K - 1 4096 acpidev 67 5K - 67 64 CAM SIM 4 1K - 4 256 CAM XPT 81 8K - 1588085 = 16,32,64,128,256,512,1024,2048,65536 CAM DEV 11 22K - 21 2048 CAM CCB 17 34K - 136755855 2048 io_apic 3 6K - 3 2048 CAM path 19 1K - 85 32 MCA 65 21K - 65 128,256,512 msi 45 6K - 45 128 nexusdev 3 1K - 3 16 solaris 315427 375503K - 960543367 = 16,32,64,128,256,512,1024,2048,4096,8192,16384,32768,65536 kstat_data 8 1K - 8 64 sfs_nodes 26 13K - 26 512 fdesc_mount 1 1K - 1 16