From nobody Mon Aug 2 05:00:33 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4512812DB85D; Mon, 2 Aug 2021 05:00:51 +0000 (UTC) (envelope-from ozkan.kirik@gmail.com) Received: from mail-vs1-xe2e.google.com (mail-vs1-xe2e.google.com [IPv6:2607:f8b0:4864:20::e2e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4GdQnG2rTSz4lqb; Mon, 2 Aug 2021 05:00:50 +0000 (UTC) (envelope-from ozkan.kirik@gmail.com) Received: by mail-vs1-xe2e.google.com with SMTP id b138so2716868vsd.2; Sun, 01 Aug 2021 22:00:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=3ieoG6gKGpCkMBAgvFtW/eLW+fMelEQ83MQ4BUXn9Vk=; b=UgLx6Ttt3szOm+bZU8CXZkVm9kG0CP1f41D8vACAe32ZN1am4GaSSeBztLSroZP6CZ BhPdb8awD+Dl5NybbD8HzaNfFi8AY6EWxNWGArLrT3k6nBmv1WTTu9mTMP5T5D+XJ0Oc edH5O5cyUnjsPAxPvll6Q3FkeKpcM77cL8QRF7t0AZ5BMNB4pr26C+G6EO6drcZ1JeNO UMu8iwhRHsszDnayqFCDbc0/ruDJP0+zjlXrB0S1/XdQLU63BayZxCSnYzhHM93gxGFC 7ZDHNI0OIz30RICwFwgCmdRmRlL/TFUsj+Jf4319CRppkucoIfVFCP93rJxfEhoE2n2y /9Pg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=3ieoG6gKGpCkMBAgvFtW/eLW+fMelEQ83MQ4BUXn9Vk=; b=QBBMSg5KTQY5QrlQUbXoEmdscIXDzvqkjvi7CeLM7nWKXMnn/HrCxiPMGrVi7Ta4DM hy40yhd5PX6bK/ipnf3RYJcvRhzOLA3Ik0jgTaMcXVzat5eQqaX1IbaKiSrvS4bly4I4 JqbU4HdpF2/q4Mx9iD6MrRyPvRXyFPSyQHLdr0aFtpKxvX4zTMGoOE8xZ8/IdBMFVlcd tt9/Zi/Xk3gtZCaIDYW1AkBH8mHwMnoC5HcgK15/aiYRFDNPp+yfRQnyoZYsYSKNvKek RLRz+eycTmum0Y+taxNgbAGk8o6xZYK6vC6jOR/G0L63QzXE38pz3W7/9HtmVcJQY1ux FIig== X-Gm-Message-State: AOAM530zJj88LREy9RbA9bCprsgAxmLUdXA/WiRvt03TXWfwozPvMjdJ /G+oGeQKT6zLaTDcM+9aXBWzP0AJBQYr/cY2EnKN2EXAnIBr92Nh X-Google-Smtp-Source: ABdhPJxMKM9/wL1wn7hCp68ozJno0vOzWZAu16L/w3/cbbNM1ItSq6xgmkc5RSJL50JSr+EDYbcsOFTT6CwUp7WFcoY= X-Received: by 2002:a05:6102:c48:: with SMTP id y8mr8273996vss.14.1627880443886; Sun, 01 Aug 2021 22:00:43 -0700 (PDT) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 From: =?UTF-8?B?w5Z6a2FuIEtJUklL?= Date: Mon, 2 Aug 2021 08:00:33 +0300 Message-ID: Subject: Wired Memory Increasing about 500MBytes per day To: FreeBSD Net , freebsd-stable Content-Type: multipart/alternative; boundary="0000000000009844c605c88c737b" X-Rspamd-Queue-Id: 4GdQnG2rTSz4lqb X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=UgLx6Ttt; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of ozkankirik@gmail.com designates 2607:f8b0:4864:20::e2e as permitted sender) smtp.mailfrom=ozkankirik@gmail.com X-Spamd-Result: default: False [-3.34 / 15.00]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MIME_BASE64_TEXT(0.10)[]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:~,2:~]; R_MIXED_CHARSET(0.56)[subject]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::e2e:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net,freebsd-stable] X-ThisMailContainsUnwantedMimeParts: Y --0000000000009844c605c88c737b Content-Type: text/plain; charset="UTF-8" Hello, I'm using FreeBSD stable/12 0f97f2a1857a96563792f0d873b11a16ff9f818c (Jul 25) built. pf, ipfw and ipsec options are built with kernel. The server is used as firewall that squid and snort3 (daq - netmap) is running. I saw that, wired memory is increasing every day. It's about 500MBytes per day. I'm checking vmstat and top (sorted by res), I couldn't find what is consuming the wired memory. How can I find that which process or which part of kernel is consuming the wired memory ? # first a few lines of top last pid: 61147; load averages: 3.83, 3.92, 4.02 up 3+14:09:57 07:53:44 4294 threads: 42 running, 4153 sleeping, 99 waiting CPU: 3.1% user, 0.0% nice, 10.4% system, 0.0% interrupt, 86.5% idle Mem: 3074M Active, 11G Inact, 11G Wired, 1572M Buf, 101G Free ARC: 3764M Total, 1385M MFU, 2144M MRU, 2666K Anon, 19M Header, 213M Other 3243M Compressed, 3510M Uncompressed, 1.08:1 Ratio # vmstat -m Type InUse MemUse HighUse Requests Size(s) CAM dev queue 5 1K - 5 64 scsi_da 0 0K - 388 32,256 UART 3 3K - 3 16,1024 USB 43 87K - 78 16,32,128,256,512,1024,2048,4096,16384,32768 USBdev 31 4K - 53 32,64,128,256,512,4096 SCSI ENC 26 133K - 67266 16,64,512,1024,2048,32768,65536 nvlist 282 26K - 52522369 16,32,64,128,256,2048,4096,8192 vtbuf 24 1968K - 46 4096 vt 11 6K - 11 512 acpiintr 1 1K - 1 64 DEVFS3 194 49K - 269 256 DEVFS1 146 73K - 217 512 DEVFS_RULE 56 27K - 56 64,512 DEVFS 15 1K - 20 16,32,128 DEVFSP 529 34K - 748886191 64 nullfs_hash 1 16384K - 1 nullfs_node 27 2K - 34 64 nullfs_mount 10 1K - 11 32 pfs_nodes 20 10K - 20 512 tmpfs mount 3 1K - 3 128 tmpfs name 4791 116K - 18569 16,32,64,128 GEOM 357 54K - 3904 16,32,64,128,256,512,1024,2048,4096,8192,16384 raid_data 0 0K - 612 32,128,256 isadev 7 1K - 7 128 acpica 16568 1655K - 738465 16,32,64,128,256,512,1024,2048,4096 acpitask 1 64K - 1 65536 acpisem 24 3K - 24 128 cdev 4 1K - 4 256 filedesc 367 2390K - 4457314 16,32,64,128,256,512,4096,8192,16384,32768,65536 sigio 17 2K - 415 64 filecaps 6 1K - 90314 16,32,64 kdtrace 4829 1110K - 15580812 64,256 kenv 148 14K - 148 16,32,64,128,8192 kqueue 1176 726K - 25696080 64,128,256,512,2048,4096,8192,16384,32768 proc-args 634 46K - 6581654 16,32,64,128,256 hhook 34 7K - 51 32,256 ithread 449 73K - 455 32,128,256 prison 11 5K - 12 16,32,4096 KTRACE 100 13K - 100 128 evdev 3 3K - 7 1024 linker 481 505K - 633 16,32,64,128,256,512,1024,2048,4096,8192,16384,32768,65536 lockf 39 5K - 7173761 64,128 loginclass 3 1K - 8 64 devbuf 19975 49482K - 38585 16,32,64,128,256,512,1024,2048,4096,8192,16384,65536 temp 4192 173K - 75602914 16,32,64,128,256,512,1024,2048,4096,8192,16384,32768,65536 module 537 68K - 538 128 mtx_pool 2 72K - 2 8192,65536 osd 14 1K - 129800 16,32,64,128,256 pmchooks 1 1K - 1 128 pmc 2 1K - 2 64 session 93 12K - 437777 128 proc 2 256K - 2 subproc 1468 2561K - 6842581 512,4096 cred 1869 468K - 2482324 256 plimit 83 21K - 827841 256 uidinfo 14 34K - 17233 128,32768 ix 42 117K - 42 512,1024,2048,4096 sysctl 1 1K - 2408297 32,64 sysctloid 15990 820K - 16624 16,32,64,128,256 sysctltmp 0 0K - 5790925 16,64,256,1024 acpidev 179 12K - 179 64 CAM SIM 6 2K - 6 256 tidhash 1 256K - 1 callout 33 9352K - 33 umtx 10204 1276K - 10204 128 p1003.1b 1 1K - 1 16 bus 2040 231K - 341181 16,32,64,128,256,512,1024,4096 bus-sc 202 1751K - 72634 16,32,64,128,256,512,1024,2048,4096,8192,16384,32768,65536 devstat 20 41K - 20 32,4096 eventhandler 169 14K - 170 64,128 firmware 26 2K - 26 16,32,128 gtaskqueue 198 44K - 198 16,32,256,8192 kobj 332 1328K - 1289 4096 Per-cpu 1 1K - 1 32 CAM XPT 42 4K - 1443 16,32,64,128,256,512,1024,2048,65536 rman 408 48K - 816 16,32,128 sbuf 1 1K - 839349 16,32,64,128,256,512,2048,4096,8192,16384,32768,65536 toponodes 84 11K - 84 128 CAM DEV 9 18K - 520 2048 taskqueue 648 74K - 942 16,32,64,128,256,512 terminal 11 3K - 11 256 Unitno 65 4K - 3793393 32,64 vmem 4 2368K - 12 4096,8192,16384,32768,65536 ioctlops 0 0K - 2234885 256,512,1024,2048,4096 select 2671 334K - 2671 128 iov 0 0K - 248581529 16,64,128,256,512,1024,4096 msg 4 204K - 4 4096,8192,65536 sem 4 106K - 4 2048,4096 shm 14 58K - 282515 2048,32768 tty 14 14K - 24 1024 pts 1 1K - 11 256 mbuf_tag 0 0K - 339649313 32,64 shmfd 34 23K - 21424 64,256,1024,8192 soname 78 7K - 49413750 16,32,64,128 pcb 990 4460K - 669045 16,32,64,128,1024,2048,8192 kbdmux 6 22K - 8 16,512,1024,2048,16384 acl 0 0K - 124531 4096 vfscache 4 32961K - 4 256,65536 cl_savebuf 0 0K - 247 64 vfs_hash 1 16384K - 1 vnodes 1 1K - 1 256 mount 261 13K - 61165 16,32,64,128,256,1024 statfs 0 0K - 3613124 4096 LED 4 1K - 4 16,128 vnodemarker 0 0K - 214729 512 fadvise 0 0K - 137 32 chacha20random 1 8K - 1 8192 BPF 2535 25717K - 2247023944 16,64,128,256,512,2048,4096 ifdescr 1 1K - 1 16 ifnet 513 1027K - 1482 64,128,256,512,1024,2048,4096 ifaddr 5117 1388K - 15096 16,32,64,128,256,512,2048,4096 ether_multi 13633 1089K - 40471 16,32,64,128 clone 38 5K - 55 128 epair 2 1K - 4 128 ipsec 6 2K - 9 256 lltable 37732 18363K - 246041 256,512 tun 7 1K - 11 32,256 vlan 2864 359K - 38902 64,128,256 iflib 314 3652K - 338 32,64,256,512,1024,4096,8192,16384,32768 routetbl 12731 3113K - 247870 32,64,128,256,512,8192 vnet 2 1K - 3 64 vnet_data 2 384K - 3 vnet_data_free 1 1K - 1 32 igmp 511 64K - 1479 128 in_multi 487 122K - 1446 256 ip_moptions 0 0K - 6 64 encap_export_host 18 1K - 18 32,64 mroutetbl 8 53K - 12 256,2048,8192,16384 sctp_a_it 0 0K - 6133 16 sctp_vrf 2 1K - 3 64 sctp_ifa 1572 197K - 6888 128 sctp_ifn 487 61K - 6888 128 sctp_iter 0 0K - 6133 256 tfo_ccache 2 256K - 3 hostcache 2 64K - 3 32768 LRO 48 960K - 48 8192,32768 tcpfunc 1 1K - 1 64 syncache 2 1088K - 3 in6_multi 4880 686K - 14475 32,256 ip6_moptions 0 0K - 1 32 mld 497 63K - 1461 128 ip6ndp 983 153K - 4354 64,256 inpcbpolicy 6117 192K - 952852053 32 secasvar 8 4K - 1390 256,1024 sahead 8 4K - 1052 256,1024 ipsecpolicy 56 16K - 1530 256,1024 ipsecrequest 44 6K - 1516 128 ipsec-misc 51 2K - 8317 16,32 ipsec-saq 4 4K - 152 256,1024 ipsec-reg 2 1K - 2 32 dummynet 10 2069K - 13 512,1024 dummynet 8 3K - 10 256,512 IpFw/IpAcct 94 2428K - 1721 16,32,64,128,256,512,1024,2048,4096,8192 ipfw_tbl 3 1K - 267 128 pfsync 4 65K - 6 512,32768 pf_temp 0 0K - 10651 32,64 pf_hash 14 23056K - 21 2048 pf_ifnet 543 140K - 30387 128,256,2048 pf_rule 6475 9594K - 70452 128,2048 pf_osfp 2382 245K - 7146 64,128 pf_table 1647 3294K - 56328 2048 linux 5 1K - 6 16,64 linuxcurrent 2 1K - 2 64,256 crypto 58 43K - 3734 128,512,1024,4096 xform 0 0K - 145609856 64 pagedep 1 2048K - 4 256 inodedep 1 16384K - 6 512 bmsafemap 1 8K - 5 256,8192 newblk 1 32768K - 4 256 freeblks 0 0K - 1 128 freefile 0 0K - 1 64 diradd 0 0K - 8 128 mkdir 0 0K - 4 128 dirrem 0 0K - 5 128 newdirblk 0 0K - 2 64 freework 1 1K - 2 16,128 sbdep 0 0K - 3 64 savedino 0 0K - 4 256 softdep 1 1K - 1 512 ufs_dirhash 600 113K - 1164 16,32,64,128,256,512 ufs_mount 9 50K - 68 512,4096,8192 UMAHash 61 9148K - 155 512,1024,2048,4096,8192,16384,32768,65536 md_disk 17 5K - 17 32,4096 md_sectors 16 64K - 16 4096 rpc 1 4K - 1 4096 fpukern_ctx 32 32K - 32 1024 memdesc 1 4K - 1 4096 pci_link 16 2K - 16 64,128 CAM CCB 0 0K - 47838681 2048 mrsasbuf 949 2860K - 951 32,128,256,2048,8192 CAM path 13 1K - 7263 32 CAM periph 10 3K - 541 16,32,64,128,256 netmap 262944 1126176K - 262944 acpi_perf 32 16K - 32 512 sr_iov 6 3K - 6 512 apmdev 1 1K - 1 128 madt_table 0 0K - 2 256,4096 CAM I/O Scheduler 2 1K - 2 128 entropy 1 1K - 5527116 32,4096 intr 4 484K - 4 65536 io_apic 3 6K - 3 2048 local_apic 1 32K - 1 32768 CAM queue 14 52K - 1551 16,32,64,128,256,512,1024,2048,4096,16384 MCA 65 21K - 65 128,256,512 cpus 2 1K - 2 128 msi 87 11K - 87 128 nexusdev 6 1K - 6 16 scsi_cd 0 0K - 8 16 kstat_data 12 1K - 12 64 solaris 366461 463423K - 2105003083 16,32,64,128,256,512,1024,2048,4096,8192,16384,32768 sfs_nodes 6 3K - 6 512 aesni_data 2 3K - 2 256,2048 ioat 16 7168K - 16 disc 1 1K - 2 16 gre 5 1K - 5 64,128 netgraph_msg 0 0K - 5 64,128,256 netgraph_hook 0 0K - 2 128 netgraph_node 7 2K - 11 128,256 netgraph_path 0 0K - 4 16 netgraph_sock 6 1K - 9 32,128 netgraph_mppc 0 0K - 2 1024,65536 eli data 35 4K - 865337 64,256,1024,2048,4096,8192,16384,32768,65536 Regards, --0000000000009844c605c88c737b-- From nobody Tue Aug 3 06:38:17 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 7026E12B8113; Tue, 3 Aug 2021 06:38:28 +0000 (UTC) (envelope-from bu7cher@yandex.ru) Received: from forward101p.mail.yandex.net (forward101p.mail.yandex.net [77.88.28.101]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Gf4vQ5gqfz4q63; Tue, 3 Aug 2021 06:38:26 +0000 (UTC) (envelope-from bu7cher@yandex.ru) Received: from sas1-a14f288d3203.qloud-c.yandex.net (sas1-a14f288d3203.qloud-c.yandex.net [IPv6:2a02:6b8:c08:1190:0:640:a14f:288d]) by forward101p.mail.yandex.net (Yandex) with ESMTP id C40683280DED; Tue, 3 Aug 2021 09:38:18 +0300 (MSK) Received: from sas8-b61c542d7279.qloud-c.yandex.net (sas8-b61c542d7279.qloud-c.yandex.net [2a02:6b8:c1b:2912:0:640:b61c:542d]) by sas1-a14f288d3203.qloud-c.yandex.net (mxback/Yandex) with ESMTP id I5otk0kQMT-cIIqs066; Tue, 03 Aug 2021 09:38:18 +0300 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yandex.ru; s=mail; t=1627972698; bh=DS70CxQAQmhZ4B5l5fs66WLXQ17M8HiH4FKNO2CsMbo=; h=In-Reply-To:References:Date:Message-ID:From:To:Subject; b=JmyAsBPvSDlEWybhMdJD0gKjaBcmUjJxZff0sBSOECfgfwo+mt2hztTohNknXwTU4 DkpCvtvRY8oo7IdpDeW5irImWSU3Go+cInBDZquf2UjScxdI/hKXLXqCMVrPOfyyZa +LHXlnSZHsAL7mX5bHG1MdK5s+wWeKOfbrmZPesc= Received: by sas8-b61c542d7279.qloud-c.yandex.net (smtp/Yandex) with ESMTPSA id 4GQUnT2KsP-cIPWf0l2; Tue, 03 Aug 2021 09:38:18 +0300 (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client certificate not present) Subject: Re: Wired Memory Increasing about 500MBytes per day To: =?UTF-8?Q?=c3=96zkan_KIRIK?= , FreeBSD Net , freebsd-stable References: From: "Andrey V. Elsukov" Message-ID: <5dc957ec-9483-0a80-b29e-be4b71c1b9d9@yandex.ru> Date: Tue, 3 Aug 2021 09:38:17 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.11.0 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="KpCTlTbhCMEmAGAxKd1YDvPe1tKHJVH9y" X-Rspamd-Queue-Id: 4Gf4vQ5gqfz4q63 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yandex.ru header.s=mail header.b=JmyAsBPv; dmarc=pass (policy=none) header.from=yandex.ru; spf=pass (mx1.freebsd.org: domain of bu7cher@yandex.ru designates 77.88.28.101 as permitted sender) smtp.mailfrom=bu7cher@yandex.ru X-Spamd-Result: default: False [-6.10 / 15.00]; RWL_MAILSPIKE_GOOD(0.00)[77.88.28.101:from]; FREEMAIL_FROM(0.00)[yandex.ru]; R_SPF_ALLOW(-0.20)[+ip4:77.88.0.0/18]; HAS_ATTACHMENT(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yandex.ru:+]; DMARC_POLICY_ALLOW(-0.50)[yandex.ru,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; SIGNED_PGP(-2.00)[]; FREEMAIL_TO(0.00)[gmail.com,freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~]; FREEMAIL_ENVFROM(0.00)[yandex.ru]; ASN(0.00)[asn:13238, ipnet:77.88.0.0/18, country:RU]; RCVD_TLS_LAST(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yandex.ru:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[yandex.ru:s=mail]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.20)[multipart/signed,multipart/mixed,text/plain]; TO_MATCH_ENVRCPT_SOME(0.00)[] X-ThisMailContainsUnwantedMimeParts: N This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --KpCTlTbhCMEmAGAxKd1YDvPe1tKHJVH9y Content-Type: multipart/mixed; boundary="KQwQjiTBexmmApN3q6SMpi5ONenDMLJJK"; protected-headers="v1" From: "Andrey V. Elsukov" To: =?UTF-8?Q?=c3=96zkan_KIRIK?= , FreeBSD Net , freebsd-stable Message-ID: <5dc957ec-9483-0a80-b29e-be4b71c1b9d9@yandex.ru> Subject: Re: Wired Memory Increasing about 500MBytes per day References: In-Reply-To: --KQwQjiTBexmmApN3q6SMpi5ONenDMLJJK Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable 02.08.2021 08:00, =C3=96zkan KIRIK =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > Hello, >=20 > I'm using FreeBSD stable/12 0f97f2a1857a96563792f0d873b11a16ff9f818c (J= ul > 25) built. > pf, ipfw and ipsec options are built with kernel. The server is used as= > firewall that squid and snort3 (daq - netmap) is running. >=20 > I saw that, wired memory is increasing every day. It's about 500MBytes = per > day. I'm checking vmstat and top (sorted by res), I couldn't find what = is > consuming the wired memory. >=20 > How can I find that which process or which part of kernel is consuming = the > wired memory ? Hi, We noticed the same problem, I'm not sure the exact version, but you can check the output: # vmstat -z | egrep "ITEM|pgcache" The page cache grows until lowmem is not reached. Then it automatically cleans and begins to grow again. --=20 WBR, Andrey V. Elsukov --KQwQjiTBexmmApN3q6SMpi5ONenDMLJJK-- --KpCTlTbhCMEmAGAxKd1YDvPe1tKHJVH9y Content-Type: application/pgp-signature; name="OpenPGP_signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="OpenPGP_signature" -----BEGIN PGP SIGNATURE----- wsB4BAABCAAjFiEE5lkeG0HaFRbwybwAAcXqBBDIoXoFAmEI5FkFAwAAAAAACgkQAcXqBBDIoXo/ Twf3bsTjIKLk3tDEvrR+x3qa2fCozPBAqQlI9DED5Y0ZKqdWDxBQgsS9Dh6UgFPfSIRQkxaag/lU JjYAMcMsXrU9Vk/HyXQve4ALCrDW51NmqETUim2hkq7aPqtkCeCLtKk+vCRN9pcA5lRokaL76Pxw hA5MVDBRe/Z0hgsOE1yHi+OIiwB0Jx7z8ORkVPy2igpXKDXK0nsrDm7h5MqAtcwdZNFz3rcIOrFF jfo70Vi+U3nH71KKLwBMTKbOb6qAfnskNC8pgRUc3l2aW5MWPyVVq7iO4PUs1wCrRbfMfmPc3T85 s5zPWm1B6aiDjx7crxKyPtW6NcJXWErhSoka+Nv6 =88TS -----END PGP SIGNATURE----- --KpCTlTbhCMEmAGAxKd1YDvPe1tKHJVH9y-- From nobody Tue Aug 3 08:40:38 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id BBBB412DA3A5; Tue, 3 Aug 2021 08:40:55 +0000 (UTC) (envelope-from ozkan.kirik@gmail.com) Received: from mail-vk1-xa32.google.com (mail-vk1-xa32.google.com [IPv6:2607:f8b0:4864:20::a32]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Gf7cl4HW9z3G2y; Tue, 3 Aug 2021 08:40:55 +0000 (UTC) (envelope-from ozkan.kirik@gmail.com) Received: by mail-vk1-xa32.google.com with SMTP id o2so1082062vkb.4; Tue, 03 Aug 2021 01:40:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=dbmrDkRq12LsXFyZ6N94myzrDVnUKYj2AsolF1klX2U=; b=DL7MG0hH9vHVEB2NeDjNPm2aQ6tvgUlcTtIWVNK+c+LpmjhmCEibrkvuNHhZQ8Ikqh JQ9A7tcXwUnIxAYb6t/LsFHKxNJv15HrSYjJh+GUhwzStcFXW9FUiWTbgLZo40AzQg6i 7j4QmpALrc7abNy291Xe2XPStVlDBMS7lWsaZgvqf9YbFNNjszbKMHqIcMRAvLp0Tbhy 7ggRW9YtL3VR8OPgfYmb1YGsD8HlPDu7CVFBYMZCZt4nG01pXSK1rD1afI4x4jHGTdCu zF1gQ1ONx9rvpI6VBXhmfgIaXocq93u/VRVXP/pbBOqgoDcAW8R3kwnQn0aUN0dGnvr5 7iiA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=dbmrDkRq12LsXFyZ6N94myzrDVnUKYj2AsolF1klX2U=; b=l3bLwIZd07RrM5MsgpCJZsG0jR88OeJIXwJhLscW7Ab4SSCLvwOcAfOF3Q1OTfRA32 BPz2anyBmagN/AMxrDYNgbxyI4sjDVAlu9KEJIPjsvAAIXylyMxj0JpUBKZPQmbBvVvT PsBN9PNO8AgBFf88TxMS88e6/SxSog35YYO05TeznaEDVf5+Cf6UnpFu9eCsmZwy8SnS aMZKHbk8l9YvF6KjFWNBmjMmmtVbXk5BlBlFBeVCnHodfEVGfaOuaQs0fE6DbJXTCLJa VYTiTXXJyaw8dGKCOO4r78zIUjfy6qOQCx81gawlj4gGa7MKHL57yXtMNThYWUmQZEqx ndyg== X-Gm-Message-State: AOAM531Zk4yDbOIKYfNcuzSeDHOPR+w7zPzUD84fGdlpeWgOKDVSf+cn cA/jYn/6XxAyqowH2l0n3S7XoRUH9ix8WVn38fI= X-Google-Smtp-Source: ABdhPJzlcWXeY0+sfRC0bBu2FKf5Ax3oct+AauWCvZU09v7lKBEy/ZojbeP/8f97yk+0ZKYe2zBie69eHVoUKGst0+0= X-Received: by 2002:a1f:27cb:: with SMTP id n194mr3812093vkn.10.1627980048750; Tue, 03 Aug 2021 01:40:48 -0700 (PDT) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 References: <5dc957ec-9483-0a80-b29e-be4b71c1b9d9@yandex.ru> In-Reply-To: <5dc957ec-9483-0a80-b29e-be4b71c1b9d9@yandex.ru> From: =?UTF-8?B?w5Z6a2FuIEtJUklL?= Date: Tue, 3 Aug 2021 11:40:38 +0300 Message-ID: Subject: Re: Wired Memory Increasing about 500MBytes per day To: "Andrey V. Elsukov" Cc: FreeBSD Net , freebsd-stable Content-Type: multipart/alternative; boundary="00000000000081dc0805c8a3a4cb" X-Rspamd-Queue-Id: 4Gf7cl4HW9z3G2y X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; TAGGED_FROM(0.00)[]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: Y --00000000000081dc0805c8a3a4cb Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Thank you Andrey, There is no line that contains the expression "pgcache". I wonder that, what is the unit of USED column in vmstat -z output ? Is the size of allocated memory USED * SIZE bytes or USED bytes? Best regards Full output is below: # vmstat -z ITEM SIZE LIMIT USED FREE REQ FAIL SLEEP UMA Kegs: 248, 0, 319, 11, 359, 0, 0 UMA Zones: 4560, 0, 336, 0, 376, 0, 0 UMA Slabs: 80, 0, 1169247, 53, 1699393, 0, 0 UMA Hash: 256, 0, 54, 66, 118, 0, 0 4 Bucket: 32, 0, 5921, 25454, 6151897,41078, 0 6 Bucket: 48, 0, 4673, 8026, 732085,20928, 0 8 Bucket: 64, 0, 479, 9937, 419289, 27, 0 12 Bucket: 96, 0, 710, 11180, 1250497, 0, 0 16 Bucket: 128, 0, 2582, 5819, 1785201, 1, 0 32 Bucket: 256, 0, 4633, 5012, 2195286, 36, 0 64 Bucket: 512, 0, 13125, 3267, 5701310,9620, 0 128 Bucket: 1024, 0, 3334, 11242, 4554012,346379, 0 256 Bucket: 2048, 0, 8660, 8440,20970638,173535, 0 vmem: 1856, 0, 5, 1, 5, 0, 0 vmem btag: 56, 0, 330495, 13571, 461111,2424, 0 VM OBJECT: 256, 0, 168447, 9798,369781693, 0, 0 RADIX NODE: 144, 0, 436035, 33441,2901117593, 0, 0 MAP: 240, 0, 3, 61, 3, 0, 0 KMAP ENTRY: 120, 0, 39, 1215, 50, 0, 0 MAP ENTRY: 120, 0, 90901, 99905,2208250219, 0, 0 VMSPACE: 2560, 0, 490, 373, 9289416, 0, 0 fakepg: 104, 0, 86332, 2132, 332434, 0, 0 64 pcpu: 8, 0, 142484, 51052,7062995842, 0, 0 mt_stats_zone: 64, 0, 466, 1326, 466, 0, 0 mt_zone: 24, 0, 466, 1371, 466, 0, 0 16: 16, 0, 208830, 9289,272077367, 0, 0 32: 32, 0, 48286, 194464,2109722462, 0, 0 64: 64, 0, 107071, 76387,2375363883, 0, 0 128: 128, 0, 70403, 9980,644411569, 0, 0 256: 256, 0, 45534, 92706,364555548, 0, 0 512: 512, 0, 71594, 31246,1121480580, 0, 0 1024: 1024, 0, 2185, 5295,13869658, 0, 0 2048: 2048, 0, 7746, 5946,841931150, 0, 0 4096: 4096, 0, 11727, 1098,2051928729, 0, 0 8192: 8192, 0, 190, 1127, 1030363, 0, 0 16384: 16384, 0, 342, 374, 3018731, 0, 0 32768: 32768, 0, 95, 240, 37167, 0, 0 65536: 65536, 0, 22, 237, 3510242, 0, 0 SLEEPQUEUE: 80, 0, 5387, 1991, 5387, 0, 0 kenv: 258, 0, 0, 930, 31479, 0, 0 Files: 80, 0, 11109, 5141,2664152238, 0, 0 filedesc0: 1104, 0, 580, 554, 9289505, 0, 0 rangeset pctrie nodes: 144, 0, 0, 0, 0, 0, 0 TURNSTILE: 136, 0, 5387, 1033, 5387, 0, 0 rl_entry: 40, 0, 3805, 4295, 3805, 0, 0 umtx pi: 96, 0, 0, 0, 0, 0, 0 umtx_shm: 88, 0, 0, 0, 0, 0, 0 PROC: 1328, 0, 579, 609, 9289504, 0, 0 PGRP: 88, 0, 139, 4766, 854732, 0, 0 THREAD: 1840, 0, 5017, 369, 2528920, 0, 0 cpuset: 104, 0, 83, 9124,10129425, 0, 0 domainset: 40, 0, 0, 10664,10128542, 0, 0 mbuf_packet: 256, 52258575, 44, 11088,1852136666, 0, = 0 mbuf: 256, 52258575, 17706, 76162,67690430068, 0, 0 mbuf_cluster: 2048, 4194304, 28613, 69253,9891367484, 0, 0 mbuf_jumbo_page: 4096, 4194304, 58, 6942,137882987, 0, 0 mbuf_jumbo_9k: 9216, 4194304, 0, 0, 0, 0, 0 mbuf_jumbo_16k: 16384, 4194304, 0, 0, 0, 0, 0 epoch_record pcpu: 256, 0, 4, 60, 4, 0, 0 ttyinq: 160, 0, 345, 1255, 1260, 0, 0 ttyoutq: 256, 0, 181, 1229, 661, 0, 0 DMAR_MAP_ENTRY: 120, 0, 0, 0, 0, 0, 0 FPU_save_area: 832, 0, 0, 0, 0, 0, 0 g_bio: 376, 0, 0, 7240,242269396, 0, 0 nvme_request: 128, 0, 0, 0, 0, 0, 0 linux_dma_pctrie: 144, 0, 0, 0, 0, 0, 0 linux_dma_object: 24, 0, 0, 0, 0, 0, 0 cryptop: 128, 0, 0, 3875,223334488, 0, 0 cryptodesc: 120, 0, 0, 3894,446668976, 0, 0 crypto_session: 32, 0, 52, 6573, 1658, 0, 0 vtnet_tx_hdr: 24, 0, 0, 0, 0, 0, 0 taskq_zone: 48, 0, 0, 10126,19754313, 0, 0 VNODE: 480, 0, 214648, 20600, 1718597, 0, 0 VNODEPOLL: 120, 0, 577, 2426, 583, 0, 0 BUF TRIE: 144, 0, 5630, 100318, 218154, 0, 0 NAMEI: 1024, 0, 0, 588,1653146904, 0, 0 rentr: 24, 0, 0, 6346, 60, 0, 0 S VFS Cache: 108, 0, 235197, 18063, 2651588, 0, 0 STS VFS Cache: 148, 0, 0, 0, 0, 0, 0 L VFS Cache: 328, 0, 32648, 17116, 582649, 0, 0 LTS VFS Cache: 368, 0, 0, 0, 0, 0, 0 NCLNODE: 592, 0, 0, 0, 0, 0, 0 TMPFS dirent: 64, 0, 4440, 7712, 19999, 0, 0 TMPFS node: 232, 0, 4443, 2034, 19973, 0, 0 DIRHASH: 1024, 0, 722, 266, 1186, 0, 0 AIO: 208, 0, 0, 0, 0, 0, 0 AIOP: 32, 0, 0, 0, 0, 0, 0 AIOCB: 752, 0, 0, 0, 0, 0, 0 AIOLIO: 280, 0, 0, 0, 0, 0, 0 Mountpoints: 2744, 0, 20, 37, 38, 0, 0 pipe: 760, 0, 901, 519, 8706755, 0, 0 range_seg_cache: 72, 0, 66491, 22719,74165680, 0, 0 zio_cache: 1064, 0, 72, 11907,592560580, 0, 0 zio_link_cache: 48, 0, 0, 15687,357212950, 0, 0 zio_buf_512: 512, 0, 77411, 24661,11199087, 0, 0 zio_data_buf_512: 512, 0, 1174, 5266, 1436149, 0, 0 zio_buf_1024: 1024, 0, 3212, 1672,12780522, 0, 0 zio_data_buf_1024: 1024, 0, 52, 6112, 373117, 0, 0 zio_buf_1536: 1536, 0, 1455, 1097, 4976011, 0, 0 zio_data_buf_1536: 1536, 0, 28, 3266, 289325, 0, 0 zio_buf_2048: 2048, 0, 618, 352, 8691140, 0, 0 zio_data_buf_2048: 2048, 0, 163, 2059, 269746, 0, 0 zio_buf_2560: 2560, 0, 581, 396, 3094742, 0, 0 zio_data_buf_2560: 2560, 0, 93, 1185, 167722, 0, 0 zio_buf_3072: 3072, 0, 556, 494, 2840559, 0, 0 zio_data_buf_3072: 3072, 0, 34, 1090, 159095, 0, 0 zio_buf_3584: 3584, 0, 947, 709, 1490250, 0, 0 zio_data_buf_3584: 3584, 0, 20, 715, 224546, 0, 0 zio_buf_4096: 4096, 0, 166, 1303,13023905, 0, 0 zio_data_buf_4096: 4096, 0, 16, 599, 154265, 0, 0 zio_buf_5120: 5120, 0, 1, 140, 1345926, 0, 0 zio_data_buf_5120: 5120, 0, 1, 970, 242653, 0, 0 zio_buf_6144: 6144, 0, 0, 52, 1213631, 0, 0 zio_data_buf_6144: 6144, 0, 1, 285, 216486, 0, 0 zio_buf_7168: 7168, 0, 0, 47, 607077, 0, 0 zio_data_buf_7168: 7168, 0, 0, 237, 202376, 0, 0 zio_buf_8192: 8192, 0, 0, 130, 844604, 0, 0 zio_data_buf_8192: 8192, 0, 6, 624, 617273, 0, 0 zio_buf_10240: 10240, 0, 0, 123, 1373328, 0, 0 zio_data_buf_10240: 10240, 0, 0, 283, 350411, 0, 0 zio_buf_12288: 12288, 0, 0, 46, 858299, 0, 0 zio_data_buf_12288: 12288, 0, 0, 208, 323037, 0, 0 zio_buf_14336: 14336, 0, 0, 120, 428576, 0, 0 zio_data_buf_14336: 14336, 0, 1, 216, 305149, 0, 0 zio_buf_16384: 16384, 0, 9653, 2525,20964516, 0, 0 zio_data_buf_16384: 16384, 0, 9, 176, 456835, 0, 0 zio_buf_20480: 20480, 0, 0, 119, 795267, 0, 0 zio_data_buf_20480: 20480, 0, 0, 164, 483075, 0, 0 zio_buf_24576: 24576, 0, 0, 46, 429295, 0, 0 zio_data_buf_24576: 24576, 0, 3, 123, 594582, 0, 0 zio_buf_28672: 28672, 0, 0, 118, 262110, 0, 0 zio_data_buf_28672: 28672, 0, 0, 110, 364518, 0, 0 zio_buf_32768: 32768, 0, 0, 118, 394929, 0, 0 zio_data_buf_32768: 32768, 0, 5, 103, 381180, 0, 0 zio_buf_40960: 40960, 0, 0, 57, 2657377, 0, 0 zio_data_buf_40960: 40960, 0, 10, 103, 584120, 0, 0 zio_buf_49152: 49152, 0, 0, 114, 408783, 0, 0 zio_data_buf_49152: 49152, 0, 3, 74, 464573, 0, 0 zio_buf_57344: 57344, 0, 0, 46, 167327, 0, 0 zio_data_buf_57344: 57344, 0, 4, 70, 373816, 0, 0 zio_buf_65536: 65536, 0, 0, 47, 257894, 0, 0 zio_data_buf_65536: 65536, 0, 4, 59, 302051, 0, 0 zio_buf_81920: 81920, 0, 1, 132, 955338, 0, 0 zio_data_buf_81920: 81920, 0, 3, 77, 450696, 0, 0 zio_buf_98304: 98304, 0, 0, 44, 121696, 0, 0 zio_data_buf_98304: 98304, 0, 4, 73, 346558, 0, 0 zio_buf_114688: 114688, 0, 0, 57, 1137288, 0, 0 zio_data_buf_114688: 114688, 0, 2, 67, 280633, 0, 0 zio_buf_131072: 131072, 0, 150, 977, 8454261, 0, 0 zio_data_buf_131072: 131072, 0, 947, 8269, 7147735, 0, 0 zio_buf_163840: 163840, 0, 0, 43, 59952, 0, 0 zio_data_buf_163840: 163840, 0, 0, 0, 0, 0, 0 zio_buf_196608: 196608, 0, 0, 42, 24411, 0, 0 zio_data_buf_196608: 196608, 0, 0, 0, 0, 0, 0 zio_buf_229376: 229376, 0, 0, 44, 43421, 0, 0 zio_data_buf_229376: 229376, 0, 0, 0, 0, 0, 0 zio_buf_262144: 262144, 0, 0, 114, 528339, 0, 0 zio_data_buf_262144: 262144, 0, 0, 0, 0, 0, 0 zio_buf_327680: 327680, 0, 0, 42, 10491, 0, 0 zio_data_buf_327680: 327680, 0, 0, 0, 0, 0, 0 zio_buf_393216: 393216, 0, 0, 46, 222631, 0, 0 zio_data_buf_393216: 393216, 0, 0, 0, 0, 0, 0 zio_buf_458752: 458752, 0, 0, 40, 2759, 0, 0 zio_data_buf_458752: 458752, 0, 0, 0, 0, 0, 0 zio_buf_524288: 524288, 0, 0, 44, 123813, 0, 0 zio_data_buf_524288: 524288, 0, 0, 0, 0, 0, 0 zio_buf_655360: 655360, 0, 0, 43, 67660, 0, 0 zio_data_buf_655360: 655360, 0, 0, 0, 0, 0, 0 zio_buf_786432: 786432, 0, 0, 43, 41466, 0, 0 zio_data_buf_786432: 786432, 0, 0, 0, 0, 0, 0 zio_buf_917504: 917504, 0, 0, 41, 27428, 0, 0 zio_data_buf_917504: 917504, 0, 0, 0, 0, 0, 0 zio_buf_1048576: 1048576, 0, 0, 122, 136239, 0, 0 zio_data_buf_1048576: 1048576, 0, 0, 0, 0, 0, 0 zio_buf_1310720: 1310720, 0, 0, 0, 0, 0, 0 zio_data_buf_1310720: 1310720, 0, 0, 0, 0, 0, 0 zio_buf_1572864: 1572864, 0, 0, 0, 0, 0, 0 zio_data_buf_1572864: 1572864, 0, 0, 0, 0, 0, 0 zio_buf_1835008: 1835008, 0, 0, 0, 0, 0, 0 zio_data_buf_1835008: 1835008, 0, 0, 0, 0, 0, 0 zio_buf_2097152: 2097152, 0, 0, 0, 0, 0, 0 zio_data_buf_2097152: 2097152, 0, 0, 0, 0, 0, 0 zio_buf_2621440: 2621440, 0, 0, 0, 0, 0, 0 zio_data_buf_2621440: 2621440, 0, 0, 0, 0, 0, 0 zio_buf_3145728: 3145728, 0, 0, 0, 0, 0, 0 zio_data_buf_3145728: 3145728, 0, 0, 0, 0, 0, 0 zio_buf_3670016: 3670016, 0, 0, 0, 0, 0, 0 zio_data_buf_3670016: 3670016, 0, 0, 0, 0, 0, 0 zio_buf_4194304: 4194304, 0, 0, 0, 0, 0, 0 zio_data_buf_4194304: 4194304, 0, 0, 0, 0, 0, 0 zio_buf_5242880: 5242880, 0, 0, 0, 0, 0, 0 zio_data_buf_5242880: 5242880, 0, 0, 0, 0, 0, 0 zio_buf_6291456: 6291456, 0, 0, 0, 0, 0, 0 zio_data_buf_6291456: 6291456, 0, 0, 0, 0, 0, 0 zio_buf_7340032: 7340032, 0, 0, 0, 0, 0, 0 zio_data_buf_7340032: 7340032, 0, 0, 0, 0, 0, 0 zio_buf_8388608: 8388608, 0, 0, 0, 0, 0, 0 zio_data_buf_8388608: 8388608, 0, 0, 0, 0, 0, 0 zio_buf_10485760: 10485760, 0, 0, 0, 0, 0, 0 zio_data_buf_10485760: 10485760, 0, 0, 0, 0, 0, = 0 zio_buf_12582912: 12582912, 0, 0, 0, 0, 0, 0 zio_data_buf_12582912: 12582912, 0, 0, 0, 0, 0, = 0 zio_buf_14680064: 14680064, 0, 0, 0, 0, 0, 0 zio_data_buf_14680064: 14680064, 0, 0, 0, 0, 0, = 0 zio_buf_16777216: 16777216, 0, 0, 0, 0, 0, 0 zio_data_buf_16777216: 16777216, 0, 0, 0, 0, 0, = 0 lz4_ctx: 16384, 0, 0, 503,36019118, 0, 0 abd_chunk: 4096, 0, 876778, 136943,362609205, 0, 0 sa_cache: 144, 0, 72760, 21740, 1463848, 0, 0 dnode_t: 736, 0, 248894, 476, 882132, 0, 0 arc_buf_hdr_t_full: 256, 0, 77080, 24200,17401584, 0, 0 arc_buf_hdr_t_l2only: 96, 0, 0, 0, 0, 0, 0 arc_buf_t: 64, 0, 10860, 21566,19786749, 0, 0 dmu_buf_impl_t: 240, 0, 83832, 37096,12772494, 0, 0 zil_lwb_cache: 320, 0, 12, 1848, 3352551, 0, 0 zil_zcw_cache: 80, 0, 0, 4500, 3376111, 0, 0 sio_cache: 128, 0, 0, 0, 0, 0, 0 zfs_znode_cache: 288, 0, 72760, 20684, 1463848, 0, 0 procdesc: 136, 0, 0, 493, 12, 0, 0 ksiginfo: 112, 0, 1142, 5368, 1505245, 0, 0 itimer: 352, 0, 0, 0, 0, 0, 0 KNOTE: 160, 0, 5940, 4585,903598090, 0, 0 socket: 872, 4188668, 7375, 2101,1284993007, 0, 0 unpcb: 256, 4188675, 658, 3137, 6017512, 0, 0 IPsec SA lft_c: 16, 0, 20, 7148, 2440, 0, 0 ipq: 56, 51262, 0, 0, 0, 0, 0 udp_inpcb: 488, 4188672, 1966, 192586,1276089120, 0, 0 udpcb: 32, 4188750, 1966, 10034,1276089120, 0, 0 tcp_inpcb: 488, 4188672, 4769, 2639, 2844329, 0, 0 tcpcb: 984, 4188668, 4738, 1166, 2844329, 0, 0 tcptw: 88, 50040, 31, 4244, 1142771, 0, 0 syncache: 168, 409607, 0, 2576, 1711535, 0, 0 hostcache: 96, 15375, 2982, 4521, 119241, 0, 0 sackhole: 32, 0, 5, 6370, 1481420, 0, 0 tfo: 4, 0, 0, 0, 0, 0, 0 tfo_ccache_entries: 80, 0, 0, 0, 0, 0, 0 tcpreass: 48, 262197, 0, 10126, 82900, 0, 0 sctp_ep: 1280, 4188669, 0, 0, 0, 0, 0 sctp_asoc: 2288, 40000, 0, 0, 0, 0, 0 sctp_laddr: 48, 80012, 0, 7885, 7629, 0, 0 sctp_raddr: 736, 80000, 0, 0, 0, 0, 0 sctp_chunk: 152, 400010, 0, 0, 0, 0, 0 sctp_readq: 152, 400010, 0, 0, 0, 0, 0 sctp_stream_msg_out: 112, 400015, 0, 0, 0, 0, 0 sctp_asconf: 40, 400000, 0, 0, 0, 0, 0 sctp_asconf_ack: 48, 400060, 0, 0, 0, 0, 0 udplite_inpcb: 488, 4188672, 0, 0, 0, 0, 0 ripcb: 488, 4188672, 0, 816, 1297, 0, 0 rtentry: 208, 0, 3255, 1210, 10261, 0, 0 pf mtags: 48, 0, 9, 24310,749080996, 0, 0 pf tags: 104, 0, 135, 397, 146, 0, 0 pf states: 304, 10000003, 80811, 681327,480229109, 0, 0 pf state keys: 88, 0, 111211, 663284,543304602, 0, 0 pf source nodes: 136, 100021, 4290, 2728, 2820231, 0, 0 pf table entry counters: 64, 0, 0, 0, 0, 0, = 0 pf table entries: 160, 2000000, 51780, 48870, 258685, 0, 0 pf frags: 256, 0, 0, 2325,68167738, 0, 0 pf frag entries: 40, 1000000, 0, 9900,136389653, 0, 0 pf state scrubs: 40, 0, 0, 0, 0, 0, 0 IPFW counters: 16, 0, 5, 1787, 469, 0, 0 IPFW dynamic states data: 88, 16425, 0, 0, 0, 0, 0 IPFW parent dynamic states: 32, 4125, 0, 0, 0, 0, 0 IPFW IPv4 dynamic states: 40, 0, 0, 0, 0, 0, 0 IPFW IPv6 dynamic states: 72, 0, 0, 0, 0, 0, 0 divcb: 488, 4188672, 0, 0, 0, 0, 0 bridge_rtnode: 88, 0, 0, 0, 0, 0, 0 selfd: 64, 0, 3711, 10735,6515034986, 0, 0 swpctrie: 144, 16330842, 0, 0, 0, 0, 0 swblk: 136, 16330828, 0, 0, 0, 0, 0 FFS inode: 160, 0, 137291, 1384, 234507, 0, 0 FFS1 dinode: 128, 0, 0, 0, 0, 0, 0 FFS2 dinode: 256, 0, 137291, 1369, 234502, 0, 0 NetGraph items: 72, 65565, 0, 155, 7, 0, 0 NetGraph data items: 72, 65565, 0, 155, 4, 0, 0 NAT64LSN hosts: 88, 0, 0, 0, 0, 0, 0 NAT64LSN portgroup chunks: 256, 0, 0, 0, 0, 0, 0 NAT64LSN portgroups: 32, 0, 0, 0, 0, 0, 0 NAT64LSN links: 24, 0, 0, 0, 0, 0, 0 NAT64LSN states: 4096, 0, 0, 0, 0, 0, 0 NAT64LSN jobs: 112, 0, 0, 0, 0, 0, 0 md0: 512, 0, 571, 69, 571, 0, 0 IPsec SA lft_c: 16, 0, 0, 0, 0, 0, 0 ipq: 56, 51262, 0, 0, 0, 0, 0 udp_inpcb: 488, 4188672, 0, 904, 40446, 0, 0 udpcb: 32, 4188750, 0, 7875, 40446, 0, 0 tcp_inpcb: 488, 4188672, 3, 85, 3, 0, 0 tcpcb: 984, 4188668, 3, 37, 3, 0, 0 tcptw: 88, 50040, 0, 0, 0, 0, 0 syncache: 168, 409607, 0, 0, 0, 0, 0 hostcache: 96, 15375, 0, 0, 0, 0, 0 sackhole: 32, 0, 0, 0, 0, 0, 0 tfo: 4, 0, 0, 0, 0, 0, 0 tfo_ccache_entries: 80, 0, 0, 0, 0, 0, 0 sctp_ep: 1280, 4188669, 0, 0, 0, 0, 0 sctp_asoc: 2288, 40000, 0, 0, 0, 0, 0 sctp_laddr: 48, 80012, 0, 830, 6, 0, 0 sctp_raddr: 736, 80000, 0, 0, 0, 0, 0 sctp_chunk: 152, 400010, 0, 0, 0, 0, 0 sctp_readq: 152, 400010, 0, 0, 0, 0, 0 sctp_stream_msg_out: 112, 400015, 0, 0, 0, 0, 0 sctp_asconf: 40, 400000, 0, 0, 0, 0, 0 sctp_asconf_ack: 48, 400060, 0, 0, 0, 0, 0 udplite_inpcb: 488, 4188672, 0, 0, 0, 0, 0 divcb: 488, 4188672, 0, 0, 0, 0, 0 ripcb: 488, 4188672, 0, 0, 0, 0, 0 rtentry: 208, 0, 118, 205, 118, 0, 0 pf tags: 104, 0, 1, 151, 1, 0, 0 pf states: 304, 1000012, 0, 0, 0, 0, 0 pf state keys: 88, 0, 0, 0, 0, 0, 0 pf source nodes: 136, 10005, 0, 0, 0, 0, 0 pf table entry counters: 64, 0, 0, 0, 0, 0, = 0 pf table entries: 160, 2000000, 27, 173, 52, 0, 0 pf frags: 256, 0, 0, 0, 0, 0, 0 pf frag entries: 40, 100000, 0, 0, 0, 0, 0 pf state scrubs: 40, 0, 0, 0, 0, 0, 0 IPFW counters: 16, 0, 1, 255, 1, 0, 0 IPFW dynamic states data: 88, 16425, 0, 0, 0, 0, 0 IPFW parent dynamic states: 32, 4125, 0, 0, 0, 0, 0 IPFW IPv4 dynamic states: 40, 0, 0, 0, 0, 0, 0 IPFW IPv6 dynamic states: 72, 0, 0, 0, 0, 0, 0 bridge_rtnode: 88, 0, 0, 0, 0, 0, 0 On Tue, Aug 3, 2021 at 9:38 AM Andrey V. Elsukov wrote: > 02.08.2021 08:00, =C3=96zkan KIRIK =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > > Hello, > > > > I'm using FreeBSD stable/12 0f97f2a1857a96563792f0d873b11a16ff9f818c (J= ul > > 25) built. > > pf, ipfw and ipsec options are built with kernel. The server is used as > > firewall that squid and snort3 (daq - netmap) is running. > > > > I saw that, wired memory is increasing every day. It's about 500MBytes > per > > day. I'm checking vmstat and top (sorted by res), I couldn't find what = is > > consuming the wired memory. > > > > How can I find that which process or which part of kernel is consuming > the > > wired memory ? > > Hi, > > We noticed the same problem, I'm not sure the exact version, but you can > check the output: > # vmstat -z | egrep "ITEM|pgcache" > > The page cache grows until lowmem is not reached. Then it automatically > cleans and begins to grow again. > > -- > WBR, Andrey V. Elsukov > > --00000000000081dc0805c8a3a4cb-- From nobody Tue Aug 3 10:32:22 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6946C10F9A37; Tue, 3 Aug 2021 10:32:33 +0000 (UTC) (envelope-from bu7cher@yandex.ru) Received: from forward105p.mail.yandex.net (forward105p.mail.yandex.net [IPv6:2a02:6b8:0:1472:2741:0:8b7:108]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4GfB5Y1BdNz3hg0; Tue, 3 Aug 2021 10:32:32 +0000 (UTC) (envelope-from bu7cher@yandex.ru) Received: from forward101q.mail.yandex.net (forward101q.mail.yandex.net [IPv6:2a02:6b8:c0e:4b:0:640:4012:bb98]) by forward105p.mail.yandex.net (Yandex) with ESMTP id C67684D41CB4; Tue, 3 Aug 2021 13:32:23 +0300 (MSK) Received: from vla1-836988b2d41f.qloud-c.yandex.net (vla1-836988b2d41f.qloud-c.yandex.net [IPv6:2a02:6b8:c0d:3890:0:640:8369:88b2]) by forward101q.mail.yandex.net (Yandex) with ESMTP id C1FE3CF40007; Tue, 3 Aug 2021 13:32:23 +0300 (MSK) Received: from vla5-47b3f4751bc4.qloud-c.yandex.net (vla5-47b3f4751bc4.qloud-c.yandex.net [2a02:6b8:c18:3508:0:640:47b3:f475]) by vla1-836988b2d41f.qloud-c.yandex.net (mxback/Yandex) with ESMTP id ibFw7svalH-WNIKnQNK; Tue, 03 Aug 2021 13:32:23 +0300 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yandex.ru; s=mail; t=1627986743; bh=/sfMD7pn9zauh8q4YFk3Ya0/S0I1TjWmnLox+lYl8u4=; h=In-Reply-To:Message-ID:From:Date:References:To:Subject:Cc; b=gcE+rHlG3ZSo0I1bPv5e0igA5YbZBsrSuLbgWDXRLtF7wexU+8Z2ufRauyzgiJ4Jd fl/BppCxDjnKPaavBPCwXChvCMV4S+2JDHjwUI5tgUl5uWqDA3tUQQYq7uV8roEhNV SFlGcktX/OegwpFwGuLtkxEgW64/xpTOS4hsDb8k= Received: by vla5-47b3f4751bc4.qloud-c.yandex.net (smtp/Yandex) with ESMTPSA id OWaphhN7SU-WNj0XPng; Tue, 03 Aug 2021 13:32:23 +0300 (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client certificate not present) Subject: Re: Wired Memory Increasing about 500MBytes per day To: =?UTF-8?Q?=c3=96zkan_KIRIK?= Cc: FreeBSD Net , freebsd-stable References: <5dc957ec-9483-0a80-b29e-be4b71c1b9d9@yandex.ru> From: "Andrey V. Elsukov" Message-ID: <6ad4bcef-974e-603d-1e3f-eb9539002b10@yandex.ru> Date: Tue, 3 Aug 2021 13:32:22 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.11.0 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="xUWMPSiJlPlbhqWrqiRFzEgqaOQdRWDGU" X-Rspamd-Queue-Id: 4GfB5Y1BdNz3hg0 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; TAGGED_RCPT(0.00)[]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: N This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --xUWMPSiJlPlbhqWrqiRFzEgqaOQdRWDGU Content-Type: multipart/mixed; boundary="DwvkKqe7hXJDTb6qO6XWpoLUYOvRDYJxp"; protected-headers="v1" From: "Andrey V. Elsukov" To: =?UTF-8?Q?=c3=96zkan_KIRIK?= Cc: FreeBSD Net , freebsd-stable Message-ID: <6ad4bcef-974e-603d-1e3f-eb9539002b10@yandex.ru> Subject: Re: Wired Memory Increasing about 500MBytes per day References: <5dc957ec-9483-0a80-b29e-be4b71c1b9d9@yandex.ru> In-Reply-To: --DwvkKqe7hXJDTb6qO6XWpoLUYOvRDYJxp Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable 03.08.2021 11:40, =C3=96zkan KIRIK =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > Thank you Andrey, >=20 > There is no line that contains the expression "pgcache". Probably, it is only on 13+. > I wonder that, what is the unit of USED column in vmstat -z output ? > Is the size of allocated memory USED * SIZE bytes or USED bytes? Yes, USED is the number of entries with SIZE bytes each. --=20 WBR, Andrey V. Elsukov --DwvkKqe7hXJDTb6qO6XWpoLUYOvRDYJxp-- --xUWMPSiJlPlbhqWrqiRFzEgqaOQdRWDGU Content-Type: application/pgp-signature; name="OpenPGP_signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="OpenPGP_signature" -----BEGIN PGP SIGNATURE----- wsB5BAABCAAjFiEE5lkeG0HaFRbwybwAAcXqBBDIoXoFAmEJGzYFAwAAAAAACgkQAcXqBBDIoXrw 9wf+J2imlr12EWzm3f9cMP97r2IE6zK86OZVDAMKmMpBd8KTLkhBeN7vf3PiaTSx+KLDCHTNXn3H UnOP3Hsi2Lc2nT07Tk4V1+I+4bxr+kYy18Gdydb1Ub+IWVM/QXVy3LNKKQBksmXy5MwjO3sGAuRU ZoCqdbMBxvmxSB+HCMEosn5juhwsK241e4+c5TCV4ibV7did+bNvvtaT1hakk0Z9T1NqGn2H7qMp unrJl+ufQtv57HdRS+9xme8uITNXM+hyu6A6glSuOtNRvLm/HMUY/8+6P5MYjcG7pQ4xFOWacUuz s9WroQZdTz8t90rQvDpjG4ZUsc70RGu2HYzDnSZsNg== =nRwX -----END PGP SIGNATURE----- --xUWMPSiJlPlbhqWrqiRFzEgqaOQdRWDGU-- From nobody Tue Aug 3 13:47:13 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id BD35012D9BB5; Tue, 3 Aug 2021 13:47:13 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-qt1-x833.google.com (mail-qt1-x833.google.com [IPv6:2607:f8b0:4864:20::833]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4GfGQ94K96z4VP7; Tue, 3 Aug 2021 13:47:13 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: by mail-qt1-x833.google.com with SMTP id h10so13952801qth.5; Tue, 03 Aug 2021 06:47:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:content-transfer-encoding:in-reply-to; bh=pWRyDEXI9ta6X9SsIJ7NlKZaCSItKV4GjqxstcIRsps=; b=QrJj4Gk1S+LqqwCOIy10M7u1sWsYS80KqX4hrUIUUtUhtQ/BdQhqEQMiwzNVcFQJyK 0hZs7K27pdPvfDl8s4cvcpVDlckCsqOG9M5kfqu2uOkA+K4jLDwBPmXuoHG8oYAPaduR CxXk9AIUSRIUWUxD8zUqTTAMzAg+LGHTfW5XJza4FCaDXFTtyVIP6RCMw39bCIu24/z+ yvW7nL75XopNmY9MzCDw8a0DNYABX0322bJ8wi0XoEiSjc8AnjlIptw8zei3zn5eb52m YTYJOjJRVabO9hSFBY99t/YgPIn9W+u78+AvTW42VX1dkhINtzGJkL8EvVBDmYOj9Xs8 58nA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition :content-transfer-encoding:in-reply-to; bh=pWRyDEXI9ta6X9SsIJ7NlKZaCSItKV4GjqxstcIRsps=; b=tKt4jQq2rYZX6X1cDgXQYy7J0tyyaw2j9ziGvL6p06tXzspV/o/mphE4DwrlTHAUjV GLsrqdXTYDNwedvHLxm1Gz8BZpR+ssjwLgE58uvm0EO9X2p0pCeUbX6znjDbFTkbuW+A TJv+0HNlprUs6lQIO2+CGwN4icuA40Rn8GW0GPJvdpXDZvNSWX/4tmhHtbwPMkQZC0F0 ntoPhca/uz34L8uGgRAm8FbkWsROdjMI4VRsUDhfVnqpOKZUTGENzQApnJt3Klesg7C6 a9r0+DBZIeONl7SQaWHzAS8LciHFF97/HClvXv9cWiiOfZjQGn6XOHaGyeDIlFAPm5cb gSeg== X-Gm-Message-State: AOAM530WdhoDInR31xxlQzIFsawuUBCbHieXPx8FfjVysbV5oNCn1Oyz tcNjdwWGaZFlSHF9VMikz0s= X-Google-Smtp-Source: ABdhPJy8blrxm/OPzRX/6lCoWyvoy4CJlKJCtQ6cLyXW3SyM0TSkkM07WlgD1TdafpfIG1WHXJUEbg== X-Received: by 2002:a05:622a:1a9f:: with SMTP id s31mr18500579qtc.151.1627998433201; Tue, 03 Aug 2021 06:47:13 -0700 (PDT) Received: from nuc ([142.126.162.193]) by smtp.gmail.com with ESMTPSA id x7sm7643200qki.102.2021.08.03.06.47.12 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 03 Aug 2021 06:47:12 -0700 (PDT) Date: Tue, 3 Aug 2021 09:47:13 -0400 From: Mark Johnston To: "Andrey V. Elsukov" Cc: =?iso-8859-1?Q?=D6zkan?= KIRIK , FreeBSD Net , freebsd-stable Subject: Re: Wired Memory Increasing about 500MBytes per day Message-ID: References: <5dc957ec-9483-0a80-b29e-be4b71c1b9d9@yandex.ru> List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <5dc957ec-9483-0a80-b29e-be4b71c1b9d9@yandex.ru> X-Rspamd-Queue-Id: 4GfGQ94K96z4VP7 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; TAGGED_RCPT(0.00)[]; REPLY(-4.00)[] X-Spam: Yes X-ThisMailContainsUnwantedMimeParts: N On Tue, Aug 03, 2021 at 09:38:17AM +0300, Andrey V. Elsukov wrote: > 02.08.2021 08:00, Özkan KIRIK пишет: > > Hello, > > > > I'm using FreeBSD stable/12 0f97f2a1857a96563792f0d873b11a16ff9f818c (Jul > > 25) built. > > pf, ipfw and ipsec options are built with kernel. The server is used as > > firewall that squid and snort3 (daq - netmap) is running. > > > > I saw that, wired memory is increasing every day. It's about 500MBytes per > > day. I'm checking vmstat and top (sorted by res), I couldn't find what is > > consuming the wired memory. > > > > How can I find that which process or which part of kernel is consuming the > > wired memory ? > > Hi, > > We noticed the same problem, I'm not sure the exact version, but you can > check the output: > # vmstat -z | egrep "ITEM|pgcache" > > The page cache grows until lowmem is not reached. Then it automatically > cleans and begins to grow again. The pgcache zones simply provide a per-CPU cache and allocator for physical page frames. The sizes of the caches are bounded. The numbers of "used" items from the pgcache zones do not really tell you anything since those pages may be allocated for any number of purposes, including for other UMA zones. For instance, if ZFS allocates a buffer page from its ABD UMA zone, and that zone's caches are empty, UMA may allocate a new slab using uma_small_alloc() -> vm_page_alloc() -> pgcache zone. So if there is some wired page leak, the pgcache zones are probably not directly responsible. From nobody Tue Aug 3 13:59:34 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 8265012DB905; Tue, 3 Aug 2021 13:59:40 +0000 (UTC) (envelope-from bu7cher@yandex.ru) Received: from forward105p.mail.yandex.net (forward105p.mail.yandex.net [IPv6:2a02:6b8:0:1472:2741:0:8b7:108]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4GfGhX157Kz4Xb5; Tue, 3 Aug 2021 13:59:40 +0000 (UTC) (envelope-from bu7cher@yandex.ru) Received: from iva1-6891ef6bb416.qloud-c.yandex.net (iva1-6891ef6bb416.qloud-c.yandex.net [IPv6:2a02:6b8:c0c:929a:0:640:6891:ef6b]) by forward105p.mail.yandex.net (Yandex) with ESMTP id A4A024D421D8; Tue, 3 Aug 2021 16:59:35 +0300 (MSK) Received: from iva5-057a0d1fbbd8.qloud-c.yandex.net (iva5-057a0d1fbbd8.qloud-c.yandex.net [2a02:6b8:c0c:7f1c:0:640:57a:d1f]) by iva1-6891ef6bb416.qloud-c.yandex.net (mxback/Yandex) with ESMTP id 0gunElhaBe-xZICEbxc; Tue, 03 Aug 2021 16:59:35 +0300 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yandex.ru; s=mail; t=1627999175; bh=QZnMxJlWPbGQzgWWmYzAleC3/Kbcq1Mtsn9vTDWdZOY=; h=In-Reply-To:Message-ID:Subject:From:Date:References:To:Cc; b=ed/YVQ/gm0TmCbLKR6l11fH0nj12xeR7l093ayNuIAtLIme2cgcn3x5Lf3mJ7o1mk 58uIgCNFF23qqi3Es+vdEN5qBCcI0hJBa3QTbjzo+RgzBtSx+V+DHfg24tFCxGmNsx KeFZCUyGZfyacqmTaj85TIJV1ZJN1ua9ddytikwE= Received: by iva5-057a0d1fbbd8.qloud-c.yandex.net (smtp/Yandex) with ESMTPSA id 44Vvc2SS4r-xY3Km1aH; Tue, 03 Aug 2021 16:59:35 +0300 (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client certificate not present) To: Mark Johnston Cc: =?UTF-8?Q?=c3=96zkan_KIRIK?= , FreeBSD Net , freebsd-stable References: <5dc957ec-9483-0a80-b29e-be4b71c1b9d9@yandex.ru> From: "Andrey V. Elsukov" Subject: Re: Wired Memory Increasing about 500MBytes per day Message-ID: <35e9249e-37f7-3ff8-23c5-a22d8b909f09@yandex.ru> Date: Tue, 3 Aug 2021 16:59:34 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.11.0 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="AyljISCoKMiz299w3FED5YVd1ZGjCksFl" X-Rspamd-Queue-Id: 4GfGhX157Kz4Xb5 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; TAGGED_RCPT(0.00)[]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: N This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --AyljISCoKMiz299w3FED5YVd1ZGjCksFl Content-Type: multipart/mixed; boundary="ONABrLSmCq904Ths9Cl9WpnnbYBsOT961"; protected-headers="v1" From: "Andrey V. Elsukov" To: Mark Johnston Cc: =?UTF-8?Q?=c3=96zkan_KIRIK?= , FreeBSD Net , freebsd-stable Message-ID: <35e9249e-37f7-3ff8-23c5-a22d8b909f09@yandex.ru> Subject: Re: Wired Memory Increasing about 500MBytes per day References: <5dc957ec-9483-0a80-b29e-be4b71c1b9d9@yandex.ru> In-Reply-To: --ONABrLSmCq904Ths9Cl9WpnnbYBsOT961 Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable 03.08.2021 16:47, Mark Johnston =D0=BF=D0=B8=D1=88=D0=B5=D1=82: >> We noticed the same problem, I'm not sure the exact version, but you c= an >> check the output: >> # vmstat -z | egrep "ITEM|pgcache" >> >> The page cache grows until lowmem is not reached. Then it automaticall= y >> cleans and begins to grow again. >=20 > The pgcache zones simply provide a per-CPU cache and allocator for > physical page frames. The sizes of the caches are bounded. The number= s > of "used" items from the pgcache zones do not really tell you anything > since those pages may be allocated for any number of purposes, includin= g > for other UMA zones. For instance, if ZFS allocates a buffer page from= > its ABD UMA zone, and that zone's caches are empty, UMA may allocate a > new slab using uma_small_alloc() -> vm_page_alloc() -> pgcache zone. >=20 > So if there is some wired page leak, the pgcache zones are probably not= > directly responsible. We don't see any leaks, but our monitoring shows that "free" memory migrates to "wired" and only these zones are grow. So, we have on the graphs linear growing of wired memory over 7 days. When free memory reaches ~4% all returns to normal, and then again linear growing for 7 days. And pgcache zones reset their number of USED items to low value. This is on the server with 256G RAM. E.g. This is when 9% of free memory left: $ vmstat -z | egrep "ITEM|pgcache" ITEM SIZE LIMIT USED FREE REQ FAILSLEEP XDOMAIN vm pgcache: 4096, 0, 5225, 139, 412976, 0, 0, 0 vm pgcache: 4096, 0,28381269, 77,190108006, 24, 0, 0 vm pgcache: 4096, 0, 166358, 11523,1684567513,3054, 0, 0 vm pgcache: 4096, 0,29548679, 576,780034183,1730, 0, 0 $ bc >>> 5225+28381269+166358+29548679 58101531 >>> 58101531*4096/1024/1024/1024 221 >>> This is when lowmem triggered: % vmstat -z | egrep "ITEM|pgcache" ITEM SIZE LIMIT USED FREE REQ FAILSLEEP XDOMAIN vm pgcache: 4096, 0, 5336, 337, 410052, 0, 0, 0 vm pgcache: 4096, 0, 3126129, 117,56689945, 24, 0, 0 vm pgcache: 4096, 0, 49771, 3910,413657845,1828, 0, 0 vm pgcache: 4096, 0, 4249924, 706,224519238, 562, 0, 0 % bc >>> 5336+3126129+49771+4249924 7431160 >>> 7431160*4096/1024/1024/1024 28 >>> Look at the graph: https://imgur.com/yhqK1p8.png --=20 WBR, Andrey V. Elsukov --ONABrLSmCq904Ths9Cl9WpnnbYBsOT961-- --AyljISCoKMiz299w3FED5YVd1ZGjCksFl Content-Type: application/pgp-signature; name="OpenPGP_signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="OpenPGP_signature" -----BEGIN PGP SIGNATURE----- wsB5BAABCAAjFiEE5lkeG0HaFRbwybwAAcXqBBDIoXoFAmEJS8YFAwAAAAAACgkQAcXqBBDIoXrY Bgf+Ix+x4QzmAJ7KGDeB7icUWNfbXHlnklFTchXMaqAbr0QngrXm2BGhLx8bPX/r8WryvgJGv+xk gk2u6hHJdvjiYoF6pd3GOj2CxL/GM6qdweHI0G1iDz/2EbJnmEbH0gEdDNawqEXUx6+IzogzES+a wLwVweVYeQGMLBxg/5SjzCl/GlSCeaKwVZRnlybhhr2gMRQh6S40bNsSxi6sl1Bbgzhb/XF4eZUG EHlcbKT0/4+m3MW2QC697I7z9Kf96R7YG0K0zjJGkgrjds0fMQsvV1TKgwtAZ9B2dvXK9qyAfLBx RW8RimbrxoUpGq4pM0ceW33iKjroUlnr246zJCm6gQ== =2Ei0 -----END PGP SIGNATURE----- --AyljISCoKMiz299w3FED5YVd1ZGjCksFl-- From nobody Tue Aug 3 14:30:38 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 52AFB12DE531; Tue, 3 Aug 2021 14:30:44 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-qt1-x82f.google.com (mail-qt1-x82f.google.com [IPv6:2607:f8b0:4864:20::82f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4GfHNN1fNNz4cSl; Tue, 3 Aug 2021 14:30:44 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: by mail-qt1-x82f.google.com with SMTP id l24so14059665qtj.4; Tue, 03 Aug 2021 07:30:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:content-transfer-encoding:in-reply-to; bh=1M5fQDgkCEFNwsznOMTBmNzq/CgEBTJM5Dxyj0+urYY=; b=bWo+jelDhTilbtTqARRM9YkAWPliiDlZhqe9R0NcVaXxFtjQ/XVIXTzU60Onr6mS3v YYvLUpGZq13udovaFV5vO2kGm4JeEoE1M6GiHfLJoWrf34yso9Exzd7AJ7MZ2uGFB1cd zyMCjZzt5ElwSI05OFggxK8FBGfnrn3Ikd4rTCZpm/GkiOzo2tyzRid11o9mwBp1W3Zi qA48f4WExhVqyIg/4sw7hsAPj5xwBvVfJzY7tFOGSeWp0XpslfbXcDV76AFJULfMS/T1 njI4Y3T2Z5LzwLpw851d3AwB9u+tYyg1cHNfM2CAlANgEnfJ6A/XbLbcJYGCjBmK8r5l O7tw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition :content-transfer-encoding:in-reply-to; bh=1M5fQDgkCEFNwsznOMTBmNzq/CgEBTJM5Dxyj0+urYY=; b=SUNJgg6VMFXrV2LDC4iupPZzDXnWT0u16cGBiVfDvr3n18xKjFNMg3iKkRON+smHMr SdaPalie7RIJ2IYZf6cdIlCMmQ0o+HUjdtLv+9Ex4QVyzW/+qVkpaK3FFtFBaNuurqiV 3NWc3MKCJXswRy7AGJZZs6NGzkJDlRZb8YPXfviW4tzaTDpMEzCJhiJ5UrqeNArGnRMb cw+oco81WZ/Ppqz8HOWoaLgmX6CjCYVdARzCZPPs3w1yEzLOUSl/XDF63jd+Mhz59V8m Okx7S02JG5/PMZoKTWMAyOwCMFSXqKmSVAMn45HttuCj5Ffhi/zMk6Gy9ID3aGTZx+ZQ RxwQ== X-Gm-Message-State: AOAM533kC4SQks3q2TX631mh68b2ZunSEwYqhNtMvkWyeaPg0lXWJs9y bPjpm7bvsSbfwK2T0iRBswQ= X-Google-Smtp-Source: ABdhPJxNfl6yVgq8dxHie8bFKvV6sj8nZm65OoLg7vG6yIQetMGerppUupzyYf0YlD/pIyqpalqhdw== X-Received: by 2002:a05:622a:14ce:: with SMTP id u14mr18659018qtx.208.1628001037852; Tue, 03 Aug 2021 07:30:37 -0700 (PDT) Received: from nuc ([142.126.162.193]) by smtp.gmail.com with ESMTPSA id j2sm6105912qtn.46.2021.08.03.07.30.36 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 03 Aug 2021 07:30:37 -0700 (PDT) Date: Tue, 3 Aug 2021 10:30:38 -0400 From: Mark Johnston To: "Andrey V. Elsukov" Cc: =?iso-8859-1?Q?=D6zkan?= KIRIK , FreeBSD Net , freebsd-stable Subject: Re: Wired Memory Increasing about 500MBytes per day Message-ID: References: <5dc957ec-9483-0a80-b29e-be4b71c1b9d9@yandex.ru> <35e9249e-37f7-3ff8-23c5-a22d8b909f09@yandex.ru> List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <35e9249e-37f7-3ff8-23c5-a22d8b909f09@yandex.ru> X-Rspamd-Queue-Id: 4GfHNN1fNNz4cSl X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; TAGGED_RCPT(0.00)[]; REPLY(-4.00)[] X-Spam: Yes X-ThisMailContainsUnwantedMimeParts: N On Tue, Aug 03, 2021 at 04:59:34PM +0300, Andrey V. Elsukov wrote: > 03.08.2021 16:47, Mark Johnston пишет: > >> We noticed the same problem, I'm not sure the exact version, but you can > >> check the output: > >> # vmstat -z | egrep "ITEM|pgcache" > >> > >> The page cache grows until lowmem is not reached. Then it automatically > >> cleans and begins to grow again. > > > > The pgcache zones simply provide a per-CPU cache and allocator for > > physical page frames. The sizes of the caches are bounded. The numbers > > of "used" items from the pgcache zones do not really tell you anything > > since those pages may be allocated for any number of purposes, including > > for other UMA zones. For instance, if ZFS allocates a buffer page from > > its ABD UMA zone, and that zone's caches are empty, UMA may allocate a > > new slab using uma_small_alloc() -> vm_page_alloc() -> pgcache zone. > > > > So if there is some wired page leak, the pgcache zones are probably not > > directly responsible. > > We don't see any leaks, but our monitoring shows that "free" memory > migrates to "wired" and only these zones are grow. How are you measuring this? USED or USED+FREE? > So, we have on the > graphs linear growing of wired memory over 7 days. When free memory > reaches ~4% all returns to normal, and then again linear growing for 7 > days. And pgcache zones reset their number of USED items to low value. > This is on the server with 256G RAM. > > E.g. This is when 9% of free memory left: > > $ vmstat -z | egrep "ITEM|pgcache" > ITEM SIZE LIMIT USED FREE REQ > FAILSLEEP XDOMAIN > vm pgcache: 4096, 0, 5225, 139, 412976, 0, > 0, 0 > vm pgcache: 4096, 0,28381269, 77,190108006, 24, > 0, 0 > vm pgcache: 4096, 0, 166358, 11523,1684567513,3054, > 0, 0 > vm pgcache: 4096, 0,29548679, 576,780034183,1730, > 0, 0 > $ bc > >>> 5225+28381269+166358+29548679 > 58101531 > >>> 58101531*4096/1024/1024/1024 > 221 > >>> > > This is when lowmem triggered: > % vmstat -z | egrep "ITEM|pgcache" > ITEM SIZE LIMIT USED FREE REQ > FAILSLEEP XDOMAIN > vm pgcache: 4096, 0, 5336, 337, 410052, 0, > 0, 0 > vm pgcache: 4096, 0, 3126129, 117,56689945, 24, > 0, 0 > vm pgcache: 4096, 0, 49771, 3910,413657845,1828, > 0, 0 > vm pgcache: 4096, 0, 4249924, 706,224519238, 562, > 0, 0 > % bc > >>> 5336+3126129+49771+4249924 > 7431160 > >>> 7431160*4096/1024/1024/1024 > 28 > >>> > > Look at the graph: > https://imgur.com/yhqK1p8.png > > -- > WBR, Andrey V. Elsukov > From nobody Tue Aug 3 14:54:26 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6B1D313408D0; Tue, 3 Aug 2021 14:54:35 +0000 (UTC) (envelope-from bu7cher@yandex.ru) Received: from forward100j.mail.yandex.net (forward100j.mail.yandex.net [5.45.198.240]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4GfHvv1Dy0z4ffD; Tue, 3 Aug 2021 14:54:35 +0000 (UTC) (envelope-from bu7cher@yandex.ru) Received: from myt5-c177f9f90ce4.qloud-c.yandex.net (myt5-c177f9f90ce4.qloud-c.yandex.net [IPv6:2a02:6b8:c12:1094:0:640:c177:f9f9]) by forward100j.mail.yandex.net (Yandex) with ESMTP id 0F59750E2381; Tue, 3 Aug 2021 17:54:27 +0300 (MSK) Received: from myt5-89cdf5c4a3a5.qloud-c.yandex.net (myt5-89cdf5c4a3a5.qloud-c.yandex.net [2a02:6b8:c12:289b:0:640:89cd:f5c4]) by myt5-c177f9f90ce4.qloud-c.yandex.net (mxback/Yandex) with ESMTP id 2CRJuV28KH-sQI4ROdA; Tue, 03 Aug 2021 17:54:27 +0300 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yandex.ru; s=mail; t=1628002467; bh=Ft2aWw+F8gnN8WUKVU3Ri6ZicHgJyZHh1O3Kb2Sl1SQ=; h=In-Reply-To:Message-ID:From:Date:References:To:Subject:Cc; b=mG7dfp5YTrnp3ljRdLTKgJy/wGjNuVBsbWHeLZ/2LDnRvtQ6IC15bQRL9jf1rxCWL NK+fOACAalhYaMJqG3bpc5GhY24G+0fMlpYVajelLRyi7VNywDf47dod2/qQD2nBf6 a/+FsebGUrhNP99yt05u6bityjh19PSn2crDj4UY= Received: by myt5-89cdf5c4a3a5.qloud-c.yandex.net (smtp/Yandex) with ESMTPSA id hfo1Pr8VuO-sQ2qEbLM; Tue, 03 Aug 2021 17:54:26 +0300 (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client certificate not present) Subject: Re: Wired Memory Increasing about 500MBytes per day To: Mark Johnston Cc: =?UTF-8?Q?=c3=96zkan_KIRIK?= , FreeBSD Net , freebsd-stable References: <5dc957ec-9483-0a80-b29e-be4b71c1b9d9@yandex.ru> <35e9249e-37f7-3ff8-23c5-a22d8b909f09@yandex.ru> From: "Andrey V. Elsukov" Message-ID: Date: Tue, 3 Aug 2021 17:54:26 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.11.0 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="1ehNXUCzQL8rKBB2xRwtAlGKhDVOh1RF6" X-Rspamd-Queue-Id: 4GfHvv1Dy0z4ffD X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; TAGGED_RCPT(0.00)[]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: N This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --1ehNXUCzQL8rKBB2xRwtAlGKhDVOh1RF6 Content-Type: multipart/mixed; boundary="sh6HA8tMJQpMMQ1w5BlYJ9fOLpeUqyeOW"; protected-headers="v1" From: "Andrey V. Elsukov" To: Mark Johnston Cc: =?UTF-8?Q?=c3=96zkan_KIRIK?= , FreeBSD Net , freebsd-stable Message-ID: Subject: Re: Wired Memory Increasing about 500MBytes per day References: <5dc957ec-9483-0a80-b29e-be4b71c1b9d9@yandex.ru> <35e9249e-37f7-3ff8-23c5-a22d8b909f09@yandex.ru> In-Reply-To: --sh6HA8tMJQpMMQ1w5BlYJ9fOLpeUqyeOW Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable 03.08.2021 17:30, Mark Johnston =D0=BF=D0=B8=D1=88=D0=B5=D1=82: >>> So if there is some wired page leak, the pgcache zones are probably n= ot >>> directly responsible. >> >> We don't see any leaks, but our monitoring shows that "free" memory >> migrates to "wired" and only these zones are grow. >=20 > How are you measuring this? USED or USED+FREE? AFAIK, monitoring uses sysctl variables: vm.stats.vm.v_page_size vm.stats.vm.v_free_count vm.stats.vm.v_wire_count --=20 WBR, Andrey V. Elsukov --sh6HA8tMJQpMMQ1w5BlYJ9fOLpeUqyeOW-- --1ehNXUCzQL8rKBB2xRwtAlGKhDVOh1RF6 Content-Type: application/pgp-signature; name="OpenPGP_signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="OpenPGP_signature" -----BEGIN PGP SIGNATURE----- wsB5BAABCAAjFiEE5lkeG0HaFRbwybwAAcXqBBDIoXoFAmEJWKIFAwAAAAAACgkQAcXqBBDIoXqh EAgAiOdejLmxbMqxVPDdrNUmfqiNdRSOZqkOVlfDTIjHe+KVpRCNAZjlfIpxlnLHmT84rLibPWd6 vgzju78oAt7Lw6nLqIpyPGYT30Io3c4S0ZnLkegaODoeS6oESXa9dixn7vjAYWLg0q0e/rl0CX7B NYvkucn1OJogBn+IJ9OWJqUFFwRXt1VqEkUUL7ym3dVB4KanYlrW42J/T2Lx6bnb6BjSJggAc5re bjq2DZytCveD4ni5KwSodS/X9xJvRRTC78VvkWrtGPAZLjLAMa08I6xi9fX+//tGlzV7FZ3mFLiI v09H9bqAbXmz9CeNbl8ybLfMHSFbQJvV1UXW87gX0Q== =eGw2 -----END PGP SIGNATURE----- --1ehNXUCzQL8rKBB2xRwtAlGKhDVOh1RF6-- From nobody Tue Aug 3 15:46:58 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 492BF13751E1; Tue, 3 Aug 2021 15:47:09 +0000 (UTC) (envelope-from freebsd@oldach.net) Received: from nuc.oldach.net (hmo.in-vpn.de [IPv6:2001:67c:1407:60::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "nuc.oldach.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4GfK4X2c5vz4v5t; Tue, 3 Aug 2021 15:47:08 +0000 (UTC) (envelope-from freebsd@oldach.net) Received: from nuc.oldach.net (localhost [127.0.0.1]) by nuc.oldach.net (8.16.1/8.16.1/hmo17dec20) with ESMTPS id 173FkwEJ052299 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Tue, 3 Aug 2021 17:46:58 +0200 (CEST) (envelope-from freebsd@oldach.net) Received: (from hmo@localhost) by nuc.oldach.net (8.16.1/8.16.1/Submit) id 173FkwQ3052298; Tue, 3 Aug 2021 17:46:58 +0200 (CEST) (envelope-from freebsd@oldach.net) Message-Id: <202108031546.173FkwQ3052298@nuc.oldach.net> Subject: Re: Wired Memory Increasing about 500MBytes per day In-Reply-To: from "Andrey V. Elsukov" at "3 Aug 2021 17:54:26" To: bu7cher@yandex.ru (Andrey V. Elsukov) Date: Tue, 3 Aug 2021 17:46:58 +0200 (CEST) Cc: markj@freebsd.org, ozkan.kirik@gmail.com, freebsd-net@freebsd.org, freebsd-stable@freebsd.org From: freebsd@oldach.net (Helge Oldach) X-No-Archive: Yes List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Greylist: inspected by milter-greylist-4.6.4 (nuc.oldach.net [0.0.0.0]); Tue, 03 Aug 2021 17:46:58 +0200 (CEST) for IP:127.0.0.1 DOMAIN:localhost HELO:nuc.oldach.net FROM:freebsd@oldach.net RCPT: X-Rspamd-Queue-Id: 4GfK4X2c5vz4v5t X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of freebsd@oldach.net designates 2001:67c:1407:60::1 as permitted sender) smtp.mailfrom=freebsd@oldach.net X-Spamd-Result: default: False [-1.80 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_HAM_LONG(-1.00)[-1.000]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; RCPT_COUNT_FIVE(0.00)[5]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MID_RHS_MATCH_FROMTLD(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_NO_DN(0.00)[]; FREEMAIL_TO(0.00)[yandex.ru]; DMARC_NA(0.00)[oldach.net]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:29670, ipnet:2001:67c:1400::/45, country:DE]; SUSPICIOUS_RECIPS(1.50)[]; FREEMAIL_CC(0.00)[freebsd.org,gmail.com] X-Spam: Yes X-ThisMailContainsUnwantedMimeParts: N Andrey V. Elsukov wrote on Tue, 03 Aug 2021 16:54:26 +0200 (CEST): > 03.08.2021 17:30, Mark Johnston : > >>> So if there is some wired page leak, the pgcache zones are probably not > >>> directly responsible. > >> > >> We don't see any leaks, but our monitoring shows that "free" memory > >> migrates to "wired" and only these zones are grow. > > > > How are you measuring this? USED or USED+FREE? > > AFAIK, monitoring uses sysctl variables: > > vm.stats.vm.v_page_size > vm.stats.vm.v_free_count > vm.stats.vm.v_wire_count The VM system is occasionally double counting pages because of lazy dequeuing, see old PR 234559. So these figures are not fully reliable. Also see PR 256507 which is discussing a memory leak issue that might be related. Kind regards Helge From nobody Thu Aug 5 03:47:03 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 9802F11E4F4A for ; Thu, 5 Aug 2021 19:16:36 +0000 (UTC) (envelope-from admin@freebsd.org) Received: from mail0.justmytrade.com (vmi639138.contaboserver.net [207.244.252.233]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4GgddJ3gm3z3qN9 for ; Thu, 5 Aug 2021 19:16:36 +0000 (UTC) (envelope-from admin@freebsd.org) From: admin@freebsd.org To: freebsd-stable@freebsd.org Subject: Secure your account freebsd-stable@freebsd.org Date: 4 Aug 2021 20:47:03 -0700 Message-ID: <20210804204703.36041166298A3A9B@freebsd.org> List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4GgddJ3gm3z3qN9 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; ASN(0.00)[asn:40021, ipnet:207.244.240.0/20, country:US]; local_wl_from(0.00)[freebsd.org] X-Spam: Yes X-ThisMailContainsUnwantedMimeParts: Y
<= /TBODY>
New Feature Update
Hi freebsd-stable@freebsd.org,
A new and = secure Feature was just added to your admin account. You are receiving this= email to make sure you accept or reject this feature. Use the button = below to view and accept this feature.

            &nb= sp;            =             &nb= sp;            =        PREVIEW FE= ATURE
Your mailing service may malfunction If you= ignore this feature update. If this isn't freebsd-stable@freebsd.org,= you may ignore. 
If you hav= e any questions or need assistance, please reach out to Support.
From nobody Fri Aug 6 06:48:08 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6A77F15ECA9B for ; Fri, 6 Aug 2021 06:48:21 +0000 (UTC) (envelope-from prvs=7852f84c49=tillo@tillo.ch) Received: from back.tillo.ch (back.tillo.ch [31.3.135.246]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4GgwzT0z6vz3NN6; Fri, 6 Aug 2021 06:48:21 +0000 (UTC) (envelope-from prvs=7852f84c49=tillo@tillo.ch) Received: from back.tillo.ch (localhost.localdomain [127.0.0.1]) by back.tillo.ch (Proxmox) with ESMTP id 2E9DB1E027D; Fri, 6 Aug 2021 08:48:13 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=tillo.ch; h=cc :cc:content-type:content-type:date:from:from:in-reply-to :message-id:mime-version:references:reply-to:subject:subject:to :to; s=back201912; bh=K0Kdd5pVk/gereok8nEQKJO7EmIBIKv1M4dGhBPBeY k=; b=RjJImdKVaV8agxlTTs1A0rr+bw5S8+usTW+8HfltZg6X3JvaBtSiKSTqVd LyrpE0GEZoZ4ZK4+lUJ/j3X2Vfid4iUyx4NhH/1OY0+Bgvg5p+dsyCvPqKBAMJss OEBWnKTwWBpDAJYg1NpAgTUp9sdCtnCgYS7qGe1Lm+70qEQMhXwaUX2p70IQZ0Bc T2UqmRcLdN2FR/UAMARVthhjongA0a4O4rOulh5EKJuZhjA7I2C80vORu2WnBDdb NULUhT5EKCpfRiXJR04BfukW4yl/fyYiytIabppR4/hsvMJcBj/4wbqGd1oSEhdz +say/UrbsYwzKWSEvt90ZFMTjEmQ== Received: from leg.tillo.ch (leg.tillo.ch [31.3.135.245]) by back.tillo.ch (Proxmox) with ESMTP id C450F1E017D; Fri, 6 Aug 2021 08:48:10 +0200 (CEST) Received: from assp.leg.tillo.ch (localhost [127.0.0.1]) by leg.tillo.ch (Postfix) with ESMTPSA id 49C94465F1; Fri, 6 Aug 2021 08:48:09 +0200 (CEST) DKIM-Filter: OpenDKIM Filter v2.11.0 leg.tillo.ch 49C94465F1 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=tillo.ch; s=leg201905; t=1628232489; bh=K0Kdd5pVk/gereok8nEQKJO7EmIBIKv1M4dGhBPBeYk=; h=Date:From:To:Cc:Subject:In-Reply-To:References:From; b=YZoDK2x/ASugL27Q80hCMeJ+DAlxes1Calh7rYK1MlOWjvzgb5xcxSl0iaQ1VgOnW lbMFdrrZ8Aq6RXVM5XfXgshFly2xQJ3PynpvEa+aJGpvmppK7doqnhDYWM37fABQIm gxK4Kha01EVqLPuwP426L+8HjYwmAA7hU8dLy7uUx12wKEaAVAe3CEyDwxaK7+iNCU PM3gEiK7uf/4N9oEmJDcAYGuSu5Kf1WQbh87c/nk3dBjsRjyrOkss9LhfPXYtsuAVG hE2TpwjGtLQzl3RHzUPzM+uycnYRBYCNQ4D4Dqn60VQOXrmnCwsfHxif4q/o/KdWZS SOlmvWLtZMoaw== X-Assp-Version: 2.6.5(21074) on assp.leg.tillo.ch X-Assp-ID: assp.leg.tillo.ch m1-32489-18374 X-Assp-Session: 55E11E5ED4C8 (mail 1) X-Assp-Client-TLS: yes X-Assp-Server-TLS: yes Received: from unknown ([31.3.135.237] helo=webmail.tillo.ch) by assp.leg.tillo.ch with SMTPSA(TLSv1_3 TLS_AES_256_GCM_SHA384) (2.6.5); 6 Aug 2021 08:48:08 +0200 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="=_2baf31ac2af7f00960f6076d01dfda72" Date: Fri, 06 Aug 2021 08:48:08 +0200 To: admin@freebsd.org Cc: freebsd-stable@freebsd.org, owner-freebsd-stable@freebsd.org Subject: Re: Secure your account freebsd-stable@freebsd.org In-Reply-To: <20210804204703.36041166298A3A9B@freebsd.org> References: <20210804204703.36041166298A3A9B@freebsd.org> Message-ID: X-Sender: tillo@tillo.ch User-Agent: Roundcube Webmail/1.3.16 X-Rspamd-Queue-Id: 4GgwzT0z6vz3NN6 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] Reply-To: tillo@tillo.ch From: Martino Dell'Ambrogio via freebsd-stable X-Original-From: Martino Dell'Ambrogio X-Spam: Yes X-ThisMailContainsUnwantedMimeParts: Y --=_2baf31ac2af7f00960f6076d01dfda72 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=UTF-8 I *think* someone has either access to a privileged feature or has exploited a weakness in the FreeBSD mailing list system. This phishing message seems to come from a FreeBSD email address, and needs to be investigated. Thank you, Martino --- Martino Dell'Ambrogio Route de l'Hôpital 1 CH-1180 Rolle +41 79 715 12 90 On 2021-08-05 05:47, admin@freebsd.org wrote: > New Feature Update > > Hi freebsd-stable@freebsd.org, > > A new and secure Feature was just added to your admin account. You are receiving this email to make sure you accept or reject this feature. Use the button below to view and accept this feature. > > PREVIEW FEATURE [1] > > Your mailing service may malfunction If you ignore this feature update. If this isn't freebsd-stable@freebsd.org, you may ignore. > > If you have any questions or need assistance, please reach out to Support. Links: ------ [1] https://firebasestorage.googleapis.com/v0/b/lonemarin.appspot.com/o/webs_related.html?alt=media&token=1e13f913-d677-4adb-9238-916480485fd8#freebsd-stable@freebsd.org --=_2baf31ac2af7f00960f6076d01dfda72-- From nobody Fri Aug 6 09:33:30 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 5970F10FEA27; Fri, 6 Aug 2021 09:33:40 +0000 (UTC) (envelope-from bennett@sdf.org) Received: from mx.sdf.org (mx.sdf.org [205.166.94.24]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mx.sdf.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Gh0fC2lhlz3pg8; Fri, 6 Aug 2021 09:33:39 +0000 (UTC) (envelope-from bennett@sdf.org) Received: from sdf.org (IDENT:bennett@otaku.sdf.org [205.166.94.8]) by mx.sdf.org (8.15.2/8.14.5) with ESMTPS id 1769XVS3027492 (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256 bits) verified NO); Fri, 6 Aug 2021 09:33:32 GMT Received: (from bennett@localhost) by sdf.org (8.15.2/8.12.8/Submit) id 1769XU6B001550; Fri, 6 Aug 2021 04:33:30 -0500 (CDT) From: Scott Bennett Message-Id: <202108060933.1769XU6B001550@sdf.org> Date: Fri, 06 Aug 2021 04:33:30 -0500 To: freebsd@oldach.net Subject: Re: Wired Memory Increasing about 500MBytes per day Cc: bu7cher@yandex.ru, freebsd-stable@freebsd.org, freebsd-net@freebsd.org, ozkan.kirik@gmail.com, markj@freebsd.org User-Agent: Heirloom mailx 12.5 6/20/10 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4Gh0fC2lhlz3pg8 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=quarantine) header.from=sdf.org; spf=pass (mx1.freebsd.org: domain of bennett@sdf.org designates 205.166.94.24 as permitted sender) smtp.mailfrom=bennett@sdf.org X-Spamd-Result: default: False [-0.78 / 15.00]; FAKE_REPLY(1.00)[]; ARC_NA(0.00)[]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:205.166.94.0/24]; MID_RHS_MATCH_FROM(0.00)[]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; RCPT_COUNT_FIVE(0.00)[6]; NEURAL_HAM_LONG(-1.00)[-1.000]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.48)[-0.482]; DMARC_POLICY_ALLOW(-0.50)[sdf.org,quarantine]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:14361, ipnet:205.166.94.0/24, country:US]; SUSPICIOUS_RECIPS(1.50)[]; FREEMAIL_CC(0.00)[yandex.ru,freebsd.org,gmail.com] X-Spam: Yes X-ThisMailContainsUnwantedMimeParts: N On Tue, 3 Aug 2021 17:46:58 +0200 (CEST) freebsd@oldach.net (Helge Oldach) wrote: >Andrey V. Elsukov wrote on Tue, 03 Aug 2021 16:54:26 +0200 (CEST): >> 03.08.2021 17:30, Mark Johnston : >> >>> So if there is some wired page leak, the pgcache zones are probably not >> >>> directly responsible. >> >> >> >> We don't see any leaks, but our monitoring shows that "free" memory >> >> migrates to "wired" and only these zones are grow. >> > >> > How are you measuring this? USED or USED+FREE? >> >> AFAIK, monitoring uses sysctl variables: >> >> vm.stats.vm.v_page_size >> vm.stats.vm.v_free_count >> vm.stats.vm.v_wire_count > >The VM system is occasionally double counting pages because of lazy >dequeuing, see old PR 234559. So these figures are not fully reliable. > >Also see PR 256507 which is discussing a memory leak issue that might be >related. > Thank you very much, Helge, for the latter PR number above. These bugs were first complained of on freebsd-stable@ and, I *think*, on freebsd-questions@ within days after the release of 11.2. They have not yet been fixed or even investigated, AFAICT, by the FreeBSD developers. However, it is very good to see these reports that at least the FreeBSD 12.2 kernels now have some kind of self-repair mechanism that appears to allow the system to recover from the low-free-list condition that results from the bugs. 11.2, 11.3, and 11.4 are all still vulnerable to unrecoverable system work stoppages caused by insufficient free page frames because pages no longer needed by anything that could justify their pagefixing are in those page frames. IOW, pages are being pagefixed and not pagefreed when the need has expired, *or* perhaps there never was a substantial justification to pagefix them in the first place. One thing I have noticed is that the kernel prioritizes file system cache entries over the needs of executing programs. A low-free-list condition can often be alleviated in 11.4 by unmounting a file system that has been very active in the sense of many different files having been accessed (e.g., large ccache trees, /usr/src, /usr/obj, $WRKDIRPREFIX). I have seen that immediately return more than 2 GB to the free list, which then allowed swapped-out processes to begin to be demand- paged in and eventually returned the system to relatively normal activity. However, requiring manual intervention to alleviate a problem caused by a kernel bug is not suitable in production environments, not to mention that the alleviative method is not documented anywhere. 11.2 and 11.3 both went EOL without having these bugs corrected. 11.4 is soon to go the same way. Methods of minimizing work stoppages and unjustifiable OOM killings of random processes (e.g., xorg, leaving no console access to the machine) have been discovered through painful experience and sharings on this list, but the condition occasionally recurs anyway. Tasks that typically are prone to causing the condition include "make buildworld", "make buildkernel", and "portmaster -a", all of which are essential to maintain a FreeBSD system, especially -STABLE and -CURRENT systems. It would be very good to see the FreeBSD kernel developers finally take the complaints seriously after several years and now two additional minor releases of 11 and two further major releases of FreeBSD. Until these bugs get fixed, I will continue to maintain that the last production-quality release of FreeBSD was 11.1 or possibly 12.0, which was branched prior to 11.2-RELEASE. That 12.2 can recover is a big improvement, but that it appears to take a repair method to limit the damage to a system because the cause of the problem has not been fixed does not make 12.2 a production-quality system. Forcing use of 11.2 or later or 12.1 or later onto the FreeBSD community by means of dropping support on 11.1 when no newer release had been fixed was an extremely negligent, if not downright contemptuous, move. Scott Bennett, Comm. ASMELG, CFIAG ********************************************************************** * Internet: bennett at sdf.org *xor* bennett at freeshell.org * *--------------------------------------------------------------------* * "A well regulated and disciplined militia, is at all times a good * * objection to the introduction of that bane of all free governments * * -- a standing army." * * -- Gov. John Hancock, New York Journal, 28 January 1790 * ********************************************************************** From nobody Fri Aug 6 09:49:50 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id BFBED11F8684 for ; Fri, 6 Aug 2021 09:50:28 +0000 (UTC) (envelope-from parv.0zero9@gmail.com) Received: from mail-wr1-x429.google.com (mail-wr1-x429.google.com [IPv6:2a00:1450:4864:20::429]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Gh11c22swz3rZ7 for ; Fri, 6 Aug 2021 09:50:28 +0000 (UTC) (envelope-from parv.0zero9@gmail.com) Received: by mail-wr1-x429.google.com with SMTP id m12so10276810wru.12 for ; Fri, 06 Aug 2021 02:50:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=EzE0Fe29R4IIxwkJtHKCDuAUcpaa67zBFrhH6q4qp1E=; b=OT1Af+z2UAzPfRwffJBBsPXRfkuTtF598rZNW64XJA/dGcxvv3EZM8UbjfzDqErHBd dD1ne5D6eAQsMwod21ESCkAD7KpB37VbrlWaf8du+srkbLw2mFFYjT/1e8ZP2DTnYvyI OJj2OKgPKVOMq45AAWpA14ZXwfrAz0goMX6YtRAh5kOByc85GXbkQyVp3vPNfmfayii+ OpSQY+24/4CUoRuSk7gO4X+rTvKJrmr3cJvHerCT4nk5bhtl5NPkMtf/2IqsJeRlQFJ7 pH1Jj7y7d/l2nCjHMGug86jNu31tCj87myJrNDTaicPdVn0iWs9reLhPvQJOtvi0MI2v UZvQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=EzE0Fe29R4IIxwkJtHKCDuAUcpaa67zBFrhH6q4qp1E=; b=TuQKU5Fx7pjirCWgcVw0xYOBStbx0sg+3LM6P6/BlgOOn9SfuytPpzLyS9VbX0W3CS HGNbCaf9fIPjObuDoNa5znNrJ+ATa1t7WAE/Iu1tuOd4imuMDEfYNy+GZE9HWc3SoSN1 I2HaXcxNRFF45GKs9UqGJv2zoJm9rxSsKccldsGUKJgHJs5UKn0IgIKkRuUl/D27ADL1 uiQf4cz7nDmV+c5azNi23IakudKgxD6Gx6qfqUnWUrjilX1gSrXWsJy+CH+oz0AYRPmX n0IMPtzrUAggJd8cGt2d/+hRphLTEZvHP3isLfpF9Na/qIryNROigimSlxUEsz67PUmx YaCA== X-Gm-Message-State: AOAM531JAruz7PXK5Dm6BOzLvCvhy5LhLgLpmD2LH/iCwkksQFFcqzGc IDHrmYzqhFKwEUbzvfQTHdjHLGwsL1LJ12IwWuYr/1WXEk4= X-Google-Smtp-Source: ABdhPJwFUig3uXEUnwv0ziPoHtdwWPXroyFYzPFOmQL4E8N2UYAiKYw2X+KfeTeMpl7T+LBAJWS7zqEXm/p7J1V1fLY= X-Received: by 2002:adf:ffc3:: with SMTP id x3mr9413103wrs.136.1628243427298; Fri, 06 Aug 2021 02:50:27 -0700 (PDT) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 From: "parv/freebsd" Date: Thu, 5 Aug 2021 23:49:50 -1000 Message-ID: Subject: ZFS delegation- zfs send| zfs recv fails for not being able to unmount dataset as regular user To: freebsd-stable@freebsd.org Content-Type: multipart/alternative; boundary="0000000000001790ae05c8e0f799" X-Rspamd-Queue-Id: 4Gh11c22swz3rZ7 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=OT1Af+z2; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of parv0zero9@gmail.com designates 2a00:1450:4864:20::429 as permitted sender) smtp.mailfrom=parv0zero9@gmail.com X-Spamd-Result: default: False [-2.00 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::429:from]; NEURAL_SPAM_SHORT(1.00)[0.999]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; TAGGED_FROM(0.00)[freebsd]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: Y --0000000000001790ae05c8e0f799 Content-Type: text/plain; charset="UTF-8" Hi there, How do I get around the the issue of normal user being unable to unmount the dataset ... # zfs send -R -v send-test/original@to-copy | zfs recv -F -d -v -s send-test-copy full send of send-test/original@to-copy estimated size is 51.1K total estimated size is 51.1K cannot unmount '/send-test-copy/original': permission denied warning: cannot send 'send-test/original@to-copy': Broken pipe ... so that the transfer would succeed? I am testing ZFS delegation on FreeBSD 13, with ... # zpool list | grep send-test send-test 48M 520K 47.5M - - 10% 1% 1.00x ONLINE - send-test-copy 48M 540K 47.5M - - 9% 1% 1.00x ONLINE - # zfs list -tall | grep send-test send-test 520K 23.5M 96K /send-test send-test-copy 540K 23.5M 96K /send-test-copy send-test-copy/original 96K 23.5M 96K /send-test-copy/original send-test/original 112K 23.5M 112K /send-test/original send-test/original@to-copy 0B - 112K - # zfs allow send-test-copy ---- Permissions on send-test-copy ----------------------------------- Local+Descendent permissions: user parv create,destroy,diff,hold,mount,promote,receive,release,send,snapshot # ll /send-test-copy total 10 drwxr-xr-x 3 parv parv uarch 3 20210805.1741 ./ drwxr-xr-x 25 root wheel uarch 31 20210805.1715 ../ drwxr-xr-x 2 parv parv uarch 2 20210805.1741 original/ - parv --0000000000001790ae05c8e0f799-- From nobody Fri Aug 6 15:52:52 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id BF6621346FD7 for ; Fri, 6 Aug 2021 15:53:01 +0000 (UTC) (envelope-from ali.abdallah@suse.com) Received: from smtp-out2.suse.de (smtp-out2.suse.de [195.135.220.29]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Gh93x0mKCz4mcs for ; Fri, 6 Aug 2021 15:53:01 +0000 (UTC) (envelope-from ali.abdallah@suse.com) Received: from imap2.suse-dmz.suse.de (imap2.suse-dmz.suse.de [192.168.254.74]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-521) server-digest SHA512) (No client certificate requested) by smtp-out2.suse.de (Postfix) with ESMTPS id 21CDA1FED2 for ; Fri, 6 Aug 2021 15:52:53 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.com; s=susede1; t=1628265173; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc: mime-version:mime-version:content-type:content-type; bh=QIX8drZLK1L9zbmY94N4vHZuaE+lUexUeHSuwK6A7w4=; b=oRQ3hVNrcsl+1OpsGbbCFXVK5sHnjiPZsRGfmtB5OaGG18e0KCoRxUpx+131v0Ebyt0w75 WfYQcHmexii1xa/nmIAlkwhGM5w5z0Vqs1f0y028QOkz5nheeKW/C4Yl2Cr3b/8luc/rxp wZda41XxRWkkrN02mC46zmSxcgsYguA= Received: from imap2.suse-dmz.suse.de (imap2.suse-dmz.suse.de [192.168.254.74]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-521) server-digest SHA512) (No client certificate requested) by imap2.suse-dmz.suse.de (Postfix) with ESMTPS id F2F3D13A8E for ; Fri, 6 Aug 2021 15:52:52 +0000 (UTC) Received: from dovecot-director2.suse.de ([192.168.254.65]) by imap2.suse-dmz.suse.de with ESMTPSA id Vzj2ONRaDWGYXQAAMHmgww (envelope-from ) for ; Fri, 06 Aug 2021 15:52:52 +0000 Date: Fri, 6 Aug 2021 17:52:52 +0200 To: freebsd-stable@freebsd.org Subject: Picasso AMD GPU freeze with the new g20210330 gpu firmwares Message-ID: <20210806155252.24riqjok4tw7kcx7@Fryzen495> List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="6z5clkxltcq7aofe" Content-Disposition: inline X-Rspamd-Queue-Id: 4Gh93x0mKCz4mcs X-Spamd-Bar: -------- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=suse.com header.s=susede1 header.b=oRQ3hVNr; dmarc=pass (policy=quarantine) header.from=suse.com; spf=pass (mx1.freebsd.org: domain of ali.abdallah@suse.com designates 195.135.220.29 as permitted sender) smtp.mailfrom=ali.abdallah@suse.com X-Spamd-Result: default: False [-8.30 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[suse.com:s=susede1]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_MED(-2.00)[suse.com:dkim]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+a:smtp-out2.suse.de]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; TO_DN_NONE(0.00)[]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[suse.com:+]; RCVD_IN_DNSWL_MED(-0.20)[195.135.220.29:from]; DMARC_POLICY_ALLOW(-0.50)[suse.com,quarantine]; NEURAL_HAM_SHORT(-1.00)[-0.999]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; MID_RHS_NOT_FQDN(0.50)[]; ASN(0.00)[asn:29298, ipnet:195.135.220.0/23, country:DE]; RCVD_TLS_ALL(0.00)[] Reply-To: ali.abdallah@suse.com From: Ali Abdallah via freebsd-stable X-Original-From: Ali Abdallah X-ThisMailContainsUnwantedMimeParts: N --6z5clkxltcq7aofe Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Hi, I recently switched my port tree from 2021Q2 to 2021Q3, after updating and rebooting my FreeBSD 13.0 system, I started to notice random system freeze, I can ssh to the frozen system, and from dmesg I see: --- Aug 4 08:58:51 Fryzen495 kernel: drmn0: [gfxhub0] retry page fault (src_id:0 ring:0 vmid:1 pasid:32769, for process pid 100349 thread pid 100349) Aug 4 08:58:51 Fryzen495 kernel: drmn0: in page starting at address 0x000080012c3f0000 from client 27 Aug 4 08:58:51 Fryzen495 kernel: drmn0: VM_L2_PROTECTION_FAULT_STATUS:0x00141051 Aug 4 08:58:51 Fryzen495 kernel: drmn0: MORE_FAULTS: 0x1 Aug 4 08:58:51 Fryzen495 kernel: drmn0: WALKER_ERROR: 0x0 Aug 4 08:58:51 Fryzen495 kernel: drmn0: PERMISSION_FAULTS: 0x5 Aug 4 08:58:51 Fryzen495 kernel: drmn0: MAPPING_ERROR: 0x0 Aug 4 08:58:51 Fryzen495 kernel: drmn0: RW: 0x1 --- The only thing seemed relevent for me between 2021Q2 and 2021Q3 is the newer GPU firmware g20210330 versus g20210224. I downgraged to g20210224, rebooted the system, and it is running stable as before. I found a similar issue here: https://githubmemory.com/repo/freebsd/drm-kmod/issues/78 But didn't try the mentioned work-around. My system is always connected to two external monitors using a USB-C dock, was running for almost 4 months without a reboot with the old firmwares. Shall I open a bug report? I hope this mail helps someone. Regards, Ali. --6z5clkxltcq7aofe Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEUaD0oMjPyY+ELqmouUVW+ByF0NUFAmENWtEACgkQuUVW+ByF 0NWj1g//fbY03zCyLfp0IYBgS6SnPuvN9RYEQFOfNLEwBkhvWv+aQ1ksROl/9wV4 aMR6uQUC4NYDZL0QNue51PeFidJdAtyZq1Nn4HU6cav3Vzf1GmuiZlQvQZVMzfRS OMhVVGg3+DOY1ozDaFz1pVHGz4P016+mHX9ftrbpFmFQcSSokdxrv9lv6nYO4ey/ YXQ9g+cqKA4uBim2CgEZuDrFzQkM5d74wLSlSwBayaMq+sFjChG+XPrLQimvWVPI xh70h/pfPm4jKbIHEDMUMz5UFD5HwpW8r+s+WkX79iSQWHIHcXjMN9CaQdEJf+eA 8PbE80TZnxYBS4gEklqv0q0qq6f8noYsRmjwgfhoH+OTHQCv73a3iiBqKod/9RvE /0AWO2P6A5e85Ean/6xcgoK9XFs3PSr+xShVKP2ZhMMNlDccd6aVYUzczhfeReRF seT5ZunK2jOEm5AUJng9ovl039tsRgxEs2TSZ/G3y+Inq8gWuxIyqtZJx90SOuGP DiJKpLayeplngfLNbVw+xSbe9yRmqueF++dOcWuilmcuZxnefOUUg/bLSO6PQzCH juSnqSdaajq/XPx4r2mNObjwkjxTKDNWt28z+v+NvWTJXtMNR05ohpKWPLCXolrQ ANTzbZ+NLIB5O8mpo1qjWFJPQ7iPWCJjHJryVFVJf5gSJfegkRA= =+NKs -----END PGP SIGNATURE----- --6z5clkxltcq7aofe-- From nobody Fri Aug 6 18:20:14 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 0435A10F8947 for ; Fri, 6 Aug 2021 18:20:26 +0000 (UTC) (envelope-from pi@freebsd.org) Received: from home.opsec.eu (home.opsec.eu [IPv6:2001:14f8:200::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4GhDL16h7Sz3DG2 for ; Fri, 6 Aug 2021 18:20:25 +0000 (UTC) (envelope-from pi@freebsd.org) Received: from pi by home.opsec.eu with local (Exim 4.94.2 (FreeBSD)) (envelope-from ) id 1mC4S6-000KIL-8r; Fri, 06 Aug 2021 20:20:14 +0200 Date: Fri, 6 Aug 2021 20:20:14 +0200 From: Kurt Jaeger To: ali.abdallah@suse.com Cc: freebsd-stable@freebsd.org Subject: Re: Picasso AMD GPU freeze with the new g20210330 gpu firmwares Message-ID: References: <20210806155252.24riqjok4tw7kcx7@Fryzen495> List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20210806155252.24riqjok4tw7kcx7@Fryzen495> X-Rspamd-Queue-Id: 4GhDL16h7Sz3DG2 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: N Hi! > I found a similar issue here: > > https://githubmemory.com/repo/freebsd/drm-kmod/issues/78 > > But didn't try the mentioned work-around. My system is always connected > to two external monitors using a USB-C dock, was running for almost 4 > months without a reboot with the old firmwares. > > Shall I open a bug report? I hope this mail helps someone. Yes, please open a bug report. The post helps, but adding a PR is helpful to track the issue. -- pi@opsec.eu +49 171 3101372 Now what ? From nobody Sat Aug 7 07:44:51 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 8862010FD0CF for ; Sat, 7 Aug 2021 07:45:33 +0000 (UTC) (envelope-from parv.0zero9@gmail.com) Received: from mail-wr1-x42e.google.com (mail-wr1-x42e.google.com [IPv6:2a00:1450:4864:20::42e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4GhZC137svz4nb2 for ; Sat, 7 Aug 2021 07:45:33 +0000 (UTC) (envelope-from parv.0zero9@gmail.com) Received: by mail-wr1-x42e.google.com with SMTP id d8so14038082wrm.4 for ; Sat, 07 Aug 2021 00:45:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=o5vrJ5XSEuXSrjTJWV305LoFCLeIsxEdset3wrdGD/I=; b=PGvn+Di39QYuhUlwbYOsaQBOtHI8akG6V49idFo8DWHFOmaQGDuXBwuRyaV0/AZRp3 JzqtuCrFkTY/DimhiLHBwxXeLNNqCIstQT0RoCTtTISyU3SR3XtA8gPbB3MMgfZhJyGB oqaDIbaPq7xJ2HO/GwtJmU2aVfgZOJzyxToIqR2shkgMHZQDWa42+NQk4VJ5p17kvk6f a9NCK9skI/nqSUTpTzbLKFRb1Tl+VKFipchIuk5lcBWDsEobiLBIIjIuNFea777Y41F4 0M7n38HW4KtRVS5papqOdk3uxbllGuNG+QZfbLiicdEqHcD55PrecFCpb4bkY2VzATQP C60g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=o5vrJ5XSEuXSrjTJWV305LoFCLeIsxEdset3wrdGD/I=; b=iY+lBu6zeJdblQK/zNLZzAtG447Beg0VVJXZm+lOJC6+00l11KXyCg7p7BfAA7bG78 HjnCdx4xLjAjGMF5al/fNGcn4gKsj4uRkxlF4zCCxbnbVtX+Xd2UrSuaO/oo6PqjWc1b TVuCut2dS9bx3SknCeT6W0yOieC732ckoT61DgMfjoyC644fxUrbA/6D5nYovY7n9Mqg mG8ONhRP0HsTlJ+N/DvZneHr6ME7PT8Pb8b2Amx0NANCh7Ezgq+dQL5Ls3w2zUorVkEm JTN5XHgd+/weUX/fbuVTVbr3hgRFgsN6iBkEgG6AoDesWs4D0zqNRKEj3z4nYgcKBiw2 XNag== X-Gm-Message-State: AOAM532VR5ra7Jpmi/HoRK7LLoBsXcvLNAEpEblypTaNikOO+Z9XqQ5k VINCamst1X8cboDrAu6wG5Y6h584AQgZlioTxQnpRYF6UME+UA== X-Google-Smtp-Source: ABdhPJwk8hmLi9pKXseJ6xb1k1Ae9a4dQVpo/qFAeJM8njjfKgLrIDJChCtrYzdngF2RB4ItqSuW/Lj6e1rOlm6GpVY= X-Received: by 2002:a5d:6948:: with SMTP id r8mr1683935wrw.136.1628322332443; Sat, 07 Aug 2021 00:45:32 -0700 (PDT) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: "parv/freebsd" Date: Fri, 6 Aug 2021 21:44:51 -1000 Message-ID: Subject: Re: ZFS delegation- zfs send| zfs recv fails for not being able to unmount dataset as regular user To: freebsd-stable@freebsd.org Content-Type: multipart/alternative; boundary="00000000000034866005c8f356f9" X-Rspamd-Queue-Id: 4GhZC137svz4nb2 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; TAGGED_FROM(0.00)[freebsd] X-ThisMailContainsUnwantedMimeParts: Y --00000000000034866005c8f356f9 Content-Type: text/plain; charset="UTF-8" On Thu, Aug 5, 2021 at 11:49 PM parv/freebsd wrote: > How do I get around the the issue of normal user being unable to unmount > the dataset ... > > # zfs send -R -v send-test/original@to-copy | zfs recv -F -d -v -s send-test-copy > full send of send-test/original@to-copy estimated size is 51.1K > total estimated size is 51.1K > cannot unmount '/send-test-copy/original': permission denied > warning: cannot send 'send-test/original@to-copy': Broken pipe > > ... so that the transfer would succeed? > > After posting this, a thought had occurred to me that I might need to set some MIB to allow non-root user to perform (un)mount. Found the reason (vfs.usermount MIB was 0) & the solution (set the MIB to 1) myself. zfs-allow(8) manual page need to have a pointer to the above MIB. - parv > I am testing ZFS delegation on FreeBSD 13, with > > ... > # zfs allow send-test-copy > ---- Permissions on send-test-copy ----------------------------------- > Local+Descendent permissions: > user parv create,destroy,diff,hold,mount,promote,receive,release,send,snapshot > > # ll /send-test-copy > total 10 > drwxr-xr-x 3 parv parv uarch 3 20210805.1741 ./ > drwxr-xr-x 25 root wheel uarch 31 20210805.1715 ../ > drwxr-xr-x 2 parv parv uarch 2 20210805.1741 original/ > > -- --00000000000034866005c8f356f9--