From owner-freebsd-current@freebsd.org Fri Apr 9 22:33:25 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 63B015C08C3 for ; Fri, 9 Apr 2021 22:33:25 +0000 (UTC) (envelope-from weiss@uni-mainz.de) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4FHCZs0j8wz4jNM for ; Fri, 9 Apr 2021 22:33:25 +0000 (UTC) (envelope-from weiss@uni-mainz.de) Received: by mailman.nyi.freebsd.org (Postfix) id 15E7E5C09D2; Fri, 9 Apr 2021 22:33:25 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1596F5C0B3B; Fri, 9 Apr 2021 22:33:25 +0000 (UTC) (envelope-from weiss@uni-mainz.de) Received: from ironport-1.zdv.net (ironport-1.zdv.net [IPv6:2001:4c80:40:62d::25:1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "ironport.zdv.net", Issuer "DFN-Verein Global Issuing CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FHCZq4RZsz4jVS; Fri, 9 Apr 2021 22:33:23 +0000 (UTC) (envelope-from weiss@uni-mainz.de) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uni-mainz.de; l=1024; q=dns/txt; s=20190702; t=1618007604; x=1649543604; h=from:to:cc:subject:date:message-id:references: in-reply-to:content-transfer-encoding:mime-version; bh=tikhteOhmw7UOLVCovcwkbmVPgcES3ZJmp5HIp5SLdw=; b=QrpZwHN9nl1QBD+KF4BnnUbaTOkggzD5XLM/l/wguUfFNpxbNPYfHq2p Vosgfr0eMkNMTkobvCUs2ArkXCJQ1puLlYxA9o8tt5591mBpCDySubwDd CR0ZHvG6+ic2IbBj7K839KojibhvenklfDGT3w/3K6DNMszNTP+Bzm7p1 kzuelcdE3JEIua0BGcpIpDUuTaiXVArE99KWMX6xGBZ6HH0lZfb41cA4Z JqHozUIbogFLZ2hBlpZihhyyhyPRs8Z+HSPnv79OBOgS7qfWRxqhsYLrr H3n1Jr1JPED1wJ1qW8MLw07PFt64W+I1jThnOvLtea062lFXOP0L90T1g w==; IronPort-SDR: FdpXM7Wkr1xxNgaO0rJQXHHXXjhXv1VLermv1ImWBiLR6p+iSrWmpel93yvgm49+d0arWlQjP0 jGLoQIESTLQTnE4l4+BcDuCSHxRUV6j6Kgkp+nqxBh9a09w74/pLU7EKhZOkvZLCmWEQr6H9sY lmYuXXlxR3oIIulAPvIfF8PLFuVxHCJi3wdluJArl7KrsHp70205XshJedis+iz4ZoMdmMET0y mZo8Pt2kpQWY292KiNLDfZhPPIermATroHIeff2xw+KWQAdYE0w9p0YkdeQiQP+ERE3AnMAUAe bRU= X-IPAS-Result: =?us-ascii?q?A+BZAAA21XBg/yNDQv2I5vSMBonQjrd/j/Gu+TBaGgEBA?= =?us-ascii?q?QEBAQEBAQEDAQEBARIBAQEBAgIBAQEBQIFSgVNqAWRZaAqWEAOafYFfCQsBA?= =?us-ascii?q?QEOAR0LCgIEAQGEDEQCgXgBJTgTAgMBAQEDAgMBAQEBAQEFAQEBAQEBBQMBA?= =?us-ascii?q?YEDhRc5DYI4BQIDHwEGg1wBAQEBAwEBTCALDAQCAQgRBAEBARUZJwEJAR0IA?= =?us-ascii?q?gQBBwYBBAEHFQSCUYMHAQ6rIXWBNIEBhFiFDAaBOQGGb4Jpg3QnFgaCC4Q1P?= =?us-ascii?q?oJgAQMBF38lAQFfhTgEgkAGPjVIVAMBAyoTAVo+kSCMa5tvgRQHgXOBG4lji?= =?us-ascii?q?3qHFiyUJZBMlRWLapIuLIRlAgQCBAUCFoFrgXxxFDuCaVAXAg6XI4VFQzACD?= =?us-ascii?q?ycCBgoBAQMJfIoqXAGBDgEB?= IronPort-PHdr: A9a23:xIpAjB0EUiOI5L7EsmDOvwIyDhhPgJ3EezUN459isYplN5qZl7zcN UDSrc9gkEXOFd2Cra4d2qyP4/mrADJeqb+681k6OKRWUBEEjchE1ycBO+WiTXPBEfjxciYhF 95DXlI2t1uyMExSBdqsLwaK+i764jEdAAjwOhRoLerpBIHSk9631+ev8JHPfglEnjWwba52I RmssAnctdQajYR/JqswyxbCv2dFdflRyW50P1yYggzy5t23/J5t8iRQv+wu+stdWqjkfKo2U KJVAi0+P286+MPkux/DTRCS5nQHSWUZjgBIAwne4x7kWJr6rzb3ufB82CmeOs32UKw0VDG/5 KplVBPklCEKPCMi/WrJlsJ/kr5UoBO5pxx+3YHUZp2VNOFjda/ZZN8WWHZNUtpUWyFHH4iyb ZYAD/AZMOhYsYfzukcOoxW9CwmiBuzvyyNHiHD50qAhz+QhCAPG0BA8E94SrXjZqsj+OqcIU eCyyanF1TXMYO1X2TD98ITHah4voeuWUb1odcTJ1VMvFwzbgVWWtIfoOD2U2foMs2iA9OptT v+vi2gmqw1opzig3MYsio/Ih44P11/L6zx0zYAoLtK3VEB1e8SrEIdMty6ELYt2RNsvTm5mt Som1rELu522cSwLxZkowxPSZf6KfpWJ7x7/VuucPyp1iGxkdbywhhu/80eux/D/W8Wo0FtHq i5In8XMu30Lyhfd5M+HSv5n8Ueg3zaCzw7T6vtaLk8qjqXbMIMuzqQ3lpoJvkTOGDL9lkbuj KKOeEUr5+el5/rib7jpqJKQKYF5hwT9P6syh8OwHOE1PwkSU2Wa/Omx0Kfs8VH3TbhPivA5i afZsJ7fKMQVuKG1HRRa34M45BmjFDiqzMwUkWQJIV9KYh6Ki4bkN0vTLP36D/qzmVShnTNty vvbJLPuGI/NIWLGkLr5eLZ97FNTxxQrwNBE4pJUFqkBIPXuWk/trNDYDgE2Mwizw+v/Ftp82 Z4SVX+SDqOEKa/StESI6v8gI+WVeoMYuSzxKvk46P7wl3M2l1kdfaiw0ZUQcn+4H/JmIkSDb XTijdkNCWYKvgwgQ+z2kFCCXyNcanmsU6856Tw2BpyqAInGS42unLOOwTq0E5hXa2xaC12BF HPleJ+YV/oCbS+fJtRukjIKVbWkRY8uyw+iuxT/xrV8MuXb4TEUuYrm1Ndv5u3TkR8y9SZzD 8SYy2yMQX97nmITRz8tx61/vEp9ylaa3ah9mfNYFNpT5vJTXggnK5HQ1/Z6BMzqWgLdYteJT 06rQtC8DjErTdIxwcQDY0hnG9q8kB/MxDGqDKIPm7yMHpw0/brW32LtKMZl13bGyK4hgkE8T ctROm2rnaB/9xLNCIHXiEqZjLuleb4b3C7X+2eJ1XCOs11AUA5sTaXFWmgSZlDKrdvj/UzCS 6GhBK8pMgtb18GNNLBFasb0gllcQ/fjItveaXqrm2isHRaI2q+MbI3ydmoBwSXdElIEnB4V/ XaaLgU+CD2hrHzAAzN1DlLgflng8e5kqHO0HQcJyRqXZRhhy6at4UxSwvaBROhV0KgJtS06p 3NzBln61c/ZGduEowMmZ6VbfuQ3/VgB3m3Y4A1xa8b9dPoy3w0jdR9qtX/jxwkiCplcidN46 zQg0QVpb6yC3V5LbD/e2or/fbfKJXvz+BSmLLXW3U7p2suZvKwA6aM5pwC54VrzRhNxz3Iyn PxcyXjUxJLKChEOVpS+GhIy/gJ5pZnUeCQw7ZjYk3p2Pv/w+hbE18goFaMKww6neZ8LOb2LP AHoHsAQHMToL/YlzQuHdBUBad9f9RlwCO+8McykTLSkMeAoyC2rjH9cyJ170weJ/it6WKjE0 sBWkLmjwgKbWmKk3x+aucftlNUBPGlKdlc= IronPort-HdrOrdr: A9a23:ncUDPK/K2TUwICHDi+Buk+HQdb1zdoIgy1knxilNYDReeMCAio SKlPMUyRf7hF8qKRYdsPqrUZPufVr385lp7Y4NeZKrWwf7sGWlRbsSi7fK6TvmBiH466phzq 9maadzE5ndClJ9gMb87mCDYqsd6fOA972lgvqb8md1QWhRGttdxipwFwrzKDwUeCBoHpw8fa Dw2uNmoH6adW0TfoCHABA+Loz+jvnqsL6jXhIcHR4g72C1/E+VwZr3CQKR0Btbcx4n+8ZBzU H/nwb05rquvpiAo3e2vVP71JhYlMDszdFOHqW3+60oAw/xgQWlbpkJYdO/lQ01u+2m5RILl9 TBsn4bX/hb1nLLcmm55SbqwgnruQxO11bezzaj7UfLkIjcfnYaA9AErZ9FehHZgnBQxe1U4e Zu5SalkLZ5STnHhz/w4tDUUQoCrDvNnVMy1egJj3JeVoMCaLhe6YwHlXkla6s9IA== X-IronPort-Anti-Spam-Filtered: true X-IronPort-AV: E=Sophos;i="5.82,210,1613430000"; d="scan'208";a="119449258" Received: from ex1111-ms1g-26.zdv.uni-mainz.de ([IPv6:fd42:4323:8cdd:606:9a03:9bff:fe2b:bcb0]) by ironport-1.zdv.net with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 10 Apr 2021 00:33:15 +0200 Received: from ex1341-ms5h-26.zdv.uni-mainz.de (fd42:4323:8cdd:606:9a03:9bff:fe2b:bbe4) by ex1111-ms1g-26.zdv.Uni-Mainz.DE (fd42:4323:8cdd:606:9a03:9bff:fe2b:bcb0) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.858.5; Sat, 10 Apr 2021 00:33:14 +0200 Received: from ex1341-ms5h-26.zdv.uni-mainz.de ([fe80::9a03:9bff:fe2b:bbe4]) by ex1341-ms5h-26.zdv.Uni-Mainz.DE ([fe80::9a03:9bff:fe2b:bbe4%11]) with mapi id 15.02.0858.002; Sat, 10 Apr 2021 00:33:14 +0200 From: =?iso-8859-1?Q?Wei=DF=2C_Dr=2E_J=FCrgen?= To: 'Mark Johnston' , Andriy Gapon CC: freebsd-stable List , FreeBSD Current Subject: RE: stable/13, vm page counts do not add up Thread-Topic: stable/13, vm page counts do not add up Thread-Index: AQHXK+ZXb6tUCqLU/kmkMO25PgBdQ6qpVl6AgAAH04CAAAmJgIADAg5w Date: Fri, 9 Apr 2021 22:33:14 +0000 Message-ID: <0ee7dc3d7bc7443b9ae60a833835caed@uni-mainz.de> References: <0606571f-fec0-c7ad-98e8-a0b8554918e2@FreeBSD.org> In-Reply-To: Accept-Language: de-DE, en-US Content-Language: de-DE X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [134.93.177.59] Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Rspamd-Queue-Id: 4FHCZq4RZsz4jVS X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uni-mainz.de header.s=20190702 header.b=QrpZwHN9; dmarc=pass (policy=none) header.from=uni-mainz.de; spf=pass (mx1.freebsd.org: domain of weiss@uni-mainz.de designates 2001:4c80:40:62d::25:1 as permitted sender) smtp.mailfrom=weiss@uni-mainz.de X-Spamd-Result: default: False [-4.23 / 15.00]; MID_RHS_MATCH_FROM(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2001:4c80:40:62d::25:1:from]; R_DKIM_ALLOW(-0.20)[uni-mainz.de:s=20190702]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; ARC_NA(0.00)[]; SPAMHAUS_ZRD(0.00)[2001:4c80:40:62d::25:1:from:127.0.2.255]; RCVD_COUNT_THREE(0.00)[4]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[uni-mainz.de:+]; DMARC_POLICY_ALLOW(-0.50)[uni-mainz.de,none]; DWL_DNSWL_LOW(-1.00)[uni-mainz.de:dkim]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; R_MIXED_CHARSET(0.77)[subject]; ASN(0.00)[asn:2857, ipnet:2001:4c80::/32, country:DE]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[stable,current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 09 Apr 2021 22:33:25 -0000 > -----Original Message----- > From: owner-freebsd-current@freebsd.org current@freebsd.org> On Behalf Of Mark Johnston > Sent: Wednesday, April 7, 2021 10:57 PM > To: Andriy Gapon > Cc: freebsd-stable List ; FreeBSD Current > > Subject: Re: stable/13, vm page counts do not add up >=20 > On Wed, Apr 07, 2021 at 11:22:41PM +0300, Andriy Gapon wrote: > > On 07/04/2021 22:54, Mark Johnston wrote: > > > On Wed, Apr 07, 2021 at 10:42:57PM +0300, Andriy Gapon wrote: > > >> > > >> I regularly see that the top's memory line does not add up (and by a= lot). > > >> That can be seen with vm.stats as well. > > >> > > >> For example: > > >> $ sysctl vm.stats | fgrep count > > >> vm.stats.vm.v_cache_count: 0 > > >> vm.stats.vm.v_user_wire_count: 3231 > > >> vm.stats.vm.v_laundry_count: 262058 > > >> vm.stats.vm.v_inactive_count: 3054178 > > >> vm.stats.vm.v_active_count: 621131 > > >> vm.stats.vm.v_wire_count: 1871176 > > >> vm.stats.vm.v_free_count: 187777 > > >> vm.stats.vm.v_page_count: 8134982 > > >> > > >> $ bc > > >>>>> 187777 + 1871176 + 621131 + 3054178 + 262058 > > >> 5996320 > > >>>>> 8134982 - 5996320 > > >> 2138662 > > >> > > >> As you can see, it's not a small number of pages either. > > >> Approximately 2 million pages, 8 gigabytes or 25% of the whole memor= y > on this > > >> system. > > >> > > >> This is 47c00a9835926e96, 13.0-STABLE amd64. > > >> I do not think that I saw anything like that when I used (much) olde= r > FreeBSD. > > > > > > One relevant change is that vm_page_wire() no longer removes pages > from > > > LRU queues, so the count of pages in the queues can include wired > pages. > > > If the page daemon runs, it will dequeue any wired pages that are > > > encountered. > > > > Maybe I misunderstand how that works, but I would expect that the sum > of all > > counters could be greater than v_page_count at times. But in my case i= t's > less. >=20 > I misread, sorry. You're right, what I described would cause double > counting. >=20 > I don't know what might be causing it then. It could be a page leak. > The kernel allocates wired pages without adjusting the v_wire_count > counter in some cases, but the ones I know about happen at boot and > should not account for such a large disparity. I do not see it on a few > systems that I have access to. >=20 > > > This was done to reduce queue lock contention, operations like > > > sendfile() which transiently wire pages would otherwise trigger two > > > queue operations per page. Now that queue operations are batched thi= s > > > might not be as important. > > > > > > We could perhaps add a new flavour of vm_page_wire() which is not laz= y > > > and would be suited for e.g., the buffer cache. What is the primary > > > source of wired pages in this case? > > > > It should be ZFS, I guess. > > > > -- > > Andriy Gapon > _______________________________________________ > freebsd-current@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current- > unsubscribe@freebsd.org" I see kernel memory disappearing, when enabling ktls: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D253281 Last test done with 13.0-RC1.=20 I'm a bit at a loss how to debug this further. Regards=20 Juergen Weiss Juergen Weiss | weiss@uni-mainz.de |