From owner-freebsd-hackers@freebsd.org Mon Nov 30 02:23:56 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id BF50C46C884 for ; Mon, 30 Nov 2020 02:23:56 +0000 (UTC) (envelope-from Keith.Owens2@dell.com) Received: from mx0b-00154904.pphosted.com (mx0b-00154904.pphosted.com [148.163.137.20]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CkpvH5YWdz4Rvm for ; Mon, 30 Nov 2020 02:23:55 +0000 (UTC) (envelope-from Keith.Owens2@dell.com) Received: from pps.filterd (m0170398.ppops.net [127.0.0.1]) by mx0b-00154904.pphosted.com (8.16.0.42/8.16.0.42) with SMTP id 0AU2ISkj011966 for ; Sun, 29 Nov 2020 21:23:53 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dell.com; h=from : to : subject : date : message-id : content-type : mime-version; s=smtpout1; bh=0iiI4Nw+NCQAhoTrukNct7zFbbLVDjTNAKhJSbpUhFc=; b=EfW8q+FnlPKGbOKlUPq5SOdh7y5HSZVq1xVniSXU0FRr0/Zoq/OyfQMFP0YLv8saRX2A XDiAnhO9/h2u6wwFMhmVyIbkJG7mXZ64BZgTWBbyf14h3Cy1R4NNywqm72nSyZGLCAqb SMU8oVUwSoEpKmfprl1eLj7QDQFr3oq12y642K8WPWFOsgWChFlCDkf1NsLE/vV6/1kK IDgmsmzZfUtrL/35k6Ht0W5SFGwBaP0RpEHpgk9iHwtS+MVc2+q6c7NZc77YCmQcXRHx 2IW379wWoQ4COgQshCVz9E6o0uD67Q6OWClWHHxei8taD5TeZqeGl/f6GJ40W9q6isuJ sw== Received: from mx0a-00154901.pphosted.com (mx0a-00154901.pphosted.com [67.231.149.39]) by mx0b-00154904.pphosted.com with ESMTP id 353jndbga9-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Sun, 29 Nov 2020 21:23:53 -0500 Received: from pps.filterd (m0142693.ppops.net [127.0.0.1]) by mx0a-00154901.pphosted.com (8.16.0.42/8.16.0.42) with SMTP id 0AU2LZU3167362 for ; Sun, 29 Nov 2020 21:23:52 -0500 Received: from nam02-sn1-obe.outbound.protection.outlook.com (mail-sn1nam02lp2052.outbound.protection.outlook.com [104.47.36.52]) by mx0a-00154901.pphosted.com with ESMTP id 354500svge-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK) for ; Sun, 29 Nov 2020 21:23:52 -0500 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=fLOeb+uwS32mzX8VrnkqCPOahqF2peUBG4eayRnrx7cPXIyjqS7FZK/F+qY4jgET4EArzBVPQFrC2bO6kz9wxVY8/kPBiUUQt3n7Y7l+snJ48JIc8tgnQ60C2gGHYa/putz+2ZcX7y/VQ7OMdkmydz7Ery8a1TS5nIFx6wIJ38AGaoTH2yd6y2juMgkf1SJaWJY2xniRLFufyVXPWXQpvo8I8z3thKEMBu8itVXupsbQmyFMZ7y4+iBCNHR1aHZCexl939TzSCVcYxbHJotQWexJi1J7d2I+//UGtx5SNXfKcAQvgn7l99PlRbfYvAiUDuvOoVTvx+H5cyRtOpsiXQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=0iiI4Nw+NCQAhoTrukNct7zFbbLVDjTNAKhJSbpUhFc=; b=HfSTEFMRLhgGJ6DjetEnu9mn6S/4wHFchLxWkpGh7TmjkkqfQyYPyAyvaWt4EXd35wCB7t5EGtl+8Jmrl+SZULJYsrlRc7T9s1JNU2wW/x7hEhmLvfmo5DrUAYXM0rbvFWbRodiUouMOay+9QXVa0zRZNtGkcs3kymhzPaGOcmuE7robmUUNamJxU1V1z5nhmIkBC5gEujr0HKPT9ylJ8AQlNcP+sEJC70x6PvkhEDnDkFE1b6dxNs+vGraO02UYIUoPMsaXfjXJCDMqU4ztv61Jx6SvGOQvOeiBJTRxJr2j7FMJm6TElbjPdgas15iF7p8++MoQlahE/uQAWiadGw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=dell.com; dmarc=pass action=none header.from=dell.com; dkim=pass header.d=dell.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Dell.onmicrosoft.com; s=selector1-Dell-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=0iiI4Nw+NCQAhoTrukNct7zFbbLVDjTNAKhJSbpUhFc=; b=LevAdqmXTzvZj8WwP2rsPHmViSPt/71W1RmQn5HERPBrxTPLnjmKHshGX3uYS8sksaAjQny8WavB044yPd+QRRxNWx27ayUYyJ/HqGMGVV/WOQi0yAULANP7+TOVf9//NzwQcLRshAiJi/LJm0sbk59ZWUfqREay8Nm/K5JfFPA= Received: from BLAPR19MB4257.namprd19.prod.outlook.com (2603:10b6:208:27b::10) by MN2PR19MB4144.namprd19.prod.outlook.com (2603:10b6:208:18b::16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3611.25; Mon, 30 Nov 2020 02:23:49 +0000 Received: from BLAPR19MB4257.namprd19.prod.outlook.com ([fe80::f4a6:1cfa:dd4e:bf8e]) by BLAPR19MB4257.namprd19.prod.outlook.com ([fe80::f4a6:1cfa:dd4e:bf8e%8]) with mapi id 15.20.3611.031; Mon, 30 Nov 2020 02:23:49 +0000 From: "Owens, Keith" To: FreeBSD Hackers Subject: VM changes for NUMA - design doc? Thread-Topic: VM changes for NUMA - design doc? Thread-Index: AQHWxr8SWPOOGb6jM0GV/Sz3KdYDQw== Date: Mon, 30 Nov 2020 02:23:48 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [45.10.233.44] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 5811bbd8-ed86-492d-60a2-08d894d6f8c8 x-ms-traffictypediagnostic: MN2PR19MB4144: x-microsoft-antispam-prvs: x-exotenant: 2khUwGVqB6N9v58KS13ncyUmMJd8q4 x-ms-oob-tlc-oobclassifiers: OLM:8273; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: oQLJLWz6bcPJ62qWxZuModEQNk1aw0B9BbUu1rBZCDAOe1Pq8YP2jHD6kC5XCC8LZb4dlpfsA3pjaObKEPxz6fUQ21BRkfqFXMlM3boP79keZRzf9feh50bGCJQgeYJX/GWkKWW+Xi8DIG817x3j0gFpxTRfSZHg+ic7FSg3eQdh4jnxl6uRyhJ7pfO9Z3ZBa4+ZnV6YS6H262mWcHRa6T2dX5sZRR7ZokwDXUDXVZAJheEqVFVlpZxhm+oo+Z1SH7WrmTXo5dWtnZhmUI2Cid6VQ1tuukWCtgDu879E0VJGJ/nsAG+ik7nLteQa1NSQfeZISAj3iTu9FymnbG14tlBP5+n0A1Aq2RQVnrDTB0RrMJkRTOzcnxcu/ehAxEguMKhpa3gm0wUJ3urrzZs9YQ== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:BLAPR19MB4257.namprd19.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(396003)(136003)(346002)(39860400002)(376002)(366004)(55016002)(6916009)(966005)(52536014)(478600001)(5660300002)(26005)(7696005)(4744005)(6506007)(186003)(21615005)(8676002)(9686003)(15974865002)(19627405001)(33656002)(2906002)(8936002)(166002)(316002)(66446008)(86362001)(66946007)(76116006)(64756008)(91956017)(66476007)(66556008)(71200400001)(786003); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata: =?iso-8859-1?Q?EljII1tbGeRim4xV33V5v9MkafdysXIH8TaTZO5UWJbhYCSwcxYZ5TOQTh?= =?iso-8859-1?Q?sMfdD2cRS7WeSYU4IWVwDtxatDzkeLbqTXe0GovZI5k2gArEVeX5HcQdzM?= =?iso-8859-1?Q?wnLkOL0RHFrFdxIm+RxAYSlUCZ06AXLghx+QV0JHb+ZwyDE/uqT1BWCemF?= =?iso-8859-1?Q?gMf7vTf9RjOTf4ujZKA4WwfAZJT14uKrHfl3PwPDKmWqlNFOxxiYRtfRaA?= =?iso-8859-1?Q?W2ZOGnh2FeWIDB0EH8Liyq+NPfI9F/MwsMwvE8rydIOlgTIUODK44rx/qo?= =?iso-8859-1?Q?HfKvGT6FKfXR6EWJFU5zQ80+Q+eEa/DRgQyF6TcAppu2DKbsILVDBca6TH?= =?iso-8859-1?Q?ULtLR7T2o6gOgh1tHDjSvsSZiCK9DFF+a2Malm85c+vNyDwwyIb4PM3IXt?= =?iso-8859-1?Q?ejYsYy/6U0PfCfpMbX0yUZtP29pcH8VJJQuael7V2Nj+gEcUtnkhetr4nK?= =?iso-8859-1?Q?LXKwUySN6rVFw5qdvZn+kMW4/QpADQMph/sV8tVnn7iWIN3DlbHFCZmmWW?= =?iso-8859-1?Q?4mbj++QM0zE/m2mTY0dBueO5EqZitoD0+O6daBQhKlmW2z4Cm0C79NoUGO?= =?iso-8859-1?Q?dnBs64Cv9fx3OEH95eOwRloKRrdegPfxBbJlyxv2/9o50dArDeTj2bOjRZ?= =?iso-8859-1?Q?LT5KZrMKQ4q8nQrt2W6NV397JuJyGxwCs8j5/3sKNh5HWAvRbEm6tTOJLL?= =?iso-8859-1?Q?i5nPamO/H/v7Pm8Np8sPKdiIs6HDGEbRaGkymLyK2lPTrGXYe6JWzeE9zm?= =?iso-8859-1?Q?lv5zpHodOd9oUKQEMOc/OV3VPeq/AbnSyOjG7Y3iI7XQI3TxoZkvN76/Ak?= =?iso-8859-1?Q?EpGybpwAIjSlMiHA5bPJs4yhc/phY/MZVx4Myxnbx+mhajjB0TKRl6veIY?= =?iso-8859-1?Q?ZpOMQEnKglezsufh7Ri06t4KAtUeTBZx6E2KfUs7VfK6Uumf1unOBOU8ns?= =?iso-8859-1?Q?j90OYp/wu+ag/a2zLmlVtS0DVReyuwG6b+5LmvAUAAGiaxnrboorbOF+sd?= =?iso-8859-1?Q?x08ggApbi4vUnxp9k=3D?= x-ms-exchange-transport-forked: True MIME-Version: 1.0 X-OriginatorOrg: Dell.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: BLAPR19MB4257.namprd19.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 5811bbd8-ed86-492d-60a2-08d894d6f8c8 X-MS-Exchange-CrossTenant-originalarrivaltime: 30 Nov 2020 02:23:48.9643 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 945c199a-83a2-4e80-9f8c-5a91be5752dd X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: gjqASR+YkI4JBwFGDqu1lUPrQeNNw7RVn2gdrs6Yxa4QwKMPJ5U2Oi2/Pt3N2xZSDcodcl8xbGMDT+Lhdf7cgg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN2PR19MB4144 X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.312, 18.0.737 definitions=2020-11-29_12:2020-11-26, 2020-11-29 signatures=0 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 phishscore=0 mlxscore=0 bulkscore=0 suspectscore=0 spamscore=0 priorityscore=1501 clxscore=1011 adultscore=0 impostorscore=0 lowpriorityscore=0 mlxlogscore=743 malwarescore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2009150000 definitions=main-2011300012 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 suspectscore=0 mlxscore=0 mlxlogscore=847 bulkscore=0 adultscore=0 malwarescore=0 spamscore=0 phishscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2009150000 definitions=main-2011300012 X-Rspamd-Queue-Id: 4CkpvH5YWdz4Rvm X-Spamd-Bar: -------- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=dell.com header.s=smtpout1 header.b=EfW8q+Fn; dkim=pass header.d=Dell.onmicrosoft.com header.s=selector1-Dell-onmicrosoft-com header.b=LevAdqmX; arc=pass (microsoft.com:s=arcselector9901:i=1); dmarc=pass (policy=none) header.from=dell.com; spf=pass (mx1.freebsd.org: domain of Keith.Owens2@dell.com designates 148.163.137.20 as permitted sender) smtp.mailfrom=Keith.Owens2@dell.com X-Spamd-Result: default: False [-8.10 / 15.00]; HAS_XOIP(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:148.163.137.20]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[dell.com:+,Dell.onmicrosoft.com:+]; DMARC_POLICY_ALLOW(-0.50)[dell.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_IN_DNSWL_LOW(-0.10)[148.163.137.20:from]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RBL_DBL_DONT_QUERY_IPS(0.00)[148.163.137.20:from]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:22843, ipnet:148.163.137.0/24, country:US]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[dell.com:s=smtpout1,Dell.onmicrosoft.com:s=selector1-Dell-onmicrosoft-com]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; RCPT_COUNT_ONE(0.00)[1]; DWL_DNSWL_LOW(-1.00)[dell.com:dkim]; SPAMHAUS_ZRD(0.00)[148.163.137.20:from:127.0.2.255]; WHITELIST_SPF_DKIM(-3.00)[dell.com:d:+,dell.com:s:+]; RWL_MAILSPIKE_POSSIBLE(0.00)[148.163.137.20:from]; RCVD_COUNT_SEVEN(0.00)[7]; MAILMAN_DEST(0.00)[freebsd-hackers] Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 30 Nov 2020 02:23:56 -0000 Is there a document that describes the current VM logic? In particular, the= delayed invalidation page queues and the changes that were introduced for = NUMA. I'm looking for something at the level of https://www.freebsd.org/doc= /en_US.ISO8859-1/books/arch-handbook/vm.html, but more up to date. The sour= ce code comments help, but I'm hoping for an overarching design document. Chapter 7. Virtual Memory System - FreeBSD Physical memory is managed on a page-by-page basis through the vm_page_t st= ructure. Pages of physical memory are categorized through the placement of = their respective vm_page_t structures on one of several paging queues. A pa= ge can be in a wired, active, inactive, cache, or free state. www.freebsd.org