From owner-freebsd-arch@FreeBSD.ORG Wed Oct 8 19:07:24 2014 Return-Path: Delivered-To: freebsd-arch@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4EEA791E for ; Wed, 8 Oct 2014 19:07:24 +0000 (UTC) Received: from mail-pd0-f170.google.com (mail-pd0-f170.google.com [209.85.192.170]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1D0E0C54 for ; Wed, 8 Oct 2014 19:07:23 +0000 (UTC) Received: by mail-pd0-f170.google.com with SMTP id p10so7367934pdj.1 for ; Wed, 08 Oct 2014 12:07:17 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:sender:content-type:mime-version:subject:from :in-reply-to:date:cc:message-id:references:to; bh=RY8PO0ce52ozOn2FgkMJmj6Gu40bax+XXpH4wN6m0Vg=; b=f6FpnwLUX+RqI6GR3u5Ezz6TOtQSGuX8QgvcY3cQGb3+R/BFAIaU5hc0wyA3gX+DN6 vxGE7rqtP3P5IvGHXIJSXKFZRUlCB6sRyEXDTT5O7w5T07b/JmGFJpknZc64GfTUChpG BOcMiPsbngpXZYGiNYIDrkjLSblNcm5OxnqvKYIFUVfbYS2ZhslgNkfQV7WcmtY1/8SA YvJwPNCa5ixX4TjNrETq5z3uzAJU2u0T2OqKwAYct5YQIUBOw33sIKywfXI2CbreMN2a ZOUtzAd3Tbwa9qVkG/BY4wNuENjlctq3duURvLoPTglcwDXKW6DdqXdI6spEijQXPOtN Zvdw== X-Gm-Message-State: ALoCoQn/5wkxPAa6JMkAxEUdtzuLCq6luQBcrajC2WyD+9rRsw5ajFSjaJzvvFi//992L2J/5hVH X-Received: by 10.70.37.208 with SMTP id a16mr11865917pdk.147.1412795228090; Wed, 08 Oct 2014 12:07:08 -0700 (PDT) Received: from [10.64.26.130] (dc1-prod.netflix.com. [69.53.236.251]) by mx.google.com with ESMTPSA id bz2sm722822pdb.17.2014.10.08.12.07.06 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Wed, 08 Oct 2014 12:07:07 -0700 (PDT) Sender: Warner Losh Content-Type: multipart/signed; boundary="Apple-Mail=_0F6CDCAF-3099-46DA-840A-D9195A00B846"; protocol="application/pgp-signature"; micalg=pgp-sha512 Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: [rfc] enumerating device / bus domain information From: Warner Losh In-Reply-To: Date: Wed, 8 Oct 2014 13:07:04 -0600 Message-Id: <2975E3D3-0335-4739-9242-5733CCEE726C@bsdimp.com> References: To: Adrian Chadd X-Mailer: Apple Mail (2.1878.6) Cc: "freebsd-arch@freebsd.org" X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Oct 2014 19:07:24 -0000 --Apple-Mail=_0F6CDCAF-3099-46DA-840A-D9195A00B846 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=windows-1252 On Oct 7, 2014, at 7:37 PM, Adrian Chadd wrote: > Hi, >=20 > Right now we're not enumerating any NUMA domain information about = devices. >=20 > The more recent intel NUMA stuff has some extra affinity information > for devices that (eventually) will allow us to bind kernel/user > threads and/or memory allocation to devices to keep access local. > There's a penalty for DMAing in/out of remote memory, so we'll want to > figure out what counts as "Local" for memory allocation and perhaps > constrain the CPU set that worker threads for a device run on. >=20 > This patch adds a few things: >=20 > * it adds a bus_if.m method for fetching the VM domain ID of a given > device; or ENOENT if it's not in a VM domain; Maybe a default VM domain. All devices are in VM domains :) By default today, we have only one VM domain, and that=92s the model that most of = the code expects=85 Warner > * it adds some hooks to print the numa-domain out of a device if it = exists; > * it adds hooks in srat.c to store the original proximity-id values > and uses them to map PXM to FreeBSD VM domain IDs; > * the ACPI code now has bus methods to enumerate which PXM (and thus > which VM domain) a device is on. >=20 > The review for it is here: >=20 > https://reviews.freebsd.org/D906 >=20 > Please ignore the vm_phys.c patch; it's purely for experimenting on my > side and won't be committed part of this work. >=20 > Thanks, >=20 >=20 > -a > _______________________________________________ > freebsd-arch@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-arch > To unsubscribe, send any mail to = "freebsd-arch-unsubscribe@freebsd.org" --Apple-Mail=_0F6CDCAF-3099-46DA-840A-D9195A00B846 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQIcBAEBCgAGBQJUNYtYAAoJEGwc0Sh9sBEAIm0P/RhhRgO39Ui2UNUwerJ1jHJ6 Y+bH52tCdhlHZ5sLYEI+BeyB1DiKvvsre0Tu6NI3fXgV5uGNAGBfOrwkHnuVg2vo wF+1g/4K4WRVh4lNA7ikP+z+vm6f7NqImJ0ESIKBG/KO1ESK+q9gMn9+ixajA3vH wO87HJwbOEC+H9LjjaW76oF5XUnBaXVcpNRPUqafCHSG6HYalxLSkNyH96A/EUEM q4GI1o8xAkto6t9NXQ86ZoPHIDzeVQDrFmTaDsMGlFigbFJGr/yyuuLRuadALVJf bzGff6hiPdR7rPM6rAb3dkabnCbND4hazytNiI+4jx45gN9DoyxcDjcuyseXha8D lxgrTe2Y2O49J+vkv8gBKy4bxSD8+BdiQTi4Nms4Tip/FcrKvgHS8UqoCSh/QgcR HTJCzzXv4wQfHp9eEhoSEaPCa3nqeqf0JZr+likbd+j4f1WHbpQ9eARfujbHk/bX 1BVll5AcMDqZQ95E8fc3ug2BUQOFjhZ1CzUMSs4PCx03oDquaYiZdk57aeAn3hl9 UCoP32UzIhbStqTZp9Od7CnvwZHtFUxnoR+jOBsrqpPeiy9G7NQuY4ppebU+7804 xmgL9OV/2YVZOod3WHgCgUAnQib1ANtiiSk4aGJ9NambQmTX1pOTVKUkCvHq22oq /qwi8/1i1ijtHFpR6AVj =o5yk -----END PGP SIGNATURE----- --Apple-Mail=_0F6CDCAF-3099-46DA-840A-D9195A00B846--