From owner-freebsd-hackers@FreeBSD.ORG Mon Oct 3 17:24:42 2011 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A7035106566C; Mon, 3 Oct 2011 17:24:42 +0000 (UTC) (envelope-from lacombar@gmail.com) Received: from mail-ww0-f42.google.com (mail-ww0-f42.google.com [74.125.82.42]) by mx1.freebsd.org (Postfix) with ESMTP id 0BC198FC14; Mon, 3 Oct 2011 17:24:41 +0000 (UTC) Received: by wwn22 with SMTP id 22so3709704wwn.1 for ; Mon, 03 Oct 2011 10:24:41 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=2VxS+ihx2QoIv7RG3rj/akOWPVC+SJkG6THL4b0zPw8=; b=JFdSQx0J3K9DtSoH0dAYXzdY9hVOYqjxGD3ipM+r7lUW7kEe+eIAjtGF5WHzVH72Y0 EC7Pu9jgx+jWIhm+aMhiWuqmjHm+RW+sGCNG5nFRUmq4fHP3u0oYG9DtDSSeNMwEdZHU pl2Amp+/p/lLzUQ2CboezDH1QYuob3MZEPDAo= MIME-Version: 1.0 Received: by 10.216.21.74 with SMTP id q52mr3620987weq.36.1317662680943; Mon, 03 Oct 2011 10:24:40 -0700 (PDT) Received: by 10.180.103.33 with HTTP; Mon, 3 Oct 2011 10:24:40 -0700 (PDT) In-Reply-To: References: <1317653757588-4865200.post@n5.nabble.com> Date: Mon, 3 Oct 2011 13:24:40 -0400 Message-ID: From: Arnaud Lacombe To: mdf@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: freebsd-hackers@freebsd.org, satish kondapalli Subject: Re: NUMA Support is there in FreeBSD. X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 03 Oct 2011 17:24:42 -0000 Hi, On Mon, Oct 3, 2011 at 12:31 PM, wrote: > On Mon, Oct 3, 2011 at 7:55 AM, satish kondapalli = wrote: >> I am new to FreeBSD, I just want know whether FreeBSD supports NUMA. >> If FreeBSD supports NUMA what are the kernel API to allocate memory? >> is there any example driver or any driver which is using the NUMA API? >> >> please provide some inputs... > > The kernel is NUMA-aware (at least for x86), > What "x86" ? i386 ? amd64 ? both ? > and memory is allocated > round-robin amongst the memory domains. =A0There are not yet any KPIs > for allocating memory in a specific NUMA domain, nor for binding > specific threads / processes to get their memory local to a bound cpu > instead of round robin. > I'm not sure to follow you. Say you have 2 memory domain attached to 2 different CPU package, each providing a memory domain, 4 physical core and eventually 8 virtual. Say you have a network adapter supporting 8 RX/TX queue, dispatching RX packet to 8 netisr. Ideally, you'd want those 8 queue/netisr to each have an affinity for a given CPU/memory domain, have the network adapter route flow evenly on those those 8 CPU. Now, if you allocated an mbuf from memory domain 1, and end up being processed by a CPU in domain 0, that likely to introduce performance penalty. Now, what about userland ? This is certainly an horribly big picture :/ - Arnaud > There have been several discussions but no one has taken the lead and > proposed some KPIs yet. =A0At $WORK the round-robin is sufficient to get > consistent performance numbers and we have not yet started any > experimentation with binding specific threads to either CPU or memory. > > Cheers, > matthew > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org= " >