From owner-freebsd-current@freebsd.org Wed Sep 12 00:16:03 2018 Return-Path: Delivered-To: freebsd-current@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9B0D710A31C7 for ; Wed, 12 Sep 2018 00:16:03 +0000 (UTC) (envelope-from kevin.bowling@kev009.com) Received: from mail-io0-x233.google.com (mail-io0-x233.google.com [IPv6:2607:f8b0:4001:c06::233]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3BFD690ABA for ; Wed, 12 Sep 2018 00:16:03 +0000 (UTC) (envelope-from kevin.bowling@kev009.com) Received: by mail-io0-x233.google.com with SMTP id q4-v6so92249iob.8 for ; Tue, 11 Sep 2018 17:16:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kev009.com; s=google; h=mime-version:from:date:message-id:subject:to; bh=a9KNXv61i0ldiumGMbgWntiYexzGCcKQaOzMHxj1hTU=; b=kF9ZI691dMHRysE0j3OxhrzLuwn9QHXtXioTMp6SCVT8thPoTnFxBjHzmxIMgCyedm L/t8WDFy7A7aDen5CZVnRPlPC12HXnGWVPztPNRAlh4PeqBKaW/1bYHF9xYC/kQo96J+ 44NdAkU1IW+/v8Qr+KWMK2VcE8qmpuT5863T0= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=a9KNXv61i0ldiumGMbgWntiYexzGCcKQaOzMHxj1hTU=; b=ARfLCXreBo3OUDGV8p8AaRvOfAd4l8lKxfBoIq0dGHTBGrnKRk6UPNdQ3SCROJdj8z nm7xOJ2VJPzitibNxL8gP7IESQersL1iKZU9GlHWtwk9ILaAv/oawxXAnopIfMzMXs7k pM5O00GM0/w+u7h4Z7nhZPPUBqOBXwc85RU72Aak6czlrvj0I59JOPuFw+OiXZhhmhJV Xr2lkDIt+54ucs8wuGul8AaDuRJofjXXetdaWISXWXgBTSXmLktLTjlk8htUDlqbUKsw j1tLjW8lftOgmPgXy7R6fq7oV6g14OnDWVBtlrm4xrQ8bJy7h484OAMWBQpbDFMIFhaE JsxA== X-Gm-Message-State: APzg51CRFiTrSz95DO4rJhBRns7D2u+JvL/x8bAMpueJFdvUlWpwWtlW z/yHnCyNMhzejgQTtjeuxEW3FxDJ2Z4xej90oAEo9H/FmWYfng== X-Google-Smtp-Source: ANB0VdbCCDYyNallK71bCpBFg047Uliy6WGF95NDl2v1ce+9x9m/UajWpJP8scfk6XQUf9zVt7Tnt5GG/Wm/7HYLWK4= X-Received: by 2002:a6b:1992:: with SMTP id 140-v6mr24543940ioz.251.1536711362066; Tue, 11 Sep 2018 17:16:02 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:a02:6416:0:0:0:0:0 with HTTP; Tue, 11 Sep 2018 17:16:01 -0700 (PDT) From: Kevin Bowling Date: Tue, 11 Sep 2018 17:16:01 -0700 Message-ID: Subject: amd64: enable options NUMA ing GENERIC and MINIMAL To: freebsd-current@freebsd.org Content-Type: text/plain; charset="UTF-8" X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 12 Sep 2018 00:16:03 -0000 -CURRENT users, in svn rS338602, 'options NUMA' has just been enabled for amd64 GENERIC and MINIMAL kernels. This should provide good effect to systems with more than one physical CPU with associated memory, certain high core count Intel chips when configured to use Cluster-on-Die or Sub-NUMA-Clustering, and recent AMD products with multiple chiplets like Thread Ripper and EPYC. If you have a single domain system, there is no expected change. If you have such NUMA machines, early testing would be greatly appreciated in order to ensure the quality and stability of the 12.0 release. You can confirm configuration of NUMA domains with 'sysctl vm.ndomains', example output: vm.ndomains: 2 This work was sponsored by Dell EMC Isilon and Netflix and led by Jeff Roberson. Some folks have participated for a long time in bi-weekly calls and stabilization. It is known to be used in production configurations for some time at Netflix and Limelight Networks. If you encounter any issues where you suspect this is the root cause, please disable 'options NUMA' in the kernel configuration and reproduce before reporting as such. This would be a good time to audit your kernel config if copied from GENERIC and consider if you can instead use 'include GENERIC-NODEBUG' to only track local modifications. Regards, Kevin Bowling