From owner-freebsd-current@freebsd.org Thu Jan 5 01:49:15 2017 Return-Path: Delivered-To: freebsd-current@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 41BF6C9E88B for ; Thu, 5 Jan 2017 01:49:15 +0000 (UTC) (envelope-from ricera10@gmail.com) Received: from mail-oi0-f45.google.com (mail-oi0-f45.google.com [209.85.218.45]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 02E711FA4 for ; Thu, 5 Jan 2017 01:49:14 +0000 (UTC) (envelope-from ricera10@gmail.com) Received: by mail-oi0-f45.google.com with SMTP id b126so564717407oia.2 for ; Wed, 04 Jan 2017 17:49:14 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=f7VAr6ac+CfcpQz56+TymbxSdk8ZoBePR4MtspdU+qI=; b=q/6z4DxZ2O+jBS6spYkhSox8etxvI/uSBsZhiG2tA4xpgeMcBYS0Fb5t4LDKiXO5Sv 6TN33CPdyW5o8FVIQzIpMD+gxvaO3iPI0+ekmWVs70xzGw9ILxE0IV0gfPij9O62mBMT Y4EpOauZDVQHVmIBZ7VCSd74cVOEiCaFMqMIZeHD15k3CVqyCNElJImvj3fiu3NrQbZR jULcz/KLZl68ngecaSj3wk62SUhAKD6GLje4Pz5OoNMlYIP3T/I9RBFO9nPfCEdCP1i3 Ao251wD6NxdpsMcZmZs47da9vrsxffUXBST6Ym6o7QANzTu0VMIChYY464u47/TuWIg4 YyQQ== X-Gm-Message-State: AIkVDXKTeXYRWweK8Iq4J/L7zUNMVNi1MC8q9wyb7FfROriG9NCM7EEuQypd7VF7SCPJWA== X-Received: by 10.202.220.139 with SMTP id t133mr30730483oig.176.1483579446391; Wed, 04 Jan 2017 17:24:06 -0800 (PST) Received: from mail-oi0-f47.google.com (mail-oi0-f47.google.com. [209.85.218.47]) by smtp.gmail.com with ESMTPSA id c3sm34656646otb.29.2017.01.04.17.24.05 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 04 Jan 2017 17:24:05 -0800 (PST) Received: by mail-oi0-f47.google.com with SMTP id 128so369160653oig.0 for ; Wed, 04 Jan 2017 17:24:05 -0800 (PST) X-Received: by 10.157.35.195 with SMTP id t61mr31263463otb.263.1483579445645; Wed, 04 Jan 2017 17:24:05 -0800 (PST) MIME-Version: 1.0 References: <20170104195909.GB2533@kib.kiev.ua> In-Reply-To: From: Eric Joyner Date: Thu, 05 Jan 2017 01:23:55 +0000 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: How many CPU cores does FreeBSD support? To: Konstantin Belousov Cc: FreeBSD Current Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jan 2017 01:49:15 -0000 I started off with a snapshot of 12-CURRENT, but I got a kernel panic on boot that complained about a duplicate local APIC ID. For now, disabling Hyper Threading gets rid of that panic. I think there's a KASSERT that wasn't getting hit on my 11.0-RELEASE install. On Wed, Jan 4, 2017 at 2:00 PM Eric Joyner wrote: > Ok; I will try that and will report back. > > - Eric > > On Wed, Jan 4, 2017 at 11:59 AM Konstantin Belousov > wrote: > > On Wed, Jan 04, 2017 at 06:53:23PM +0000, Eric Joyner wrote: > > Adding freebsd-current, because that's a good idea. > > > > I see these lines in the beginning of dmesg: > > > > MADT: Ignoring local APIC ID 256 (too high) > > > > > > [907/911] > > MADT: Ignoring local APIC ID 260 (too high) > > > > > > [906/911] > > MADT: Ignoring local APIC ID 264 (too high) > > > > > > [905/911] > > MADT: Ignoring local APIC ID 268 (too high) > > > > > > [904/911] > > MADT: Ignoring local APIC ID 272 (too high) > > > > > > [903/911] > > MADT: Ignoring local APIC ID 276 (too high) > > > > > > [902/911] > > MADT: Ignoring local APIC ID 280 (too high) > > > > > > [901/911] > > MADT: Ignoring local APIC ID 272 (too high) > > > > > > [903/911] > > MADT: Ignoring local APIC ID 276 (too high) > > > > > > [902/911] > > MADT: Ignoring local APIC ID 280 (too high) > > > > > > [901/911] > > MADT: Ignoring local APIC ID 276 (too high) > > > > > > [902/911] > > MADT: Ignoring local APIC ID 280 (too high) > > MADT: Ignoring local APIC ID 284 (too high) > > MADT: Ignoring local APIC ID 288 (too high) > > MADT: Ignoring local APIC ID 292 (too high) > > MADT: Ignoring local APIC ID 296 (too high) > > MADT: Ignoring local APIC ID 300 (too high) > > MADT: Ignoring local APIC ID 257 (too high) > > MADT: Ignoring local APIC ID 261 (too high) > > MADT: Ignoring local APIC ID 265 (too high) > > MADT: Ignoring local APIC ID 269 (too high) > > MADT: Ignoring local APIC ID 273 (too high) > > MADT: Ignoring local APIC ID 277 (too high) > > MADT: Ignoring local APIC ID 281 (too high) > > MADT: Ignoring local APIC ID 285 (too high) > > MADT: Ignoring local APIC ID 289 (too high) > > MADT: Ignoring local APIC ID 293 (too high) > > MADT: Ignoring local APIC ID 297 (too high) > > MADT: Ignoring local APIC ID 301 (too high) > > MADT: Ignoring local APIC ID 258 (too high) > > MADT: Ignoring local APIC ID 262 (too high) > > MADT: Ignoring local APIC ID 266 (too high) > > MADT: Ignoring local APIC ID 270 (too high) > > MADT: Ignoring local APIC ID 274 (too high) > > MADT: Ignoring local APIC ID 278 (too high) > > MADT: Ignoring local APIC ID 282 (too high) > > MADT: Ignoring local APIC ID 286 (too high) > > MADT: Ignoring local APIC ID 290 (too high) > > MADT: Ignoring local APIC ID 294 (too high) > > MADT: Ignoring local APIC ID 298 (too high) > > MADT: Ignoring local APIC ID 302 (too high) > > MADT: Ignoring local APIC ID 255 (too high) > > MADT: Ignoring local APIC ID 259 (too high) > > MADT: Ignoring local APIC ID 263 (too high) > > MADT: Ignoring local APIC ID 267 (too high) > > MADT: Ignoring local APIC ID 271 (too high) > > MADT: Ignoring local APIC ID 275 (too high) > > MADT: Ignoring local APIC ID 279 (too high) > > MADT: Ignoring local APIC ID 283 (too high) > > MADT: Ignoring local APIC ID 287 (too high) > > MADT: Ignoring local APIC ID 291 (too high) > > MADT: Ignoring local APIC ID 295 (too high) > > MADT: Ignoring local APIC ID 299 (too high) > > MADT: Ignoring local APIC ID 303 (too high) > > Copyright (c) 1992-2016 The FreeBSD Project. > > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 > > The Regents of the University of California. All rights reserved. > > FreeBSD is a registered trademark of The FreeBSD Foundation. > > FreeBSD 11.0-RELEASE-p1 #0 r306420: Thu Sep 29 01:43:23 UTC 2016 > > root@releng2.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 > > FreeBSD clang version 3.8.0 (tags/RELEASE_380/final 262564) (based on > LLVM > > 3.8.0) > > SRAT: No CPU found for memory domain 1 > > VT(efifb): resolution 800x600 > > CPU: Intel(R) Xeon Phi(TM) CPU 7250 @ 1.40GHz (1396.80-MHz K8-class CPU) > > Origin="GenuineIntel" Id=0x50671 Family=0x6 Model=0x57 Stepping=1 > > > > > Features=0xbfebfbff > > > > > Features2=0x7ff8f39f > > AMD Features=0x2c100800 > > AMD Features2=0x121 > > Structured Extended > > > Features=0x1c0d23ab > > Structured Extended Features2=0x1 > > XSAVE Features=0x1 > > TSC: P-state invariant, performance statistics > > real memory = 223332007936 (212986 MB) > > avail memory = 216976429056 (206924 MB) > > Event timer "LAPIC" quality 600 > > ACPI APIC Table: > > FreeBSD/SMP: Multiprocessor System Detected: 223 CPUs > > FreeBSD/SMP: Non-uniform topology > > > > It sounds like those MADT errors point to the problem? > > In sys/x86/acpica/madt.c file, function madt_add_cpu(), just remove > the block > if (apic_id > MAX_APIC_ID) { > printf("MADT: Ignoring local APIC ID %u (too high)\n", > apic_id); > return; > } > Best to do it on HEAD and not on 11.0. > If it helps, commit the change. > > Also, for >= 256 CPUs, you might need to enable interrupt remapping > in the DMAR, use loader tunables > hw.dmar.enable <= to enable DMAR > hw.dmar.ir <= to enable remapping > hw.dmar.dma <= to disable IOMMU if it interacts badly with your hw > >