From owner-freebsd-hackers@FreeBSD.ORG Mon Mar 28 22:15:34 2005 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 247B016A4CE for ; Mon, 28 Mar 2005 22:15:34 +0000 (GMT) Received: from seven.Alameda.net (seven.alameda.net [64.81.53.71]) by mx1.FreeBSD.org (Postfix) with ESMTP id 3923A43D39 for ; Mon, 28 Mar 2005 22:15:33 +0000 (GMT) (envelope-from ulf@Alameda.net) Received: by seven.Alameda.net (Postfix, from userid 1000) id A12283A201; Mon, 28 Mar 2005 14:15:32 -0800 (PST) Date: Mon, 28 Mar 2005 14:15:32 -0800 From: Ulf Zimmermann To: Greg Eden Message-ID: <20050328221531.GA13841@seven.alameda.net> References: Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: Organization: Alameda Networks, Inc. X-Operating-System: FreeBSD 4.10-RELEASE-p2 User-Agent: Mutt/1.5.6i cc: freebsd-hackers@freebsd.org Subject: Re: FreeBSD 5.3R SMP Kernel not detecting 2nd CPU in a HP DL360(?) X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: ulf@Alameda.net List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Mar 2005 22:15:34 -0000 On Mon, Mar 28, 2005 at 09:51:23PM +0100, Greg Eden wrote: > > Hello All, > > I have a co-located HP DL360 G3 server to which I do not have physical > access. It has 2 x 2.8GHz Xeon CPUs with HTT. One of the ISP's > engineers has confirmed that both CPUs are detected when the BIOS > POSTs. > > I have cvsup'd to the latest 5.3R security release and successfully > built 'world', something I have done successfully many times with 4.x > releases, using the instructions from the handbook. I used a custom > kernel configuration which included 'options SMP' and 'device apic'. On > reboot dmesg confirmed that the custom kernel was used, however SMP was > not active and the additional CPUs were not launched. > > Thinking that perhaps my custom kernel conf was at fault, I compiled a > GENERIC smp kernel with: > > # cd /usr/obj > # chflags -R noschg * > # rm -rf * > /usr/src/# make buildkernel KERNCONF=SMP > /usr/src/# make installkernel KERNCONF=SMP > > After reboot the dmesg output is as follows: > > FreeBSD 5.3-RELEASE-p5 #0: Thu Mar 24 14:37:29 GMT 2005 > greg@[snip].warprecords.com:/usr/obj/usr/src/sys/SMP > Timecounter "i8254" frequency 1193182 Hz quality 0 > CPU: Intel(R) Xeon(TM) CPU 2.80GHz (2799.22-MHz 686-class CPU) > Origin = "GenuineIntel" Id = 0xf29 Stepping = 9 > > Features=0xbfebf9ff CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> > Hyperthreading: 2 logical CPUs > real memory = 2147459072 (2047 MB) > avail memory = 2095996928 (1998 MB) > npx0: [FAST] > npx0: on motherboard > npx0: INT 16 interface > acpi0: on motherboard > acpi0: Power Button (fixed) > Timecounter "ACPI-safe" frequency 3579545 Hz quality 1000 > acpi_timer0: <32-bit timer at 3.579545MHz> port 0x920-0x923 on acpi0 > cpu0: on acpi0 > acpi_tz0: on acpi0 > pcib0: on acpi0 > ACPI link \\_SB_.IN31 has invalid initial irq 3, ignoring > pci0: on pcib0 > pci0: at device 3.0 (no driver attached) > ciss0: port 0x2800-0x28ff mem > 0xf5df0000-0xf5df3fff,0xf5f80000-0xf5fbffff irq 11 at device 4.0 on > pci0 > ciss0: [GIANT-LOCKED] > pci0: at device 5.0 (no driver attached) > pci0: at device 5.2 (no driver attached) > isab0: at device 15.0 on pci0 > isa0: on isab0 > atapci0: port > 0x2000-0x200f,0x376,0x170-0x177,0x3f6,0x1f0-0x1f7 at device 15.1 on > pci0 > ata0: channel #0 on atapci0 > ata1: channel #1 on atapci0 > ohci0: mem 0xf5e70000-0xf5e70fff irq 10 > at device 15.2 on pci0 > ohci0: [GIANT-LOCKED] > usb0: OHCI version 1.0, legacy support > usb0: SMM does not respond, resetting > usb0: on ohci0 > usb0: USB revision 1.0 > uhub0: (0x1166) OHCI root hub, class 9/0, rev 1.00/1.00, addr 1 > uhub0: 4 ports with 4 removable, self powered > pcib1: on acpi0 > pci1: on pcib1 > bge0: mem > 0xf7ef0000-0xf7efffff irq 11 at device 2.0 on pci1 > miibus0: on bge0 > brgphy0: on miibus0 > brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX, > 1000baseTX-FDX, auto > bge0: Ethernet address: 00:11:85:6b:07:d8 > pcib2: on acpi0 > pci4: on pcib2 > bge1: mem > 0xf7ff0000-0xf7ffffff irq 15 at device 2.0 on pci4 > miibus1: on bge1 > brgphy1: on miibus1 > brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX, > 1000baseTX-FDX, auto > bge1: Ethernet address: 00:11:85:6b:07:db > atkbdc0: port 0x64,0x60 irq 1 on acpi0 > atkbd0: irq 1 on atkbdc0 > kbd0 at atkbd0 > atkbd0: [GIANT-LOCKED] > sio0: port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 > sio0: type 16550A > fdc0: port 0x3f2-0x3f5 irq 6 drq 2 on > acpi0 > fdc0: [FAST] > fd0: <1440-KB 3.5" drive> on fdc0 drive 0 > orm0: at iomem > 0xee000-0xeffff,0xcc000-0xcd7ff,0xc8000-0xcbfff,0xc0000-0xc7fff on isa0 > pmtimer0 on isa0 > ppc0: parallel port not found. > sc0: at flags 0x100 on isa0 > sc0: VGA <16 virtual consoles, flags=0x300> > sio1: configured irq 3 not in bitmap of probed irqs 0 > sio1: port may not be enabled > vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on > isa0 > Timecounter "TSC" frequency 2799224924 Hz quality 800 > Timecounters tick every 10.000 msec > acd0: CDROM at ata0-master PIO4 > da0 at ciss0 bus 0 target 0 lun 0 > da0: Fixed Direct Access SCSI-0 device > da0: 135.168MB/s transfers > da0: 69459MB (142253280 512 byte sectors: 255H 32S/T 17433C) > Mounting root from ufs:/dev/da0s1a > > and > > ~> sysctl kern.smp.active > kern.smp.active: 0 > > I just don't understand why the kernel isn't running SMP. To my mind > it's either something in my method (most likely), a hardware problem, > or something odd in the way 5.3R detects the CPUs on the hardware. > > I have successfully compiled SMP kernels on identical hardware with > FreeBSD 4.8R. With the HTT 4 CPUs are launched as they should be here. > > Now I think about it I have another machine, a HP DL380 with a single > HTT Xeon processor, which is displaying the same problem. > > Thanks in advance. > > greg. DL380 g3 have build in iLO. Can your colo hookup that ethernet? That will allow you console access including power on/off, reset and you will be able to see faults (fan, power supply, etc.). I have a DL380 g3 with dual P4-3.2GHz 1MB L3 cache, the kern conf has just "options SMP" to make it work. Here is the top part and bottom part of dmesg from boot: Copyright (c) 1992-2005 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD 5.3-STABLE #0: Sun Feb 20 17:42:41 PST 2005 root@evil.alameda.net:/usr/obj/usr/src/sys/EVIL Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Xeon(TM) CPU 3.20GHz (3183.19-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0xf25 Stepping = 5 Features=0xbfebfbff Hyperthreading: 2 logical CPUs real memory = 4026507264 (3839 MB) avail memory = 3941990400 (3759 MB) ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 6 MADT: Forcing active-low polarity and level trigger for SCI ioapic0 irqs 0-15 on motherboard ioapic1 irqs 16-31 on motherboard ioapic2 irqs 32-47 on motherboard ioapic3 irqs 48-63 on motherboard npx0: on motherboard npx0: INT 16 interface acpi0: on motherboard acpi0: Power Button (fixed) Timecounter "ACPI-safe" frequency 3579545 Hz quality 1000 acpi_timer0: <32-bit timer at 3.579545MHz> port 0x920-0x923 on acpi0 cpu0: on acpi0 cpu1: on acpi0 ... SMP: AP CPU #1 Launched! ... kern.smp.active: 1 kern.smp.disabled: 0 kern.smp.cpus: 2 This box was running 5.2.1 before so I am very sure SMP will work on it. -- Regards, Ulf. --------------------------------------------------------------------- Ulf Zimmermann, 1525 Pacific Ave., Alameda, CA-94501, #: 510-865-0204 You can find my resume at: http://seven.Alameda.net/~ulf/resume.html