Date: Sat, 15 Apr 2000 18:57:53 -0500 From: "Duncan, Eric A." <eric@cdc.net> To: "Ben Vaughn" <bvaughn@pns.net>, <freebsd-smp@freebsd.org> Subject: RE: Issues with Spankin' new Poweredge 4400 w/ dual 866's and 133MHz FSB? Message-ID: <NDBBIMCDELJLMJDJPOFIIEPJCDAA.eric@cdc.net> In-Reply-To: <NDBBLJLIKLNKLNOLEJIKCEKMCDAA.bvaughn@pns.net>
next in thread | previous in thread | raw e-mail | index | archive | help
Ben, Several of us are having the same issues. It stops after the SIO probing (which doesn't have anything to do with the problem). After reading a few other messages that users have posted, it seems to be a problem with FBSD being able to handle more then one APIC. Here's an article to back it up: http://www.freebsd.org/cgi/getmsg.cgi?fetch=0+0+/usr/local/www/db/text/2000/ freebsd-smp/20000220.freebsd-smp Give thanks to Osamu for posting that message. As it mentions, Linux seems to have fixed the issue recently. And in the message, it suggests that FBSD's developers take a look at Linux's code (ewww!!) to see if anything can be applied. Yes, this is a serious problem. I was hoping to have our new 2450 dual 733mhz's online last month. But this stopped that entire analogy. As it stands, it is running off of 1 cpu. :( Suggestions: A few suggestions have came across the wire. The only thing I can see to try is to disable the second APIC in the BIOS. But for me, and other Dell customers, that isn't an issue as Dell's BIOS is very limited. And in their Utility configuration as well. Dell said (and I verified it) that they can not disable the second APIC as they work hand and hand on the system. Maybe if you call, that will make at lease 4 inquiries to Dell and hopefully they can release a BIOS update for it. So if you can't disable all but 1 APIC, I believe you are out of luck using FreeBSD 4.0 on that machine. FreeBSD 4.0 developers: Are you guys looking into this? If you can give me a hint of which files to look into in the source, I'll start debugging Linux to see if I can find their changes. Eric Duncan eric@cdc.net -----Original Message----- From: owner-freebsd-smp@FreeBSD.ORG [mailto:owner-freebsd-smp@FreeBSD.ORG]On Behalf Of Ben Vaughn Sent: Friday, April 14, 2000 7:50 PM To: freebsd-smp@freebsd.org Subject: Issues with Spankin' new Poweredge 4400 w/ dual 866's and 133MHz FSB? Hello, Just got 4.0-STABLE onto this new server of ours, and i'm having serious problems getting SMP to work. If I enable SMP, I have to use the following kernel settings: #options SMP # Symmetric MultiProcessor Kernel #options APIC_IO # Symmetric (APIC) I/O # Optionally these may need tweaked, (defaults shown): #options NCPU=2 # number of CPUs #options NBUS=14 # number of busses #options NAPIC=4 # number of IO APICs #options NINTR=47 # number of INTs Without the comments, of course. When I boot, I get past the initial screen, but the boot process stops right after sio1 initializes. Enabling DDB, and trying to CTRL-ALT-ESCAPE won't allow me to, so I suppose the whole thing just dies hard-core when it gets there. Below is a copy of my mptable and dmesg. If you need anything else, please tell me. I was hoping to bring this server live by April 21, so I hope someone can help. :-) Regards, Ben Vaughn Prophet Network Systems ============================================================================ === MPTable, version 2.0.15 ---------------------------------------------------------------------------- --- MP Floating Pointer Structure: location: BIOS physical address: 0x000fe710 signature: '_MP_' length: 16 bytes version: 1.4 checksum: 0x91 mode: Virtual Wire ---------------------------------------------------------------------------- --- MP Config Table Header: physical address: 0x000f0000 signature: 'PCMP' base table length: 604 version: 1.4 checksum: 0x57 OEM ID: 'DELL ' Product ID: 'POWEREDGE 9A' OEM table pointer: 0x00000000 OEM table size: 0 entry count: 67 local APIC address: 0xfee00000 extended table length: 208 extended table checksum: 195 ---------------------------------------------------------------------------- --- MP Config Base Table Entries: -- Processors: APIC ID Version State Family Model Step Flags 1 0x11 BSP, usable 6 8 3 0x383fbff 0 0x11 AP, usable 6 8 3 0x383fbff -- Bus: Bus ID Type 0 PCI 1 PCI 2 PCI 3 PCI 4 PCI 5 PCI 6 PCI 7 PCI 8 PCI 9 PCI 10 PCI 11 PCI 12 PCI 13 ISA -- I/O APICs: APIC ID Version State Address 2 0x11 usable 0xfec00000 3 0x11 usable 0xfec01000 -- I/O Ints: Type Polarity Trigger Bus ID IRQ APIC ID PIN# ExtINT active-hi edge 13 0 2 0 INT conforms conforms 13 1 2 1 INT conforms conforms 13 0 2 2 INT conforms conforms 13 3 2 3 INT conforms conforms 13 4 2 4 INT conforms conforms 13 6 2 6 INT conforms conforms 13 7 2 7 INT conforms conforms 13 8 2 8 INT conforms conforms 13 9 2 9 INT conforms conforms 13 11 2 11 INT conforms conforms 13 12 2 12 INT conforms conforms 13 15 2 15 INT conforms conforms 0 4:A 3 0 INT conforms conforms 7 6:A 3 9 INT conforms conforms 7 4:A 3 15 INT conforms conforms 7 4:B 3 8 INT conforms conforms 0 8:A 3 1 INT conforms conforms 0 8:C 3 1 INT conforms conforms 8 10:A 3 2 INT conforms conforms 8 10:C 3 2 INT conforms conforms 8 8:A 3 3 INT conforms conforms 8 8:C 3 3 INT conforms conforms 8 6:A 3 4 INT conforms conforms 8 6:C 3 4 INT conforms conforms 8 4:A 3 5 INT conforms conforms 8 4:C 3 5 INT conforms conforms 1 8:A 3 6 INT conforms conforms 1 8:C 3 6 INT conforms conforms 1 4:A 3 7 INT conforms conforms 1 4:C 3 7 INT conforms conforms 0 8:B 3 8 INT conforms conforms 0 8:D 3 8 INT conforms conforms 6 4:B 3 8 INT conforms conforms 8 10:B 3 9 INT conforms conforms 8 10:D 3 9 INT conforms conforms 6 4:C 3 9 INT conforms conforms 8 8:B 3 10 INT conforms conforms 8 8:D 3 10 INT conforms conforms 8 6:B 3 11 INT conforms conforms 8 6:D 3 11 INT conforms conforms 8 4:B 3 12 INT conforms conforms 8 4:D 3 12 INT conforms conforms 1 8:B 3 13 INT conforms conforms 1 8:D 3 13 INT conforms conforms 1 4:B 3 14 INT conforms conforms 1 4:D 3 14 INT conforms conforms 6 4:A 3 15 -- Local Ints: Type Polarity Trigger Bus ID IRQ APIC ID PIN# ExtINT active-hi edge 13 0 255 0 NMI active-hi edge 13 0 255 1 ---------------------------------------------------------------------------- --- MP Config Extended Table Entries: -- bus ID: 0 address type: I/O address address base: 0xf000 address range: 0x1000 -- bus ID: 0 address type: memory address address base: 0xa0000 address range: 0x20000 -- bus ID: 0 address type: memory address address base: 0xfd000000 address range: 0x1b10000 -- bus ID: 1 address type: I/O address address base: 0xd000 address range: 0x2000 -- bus ID: 1 address type: memory address address base: 0xfbf00000 address range: 0x1100000 -- bus ID: 6 address type: I/O address address base: 0xc000 address range: 0x1000 -- bus ID: 6 address type: memory address address base: 0xfa000000 address range: 0x1f00000 -- bus ID: 8 address type: I/O address address base: 0xa000 address range: 0x2000 -- bus ID: 0 address type: I/O address address base: 0x0 address range: 0xa000 -- bus ID: 8 address type: memory address address base: 0xf8f00000 address range: 0x1100000 -- bus ID: 13 bus info: 0x01 parent bus ID: 0 ---------------------------------------------------------------------------- --- # SMP kernel config file options: # Required: options SMP # Symmetric MultiProcessor Kernel options APIC_IO # Symmetric (APIC) I/O # Optional (built-in defaults will work in most cases): #options NCPU=2 # number of CPUs #options NBUS=14 # number of busses #options NAPIC=2 # number of IO APICs #options NINTR=47 # number of INTs ============================================================================ === And, My DMESG: root@blerf:/usr/src# dmesg Copyright (c) 1992-2000 The FreeBSD Project. Copyright (c) 1982, 1986, 1989, 1991, 1993 The Regents of the University of California. All rights reserved. FreeBSD 4.0-STABLE #0: Fri Apr 14 13:39:26 EST 2000 root@blerf.pns.net:/usr/obj/usr/src/sys/PNS-SMP Timecounter "i8254" frequency 1193182 Hz CPU: Pentium III/Pentium III Xeon (863.93-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0x683 Stepping = 3 Features=0x383fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA, CMOV,PAT,PSE36,MMX,FXSR,XMM> real memory = 2147475456 (2097144K bytes) config> di sn0 No such device: sn0 Invalid command or syntax. Type `?' for help. config> di lnc0 No such device: lnc0 Invalid command or syntax. Type `?' for help. config> di le0 No such device: le0 Invalid command or syntax. Type `?' for help. config> di ie0 No such device: ie0 Invalid command or syntax. Type `?' for help. config> di fe0 No such device: fe0 Invalid command or syntax. Type `?' for help. config> di ed0 No such device: ed0 Invalid command or syntax. Type `?' for help. config> di cs0 No such device: cs0 Invalid command or syntax. Type `?' for help. config> di bt0 No such device: bt0 Invalid command or syntax. Type `?' for help. config> di aic0 No such device: aic0 Invalid command or syntax. Type `?' for help. config> di aha0 No such device: aha0 Invalid command or syntax. Type `?' for help. config> di adv0 No such device: adv0 Invalid command or syntax. Type `?' for help. config> q avail memory = 2086125568 (2037232K bytes) Preloaded elf kernel "kernel" at 0xc0303000. Preloaded userconfig_script "/boot/kernel.conf" at 0xc030309c. Pentium Pro MTRR support enabled md0: Malloc disk npx0: <math processor> on motherboard npx0: INT 16 interface pcib0: <RCC LE host to PCI bridge> on motherboard pci0: <PCI bus> on pcib0 fxp0: <Intel EtherExpress Pro 10/100B Ethernet> port 0xfcc0-0xfcff mem 0xfe900000-0xfe9fffff,0xfeb02000-0xfeb02fff irq 14 at device 4.0 on pci0 fxp0: Ethernet address 00:b0:d0:20:a7:06 pci0: <ATI model 4759 graphics accelerator> at 6.0 isab0: <PCI to ISA bridge (vendor=1166 device=0200)> at device 15.0 on pci0 isa0: <ISA bus> on isab0 pci0: <OHCI USB controller> at 15.2 irq 11 pcib1: <RCC LE host to PCI bridge> on motherboard pci1: <PCI bus> on pcib1 pcib6: <RCC LE host to PCI bridge> on motherboard pci6: <PCI bus> on pcib6 pcib9: <PCI to PCI bridge (vendor=8086 device=0962)> at device 4.0 on pci6 pci7: <PCI bus> on pcib9 ahc0: <Adaptec aic7899 Ultra160 SCSI adapter> port 0xcc00-0xccff mem 0xfbdff000-0xfbdfffff irq 10 at device 4.0 on pci7 ahc0: aic7899 Wide Channel A, SCSI Id=7, 16/255 SCBs ahc1: <Adaptec aic7899 Ultra160 SCSI adapter> port 0xc800-0xc8ff mem 0xfbdfe000-0xfbdfefff irq 5 at device 4.1 on pci7 ahc1: aic7899 Wide Channel B, SCSI Id=7, 16/255 SCBs ahc2: <Adaptec aic7880 Ultra SCSI adapter> port 0xc400-0xc4ff mem 0xfbdfd000-0xfbdfdfff irq 14 at device 6.0 on pci7 ahc2: aic7880 Single Channel A, SCSI Id=7, 16/255 SCBs pcib8: <RCC LE host to PCI bridge> on motherboard pci8: <PCI bus> on pcib8 fdc0: <NEC 72065B or clone> at port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on isa0 fdc0: FIFO enabled, 8 bytes threshold fd0: <1440-KB 3.5" drive> on fdc0 drive 0 atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0 atkbd0: <AT Keyboard> irq 1 on atkbdc0 vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 sc0: <System console> on isa0 sc0: VGA <16 virtual consoles, flags=0x200> sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0 sio0: type 16550A sio1 at port 0x2f8-0x2ff irq 3 on isa0 sio1: type 16550A IP packet filtering initialized, divert disabled, rule-based forwarding disabled, default to accept, logging limited to 100 packets/entry by default DUMMYNET initialized (000106) Waiting 15 seconds for SCSI devices to settle pass2 at ahc0 bus 0 target 6 lun 0 pass2: <DELL 1x6 U2W SCSI BP 5.35> Fixed Processor SCSI-2 device pass2: 3.300MB/s transfers da0 at ahc0 bus 0 target 0 lun 0 da0: <QUANTUM ATLAS 10K 9SCA UCHD> Fixed Direct Access SCSI-3 device da0: 80.000MB/s transfers (40.000MHz, offset 31, 16bit), Tagged Queueing Enabled da0: 8683MB (17783249 512 byte sectors: 255H 63S/T 1106C) da1 at ahc0 bus 0 target 1 lun 0 da1: <QUANTUM ATLAS 10K 9SCA UCHD> Fixed Direct Access SCSI-3 device da1: 80.000MB/s transfers (40.000MHz, offset 31, 16bit), Tagged Queueing Enabled da1: 8683MB (17783249 512 byte sectors: 255H 63S/T 1106C) vinum: loaded Mounting root from ufs:/dev/da0s1a cd0 at ahc2 bus 0 target 5 lun 0 cd0: <NEC CD-ROM DRIVE:466 1.06> Removable CD-ROM SCSI-2 device cd0: 20.000MB/s transfers (20.000MHz, offset 15) cd0: Attempt to query device size failed: NOT READY, Medium not present To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?NDBBIMCDELJLMJDJPOFIIEPJCDAA.eric>