From owner-freebsd-smp Mon Apr 17 12:17:51 2000 Delivered-To: freebsd-smp@freebsd.org Received: from relativity.student.utwente.nl (wit389306.student.utwente.nl [130.89.234.166]) by hub.freebsd.org (Postfix) with ESMTP id 152C737B930 for ; Mon, 17 Apr 2000 12:17:49 -0700 (PDT) (envelope-from djb@wit389306.student.utwente.nl) Received: by relativity.student.utwente.nl (Postfix, from userid 1000) id 2B9E15DE5; Mon, 17 Apr 2000 21:17:43 +0200 (CEST) Date: Mon, 17 Apr 2000 21:17:43 +0200 From: Dave Boers To: FreeBSD-smp@FreeBSD.org Cc: Tommy Hallgren , Jeremiah Gowdy , bart@ixori.demon.nl, Matthew Dillon Subject: Re: SMP and vn Message-ID: <20000417211743.A589@relativity.student.utwente.nl> Reply-To: djb@relativity.student.utwente.nl References: <20000327183911.18682.qmail@web124.yahoomail.com> <20000329132919.A10781@relativity.student.utwente.nl> <200003291604.IAA63016@apollo.backplane.com> <20000329203525.A379@relativity.student.utwente.nl> <20000403115124.A374@relativity.student.utwente.nl> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Mailer: Mutt 1.0.1i In-Reply-To: <20000403115124.A374@relativity.student.utwente.nl>; from djb@relativity.student.utwente.nl on Mon, Apr 03, 2000 at 11:51:24AM +0200 Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org On Mon, Apr 03, 2000 at 11:51:24AM +0200, Dave Boers wrote: > [Ongoing story about 4.0 hangs on SMP systems] I finally found what triggers the hangs we have been talking about. On my system they are triggered by licq and cdrecord. The one thing those applications have in common is that they use Posix scheduling. I have used licq remote and I did not use cdrecord or other applications that use Posix scheduling for the past 15 days and my uptime is also 15 days. That's the longest uptime since a long time for this system! I suspect that the people who have suspected XFree86 of crashing their system had it compiled with support for pthreads... Anyway, as far as I am concerned, the answer is there now: posix scheduling has bugs on smp systems; those bugs were likely introduced in 4.0-current somewhere in december 1999 or january 2000. If anyone wants to look into the problem, I can help testing. From what I know, it looks like the kernel is looping (because there is no panic). Regards, Dave. -- djb@ifa.au.dk d.j.boers@tn.utwente.nl PGP key: ftp://relativity.student.utwente.nl:/pub/pgpkeys/djb.asc To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Mon Apr 17 13:23:31 2000 Delivered-To: freebsd-smp@freebsd.org Received: from relativity.student.utwente.nl (wit389306.student.utwente.nl [130.89.234.166]) by hub.freebsd.org (Postfix) with ESMTP id 090DC37B985 for ; Mon, 17 Apr 2000 13:23:29 -0700 (PDT) (envelope-from djb@wit389306.student.utwente.nl) Received: by relativity.student.utwente.nl (Postfix, from userid 1000) id 3D01C5DE5; Mon, 17 Apr 2000 22:23:28 +0200 (CEST) Date: Mon, 17 Apr 2000 22:23:28 +0200 From: Dave Boers To: "Duncan, Eric A." Cc: FreeBSD-smp@FreeBSD.org, Tommy Hallgren , Jeremiah Gowdy , bart@ixori.demon.nl, Matthew Dillon Subject: Re: SMP and vn Message-ID: <20000417222328.A781@relativity.student.utwente.nl> Reply-To: djb@relativity.student.utwente.nl References: <20000417211743.A589@relativity.student.utwente.nl> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Mailer: Mutt 1.0.1i In-Reply-To: ; from eric@cdc.net on Mon, Apr 17, 2000 at 02:27:53PM -0500 Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org On Mon, Apr 17, 2000 at 02:27:53PM -0500, Duncan, Eric A. wrote: > I can help test on the following systems (that all have the same issue as > stated of hanging on boot): Actually, those were not exactly the kind of hangs I was referring to. If you look further up this thread (which has everything to do with SMP and very little with vn), you will find that these hangs always happen after boot. They have been referred to as "lockups" also. Now, if FreeBSD wouldn't produce so many hangs on SMP systems, we wouldn't be having all this confusion ;-) Regards, Dave Boers. -- djb@ifa.au.dk d.j.boers@tn.utwente.nl PGP key: ftp://relativity.student.utwente.nl:/pub/pgpkeys/djb.asc To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Mon Apr 17 13:29:27 2000 Delivered-To: freebsd-smp@freebsd.org Received: from megamail.dsl.net (megamail.dsl.net [209.87.64.97]) by hub.freebsd.org (Postfix) with ESMTP id DEEFF37BC5C for ; Mon, 17 Apr 2000 13:29:23 -0700 (PDT) (envelope-from eric@cdc.net) Received: from garfield (216-175-151-207.client.dsl.net [216.175.151.207]) by megamail.dsl.net (8.9.3/8.9.3) with SMTP id PAA06634; Mon, 17 Apr 2000 15:32:35 -0400 From: "Duncan, Eric A." To: , Cc: "Tommy Hallgren" , "Jeremiah Gowdy" , , "Matthew Dillon" Subject: RE: SMP and vn Date: Mon, 17 Apr 2000 14:27:53 -0500 Message-ID: MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Priority: 3 (Normal) X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook IMO, Build 9.0.2416 (9.0.2911.0) X-MimeOLE: Produced By Microsoft MimeOLE V5.00.2919.6600 Importance: Normal In-Reply-To: <20000417211743.A589@relativity.student.utwente.nl> Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org I can help test on the following systems (that all have the same issue as stated of hanging on boot): Dell 2450 two P-III 733mhz Dell 2400 two P-III 533mhz Dell 4400 two Xeon 733mhz Eric Duncan eric@cdc.net -----Original Message----- From: owner-freebsd-smp@FreeBSD.ORG [mailto:owner-freebsd-smp@FreeBSD.ORG]On Behalf Of Dave Boers Sent: Monday, April 17, 2000 2:18 PM To: FreeBSD-smp@FreeBSD.org Cc: Tommy Hallgren; Jeremiah Gowdy; bart@ixori.demon.nl; Matthew Dillon Subject: Re: SMP and vn On Mon, Apr 03, 2000 at 11:51:24AM +0200, Dave Boers wrote: > [Ongoing story about 4.0 hangs on SMP systems] I finally found what triggers the hangs we have been talking about. On my system they are triggered by licq and cdrecord. The one thing those applications have in common is that they use Posix scheduling. I have used licq remote and I did not use cdrecord or other applications that use Posix scheduling for the past 15 days and my uptime is also 15 days. That's the longest uptime since a long time for this system! I suspect that the people who have suspected XFree86 of crashing their system had it compiled with support for pthreads... Anyway, as far as I am concerned, the answer is there now: posix scheduling has bugs on smp systems; those bugs were likely introduced in 4.0-current somewhere in december 1999 or january 2000. If anyone wants to look into the problem, I can help testing. From what I know, it looks like the kernel is looping (because there is no panic). Regards, Dave. -- djb@ifa.au.dk d.j.boers@tn.utwente.nl PGP key: ftp://relativity.student.utwente.nl:/pub/pgpkeys/djb.asc To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Tue Apr 18 4:44:51 2000 Delivered-To: freebsd-smp@freebsd.org Received: from TYO203.gate.nec.co.jp (TYO203.gate.nec.co.jp [202.32.8.211]) by hub.freebsd.org (Postfix) with ESMTP id E49DC37B651 for ; Tue, 18 Apr 2000 04:44:43 -0700 (PDT) (envelope-from mihara@prd.fc.nec.co.jp) Received: from mailsv.nec.co.jp (mailsv-le1 [192.168.1.90]) by TYO203.gate.nec.co.jp (8.9.3/3.7W00031314) with ESMTP id UAA14062 for ; Tue, 18 Apr 2000 20:44:42 +0900 (JST) Received: from elmer.prd.fc.nec.co.jp (root@elmer.prd.fc.nec.co.jp [10.32.193.1]) by mailsv.nec.co.jp (8.9.3/3.7W-MAILSV-NEC) with ESMTP id UAA05347 for ; Tue, 18 Apr 2000 20:44:41 +0900 (JST) Received: from oz.prd.fc.nec.co.jp (oz.prd.fc.nec.co.jp [10.32.193.3]) by elmer.prd.fc.nec.co.jp (8.8.8/3.6W-00032121) with ESMTP id UAA05127 for ; Tue, 18 Apr 2000 20:44:40 +0900 (JST) Date: Tue, 18 Apr 2000 20:44:23 +0900 Message-ID: <86hfczbpm0.wl@oz.prd.fc.nec.co.jp> From: Osamu MIHARA To: freebsd-smp@freebsd.org Subject: Multiple APIC support (RE: Issues with Spankin' new Poweredge 4400 w/ dual 866's and 133MHz FSB?) In-Reply-To: In your message of "Sat, 15 Apr 2000 18:57:53 -0500" References: User-Agent: Wanderlust/1.1.0 (Overjoyed) SEMI/1.13.7 (Awazu) FLIM/1.13.2 (Kasanui) MULE XEmacs/21.1 (patch 9) (Canyonlands) (i386-unknown-freebsd3.4) Organization: NEC Corporation, Tokyo Japan MIME-Version: 1.0 (generated by SEMI 1.13.7 - "Awazu") Content-Type: text/plain; charset=US-ASCII Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org I have tested SMP kernel on another machine which has 2 IO-APICs. The machine is NEC's Express5800/140, with dual Pentium 100Mhz CPUs and Intel's chipset. This machine has a bios menu which I can choose disable/enable second IO-APIC. When disabling the second IO-APIC, the SMP kernel boot up without problem. However, if I enables the second IO-APIC, the kernel causes panic while booting (after detecting adv1, maybe while testing APIC_IO). The question is if FreeBSD supports multiple APICs? If it's not, it is not a RCC chipset specific problem. I would like to know if there are machines with multiple APICs which can run SMP kernel. Boot message when the second APIC is disabled and mptable output follows. -- Osamu MIHARA // NEC Printers Division Copyright (c) 1992-2000 The FreeBSD Project. Copyright (c) 1982, 1986, 1989, 1991, 1993 The Regents of the University of California. All rights reserved. FreeBSD 5.0-CURRENT #0: Tue Apr 18 20:16:45 JST 2000 root@swd-poseidon.prd.fc.nec.co.jp:/usr/src/sys/compile/POSEIDON Timecounter "i8254" frequency 1193182 Hz CPU: Pentium/P54C (97.00-MHz 586-class CPU) Origin = "GenuineIntel" Id = 0x525 Stepping = 5 Features=0x3bf real memory = 100663296 (98304K bytes) FreeBSD Kernel Configuration Utility - Version 1.2 Type "help" for help or "visual" to go to the visual configuration interface (requires MGA/VGA display or serial terminal capable of displaying ANSI graphics). Programming 16 pins in IOAPIC #0 IOAPIC #0 intpin 2 -> irq 0 Programming 16 pins in IOAPIC #1 FreeBSD/SMP: Multiprocessor motherboard cpu0 (BSP): apic id: 0, version: 0x00030010, at 0xfee00000 cpu1 (AP): apic id: 3, version: 0x00030010, at 0xfee00000 io0 (APIC): apic id: 14, version: 0x000f0011, at 0xfec00000 io1 (APIC): apic id: 13, version: 0x000f0011, at 0xfff7ec00 Intel Pentium detected, installing workaround for F00F bug md0: Malloc disk npx0: on motherboard npx0: INT 16 interface pcib0: on motherboard pci0: on pcib0 isab0: at device 14.0 on pci0 eisa0: on isab0 mainboard0: on eisa0 slot 0 ep0: <3Com 3C579-TP EISA Network Adapter> at 0x2000-0x200f, 0x2c80-0x2c89 ep0: irq 5 (level) on eisa0 slot 2 ep0: Ethernet address 00:20:af:ee:b5:04 ep0: supplying EUI64: 00:20:af:ff:fe:ee:b5:04 isa0: on isab0 chip1: <> mem 0xfff7ec00-0xfff7efff at device 15.0 on pci0 pcib1: on motherboard pci1: on pcib1 ahc0: port 0xfc00-0xfcff mem 0xff9fe000-0xff9fefff irq 10 at device 13.0 on pci1 ahc0: Using left over BIOS settings ahc0: aic7870 Wide Channel A, SCSI Id=7, 16/255 SCBs ahc1: port 0xf800-0xf8ff mem 0xff9ff000-0xff9fffff irq 10 at device 14.0 on pci1 ahc1: Using left over BIOS settings ahc1: aic7870 Wide Channel A, SCSI Id=7, 16/255 SCBs fdc0: at port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on isa0 fdc0: FIFO enabled, 8 bytes threshold fd0: <1440-KB 3.5" drive> on fdc0 drive 0 atkbdc0: at port 0x60,0x64 on isa0 atkbd0: irq 1 on atkbdc0 psm0: irq 12 on atkbdc0 psm0: model Generic PS/2 mouse, device ID 0 vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 sc0: on isa0 sc0: VGA <16 virtual consoles, flags=0x200> sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0 sio0: type 16550A sio1 at port 0x2f8-0x2ff irq 3 on isa0 sio1: type 16550A ppc0: at port 0x378-0x37f irq 7 on isa0 ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode ppc0: FIFO with 16/16/8 bytes threshold ppi0: on ppbus0 ppi0: can't allocate irq device_probe_and_attach: ppi0 attach returned 12 lpt0: on ppbus0 lpt0: Interrupt-driven port plip0: on ppbus0 adv1: Invalid baseport of 0x20 specified. Neerest valid baseport is 0x100. Failing probe. unknown0: at port 0x20-0x21,0xa0-0xa1 irq 2 on isa0 adv1: Invalid baseport of 0x0 specified. Neerest valid baseport is 0x100. Failing probe. unknown1: at port 0-0xf,0x80-0x90,0x94-0x9f,0xc0-0xde,0x40b,0x410-0x43f,0x481-0x483,0x487,0x489-0x48c,0x4d6 drq 4 on isa0 adv1: Invalid baseport of 0x40 specified. Neerest valid baseport is 0x100. Failing probe. unknown2: at port 0x40-0x43 irq 0 on isa0 adv1: Invalid baseport of 0x70 specified. Neerest valid baseport is 0x100. Failing probe. unknown3: at port 0x70-0x71 irq 8 on isa0 adv1: Invalid baseport of 0x61 specified. Neerest valid baseport is 0x100. Failing probe. unknown4: at port 0x61 on isa0 adv1: Invalid baseport of 0xf0 specified. Neerest valid baseport is 0x100. Failing probe. unknown5: at port 0xf0-0xff irq 13 on isa0 unknown: can't assign resources unknown: can't assign resources unknown6: at port 0x330 iomem 0xe8000-0xfffff,0-0x9ffff,0x100000-0x5ffffff,0xfff80000-0xffffffff,0xfee00000-0xfee00fff,0xfec00000-0xfec003ff on isa0 unknown: can't assign resources unknown: can't assign resources unknown: can't assign resources adv1: Invalid baseport of 0x1f0 specified. Neerest valid baseport is 0x210. Failing probe. unknown7: at port 0x1f0-0x1f7,0x3f6 irq 14 drq 7 on isa0 unknown: can't assign resources unknown: can't assign resources unknown: can't assign resources unknown: can't assign resources adv1: Invalid baseport of 0xd000 specified. Neerest valid baseport is 0x330. Failing probe. unknown8: at port 0xd000-0xd053,0xd080-0xd0a5,0xdc80-0xdc83,0x10,0x11,0x12 on isa0 adv1: Invalid baseport of 0x72 specified. Neerest valid baseport is 0x100. Failing probe. unknown9: at port 0x72-0x73 on isa0 APIC_IO: Testing 8254 interrupt delivery APIC_IO: routing 8254 via IOAPIC #0 intpin 2 Waiting 15 seconds for SCSI devices to settle SMP: AP CPU #1 Launched! Mounting root from ufs:da0s1a da0 at ahc0 bus 0 target 0 lun 0 da0: Fixed Direct Access SCSI-2 device da0: 20.000MB/s transfers (10.000MHz, offset 8, 16bit), Tagged Queueing Enabled da0: 2049MB (4197405 512 byte sectors: 64H 32S/T 2049C) cd0 at ahc0 bus 0 target 2 lun 0 cd0: Removable CD-ROM SCSI-2 device cd0: 4.901MB/s transfers (4.901MHz, offset 15) cd0: Attempt to query device size failed: NOT READY, Medium not present WARNING: run /dev/MAKEDEV before 2000-06-01 to get rid of block devices ep0: starting DAD for fe80:0001::0220:afff:feee:b504 ep0: DAD complete for fe80:0001::0220:afff:feee:b504 - no duplicates found ahc1: Data Parity Error Detected during address or write data phase =============================================================================== MPTable, version 2.0.15 ------------------------------------------------------------------------------- MP Floating Pointer Structure: location: BIOS physical address: 0x000f2700 signature: '_MP_' length: 16 bytes version: 1.4 checksum: 0x5a mode: Virtual Wire ------------------------------------------------------------------------------- MP Config Table Header: physical address: 0x000f2710 signature: 'PCMP' base table length: 276 version: 1.4 checksum: 0xf5 OEM ID: 'INTEL ' Product ID: 'XXPRESS ' OEM table pointer: 0x00000000 OEM table size: 0 entry count: 26 local APIC address: 0xfee00000 extended table length: 244 extended table checksum: 162 ------------------------------------------------------------------------------- MP Config Base Table Entries: -- Processors: APIC ID Version State Family Model Step Flags 0 0x10 BSP, usable 5 2 5 0x03bf 3 0x10 AP, usable 5 2 5 0x03bf -- Bus: Bus ID Type 0 PCI 1 PCI 18 XPRESS 19 EISA -- I/O APICs: APIC ID Version State Address 14 0x11 usable 0xfec00000 13 0x11 usable 0xfff7ec00 -- I/O Ints: Type Polarity Trigger Bus ID IRQ APIC ID PIN# ExtINT active-hi edge 19 0 14 0 INT active-hi edge 19 1 14 1 INT active-hi edge 19 0 14 2 INT active-hi edge 19 3 14 3 INT active-hi edge 19 4 14 4 INT active-hi edge 19 5 14 5 INT active-hi edge 19 6 14 6 INT active-hi edge 19 7 14 7 INT active-hi edge 19 8 14 8 INT active-hi edge 19 9 14 9 INT conforms level 19 10 14 10 INT active-hi edge 19 11 14 11 INT active-hi edge 19 12 14 12 INT active-hi edge 19 13 14 13 INT active-hi edge 19 14 14 14 INT active-hi edge 19 15 14 15 -- Local Ints: Type Polarity Trigger Bus ID IRQ APIC ID PIN# ExtINT active-hi edge 19 0 255 0 NMI active-hi edge 0 0:A 255 1 ------------------------------------------------------------------------------- MP Config Extended Table Entries: -- bus ID: 18 address type: memory address address base: 0x0 address range: 0xa0000 -- bus ID: 18 address type: memory address address base: 0xc0000 address range: 0x5f40000 -- bus ID: 1 address type: memory address address base: 0xff900000 address range: 0x100000 -- bus ID: 1 address type: I/O address address base: 0xf000 address range: 0x400 -- bus ID: 1 address type: I/O address address base: 0xf400 address range: 0x400 -- bus ID: 1 address type: I/O address address base: 0xf800 address range: 0x400 -- bus ID: 1 address type: I/O address address base: 0xfc00 address range: 0x400 -- bus ID: 0 address type: memory address address base: 0xa0000 address range: 0x20000 -- bus ID: 0 address type: memory address address base: 0x6000000 address range: 0xf9900000 -- bus ID: 0 address type: memory address address base: 0xffa00000 address range: 0x600000 -- bus ID: 0 address type: I/O address address base: 0x0 address range: 0xf000 -- bus ID: 19 bus info: 0x01 parent bus ID: 0-- bus ID: 0 address modifier: add predefined range: 0x00000000-- bus ID: 1 address modifier: subtract predefined range: 0x00000000 ------------------------------------------------------------------------------- # SMP kernel config file options: # Required: options SMP # Symmetric MultiProcessor Kernel options APIC_IO # Symmetric (APIC) I/O # Optional (built-in defaults will work in most cases): #options NCPU=2 # number of CPUs #options NBUS=4 # number of busses #options NAPIC=2 # number of IO APICs #options NINTR=24 # number of INTs =============================================================================== To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Tue Apr 18 8:36:44 2000 Delivered-To: freebsd-smp@freebsd.org Received: from Ilsa.StevesCafe.com (Ilsa.StevesCafe.com [206.168.13.65]) by hub.freebsd.org (Postfix) with ESMTP id D2A0C37B9A3 for ; Tue, 18 Apr 2000 08:36:38 -0700 (PDT) (envelope-from fbsd@Ilsa.StevesCafe.com) Received: from Ilsa.StevesCafe.com (localhost [127.0.0.1]) by Ilsa.StevesCafe.com (8.9.3/8.9.3) with ESMTP id JAA60882; Tue, 18 Apr 2000 09:36:32 -0600 (MDT) (envelope-from fbsd@Ilsa.StevesCafe.com) Message-Id: <200004181536.JAA60882@Ilsa.StevesCafe.com> X-Mailer: exmh version 2.0.2 2/24/98 From: Steve Passe To: Osamu MIHARA Cc: freebsd-smp@FreeBSD.ORG Subject: Re: Multiple APIC support (RE: Issues with Spankin' new Poweredge 4400 w/ dual 866's and 133MHz FSB?) In-reply-to: Your message of "Tue, 18 Apr 2000 20:44:23 +0900." <86hfczbpm0.wl@oz.prd.fc.nec.co.jp> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Tue, 18 Apr 2000 09:36:32 -0600 Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org Hi, > I have tested SMP kernel on another machine which has 2 IO-APICs. The > machine is NEC's Express5800/140, with dual Pentium 100Mhz CPUs and > Intel's chipset. This machine has a bios menu which I can choose > disable/enable second IO-APIC. When disabling the second IO-APIC, the > SMP kernel boot up without problem. However, if I enables the second > IO-APIC, the kernel causes panic while booting (after detecting adv1, > maybe while testing APIC_IO). > > The question is if FreeBSD supports multiple APICs? If it's not, it > is not a RCC chipset specific problem. I would like to know if there > are machines with multiple APICs which can run SMP kernel. > > Boot message when the second APIC is disabled and mptable output > follows. ... > Programming 16 pins in IOAPIC #0 > IOAPIC #0 intpin 2 -> irq 0 > Programming 16 pins in IOAPIC #1 > FreeBSD/SMP: Multiprocessor motherboard > cpu0 (BSP): apic id: 0, version: 0x00030010, at 0xfee00000 > cpu1 (AP): apic id: 3, version: 0x00030010, at 0xfee00000 > io0 (APIC): apic id: 14, version: 0x000f0011, at 0xfec00000 > io1 (APIC): apic id: 13, version: 0x000f0011, at 0xfff7ec00 ^^^^^^^ Its been awhile since I worked on this stuff, but this address looks 'wrong' to me. It might be because the 2nd APIC wasn't enabled and thus wasn't mapped in memory properly... What address does it get when its enabled? -- Steve Passe | powered by smp@csn.net | Symmetric MultiProcessor FreeBSD To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Tue Apr 18 17:44: 4 2000 Delivered-To: freebsd-smp@freebsd.org Received: from TYO202.gate.nec.co.jp (TYO202.gate.nec.co.jp [202.247.6.41]) by hub.freebsd.org (Postfix) with ESMTP id 5B19937B6E0 for ; Tue, 18 Apr 2000 17:43:58 -0700 (PDT) (envelope-from mihara@prd.fc.nec.co.jp) Received: from mailsv4.nec.co.jp (mailsv4-le1 [192.168.1.93]) by TYO202.gate.nec.co.jp (8.9.3/3.7W00031314) with ESMTP id JAA16928 for ; Wed, 19 Apr 2000 09:43:55 +0900 (JST) Received: from elmer.prd.fc.nec.co.jp (root@elmer.prd.fc.nec.co.jp [10.32.193.1]) by mailsv4.nec.co.jp (8.9.3/3.7W-MAILSV4-NEC) with ESMTP id JAA04609 for ; Wed, 19 Apr 2000 09:43:55 +0900 (JST) Received: from oz.prd.fc.nec.co.jp (oz.prd.fc.nec.co.jp [10.32.193.3]) by elmer.prd.fc.nec.co.jp (8.8.8/3.6W-00032121) with ESMTP id JAA13826 for ; Wed, 19 Apr 2000 09:43:53 +0900 (JST) Date: Wed, 19 Apr 2000 09:43:35 +0900 Message-ID: <86d7nmc43s.wl@oz.prd.fc.nec.co.jp> From: Osamu MIHARA To: freebsd-smp@FreeBSD.ORG Subject: Re: Multiple APIC support (RE: Issues with Spankin' new Poweredge 4400 w/ dual 866's and 133MHz FSB?) In-Reply-To: In your message of "Tue, 18 Apr 2000 09:36:32 -0600" <200004181536.JAA60882@Ilsa.StevesCafe.com> References: <86hfczbpm0.wl@oz.prd.fc.nec.co.jp> <200004181536.JAA60882@Ilsa.StevesCafe.com> User-Agent: Wanderlust/1.1.0 (Overjoyed) SEMI/1.13.7 (Awazu) FLIM/1.13.2 (Kasanui) MULE XEmacs/21.1 (patch 9) (Canyonlands) (i386-unknown-freebsd3.4) Organization: NEC Corporation, Tokyo Japan MIME-Version: 1.0 (generated by SEMI 1.13.7 - "Awazu") Content-Type: text/plain; charset=US-ASCII Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org At Tue, 18 Apr 2000 09:36:32 -0600, Steve Passe wrote: > > io1 (APIC): apic id: 13, version: 0x000f0011, at 0xfff7ec00 > ^^^^^^^ > Its been awhile since I worked on this stuff, but this address looks 'wrong' > to me. It might be because the 2nd APIC wasn't enabled and thus wasn't mapped > in memory properly... What address does it get when its enabled? Here is the boot log when it's enabled. The address is same as above. I guess this address comes from mptable. > I/O APICs: APIC ID Version State Address > 14 0x11 usable 0xfec00000 > 13 0x11 usable 0xfff7ec00 --- Copyright (c) 1992-2000 The FreeBSD Project. Copyright (c) 1982, 1986, 1989, 1991, 1993 The Regents of the University of California. All rights reserved. FreeBSD 5.0-CURRENT #0: Tue Apr 18 20:16:45 JST 2000 root@swd-poseidon.prd.fc.nec.co.jp:/usr/src/sys/compile/POSEIDON Timecounter "i8254" frequency 1193182 Hz CPU: Pentium/P54C (99.00-MHz 586-class CPU) Origin = "GenuineIntel" Id = 0x525 Stepping = 5 Features=0x3bf real memory = 100663296 (98304K bytes) avail memory = 94220288 (92012K bytes) Programming 16 pins in IOAPIC #0 IOAPIC #0 intpin 2 -> irq 0 Programming 16 pins in IOAPIC #1 IOAPIC #1 intpin 0 -> irq 2 IOAPIC #1 intpin 1 -> irq 16 IOAPIC #1 intpin 2 -> irq 17 IOAPIC #1 intpin 3 -> irq 18 IOAPIC #1 intpin 4 -> irq 19 IOAPIC #1 intpin 5 -> irq 20 IOAPIC #1 intpin 6 -> irq 21 IOAPIC #1 intpin 7 -> irq 22 IOAPIC #1 intpin 12 -> irq 23 FreeBSD/SMP: Multiprocessor motherboard cpu0 (BSP): apic id: 0, version: 0x00030010, at 0xfee00000 cpu1 (AP): apic id: 3, version: 0x00030010, at 0xfee00000 io0 (APIC): apic id: 14, version: 0x000f0011, at 0xfec00000 io1 (APIC): apic id: 13, version: 0x000f0011, at 0xfff7ec00 Intel Pentium detected, installing workaround for F00F bug md0: Malloc disk npx0: on motherboard npx0: INT 16 interface pcib0: on motherboard pci0: on pcib0 isab0: at device 14.0 on pci0 eisa0: on isab0 mainboard0: on eisa0 slot 0 ep0: <3Com 3C579-TP EISA Network Adapter> at 0x2000-0x200f, 0x2c80-0x2c89 ep0: irq 5 (level) on eisa0 slot 2 ep0: Ethernet address 00:20:af:ee:b5:04 ep0: supplying EUI64: 00:20:af:ff:fe:ee:b5:04 isa0: on isab0 chip1: <> mem 0xfff7ec00-0xfff7efff at device 15.0 on pci0 pcib1: on motherboard pci1: on pcib1 ahc0: port 0xfc00-0xfcff mem 0xff9fe000-0xff9feff f irq 23 at device 13.0 on pci1 ahc0: Using left over BIOS settings ahc0: aic7870 Wide Channel A, SCSI Id=7, 16/255 SCBs ahc1: port 0xf800-0xf8ff mem 0xff9ff000-0xff9ffff f at device 14.0 on pci1 Fatal trap 12: page fault while in kernel mode mp_lock = 00000002; cpuid = 0; lapic.id = 00000000 fault virtual address = 0x1c fault code = supervisor read, page not present instruction pointer = 0x8:0xc02c4dc0 stack pointer = 0x10:0xc039be54 frame pointer = 0x10:0xc039be54 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, def32 1, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 0 (swapper) interrupt mask = net tty bio cam <- SMP: XXX trap number = 12 panic: page fault mp_lock = 00000002; cpuid = 0; lapic.id = 00000000 Uptime: 0s Automatic reboot in 15 seconds - press a key on the console to abort --> Press a key on the console to reboot <-- -- Osamu MIHARA // NEC Printers Division To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Tue Apr 18 23:45: 5 2000 Delivered-To: freebsd-smp@freebsd.org Received: from Ilsa.StevesCafe.com (Ilsa.StevesCafe.com [206.168.13.65]) by hub.freebsd.org (Postfix) with ESMTP id B866137BC0D for ; Tue, 18 Apr 2000 23:45:03 -0700 (PDT) (envelope-from fbsd@Ilsa.StevesCafe.com) Received: from Ilsa.StevesCafe.com (localhost [127.0.0.1]) by Ilsa.StevesCafe.com (8.9.3/8.9.3) with ESMTP id AAA65180; Wed, 19 Apr 2000 00:44:54 -0600 (MDT) (envelope-from fbsd@Ilsa.StevesCafe.com) Message-Id: <200004190644.AAA65180@Ilsa.StevesCafe.com> X-Mailer: exmh version 2.0.2 2/24/98 From: Steve Passe To: Osamu MIHARA Cc: freebsd-smp@FreeBSD.ORG Subject: Re: Multiple APIC support (RE: Issues with Spankin' new Poweredge 4400 w/ dual 866's and 133MHz FSB?) In-reply-to: Your message of "Wed, 19 Apr 2000 09:43:35 +0900." <86d7nmc43s.wl@oz.prd.fc.nec.co.jp> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Wed, 19 Apr 2000 00:44:54 -0600 Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org Hi, > At Tue, 18 Apr 2000 09:36:32 -0600, > Steve Passe wrote: > > > io1 (APIC): apic id: 13, version: 0x000f0011, at 0xfff7ec00 > > ^^^^^^^ > > Its been awhile since I worked on this stuff, but this address looks 'wrong' > > to me. It might be because the 2nd APIC wasn't enabled and thus wasn't mapped > > in memory properly... What address does it get when its enabled? > > Here is the boot log when it's enabled. The address is same as above. > I guess this address comes from mptable. > > > I/O APICs: APIC ID Version State Address > > 14 0x11 usable 0xfec00000 > > 13 0x11 usable 0xfff7ec00 We need to get one of the VM guys to look at the code in pmap.c:pmap_bootstrap() around line 422. I think this code assumes that IO apics are aligned to a PAGE_SIZE boundary which isn't true for your second IO apic @ 0xfff7ec00. -- Steve Passe | powered by smp@csn.net | Symmetric MultiProcessor FreeBSD To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Wed Apr 19 0:10:16 2000 Delivered-To: freebsd-smp@freebsd.org Received: from verdi.nethelp.no (verdi.nethelp.no [158.36.41.162]) by hub.freebsd.org (Postfix) with SMTP id 30B4337B696 for ; Wed, 19 Apr 2000 00:10:10 -0700 (PDT) (envelope-from sthaug@nethelp.no) Received: (qmail 81643 invoked by uid 1001); 19 Apr 2000 07:10:07 +0000 (GMT) To: smp@csn.net Cc: mihara@prd.fc.nec.co.jp, freebsd-smp@FreeBSD.ORG Subject: Re: Multiple APIC support (RE: Issues with Spankin' new Poweredge 4400 w/ dual 866's and 133MHz FSB?) From: sthaug@nethelp.no In-Reply-To: Your message of "Wed, 19 Apr 2000 00:44:54 -0600" References: <200004190644.AAA65180@Ilsa.StevesCafe.com> X-Mailer: Mew version 1.05+ on Emacs 19.34.2 Mime-Version: 1.0 Content-Type: Text/Plain; charset=us-ascii Date: Wed, 19 Apr 2000 09:10:07 +0200 Message-ID: <81641.956128207@verdi.nethelp.no> Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org > > > I/O APICs: APIC ID Version State Address > > > 14 0x11 usable 0xfec00000 > > > 13 0x11 usable 0xfff7ec00 > > We need to get one of the VM guys to look at the code in > pmap.c:pmap_bootstrap() > around line 422. I think this code assumes that IO apics are aligned to > a PAGE_SIZE boundary which isn't true for your second IO apic @ 0xfff7ec00. However, this is not the problem for the IBM Netfinity 5600 servers with the RCC chipset: I/O APICs: APIC ID Version State Address 14 0x11 usable 0xfec00000 15 0x11 usable 0xfec01000 It still panics. Full mptable output below. Steinar Haug, Nethelp consulting, sthaug@nethelp.no =============================================================================== MPTable, version 2.0.15 ------------------------------------------------------------------------------- MP Floating Pointer Structure: location: EBDA physical address: 0x0009e140 signature: '_MP_' length: 16 bytes version: 1.4 checksum: 0xd1 mode: Virtual Wire ------------------------------------------------------------------------------- MP Config Table Header: physical address: 0x0009e6e0 signature: 'PCMP' base table length: 444 version: 1.4 checksum: 0x70 OEM ID: 'IBM GNK ' Product ID: 'Teton SMP ' OEM table pointer: 0x00000000 OEM table size: 0 entry count: 47 local APIC address: 0xfee00000 extended table length: 156 extended table checksum: 37 ------------------------------------------------------------------------------- MP Config Base Table Entries: -- Processors: APIC ID Version State Family Model Step Flags 1 0x11 BSP, usable 6 8 1 0x0301 0 0x11 AP, usable 6 8 1 0x0301 -- Bus: Bus ID Type 0 PCI 1 PCI 2 PCI 3 PCI 4 PCI 5 PCI 6 ISA -- I/O APICs: APIC ID Version State Address 14 0x11 usable 0xfec00000 15 0x11 usable 0xfec01000 -- I/O Ints: Type Polarity Trigger Bus ID IRQ APIC ID PIN# ExtINT active-hi edge 6 0 14 0 INT active-hi edge 6 1 14 1 INT active-hi edge 6 0 14 2 INT active-hi edge 6 3 14 3 INT active-hi edge 6 4 14 4 INT active-hi edge 6 6 14 6 INT active-hi edge 6 7 14 7 INT active-hi edge 6 8 14 8 INT active-hi edge 6 10 14 10 INT active-hi edge 6 11 14 11 INT active-hi edge 6 12 14 12 INT active-hi edge 6 13 14 13 INT active-hi edge 6 14 14 14 INT active-hi edge 6 15 14 15 INT active-lo level 0 2:A 15 11 INT active-lo level 0 9:A 15 0 INT active-lo level 1 4:A 15 2 INT active-lo level 1 5:A 15 3 INT active-lo level 2 3:A 15 12 INT active-lo level 2 3:A 15 13 INT active-lo level 2 5:A 15 4 INT active-lo level 2 5:B 15 5 INT active-lo level 2 5:C 15 4 INT active-lo level 2 5:D 15 5 INT active-lo level 2 6:A 15 6 INT active-lo level 2 6:B 15 7 INT active-lo level 2 6:C 15 6 INT active-lo level 2 6:D 15 7 INT active-lo level 2 7:A 15 8 INT active-lo level 2 7:B 15 9 INT active-lo level 2 7:C 15 8 INT active-lo level 2 7:D 15 9 INT active-lo level 6 5 15 10 INT active-lo level 0 15:A 14 9 -- Local Ints: Type Polarity Trigger Bus ID IRQ APIC ID PIN# ExtINT conforms conforms 6 0 255 0 NMI conforms conforms 6 0 255 1 ------------------------------------------------------------------------------- MP Config Extended Table Entries: -- bus ID: 0 address type: memory address address base: 0xf7000000 address range: 0x9000000 -- bus ID: 2 address type: memory address address base: 0x38000000 address range: 0xbf000000 -- bus ID: 0 address type: memory address address base: 0xa0000 address range: 0x20000 -- bus ID: 0 address type: memory address address base: 0xc0000 address range: 0x10000 -- bus ID: 0 address type: I/O address address base: 0x0 address range: 0x4aec -- bus ID: 0 address type: I/O address address base: 0x82e8 address range: 0x7d17 -- bus ID: 2 address type: I/O address address base: 0x4aec address range: 0x37fc -- bus ID: 1 bus info: 0x00 parent bus ID: 0-- bus ID: 6 bus info: 0x01 parent bus ID: 0 ------------------------------------------------------------------------------- # SMP kernel config file options: # Required: options SMP # Symmetric MultiProcessor Kernel options APIC_IO # Symmetric (APIC) I/O # Optional (built-in defaults will work in most cases): #options NCPU=2 # number of CPUs #options NBUS=7 # number of busses #options NAPIC=2 # number of IO APICs #options NINTR=34 # number of INTs =============================================================================== To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Wed Apr 19 7: 7:56 2000 Delivered-To: freebsd-smp@freebsd.org Received: from verdi.nethelp.no (verdi.nethelp.no [158.36.41.162]) by hub.freebsd.org (Postfix) with SMTP id B73F637BCEA for ; Wed, 19 Apr 2000 07:07:39 -0700 (PDT) (envelope-from sthaug@nethelp.no) Received: (qmail 88253 invoked by uid 1001); 19 Apr 2000 14:05:27 +0000 (GMT) To: smp@csn.net, mihara@prd.fc.nec.co.jp, freebsd-smp@FreeBSD.ORG Subject: Re: Multiple APIC support (RE: Issues with Spankin' new Poweredge 4400 w/ dual 866's and 133MHz FSB?) From: sthaug@nethelp.no In-Reply-To: Your message of "Wed, 19 Apr 2000 09:10:07 +0200" References: <81641.956128207@verdi.nethelp.no> X-Mailer: Mew version 1.05+ on Emacs 19.34.2 Mime-Version: 1.0 Content-Type: Text/Plain; charset=us-ascii Date: Wed, 19 Apr 2000 16:05:27 +0200 Message-ID: <88251.956153127@verdi.nethelp.no> Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org > However, this is not the problem for the IBM Netfinity 5600 servers with > the RCC chipset: > > I/O APICs: APIC ID Version State Address > 14 0x11 usable 0xfec00000 > 15 0x11 usable 0xfec01000 > > It still panics. A bit more info: No, it doesn't panic. Instead it hangs (hard!) after detecting the serial ports. Doesn't react to DDB and ctrl-alt-esc either. Below is a dmesg printout from a normal uniprocessor startup, and kernel config pluss mptable for the SMP case. With two processors, there are a couple of interesting messages as the builtin Adaptec two-channel SCSI controller is probed: ahc1: rev 0x00 int a irq 19 on pci2.3.0 bogus MP table, 2 IO APIC pins connected to the same PCI device or ISA/EISA interrupt Registered extra interrupt handler for int 20 (in addition to int 19) ahc1: aic7896/97 Wide Channel A, SCSI Id=7, 16/255 SCBs ahc2: rev 0x00 int a irq 19 on pci2.3.1 bogus MP table, 2 IO APIC pins connected to the same PCI device or ISA/EISA interrupt Registered extra interrupt handler for int 20 (in addition to int 19) ahc2: aic7896/97 Wide Channel B, SCSI Id=7, 16/255 SCBs (With one processor these are both on irq 10, and the "bogus MP table" and "Registered extra interrupt handler" messages do not appear.) Steinar Haug, Nethelp consulting, sthaug@nethelp.no ---------------------------------------------------------------------- Copyright (c) 1992-1999 FreeBSD Inc. Copyright (c) 1982, 1986, 1989, 1991, 1993 The Regents of the University of California. All rights reserved. FreeBSD 3.4-STABLE #2: Fri Apr 7 12:44:46 CEST 2000 sthaug@mail1.enitel.no:/usr/src/sys/compile/NF5600 Timecounter "i8254" frequency 1193182 Hz Timecounter "TSC" frequency 599716605 Hz CPU: Pentium III/Pentium III Xeon (599.72-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0x681 Stepping = 1 Features=0x387fbff,MMX,FXSR,> real memory = 939524096 (917504K bytes) avail memory = 911769600 (890400K bytes) Preloaded elf kernel "kernel" at 0xc02d8000. Pentium Pro MTRR support enabled Probing for devices on PCI bus 0: chip0: rev 0x05 on pci0.0.0 chip1: rev 0x05 on pci0.0.1 vga0: rev 0x01 int a irq 255 on pci0.1.0 lnc1: rev 0x43 int a irq 11 on pci0.2.0 ahc0: rev 0x00 int a irq 10 on pci0.9.0 ahc0: aic7890/91 Wide Channel A, SCSI Id=7, 16/255 SCBs chip2: rev 0x03 on pci0.10.0 chip3: rev 0x4f on pci0.15.0 Probing for devices on PCI bus 1: fxp0: rev 0x05 int a irq 15 on pci1.4.0 fxp0: Ethernet address 00:d0:b7:5f:b7:a8 fxp1: rev 0x05 int a irq 11 on pci1.5.0 fxp1: Ethernet address 00:d0:b7:5f:b7:a9 Probing for devices on PCI bus 2: ahc1: rev 0x00 int a irq 10 on pci2.3.0 ahc1: aic7896/97 Wide Channel A, SCSI Id=7, 16/255 SCBs ahc2: rev 0x00 int a irq 10 on pci2.3.1 ahc2: aic7896/97 Wide Channel B, SCSI Id=7, 16/255 SCBs ti0: rev 0x01 int a irq 15 on pci2.5.0 ti0: Ethernet address: 00:a0:cc:73:32:dd Probing for devices on the ISA bus: sc0 on isa sc0: VGA color <16 virtual consoles, flags=0x0> atkbdc0 at 0x60-0x6f on motherboard atkbd0 irq 1 on isa psm0 not found sio0 at 0x3f8-0x3ff irq 4 flags 0x10 on isa sio0: type 16550A sio1 at 0x2f8-0x2ff irq 3 on isa sio1: type 16550A fdc0 at 0x3f0-0x3f7 irq 6 drq 2 on isa fdc0: FIFO enabled, 8 bytes threshold fd0: 1.44MB 3.5in lnc0 not found at 0x280 vga0 at 0x3b0-0x3df maddr 0xa0000 msize 131072 on isa npx0 on motherboard npx0: INT 16 interface Waiting 3 seconds for SCSI devices to settle sa0 at ahc0 bus 0 target 0 lun 0 sa0: Removable Sequential Access SCSI-2 device sa0: 40.000MB/s transfers (20.000MHz, offset 15, 16bit) pass1 at ahc0 bus 0 target 0 lun 1 pass1: Removable Changer SCSI-2 device pass1: 40.000MB/s transfers (20.000MHz, offset 15, 16bit) pass4 at ahc1 bus 0 target 15 lun 0 pass4: Fixed Processor SCSI-2 device pass4: 3.300MB/s transfers changing root device to da0s1a da0 at ahc1 bus 0 target 0 lun 0 da0: Fixed Direct Access SCSI-2 device da0: 80.000MB/s transfers (40.000MHz, offset 15, 16bit), Tagged Queueing Enabled da0: 8678MB (17774160 512 byte sectors: 255H 63S/T 1106C) da1 at ahc1 bus 0 target 1 lun 0 da1: Fixed Direct Access SCSI-2 device da1: 80.000MB/s transfers (40.000MHz, offset 15, 16bit), Tagged Queueing Enabled da1: 8678MB (17774160 512 byte sectors: 255H 63S/T 1106C) ---------------------------------------------------------------------- # $FreeBSD: src/sys/i386/conf/GENERIC,v 1.143.2.27 2000/03/01 10:51:37 nik Exp $ machine "i386" cpu "I686_CPU" ident "NF5600" maxusers 50 options MATH_EMULATE #Support for x87 emulation options INET #InterNETworking options FFS #Berkeley Fast Filesystem options FFS_ROOT #FFS usable as root device [keep this!] options NFS #Network Filesystem options NFS_ROOT #NFS usable as root device, "NFS" req'ed options MSDOSFS #MSDOS Filesystem options "CD9660" #ISO 9660 Filesystem options "CD9660_ROOT" #CD-ROM usable as root. "CD9660" req'ed options PROCFS #Process filesystem options "COMPAT_43" #Compatible with BSD 4.3 [KEEP THIS!] options SCSI_DELAY=3000 #Be pessimistic about Joe SCSI device options UCONSOLE #Allow users to grab the console options USERCONFIG #boot -c editor options VISUAL_USERCONFIG #visual boot -c editor options KTRACE #ktrace(1) syscall trace support options SYSVSHM #SYSV-style shared memory options SYSVMSG #SYSV-style message queues options SYSVSEM #SYSV-style semaphores options MSGBUF_SIZE=32768 options INCLUDE_CONFIG_FILE # Include this file in kernel options SOFTUPDATES options DDB config kernel root on da0 options SMP # Symmetric MultiProcessor Kernel options APIC_IO # Symmetric (APIC) I/O # Optionally these may need tweaked, (defaults shown): #options NCPU=2 # number of CPUs options NBUS=7 # number of busses options NAPIC=2 # number of IO APICs options NINTR=34 # number of INTs controller isa0 controller pci0 controller fdc0 at isa? port "IO_FD1" bio irq 6 drq 2 disk fd0 at fdc0 drive 0 controller ahc0 # AHA2940 and onboard AIC7xxx devices controller scbus0 # SCSI bus (required) device da0 # Direct Access (disks) device sa0 # Sequential Access (tape etc) device cd0 # CD device pass0 # Passthrough device (direct SCSI) controller atkbdc0 at isa? port IO_KBD tty device atkbd0 at isa? tty irq 1 device psm0 at isa? tty irq 12 device vga0 at isa? port ? conflicts device sc0 at isa? tty device npx0 at isa? port IO_NPX irq 13 device sio0 at isa? port "IO_COM1" flags 0x10 tty irq 4 device sio1 at isa? port "IO_COM2" tty irq 3 device de0 # DEC/Intel DC21x4x (``Tulip'') device fxp0 # Intel EtherExpress PRO/100B (82557, 82558) device ti0 device lnc0 at isa? port 0x280 net irq 10 drq 0 pseudo-device loop # Network loopback pseudo-device ether # Ethernet support pseudo-device ppp 1 # Kernel PPP pseudo-device tun 1 # Packet tunnel pseudo-device pty 32 # Pseudo-ttys (telnet etc) pseudo-device gzip # Exec gzipped a.out's pseudo-device bpfilter 4 #Berkeley packet filter =============================================================================== MPTable, version 2.0.15 ------------------------------------------------------------------------------- MP Floating Pointer Structure: location: EBDA physical address: 0x0009e140 signature: '_MP_' length: 16 bytes version: 1.4 checksum: 0xd1 mode: Virtual Wire ------------------------------------------------------------------------------- MP Config Table Header: physical address: 0x0009e6e0 signature: 'PCMP' base table length: 444 version: 1.4 checksum: 0x70 OEM ID: 'IBM GNK ' Product ID: 'Teton SMP ' OEM table pointer: 0x00000000 OEM table size: 0 entry count: 47 local APIC address: 0xfee00000 extended table length: 156 extended table checksum: 37 ------------------------------------------------------------------------------- MP Config Base Table Entries: -- Processors: APIC ID Version State Family Model Step Flags 1 0x11 BSP, usable 6 8 1 0x0301 0 0x11 AP, usable 6 8 1 0x0301 -- Bus: Bus ID Type 0 PCI 1 PCI 2 PCI 3 PCI 4 PCI 5 PCI 6 ISA -- I/O APICs: APIC ID Version State Address 14 0x11 usable 0xfec00000 15 0x11 usable 0xfec01000 -- I/O Ints: Type Polarity Trigger Bus ID IRQ APIC ID PIN# ExtINT active-hi edge 6 0 14 0 INT active-hi edge 6 1 14 1 INT active-hi edge 6 0 14 2 INT active-hi edge 6 3 14 3 INT active-hi edge 6 4 14 4 INT active-hi edge 6 6 14 6 INT active-hi edge 6 7 14 7 INT active-hi edge 6 8 14 8 INT active-hi edge 6 10 14 10 INT active-hi edge 6 11 14 11 INT active-hi edge 6 12 14 12 INT active-hi edge 6 13 14 13 INT active-hi edge 6 14 14 14 INT active-hi edge 6 15 14 15 INT active-lo level 0 2:A 15 11 INT active-lo level 0 9:A 15 0 INT active-lo level 1 4:A 15 2 INT active-lo level 1 5:A 15 3 INT active-lo level 2 3:A 15 12 INT active-lo level 2 3:A 15 13 INT active-lo level 2 5:A 15 4 INT active-lo level 2 5:B 15 5 INT active-lo level 2 5:C 15 4 INT active-lo level 2 5:D 15 5 INT active-lo level 2 6:A 15 6 INT active-lo level 2 6:B 15 7 INT active-lo level 2 6:C 15 6 INT active-lo level 2 6:D 15 7 INT active-lo level 2 7:A 15 8 INT active-lo level 2 7:B 15 9 INT active-lo level 2 7:C 15 8 INT active-lo level 2 7:D 15 9 INT active-lo level 6 5 15 10 INT active-lo level 0 15:A 14 9 -- Local Ints: Type Polarity Trigger Bus ID IRQ APIC ID PIN# ExtINT conforms conforms 6 0 255 0 NMI conforms conforms 6 0 255 1 ------------------------------------------------------------------------------- MP Config Extended Table Entries: -- bus ID: 0 address type: memory address address base: 0xf7000000 address range: 0x9000000 -- bus ID: 2 address type: memory address address base: 0x38000000 address range: 0xbf000000 -- bus ID: 0 address type: memory address address base: 0xa0000 address range: 0x20000 -- bus ID: 0 address type: memory address address base: 0xc0000 address range: 0x10000 -- bus ID: 0 address type: I/O address address base: 0x0 address range: 0x4aec -- bus ID: 0 address type: I/O address address base: 0x82e8 address range: 0x7d17 -- bus ID: 2 address type: I/O address address base: 0x4aec address range: 0x37fc -- bus ID: 1 bus info: 0x00 parent bus ID: 0-- bus ID: 6 bus info: 0x01 parent bus ID: 0 ------------------------------------------------------------------------------- # SMP kernel config file options: # Required: options SMP # Symmetric MultiProcessor Kernel options APIC_IO # Symmetric (APIC) I/O # Optional (built-in defaults will work in most cases): #options NCPU=2 # number of CPUs #options NBUS=7 # number of busses #options NAPIC=2 # number of IO APICs #options NINTR=34 # number of INTs =============================================================================== To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Wed Apr 19 8:29:37 2000 Delivered-To: freebsd-smp@freebsd.org Received: from Ilsa.StevesCafe.com (Ilsa.StevesCafe.com [206.168.13.65]) by hub.freebsd.org (Postfix) with ESMTP id 1DF8737BCE1 for ; Wed, 19 Apr 2000 08:29:34 -0700 (PDT) (envelope-from fbsd@Ilsa.StevesCafe.com) Received: from Ilsa.StevesCafe.com (localhost [127.0.0.1]) by Ilsa.StevesCafe.com (8.9.3/8.9.3) with ESMTP id JAA67553; Wed, 19 Apr 2000 09:27:58 -0600 (MDT) (envelope-from fbsd@Ilsa.StevesCafe.com) Message-Id: <200004191527.JAA67553@Ilsa.StevesCafe.com> X-Mailer: exmh version 2.0.2 2/24/98 From: Steve Passe To: sthaug@nethelp.no Cc: mihara@prd.fc.nec.co.jp, freebsd-smp@FreeBSD.ORG Subject: Re: Multiple APIC support (RE: Issues with Spankin' new Poweredge 4400 w/ dual 866's and 133MHz FSB?) In-reply-to: Your message of "Wed, 19 Apr 2000 09:10:07 +0200." <81641.956128207@verdi.nethelp.no> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Wed, 19 Apr 2000 09:27:58 -0600 Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org Hi, > > > > I/O APICs: APIC ID Version State Address > > > > 14 0x11 usable 0xfec00000 > > > > 13 0x11 usable 0xfff7ec00 > > > > We need to get one of the VM guys to look at the code in > > pmap.c:pmap_bootstrap() > > around line 422. I think this code assumes that IO apics are aligned to > > a PAGE_SIZE boundary which isn't true for your second IO apic @ 0xfff7ec00. > > However, this is not the problem for the IBM Netfinity 5600 servers with > the RCC chipset: > > I/O APICs: APIC ID Version State Address > 14 0x11 usable 0xfec00000 > 15 0x11 usable 0xfec01000 > I agree, its 2 different issues. -- Steve Passe | powered by smp@csn.net | Symmetric MultiProcessor FreeBSD To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Wed Apr 19 10:26:25 2000 Delivered-To: freebsd-smp@freebsd.org Received: from mail.webmonster.de (datasink.webmonster.de [194.162.162.209]) by hub.freebsd.org (Postfix) with SMTP id DAF0A37B857 for ; Wed, 19 Apr 2000 10:26:19 -0700 (PDT) (envelope-from karsten@rohrbach.de) Received: (qmail 75215 invoked by uid 1000); 19 Apr 2000 17:26:18 -0000 Date: Wed, 19 Apr 2000 19:26:18 +0200 From: "Karsten W. Rohrbach" To: James Housley Cc: freebsd-smp@FreeBSD.ORG Subject: Re: ASUS P2B-D & SMB Message-ID: <20000419192618.C74835@rohrbach.de> Reply-To: karsten@rohrbach.de References: <38F71BBB.9FCD3C8B@thehousleys.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Mailer: Mutt 1.0i In-Reply-To: <38F71BBB.9FCD3C8B@thehousleys.net>; from jim@thehousleys.net on Fri, Apr 14, 2000 at 09:23:07AM -0400 X-Arbitrary-Number-Of-The-Day: 42 X-Sender: karsten@rohrbach.de Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org you enabled apm/acpi in the bios and happen to have something like apm_enable=YES apmd_enable=YES in /etc/rc.conf? apm screws the box, it's not smp safe afaik... /k James Housley(jim@thehousleys.net)@Fri, Apr 14, 2000 at 09:23:07AM -0400: > I have an Asus P2B-D for my server. I tried to enable the SMB in SMP > mode but I get a panic on boot. I don't have a log yet. I added the > following to my SMP kernel to cause the panic. > > controller smbus0 > controller intpm0 > device smb0 at smbus? > controller iicbus0 > controller iicbb0 > device ic0 at iicbus? > device iic0 at iicbus? > device iicsmb0 at iicbus? > controller pcf0 at isa? port 0x320 net irq 5 > > In UP mode it boots fine and produces the following dmesg. > > Copyright (c) 1992-1999 FreeBSD Inc. > Copyright (c) 1982, 1986, 1989, 1991, 1993 > The Regents of the University of California. All rights > reserved. > FreeBSD 3.4-STABLE #0: Fri Apr 14 08:29:18 EDT 2000 > root@cat.int.thehousleys.net:/usr/src/sys/compile/MYKERNELup > Timecounter "i8254" frequency 1193182 Hz > CPU: Pentium II/Pentium II Xeon/Celeron (451.02-MHz 686-class CPU) > Origin = "GenuineIntel" Id = 0x665 Stepping = 5 > > Features=0x183fbff OV,PAT,PSE36,MMX,FXSR> > real memory = 268435456 (262144K bytes) > avail memory = 258486272 (252428K bytes) > Preloaded elf kernel "kernel" at 0xc0281000. > Pentium Pro MTRR support enabled > Probing for devices on PCI bus 0: > chip0: rev 0x03 on pci0.0.0 > chip1: rev 0x03 on pci0.1.0 > chip2: rev 0x02 on pci0.4.0 > ide_pci0: rev 0x01 on pci0.4.1 > intpm0: rev 0x02 on pci0.4.3 > intpm0: I/O mapped e800 ALLOCED IRQ 0 intr IRQ 9 enabled revision 0 > intsmb0: > smbus0: on intsmb0 > smb0: on smbus0 > intpm0: PM I/O mapped e400 > vx0: <3COM 3C590 Etherlink III PCI> rev 0x00 int a irq 9 on pci0.9.0 > utp[*utp*] address 00:60:97:08:9a:d7 > ed1: rev 0x00 int a irq 12 on > pci0.10.0 > ed1: address 00:80:c8:de:1a:50, type NE2000 (16 bit) > bt0: rev 0x08 int a irq 10 on > pci0.11. > 0 > bt0: BT-948 FW Rev. 5.06I Ultra Narrow SCSI Host Adapter, SCSI ID 7, 192 > CCBs > vga0: rev 0x54 int a irq 11 on pci0.12.0 > Probing for devices on PCI bus 1: > Probing for devices on the ISA bus: > sc0 on isa > sc0: VGA color <16 virtual consoles, flags=0x0> > ed0 not found > atkbdc0 at 0x60-0x6f on motherboard > atkbd0 irq 1 on isa > psm0 not found > sio0 at 0x3f8-0x3ff irq 4 flags 0x10 on isa > sio0: type 16550A > sio1 at 0x2f8-0x2ff irq 3 on isa > sio1: type 16550A > sio2 at 0x3e8-0x3ef irq 5 on isa > sio2: type 16550A > ppc0 at 0x378 irq 7 on isa > ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode > ppc0: FIFO with 16/16/9 bytes threshold > lpt0: on ppbus 0 > lpt0: Interrupt-driven port > ppi0: on ppbus 0 > fdc0 at 0x3f0-0x3f7 irq 6 drq 2 on isa > fdc0: FIFO enabled, 8 bytes threshold > fd0: 1.44MB 3.5in > wdc0 at 0x1f0-0x1f7 irq 14 flags 0xa0ffa0ff on isa > wdc0: unit 0 (wd0): , DMA, 32-bit, multi-block-16 > wd0: 6149MB (12594960 sectors), 13328 cyls, 15 heads, 63 S/T, 512 B/S > wdc0: unit 1 (atapi): , removable, accel, dma, > iordis > acd0: drive speed 1378KB/sec, 128KB cache > acd0: supported read types: CD-R, CD-DA > acd0: Audio: play, 256 volume levels > acd0: Mechanism: ejectable tray > acd0: Medium: no/blank disc inside, unlocked > wdc1 at 0x170-0x177 irq 15 flags 0xa0ffa0ff on isa > wdc1: unit 0 (wd2): , DMA, 32-bit, multi-block-16 > wd2: 6149MB (12594960 sectors), 13328 cyls, 15 heads, 63 S/T, 512 B/S > pcf0 at 0x320 irq 5 on isa > pcf0 not attached due to irq conflict with sio2 at 5 > bt: unit number (1) too high > bt1 not found at 0x330 > vga0 at 0x3b0-0x3df maddr 0xa0000 msize 131072 on isa > npx0 on motherboard > npx0: INT 16 interface > apm0 flags 0x20 on isa > apm: found APM BIOS version 1.2 > pcf0: > iicbus0: on pcf0 addr 0xaa > iicsmb0: on iicbus0 > smbus1: on iicsmb0 > smb1: on smbus1 > iic0: on iicbus0 > IP packet filtering initialized, divert enabled, rule-based forwarding > enabled, > default to accept, logging limited to 25 packets/entry by default > sa0 at bt0 bus 0 target 3 lun 0 > sa0: Removable Sequential Access SCSI-2 device > sa0: 10.000MB/s transfers (10.000MHz, offset 15) > da0 at bt0 bus 0 target 0 lun 0 > da0: Fixed Direct Access SCSI-2 device > da0: 10.000MB/s transfers (10.000MHz, offset 15), Tagged Queueing > Enabled > da0: 1006MB (2061108 512 byte sectors: 64H 32S/T 1006C) > changing root device to wd0s1a > > In SMP it paniced at the "intsmb0: " line I > think. > > What can I do to trouble shoot this. This functionality is not required > by me, but if I can help with out bringing the server down for too long > I will do what is needed. > > My first guesses are I probably need a serial console? and kernel > debugging DDG? > > I din't find any open PRs in "i386" searching for SMB or SMP. All > pointers welcome. > > Jim > -- > In God we Trust -- all others must submit an X.509 certificate. > -- Charles Forsythe > > > To Unsubscribe: send mail to majordomo@FreeBSD.org > with "unsubscribe freebsd-smp" in the body of the message -- > "What's the best part of getting a blowjob? Five minutes of silence." http://www.webmonster.de http://www.apache.de http://www.splatterworld.de (NIC-HDL KR433/KR11-RIPE) To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Wed Apr 19 14:44:51 2000 Delivered-To: freebsd-smp@freebsd.org Received: from duke.cs.duke.edu (duke.cs.duke.edu [152.3.140.1]) by hub.freebsd.org (Postfix) with ESMTP id 0FEFA37BDC8 for ; Wed, 19 Apr 2000 14:44:46 -0700 (PDT) (envelope-from gallatin@cs.duke.edu) Received: from grasshopper.cs.duke.edu (grasshopper.cs.duke.edu [152.3.145.30]) by duke.cs.duke.edu (8.9.3/8.9.3) with ESMTP id RAA03777; Wed, 19 Apr 2000 17:44:24 -0400 (EDT) Received: (from gallatin@localhost) by grasshopper.cs.duke.edu (8.9.3/8.9.1) id RAA02749; Wed, 19 Apr 2000 17:44:24 -0400 (EDT) (envelope-from gallatin@cs.duke.edu) From: Andrew Gallatin MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Date: Wed, 19 Apr 2000 17:44:24 -0400 (EDT) To: Steve Passe Cc: sthaug@nethelp.no, mihara@prd.fc.nec.co.jp, freebsd-smp@FreeBSD.ORG Subject: Re: Multiple APIC support (RE: Issues with Spankin' new Poweredge 4400 w/ dual 866's and 133MHz FSB?) In-Reply-To: <200004191527.JAA67553@Ilsa.StevesCafe.com> References: <81641.956128207@verdi.nethelp.no> <200004191527.JAA67553@Ilsa.StevesCafe.com> X-Mailer: VM 6.43 under 20.4 "Emerald" XEmacs Lucid Message-ID: <14590.9330.960514.16657@grasshopper.cs.duke.edu> Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org Steve Passe writes: > Hi, > > > > > > I/O APICs: APIC ID Version State Address > > > > > 14 0x11 usable 0xfec00000 > > > > > 13 0x11 usable 0xfff7ec00 > > > > > > We need to get one of the VM guys to look at the code in > > > pmap.c:pmap_bootstrap() > > > around line 422. I think this code assumes that IO apics are aligned to > > > a PAGE_SIZE boundary which isn't true for your second IO apic @ 0xfff7ec00. > > > > However, this is not the problem for the IBM Netfinity 5600 servers with > > the RCC chipset: > > > > I/O APICs: APIC ID Version State Address > > 14 0x11 usable 0xfec00000 > > 15 0x11 usable 0xfec01000 > > > > I agree, its 2 different issues. I think an important tidbit is that in Eric Duncan's post (http://docs.FreeBSD.org/cgi/getmsg.cgi?fetch=5951+0+archive/2000/freebsd-smp/20000416.freebsd-smp), he mentions that 3.4 works properly, enables both CPUs & does not hang. This is probably worth at least some sort of investigation by SMP hackers (I'm not an SMP person, I just tripped over this thread while researching a PE4400 purchase). Also, if somebody has a PE2400 or a PE4400 which they're attempting to run 3-stable on, can they tell me if all the pci buses (at least 2 peer buses on the PE2400, and at least 4 on the PE4400) are detected? If not, try the appended patch. This was coded blindly, I don't run 3-stable. If what Eric said was true, this *might* be enough to get some poor soul running SMP on a 2400 using 3-stable. (aic7899 support has not been backported to 3-stable, so 2450 & 44x0 owners are out of luck, but the 2400 uses an aic7890). Cheers, Drew ------------------------------------------------------------------------------ Andrew Gallatin, Sr Systems Programmer http://www.cs.duke.edu/~gallatin Duke University Email: gallatin@cs.duke.edu Department of Computer Science Phone: (919) 660-6590 Index: sys/pci/pcisupport.c =================================================================== RCS file: /home/ncvs/src/sys/pci/pcisupport.c,v retrieving revision 1.86.2.13 diff -u -r1.86.2.13 pcisupport.c --- sys/pci/pcisupport.c 1999/11/01 22:48:34 1.86.2.13 +++ sys/pci/pcisupport.c 2000/04/19 17:11:53 @@ -203,12 +203,12 @@ } static void -fixbushigh_Ross(pcici_t tag) +fixbushigh_rcc(pcici_t tag) { int secondarybus; /* just guessing the secondary bus register number ... */ - secondarybus = pci_cfgread(tag, 0x45, 1); + secondarybus = pci_cfgread(tag, 0x44, 1); if (secondarybus != 0) tag->secondarybus = tag->subordinatebus = secondarybus + 1; } @@ -409,10 +409,16 @@ case 0xc8221045: return ("OPTi 82C822 host to PCI Bridge"); - /* Ross (?) -- vendor 0x1166 */ + /* rcc -- vendor 0x1166 */ case 0x00051166: - fixbushigh_Ross(tag); - return ("Ross (?) host to PCI bridge"); + /* FALLTHROUGH */ + case 0x00061166: + /* FALLTHROUGH */ + case 0x00081166: + /* FALLTHROUGH */ + case 0x00091166: + fixbushigh_rcc(tag); + return ("RCC host to PCI bridge"); /* Others */ case 0x00221014: To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Wed Apr 19 14:57:15 2000 Delivered-To: freebsd-smp@freebsd.org Received: from duke.cs.duke.edu (duke.cs.duke.edu [152.3.140.1]) by hub.freebsd.org (Postfix) with ESMTP id 296C337BCA6 for ; Wed, 19 Apr 2000 14:56:03 -0700 (PDT) (envelope-from gallatin@cs.duke.edu) Received: from grasshopper.cs.duke.edu (grasshopper.cs.duke.edu [152.3.145.30]) by duke.cs.duke.edu (8.9.3/8.9.3) with ESMTP id RAA04071 for ; Wed, 19 Apr 2000 17:56:02 -0400 (EDT) Received: (from gallatin@localhost) by grasshopper.cs.duke.edu (8.9.3/8.9.1) id RAA02765; Wed, 19 Apr 2000 17:56:02 -0400 (EDT) (envelope-from gallatin@cs.duke.edu) From: Andrew Gallatin MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Date: Wed, 19 Apr 2000 17:56:01 -0400 (EDT) To: freebsd-smp@freebsd.org Subject: I/O APIC X-Mailer: VM 6.43 under 20.4 "Emerald" XEmacs Lucid Message-ID: <14590.10426.763064.533504@grasshopper.cs.duke.edu> Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org This is probably a dumb question, so forgive me. My low-level system knowledge is pretty much limited to alphas & I don't know a lot about PCs. When installing Solaris/x86 on one of our PowerEdge 2400s (SMP capable, 2 I/O APICs, 1 CPU), I noticed that it uses the I/O APICs for interrupts rather than the normal isa irq x. Is there an advantage to this? This rang a bell, because the same PowerEdge2400 tends to spew 'stray irq 15' when under heavy interrupt load & running FreeBSD. There's nothing attached to irq 15. I'm thinking that the traditional irq method is probably not well tested on this hardware since it would seem that at least some OSes use the I/O APIC even in single CPU mode. Would it be better for FreeBSD run I/O APIC capable machines via the I/O APIC even when using only a single CPU? I know we can't do this now, but would it be worth sorting through that code? Is there more to it than untangling the IOAPIC and SMP ifdefs? Again, apologies for the dumb question. ------------------------------------------------------------------------------ Andrew Gallatin, Sr Systems Programmer http://www.cs.duke.edu/~gallatin Duke University Email: gallatin@cs.duke.edu Department of Computer Science Phone: (919) 660-6590 To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Wed Apr 19 14:57:18 2000 Delivered-To: freebsd-smp@freebsd.org Received: from verdi.nethelp.no (verdi.nethelp.no [158.36.41.162]) by hub.freebsd.org (Postfix) with SMTP id 8660437BD80 for ; Wed, 19 Apr 2000 14:56:34 -0700 (PDT) (envelope-from sthaug@nethelp.no) Received: (qmail 96901 invoked by uid 1001); 19 Apr 2000 21:56:32 +0000 (GMT) To: gallatin@cs.duke.edu Cc: smp@csn.net, mihara@prd.fc.nec.co.jp, freebsd-smp@FreeBSD.ORG Subject: Re: Multiple APIC support (RE: Issues with Spankin' new Poweredge 4400 w/ dual 866's and 133MHz FSB?) From: sthaug@nethelp.no In-Reply-To: Your message of "Wed, 19 Apr 2000 17:44:24 -0400 (EDT)" References: <14590.9330.960514.16657@grasshopper.cs.duke.edu> X-Mailer: Mew version 1.05+ on Emacs 19.34.2 Mime-Version: 1.0 Content-Type: Text/Plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit Date: Wed, 19 Apr 2000 23:56:32 +0200 Message-ID: <96899.956181392@verdi.nethelp.no> Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org > > > However, this is not the problem for the IBM Netfinity 5600 servers with > > > the RCC chipset: > > > > > > I/O APICs: APIC ID Version State Address > > > 14 0x11 usable 0xfec00000 > > > 15 0x11 usable 0xfec01000 > > > > > > > I agree, its 2 different issues. > > > I think an important tidbit is that in Eric Duncan's post > (http://docs.FreeBSD.org/cgi/getmsg.cgi?fetch=5951+0+archive/2000/freebsd-smp/20000416.freebsd-smp), > he mentions that 3.4 works properly, enables both CPUs & does not > hang. This is probably worth at least some sort of investigation by > SMP hackers (I'm not an SMP person, I just tripped over this thread > while researching a PE4400 purchase). Unfortunately, 3.4-STABLE is what I'm trying to run, and which hangs after probing the serial ports. > Also, if somebody has a PE2400 or a PE4400 which they're attempting to > run 3-stable on, can they tell me if all the pci buses (at least 2 > peer buses on the PE2400, and at least 4 on the PE4400) are detected? > If not, try the appended patch. This was coded blindly, I don't run > 3-stable. I'm using a similar patch from Dag-Erling Smørgrav : *** pcisupport.c.orig Sun Mar 12 22:55:15 2000 --- pcisupport.c Sun Apr 9 21:42:30 2000 *************** *** 88,93 **** --- 88,100 ---- } } + /* Hackety-hack-hack */ + static void + fixbushigh_nf5600(pcici_t tag) + { + tag->secondarybus = tag->subordinatebus = 2; + } + static void fixwsc_natoma(device_t dev) { *************** *** 674,679 **** --- 681,690 ---- pcib_match(device_t dev) { switch (pci_get_devid(dev)) { + /* IBM Netfinity 5600 */ + case 0x00091166: + fixbushigh_nf5600(tag); + return ("IBM Netfinity 5600 host to PCI bridge"); /* Intel -- vendor 0x8086 */ case 0x71818086: return ("Intel 82443LX (440 LX) PCI-PCI (AGP) bridge"); It works well enough that the PCI busses are detected. But no SMP. I haven't tried -current on this box yet. Steinar Haug, Nethelp consulting, sthaug@nethelp.no To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Wed Apr 19 15:12:44 2000 Delivered-To: freebsd-smp@freebsd.org Received: from duke.cs.duke.edu (duke.cs.duke.edu [152.3.140.1]) by hub.freebsd.org (Postfix) with ESMTP id 6136937B7EC for ; Wed, 19 Apr 2000 15:12:40 -0700 (PDT) (envelope-from gallatin@cs.duke.edu) Received: from grasshopper.cs.duke.edu (grasshopper.cs.duke.edu [152.3.145.30]) by duke.cs.duke.edu (8.9.3/8.9.3) with ESMTP id SAA04469; Wed, 19 Apr 2000 18:12:35 -0400 (EDT) Received: (from gallatin@localhost) by grasshopper.cs.duke.edu (8.9.3/8.9.1) id SAA02791; Wed, 19 Apr 2000 18:12:35 -0400 (EDT) (envelope-from gallatin@cs.duke.edu) From: Andrew Gallatin MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable Date: Wed, 19 Apr 2000 18:12:35 -0400 (EDT) To: sthaug@nethelp.no Cc: eric@cdc.net, smp@csn.net, mihara@prd.fc.nec.co.jp, freebsd-smp@FreeBSD.ORG Subject: Re: Multiple APIC support (RE: Issues with Spankin' new Poweredge 4400 w/ dual 866's and 133MHz FSB?) In-Reply-To: <96899.956181392@verdi.nethelp.no> References: <14590.9330.960514.16657@grasshopper.cs.duke.edu> <96899.956181392@verdi.nethelp.no> X-Mailer: VM 6.43 under 20.4 "Emerald" XEmacs Lucid Message-ID: <14590.11665.274938.518505@grasshopper.cs.duke.edu> Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org sthaug@nethelp.no writes: > >=20 > > I think an important tidbit is that in Eric Duncan's post=20 > > (http://docs.FreeBSD.org/cgi/getmsg.cgi?fetch=3D5951+0+archive/200= 0/freebsd-smp/20000416.freebsd-smp),=20 > > he mentions that 3.4 works properly, enables both CPUs & does not > > hang. This is probably worth at least some sort of investigation = by > > SMP hackers (I'm not an SMP person, I just tripped over this threa= d > > while researching a PE4400 purchase). >=20 > Unfortunately, 3.4-STABLE is what I'm trying to run, and which hangs= after > probing the serial ports. I misspoke -- I just re-read his message. He said he compiled a "3.3-STABLE kernel". It might be interesting to find out exactly what he means by this. Duncan, do you mean 3.3-RELEASE, or do you mean RELENG_3 as of some date? What date? > I'm using a similar patch from Dag-Erling Sm=F8rgrav : Yes, it boils down to the same thing, but its a little too specific ;-) If you or anybody else gets a chance to try mine, please let me know if it works. It might be nice to get it committed. Thanks, Drew -----------------------------------------------------------------------= ------- Andrew Gallatin, Sr Systems Programmer=09http://www.cs.duke.edu/~gallat= in Duke University=09=09=09=09Email: gallatin@cs.duke.edu Department of Computer Science=09=09Phone: (919) 660-6590 To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Wed Apr 19 17:41:56 2000 Delivered-To: freebsd-smp@freebsd.org Received: from lor.watermarkgroup.com (lor.watermarkgroup.com [207.202.73.33]) by hub.freebsd.org (Postfix) with ESMTP id D046E37BD69 for ; Wed, 19 Apr 2000 17:41:49 -0700 (PDT) (envelope-from luoqi@watermarkgroup.com) Received: (from luoqi@localhost) by lor.watermarkgroup.com (8.8.8/8.8.8) id UAA24083; Wed, 19 Apr 2000 20:23:04 -0400 (EDT) (envelope-from luoqi) Date: Wed, 19 Apr 2000 20:23:04 -0400 (EDT) From: Luoqi Chen Message-Id: <200004200023.UAA24083@lor.watermarkgroup.com> To: mihara@prd.fc.nec.co.jp, smp@csn.net Subject: Re: Multiple APIC support (RE: Issues with Spankin' new Poweredge 4400 w/ dual 866's and 133MHz FSB?) Cc: freebsd-smp@FreeBSD.ORG Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org > We need to get one of the VM guys to look at the code in > pmap.c:pmap_bootstrap() > around line 422. I think this code assumes that IO apics are aligned to > a PAGE_SIZE boundary which isn't true for your second IO apic @ 0xfff7ec00. > > -- > Steve Passe | powered by > smp@csn.net | Symmetric MultiProcessor FreeBSD > You're right, the code in pmap.c assumes page alignment for IO apics but according to MPspec they are only required to be aligned to 1K boundary. There is also a typo that would cause problems if you have more than one io apics that are on different pages. The following patch should fix these problems. -lq Index: pmap.c =================================================================== RCS file: /home/ncvs/src/sys/i386/i386/pmap.c,v retrieving revision 1.252 diff -u -r1.252 pmap.c --- pmap.c 2000/03/16 08:51:49 1.252 +++ pmap.c 2000/04/20 00:10:19 @@ -426,9 +426,10 @@ for (j = 0; j < mp_napics; j++) { /* same page frame as a previous IO apic? */ if (((vm_offset_t)SMPpt[NPTEPG-2-j] & PG_FRAME) == - (io_apic_address[0] & PG_FRAME)) { + (io_apic_address[i] & PG_FRAME)) { ioapic[i] = (ioapic_t *)((u_int)SMP_prvspace - + (NPTEPG-2-j)*PAGE_SIZE); + + (NPTEPG-2-j)*PAGE_SIZE) + + (io_apic_address[i] & PAGE_MASK); break; } /* use this slot if available */ @@ -436,7 +437,8 @@ SMPpt[NPTEPG-2-j] = (pt_entry_t)(PG_V | PG_RW | pgeflag | (io_apic_address[i] & PG_FRAME)); ioapic[i] = (ioapic_t *)((u_int)SMP_prvspace - + (NPTEPG-2-j)*PAGE_SIZE); + + (NPTEPG-2-j)*PAGE_SIZE) + + (io_apic_address[i] & PAGE_MASK); break; } } To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Wed Apr 19 18:40:17 2000 Delivered-To: freebsd-smp@freebsd.org Received: from TYO203.gate.nec.co.jp (TYO203.gate.nec.co.jp [202.32.8.211]) by hub.freebsd.org (Postfix) with ESMTP id 5923B37B7E2 for ; Wed, 19 Apr 2000 18:40:14 -0700 (PDT) (envelope-from mihara@prd.fc.nec.co.jp) Received: from mailsv.nec.co.jp (mailsv-le1 [192.168.1.90]) by TYO203.gate.nec.co.jp (8.9.3/3.7W00031314) with ESMTP id KAA05091; Thu, 20 Apr 2000 10:40:13 +0900 (JST) Received: from elmer.prd.fc.nec.co.jp (root@elmer.prd.fc.nec.co.jp [10.32.193.1]) by mailsv.nec.co.jp (8.9.3/3.7W-MAILSV-NEC) with ESMTP id KAA14980; Thu, 20 Apr 2000 10:40:11 +0900 (JST) Received: from oz.prd.fc.nec.co.jp (oz.prd.fc.nec.co.jp [10.32.193.3]) by elmer.prd.fc.nec.co.jp (8.8.8/3.6W-00032121) with ESMTP id KAA14655; Thu, 20 Apr 2000 10:40:08 +0900 (JST) Date: Thu, 20 Apr 2000 10:39:47 +0900 Message-ID: <868zy9v9cs.wl@oz.prd.fc.nec.co.jp> From: Osamu MIHARA To: gallatin@cs.duke.edu Cc: freebsd-smp@freebsd.org Subject: Re: I/O APIC In-Reply-To: In your message of "Wed, 19 Apr 2000 17:56:01 -0400 (EDT)" <14590.10426.763064.533504@grasshopper.cs.duke.edu> References: <14590.10426.763064.533504@grasshopper.cs.duke.edu> User-Agent: Wanderlust/1.1.0 (Overjoyed) SEMI/1.13.7 (Awazu) FLIM/1.13.2 (Kasanui) MULE XEmacs/21.1 (patch 9) (Canyonlands) (i386-unknown-freebsd3.4) Organization: NEC Corporation, Tokyo Japan MIME-Version: 1.0 (generated by SEMI 1.13.7 - "Awazu") Content-Type: text/plain; charset=US-ASCII Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org # I just started to study APIC and SMP stuffs, so please correct me if # I'm wrong. At Wed, 19 Apr 2000 17:56:01 -0400 (EDT), Andrew Gallatin wrote: > When installing Solaris/x86 on one of our PowerEdge 2400s (SMP > capable, 2 I/O APICs, 1 CPU), I noticed that it uses the I/O APICs for > interrupts rather than the normal isa irq x. Is there an advantage to > this? One advantage is that multiple I/O-APICs can handle more interrupts than traditional PIC. If you use PIC, it can handles only 16 interrupts at most, and you may need share a interrupt for some devices. With multiple IO-APICs, you don't need to share interrupts, and it does not pay for overheads of interrupt sharing, resulting in better I/O throughput, even with single CPU. -- Osamu MIHARA // NEC Printers Division To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Wed Apr 19 18:56:47 2000 Delivered-To: freebsd-smp@freebsd.org Received: from TYO203.gate.nec.co.jp (TYO203.gate.nec.co.jp [202.32.8.211]) by hub.freebsd.org (Postfix) with ESMTP id 3750737BD74 for ; Wed, 19 Apr 2000 18:56:44 -0700 (PDT) (envelope-from mihara@prd.fc.nec.co.jp) Received: from mailsv.nec.co.jp (mailsv-le1 [192.168.1.90]) by TYO203.gate.nec.co.jp (8.9.3/3.7W00031314) with ESMTP id KAA14541; Thu, 20 Apr 2000 10:56:42 +0900 (JST) Received: from elmer.prd.fc.nec.co.jp (root@elmer.prd.fc.nec.co.jp [10.32.193.1]) by mailsv.nec.co.jp (8.9.3/3.7W-MAILSV-NEC) with ESMTP id KAA28730; Thu, 20 Apr 2000 10:56:40 +0900 (JST) Received: from oz.prd.fc.nec.co.jp (oz.prd.fc.nec.co.jp [10.32.193.3]) by elmer.prd.fc.nec.co.jp (8.8.8/3.6W-00032121) with ESMTP id KAA15303; Thu, 20 Apr 2000 10:56:34 +0900 (JST) Date: Thu, 20 Apr 2000 10:56:12 +0900 Message-ID: <867ldtv8lf.wl@oz.prd.fc.nec.co.jp> From: Osamu MIHARA To: luoqi@watermarkgroup.com Cc: smp@csn.net, freebsd-smp@FreeBSD.ORG Subject: Re: Multiple APIC support (RE: Issues with Spankin' new Poweredge 4400 w/ dual 866's and 133MHz FSB?) In-Reply-To: In your message of "Wed, 19 Apr 2000 20:23:04 -0400 (EDT)" <200004200023.UAA24083@lor.watermarkgroup.com> References: <200004200023.UAA24083@lor.watermarkgroup.com> User-Agent: Wanderlust/1.1.0 (Overjoyed) SEMI/1.13.7 (Awazu) FLIM/1.13.2 (Kasanui) MULE XEmacs/21.1 (patch 9) (Canyonlands) (i386-unknown-freebsd3.4) Organization: NEC Corporation, Tokyo Japan MIME-Version: 1.0 (generated by SEMI 1.13.7 - "Awazu") Content-Type: text/plain; charset=US-ASCII Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org Hi Luoqi, At Wed, 19 Apr 2000 20:23:04 -0400 (EDT), Luoqi Chen wrote: > You're right, the code in pmap.c assumes page alignment for IO apics but > according to MPspec they are only required to be aligned to 1K boundary. > There is also a typo that would cause problems if you have more than one > io apics that are on different pages. The following patch should fix these > problems. Thank you for the patch, but applying your patch results in panic while booting, just after showing avail memory. Here is the boot log. (Even if second IO-APIC is disabled, the phenomenon is same.) >> FreeBSD/i386 BOOT Default: 0:da(0,a)kernel boot: Copyright (c) 1992-2000 The FreeBSD Project. Copyright (c) 1982, 1986, 1989, 1991, 1993 The Regents of the University of California. All rights reserved. FreeBSD 5.0-CURRENT #1: Thu Apr 20 10:42:34 JST 2000 mihara@swd-poseidon.prd.fc.nec.co.jp:/usr/src/sys/compile/POSEIDON Timecounter "i8254" frequency 1193182 Hz CPU: Pentium/P54C (98.00-MHz 586-class CPU) Origin = "GenuineIntel" Id = 0x525 Stepping = 5 Features=0x3bf real memory = 100663296 (98304K bytes) avail memory = 94220288 (92012K bytes) Fatal trap 12: page fault while in kernel mode mp_lock = 00000008; cpuid = 0; lapic.id = 00000000 fault virtual address = 0xffc15000 fault code = supervisor write, page not present instruction pointer = 0x8:0xc02c9d27 stack pointer = 0x10:0xc039bf44 frame pointer = 0x10:0xc039bf54 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, def32 1, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = Idle interrupt mask = net tty bio cam <- SMP: XXX trap number = 12 panic: page fault mp_lock = 00000008; cpuid = 0; lapic.id = 00000000 Uptime: 0s -- Osamu MIHARA // NEC Printers Division To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Wed Apr 19 20:19: 7 2000 Delivered-To: freebsd-smp@freebsd.org Received: from lor.watermarkgroup.com (lor.watermarkgroup.com [207.202.73.33]) by hub.freebsd.org (Postfix) with ESMTP id AE0C137B8CB for ; Wed, 19 Apr 2000 20:19:04 -0700 (PDT) (envelope-from luoqi@watermarkgroup.com) Received: (from luoqi@localhost) by lor.watermarkgroup.com (8.8.8/8.8.8) id XAA26909; Wed, 19 Apr 2000 23:19:01 -0400 (EDT) (envelope-from luoqi) Date: Wed, 19 Apr 2000 23:19:01 -0400 (EDT) From: Luoqi Chen Message-Id: <200004200319.XAA26909@lor.watermarkgroup.com> To: mihara@prd.fc.nec.co.jp Subject: Re: Multiple APIC support (RE: Issues with Spankin' new Poweredge 4400 w/ dual 866's and 133MHz FSB?) Cc: freebsd-smp@FreeBSD.ORG, smp@csn.net Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org > Thank you for the patch, but applying your patch results in panic > while booting, just after showing avail memory. Here is the boot log. > (Even if second IO-APIC is disabled, the phenomenon is same.) > My fault, I made a mistake in the patch. Here's the correct one (the offset should be added before typecasting), Index: pmap.c =================================================================== RCS file: /home/ncvs/src/sys/i386/i386/pmap.c,v retrieving revision 1.252 diff -u -r1.252 pmap.c --- pmap.c 2000/03/16 08:51:49 1.252 +++ pmap.c 2000/04/20 03:14:48 @@ -426,9 +426,10 @@ for (j = 0; j < mp_napics; j++) { /* same page frame as a previous IO apic? */ if (((vm_offset_t)SMPpt[NPTEPG-2-j] & PG_FRAME) == - (io_apic_address[0] & PG_FRAME)) { + (io_apic_address[i] & PG_FRAME)) { ioapic[i] = (ioapic_t *)((u_int)SMP_prvspace - + (NPTEPG-2-j)*PAGE_SIZE); + + (NPTEPG-2-j)*PAGE_SIZE + + (io_apic_address[i] & PAGE_MASK)); break; } /* use this slot if available */ @@ -436,7 +437,8 @@ SMPpt[NPTEPG-2-j] = (pt_entry_t)(PG_V | PG_RW | pgeflag | (io_apic_address[i] & PG_FRAME)); ioapic[i] = (ioapic_t *)((u_int)SMP_prvspace - + (NPTEPG-2-j)*PAGE_SIZE); + + (NPTEPG-2-j)*PAGE_SIZE + + (io_apic_address[i] & PAGE_MASK)); break; } } -lq To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Wed Apr 19 20:39:38 2000 Delivered-To: freebsd-smp@freebsd.org Received: from mass.cdrom.com (mass.cdrom.com [204.216.28.184]) by hub.freebsd.org (Postfix) with ESMTP id 23E7937B92A for ; Wed, 19 Apr 2000 20:39:37 -0700 (PDT) (envelope-from msmith@mass.cdrom.com) Received: from mass.cdrom.com (localhost [127.0.0.1]) by mass.cdrom.com (8.9.3/8.9.3) with ESMTP id UAA05795; Wed, 19 Apr 2000 20:45:56 -0700 (PDT) (envelope-from msmith@mass.cdrom.com) Message-Id: <200004200345.UAA05795@mass.cdrom.com> X-Mailer: exmh version 2.1.1 10/15/1999 To: Luoqi Chen Cc: freebsd-smp@FreeBSD.ORG Subject: Re: Multiple APIC support (RE: Issues with Spankin' new Poweredge 4400 w/ dual 866's and 133MHz FSB?) In-reply-to: Your message of "Wed, 19 Apr 2000 23:19:01 EDT." <200004200319.XAA26909@lor.watermarkgroup.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Wed, 19 Apr 2000 20:45:56 -0700 From: Mike Smith Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org > > Thank you for the patch, but applying your patch results in panic > > while booting, just after showing avail memory. Here is the boot log. > > (Even if second IO-APIC is disabled, the phenomenon is same.) > > > My fault, I made a mistake in the patch. Here's the correct one > (the offset should be added before typecasting), This now has SMP working on my Supermicro PIIDM3 board (i840, two APICs); thanks! -- \\ Give a man a fish, and you feed him for a day. \\ Mike Smith \\ Tell him he should learn how to fish himself, \\ msmith@freebsd.org \\ and he'll hate you for a lifetime. \\ msmith@cdrom.com To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Thu Apr 20 5:30:14 2000 Delivered-To: freebsd-smp@freebsd.org Received: from TYO202.gate.nec.co.jp (TYO202.gate.nec.co.jp [202.247.6.41]) by hub.freebsd.org (Postfix) with ESMTP id 136D637BDFD; Thu, 20 Apr 2000 05:30:10 -0700 (PDT) (envelope-from mihara@prd.fc.nec.co.jp) Received: from mailsv4.nec.co.jp (mailsv4-le1 [192.168.1.93]) by TYO202.gate.nec.co.jp (8.9.3/3.7W00031314) with ESMTP id VAA27061; Thu, 20 Apr 2000 21:30:08 +0900 (JST) Received: from elmer.prd.fc.nec.co.jp (root@elmer.prd.fc.nec.co.jp [10.32.193.1]) by mailsv4.nec.co.jp (8.9.3/3.7W-MAILSV4-NEC) with ESMTP id VAA02700; Thu, 20 Apr 2000 21:30:07 +0900 (JST) Received: from oz.prd.fc.nec.co.jp (oz.prd.fc.nec.co.jp [10.32.193.3]) by elmer.prd.fc.nec.co.jp (8.8.8/3.6W-00032121) with ESMTP id VAA06112; Thu, 20 Apr 2000 21:30:06 +0900 (JST) Date: Thu, 20 Apr 2000 21:29:43 +0900 Message-ID: <863dohuf9k.wl@oz.prd.fc.nec.co.jp> From: Osamu MIHARA To: luoqi@watermarkgroup.com Cc: msmith@freebsd.org, freebsd-smp@FreeBSD.ORG Subject: Re: Multiple APIC support (RE: Issues with Spankin' new Poweredge 4400 w/ dual 866's and 133MHz FSB?) In-Reply-To: In your message of "Wed, 19 Apr 2000 20:45:56 -0700" <200004200345.UAA05795@mass.cdrom.com> References: <200004200319.XAA26909@lor.watermarkgroup.com> <200004200345.UAA05795@mass.cdrom.com> User-Agent: Wanderlust/1.1.0 (Overjoyed) SEMI/1.13.7 (Awazu) FLIM/1.13.2 (Kasanui) MULE XEmacs/21.1 (patch 9) (Canyonlands) (i386-unknown-freebsd3.4) Organization: NEC Corporation, Tokyo Japan MIME-Version: 1.0 (generated by SEMI 1.13.7 - "Awazu") Content-Type: text/plain; charset=US-ASCII Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org At Wed, 19 Apr 2000 20:45:56 -0700, Mike Smith wrote: > > My fault, I made a mistake in the patch. Here's the correct one > > (the offset should be added before typecasting), > > This now has SMP working on my Supermicro PIIDM3 board (i840, two APICs); > thanks! Umm, my machine still cases panic, just same as before applying the patch. Copyright (c) 1992-2000 The FreeBSD Project. Copyright (c) 1982, 1986, 1989, 1991, 1993 The Regents of the University of California. All rights reserved. FreeBSD 5.0-CURRENT #3: Thu Apr 20 21:15:59 JST 2000 mihara@swd-poseidon.prd.fc.nec.co.jp:/usr/src/sys/compile/POSEIDON Timecounter "i8254" frequency 1193182 Hz CPU: Pentium/P54C (97.00-MHz 586-class CPU) Origin = "GenuineIntel" Id = 0x525 Stepping = 5 Features=0x3bf real memory = 100663296 (98304K bytes) avail memory = 94220288 (92012K bytes) Programming 16 pins in IOAPIC #0 IOAPIC #0 intpin 2 -> irq 0 Programming 16 pins in IOAPIC #1 IOAPIC #1 intpin 0 -> irq 2 IOAPIC #1 intpin 1 -> irq 16 IOAPIC #1 intpin 2 -> irq 17 IOAPIC #1 intpin 3 -> irq 18 IOAPIC #1 intpin 4 -> irq 19 IOAPIC #1 intpin 5 -> irq 20 IOAPIC #1 intpin 6 -> irq 21 IOAPIC #1 intpin 7 -> irq 22 IOAPIC #1 intpin 12 -> irq 23 FreeBSD/SMP: Multiprocessor motherboard cpu0 (BSP): apic id: 0, version: 0x00030010, at 0xfee00000 cpu1 (AP): apic id: 3, version: 0x00030010, at 0xfee00000 io0 (APIC): apic id: 14, version: 0x000f0011, at 0xfec00000 io1 (APIC): apic id: 13, version: 0x000f0011, at 0xfff7ec00 Intel Pentium detected, installing workaround for F00F bug md0: Malloc disk npx0: on motherboard npx0: INT 16 interface pcib0: on motherboard pci0: on pcib0 isab0: at device 14.0 on pci0 eisa0: on isab0 mainboard0: on eisa0 slot 0 ep0: <3Com 3C579-TP EISA Network Adapter> at 0x2000-0x200f, 0x2c80-0x2c89 ep0: irq 5 (level) on eisa0 slot 2 ep0: Ethernet address 00:20:af:ee:b5:04 ep0: supplying EUI64: 00:20:af:ff:fe:ee:b5:04 isa0: on isab0 chip1: <> mem 0xfff7ec00-0xfff7efff at device 15.0 on pci0 pcib1: on motherboard pci1: on pcib1 ahc0: port 0xfc00-0xfcff mem 0xff9fe000-0xff9feff f irq 23 at device 13.0 on pci1 ahc0: Using left over BIOS settings ahc0: aic7870 Wide Channel A, SCSI Id=7, 16/255 SCBs ahc1: port 0xf800-0xf8ff mem 0xff9ff000-0xff9ffff f at device 14.0 on pci1 Fatal trap 12: page fault while in kernel mode mp_lock = 00000002; cpuid = 0; lapic.id = 00000000 fault virtual address = 0x1c fault code = supervisor read, page not present instruction pointer = 0x8:0xc02c4dc0 stack pointer = 0x10:0xc039be54 frame pointer = 0x10:0xc039be54 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, def32 1, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 0 (swapper) interrupt mask = net tty bio cam <- SMP: XXX trap number = 12 panic: page fault mp_lock = 00000002; cpuid = 0; lapic.id = 00000000 Uptime: 0s Automatic reboot in 15 seconds - press a key on the console to abort -- Osamu MIHARA // NEC Printers Division To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Thu Apr 20 5:34: 5 2000 Delivered-To: freebsd-smp@freebsd.org Received: from mail.targetnet.com (mail.targetnet.com [207.245.246.3]) by hub.freebsd.org (Postfix) with ESMTP id 87AE137BDB0; Thu, 20 Apr 2000 05:34:03 -0700 (PDT) (envelope-from james@targetnet.com) Received: from james by mail.targetnet.com with local (Exim 3.02 #1) id 12iG9i-0005k8-00; Thu, 20 Apr 2000 08:34:02 -0400 Date: Thu, 20 Apr 2000 08:34:02 -0400 From: James FitzGibbon To: Mike Smith Cc: freebsd-smp@FreeBSD.ORG Subject: Re: Multiple APIC support (RE: Issues with Spankin' new Poweredge 4400 w/ dual 866's and 133MHz FSB?) Message-ID: <20000420083401.B4898@targetnet.com> References: <200004200319.XAA26909@lor.watermarkgroup.com> <200004200345.UAA05795@mass.cdrom.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Mailer: Mutt 1.0pre1i In-Reply-To: <200004200345.UAA05795@mass.cdrom.com> Organization: Targetnet.com Inc. Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org * Mike Smith (msmith@freebsd.org) [000419 23:39]: > This now has SMP working on my Supermicro PIIDM3 board (i840, two APICs); > thanks! What configuration (memory, perhiperals, FSB speed) are you running with this board ? I have a single processor PIIIDM3 and it either panics on boot or fails during make world with signal 4 and 8 failures. I've tried both 3.4 and 4.0 without success. TIA. -- j. James FitzGibbon james@targetnet.com Targetnet.com Inc. Voice/Fax +1 416 306-0466/0452 To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Thu Apr 20 7:31:58 2000 Delivered-To: freebsd-smp@freebsd.org Received: from lor.watermarkgroup.com (lor.watermarkgroup.com [207.202.73.33]) by hub.freebsd.org (Postfix) with ESMTP id 8EECE37B67E; Thu, 20 Apr 2000 07:31:55 -0700 (PDT) (envelope-from luoqi@watermarkgroup.com) Received: (from luoqi@localhost) by lor.watermarkgroup.com (8.8.8/8.8.8) id KAA05757; Thu, 20 Apr 2000 10:31:54 -0400 (EDT) (envelope-from luoqi) Date: Thu, 20 Apr 2000 10:31:54 -0400 (EDT) From: Luoqi Chen Message-Id: <200004201431.KAA05757@lor.watermarkgroup.com> To: mihara@prd.fc.nec.co.jp Subject: Re: Multiple APIC support (RE: Issues with Spankin' new Poweredge 4400 w/ dual 866's and 133MHz FSB?) Cc: freebsd-smp@freebsd.org, msmith@freebsd.org Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org > Fatal trap 12: page fault while in kernel mode > mp_lock = 00000002; cpuid = 0; lapic.id = 00000000 > fault virtual address = 0x1c > fault code = supervisor read, page not present > instruction pointer = 0x8:0xc02c4dc0 > stack pointer = 0x10:0xc039be54 > frame pointer = 0x10:0xc039be54 > code segment = base 0x0, limit 0xfffff, type 0x1b > = DPL 0, pres 1, def32 1, gran 1 > processor eflags = interrupt enabled, resume, IOPL = 0 > current process = 0 (swapper) > interrupt mask = net tty bio cam <- SMP: XXX > trap number = 12 > panic: page fault > mp_lock = 00000002; cpuid = 0; lapic.id = 00000000 > Uptime: 0s > Automatic reboot in 15 seconds - press a key on the console to abort > -- > Osamu MIHARA // NEC Printers Division > It'll be helpful to diagnose the problem if you could provide the symbol list around the faulting instruction (0xc02c4dc0). -lq To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Thu Apr 20 10:45:44 2000 Delivered-To: freebsd-smp@freebsd.org Received: from mass.cdrom.com (adsl-63-202-177-62.dsl.snfc21.pacbell.net [63.202.177.62]) by hub.freebsd.org (Postfix) with ESMTP id 2BF6B37B9E9 for ; Thu, 20 Apr 2000 10:45:42 -0700 (PDT) (envelope-from msmith@mass.cdrom.com) Received: from mass.cdrom.com (localhost [127.0.0.1]) by mass.cdrom.com (8.9.3/8.9.3) with ESMTP id KAA00806; Thu, 20 Apr 2000 10:52:35 -0700 (PDT) (envelope-from msmith@mass.cdrom.com) Message-Id: <200004201752.KAA00806@mass.cdrom.com> X-Mailer: exmh version 2.1.1 10/15/1999 To: James FitzGibbon Cc: freebsd-smp@FreeBSD.ORG Subject: Re: Multiple APIC support (RE: Issues with Spankin' new Poweredge 4400 w/ dual 866's and 133MHz FSB?) In-reply-to: Your message of "Thu, 20 Apr 2000 08:34:02 EDT." <20000420083401.B4898@targetnet.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Thu, 20 Apr 2000 10:52:35 -0700 From: Mike Smith Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org > * Mike Smith (msmith@freebsd.org) [000419 23:39]: > > > This now has SMP working on my Supermicro PIIDM3 board (i840, two APICs); > > thanks! > > What configuration (memory, perhiperals, FSB speed) are you running with > this board ? I have a single processor PIIIDM3 and it either panics on boot > or fails during make world with signal 4 and 8 failures. I've tried both > 3.4 and 4.0 without success. My first guess would be that you haven't installed the CPU terminator. 8) Dual PIII/500, 128MB on two non-ECC DIMMS; a variety of peripherals including various RAID controllers, onboard IDE and SCSI all active. I'm fairly sure the FSB is only running at 100MHz. -- \\ Give a man a fish, and you feed him for a day. \\ Mike Smith \\ Tell him he should learn how to fish himself, \\ msmith@freebsd.org \\ and he'll hate you for a lifetime. \\ msmith@cdrom.com To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Fri Apr 21 4:24:29 2000 Delivered-To: freebsd-smp@freebsd.org Received: from verdi.nethelp.no (verdi.nethelp.no [158.36.41.162]) by hub.freebsd.org (Postfix) with SMTP id ED1CA37B8E1 for ; Fri, 21 Apr 2000 04:24:20 -0700 (PDT) (envelope-from sthaug@nethelp.no) Received: (qmail 25079 invoked by uid 1001); 21 Apr 2000 11:24:18 +0000 (GMT) To: gallatin@cs.duke.edu Cc: eric@cdc.net, smp@csn.net, mihara@prd.fc.nec.co.jp, freebsd-smp@FreeBSD.ORG Subject: Re: Multiple APIC support (RE: Issues with Spankin' new Poweredge 4400 w/ dual 866's and 133MHz FSB?) From: sthaug@nethelp.no In-Reply-To: Your message of "Wed, 19 Apr 2000 18:12:35 -0400 (EDT)" References: <14590.11665.274938.518505@grasshopper.cs.duke.edu> X-Mailer: Mew version 1.05+ on Emacs 19.34.2 Mime-Version: 1.0 Content-Type: Text/Plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit Date: Fri, 21 Apr 2000 13:24:18 +0200 Message-ID: <25077.956316258@verdi.nethelp.no> Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org > > I'm using a similar patch from Dag-Erling Smørgrav : > > Yes, it boils down to the same thing, but its a little too specific > ;-) If you or anybody else gets a chance to try mine, please let me > know if it works. It might be nice to get it committed. Working fine here on 3.4-STABLE now. Steinar Haug, Nethelp consulting, sthaug@nethelp.no ---------------------------------------------------------------------- Copyright (c) 1992-1999 FreeBSD Inc. Copyright (c) 1982, 1986, 1989, 1991, 1993 The Regents of the University of California. All rights reserved. FreeBSD 3.4-STABLE #0: Fri Apr 21 12:34:24 CEST 2000 sthaug@mail1.enitel.no:/local/freebsd/stable3/src/sys/compile/NF5600_SMP Timecounter "i8254" frequency 1193182 Hz CPU: Pentium III/Pentium III Xeon (599.72-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0x681 Stepping = 1 Features=0x387fbff,MMX,FXSR,> real memory = 939524096 (917504K bytes) avail memory = 911634432 (890268K bytes) Programming 16 pins in IOAPIC #0 Programming 16 pins in IOAPIC #1 IOAPIC #1 intpint 0 -> irq 16 IOAPIC #1 intpint 2 -> irq 17 IOAPIC #1 intpint 3 -> irq 18 IOAPIC #1 intpint 4 -> irq 21 IOAPIC #1 intpint 5 -> irq 22 IOAPIC #1 intpint 6 -> irq 23 IOAPIC #1 intpint 7 -> irq -1 IOAPIC #1 intpint 8 -> irq -1 IOAPIC #1 intpint 9 -> irq -1 IOAPIC #1 intpint 10 -> irq -1 IOAPIC #1 intpint 11 -> irq 5 IOAPIC #1 intpint 12 -> irq 19 IOAPIC #1 intpint 13 -> irq 20 FreeBSD/SMP: Multiprocessor motherboard cpu0 (BSP): apic id: 1, version: 0x00040011, at 0xfee00000 cpu1 (AP): apic id: 0, version: 0x00040011, at 0xfee00000 io0 (APIC): apic id: 14, version: 0x000f0011, at 0xfec00000 io1 (APIC): apic id: 15, version: 0x000f0011, at 0xfec01000 Preloaded elf kernel "kernel.smp" at 0xc02f5000. Pentium Pro MTRR support enabled Probing for devices on PCI bus 0: chip0: rev 0x05 on pci0.0.0 chip1: rev 0x05 on pci0.0.1 vga0: rev 0x01 int a irq 255 on pci0.1.0 lnc1: rev 0x43 int a irq 5 on pci0.2.0 ahc0: rev 0x00 int a irq 16 on pci0.9.0 ahc0: aic7890/91 Wide Channel A, SCSI Id=7, 16/255 SCBs chip2: rev 0x03 on pci0.10.0 chip3: rev 0x4f on pci0.15.0 Probing for devices on PCI bus 1: fxp0: rev 0x05 int a irq 17 on pci1.4.0 fxp0: Ethernet address 00:d0:b7:5f:b7:a8 fxp1: rev 0x05 int a irq 18 on pci1.5.0 fxp1: Ethernet address 00:d0:b7:5f:b7:a9 Probing for devices on PCI bus 2: ahc1: rev 0x00 int a irq 19 on pci2.3.0 bogus MP table, 2 IO APIC pins connected to the same PCI device or ISA/EISA interrupt Registered extra interrupt handler for int 20 (in addition to int 19) ahc1: aic7896/97 Wide Channel A, SCSI Id=7, 16/255 SCBs ahc2: rev 0x00 int a irq 19 on pci2.3.1 bogus MP table, 2 IO APIC pins connected to the same PCI device or ISA/EISA interrupt Registered extra interrupt handler for int 20 (in addition to int 19) ahc2: aic7896/97 Wide Channel B, SCSI Id=7, 16/255 SCBs ti0: rev 0x01 int a irq 21 on pci2.5.0 ti0: Ethernet address: 00:a0:cc:73:32:dd Probing for devices on PCI bus 3: Probing for devices on the ISA bus: sc0 on isa sc0: VGA color <16 virtual consoles, flags=0x0> atkbdc0 at 0x60-0x6f on motherboard atkbd0 irq 1 on isa psm0 not found sio0 at 0x3f8-0x3ff irq 4 flags 0x10 on isa sio0: type 16550A sio1 at 0x2f8-0x2ff irq 3 on isa sio1: type 16550A fdc0 at 0x3f0-0x3f7 irq 6 drq 2 on isa fdc0: FIFO enabled, 8 bytes threshold fd0: 1.44MB 3.5in lnc0 not found at 0x280 vga0 at 0x3b0-0x3df maddr 0xa0000 msize 131072 on isa npx0 on motherboard npx0: INT 16 interface APIC_IO: Testing 8254 interrupt delivery APIC_IO: Broken MP table detected: 8254 is not connected to IO APIC int pin 2 APIC_IO: routing 8254 via 8259 on pin 0 Waiting 3 seconds for SCSI devices to settle SMP: AP CPU #1 Launched! sa0 at ahc0 bus 0 target 0 lun 0 sa0: Removable Sequential Access SCSI-2 device sa0: 40.000MB/s transfers (20.000MHz, offset 15, 16bit) pass1 at ahc0 bus 0 target 0 lun 1 pass1: Removable Changer SCSI-2 device pass1: 40.000MB/s transfers (20.000MHz, offset 15, 16bit) pass4 at ahc1 bus 0 target 15 lun 0 pass4: Fixed Processor SCSI-2 device pass4: 3.300MB/s transfers changing root device to da0s1a da0 at ahc1 bus 0 target 0 lun 0 da0: Fixed Direct Access SCSI-2 device da0: 80.000MB/s transfers (40.000MHz, offset 15, 16bit), Tagged Queueing Enabled da0: 8678MB (17774160 512 byte sectors: 255H 63S/T 1106C) da1 at ahc1 bus 0 target 1 lun 0 da1: Fixed Direct Access SCSI-2 device da1: 80.000MB/s transfers (40.000MHz, offset 15, 16bit), Tagged Queueing Enabled da1: 8678MB (17774160 512 byte sectors: 255H 63S/T 1106C) cmd ntpd pid 132 tried to use non-present sched_get_priority_max cmd ntpd pid 132 tried to use non-present sched_setscheduler ti0: gigabit link up To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Fri Apr 21 4:31:53 2000 Delivered-To: freebsd-smp@freebsd.org Received: from verdi.nethelp.no (verdi.nethelp.no [158.36.41.162]) by hub.freebsd.org (Postfix) with SMTP id 0F88D37B6B4 for ; Fri, 21 Apr 2000 04:31:48 -0700 (PDT) (envelope-from sthaug@nethelp.no) Received: (qmail 25148 invoked by uid 1001); 21 Apr 2000 11:31:46 +0000 (GMT) To: luoqi@watermarkgroup.com Cc: mihara@prd.fc.nec.co.jp, freebsd-smp@FreeBSD.ORG, smp@csn.net Subject: Re: Multiple APIC support (RE: Issues with Spankin' new Poweredge 4400 w/ dual 866's and 133MHz FSB?) From: sthaug@nethelp.no In-Reply-To: Your message of "Wed, 19 Apr 2000 23:19:01 -0400 (EDT)" References: <200004200319.XAA26909@lor.watermarkgroup.com> X-Mailer: Mew version 1.05+ on Emacs 19.34.2 Mime-Version: 1.0 Content-Type: Text/Plain; charset=us-ascii Date: Fri, 21 Apr 2000 13:31:46 +0200 Message-ID: <25146.956316706@verdi.nethelp.no> Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org > > Thank you for the patch, but applying your patch results in panic > > while booting, just after showing avail memory. Here is the boot log. > > (Even if second IO-APIC is disabled, the phenomenon is same.) > > > My fault, I made a mistake in the patch. Here's the correct one > (the offset should be added before typecasting), The pmap.c code looks somewhat different in 3.4-STABLE, and it wasn't obvious to me what the complete patch for 3.4-STABLE would be. However, I was trying to get an IBM Netfinity 5600 server to run SMP, and this box has both the two IOAPICs on page boundaries. Thus I was hoping I could get away with only fixing the typo you found: *** pmap.c.orig Sat Apr 1 23:58:17 2000 --- pmap.c Fri Apr 21 12:30:11 2000 *************** *** 434,440 **** for (j = 0; j < 16; j++) { /* same page frame as a previous IO apic? */ if (((vm_offset_t)SMP_prvpt[j + 16] & PG_FRAME) == ! (io_apic_address[0] & PG_FRAME)) { ioapic[i] = (ioapic_t *)&SMP_ioapic[j * PAGE_SIZE]; break; } --- 434,440 ---- for (j = 0; j < 16; j++) { /* same page frame as a previous IO apic? */ if (((vm_offset_t)SMP_prvpt[j + 16] & PG_FRAME) == ! (io_apic_address[i] & PG_FRAME)) { ioapic[i] = (ioapic_t *)&SMP_ioapic[j * PAGE_SIZE]; break; } and this does indeed seem to be the case. I'm now happily running SMP on this box. Steinar Haug, Nethelp consulting, sthaug@nethelp.no ---------------------------------------------------------------------- Copyright (c) 1992-1999 FreeBSD Inc. Copyright (c) 1982, 1986, 1989, 1991, 1993 The Regents of the University of California. All rights reserved. FreeBSD 3.4-STABLE #0: Fri Apr 21 12:34:24 CEST 2000 sthaug@mail1.enitel.no:/local/freebsd/stable3/src/sys/compile/NF5600_SMP Timecounter "i8254" frequency 1193182 Hz CPU: Pentium III/Pentium III Xeon (599.72-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0x681 Stepping = 1 Features=0x387fbff,MMX,FXSR,> real memory = 939524096 (917504K bytes) avail memory = 911634432 (890268K bytes) Programming 16 pins in IOAPIC #0 Programming 16 pins in IOAPIC #1 IOAPIC #1 intpint 0 -> irq 16 IOAPIC #1 intpint 2 -> irq 17 IOAPIC #1 intpint 3 -> irq 18 IOAPIC #1 intpint 4 -> irq 21 IOAPIC #1 intpint 5 -> irq 22 IOAPIC #1 intpint 6 -> irq 23 IOAPIC #1 intpint 7 -> irq -1 IOAPIC #1 intpint 8 -> irq -1 IOAPIC #1 intpint 9 -> irq -1 IOAPIC #1 intpint 10 -> irq -1 IOAPIC #1 intpint 11 -> irq 5 IOAPIC #1 intpint 12 -> irq 19 IOAPIC #1 intpint 13 -> irq 20 FreeBSD/SMP: Multiprocessor motherboard cpu0 (BSP): apic id: 1, version: 0x00040011, at 0xfee00000 cpu1 (AP): apic id: 0, version: 0x00040011, at 0xfee00000 io0 (APIC): apic id: 14, version: 0x000f0011, at 0xfec00000 io1 (APIC): apic id: 15, version: 0x000f0011, at 0xfec01000 Preloaded elf kernel "kernel.smp" at 0xc02f5000. Pentium Pro MTRR support enabled Probing for devices on PCI bus 0: chip0: rev 0x05 on pci0.0.0 chip1: rev 0x05 on pci0.0.1 vga0: rev 0x01 int a irq 255 on pci0.1.0 lnc1: rev 0x43 int a irq 5 on pci0.2.0 ahc0: rev 0x00 int a irq 16 on pci0.9.0 ahc0: aic7890/91 Wide Channel A, SCSI Id=7, 16/255 SCBs chip2: rev 0x03 on pci0.10.0 chip3: rev 0x4f on pci0.15.0 Probing for devices on PCI bus 1: fxp0: rev 0x05 int a irq 17 on pci1.4.0 fxp0: Ethernet address 00:d0:b7:5f:b7:a8 fxp1: rev 0x05 int a irq 18 on pci1.5.0 fxp1: Ethernet address 00:d0:b7:5f:b7:a9 Probing for devices on PCI bus 2: ahc1: rev 0x00 int a irq 19 on pci2.3.0 bogus MP table, 2 IO APIC pins connected to the same PCI device or ISA/EISA interrupt Registered extra interrupt handler for int 20 (in addition to int 19) ahc1: aic7896/97 Wide Channel A, SCSI Id=7, 16/255 SCBs ahc2: rev 0x00 int a irq 19 on pci2.3.1 bogus MP table, 2 IO APIC pins connected to the same PCI device or ISA/EISA interrupt Registered extra interrupt handler for int 20 (in addition to int 19) ahc2: aic7896/97 Wide Channel B, SCSI Id=7, 16/255 SCBs ti0: rev 0x01 int a irq 21 on pci2.5.0 ti0: Ethernet address: 00:a0:cc:73:32:dd Probing for devices on PCI bus 3: Probing for devices on the ISA bus: sc0 on isa sc0: VGA color <16 virtual consoles, flags=0x0> atkbdc0 at 0x60-0x6f on motherboard atkbd0 irq 1 on isa psm0 not found sio0 at 0x3f8-0x3ff irq 4 flags 0x10 on isa sio0: type 16550A sio1 at 0x2f8-0x2ff irq 3 on isa sio1: type 16550A fdc0 at 0x3f0-0x3f7 irq 6 drq 2 on isa fdc0: FIFO enabled, 8 bytes threshold fd0: 1.44MB 3.5in lnc0 not found at 0x280 vga0 at 0x3b0-0x3df maddr 0xa0000 msize 131072 on isa npx0 on motherboard npx0: INT 16 interface APIC_IO: Testing 8254 interrupt delivery APIC_IO: Broken MP table detected: 8254 is not connected to IO APIC int pin 2 APIC_IO: routing 8254 via 8259 on pin 0 Waiting 3 seconds for SCSI devices to settle SMP: AP CPU #1 Launched! sa0 at ahc0 bus 0 target 0 lun 0 sa0: Removable Sequential Access SCSI-2 device sa0: 40.000MB/s transfers (20.000MHz, offset 15, 16bit) pass1 at ahc0 bus 0 target 0 lun 1 pass1: Removable Changer SCSI-2 device pass1: 40.000MB/s transfers (20.000MHz, offset 15, 16bit) pass4 at ahc1 bus 0 target 15 lun 0 pass4: Fixed Processor SCSI-2 device pass4: 3.300MB/s transfers changing root device to da0s1a da0 at ahc1 bus 0 target 0 lun 0 da0: Fixed Direct Access SCSI-2 device da0: 80.000MB/s transfers (40.000MHz, offset 15, 16bit), Tagged Queueing Enabled da0: 8678MB (17774160 512 byte sectors: 255H 63S/T 1106C) da1 at ahc1 bus 0 target 1 lun 0 da1: Fixed Direct Access SCSI-2 device da1: 80.000MB/s transfers (40.000MHz, offset 15, 16bit), Tagged Queueing Enabled da1: 8678MB (17774160 512 byte sectors: 255H 63S/T 1106C) cmd ntpd pid 132 tried to use non-present sched_get_priority_max cmd ntpd pid 132 tried to use non-present sched_setscheduler ti0: gigabit link up To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Fri Apr 21 17:24:24 2000 Delivered-To: freebsd-smp@freebsd.org Received: from apollo.backplane.com (apollo.backplane.com [216.240.41.2]) by hub.freebsd.org (Postfix) with ESMTP id EEBCC37B653 for ; Fri, 21 Apr 2000 17:24:20 -0700 (PDT) (envelope-from dillon@apollo.backplane.com) Received: (from dillon@localhost) by apollo.backplane.com (8.9.3/8.9.1) id RAA49064; Fri, 21 Apr 2000 17:24:12 -0700 (PDT) (envelope-from dillon) Date: Fri, 21 Apr 2000 17:24:12 -0700 (PDT) From: Matthew Dillon Message-Id: <200004220024.RAA49064@apollo.backplane.com> To: Luoqi Chen Cc: mihara@prd.fc.nec.co.jp, freebsd-smp@FreeBSD.ORG, smp@csn.net Subject: Patch appears to work (was Re: Multiple APIC support) Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org Hey Luoqi, the patch works over here! I forwarded it to a friend who has a duel-cpu DELL box which is running FreeBSD which we couldn't get working in SMP before. With the patch applied it appears to work! I think you should commit it (if you haven't already). Also MFCing it to 4.x (A 4.x box is what we tested it under) would be good. -Matt Matthew Dillon : (Luoqi Chen writes) : :My fault, I made a mistake in the patch. Here's the correct one :(the offset should be added before typecasting), : :Index: pmap.c :=================================================================== :RCS file: /home/ncvs/src/sys/i386/i386/pmap.c,v :retrieving revision 1.252 :diff -u -r1.252 pmap.c :--- pmap.c 2000/03/16 08:51:49 1.252 :+++ pmap.c 2000/04/20 03:14:48 :@@ -426,9 +426,10 @@ : for (j = 0; j < mp_napics; j++) { : /* same page frame as a previous IO apic? */ : if (((vm_offset_t)SMPpt[NPTEPG-2-j] & PG_FRAME) == :- (io_apic_address[0] & PG_FRAME)) { :+ (io_apic_address[i] & PG_FRAME)) { : ioapic[i] = (ioapic_t *)((u_int)SMP_prvspace :- + (NPTEPG-2-j)*PAGE_SIZE); :+ + (NPTEPG-2-j)*PAGE_SIZE :+ + (io_apic_address[i] & PAGE_MASK)); : break; : } : /* use this slot if available */ :@@ -436,7 +437,8 @@ : SMPpt[NPTEPG-2-j] = (pt_entry_t)(PG_V | PG_RW | : pgeflag | (io_apic_address[i] & PG_FRAME)); : ioapic[i] = (ioapic_t *)((u_int)SMP_prvspace :- + (NPTEPG-2-j)*PAGE_SIZE); :+ + (NPTEPG-2-j)*PAGE_SIZE :+ + (io_apic_address[i] & PAGE_MASK)); : break; : } : } : : :-lq To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Sat Apr 22 16:31: 6 2000 Delivered-To: freebsd-smp@freebsd.org Received: from gateway.mindmaker.com (gateway.mindmaker.com [209.66.98.130]) by hub.freebsd.org (Postfix) with ESMTP id E7FDF37B85B for ; Sat, 22 Apr 2000 16:31:01 -0700 (PDT) (envelope-from bbeck@mindmaker.com) Received: (from root@localhost) by gateway.mindmaker.com (8.8.8/8.8.7) id QAA29814; Sat, 22 Apr 2000 16:31:01 -0700 (PDT) Received: from mail.int.mindmaker.com(192.168.10.10) by gateway.mindmaker.com via smap (V2.0) id xma029812; Sat, 22 Apr 00 16:30:45 -0700 Received: from mindmaker.com (auth.int.mindmaker.com [192.168.10.15]) by mail.int.mindmaker.com (8.9.3/8.9.3) with ESMTP id QAA09700; Sat, 22 Apr 2000 16:30:58 -0700 (PDT) Message-ID: <39023622.8777F483@mindmaker.com> Date: Sat, 22 Apr 2000 16:30:42 -0700 From: Bernhard Beck X-Mailer: Mozilla 4.6 [en] (Win95; U) X-Accept-Language: en MIME-Version: 1.0 To: smp@freebsd.org, luoqi@watermarkgroup.com Cc: dillon@backplane.com Subject: Patch works with Dell 2450 (Re: Multiple APIC support) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org I just confirmed that Luoqi's patch works against 4.0-RELEASE on a Dell PowerEdge 2450. The system boots fine. I ran a quick check by re-compiling the kernel. So far no problems. FBSD 4.0, RCC chipset, AIC 7899 and SMP all working at the same time. Now waiting for the commit of the patch to 4.0-STABLE. Thanks a lot guys, you saved my day! Bernhard bbeck@mindmaker.com To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message