From owner-freebsd-smp@FreeBSD.ORG Mon Aug 18 04:20:02 2003 Return-Path: Delivered-To: freebsd-smp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0605137B40D for ; Mon, 18 Aug 2003 04:20:02 -0700 (PDT) Received: from thot.infomex.pl (thot.infomex.pl [195.205.200.1]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9E2CA4408F for ; Mon, 18 Aug 2003 03:47:31 -0700 (PDT) (envelope-from warex@vsh.pl) Received: by thot.infomex.pl (Postfix, from userid 1590) id 24F42275A9; Mon, 18 Aug 2003 12:48:39 +0200 (CEST) Received: from xxxifh6kxt8och (unknown [195.205.200.91]) by thot.infomex.pl (Postfix) with ESMTP id DC65527420 for ; Mon, 18 Aug 2003 12:48:38 +0200 (CEST) Message-ID: <005b01c36576$1999c500$5bc8cdc3@xxxifh6kxt8och> From: "Markus Paluschek" To: Date: Mon, 18 Aug 2003 12:47:19 +0200 MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-2" Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2800.1158 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165 Subject: problem with smp on FreeBSD-5.1 X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Aug 2003 11:20:06 -0000 I have Compaq Proliant ML350 server machine with configuration: 2x Pentium Xeon 2,4 GHz 1200 MB ram 2x SCSI hard disks RAID smart array 641 controller When i recompiled kernel from sources downloaded by cvsup, it compiled well, but when i've rebooted and started booting from new kernel and booting have stuck in suck process: ........................ CPU: Intel(R) Xeon (TM) CPU 2,40GHz (2392.25-MHz 686-class CPU) Origin = "GenuineIntel" id = 0xf27 Stepping = 7 Features=0xbfebf9ff Hyperthreading: 2 logical CPUs real memor = 1342152704 (1279 MB) avail memory = 1299877888 (1239 MB) Changing APIC ID for IO APIC #0 from 0 to 2 on chip Changing APIC ID for IO APIC #1 from 0 to 3 on chip Changing APIC ID for IO APIC #2 from 0 to 4 on chip Changing APIC ID for IO APIC #3 from 0 to 5 on chip Programming 16 pins in IOAPIC #0 IOAPIC #0 intpin 2 -> irq 0 Programming 16 pins in IOAPIC #1 Programming 16 pins in IOAPIC #2 Programming 16 pins in IOAPIC #3 Now i can only reboot machine by manual reseting. I haven't found anything on google. Those FreeBSD have been installed from CD. best regards Markus Paluschek From owner-freebsd-smp@FreeBSD.ORG Mon Aug 18 07:33:15 2003 Return-Path: Delivered-To: freebsd-smp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 73C0237B401 for ; Mon, 18 Aug 2003 07:33:15 -0700 (PDT) Received: from ztxmail03.ztx.compaq.com (ztxmail03.ztx.compaq.com [161.114.1.207]) by mx1.FreeBSD.org (Postfix) with ESMTP id 906A643FBF for ; Mon, 18 Aug 2003 07:33:14 -0700 (PDT) (envelope-from john.cagle@hp.com) Received: from cceexg13.americas.cpqcorp.net (cceexg13.americas.cpqcorp.net [16.110.250.119]) by ztxmail03.ztx.compaq.com (Postfix) with ESMTP id F2D45B579; Mon, 18 Aug 2003 09:33:13 -0500 (CDT) Received: from cceexc19.americas.cpqcorp.net ([16.110.250.85]) by cceexg13.americas.cpqcorp.net with Microsoft SMTPSVC(5.0.2195.6673); Mon, 18 Aug 2003 09:33:13 -0500 X-MimeOLE: Produced By Microsoft Exchange V6.0.6375.0 content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Date: Mon, 18 Aug 2003 09:33:12 -0500 Message-ID: X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: problem with smp on FreeBSD-5.1 Thread-Index: AcNleuuiSUDYUWoeRregU6PL6CvPUgAGfyrg From: "Cagle, John (ISS-Houston)" To: "Markus Paluschek" , X-OriginalArrivalTime: 18 Aug 2003 14:33:13.0640 (UTC) FILETIME=[A7CF0280:01C36595] Subject: RE: problem with smp on FreeBSD-5.1 X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Aug 2003 14:33:15 -0000 > -----Original Message----- > From: Markus Paluschek [mailto:warex@vsh.pl]=20 > Sent: Monday, August 18, 2003 5:47 AM > To: freebsd-smp@freebsd.org > Subject: problem with smp on FreeBSD-5.1 >=20 > I have Compaq Proliant ML350 server machine with configuration: > 2x Pentium Xeon 2,4 GHz > 1200 MB ram > 2x SCSI hard disks > RAID smart array 641 controller >=20 > When i recompiled kernel from sources downloaded by cvsup, it=20 > compiled well, > but when > i've rebooted and started booting from new kernel and booting=20 > have stuck in > suck process: > ........................ > CPU: Intel(R) Xeon (TM) CPU 2,40GHz (2392.25-MHz 686-class CPU) > Origin =3D "GenuineIntel" id =3D 0xf27 Stepping =3D 7 >=20 > Features=3D0xbfebf9ff R,PGE,MCA,CMOV > ,P > AR, PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> > Hyperthreading: 2 logical CPUs > real memor =3D 1342152704 (1279 MB) > avail memory =3D 1299877888 (1239 MB) > Changing APIC ID for IO APIC #0 from 0 to 2 on chip > Changing APIC ID for IO APIC #1 from 0 to 3 on chip > Changing APIC ID for IO APIC #2 from 0 to 4 on chip > Changing APIC ID for IO APIC #3 from 0 to 5 on chip > Programming 16 pins in IOAPIC #0 > IOAPIC #0 intpin 2 -> irq 0 > Programming 16 pins in IOAPIC #1 > Programming 16 pins in IOAPIC #2 > Programming 16 pins in IOAPIC #3 >=20 > Now i can only reboot machine by manual reseting. > I haven't found anything on google. > Those FreeBSD have been installed from CD. >=20 > best regards > Markus Paluschek Make sure your ROM BIOS setup has the OS type configured for Linux. Does it work if only 1 processor is installed? The next four lines in the boot log should be something like: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs cpu0 (BSP): apic id: 0, version: 0x00050014, at 0xfee00000 cpu1 (AP): apic id: 1, version: 0x00050014, at 0xfee00000 cpu2 (AP): apic id: 2, version: 0x00050014, at 0xfee00000 cpu3 (AP): apic id: 3, version: 0x00050014, at 0xfee00000 Do you see any of these lines? Regards, John From owner-freebsd-smp@FreeBSD.ORG Tue Aug 19 02:11:58 2003 Return-Path: Delivered-To: freebsd-smp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5E01716A4BF for ; Tue, 19 Aug 2003 02:11:58 -0700 (PDT) Received: from thot.infomex.pl (thot.infomex.pl [195.205.200.1]) by mx1.FreeBSD.org (Postfix) with ESMTP id 5A05E43FA3 for ; Tue, 19 Aug 2003 02:11:54 -0700 (PDT) (envelope-from warex@vsh.pl) Received: by thot.infomex.pl (Postfix, from userid 1590) id 430C227511; Tue, 19 Aug 2003 11:12:55 +0200 (CEST) Received: from xxxifh6kxt8och (unknown [195.205.200.91]) by thot.infomex.pl (Postfix) with ESMTP id D93C6274B1; Tue, 19 Aug 2003 11:12:54 +0200 (CEST) Message-ID: <001701c36631$e0059a00$5bc8cdc3@xxxifh6kxt8och> From: "Markus Paluschek" To: "Cagle, John (ISS-Houston)" , References: Date: Tue, 19 Aug 2003 11:11:28 +0200 MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2800.1158 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165 Subject: Re: problem with smp on FreeBSD-5.1 X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 Aug 2003 09:11:58 -0000 > -----Original Message----- > From: Markus Paluschek [mailto:warex@vsh.pl] > Sent: Monday, August 18, 2003 5:47 AM > To: freebsd-smp@freebsd.org > Subject: problem with smp on FreeBSD-5.1 > > I have Compaq Proliant ML350 server machine with configuration: > 2x Pentium Xeon 2,4 GHz > 1200 MB ram > 2x SCSI hard disks > RAID smart array 641 controller > > When i recompiled kernel from sources downloaded by cvsup, it > compiled well, > but when > i've rebooted and started booting from new kernel and booting > have stuck in > suck process: > ........................ > CPU: Intel(R) Xeon (TM) CPU 2,40GHz (2392.25-MHz 686-class CPU) > Origin = "GenuineIntel" id = 0xf27 Stepping = 7 > > Features=0xbfebf9ff R,PGE,MCA,CMOV > ,P > AR, PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> > Hyperthreading: 2 logical CPUs > real memor = 1342152704 (1279 MB) > avail memory = 1299877888 (1239 MB) > Changing APIC ID for IO APIC #0 from 0 to 2 on chip > Changing APIC ID for IO APIC #1 from 0 to 3 on chip > Changing APIC ID for IO APIC #2 from 0 to 4 on chip > Changing APIC ID for IO APIC #3 from 0 to 5 on chip > Programming 16 pins in IOAPIC #0 > IOAPIC #0 intpin 2 -> irq 0 > Programming 16 pins in IOAPIC #1 > Programming 16 pins in IOAPIC #2 > Programming 16 pins in IOAPIC #3 > > Now i can only reboot machine by manual reseting. > I haven't found anything on google. > Those FreeBSD have been installed from CD. > > best regards > Markus Paluschek >Make sure your ROM BIOS setup has the OS type configured for Linux. I have tryed on UNIXWARE, Other and Linux with same results - dont work as i've showed above. >Does it work if only 1 processor is installed? Yes, in default instalation its working couse only 1 procesor is used by default. >The next four lines in the boot log should be something like: >> >FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs >cpu0 (BSP): apic id: 0, version: 0x00050014, at 0xfee00000 >cpu1 (AP): apic id: 1, version: 0x00050014, at 0xfee00000 >cpu2 (AP): apic id: 2, version: 0x00050014, at 0xfee00000 >cpu3 (AP): apic id: 3, version: 0x00050014, at 0xfee00000 >> >Do you see any of these lines? No, i don't it freeze in this line: Programming 16 pins in IOAPIC #3 >> >Regards, >John From owner-freebsd-smp@FreeBSD.ORG Tue Aug 19 16:24:00 2003 Return-Path: Delivered-To: freebsd-smp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 91BD016A4BF for ; Tue, 19 Aug 2003 16:24:00 -0700 (PDT) Received: from mail11.atl.registeredsite.com (mail11.atl.registeredsite.com [64.224.219.85]) by mx1.FreeBSD.org (Postfix) with ESMTP id B2EC343F93 for ; Tue, 19 Aug 2003 16:23:59 -0700 (PDT) (envelope-from ) Received: from imta04a2.registeredsite.com (imta04a2.registeredsite.com [64.225.255.13])h7JNNw64015179 for ; Tue, 19 Aug 2003 19:23:58 -0400 To: smp@freebsd.org From: "Auto-reply from barry@hamradio.com" In-Reply-To: <42DJCBDB2F6J61BA@freebsd.org> Precedence: bulk Date: Tue, 19 Aug 2003 19:23:58 -0400 Message-ID: <20030819232358.WFP17824.imta04a2.registeredsite.com@imta04a2> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Subject: Re: new mailN0fIGhiw X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.1 List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 Aug 2003 23:24:00 -0000 Thanks for your e-mail. I will try to get back to you as soon as possible. If you need help with complex equipment selection this cannot be done by e-mail, as I need to inquire about your station in order to provide good answers to your questions. Please CALL me for more information. If this is urgent, please call me at 800-444-0047 - if I am not availabe when you call, please mention your e-mail to the person receiving the call. TOLL FREE 800-444-0047 Int'l callers 603-898-3750 or FAX 603-898-1041 Thanks, 73 Barry Onigman, Manager HRO Internet Services To get information to track a shipment, please see http://www.hamradio.com/web/orderstat.html To get information about returning products see http://www.hamradio.com/web/help.html#returns International ordering info http://www.hamradio.com/web/intl.html From owner-freebsd-smp@FreeBSD.ORG Tue Aug 19 19:31:35 2003 Return-Path: Delivered-To: freebsd-smp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 497CE16A4BF for ; Tue, 19 Aug 2003 19:31:35 -0700 (PDT) Received: from luftpost.plosh.net (luftpost.plosh.net [204.152.186.181]) by mx1.FreeBSD.org (Postfix) with ESMTP id CBD2E43F75 for ; Tue, 19 Aug 2003 19:31:34 -0700 (PDT) (envelope-from Peter_Losher@isc.org) Received: from 2001:4f8:3:e:209:5bff:fe4b:b277 (unknown [2001:4f8:3:e:209:5bff:fe4b:b277]) (using TLSv1 with cipher RC4-MD5 (128/128 bits)) (Client did not present a certificate) by luftpost.plosh.net (Postfix) with ESMTP id 7500832606 for ; Tue, 19 Aug 2003 19:32:10 -0700 (PDT) (envelope-from Peter_Losher@isc.org) From: Peter Losher Organization: ISC To: smp@freebsd.org Date: Tue, 19 Aug 2003 19:31:34 -0700 User-Agent: KMail/1.5.3 MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200308191931.34893.Peter_Losher@isc.org> Subject: FreeBSD 5.1-REL locks up w/ a SMP Kernel X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 20 Aug 2003 02:31:35 -0000 I have a Rackable Systems 1U here that I am trying to get a SMP kernel running on, It has dual PIII 1GHz CPU's on a Tyan Thunder LE-T v10.7 motherboard (with ServerWorks chips strewn all over). A uni-processor kernel works just fine, but when I bring out a SMP-aware kernel, it boots until: unknown: can't assign resources (port) unknown: can't assign resources (port) unknown: can't assign resources (port) unknown: can't assign resources (port) APIC_IO: Testing 8254 interrupt delivery And that's when it locks up. The first for lines are there with both kernels, the APIC_IO line obviously only shows up when SMP is turned on. Any ideas on what may be going on here? Best Wishes - Peter Losher -- Peter_Losher@isc.org | ISC | OpenPGP 0xE8048D08 | "The bits must flow" From owner-freebsd-smp@FreeBSD.ORG Wed Aug 20 10:24:48 2003 Return-Path: Delivered-To: freebsd-smp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 73CAC16A4FA for ; Wed, 20 Aug 2003 10:24:48 -0700 (PDT) Received: from mail.speakeasy.net (mail9.speakeasy.net [216.254.0.209]) by mx1.FreeBSD.org (Postfix) with ESMTP id DD48B43F3F for ; Wed, 20 Aug 2003 10:24:47 -0700 (PDT) (envelope-from jhb@FreeBSD.org) Received: (qmail 16328 invoked from network); 20 Aug 2003 17:24:47 -0000 Received: from unknown (HELO server.baldwin.cx) ([216.27.160.63]) (envelope-sender )encrypted SMTP for ; 20 Aug 2003 17:24:47 -0000 Received: from laptop.baldwin.cx (gw1.twc.weather.com [216.133.140.1]) by server.baldwin.cx (8.12.9/8.12.9) with ESMTP id h7KHOj9s094826; Wed, 20 Aug 2003 13:24:45 -0400 (EDT) (envelope-from jhb@FreeBSD.org) Message-ID: X-Mailer: XFMail 1.5.4 on FreeBSD X-Priority: 3 (Normal) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 8bit MIME-Version: 1.0 In-Reply-To: <200308191931.34893.Peter_Losher@isc.org> Date: Wed, 20 Aug 2003 13:25:09 -0400 (EDT) From: John Baldwin To: Peter Losher cc: smp@freebsd.org Subject: RE: FreeBSD 5.1-REL locks up w/ a SMP Kernel X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 20 Aug 2003 17:24:48 -0000 On 20-Aug-2003 Peter Losher wrote: > I have a Rackable Systems 1U here that I am trying to get a SMP kernel > running on, It has dual PIII 1GHz CPU's on a Tyan Thunder LE-T v10.7 > motherboard (with ServerWorks chips strewn all over). A uni-processor > kernel works just fine, but when I bring out a SMP-aware kernel, it > boots until: > > unknown: can't assign resources (port) > unknown: can't assign resources (port) > unknown: can't assign resources (port) > unknown: can't assign resources (port) > APIC_IO: Testing 8254 interrupt delivery > > And that's when it locks up. The first for lines are there with both > kernels, the APIC_IO line obviously only shows up when SMP is turned on. > Any ideas on what may be going on here? You likely aren't getting interrupts from the RTC on IRQ8, so it spins forever. Has anyone else had problems with this motherboard and/or gotten it to work ok? -- John Baldwin <>< http://www.FreeBSD.org/~jhb/ "Power Users Use the Power to Serve!" - http://www.FreeBSD.org/ From owner-freebsd-smp@FreeBSD.ORG Wed Aug 20 10:47:11 2003 Return-Path: Delivered-To: freebsd-smp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 267E716A4C0; Wed, 20 Aug 2003 10:47:11 -0700 (PDT) Received: from odin.ac.hmc.edu (Odin.AC.HMC.Edu [134.173.32.75]) by mx1.FreeBSD.org (Postfix) with ESMTP id 5503043F93; Wed, 20 Aug 2003 10:47:10 -0700 (PDT) (envelope-from brdavis@odin.ac.hmc.edu) Received: from odin.ac.hmc.edu (IDENT:brdavis@localhost.localdomain [127.0.0.1]) by odin.ac.hmc.edu (8.12.9/8.12.3) with ESMTP id h7KHl87c018889; Wed, 20 Aug 2003 10:47:08 -0700 Received: (from brdavis@localhost) by odin.ac.hmc.edu (8.12.9/8.12.3/Submit) id h7KHl7tE018888; Wed, 20 Aug 2003 10:47:07 -0700 Date: Wed, 20 Aug 2003 10:47:07 -0700 From: Brooks Davis To: John Baldwin Message-ID: <20030820174707.GA27301@Odin.AC.HMC.Edu> References: <200308191931.34893.Peter_Losher@isc.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="lrZ03NoBR/3+SXJZ" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.4i X-Virus-Scanned: by amavisd-milter (http://amavis.org/) on odin.ac.hmc.edu cc: smp@freebsd.org cc: Peter Losher Subject: Re: FreeBSD 5.1-REL locks up w/ a SMP Kernel X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 20 Aug 2003 17:47:11 -0000 --lrZ03NoBR/3+SXJZ Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Aug 20, 2003 at 01:25:09PM -0400, John Baldwin wrote: >=20 > On 20-Aug-2003 Peter Losher wrote: > > I have a Rackable Systems 1U here that I am trying to get a SMP kernel= =20 > > running on, It has dual PIII 1GHz CPU's on a Tyan Thunder LE-T v10.7= =20 > > motherboard (with ServerWorks chips strewn all over). A uni-processor= =20 > > kernel works just fine, but when I bring out a SMP-aware kernel, it=20 > > boots until: > >=20 > > unknown: can't assign resources (port) > > unknown: can't assign resources (port) > > unknown: can't assign resources (port) > > unknown: can't assign resources (port) > > APIC_IO: Testing 8254 interrupt delivery > >=20 > > And that's when it locks up. The first for lines are there with both= =20 > > kernels, the APIC_IO line obviously only shows up when SMP is turned on= =2E =20 > > Any ideas on what may be going on here? >=20 > You likely aren't getting interrupts from the RTC on IRQ8, so it spins > forever. Has anyone else had problems with this > motherboard and/or gotten it to work ok? I don't think I have any running current, but I've got >100 LE-T's running SMP on 4.8 (they have worked fine since 4.4). -- Brooks --=20 Any statement of the form "X is the one, true Y" is FALSE. PGP fingerprint 655D 519C 26A7 82E7 2529 9BF0 5D8E 8BE9 F238 1AD4 --lrZ03NoBR/3+SXJZ Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.1 (GNU/Linux) iD8DBQE/Q7PgXY6L6fI4GtQRAg7sAKC4Krm0Fp+lXjDwmXVm24iNVzPxdwCfe86M zZcWSplG4dpqrDx/qI27gFo= =dEMC -----END PGP SIGNATURE----- --lrZ03NoBR/3+SXJZ-- From owner-freebsd-smp@FreeBSD.ORG Wed Aug 20 11:18:36 2003 Return-Path: Delivered-To: freebsd-smp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3DD7316A4BF; Wed, 20 Aug 2003 11:18:36 -0700 (PDT) Received: from mail.fpsn.net (mail.fpsn.net [63.224.69.57]) by mx1.FreeBSD.org (Postfix) with ESMTP id EDB2F43FD7; Wed, 20 Aug 2003 11:18:32 -0700 (PDT) (envelope-from cfaber@fpsn.net) Received: from fpsn.net (mirc-sucks@unixgr.com [63.224.69.60]) (authenticated bits=0) by mail.fpsn.net (8.12.9/8.12.9) with ESMTP id h7KIIKrd025326; Wed, 20 Aug 2003 12:18:23 -0600 (MDT) Message-ID: <3F43BB52.5060503@fpsn.net> Date: Wed, 20 Aug 2003 12:17:54 -0600 From: Colin Faber Organization: fpsn.net, Inc. (http://www.fpsn.net) User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.4b) Gecko/20030507 X-Accept-Language: en-us, en MIME-Version: 1.0 To: ohartman@klima.physik.uni-mainz.de References: <20030813103509.Q49991@mail.physik.uni-mainz.de> In-Reply-To: <20030813103509.Q49991@mail.physik.uni-mainz.de> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Filter-Engine: scanmail (Ruckus scanmail) 1.0-Beta (ab 1.89) X-Filter-Url: http://www.fpsn.net/ruckus X-Spam: No cc: freebsd-stable@freebsd.org cc: freebsd-smp@freebsd.org Subject: (2) 5.1-R-p2 crashes on SMP with AMI RAID and Intel 1000/Pro X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 20 Aug 2003 18:18:36 -0000 Hi, I've got nearly the same setup in a Dell 1600SC with a gig of ram and a PERC4/Sc (LSI MegaRAID) card. Dual 2.4GHz Xeon P4 HT CPU's and I've discovered I can lock up FreeBSD 5.1-RELEASE-p2 on command simply by running something to quickly create and remove a directory. i.e.: perl -e 'for(my $i = 0 ; $i < 9999; $i++){ mkdir("abc"); rmdir("abc"); }' Having machdep.cpu_idle_hlt = 0 makes no difference. Kernel: FreeBSD 5.1-RELEASE-p2 FreeBSD 5.1-RELEASE-p2 #0: Mon Aug 11 21:40:47 MDT 2003 i386 Raid: amr0: mem 0xfcd00000-0xfcd0ffff irq 3 at device 2.0 on pci1 amrd0: on amr0 amrd0: 34556MB (70770688 sectors) RAID 5 (optimal) I suspect that your and my problems are more driver related to the amr driver and may be exposing some other problem with in the kernels fs locking. I don't think (as others have suggested) that your issue is power related, or related to the combination of hardware you're using. (Other than the fact that you've got a MegaRAID card). The exact crash message I'm seeing is: panic: lockmgr: locking against myself cpuid = 0; lapic.id 00000000 boot() called on cpu#0 syncing disks, buffers remaining... panic: ffs_copyonwrite: recursive call cpuid = 0; lapic.id 00000000 boot() called on cpu#0 Uptime: 58s pfs_vncache_unload(): 7 entries remaining amr0: flushing cache...done Terminate ACPI Hartmann, O. wrote: > Dear Sirs. > > It seems to me a never ending story. We run a box with a TYAN Thunder > 2500 Dual SMP mainboard, 2GB ECC Tyan certified memory, AMI Enterprise > 1600 RAID adapter and additional Intel 1000/Pro server type (64 bit) > GBit LAN NIC. With FreeBSD 4.8 this was stable, but to achive this > state was really hard! It is a story similar to that what happend when > we changed towards FreeBSD 5.1-RELEASE-p2 on this machine. > > It seems to be highly dependend in which PCI slot several cards are > attached, so I will report this here also. > > Phenomenon: > > After a while the machine was running, the SMP kernel reboots > spontanously. This is when heavy IO is done, compiling or, when in the > morning time our department gets up and our staff connects to the samba > server. > > Dependend on which devices are switched on or off by BIOS, the kernel > freezes at the stage when the amr0 RAID got recognized. I can avoid this > by enabling the built in NIC (fxp0). I can force this by putting the em0 > NIC into another slot, for instance in the one remaining 64BIT/66MHz > slot (which should be a separate bus). > > This 'game' was identical to that I had with FreeBSD 4.X - 4.8 and I > found out, that putting an additional NIC into PCI slot No. 2 (counted > from AGP slot on) made things clear, but using both NICs together > (either additional fxp0 or the new em0) remains the systems completely > unstable. > > In FreeBSD 5.1-RELEASE-p2 and especially in FreeBSD 5.1-CURRENT this > 'gambling' seems to reach its climax. My kernel is built up with > SCHED_4BSD because SCHED_ULE and ADAPTIVE_MUTEXES crashes immediately > the same way as described (running a while, then coredumping or freeze > at the stage after the amr0-RAID showed up in the kernel boot messages, > see the dmesg output below). > > I'm not an hardware expert, but all this wierd stuff looks like to me to be > a IRQ routing problem. I fiddled around with many hand-assigned IRQ configurations, > but nothing helped. Either the Intel 1000/Pro or the AMI RAID causing > problems in the TYAN Thunder 2500 SMP environment. > > We have also a SMP machine with a similar hardware, based on an ASUS CV4X-D, > AMI Elite 1600 RAID controller and the same Intel em0 1GBit NIC. OS is > FreeBSD 4.8 and this system never had any problem! > > I feel a little bit helpless this moment, because I think I tried every trick > and something seems to be wrong with the combination TYAN Thunder 2500 and FreeBSD > 5.X SMP. It is also very courios, that a kernel without SMP/IO_APIC freezes after > booting at the same place (amr0 RAID recognition). > > Is there any help outside? > > I attach the kernel config file and the dmesg output. Please note: I disabled both > serial ports, the parallel port, sound and usb to get additional IRQs. But I have to > enable the built in NIC to get a bootable, but instable FreeBSD 5.1-R box. > > ==================================== > DMESG output > ==================================== > > Copyright (c) 1992-2003 The FreeBSD Project. > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 > The Regents of the University of California. All rights reserved. > FreeBSD 5.1-RELEASE-p2 #14: Wed Aug 13 09:47:00 CEST 2003 > root@atmos.physik.uni-mainz.de:/usr/obj/usr/src/sys/ATMOS > Preloaded elf kernel "/boot/kernel/kernel" at 0xc0458000. > Timecounter "i8254" frequency 1193182 Hz > Timecounter "TSC" frequency 868644793 Hz > CPU: Intel Pentium III (868.64-MHz 686-class CPU) > Origin = "GenuineIntel" Id = 0x683 Stepping = 3 > Features=0x387fbff > real memory = 2147483648 (2048 MB) > avail memory = 2085625856 (1989 MB) > Programming 16 pins in IOAPIC #0 > IOAPIC #0 intpin 2 -> irq 0 > Programming 16 pins in IOAPIC #1 > FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs > cpu0 (BSP): apic id: 1, version: 0x00040011, at 0xfee00000 > cpu1 (AP): apic id: 0, version: 0x00040011, at 0xfee00000 > io0 (APIC): apic id: 2, version: 0x000f0011, at 0xfec00000 > io1 (APIC): apic id: 3, version: 0x000f0011, at 0xfec01000 > netsmb_dev: loaded > Pentium Pro MTRR support enabled > npx0: on motherboard > npx0: INT 16 interface > pcibios: BIOS version 2.10 > Using $PIR table, 12 entries at 0xc00fdf00 > pcib0: at pcibus 0 on motherboard > pci0: on pcib0 > IOAPIC #1 intpin 13 -> irq 2 > IOAPIC #1 intpin 12 -> irq 16 > IOAPIC #1 intpin 2 -> irq 17 > IOAPIC #1 intpin 7 -> irq 18 > pcib1: at device 0.1 on pci0 > pci1: on pcib1 > IOAPIC #1 intpin 1 -> irq 19 > pci1: at device 0.0 (no driver attached) > sym0: <896> port 0xf800-0xf8ff mem 0xfeafe000-0xfeafffff,0xfeafac00-0xfeafafff irq 2 at device 1.0 on pci0 > sym0: Symbios NVRAM, ID 7, Fast-40, SE, parity checking > sym0: open drain IRQ line driver, using on-chip SRAM > sym0: using LOAD/STORE-based firmware. > sym0: handling phase mismatch from SCRIPTS. > sym1: <896> port 0xf400-0xf4ff mem 0xfeafc000-0xfeafdfff,0xfeafa800-0xfeafabff irq 16 at device 1.1 on pci0 > sym1: Symbios NVRAM, ID 7, Fast-40, LVD, parity checking > sym1: open drain IRQ line driver, using on-chip SRAM > sym1: using LOAD/STORE-based firmware. > sym1: handling phase mismatch from SCRIPTS. > em0: port 0xfcc0-0xfcff mem 0xfeac0000-0xfeadffff irq 17 at device 4.0 on pci0 > em0: Speed:1000 Mbps Duplex:Full > fxp0: port 0xfc40-0xfc7f mem 0xfe900000-0xfe9fffff,0xfeaf9000-0xfeaf9fff irq 18 at device 7.0 on pci0 > fxp0: Ethernet address 00:e0:81:00:f0:d7 > miibus0: on fxp0 > inphy0: on miibus0 > inphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto > isab0: port 0x500-0x50f at device 15.0 on pci0 > isa0: on isab0 > pci0: at device 15.1 (no driver attached) > pcib2: at pcibus 2 on motherboard > pci2: on pcib2 > pcib3: at device 2.0 on pci2 > pci3: on pcib3 > IOAPIC #1 intpin 11 -> irq 20 > IOAPIC #1 intpin 8 -> irq 21 > pcib4: at device 0.0 on pci3 > pci4: on pcib4 > IOAPIC #1 intpin 10 -> irq 22 > amr0: mem 0xf0000000-0xf3ffffff irq 22 at device 0.0 on pci4 > amr0: Firmware G170, BIOS F316, 64MB RAM > pci3: at device 1.0 (no driver attached) > pci3: at device 2.0 (no driver attached) > orm0: