Date: Thu, 07 Nov 2002 12:50:57 -0600 From: "Paul" <paul@ych.us> To: freebsd-smp@freebsd.org Subject: smp intermittant failures Message-ID: <20021107185057.22819.qmail@mail.crosswind.net>
next in thread | raw e-mail | index | archive | help
Hello,
On a few boxes we have, we are getting the following errors on boot. These
are all from dmesg. It appears to have something to do with si* but even
with console redirection disabled, the APIC_IO in some instances, is the
last thing that comes up on monitor before system 'freezes'.
Any help or information would be greatly appreciated.
Thanks,
Paul
I have tested serial redirection on the server, using a FreeBSD 4.5 GENERIC
kernel with SMP support enabled.
Only the two config lines for SMP support were changed.
The testing was done on a fresh minimal install of FreeBSD 4.5 - other than
assigning a hostname & configuring the network interface there was no
additional software installed or changes other than enabling the console
redirection in boot.config & /etc/ttys.
The three attached files are dmesg output. I have added a brief note to the
top of each one.Note that the dmesg3.txt file was captured on the laptop
Hyperterminal session.
I also tested the same box using a GENERIC kernel without SMP support. I
could not get the console redirection to fail using the non-SMP kernel.
Output of dmesg 1: Note SI0
Copyright (c) 1992-2002 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD 4.5-RELEASE #0: Thu Nov 7 13:05:52 EST 2002
dwayne@myplace:/usr/home/sog013_sun/rcs_tree/static/4.5-RELEASE/src/sys/comp
ile/GENMULTI
Timecounter "i8254" frequency 1193182 Hz
CPU: Pentium III/Pentium III Xeon/Celeron (1263.45-MHz 686-class CPU)
Origin = "GenuineIntel" Id = 0x6b1 Stepping = 1
Features=0x383fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA
,CMOV,PAT,PSE36,MMX,FXSR,SSE>
real memory = 2147418112 (2097088K bytes)
avail memory = 2086842368 (2037932K bytes)
Programming 16 pins in IOAPIC #0
IOAPIC #0 intpin 2 -> irq 0
Programming 16 pins in IOAPIC #1
FreeBSD/SMP: Multiprocessor motherboard
cpu0 (BSP): apic id: 3, version: 0x00040011, at 0xfee00000
cpu1 (AP): apic id: 0, version: 0x00040011, at 0xfee00000
io0 (APIC): apic id: 4, version: 0x000f0011, at 0xfec00000
io1 (APIC): apic id: 5, version: 0x000f0011, at 0xfec01000
Preloaded elf kernel "kernel" at 0xc04a7000.
Pentium Pro MTRR support enabled
md0: Malloc disk
Using $PIR table, 13 entries at 0xc00f3bc0
npx0: <math processor> on motherboard
npx0: INT 16 interface
pcib1: <ServerWorks host to PCI bridge> on motherboard
IOAPIC #1 intpin 11 -> irq 2
IOAPIC #1 intpin 10 -> irq 3
IOAPIC #1 intpin 15 -> irq 5
pci1: <PCI bus> on pcib1
ahc0: <Adaptec aic7899 Ultra160 SCSI adapter> port 0x2400-0x24ff mem
0xfebe0000-0xfebe0fff irq 2 at device 7.0 on pci1
aic7899: Ultra160 Wide Channel A, SCSI Id=7, 32/255 SCBs
ahc1: <Adaptec aic7899 Ultra160 SCSI adapter> port 0x2000-0x20ff mem
0xfebf0000-0xfebf0fff irq 3 at device 7.1 on pci1
aic7899: Ultra160 Wide Channel B, SCSI Id=7, 32/255 SCBs
pci1: <unknown card> (vendor=0x10b7, dev=0x0001) at 8.0 irq 5
pcib0: <ServerWorks host to PCI bridge> on motherboard
IOAPIC #1 intpin 5 -> irq 7
IOAPIC #1 intpin 4 -> irq 9
IOAPIC #1 intpin 2 -> irq 10
IOAPIC #0 intpin 10 -> irq 11
pci0:fxp0: <Intel Pro 10/100B/100+ Ethernet> port 0x1400-0x143f mem
0xfeaa0000-0xfeabffff,0xfeae0000-0xfeae0fff irq 7 at device 3.0 on pci0
fxp0: Ethernet address 00:03:47:d5:d2:7d
inphy0: <i82555 10/100 media interface> on miibus0
inphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
fxp1: <Intel Pro 10/100B/100+ Ethernet> port 0x1440-0x147f mem
0xfea60000-0xfea7ffff,0xfea90000-0xfea90fff irq 9 at device 4.0 on pci0
fxp1: Ethernet address 00:03:47:d5:d2:7e
inphy1: <i82555 10/100 media interface> on miibus1
inphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
pci0: <ATI Mach64-GR graphics accelerator> at 12.0 irq 10
isab0: <PCI to ISA bridge (vendor=1166 device=0201)> at device 15.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Generic PCI ATA controller> port
0x410-0x413,0x3a0-0x3af,0-0x3,0-0x7,0-0x3,0-0x7 at device 15.1 on pci0
ata0: at 0x1f0 irq 14 on atapci0
ohci0: <OHCI (generic) USB controller> mem 0xfea80000-0xfea80fff irq 11 at
device 15.2 on pci0
usb0: OHCI version 1.0, legacy support
SMuPs:b 0A:P SCMPMU d#o1s Lnauotnc rheesd!po
nd, resetting
usb0: <OHCI (generic) USB controller> on ohci0
usb0: USB revision 1.0
uhub0: (unknown) OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 4 ports with 4 removable, self powered
pcib2: <ServerWorks host to PCI bridge> on motherboard
pci2: <PCI bus> on pcib2
pcib3: <ServerWorks host to PCI bridge> on motherboard
pci3: <PCI bus> on pcib3
pcib4: <Host to PCI bridge> on motherboard
pci4: <PCI bus> on pcib4
orm0: <Option ROMs> at iomem
0xc0000-0xc7fff,0xc8000-0xc97ff,0xc9800-0xcafff,0xcb000-0xd0fff,0xe4000-0xe7
fff on isa0
fdc0: <NEC 72065B or clone> at port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on isa0
fdc0: FIFO enabled, 8 bytes threshold
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> flags 0x1 irq 1 on atkbdc0
kbd0 at atkbd0
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x100>
sio0: configured irq 4 not in bitmap of probed irqs 0
sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0
sio0: type 16550A, console
sio1: configured irq 3 not in bitmap of probed irqs 0
ppc0: parallel port not found.
APIC_IO: Testing 8254 interrupt delivery
APIC_IO: Broken MP table detected: 8254 is not connected to IOAPIC #0 intpin
2
APIC_IO: routing 8254 via 8259 and IOAPIC #0 intpin 0
acd0: CDROM <SAMSUNG CD-ROM SN-124> at ata0-master using PIO4
Waiting 15 seconds for SCSI devices to settle
pass1 at ahc1 bus 0 target 6 lun 0
pass1: <ESG-SHV SCA HSBP M18 0.07> Fixed Processor SCSI-2 device
pass1: 3.300MB/s transfers
da0 at ahc1 bus 0 target 0 lun 0
da0: <SEAGATE ST318452LC 0004> Fixed Direct Access SCSI-3 device
da0: 160.000MB/s transfers (80.000MHz, offset 63, 16bit), Tagged Queueing
Enabled
da0: 17501MB (35843670 512 byte sectors: 255H 63S/T 2231C)
Mounting root from ufs:/dev/da0s1a
Output of dmesg 2:
This dmesg output is from a GENERIC FreeBSD 4.5 kernel with smp support.
The system has no keyboard/monitor attached, the "Y" adaptor is attached
to the keyboard adapter.
The system came up completely and I am able to login via the serial console.
I noticed that the console messages appearing on the serial console during
bootup did not slow down as in the previous boot.
Note that the sio0 line: "sio0: configured irq 4 not in bitmap of probed
irqs 0" did not appear.
Copyright (c) 1992-2002 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD 4.5-RELEASE #0: Thu Nov 7 13:05:52 EST 2002
dwayne@myplace:/usr/home/sog013_sun/rcs_tree/static/4.5-RELEASE/src/sys/comp
ile/GENMULTI
Timecounter "i8254" frequency 1193182 Hz
CPU: Pentium III/Pentium III Xeon/Celeron (1263.45-MHz 686-class CPU)
Origin = "GenuineIntel" Id = 0x6b1 Stepping = 1
Features=0x383fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA
,CMOV,PAT,PSE36,MMX,FXSR,SSE>
real memory = 2147418112 (2097088K bytes)
avail memory = 2086842368 (2037932K bytes)
Programming 16 pins in IOAPIC #0
IOAPIC #0 intpin 2 -> irq 0
Programming 16 pins in IOAPIC #1
FreeBSD/SMP: Multiprocessor motherboard
cpu0 (BSP): apic id: 3, version: 0x00040011, at 0xfee00000
cpu1 (AP): apic id: 0, version: 0x00040011, at 0xfee00000
io0 (APIC): apic id: 4, version: 0x000f0011, at 0xfec00000
io1 (APIC): apic id: 5, version: 0x000f0011, at 0xfec01000
Preloaded elf kernel "kernel" at 0xc04a7000.
Pentium Pro MTRR support enabled
md0: Malloc disk
Using $PIR table, 13 entries at 0xc00f3bc0
npx0: <math processor> on motherboard
npx0: INT 16 interface
pcib1: <ServerWorks host to PCI bridge> on motherboard
IOAPIC #1 intpin 11 -> irq 2
IOAPIC #1 intpin 10 -> irq 3
IOAPIC #1 intpin 15 -> irq 5
pci1: <PCI bus> on pcib1
ahc0: <Adaptec aic7899 Ultra160 SCSI adapter> port 0x2400-0x24ff mem
0xfebe0000-0xfebe0fff irq 2 at device 7.0 on pci1
aic7899: Ultra160 Wide Channel A, SCSI Id=7, 32/255 SCBs
ahc1: <Adaptec aic7899 Ultra160 SCSI adapter> port 0x2000-0x20ff mem
0xfebf0000-0xfebf0fff irq 3 at device 7.1 on pci1
aic7899: Ultra160 Wide Channel B, SCSI Id=7, 32/255 SCBs
pci1: <unknown card> (vendor=0x10b7, dev=0x0001) at 8.0 irq 5
pcib0: <ServerWorks host to PCI bridge> on motherboard
IOAPIC #1 intpin 5 -> irq 7
IOAPIC #1 intpin 4 -> irq 9
IOAPIC #1 intpin 2 -> irq 10
IOAPIC #0 intpin 10 -> irq 11
pci0: <PCI bus> on pcib0
fxp0: <Intel Pro 10/100B/100+ Ethernet> port 0x1400-0x143f mem
0xfeaa0000-0xfeabffff,0xfeae0000-0xfeae0fff irq 7 at device 3.0 on pci0
fxp0: Ethernet address 00:03:47:d5:d2:7d
inphy0: <i82555 10/100 media interface> on miibus0
inphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
fxp1: <Intel Pro 10/100B/100+ Ethernet> port 0x1440-0x147f mem
0xfea60000-0xfea7ffff,0xfea90000-0xfea90fff irq 9 at device 4.0 on pci0
fxp1: Ethernet address 00:03:47:d5:d2:7e
inphy1: <i82555 10/100 media interface> on miibus1
inphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
pci0: <ATI Mach64-GR graphics accelerator> at 12.0 irq 10
isab0: <PCI to ISA bridge (vendor=1166 device=0201)> at device 15.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Generic PCI ATA controller> port
0x410-0x413,0x3a0-0x3af,0-0x3,0-0x7,0-0x3,0-0x7 at device 15.1 on pci0
ata0: at 0x1f0 irq 14 on atapci0
ohci0: <OHCI (generic) USB controller> mem 0xfea80000-0xfea80fff irq 11 at
device 15.2 on pci0
usb0: OHCI version 1.0, legacy support
usb0: SMM does not respond, resetting
usb0: <OHCI (generic) USB controller> on ohci0
usb0: USB revision 1.0
uhub0: (unknown) OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 4 ports with 4 removable, self powered
pcib2: <ServerWorks host to PCI bridge> on motherboard
pci2: <PCI bus> on pcib2
pcib3: <ServerWorks host to PCI bridge> on motherboard
pci3: <PCI bus> on pcib3
pcib4: <Host to PCI bridge> on motherboard
pci4: <PCI bus> on pcib4
orm0: <Option ROMs> at iomem
0xc0000-0xc7fff,0xc8000-0xc97ff,0xc9800-0xcafff,0xcb000-0xd0fff,0xe4000-0xe7
fff on isa0
fdc0: <NEC 72065B or clone> at port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on isa0
fdc0: FIFO enabled, 8 bytes threshold
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x100>
sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0
sio0: type 16550A, console
sio1: configured irq 3 not in bitmap of probed irqs 0
ppc0: parallel port not found.
APIC_IO: Testing 8254 interrupt delivery
APIC_IO: Broken MP table detected: 8254 is not connected to IOAPIC #0 intpin
2
APIC_IO: routing 8254 via 8259 and IOAPIC #0 intpin 0
SMP: AP CPU #1 Launched!
acd0: CDROM <SAMSUNG CD-ROM SN-124> at ata0-master using PIO4
Waiting 15 seconds for SCSI devices to settle
pass1 at ahc1 bus 0 target 6 lun 0
pass1: <ESG-SHV SCA HSBP M18 0.07> Fixed Processor SCSI-2 device
pass1: 3.300MB/s transfers
da0 at ahc1 bus 0 target 0 lun 0
da0: <SEAGATE ST318452LC 0004> Fixed Direct Access SCSI-3 device
da0: 160.000MB/s transfers (80.000MHz, offset 63, 16bit), Tagged Queueing
Enabled
da0: 17501MB (35843670 512 byte sectors: 255H 63S/T 2231C)
Mounting root from ufs:/dev/da0s1a
And finally, dmesg 3 Output:
This dmesg output is from a GENERIC FreeBSD 4.5 kernel with smp support.
The system has no monitor or keyboard attached, the "Y" connector is plugged
into the keyboard connection.
The system failed to come up, and I am unable to login via the serial
console.
The system does not respond to "pings", and reattaching the keyboard/monitor
to attempt login via ttyv0 is unsuccessful.
The console messages appearing on the serial console during
bootup appear at normal speed - no slowdown noted.
Note the first sio0 line. - this seems to appear whenever the console
redirection fails to work.
Peter
Copyright (c) 1992-2002 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
E The Regents of the University of California. All rights reserved.
FreeBSD 4.5-RELEASE #0: Thu Nov 7 13:05:52 EST 2002
dwayne@myplace:/usr/home/sog013_sun/rcs_tree/static/4.5-RELEASE/sI
Timecounter "i8254" frequency 1193182 Hz
CPU: Pentium III/Pentium III Xeon/Celeron (1263.45-MHz 686-class CPU)
Origin = "GenuineIntel" Id = 0x6b1 Stepping = 1
Features=0x383fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA
,C>
real memory = 2147418112 (2097088K bytes)
avail memory = 2086842368 (2037932K bytes)
Programming 16 pins in IOAPIC #0
IOAPIC #0 intpin 2 -> irq 0
Programming 16 pins in IOAPIC #1
FreeBSD/SMP: Multiprocessor motherboard
cpu0 (BSP): apic id: 3, version: 0x00040011, at 0xfee00000
cpu1 (AP): apic id: 0, version: 0x00040011, at 0xfee00000
io0 (APIC): apic id: 4, version: 0x000f0011, at 0xfec00000
io1 (APIC): apic id: 5, version: 0x000f0011, at 0xfec01000
Preloaded elf kernel "kernel" at 0xc04a7000.
Pentium Pro MTRR support enabled
md0: Malloc disk
Using $PIR table, 13 entries at 0xc00f3bc0
npx0: <math processor> on motherboard
npx0: INT 16 interface
pcib1: <ServerWorks host to PCI bridge> on motherboard
IOAPIC #1 intpin 11 -> irq 2
IOAPIC #1 intpin 10 -> irq 3
IOAPIC #1 intpin 15 -> irq 5
pci1: <PCI bus> on pcib1
ahc0: <Adaptec aic7899 Ultra160 SCSI adapter> port 0x2400-0x24ff mem
0xfebe00001
aic7899: Ultra160 Wide Channel A, SCSI Id=7, 32/255 SCBs
ahc1: <Adaptec aic7899 Ultra160 SCSI adapter> port 0x2000-0x20ff mem
0xfebf00001
aic7899: Ultra160 Wide Channel B, SCSI Id=7, 32/255 SCBs
pci1: <unknown card> (vendor=0x10b7, dev=0x0001) at 8.0 irq 5
pcib0: <ServerWorks host to PCI bridge> on motherboard
IOAPIC #1 intpin 5 -> irq 7
IOAPIC #1 intpin 4 -> irq 9
IOAPIC #1 intpin 2 -> irq 10
IOAPIC #0 intpin 10 -> irq 11
pci0: <PCI bus> on pcib0
fxp0: <Intel Pro 10/100B/100+ Ethernet> port 0x1400-0x143f mem
0xfeaa0000-0xfea0
fxp0: Ethernet address 00:03:47:d5:d2:7d
inphy0: <i82555 10/100 media interface> on miibus0
inphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
fxp1: <Intel Pro 10/100B/100+ Ethernet> port 0x1440-0x147f mem
0xfea60000-0xfea0
fxp1: Ethernet address 00:03:47:d5:d2:7e
inphy1: <i82555 10/100 media interface> on miibus1
inphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
pci0: <ATI Mach64-GR graphics accelerator> at 12.0 irq 10
isab0: <PCI to ISA bridge (vendor=1166 device=0201)> at device 15.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Generic PCI ATA controller> port
0x410-0x413,0x3a0-0x3af,0-0x3,0-0x7,0
ata0: at 0x1f0 irq 14 on atapci0
ohci0: <OHCI (generic) USB controller> mem 0xfea80000-0xfea80fff irq 11 at
devi0
usb0: OHCI version 1.0, legacy support
SMuPs:b0:P SMMU does not respond, resetting
usb0: <OHCI (generic) USB controller> on ohci0
usb0: USB revision 1.0
uhub0: (unknown) OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 4 ports with 4 removable, self powered
pcib2: <ServerWorks host to PCI bridge> on motherboard
pci2: <PCI bus> on pcib2
pcib3: <ServerWorks host to PCI bridge> on motherboard
pci3: <PCI bus> on pcib3
pcib4: <Host to PCI bridge> on motherboard
pci4: <PCI bus> on pcib4
orm0: <Option ROMs> at iomem
0xc0000-0xc7fff,0xc8000-0xc97ff,0xc9800-0xcafff,0x0
fdc0: <NEC 72065B or clone> at port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on isa0
fdc0: FIFO enabled, 8 bytes threshold
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x100>
sio0: configured irq 4 not in bitmap of probed irqs 0
sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0
sio0: type 16550A, console
sio1: configured irq 3 not in bitmap of probed irqs 0
ppc0: parallel port not found.
APIC_IO: Testing 8254 interrupt delivery
The line above the APIC_IO is when system hangs or freezes.
Again, thanks for any help with this.
To Unsubscribe: send mail to majordomo@FreeBSD.org
with "unsubscribe freebsd-smp" in the body of the message
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20021107185057.22819.qmail>