Date: Fri, 20 May 2005 09:34:05 -0600 (MDT) From: Barkley Vowk <bvowk@math.ualberta.ca> To: FreeBSD-gnats-submit@FreeBSD.org Subject: i386/81311: Athlon MP SMP + 3ware + em0 = deadlock, no SMP = everything works Message-ID: <200505201534.j4KFY57f002986@zavijava4.math.ualberta.ca> Resent-Message-ID: <200505201540.j4KFe2sW064143@freefall.freebsd.org>
next in thread | raw e-mail | index | archive | help
>Number: 81311
>Category: i386
>Synopsis: Athlon MP SMP + 3ware + em0 = deadlock, no SMP = everything works
>Confidential: no
>Severity: serious
>Priority: medium
>Responsible: freebsd-i386
>State: open
>Quarter:
>Keywords:
>Date-Required:
>Class: sw-bug
>Submitter-Id: current-users
>Arrival-Date: Fri May 20 15:40:02 GMT 2005
>Closed-Date:
>Last-Modified:
>Originator: Barkley Vowk
>Release: FreeBSD 5.4-RELEASE-p1 i386
>Organization:
University Of Alberta
>Environment:
System: FreeBSD zavijava4.math.ualberta.ca 5.4-RELEASE-p1 FreeBSD 5.4-RELEASE-p1 #0: Thu May 19 18:10:48 MDT 2005 root@zavijava4.math.ualberta.ca:/usr/obj/usr/src/sys/GENERIC i386
Copyright (c) 1992-2005 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD 5.4-RELEASE-p1 #0: Thu May 19 18:10:48 MDT 2005
root@zavijava4.math.ualberta.ca:/usr/obj/usr/src/sys/GENERIC
MPTable: <TYAN PAULANER >
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: AMD Athlon(tm) MP 2600+ (2133.42-MHz 686-class CPU)
Origin = "AuthenticAMD" Id = 0x681 Stepping = 1
Features=0x383fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE>
AMD Features=0xc0480000<MP,AMIE,DSP,3DNow!>
real memory = 1073217536 (1023 MB)
avail memory = 1040678912 (992 MB)
ioapic0: Assuming intbase of 0
ioapic0 <Version 1.1> irqs 0-23 on motherboard
npx0: <math processor> on motherboard
npx0: INT 16 interface
cpu0 on motherboard
pcib0: <MPTable Host-PCI bridge> pcibus 0 on motherboard
pci0: <PCI bus> on pcib0
agp0: <AMD 762 host to AGP bridge> port 0x1060-0x1063 mem 0xf6200000-0xf6200fff,0xf8000000-0xfbffffff at device 0.0 on pci0
pcib1: <PCI-PCI bridge> at device 1.0 on pci0
pci1: <PCI bus> on pcib1
isab0: <PCI-ISA bridge> at device 7.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <AMD 768 UDMA100 controller> port 0xf000-0xf00f,0x376,0x170-0x177,0x3f6,0x1f0-0x1f7 at device 7.1 on pci0
ata0: channel #0 on atapci0
ata1: channel #1 on atapci0
pci0: <bridge> at device 7.3 (no driver attached)
twe0: <3ware Storage Controller. Driver version 1.50.01.002> port 0x1050-0x105f mem 0xf4000000-0xf47fffff irq 16 at device 8.0 on pci0
twe0: 8 ports, Firmware FE7S 1.05.00.056, BIOS BE7X 1.08.00.046
em0: <Intel(R) PRO/1000 Network Connection, Version - 1.7.35> port 0x1000-0x103f mem 0xf4800000-0xf481ffff irq 19 at device 11.0 on pci0
em0: Ethernet address: 00:e0:81:25:73:36
em0: Speed:N/A Duplex:N/A
pcib2: <MPTable PCI-PCI bridge> at device 16.0 on pci0
pci2: <PCI bus> on pcib2
ohci0: <OHCI (generic) USB controller> mem 0xf4900000-0xf4900fff irq 19 at device 0.0 on pci2
usb0: OHCI version 1.0, legacy support
usb0: SMM does not respond, resetting
usb0: <OHCI (generic) USB controller> on ohci0
usb0: USB revision 1.0
uhub0: AMD OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 4 ports with 4 removable, self powered
pci2: <display, VGA> at device 7.0 (no driver attached)
fxp0: <Intel 82551 Pro/100 Ethernet> port 0x2400-0x243f mem 0xf4920000-0xf493ffff,0xf4902000-0xf4902fff irq 18 at device 8.0 on pci2
miibus0: <MII bus> on fxp0
inphy0: <i82555 10/100 media interface> on miibus0
inphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
fxp0: Ethernet address: 00:e0:81:25:73:37
orm0: <ISA Option ROMs> at iomem 0xe0000-0xe3fff,0xc8000-0xc8fff,0xc0000-0xc7fff on isa0
pmtimer0 on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x64,0x60 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
ppc0: <Parallel port> at port 0x378-0x37f irq 7 on isa0
ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode
ppc0: FIFO with 16/16/9 bytes threshold
ppbus0: <Parallel port bus> on ppc0
plip0: <PLIP network interface> on ppbus0
lpt0: <Printer> on ppbus0
lpt0: Interrupt-driven port
ppi0: <Parallel I/O> on ppbus0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0
sio0: type 16550A
sio1 at port 0x2f8-0x2ff irq 3 on isa0
sio1: type 16550A
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
unknown: <PNP0303> can't assign resources (port)
unknown: <PNP0c02> can't assign resources (memory)
unknown: <PNP0501> can't assign resources (port)
unknown: <PNP0501> can't assign resources (port)
unknown: <PNP0401> can't assign resources (port)
Timecounter "TSC" frequency 2133422851 Hz quality 800
Timecounters tick every 10.000 msec
twed0: <Unit 0, RAID5, Normal> on twe0
twed0: 915760MB (1875478272 sectors)
Mounting root from ufs:/dev/twed0s1a
WARNING: /home was not properly dismounted
WARNING: /tmp was not properly dismounted
WARNING: /usr was not properly dismounted
WARNING: /var was not properly dismounted
em0: Link is up 1000 Mbps Full Duplex
>Description:
This machine is a heavily loaded NFS server, with an SMP kernel, the
machine deadlocks in about 2 minutes under heavy load. If I remove
SMP from the kernel, the machine seems to have no problems at all.
When the machine deadlocks, there is no network or disk activity at
all, and the keyboard will let me attempt to login, but it will hang
after asking for the username. I suspect the 3ware board or the em
nic are the issue.
>How-To-Repeat:
I can reproduce the problem with 2 clients mounting the filesystem
via NFS, and then running:
iozone 1000
The deadlock happens about 2 minutes later.
>Fix:
Remove SMP from the kernel
>Release-Note:
>Audit-Trail:
>Unformatted:
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?200505201534.j4KFY57f002986>