Date: Mon, 30 Aug 2004 20:11:58 +0200 From: "Daniel Eriksson" <daniel_k_eriksson@telia.com> To: "'Daniel Eriksson'" <daniel_k_eriksson@telia.com>, "'Lukas Ertl'" <le@freebsd.org>, <freebsd-current@freebsd.org> Subject: RE: PLEASE TEST: IPI deadlock avoidance patch Message-ID: <!~!UENERkVCMDkAAQACAAAAAAAAAAAAAAAAABgAAAAAAAAA0VcX9IoJqUaXPS8MjT1PdsKAAAAQAAAADquDJ%2Bmdi0ClwuYGqAhj4gEAAAAA@telia.com> In-Reply-To: <!~!UENERkVCMDkAAQACAAAAAAAAAAAAAAAAABgAAAAAAAAA0VcX9IoJqUaXPS8MjT1PdsKAAAAQAAAAciVbQl3RwkOpqJOt%2B0jebAEAAAAA@telia.com>
next in thread | previous in thread | raw e-mail | index | archive | help
This is a multi-part message in MIME format.
------=_NextPart_000_0017_01C48ECD.9AA793D0
Content-Type: text/plain;
charset="US-ASCII"
Content-Transfer-Encoding: 7bit
I wrote:
> Hmm, after running the test a second time, I actually got a
> crc error even when using a UP kernel. The test set is 9GB+
> in ~270 files. With SMP I seem to get around 10% corrupt
> files after simply making a duplicate of the folder. With
> UP I have gotten 1 corrupt file in 2 tries (~550 files
> copied).
>
> I'll report back here after I have tested "classic" vinum.
Ok, I've run a few more tests now, and the results are not looking very good
for gvinum in RAID-5 mode:
Testbed:
--------
* FreeBSD 6-CURRENT, 2004.08.29.21.00.00
* ASUS P2B-DS mobo, 2 x 700MHz P3, 1GB ECC RAM
* OS disc: Some old 9GB ATA connected to on-board Intel BX chipset
* Data discs: 4 x 120GB Maxtor SATA discs connected to a HighPoint
RocketRAID 1540 card (HPT374 chipset)
* RAID-5 array created using "vinum raid5" command (so disklabel was edited)
Testset:
--------
* 9.1GB data in 273 files (mostly zip-files, rar-files and exe-files)
* crc checksums created and checked with /usr/ports/security/cksfv
* cd /space/raid5/ && cp -Rp testdir testdir.copy
Results:
--------
gvinum / SMP: 117 corrupt files in 4 tests (~10.7% error)
gvinum / UP : 3 corrupt files in 5 tests (~0.2% error)
vinum / SMP : no corrupt files in 3 tests
Observation: vinum seems to offer more than 3x the read performance compared
to gvinum (measured by timing the crc-checksumming). Write performance seems
about equal.
/Daniel Eriksson
------=_NextPart_000_0017_01C48ECD.9AA793D0
Content-Type: application/octet-stream;
name="dmesg.boot"
Content-Transfer-Encoding: quoted-printable
Content-Disposition: attachment;
filename="dmesg.boot"
Copyright (c) 1992-2004 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD 6.0-CURRENT #2: Mon Aug 30 17:14:22 CEST 2004
daniel@xxx.xxx.xxx:/usr/obj/usr/src/sys/SENTINEL
WARNING: MPSAFE network stack disabled, expect reduced performance.
ACPI APIC Table: <ASUS P2B-DS >
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel Pentium III (701.59-MHz 686-class CPU)
Origin =3D "GenuineIntel" Id =3D 0x681 Stepping =3D 1
=
Features=3D0x383fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE=
,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE>
real memory =3D 1073729536 (1023 MB)
avail memory =3D 1041174528 (992 MB)
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
cpu0 (BSP): APIC ID: 1
cpu1 (AP): APIC ID: 0
ioapic0 <Version 1.1> irqs 0-23 on motherboard
npx0: [FAST]
npx0: <math processor> on motherboard
npx0: INT 16 interface
acpi0: <ASUS P2B-DS> on motherboard
acpi0: Overriding SCI Interrupt from IRQ 9 to IRQ 20
acpi0: Power Button (fixed)
Timecounter "ACPI-safe" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0xe408-0xe40b on acpi0
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
acpi_button0: <Power Button> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
agp0: <Intel 82443BX (440 BX) host to PCI bridge> mem =
0xe4000000-0xe7ffffff at device 0.0 on pci0
pcib1: <PCI-PCI bridge> at device 1.0 on pci0
pci1: <PCI bus> on pcib1
pci1: <display, VGA> at device 0.0 (no driver attached)
isab0: <PCI-ISA bridge> at device 4.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel PIIX4 UDMA33 controller> port =
0xb800-0xb80f,0x376,0x170-0x177,0x3f6,0x1f0-0x1f7 at device 4.1 on pci0
ata0: channel #0 on atapci0
ata1: channel #1 on atapci0
uhci0: <Intel 82371AB/EB (PIIX4) USB controller> port 0xb400-0xb41f irq =
19 at device 4.2 on pci0
uhci0: [GIANT-LOCKED]
usb0: <Intel 82371AB/EB (PIIX4) USB controller> on uhci0
usb0: USB revision 1.0
uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
pci0: <bridge, PCI-unknown> at device 4.3 (no driver attached)
ahc0: <Adaptec aic7890/91 Ultra2 SCSI adapter> port 0xb000-0xb0ff mem =
0xe1000000-0xe1000fff irq 19 at device 6.0 on pci0
ahc0: [GIANT-LOCKED]
aic7890/91: Ultra2 Wide Channel A, SCSI Id=3D15, 32/253 SCBs
atapci1: <HighPoint HPT374 (channel 0+1) UDMA133 controller> port =
0x9400-0x94ff,0x9800-0x9803,0xa000-0xa007,0xa400-0xa403,0xa800-0xa807 =
irq 19 at device 9.0 on pci0
ata2: channel #0 on atapci1
ata3: channel #1 on atapci1
atapci2: <HighPoint HPT374 (channel 2+3) UDMA133 controller> port =
0x7800-0x78ff,0x8000-0x8003,0x8400-0x8407,0x8800-0x8803,0x9000-0x9007 =
irq 19 at device 9.1 on pci0
ata4: channel #0 on atapci2
ata5: channel #1 on atapci2
xl0: <3Com 3c905C-TX Fast Etherlink XL> port 0x7400-0x747f mem =
0xe0800000-0xe080007f irq 18 at device 10.0 on pci0
miibus0: <MII bus> on xl0
xlphy0: <3c905C 10/100 internal PHY> on miibus0
xlphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
xl0: Ethernet address: 00:01:02:73:f4:f5
xl0: [GIANT-LOCKED]
xl1: <3Com 3c905C-TX Fast Etherlink XL> port 0x7000-0x707f mem =
0xe0000000-0xe000007f irq 17 at device 11.0 on pci0
miibus1: <MII bus> on xl1
xlphy1: <3c905C 10/100 internal PHY> on miibus1
xlphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
xl1: Ethernet address: 00:50:da:8d:d2:af
xl1: [GIANT-LOCKED]
fxp0: <Intel 82559 Pro/100 Ethernet> port 0x6800-0x683f mem =
0xdf000000-0xdf0fffff,0xdf800000-0xdf800fff irq 16 at device 12.0 on =
pci0
miibus2: <MII bus> on fxp0
inphy0: <i82555 10/100 media interface> on miibus2
inphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
fxp0: Ethernet address: 00:03:47:09:6f:51
fxp0: [GIANT-LOCKED]
speaker0 port 0x61 on acpi0
fdc0: <floppy drive controller> port 0x3f7,0x3f2-0x3f5 irq 6 drq 2 on =
acpi0
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
sio0 port 0x3f8-0x3ff irq 4 on acpi0
sio0: type 16550A
atkbdc0: <Keyboard controller (i8042)> port 0x64,0x60 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
psm0: model Generic PS/2 mouse, device ID 0
pmtimer0 on isa0
orm0: <ISA Option ROMs> at iomem =
0xd4000-0xd57ff,0xd0000-0xd07ff,0xcc000-0xcc7ff,0xc0000-0xc7fff on isa0
sc0: <System console> on isa0
sc0: VGA <16 virtual consoles, flags=3D0x200>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on =
isa0
sio1: configured irq 3 not in bitmap of probed irqs 0
sio1: port may not be enabled
Timecounters tick every 1.000 msec
ipfw2 initialized, divert enabled, rule-based forwarding disabled, =
default to accept, logging unlimited
ad0: 8693MB <IBM-DJNA-370910/J74OA30K> [17662/16/63] at ata0-master =
UDMA33
ATAPI_RESET time =3D 50us
acd0: CDROM <SAMSUNG CD-ROM SC-148F/PS05> at ata1-master PIO4
ad4: 117246MB <Maxtor 6Y120M0/YAR51EW0> [238216/16/63] at ata2-master =
SATA150
ad6: 117246MB <Maxtor 6Y120M0/YAR51EW0> [238216/16/63] at ata3-master =
SATA150
ad8: 117246MB <Maxtor 6Y120M0/YAR51EW0> [238216/16/63] at ata4-master =
SATA150
ad10: 117246MB <Maxtor 6Y120M0/YAR51EW0> [238216/16/63] at ata5-master =
SATA150
Waiting 2 seconds for SCSI devices to settle
SMP: AP CPU #1 Launched!
Mounting root from ufs:/dev/ad0s1a
------=_NextPart_000_0017_01C48ECD.9AA793D0--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?!~!UENERkVCMDkAAQACAAAAAAAAAAAAAAAAABgAAAAAAAAA0VcX9IoJqUaXPS8MjT1PdsKAAAAQAAAADquDJ%2Bmdi0ClwuYGqAhj4gEAAAAA>