Date: Mon, 26 Jan 2009 15:14:56 +0100 From: =?ISO-8859-1?Q?Eirik_=D8verby?= <eirik.overby@modirum.com> To: hardware@freebsd.org Subject: Areca ARC-1210 abysmal performance Message-ID: <C17BDEAE-9EDA-4E64-A524-D795EBF0D78C@modirum.com>
next in thread | raw e-mail | index | archive | help
Hi,
I've just purchased a pile of Areca 1210 controllers, having seen that
they should perform well with FreeBSD. Now having hooked up a pair of
them to 4 WD 250gb SATA drives and configured them to RAID1+0, I see
them perform very, very badly.
Below is a typical test I run on newly created arrays, to see the
sustained write speeds they can handle. It's nowhere near a real-world
test, but I've found it to often reveal issues early on.
As you can see, the Areca seems to accept a lump of data (filling its
write cache) early on, then practically slows to a crawl, and for long
stretches of time no data is written at all, before another burst is
written followed by trickling, repeat ad infinitum.
I've repeated this with HDD cache on and off, controller cache on and
off, NCQ on and off and at both SATA150 and SATA300 speeds. When
disabling the controller cache (setting it to write-through), I don't
get the initial burst, but a slow trickle of data ~5-15 mbytes/sec.
While this is going on, the system is basically unresponsive. There is
nothing else going on, only sshd running.
I've just updated the firmware to the latest as of today, however that
didn't change anything.
I'm on FreeBSD 7.1-RELEASE. Dmesg output below.
Can anyone point me in the right direction here?
Thanks,
/Eirik
[root@md-hh-play-01 /usr]# dd if=/dev/zero of=testfile bs=64k & iostat 1
[1] 889
tty da0 pass0
pass1 cpu
tin tout KB/t tps MB/s KB/t tps MB/s KB/t tps MB/s us ni sy
in id
1 98 61.81 76 4.60 0.00 0 0.00 0.00 0 0.00 0 0
0 0 99
0 231 64.00 3732 233.22 0.00 0 0.00 0.00 0 0.00 0 0
13 2 85
0 79 64.00 264 16.48 0.00 0 0.00 0.00 0 0.00 0 0
0 0 100
0 78 64.00 394 24.60 0.00 0 0.00 0.00 0 0.00 0 0
1 0 98
0 77 64.00 320 19.98 0.00 0 0.00 0.00 0 0.00 0 0
1 1 98
0 77 61.74 234 14.10 0.00 0 0.00 0.00 0 0.00 0 0
0 0 100
0 78 64.00 180 11.24 0.00 0 0.00 0.00 0 0.00 0 0
0 0 99
0 77 60.90 31 1.84 0.00 0 0.00 0.00 0 0.00 0 0
0 0 100
0 78 0.00 0 0.00 0.00 0 0.00 0.00 0 0.00 0 0
0 0 100
0 78 0.00 0 0.00 0.00 0 0.00 0.00 0 0.00 0 0
0 0 100
[root@md-hh-play-01 /usr]# vmstat -i
interrupt total rate
irq3: sio0 304870 198
irq4: sio1 2 0
irq10: ohci0+ 258071 167
irq14: ata0 58 0
cpu0: timer 3075904 1999
irq256: nfe0 2652 1
cpu1: timer 3067930 1994
cpu2: timer 3067899 1994
cpu3: timer 3067930 1994
Total 12845316 8351
DMESG:
Copyright (c) 1992-2009 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 7.1-RELEASE #0: Thu Jan 1 08:58:24 UTC 2009
root@driscoll.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Dual-Core AMD Opteron(tm) Processor 2218 (2600.02-MHz K8-class CPU)
Origin = "AuthenticAMD" Id = 0x40f13 Stepping = 3
Features
=
0x178bfbff
<
FPU
,VME
,DE
,PSE
,TSC
,MSR
,PAE
,MCE
,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
Features2=0x2001<SSE3,CX16>
AMD Features=0xea500800<SYSCALL,NX,MMX+,FFXSR,RDTSCP,LM,3DNow!+,
3DNow!>
AMD Features2=0x1f<LAHF,CMP,SVM,ExtAPIC,CR8>
Cores per package: 2
usable memory = 4280922112 (4082 MB)
avail memory = 4115517440 (3924 MB)
ACPI APIC Table: <PTLTD APIC >
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
cpu0 (BSP): APIC ID: 0
cpu1 (AP): APIC ID: 1
cpu2 (AP): APIC ID: 2
cpu3 (AP): APIC ID: 3
ioapic0 <Version 1.1> irqs 0-23 on motherboard
kbd1 at kbdmux0
ath_hal: 0.9.20.3 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413,
RF5413)
acpi0: <PTLTD XSDT> on motherboard
acpi0: [ITHREAD]
acpi0: Power Button (fixed)
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1008-0x100b on acpi0
acpi_hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff
on acpi0
Timecounter "HPET" frequency 25000000 Hz quality 900
acpi_button0: <Power Button> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pci0: <memory, RAM> at device 0.0 (no driver attached)
isab0: <PCI-ISA bridge> port 0x1c00-0x1c7f at device 1.0 on pci0
isa0: <ISA bus> on isab0
pci0: <serial bus, SMBus> at device 1.1 (no driver attached)
ohci0: <OHCI (generic) USB controller> mem 0xc8040000-0xc8040fff irq
10 at device 2.0 on pci0
ohci0: [GIANT-LOCKED]
ohci0: [ITHREAD]
usb0: OHCI version 1.0, legacy support
usb0: SMM does not respond, resetting
usb0: <OHCI (generic) USB controller> on ohci0
usb0: USB revision 1.0
uhub0: <nVidia OHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb0
uhub0: 10 ports with 10 removable, self powered
ehci0: <EHCI (generic) USB 2.0 controller> mem 0xc8041000-0xc80410ff
irq 11 at device 2.1 on pci0
ehci0: [GIANT-LOCKED]
ehci0: [ITHREAD]
usb1: EHCI version 1.0
usb1: companion controller, 10 ports each: usb0
usb1: <EHCI (generic) USB 2.0 controller> on ehci0
usb1: USB revision 2.0
uhub1: <nVidia EHCI root hub, class 9/0, rev 2.00/1.00, addr 1> on usb1
uhub1: 10 ports with 10 removable, self powered
atapci0: <nVidia nForce MCP55 UDMA133 controller> port
0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x2480-0x248f at device 4.0 on pci0
ata0: <ATA channel 0> on atapci0
ata0: [ITHREAD]
ata1: <ATA channel 1> on atapci0
ata1: [ITHREAD]
pcib1: <ACPI PCI-PCI bridge> at device 6.0 on pci0
pci1: <ACPI PCI bus> on pcib1
vgapci0: <VGA-compatible display> port 0x3000-0x30ff mem
0xd0000000-0xd7ffffff,0xc8100000-0xc810ffff irq 5 at device 4.0 on pci1
nfe0: <NVIDIA nForce MCP55 Networking Adapter> port 0x2490-0x2497 mem
0xc8042000-0xc8042fff,0xc8041800-0xc80418ff,0xc8041400-0xc804140f irq
11 at device 8.0 on pci0
miibus0: <MII bus> on nfe0
e1000phy0: <Marvell 88E1149 Gigabit PHY> PHY 0 on miibus0
e1000phy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX-
FDX, auto
nfe0: Ethernet address: 00:e0:81:76:89:a8
nfe0: [FILTER]
nfe0: [FILTER]
nfe0: [FILTER]
nfe0: [FILTER]
nfe0: [FILTER]
nfe0: [FILTER]
nfe0: [FILTER]
nfe0: [FILTER]
nfe1: <NVIDIA nForce MCP55 Networking Adapter> port 0x2498-0x249f mem
0xc8044000-0xc8044fff,0xc8043000-0xc80430ff,0xc8041c00-0xc8041c0f irq
10 at device 9.0 on pci0
miibus1: <MII bus> on nfe1
e1000phy1: <Marvell 88E1149 Gigabit PHY> PHY 1 on miibus1
e1000phy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX-
FDX, auto
nfe1: Ethernet address: 00:e0:81:76:89:a9
nfe1: [FILTER]
nfe1: [FILTER]
nfe1: [FILTER]
nfe1: [FILTER]
nfe1: [FILTER]
nfe1: [FILTER]
nfe1: [FILTER]
nfe1: [FILTER]
pcib2: <ACPI PCI-PCI bridge> at device 10.0 on pci0
pci2: <ACPI PCI bus> on pcib2
pcib3: <ACPI PCI-PCI bridge> at device 13.0 on pci0
pci3: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> at device 15.0 on pci0
pci4: <ACPI PCI bus> on pcib4
pcib5: <ACPI PCI-PCI bridge> at device 0.0 on pci4
pci5: <ACPI PCI bus> on pcib5
arcmsr0: <Areca SATA Host Adapter RAID Controller
> mem 0xc8200000-0xc8200fff,0xd8000000-0xd83fffff irq 10 at device
14.0 on pci5
ARECA RAID ADAPTER0: Driver Version 1.20.00.15 2007-10-07
ARECA RAID ADAPTER0: FIRMWARE VERSION V1.46 2009-01-06
arcmsr0: [ITHREAD]
pcib6: <PCI-PCI bridge> at device 0.2 on pci4
pci6: <PCI bus> on pcib6
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
atkbd0: [ITHREAD]
sio0: configured irq 3 not in bitmap of probed irqs 0
sio0: port may not be enabled
sio0: configured irq 3 not in bitmap of probed irqs 0
sio0: port may not be enabled
sio0: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 flags 0x10
on acpi0
sio0: type 16550A
sio0: [FILTER]
sio1: configured irq 4 not in bitmap of probed irqs 0
sio1: port may not be enabled
sio1: configured irq 4 not in bitmap of probed irqs 0
sio1: port may not be enabled
sio1: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 on acpi0
sio1: type 16550A
sio1: [FILTER]
fdc0: <floppy drive controller> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on
acpi0
fdc0: [FILTER]
ppc0: <Parallel port> port 0x378-0x37f,0x778-0x77f irq 7 drq 3 on acpi0
ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode
ppc0: FIFO with 16/16/9 bytes threshold
ppbus0: <Parallel port bus> on ppc0
ppbus0: [ITHREAD]
plip0: <PLIP network interface> on ppbus0
plip0: WARNING: using obsoleted IFF_NEEDSGIANT flag
lpt0: <Printer> on ppbus0
lpt0: Interrupt-driven port
ppi0: <Parallel I/O> on ppbus0
ppc0: [GIANT-LOCKED]
ppc0: [ITHREAD]
cpu0: <ACPI CPU> on acpi0
acpi_throttle0: <ACPI CPU Throttling> on cpu0
powernow0: <PowerNow! K8> on cpu0
cpu1: <ACPI CPU> on acpi0
powernow1: <PowerNow! K8> on cpu1
cpu2: <ACPI CPU> on acpi0
powernow2: <PowerNow! K8> on cpu2
cpu3: <ACPI CPU> on acpi0
powernow3: <PowerNow! K8> on cpu3
ipmi0: <IPMI System Interface> on isa0
ipmi0: KCS mode found at io 0xca8 alignment 0x4 on isa
orm0: <ISA Option ROM> at iomem 0xc0000-0xc8fff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on
isa0
Timecounters tick every 1.000 msec
acd0: CDROM <CD-224E-N/1.AA> at ata0-slave UDMA33
Waiting 5 seconds for SCSI devices to settle
ipmi0: IPMI device rev. 0, firmware rev. 0.2, version 2.0
ipmi0: Number of channels 5
ipmi0: Attached watchdog
(probe16:arcmsr0:0:16:0): inquiry data fails comparison at DV1 step
da0 at arcmsr0 bus 0 target 0 lun 0
da0: <Areca ARC-1210-VOL#00 R001> Fixed Direct Access SCSI-5 device
da0: 166.666MB/s transfers (83.333MHz DT, offset 32, 16bit)
da0: 476837MB (976562176 512 byte sectors: 255H 63S/T 60788C)
SMP: AP CPU #1 Launched!
SMP: AP CPU #2 Launched!
SMP: AP CPU #3 Launched!
Trying to mount root from ufs:/dev/da0s1a
fuse4bsd: version 0.3.9-pre1, FUSE ABI 7.8
nfe0: link state changed to UP
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?C17BDEAE-9EDA-4E64-A524-D795EBF0D78C>