Date: Fri, 29 Apr 2005 00:00:28 +0100 From: "Steven Hartland" <killing@multiplay.co.uk> To: "Eric Anderson" <anderson@centtech.com>,<arne_woerner@yahoo.com>, "Scott Long" <scottl@samsco.org> Cc: freebsd-performance@freebsd.org Subject: Re: Very low disk performance Highpoint 1820a Message-ID: <006201c54c46$14c0d290$b3db87d4@multiplay.co.uk> References: <20050428162201.39269.qmail@web41214.mail.yahoo.com> <42711726.2000607@centtech.com>
next in thread | previous in thread | raw e-mail | index | archive | help
Scott I've sent this to you as from reading around you did the
original driver conversion and as such may have an idea
on the areas I could look at hope you dont mind.
Ok some real strange going on write performance is ~ 140MB/s:
gstat:
dT: 0.505 flag_I 500000us sizeof 240 i -1
L(q) ops/s r/s kBps ms/r w/s kBps ms/w %busy Name
0 1100 4 63 13.2 1096 140313 1.2 57.8| da0
0 1100 4 63 13.3 1096 140313 1.3 59.3| da0s1
where as read is ~42MB/s
gstat:
dT: 0.505 flag_I 500000us sizeof 240 i -1
L(q) ops/s r/s kBps ms/r w/s kBps ms/w %busy Name
1 335 335 42836 2.8 0 0 0.0 93.3| da0
1 335 335 42836 2.8 0 0 0.0 93.6| da0s1
Some updated figures:
5.4-STABLE Highpoint 1820a RAID 5 ( 5 disk )
Write:
dd if=/dev/zero of=./test.0 bs=64k count=50000
50000+0 records in
50000+0 records out
3276800000 bytes transferred in 25.088439 secs (130609959 bytes/sec)
Read:
dd if=./test.0 of=/dev/null bs=64k count=50000
50000+0 records in
50000+0 records out
3276800000 bytes transferred in 69.765394 secs (46968845 bytes/sec)
vmstat while doing the above dd:
Read:
vmstat -w 1
procs memory page disks faults cpu
r b w avm fre flt re pi po fr sr da0 pa0 in sy cs us sy id
0 1 0 56560 1840332 6 2 0 0 872 539 0 0 1625 1859 3468 1 3 96
0 1 0 56560 1797548 3 0 0 0 3 0 331 0 1949 1449 7071 0 7 93
0 1 0 56560 1751308 0 0 0 0 0 0 359 0 2071 1581 7600 0 7 93
0 1 0 56560 1707516 0 0 0 0 0 0 338 0 1974 1488 7219 0 8 92
0 1 0 56560 1663084 0 0 0 0 0 0 343 0 2003 1509 7300 0 10 90
....
Write:
vmstat -w 1
procs memory page disks faults cpu
r b w avm fre flt re pi po fr sr da0 pa0 in sy cs us sy id
0 0 1 56560 1912484 6 1 0 0 804 495 1246 0 1627 1864 3454 1 3 96
0 0 1 56560 1779912 3 0 0 0 3 0 1015 0 3606 4272 18207 0 94 6
0 0 1 56560 1634632 0 0 0 0 0 0 1123 0 3939 4657 17973 0 51 49
0 0 1 56560 1507016 0 0 0 0 0 0 996 0 3522 4104 15487 0 46 54
0 0 1 56560 1367688 0 0 0 0 0 0 1075 0 3748 4469 17131 0 45 55
...
iostat while doing the above dd:
Read:
tty da0 pass0 cpu
tin tout KB/t tps MB/s KB/t tps MB/s us ni sy in id
0 61 127.66 328 40.94 0.00 0 0.00 0 0 7 1 92
0 61 127.39 365 45.43 0.00 0 0.00 0 0 6 1 92
0 61 127.13 383 47.56 0.00 0 0.00 0 0 8 1 91
...
Write:
tty da0 pass0 cpu
tin tout KB/t tps MB/s KB/t tps MB/s us ni sy in id
0 62 126.26 1031 127.18 0.00 0 0.00 0 0 34 13 53
0 63 127.67 1004 125.19 0.00 0 0.00 0 0 35 12 53
0 63 127.57 1028 128.05 0.00 0 0.00 0 0 38 12 51
0 63 127.57 1025 127.63 0.00 0 0.00 0 0 34 11 55
System Summary:
Dual AMD 244, 2GB ram, 5 * Seagate SATA 400GB on a
Highpoint 1820a 64Bit PCI-X @ 133Mhz RAID 5 array.
Relavent dmesg:
FreeBSD 5.4-STABLE #0: Wed Apr 27 08:10:14 UTC 2005
root@test:/usr/src/sys/i386/compile/SMP_200HZ
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: AMD Opteron(tm) Processor 244 (1794.41-MHz 686-class CPU)
Origin = "AuthenticAMD" Id = 0xf5a Stepping = 10
Features=0x78bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2>
AMD Features=0xe0500000<NX,AMIE,LM,DSP,3DNow!>
real memory = 2146893824 (2047 MB)
avail memory = 2099625984 (2002 MB)
ACPI APIC Table: <PTLTD APIC >
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
cpu0 (BSP): APIC ID: 0
cpu1 (AP): APIC ID: 1
hptmv0: <RocketRAID 182x SATA Controller> mem 0xf8200000-0xf827ffff irq 25 at device 1.0 on pci9
RocketRAID 182x SATA Controller driver Version 1.1
RR182x [0,0]: channel started successfully
RR182x [0,1]: channel started successfully
RR182x [0,2]: channel started successfully
RR182x [0,3]: channel started successfully
RR182x [0,4]: channel started successfully
RR182x: RAID5 write-back enabled
Timecounters tick every 5.000 msec
da0 at hptmv0 bus 0 target 0 lun 0
da0: <RR182x RAID 5 Array 3.00> Fixed Direct Access SCSI-0 device
da0: 1526216MB (3125690368 512 byte sectors: 255H 63S/T 194565C)
Steve
================================================
This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it.
In the event of misdirection, illegible or incomplete transmission please telephone (023) 8024 3137
or return the E.mail to postmaster@multiplay.co.uk.
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?006201c54c46$14c0d290$b3db87d4>