Date: Wed, 29 Nov 2006 18:18:00 -0800 From: Derrick MacPherson <dmacpher@vfs.com> To: freebsd-questions@freebsd.org Subject: degraded RAID performance after OS upgrade, and drives added. Message-ID: <8A1C4E8F-5409-4A75-AB61-2475F1688330@vfs.com>
next in thread | raw e-mail | index | archive | help
We updated to 6.1 this weekend and added 3 300gb drives to the external raid cabinet, they were to go on a seprate controller but the server happens to have a few other boxes on top making it impossible at that time, so we put the 3x300 (RAID5) , upgraded the OS and performance is very poor. When I run systat I see upward of 300 tps on the problematic array (da2) and under systat -vmstat : Disks da0 da1 da2 pass0 pass1 pass2 KB/t 0.00 0.00 15.00 0.00 0.00 0.00 tps 0 0 341 0 0 0 MB/s 0.00 0.00 4.99 0.00 0.00 0.00 % busy 0 0 95 0 0 0 the busy percentage is consistenly over 90% sometimes over 100%. I'm not sure where to go next with providing info for someone to look at or testing to run.. camcontrol devlist <COMPAQ RAID 1 VOLUME OK> at scbus0 target 0 lun 0 (da0,pass0) <COMPAQ RAID 0 VOLUME OK> at scbus0 target 1 lun 0 (da1,pass1) <COMPAQ RAID 5 VOLUME OK> at scbus0 target 2 lun 0 (da2,pass2) out of dmesg: ciss0: <Compaq Smart Array 5i> port 0x3000-0x30ff mem 0xf05c0000-0xf05fffff,0xf04f0000-0xf04f3fff irq 30 at device 3.0 on pci1 ciss0: [GIANT-LOCKED] da0 at ciss0 bus 0 target 0 lun 0 da0: <COMPAQ RAID 1 VOLUME OK> Fixed Direct Access SCSI-0 device da0: 135.168MB/s transfers da0: 140006MB (286734240 512 byte sectors: 255H 32S/T 35139C) da1 at ciss0 bus 0 target 1 lun 0 da1: <COMPAQ RAID 0 VOLUME OK> Fixed Direct Access SCSI-0 device da1: 135.168MB/s transfers da1: 140006MB (286734240 512 byte sectors: 255H 32S/T 35139C) da2 at ciss0 bus 0 target 2 lun 0 da2: <COMPAQ RAID 5 VOLUME OK> Fixed Direct Access SCSI-0 device da2: 135.168MB/s transfers da2: 572195MB (1171856412 512 byte sectors: 255H 63S/T 65535C) dmesg Copyright (c) 1992-2006 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD 6.1-RELEASE-p10 #0: Sat Nov 25 15:52:17 PST 2006 root@mail.vfs.com:/usr/src/sys/i386/compile/SMP Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Xeon(TM) CPU 2.80GHz (2786.87-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0xf25 Stepping = 5 Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE ,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> Features2=0x4400<CNTX-ID,<b14>> Logical CPUs per core: 2 real memory = 2147459072 (2047 MB) avail memory = 2096439296 (1999 MB) ACPI APIC Table: <COMPAQ 00000083> FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 6 cpu3 (AP): APIC ID: 7 MADT: Forcing active-low polarity and level trigger for SCI ioapic0 <Version 1.1> irqs 0-15 on motherboard ioapic1 <Version 1.1> irqs 16-31 on motherboard ioapic2 <Version 1.1> irqs 32-47 on motherboard ioapic3 <Version 1.1> irqs 48-63 on motherboard kbd1 at kbdmux0 acpi0: <COMPAQ P29> on motherboard acpi0: Power Button (fixed) Timecounter "ACPI-safe" frequency 3579545 Hz quality 1000 acpi_timer0: <32-bit timer at 3.579545MHz> port 0x920-0x923 on acpi0 cpu0: <ACPI CPU> on acpi0 cpu1: <ACPI CPU> on acpi0 cpu2: <ACPI CPU> on acpi0 cpu3: <ACPI CPU> on acpi0 pcib0: <ACPI Host-PCI bridge> on acpi0 pci0: <ACPI PCI bus> on pcib0 pci0: <display, VGA> at device 3.0 (no driver attached) pci0: <base peripheral> at device 4.0 (no driver attached) pci0: <base peripheral> at device 4.2 (no driver attached) isab0: <PCI-ISA bridge> at device 15.0 on pci0 isa0: <ISA bus> on isab0 atapci0: <ServerWorks CSB5 UDMA100 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x2000-0x200f at device 15.1 on pci0 ata0: <ATA channel 0> on atapci0 ata1: <ATA channel 1> on atapci0 ohci0: <OHCI (generic) USB controller> mem 0xeeef0000-0xeeef0fff irq 7 at device 15.2 on pci0 ohci0: [GIANT-LOCKED] usb0: OHCI version 1.0, legacy support usb0: SMM does not respond, resetting usb0: <OHCI (generic) USB controller> on ohci0 usb0: USB revision 1.0 uhub0: (0x1166) OHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub0: 4 ports with 4 removable, self powered pcib1: <ACPI Host-PCI bridge> on acpi0 pci1: <ACPI PCI bus> on pcib1 ciss0: <Compaq Smart Array 5i> port 0x3000-0x30ff mem 0xf05c0000-0xf05fffff,0xf04f0000-0xf04f3fff irq 30 at device 3.0 on pci1 ciss0: [GIANT-LOCKED] pcib2: <ACPI Host-PCI bridge> on acpi0 pci2: <ACPI PCI bus> on pcib2 bge0: <Broadcom BCM5703 Gigabit Ethernet, ASIC rev. 0x1002> mem 0xf06f0000-0xf06fffff irq 29 at device 1.0 on pci2 miibus0: <MII bus> on bge0 brgphy0: <BCM5703 10/100/1000baseTX PHY> on miibus0 brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX, 1000baseTX-FDX, auto bge0: Ethernet address: 00:11:0a:9e:2f:49 bge1: <Broadcom BCM5703 Gigabit Ethernet, ASIC rev. 0x1002> mem 0xf06e0000-0xf06effff irq 31 at device 2.0 on pci2 miibus1: <MII bus> on bge1 brgphy1: <BCM5703 10/100/1000baseTX PHY> on miibus1 brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX, 1000baseTX-FDX, auto bge1: Ethernet address: 00:11:0a:9e:2f:48 pcib3: <ACPI Host-PCI bridge> on acpi0 pci3: <ACPI PCI bus> on pcib3 pcib4: <ACPI Host-PCI bridge> on acpi0 pci6: <ACPI PCI bus> on pcib4 pci6: <base peripheral, PCI hot-plug controller> at device 30.0 (no driver attached) acpi_tz0: <Thermal Zone> on acpi0 atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0 atkbd0: <AT Keyboard> irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] psm0: <PS/2 Mouse> irq 12 on atkbdc0 psm0: [GIANT-LOCKED] psm0: model IntelliMouse, device ID 3 sio0: <Standard PC COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 sio0: type 16550A fdc0: <floppy drive controller (FDE)> port 0x3f2-0x3f5 irq 6 drq 2 on acpi0 fdc0: [FAST] fd0: <1440-KB 3.5" drive> on fdc0 drive 0 pmtimer0 on isa0 orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xcbfff, 0xcc000-0xcd7ff,0xee000-0xeffff on isa0 ppc0: parallel port not found. sc0: <System console> at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> sio1: configured irq 3 not in bitmap of probed irqs 0 sio1: port may not be enabled vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 Timecounters tick every 1.000 msec acd0: CDROM <COMPAQ CD-ROM SN-124/N104> at ata0-master PIO4 SMP: AP CPU #2 Launched! SMP: AP CPU #1 Launched! SMP: AP CPU #3 Launched! da0 at ciss0 bus 0 target 0 lun 0 da0: <COMPAQ RAID 1 VOLUME OK> Fixed Direct Access SCSI-0 device da0: 135.168MB/s transfers da0: 140006MB (286734240 512 byte sectors: 255H 32S/T 35139C) da1 at ciss0 bus 0 target 1 lun 0 da1: <COMPAQ RAID 0 VOLUME OK> Fixed Direct Access SCSI-0 device da1: 135.168MB/s transfers da1: 140006MB (286734240 512 byte sectors: 255H 32S/T 35139C) da2 at ciss0 bus 0 target 2 lun 0 da2: <COMPAQ RAID 5 VOLUME OK> Fixed Direct Access SCSI-0 device da2: 135.168MB/s transfers da2: 572195MB (1171856412 512 byte sectors: 255H 63S/T 65535C)
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?8A1C4E8F-5409-4A75-AB61-2475F1688330>