From owner-freebsd-questions@FreeBSD.ORG Mon Jan 9 02:10:07 2012 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7CF1B106566B for ; Mon, 9 Jan 2012 02:10:07 +0000 (UTC) (envelope-from freebsd@pki2.com) Received: from btw.pki2.com (btw.pki2.com [IPv6:2001:470:a:6fd::2]) by mx1.freebsd.org (Postfix) with ESMTP id 01BDA8FC17 for ; Mon, 9 Jan 2012 02:10:06 +0000 (UTC) Received: from [127.0.0.1] (localhost [127.0.0.1]) by btw.pki2.com (8.14.5/8.14.5) with ESMTP id q0929mDe062759; Sun, 8 Jan 2012 18:09:48 -0800 (PST) (envelope-from freebsd@pki2.com) From: Dennis Glatting To: Vincent Hoffman In-Reply-To: <4F0A253C.9050205@unsane.co.uk> References: <1325995909.53760.11.camel@btw.pki2.com> <4F0A253C.9050205@unsane.co.uk> Content-Type: text/plain; charset="ISO-8859-1" Date: Sun, 08 Jan 2012 18:09:48 -0800 Message-ID: <1326074988.53760.30.camel@btw.pki2.com> Mime-Version: 1.0 X-Mailer: Evolution 2.32.1 FreeBSD GNOME Team Port Content-Transfer-Encoding: 7bit X-yoursite-MailScanner-Information: Dennis Glatting X-yoursite-MailScanner-ID: q0929mDe062759 X-yoursite-MailScanner: Found to be clean X-MailScanner-From: freebsd@pki2.com X-yoursite-MailScanner-Watermark: 1326679789.03437@3NDw3SXIYw9t2tPrCkd6BQ Cc: freebsd-questions@freebsd.org Subject: Re: RELENG_9 and mps driver (LSI 9211-8i) X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 09 Jan 2012 02:10:07 -0000 A question for folks along the hardware RAID (SATA 2/3) line of thinking. I have systems with bunches of disks where I use ZFS for the arrays but I prefer my OS to be hardware RAID (please, no arguments --it's my bias). My OS disks are usually different and smaller (usually 1TB) than my ZFS array disks (2-3 TB) and they don't see the kind of activity where I'm concerned about performance. My swap is usually a SSD. What are folks bias in terms of simple hardware RAID (RAID1) devices? All I need is a RAID1 device, therefore two ports. I'm looking through various documentation and component sites and there are lots of options. For hardware RAID I have been using Areca 1880i although not yet supported by FreeBSD, expensive, and quirky (I've killed two of them; otherwise it's a nice board). Here these are legacy boards (i.e., they were previously used elsewhere), which is the only reason they make sense in my applications. I have used the HighPoint RocketRAID boards and I must say, collectively (I've had several), I hate them. I've used MB hardware RAID devices, which often work but folks sneer at. In general I run FreeBSD amd64 RELENG_8 but will be migrating to 9, and have done so in several cases. On Sun, 2012-01-08 at 23:22 +0000, Vincent Hoffman wrote: > On 08/01/2012 04:11, Dennis Glatting wrote: > > I have three LSI 9211-8i boards in my system: two flashed to T and one > > R. The Ts appear to work fine but the operating system doesn't see the > > RAID1 volume on R, but neither did RELENG_8. > > > > I am writing to ask how well R is supported, if at all. Or, since this > > my first case of using R under LSI+FreeBSD, perhaps there is common > > mistakes I may be making -- the array is stable. > I dont have one handy to test but the manpage says in the BUGS section > BUGS > This driver is still in development, it has only been tested on the > amd64 > architecture and has some known shortcomings: > o No IR (Integrated RAID) support. > o No userland utility support (e.g. mptutil(8).) > o Sometimes the driver gets into a state where devices arrive and > depart multiple times, without user intervention. > o The error recovery code isn't complete. > > > This along with this thread > http://forums.freebsd.org/archive/index.php/t-4505.html > Indicates the R isnt fully supported, from what i can gather its fine as > JBOD so you can use zfs or one of the geom software RAIDs though. > > > Vince > > > The boards (mps1 is the board with the RAID1 array): > > > > mps0: port 0xde00-0xdeff mem > > 0xfd9fc000-0xfd9fffff,0xfd980000-0xfd9bffff irq 19 at device 0.0 on pci1 > > mps0: Firmware: 12.00.00.00 > > mps0: IOCCapabilities: > > 1285c > > mps1: port 0x9e00-0x9eff mem > > 0xfdefc000-0xfdefffff,0xfde80000-0xfdebffff irq 19 at device 0.0 on pci5 > > mps1: Firmware: 12.00.00.00 > > mps1: IOCCapabilities: > > 185c > > mps2: port 0x8e00-0x8eff mem > > 0xfdcfc000-0xfdcfffff,0xfdc80000-0xfdcbffff irq 16 at device 0.0 on pci6 > > mps2: Firmware: 12.00.00.00 > > mps2: IOCCapabilities: > > 1285c > > > > > > > > bd3# uname -a > > FreeBSD bd3 9.0-STABLE FreeBSD 9.0-STABLE #0: Sat Jan 7 16:09:10 PST > > 2012 root@bd3:/sys/amd64/compile/BULLDOZER amd64 > > > > (i.e., the OS was csup against RELENG_9 and build today). > > > > > > Other data: > > > > > > bd3# dmesg > > Copyright (c) 1992-2012 The FreeBSD Project. > > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 > > The Regents of the University of California. All rights > > reserved. > > FreeBSD is a registered trademark of The FreeBSD Foundation. > > FreeBSD 9.0-STABLE #0: Sat Jan 7 16:09:10 PST 2012 > > root@bd3:/sys/amd64/compile/BULLDOZER amd64 > > CPU: AMD FX(tm)-8150 Eight-Core Processor (4017.99-MHz > > K8-class CPU) > > Origin = "AuthenticAMD" Id = 0x600f12 Family = 15 Model = 1 > > Stepping = 2 > > > > Features=0x178bfbff > MOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT> > > > > Features2=0x1698220b > XSAVE,AVX> > > AMD Features=0x2e500800 > > AMD > > Features2=0x1c9bfff > BS,XOP,SKINIT,WDT,LWP,FMA4,NodeId,Topology,,> > > TSC: P-state invariant, performance statistics > > real memory = 17179869184 (16384 MB) > > avail memory = 16508002304 (15743 MB) > > Event timer "LAPIC" quality 400 > > ACPI APIC Table: > > FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs > > FreeBSD/SMP: 1 package(s) x 8 core(s) > > cpu0 (BSP): APIC ID: 0 > > cpu1 (AP): APIC ID: 1 > > cpu2 (AP): APIC ID: 2 > > cpu3 (AP): APIC ID: 3 > > cpu4 (AP): APIC ID: 4 > > cpu5 (AP): APIC ID: 5 > > cpu6 (AP): APIC ID: 6 > > cpu7 (AP): APIC ID: 7 > > ioapic0: Changing APIC ID to 8 > > ioapic0 irqs 0-23 on motherboard > > kbd1 at kbdmux0 > > acpi0: on motherboard > > acpi0: Power Button (fixed) > > acpi0: reservation of 0, a0000 (3) failed > > acpi0: reservation of 100000, cfca0000 (3) failed > > Timecounter "ACPI-safe" frequency 3579545 Hz quality 850 > > acpi_timer0: <32-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 > > cpu0: on acpi0 > > cpu1: on acpi0 > > cpu2: on acpi0 > > cpu3: on acpi0 > > cpu4: on acpi0 > > cpu5: on acpi0 > > cpu6: on acpi0 > > cpu7: on acpi0 > > acpi_button0: on acpi0 > > pcib0: port 0xcf8-0xcff on acpi0 > > pci0: on pcib0 > > pci0: at device 0.2 (no driver attached) > > pcib1: irq 19 at device 3.0 on pci0 > > pci1: on pcib1 > > mps0: port 0xde00-0xdeff mem > > 0xfd9fc000-0xfd9fffff,0xfd980000-0xfd > > 9bffff irq 19 at device 0.0 on pci1 > > mps0: Firmware: 12.00.00.00 > > mps0: IOCCapabilities: > > 1285c > tReplay,HostDisc> > > pcib2: irq 16 at device 4.0 on pci0 > > pci2: on pcib2 > > em0: port 0xcf00-0xcf1f mem > > 0xfd7c0 > > 000-0xfd7dffff,0xfd700000-0xfd77ffff,0xfd7fc000-0xfd7fffff irq 16 at > > device 0.0 > > on pci2 > > em0: Using MSIX interrupts with 3 vectors > > em0: Ethernet address: 00:1b:21:c6:d2:a0 > > pcib3: irq 17 at device 9.0 on pci0 > > pci3: on pcib3 > > xhci0: mem 0xfd5f8000-0xfd5fffff irq > > 17 at d > > evice 0.0 on pci3 > > xhci0: 64 byte context size. > > usbus0 on xhci0 > > pcib4: irq 18 at device 10.0 on pci0 > > pci4: on pcib4 > > ahci0: port > > 0xaf00-0xaf07,0xae00-0xae03, > > 0xad00-0xad07,0xac00-0xac03,0xab00-0xab0f mem 0xfcbff000-0xfcbff1ff irq > > 18 at de > > vice 0.0 on pci4 > > ahci0: AHCI v1.00 with 2 6Gbps ports, Port Multiplier supported with FBS > > ahcich0: at channel 0 on ahci0 > > ahcich1: at channel 1 on ahci0 > > pcib5: irq 19 at device 11.0 on pci0 > > pci5: on pcib5 > > mps1: port 0x9e00-0x9eff mem > > 0xfdefc000-0xfdefffff,0xfde80000-0xfd > > ebffff irq 19 at device 0.0 on pci5 > > mps1: Firmware: 12.00.00.00 > > mps1: IOCCapabilities: > > 185c > > pcib6: irq 16 at device 12.0 on pci0 > > pci6: on pcib6 > > mps2: port 0x8e00-0x8eff mem > > 0xfdcfc000-0xfdcfffff,0xfdc80000-0xfd > > cbffff irq 16 at device 0.0 on pci6 > > mps2: Firmware: 12.00.00.00 > > mps2: IOCCapabilities: > > 1285c > tReplay,HostDisc> > > pcib7: irq 17 at device 13.0 on pci0 > > pci7: on pcib7 > > vgapci0: port 0xee00-0xeeff mem > > 0xd0000000-0xdfffffff,0 > > xfdac0000-0xfdadffff irq 17 at device 0.0 on pci7 > > hdac0: mem > > 0xfdafc000-0xfdaffff > > f irq 18 at device 0.1 on pci7 > > ahci1: port > > 0xff00-0xff07,0xfe00-0xfe03,0xfd00 > > -0xfd07,0xfc00-0xfc03,0xfb00-0xfb0f mem 0xfdfff000-0xfdfff3ff irq 19 at > > device 1 > > 7.0 on pci0 > > ahci1: AHCI v1.20 with 4 6Gbps ports, Port Multiplier supported > > ahcich2: at channel 0 on ahci1 > > ahcich3: at channel 1 on ahci1 > > ahcich4: at channel 2 on ahci1 > > ahcich5: at channel 3 on ahci1 > > ohci0: mem 0xfdffe000-0xfdffefff irq 18 > > at devic > > e 18.0 on pci0 > > usbus1: on ohci0 > > ehci0: mem 0xfdffd000-0xfdffd0ff irq > > 17 at d > > evice 18.2 on pci0 > > usbus2: EHCI version 1.0 > > usbus2: on ehci0 > > ohci1: mem 0xfdffc000-0xfdffcfff irq 18 > > at devic > > e 19.0 on pci0 > > usbus3: on ohci1 > > ehci1: mem 0xfdffb000-0xfdffb0ff irq > > 17 at d > > evice 19.2 on pci0 > > usbus4: EHCI version 1.0 > > usbus4: on ehci1 > > pci0: at device 20.0 (no driver attached) > > atapci0: port > > 0x1f0-0x1f7,0x3f6,0x170-0x177, > > 0x376,0xfa00-0xfa0f at device 20.1 on pci0 > > ata0: at channel 0 on atapci0 > > ata1: at channel 1 on atapci0 > > isab0: at device 20.3 on pci0 > > isa0: on isab0 > > pcib8: at device 20.4 on pci0 > > pci8: on pcib8 > > ohci2: mem 0xfdffa000-0xfdffafff irq 18 > > at devic > > e 20.5 on pci0 > > usbus5: on ohci2 > > pcib9: at device 21.0 on pci0 > > pci9: on pcib9 > > re0: port > > 0x6e00-0x6ef > > f mem 0xfd0ff000-0xfd0fffff,0xfd0f8000-0xfd0fbfff irq 17 at device 0.0 > > on pci9 > > re0: Using 1 MSI-X message > > re0: Chip rev. 0x2c800000 > > re0: MAC rev. 0x00000000 > > miibus0: on re0 > > rgephy0: PHY 1 on > > miibus0 > > rgephy0: none, 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, > > 100baseTX-FDX > > , 100baseTX-FDX-flow, 1000baseT, 1000baseT-master, 1000baseT-FDX, > > 1000baseT-FDX- > > master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flow > > re0: Ethernet address: 50:e5:49:45:55:8e > > pcib10: at device 21.1 on pci0 > > pci10: on pcib10 > > xhci1: mem 0xfcff8000-0xfcffffff irq > > 17 at d > > evice 0.0 on pci10 > > xhci1: 64 byte context size. > > usbus6 on xhci1 > > pcib11: at device 21.2 on pci0 > > pci11: on pcib11 > > ahci2: port > > 0x3f00-0x3f07,0x3e00-0x3e03, > > 0x3d00-0x3d07,0x3c00-0x3c03,0x3b00-0x3b0f mem 0xfcdff000-0xfcdff1ff irq > > 17 at de > > vice 0.0 on pci11 > > ahci2: AHCI v1.00 with 2 6Gbps ports, Port Multiplier supported with FBS > > ahcich6: at channel 0 on ahci2 > > ahcich7: at channel 1 on ahci2 > > ohci3: mem 0xfdff9000-0xfdff9fff irq 18 > > at devic > > e 22.0 on pci0 > > usbus7: on ohci3 > > ehci2: mem 0xfdff8000-0xfdff80ff irq > > 17 at d > > evice 22.2 on pci0 > > usbus8: EHCI version 1.0 > > usbus8: on ehci2 > > attimer0: port 0x40-0x43 on acpi0 > > Timecounter "i8254" frequency 1193182 Hz quality 0 > > Event timer "i8254" frequency 1193182 Hz quality 100 > > hpet0: iomem 0xfed00000-0xfed003ff irq 0,8 > > on acpi0 > > Timecounter "HPET" frequency 14318180 Hz quality 950 > > atrtc0: port 0x70-0x73 on acpi0 > > Event timer "RTC" frequency 32768 Hz quality 0 > > orm0: at iomem > > 0xc0000-0xcffff,0xd5000-0xdafff,0xdb000-0xdbfff > > on isa0 > > sc0: at flags 0x100 on isa0 > > sc0: VGA <16 virtual consoles, flags=0x300> > > vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on > > isa0 > > atkbdc0: at port 0x60,0x64 on isa0 > > atkbd0: irq 1 on atkbdc0 > > kbd0 at atkbd0 > > atkbd0: [GIANT-LOCKED] > > ppc0: cannot reserve I/O port range > > hwpstate0: on cpu0 > > Timecounters tick every 1.000 msec > > hdac0: HDA Codec #0: ATI R6xx HDMI > > pcm0: at cad 0 nid 1 on hdac0 > > usbus0: 5.0Gbps Super Speed USB v3.0 > > usbus1: 12Mbps Full Speed USB v1.0 > > usbus2: 480Mbps High Speed USB v2.0 > > usbus3: 12Mbps Full Speed USB v1.0 > > usbus4: 480Mbps High Speed USB v2.0 > > usbus5: 12Mbps Full Speed USB v1.0 > > usbus6: 5.0Gbps Super Speed USB v3.0 > > usbus7: 12Mbps Full Speed USB v1.0 > > usbus8: 480Mbps High Speed USB v2.0 > > ugen0.1: <0x1b6f> at usbus0 > > uhub0: <0x1b6f XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on > > usbus0 > > ugen1.1: at usbus1 > > uhub1: on usbus1 > > ugen2.1: at usbus2 > > uhub2: on usbus2 > > ugen3.1: at usbus3 > > uhub3: on usbus3 > > ugen4.1: at usbus4 > > uhub4: on usbus4 > > ugen5.1: at usbus5 > > uhub5: on usbus5 > > ugen6.1: <0x1b6f> at usbus6 > > uhub6: <0x1b6f XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on > > usbus6 > > ugen7.1: at usbus7 > > uhub7: on usbus7 > > ugen8.1: at usbus8 > > uhub8: on usbus8 > > uhub5: 2 ports with 2 removable, self powered > > uhub7: 4 ports with 4 removable, self powered > > uhub1: 5 ports with 5 removable, self powered > > uhub3: 5 ports with 5 removable, self powered > > uhub0: 4 ports with 4 removable, self powered > > uhub6: 4 ports with 4 removable, self powered > > uhub8: 4 ports with 4 removable, self powered > > uhub2: 5 ports with 5 removable, self powered > > uhub4: 5 ports with 5 removable, self powered > > ugen1.2: at usbus1 > > ukbd0: > > on usbus1 > > kbd2 at ukbd0 > > uhid0: > > on usbus1 > > ada0 at ahcich2 bus 0 scbus5 target 0 lun 0 > > ada0: ATA-8 SATA 3.x device > > ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) > > ada0: Command Queueing enabled > > ada0: 85857MB (175836528 512 byte sectors: 16H 63S/T 16383C) > > ada0: Previously was known as ad8 > > ada1 at ahcich3 bus 0 scbus6 target 0 lun 0 > > ada1: ATA-8 SATA 2.x device > > ada1: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) > > ada1: Command Queueing enabled > > ada1: 57241MB (117231408 512 byte sectors: 16H 63S/T 16383C) > > ada1: Previously was known as ad10 > > ada2 at ahcich4 bus 0 scbus7 target 0 lun 0 > > ada2: ATA-8 SATA 2.x device > > ada2: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) > > ada2: Command Queueing enabled > > ada2: 953869MB (1953525168 512 byte sectors: 16H 63S/T 16383C) > > ada2: Previously was known as ad12 > > da7 at mps0 bus 0 scbus0 target 7 lun 0 > > da7: Fixed Direct Access SCSI-6 device > > da7: 300.000MB/s transfers > > da7: Command Queueing enabled > > da7: 2384658MB (4883781168 512 byte sectors: 255H 63S/T 304001C) > > da3 at mps0 bus 0 scbus0 target 3 lun 0 > > da3: Fixed Direct Access SCSI-6 device > > da3: 300.000MB/s transfers > > da3: Command Queueing enabled > > da3: 2384658MB (4883781168 512 byte sectors: 255H 63S/T 304001C) > > da0 at mps0 bus 0 scbus0 target 0 lun 0 > > da0: Fixed Direct Access SCSI-6 device > > da0: 300.000MB/s transfers > > da0: Command Queueing enabled > > da0: 2384658MB (4883781168 512 byte sectors: 255H 63S/T 304001C) > > da9 at mps2 bus 0 scbus4 target 1 lun 0 > > da9: Fixed Direct Access SCSI-6 device > > da9: 300.000MB/s transfers > > da9: Command Queueing enabled > > da9: 2384658MB (4883781168 512 byte sectors: 255H 63S/T 304001C) > > da10 at mps2 bus 0 scbus4 target 2 lun 0 > > da10: Fixed Direct Access SCSI-6 device > > da10: 300.000MB/s transfers > > da10: Command Queueing enabled > > da10: 2384658MB (4883781168 512 byte sectors: 255H 63S/T 304001C) > > da8 at mps2 bus 0 scbus4 target 0 lun 0 > > da8: Fixed Direct Access SCSI-6 device > > da8: 300.000MB/s transfers > > da8: Command Queueing enabled > > da8: 2384658MB (4883781168 512 byte sectors: 255H 63S/T 304001C) > > da11 at mps2 bus 0 scbus4 target 3 lun 0 > > da11: Fixed Direct Access SCSI-6 device > > da11: 300.000MB/s transfers > > da11: Command Queueing enabled > > da11: 2384658MB (4883781168 512 byte sectors: 255H 63S/T 304001C) > > da6 at mps0 bus 0 scbus0 target 6 lun 0 > > da6: Fixed Direct Access SCSI-6 device > > da6: 300.000MB/s transfers > > da6: Command Queueing enabled > > da6: 2384658MB (4883781168 512 byte sectors: 255H 63S/T 304001C) > > da4 at mps0 bus 0 scbus0 target 4 lun 0 > > da4: Fixed Direct Access SCSI-6 device > > da4: 300.000MB/s transfers > > da4: Command Queueing enabled > > da4: 2384658MB (4883781168 512 byte sectors: 255H 63S/T 304001C) > > da5 at mps0 bus 0 scbus0 target 5 lun 0 > > da5: Fixed Direct Access SCSI-6 device > > da5: 300.000MB/s transfers > > da5: Command Queueing enabled > > da5: 2384658MB (4883781168 512 byte sectors: 255H 63S/T 304001C) > > da1 at mps0 bus 0 scbus0 target 1 lun 0 > > da1: Fixed Direct Access SCSI-6 device > > da1: 300.000MB/s transfers > > da1: Command Queueing enabled > > da1: 2384658MB (4883781168 512 byte sectors: 255H 63S/T 304001C) > > da2 at mps0 bus 0 scbus0 target 2 lun 0 > > da2: Fixed Direct Access SCSI-6 device > > da2: 300.000MB/s transfers > > da2: Command Queueing enabled > > da2: 2384658MB (4883781168 512 byte sectors: 255H 63S/T 304001C) > > SMP: AP CPU #1 Launched! > > SMP: AP CPU #4 Launched! > > SMP: AP CPU #6 Launched! > > SMP: AP CPU #5 Launched! > > SMP: AP CPU #2 Launched! > > SMP: AP CPU #7 Launched! > > SMP: AP CPU #3 Launched! > > Timecounter "TSC-low" frequency 15695275 Hz quality 1000 > > Trying to mount root from ufs:/dev/gpt/disk0 [rw]... > > ZFS filesystem version 5 > > ZFS storage pool version 28 > > > > > > _______________________________________________ > > freebsd-questions@freebsd.org mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-questions > > To unsubscribe, send any mail to "freebsd-questions-unsubscribe@freebsd.org" > > _______________________________________________ > freebsd-questions@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-questions > To unsubscribe, send any mail to "freebsd-questions-unsubscribe@freebsd.org"