From owner-freebsd-stable@FreeBSD.ORG Thu Feb 3 11:38:35 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 18EB81065672 for ; Thu, 3 Feb 2011 11:38:35 +0000 (UTC) (envelope-from ml@my.gd) Received: from mail-wy0-f182.google.com (mail-wy0-f182.google.com [74.125.82.182]) by mx1.freebsd.org (Postfix) with ESMTP id 99BE18FC16 for ; Thu, 3 Feb 2011 11:38:32 +0000 (UTC) Received: by wyf19 with SMTP id 19so1035816wyf.13 for ; Thu, 03 Feb 2011 03:38:31 -0800 (PST) Received: by 10.227.157.76 with SMTP id a12mr6067408wbx.57.1296733111376; Thu, 03 Feb 2011 03:38:31 -0800 (PST) Received: from dfleuriot.technique-admin.paris.hi-media-techno.com ([83.167.62.196]) by mx.google.com with ESMTPS id w25sm519258wbd.23.2011.02.03.03.38.29 (version=SSLv3 cipher=RC4-MD5); Thu, 03 Feb 2011 03:38:29 -0800 (PST) Message-ID: <4D4A93B4.9020401@my.gd> Date: Thu, 03 Feb 2011 12:38:28 +0100 From: Damien Fleuriot User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.13) Gecko/20101207 Thunderbird/3.1.7 MIME-Version: 1.0 To: freebsd-stable@freebsd.org References: <20110129222400.R39951@maildrop.int.zabbadoz.net> <20110130221826.GA41684@iqpano.freenix.org> <4D46A276.60304@my.gd> <20110201230912.GB45575@iqpano.freenix.org> In-Reply-To: <20110201230912.GB45575@iqpano.freenix.org> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Subject: Re: KERN - mfi driver for Dell raid h200 on r210 servers X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Feb 2011 11:38:35 -0000 On 2/2/11 12:09 AM, Ollivier Robert wrote: > According to Damien Fleuriot: >> As requested, find below the output of a verbose boot. > > Thanks to Damien and his machine, we have seen that in RAID mode, the mps driver, backported from current (backported as in, drop the mps directory in the 8.2 tree) is not able to see the RAID array. > > De-constructing the RAID and using the disks in passthrough make them visible and we can now configure them as we wish. > > Which is incidently exactly what I intend to do anyway with such a system ;-) > Hello list, As written by Ollivier, it's possible to get the disks in passthrough/JBOD although one still needs the mps driver. I'm writing a procedure as we speak so people can easily get this working. Thanks to everyone who took the time to reply and participate in this thread. Thanks to mm@ for MFSBSD. Thanks to Ollivier for his help with mps. Thanks to the devs for mps in HEAD. Find below some output from the now functional Dell r210 server with the h200 RAID card. DMESG --- Copyright (c) 1992-2011 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 8.2-RC3 #1: Thu Feb 3 11:03:48 CET 2011 root@mybsd:/usr/obj/usr/src/sys/DAM amd64 module_register: module g_label already exists! Module g_label failed to register: 17 Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Xeon(R) CPU L3426 @ 1.87GHz (1862.00-MHz K8-class CPU) Origin = "GenuineIntel" Id = 0x106e5 Family = 6 Model = 1e Stepping = 5 Features=0xbfebfbff Features2=0x98e3fd AMD Features=0x28100800 AMD Features2=0x1 TSC: P-state invariant real memory = 17179869184 (16384 MB) avail memory = 16519426048 (15754 MB) ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs FreeBSD/SMP: 1 package(s) x 4 core(s) x 2 SMT threads cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 2 cpu3 (AP): APIC ID: 3 cpu4 (AP): APIC ID: 4 cpu5 (AP): APIC ID: 5 cpu6 (AP): APIC ID: 6 cpu7 (AP): APIC ID: 7 ACPI Error: Null physical address for ACPI table [(null)] (20101013/tbutils-512) ACPI Error: Null physical address for ACPI table [(null)] (20101013/tbutils-512) ACPI Error: Null physical address for ACPI table [(null)] (20101013/tbutils-512) ACPI Error: Null physical address for ACPI table [(null)] (20101013/tbutils-512) ioapic0 irqs 0-23 on motherboard acpi0: on motherboard acpi0: [ITHREAD] acpi0: Power Button (fixed) unknown: I/O range not supported Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 cpu0: on acpi0 cpu1: on acpi0 cpu2: on acpi0 cpu3: on acpi0 cpu4: on acpi0 cpu5: on acpi0 cpu6: on acpi0 cpu7: on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib1: at device 3.0 on pci0 pci1: on pcib1 mps0: port 0xfc00-0xfcff mem 0xdf2b0000-0xdf2bffff,0xdf2c0000-0xdf2fffff irq 16 at device 0.0 on pci1 mps0: Firmware: 02.15.57.00 mps0: IOCCapabilities: 185c mps0: [ITHREAD] pci0: at device 8.0 (no driver attached) pci0: at device 8.1 (no driver attached) pci0: at device 8.2 (no driver attached) pci0: at device 8.3 (no driver attached) pci0: at device 16.0 (no driver attached) pci0: at device 16.1 (no driver attached) ehci0: mem 0xdf0fa000-0xdf0fa3ff irq 22 at device 26.0 on pci0 ehci0: [ITHREAD] usbus0: EHCI version 1.0 usbus0: on ehci0 pcib2: at device 28.0 on pci0 pci2: on pcib2 bce0: mem 0xda000000-0xdbffffff irq 16 at device 0.0 on pci2 miibus0: on bce0 brgphy0: PHY 1 on miibus0 brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow bce0: Ethernet address: 00:26:b9:7e:83:71 bce0: [ITHREAD] bce1: mem 0xdc000000-0xddffffff irq 17 at device 0.1 on pci2 miibus1: on bce1 brgphy1: PHY 1 on miibus1 brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow bce1: Ethernet address: 00:26:b9:7e:83:72 bce1: [ITHREAD] ehci1: mem 0xdf0fc000-0xdf0fc3ff irq 22 at device 29.0 on pci0 ehci1: [ITHREAD] usbus1: EHCI version 1.0 usbus1: on ehci1 pcib3: at device 30.0 on pci0 pci3: on pcib3 vgapci0: mem 0xd9800000-0xd9ffffff,0xde7fc000-0xde7fffff,0xde800000-0xdeffffff irq 19 at device 3.0 on pci3 isab0: at device 31.0 on pci0 isa0: on isab0 atapci0: port 0xecd0-0xecd7,0xecc8-0xeccb,0xecd8-0xecdf,0xeccc-0xeccf,0xece0-0xecff mem 0xdf0fe000-0xdf0fe7ff irq 20 at device 31.2 on pci0 atapci0: [ITHREAD] atapci0: AHCI called from vendor specific driver atapci0: AHCI v1.30 controller with 6 3Gbps ports, PM supported ata2: on atapci0 ata2: [ITHREAD] ata3: on atapci0 ata3: [ITHREAD] ata4: on atapci0 ata4: [ITHREAD] ata5: on atapci0 ata5: [ITHREAD] ata6: on atapci0 ata6: [ITHREAD] ata7: on atapci0 ata7: [ITHREAD] acpi_hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 900 atrtc0: port 0x70-0x7f irq 8 on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart0: [FILTER] uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 uart1: [FILTER] orm0: at iomem 0xc0000-0xc7fff,0xc8000-0xc8fff,0xec000-0xeffff on isa0 atkbd: unable to set the command byte. sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 atkbdc0: at port 0x60,0x64 on isa0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] atkbd0: [ITHREAD] est0: on cpu0 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr f device_attach: est0 attach returned 6 p4tcc0: on cpu0 est1: on cpu1 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr f device_attach: est1 attach returned 6 p4tcc1: on cpu1 est2: on cpu2 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr f device_attach: est2 attach returned 6 p4tcc2: on cpu2 est3: on cpu3 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr f device_attach: est3 attach returned 6 p4tcc3: on cpu3 est4: on cpu4 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr f device_attach: est4 attach returned 6 p4tcc4: on cpu4 est5: on cpu5 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr f device_attach: est5 attach returned 6 p4tcc5: on cpu5 est6: on cpu6 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr f device_attach: est6 attach returned 6 p4tcc6: on cpu6 est7: on cpu7 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr f device_attach: est7 attach returned 6 p4tcc7: on cpu7 Timecounters tick every 1.000 msec The GEOM class LABEL is already loaded. usbus0: 480Mbps High Speed USB v2.0 usbus1: 480Mbps High Speed USB v2.0 ugen0.1: at usbus0 uhub0: on usbus0 ugen1.1: at usbus1 uhub1: on usbus1 uhub0: 2 ports with 2 removable, self powered uhub1: 2 ports with 2 removable, self powered ugen0.2: at usbus0 uhub2: on usbus0 ugen1.2: at usbus1 uhub3: on usbus1 uhub2: 6 ports with 6 removable, self powered uhub3: 6 ports with 6 removable, self powered ugen1.3: at usbus1 uhub4: on usbus1 ugen0.3: at usbus0 ukbd0: on usbus0 kbd1 at ukbd0 uhid0: on usbus0 uhub4: 4 ports with 4 removable, self powered da0 at mps0 bus 0 scbus0 target 0 lun 0 da0: Fixed Direct Access SCSI-5 device da0: 300.000MB/s transfers da0: Command Queueing enabled da0: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C) da1 at mps0 bus 0 scbus0 target 1 lun 0 da1: Fixed Direct Access SCSI-5 device da1: 300.000MB/s transfers da1: Command Queueing enabled da1: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C) GEOM_MIRROR: Device mirror/mirror-root launched (2/2). GEOM_MIRROR: Device mirror/mirror-swap launched (2/2). GEOM_MIRROR: Device mirror/mirror-usr launched (2/2). GEOM_MIRROR: Device mirror/mirror-var launched (2/2). SMP: AP CPU #1 Launched! SMP: AP CPU #6 Launched! SMP: AP CPU #3 Launched! SMP: AP CPU #5 Launched! SMP: AP CPU #2 Launched! SMP: AP CPU #4 Launched! SMP: AP CPU #7 Launched! Trying to mount root from ufs:/dev/mirror/mirror-root GPART --- => 34 3907029101 da0 GPT (1.8T) 34 128 1 freebsd-boot (64K) 162 12582912 2 freebsd-ufs (6.0G) 12583074 12582912 3 freebsd-swap (6.0G) 25165986 33554432 4 freebsd-ufs (16G) 58720418 67108864 5 freebsd-ufs (32G) 125829282 3781199853 6 freebsd-zfs (1.8T) => 34 3907029101 da1 GPT (1.8T) 34 128 1 freebsd-boot (64K) 162 12582912 2 freebsd-ufs (6.0G) 12583074 12582912 3 freebsd-swap (6.0G) 25165986 33554432 4 freebsd-ufs (16G) 58720418 67108864 5 freebsd-ufs (32G) 125829282 3781199853 6 freebsd-zfs (1.8T) GMIRROR --- Name Status Components mirror/mirror-root COMPLETE da0p2 da1p2 mirror/mirror-swap COMPLETE da0p3 da1p3 mirror/mirror-usr COMPLETE da0p4 da1p4 mirror/mirror-var COMPLETE da0p5 da1p5 DF --- Filesystem Size Used Avail Capacity Mounted on /dev/mirror/mirror-root 5.8G 864M 4.5G 16% / devfs 1.0K 1.0K 0B 100% /dev /dev/mirror/mirror-usr 15G 2.7G 12G 19% /usr /dev/mirror/mirror-var 31G 1.3M 29G 0% /var devfs 1.0K 1.0K 0B 100% /var/named/dev tank 1.7T 21K 1.7T 0% /tank ZPOOL --- pool: tank state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM tank ONLINE 0 0 0 mirror ONLINE 0 0 0 da0p6 ONLINE 0 0 0 da1p6 ONLINE 0 0 0 NAME USED AVAIL REFER MOUNTPOINT tank 72K 1.72T 21K /tank UNAME --- FreeBSD mybsd 8.2-RC3 FreeBSD 8.2-RC3 #1: Thu Feb 3 11:03:48 CET 2011 root@mybsd:/usr/obj/usr/src/sys/DAM amd64 KLDSTAT --- Id Refs Address Size Name 1 14 0xffffffff80100000 911b58 kernel 2 1 0xffffffff80a12000 bc10 geom_label.ko 3 1 0xffffffff80a1e000 21068 geom_mirror.ko 4 1 0xffffffff80c22000 104a7a zfs.ko 5 1 0xffffffff80d27000 f28c krpc.ko 6 1 0xffffffff80d37000 1a22 opensolaris.ko BUILT-IN mps driver --- mybsd# kldstat -v |grep mps 97 pci/mps