Date: Thu, 03 Feb 2011 12:38:28 +0100 From: Damien Fleuriot <ml@my.gd> To: freebsd-stable@freebsd.org Subject: Re: KERN - mfi driver for Dell raid h200 on r210 servers Message-ID: <4D4A93B4.9020401@my.gd> In-Reply-To: <20110201230912.GB45575@iqpano.freenix.org> References: <AANLkTikfZ_ba4w975Y9pB4inY2xWae2i0253SM=ie-G0@mail.gmail.com> <20110129222400.R39951@maildrop.int.zabbadoz.net> <AANLkTi=wbi3B%2BxSKBR-6TsFbBHWP26PE=HBUpKYBzG-1@mail.gmail.com> <20110130221826.GA41684@iqpano.freenix.org> <4D46A276.60304@my.gd> <20110201230912.GB45575@iqpano.freenix.org>
next in thread | previous in thread | raw e-mail | index | archive | help
On 2/2/11 12:09 AM, Ollivier Robert wrote:
> According to Damien Fleuriot:
>> As requested, find below the output of a verbose boot.
>
> Thanks to Damien and his machine, we have seen that in RAID mode, the mps driver, backported from current (backported as in, drop the mps directory in the 8.2 tree) is not able to see the RAID array.
>
> De-constructing the RAID and using the disks in passthrough make them visible and we can now configure them as we wish.
>
> Which is incidently exactly what I intend to do anyway with such a system ;-)
>
Hello list,
As written by Ollivier, it's possible to get the disks in
passthrough/JBOD although one still needs the mps driver.
I'm writing a procedure as we speak so people can easily get this working.
Thanks to everyone who took the time to reply and participate in this
thread.
Thanks to mm@ for MFSBSD.
Thanks to Ollivier for his help with mps.
Thanks to the devs for mps in HEAD.
Find below some output from the now functional Dell r210 server with the
h200 RAID card.
DMESG
---
Copyright (c) 1992-2011 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 8.2-RC3 #1: Thu Feb 3 11:03:48 CET 2011
root@mybsd:/usr/obj/usr/src/sys/DAM amd64
module_register: module g_label already exists!
Module g_label failed to register: 17
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(R) CPU L3426 @ 1.87GHz (1862.00-MHz
K8-class CPU)
Origin = "GenuineIntel" Id = 0x106e5 Family = 6 Model = 1e
Stepping = 5
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Features2=0x98e3fd<SSE3,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,POPCNT>
AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
AMD Features2=0x1<LAHF>
TSC: P-state invariant
real memory = 17179869184 (16384 MB)
avail memory = 16519426048 (15754 MB)
ACPI APIC Table: <DELL PE_SC3 >
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
FreeBSD/SMP: 1 package(s) x 4 core(s) x 2 SMT threads
cpu0 (BSP): APIC ID: 0
cpu1 (AP): APIC ID: 1
cpu2 (AP): APIC ID: 2
cpu3 (AP): APIC ID: 3
cpu4 (AP): APIC ID: 4
cpu5 (AP): APIC ID: 5
cpu6 (AP): APIC ID: 6
cpu7 (AP): APIC ID: 7
ACPI Error: Null physical address for ACPI table [(null)]
(20101013/tbutils-512)
ACPI Error: Null physical address for ACPI table [(null)]
(20101013/tbutils-512)
ACPI Error: Null physical address for ACPI table [(null)]
(20101013/tbutils-512)
ACPI Error: Null physical address for ACPI table [(null)]
(20101013/tbutils-512)
ioapic0 <Version 2.0> irqs 0-23 on motherboard
acpi0: <DELL PE_SC3> on motherboard
acpi0: [ITHREAD]
acpi0: Power Button (fixed)
unknown: I/O range not supported
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
cpu4: <ACPI CPU> on acpi0
cpu5: <ACPI CPU> on acpi0
cpu6: <ACPI CPU> on acpi0
cpu7: <ACPI CPU> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 3.0 on pci0
pci1: <ACPI PCI bus> on pcib1
mps0: <LSI SAS2008> port 0xfc00-0xfcff mem
0xdf2b0000-0xdf2bffff,0xdf2c0000-0xdf2fffff irq 16 at device 0.0 on pci1
mps0: Firmware: 02.15.57.00
mps0: IOCCapabilities:
185c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,IR>
mps0: [ITHREAD]
pci0: <base peripheral> at device 8.0 (no driver attached)
pci0: <base peripheral> at device 8.1 (no driver attached)
pci0: <base peripheral> at device 8.2 (no driver attached)
pci0: <base peripheral> at device 8.3 (no driver attached)
pci0: <base peripheral> at device 16.0 (no driver attached)
pci0: <base peripheral> at device 16.1 (no driver attached)
ehci0: <Intel PCH USB 2.0 controller USB-B> mem 0xdf0fa000-0xdf0fa3ff
irq 22 at device 26.0 on pci0
ehci0: [ITHREAD]
usbus0: EHCI version 1.0
usbus0: <Intel PCH USB 2.0 controller USB-B> on ehci0
pcib2: <ACPI PCI-PCI bridge> at device 28.0 on pci0
pci2: <ACPI PCI bus> on pcib2
bce0: <Broadcom NetXtreme II BCM5716 1000Base-T (C0)> mem
0xda000000-0xdbffffff irq 16 at device 0.0 on pci2
miibus0: <MII bus> on bce0
brgphy0: <BCM5709C 10/100/1000baseTX PHY> PHY 1 on miibus0
brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT,
1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
bce0: Ethernet address: 00:26:b9:7e:83:71
bce0: [ITHREAD]
bce1: <Broadcom NetXtreme II BCM5716 1000Base-T (C0)> mem
0xdc000000-0xddffffff irq 17 at device 0.1 on pci2
miibus1: <MII bus> on bce1
brgphy1: <BCM5709C 10/100/1000baseTX PHY> PHY 1 on miibus1
brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT,
1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
bce1: Ethernet address: 00:26:b9:7e:83:72
bce1: [ITHREAD]
ehci1: <Intel PCH USB 2.0 controller USB-A> mem 0xdf0fc000-0xdf0fc3ff
irq 22 at device 29.0 on pci0
ehci1: [ITHREAD]
usbus1: EHCI version 1.0
usbus1: <Intel PCH USB 2.0 controller USB-A> on ehci1
pcib3: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci3: <ACPI PCI bus> on pcib3
vgapci0: <VGA-compatible display> mem
0xd9800000-0xd9ffffff,0xde7fc000-0xde7fffff,0xde800000-0xdeffffff irq 19
at device 3.0 on pci3
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel 5 Series/3400 Series PCH SATA300 controller> port
0xecd0-0xecd7,0xecc8-0xeccb,0xecd8-0xecdf,0xeccc-0xeccf,0xece0-0xecff
mem 0xdf0fe000-0xdf0fe7ff irq 20 at device 31.2 on pci0
atapci0: [ITHREAD]
atapci0: AHCI called from vendor specific driver
atapci0: AHCI v1.30 controller with 6 3Gbps ports, PM supported
ata2: <ATA channel 0> on atapci0
ata2: [ITHREAD]
ata3: <ATA channel 1> on atapci0
ata3: [ITHREAD]
ata4: <ATA channel 2> on atapci0
ata4: [ITHREAD]
ata5: <ATA channel 3> on atapci0
ata5: [ITHREAD]
ata6: <ATA channel 4> on atapci0
ata6: [ITHREAD]
ata7: <ATA channel 5> on atapci0
ata7: [ITHREAD]
acpi_hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on
acpi0
Timecounter "HPET" frequency 14318180 Hz quality 900
atrtc0: <AT realtime clock> port 0x70-0x7f irq 8 on acpi0
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart0: [FILTER]
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
uart1: [FILTER]
orm0: <ISA Option ROMs> at iomem
0xc0000-0xc7fff,0xc8000-0xc8fff,0xec000-0xeffff on isa0
atkbd: unable to set the command byte.
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
atkbd0: [ITHREAD]
est0: <Enhanced SpeedStep Frequency Control> on cpu0
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr f
device_attach: est0 attach returned 6
p4tcc0: <CPU Frequency Thermal Control> on cpu0
est1: <Enhanced SpeedStep Frequency Control> on cpu1
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr f
device_attach: est1 attach returned 6
p4tcc1: <CPU Frequency Thermal Control> on cpu1
est2: <Enhanced SpeedStep Frequency Control> on cpu2
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr f
device_attach: est2 attach returned 6
p4tcc2: <CPU Frequency Thermal Control> on cpu2
est3: <Enhanced SpeedStep Frequency Control> on cpu3
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr f
device_attach: est3 attach returned 6
p4tcc3: <CPU Frequency Thermal Control> on cpu3
est4: <Enhanced SpeedStep Frequency Control> on cpu4
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr f
device_attach: est4 attach returned 6
p4tcc4: <CPU Frequency Thermal Control> on cpu4
est5: <Enhanced SpeedStep Frequency Control> on cpu5
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr f
device_attach: est5 attach returned 6
p4tcc5: <CPU Frequency Thermal Control> on cpu5
est6: <Enhanced SpeedStep Frequency Control> on cpu6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr f
device_attach: est6 attach returned 6
p4tcc6: <CPU Frequency Thermal Control> on cpu6
est7: <Enhanced SpeedStep Frequency Control> on cpu7
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr f
device_attach: est7 attach returned 6
p4tcc7: <CPU Frequency Thermal Control> on cpu7
Timecounters tick every 1.000 msec
The GEOM class LABEL is already loaded.
usbus0: 480Mbps High Speed USB v2.0
usbus1: 480Mbps High Speed USB v2.0
ugen0.1: <Intel> at usbus0
uhub0: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus0
ugen1.1: <Intel> at usbus1
uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
uhub0: 2 ports with 2 removable, self powered
uhub1: 2 ports with 2 removable, self powered
ugen0.2: <vendor 0x8087> at usbus0
uhub2: <vendor 0x8087 product 0x0020, class 9/0, rev 2.00/0.00, addr 2>
on usbus0
ugen1.2: <vendor 0x8087> at usbus1
uhub3: <vendor 0x8087 product 0x0020, class 9/0, rev 2.00/0.00, addr 2>
on usbus1
uhub2: 6 ports with 6 removable, self powered
uhub3: 6 ports with 6 removable, self powered
ugen1.3: <vendor 0x0424> at usbus1
uhub4: <vendor 0x0424 product 0x2514, class 9/0, rev 2.00/0.00, addr 3>
on usbus1
ugen0.3: <Avocent> at usbus0
ukbd0: <Keyboard> on usbus0
kbd1 at ukbd0
uhid0: <Mouse> on usbus0
uhub4: 4 ports with 4 removable, self powered
da0 at mps0 bus 0 scbus0 target 0 lun 0
da0: <ATA Hitachi HUA72202 A25C> Fixed Direct Access SCSI-5 device
da0: 300.000MB/s transfers
da0: Command Queueing enabled
da0: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
da1 at mps0 bus 0 scbus0 target 1 lun 0
da1: <ATA Hitachi HUA72202 A25C> Fixed Direct Access SCSI-5 device
da1: 300.000MB/s transfers
da1: Command Queueing enabled
da1: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
GEOM_MIRROR: Device mirror/mirror-root launched (2/2).
GEOM_MIRROR: Device mirror/mirror-swap launched (2/2).
GEOM_MIRROR: Device mirror/mirror-usr launched (2/2).
GEOM_MIRROR: Device mirror/mirror-var launched (2/2).
SMP: AP CPU #1 Launched!
SMP: AP CPU #6 Launched!
SMP: AP CPU #3 Launched!
SMP: AP CPU #5 Launched!
SMP: AP CPU #2 Launched!
SMP: AP CPU #4 Launched!
SMP: AP CPU #7 Launched!
Trying to mount root from ufs:/dev/mirror/mirror-root
GPART
---
=> 34 3907029101 da0 GPT (1.8T)
34 128 1 freebsd-boot (64K)
162 12582912 2 freebsd-ufs (6.0G)
12583074 12582912 3 freebsd-swap (6.0G)
25165986 33554432 4 freebsd-ufs (16G)
58720418 67108864 5 freebsd-ufs (32G)
125829282 3781199853 6 freebsd-zfs (1.8T)
=> 34 3907029101 da1 GPT (1.8T)
34 128 1 freebsd-boot (64K)
162 12582912 2 freebsd-ufs (6.0G)
12583074 12582912 3 freebsd-swap (6.0G)
25165986 33554432 4 freebsd-ufs (16G)
58720418 67108864 5 freebsd-ufs (32G)
125829282 3781199853 6 freebsd-zfs (1.8T)
GMIRROR
---
Name Status Components
mirror/mirror-root COMPLETE da0p2
da1p2
mirror/mirror-swap COMPLETE da0p3
da1p3
mirror/mirror-usr COMPLETE da0p4
da1p4
mirror/mirror-var COMPLETE da0p5
da1p5
DF
---
Filesystem Size Used Avail Capacity Mounted on
/dev/mirror/mirror-root 5.8G 864M 4.5G 16% /
devfs 1.0K 1.0K 0B 100% /dev
/dev/mirror/mirror-usr 15G 2.7G 12G 19% /usr
/dev/mirror/mirror-var 31G 1.3M 29G 0% /var
devfs 1.0K 1.0K 0B 100% /var/named/dev
tank 1.7T 21K 1.7T 0% /tank
ZPOOL
---
pool: tank
state: ONLINE
scrub: none requested
config:
NAME STATE READ WRITE CKSUM
tank ONLINE 0 0 0
mirror ONLINE 0 0 0
da0p6 ONLINE 0 0 0
da1p6 ONLINE 0 0 0
NAME USED AVAIL REFER MOUNTPOINT
tank 72K 1.72T 21K /tank
UNAME
---
FreeBSD mybsd 8.2-RC3 FreeBSD 8.2-RC3 #1: Thu Feb 3 11:03:48 CET 2011
root@mybsd:/usr/obj/usr/src/sys/DAM amd64
KLDSTAT
---
Id Refs Address Size Name
1 14 0xffffffff80100000 911b58 kernel
2 1 0xffffffff80a12000 bc10 geom_label.ko
3 1 0xffffffff80a1e000 21068 geom_mirror.ko
4 1 0xffffffff80c22000 104a7a zfs.ko
5 1 0xffffffff80d27000 f28c krpc.ko
6 1 0xffffffff80d37000 1a22 opensolaris.ko
BUILT-IN mps driver
---
mybsd# kldstat -v |grep mps
97 pci/mps
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4D4A93B4.9020401>