From owner-freebsd-questions Sat Feb 2 19:24:11 2002 Delivered-To: freebsd-questions@freebsd.org Received: from dns1.digitalglobe.com (dns1.digitalglobe.com [205.166.175.34]) by hub.freebsd.org (Postfix) with ESMTP id E19FF37B400 for ; Sat, 2 Feb 2002 19:22:41 -0800 (PST) Received: from dhcp14.digitalglobe.com (dhcp14.digitalglobe.com [10.10.44.14]) by dns1.digitalglobe.com (8.11.6/8.11.4) with ESMTP id g133Cuv05134 for ; Sat, 2 Feb 2002 20:12:56 -0700 (MST) Subject: QLOGIC 2200/FBSD 4.5/Chapparel *desperation* ;)] From: John-David Childs To: freebsd-questions@freebsd.org Content-Type: multipart/mixed; boundary="=-LTGeibQcQ+VGJfX3lirw" X-Mailer: Evolution/1.0 (Preview Release) Date: 02 Feb 2002 20:22:41 -0700 Message-Id: <1012706561.23226.7.camel@dhcp14> Mime-Version: 1.0 Sender: owner-freebsd-questions@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.ORG --=-LTGeibQcQ+VGJfX3lirw Content-Type: text/plain Content-Transfer-Encoding: 7bit IF this gets posted more than once, I apologize...I waited for several hours for the post to come through before resending. I'm *desperately* trying to get FreeBSD 4.5 (ok, *any* version of FreeBSD) working with a QLOGIC 2200 fibre-channel HBA, Chapparel RAID controller, and Fortra enclosure. The raid is built with 12 73 GB Ultra160 SCSI disks. > Why am I desperate, you ask? Because I told my boss it could be done. Because I have three days to get this thing running or I get to eat crow. Because I've been using FreeBSD whereever and whenever possible since 1992, and bringing FreeBSD into the corporate workplaces at my full-time and contract jobs whenever it made sense. Unfortunately, I lost a recent battle to employ FreeBSD as corporate webserver(s) and desktop workstations...because the JVM (both native and Linux-emulated) crashed under heavy load. Now, I'm hoping to redeem myself. Unfortunately, losing this battle will mean eliminating FreeBSD from my current company...because only the Sendmail/DNS servers remain...and they'll be (relatively) unsupportable when I'm escorted out the door in this heavily Sun/SGI and ever-more-common Linux shop. Another sysadmin has managed to get this setup working with Linux, although very poorly. We've also managed to get the ISP2200, Chapparel, and Fortra setup working quite well with the various SUN and SGI workstations/servers in the company. The current server uses FreeBSD, but without the QLOGIC/Chapparel/Fortra setup. (BTW: It was running 4.4-STABLE with networking/performance problems (notably FTP) which were alleviated by some serious kernel tweaks and lots of RAM, but 4.5 (and recent 4.4-STABLE fixes) have improved networking quite a bit. In fact...a PIII-600 FreeBSD box with 512M RAM was able to keep pace with a P4 1.7Ghz box using 1G RAM...but I digress). I've turned the QLOGIC BIOS on, I've enabled isp and isp-fw in the kernel, tried with TAGGING=1 and TAGGING off. There is also an Adaptec AIC7892 Ultra160 SCSI controller on the motherboard, which controls the boot device (da0). It appears to share IRQ 14 with the ISP2200, although FreeBSD appears to move it to IRQ 18. The BIOS can see the RAID array on LUN 1, and Booteasy presents an F1 to boot FreeBSD, and F5 to boot "Disk 1". FreeBSD can see the QLOGIC 2200, download firmware, and perform a LIP Reset. But NO drives show up. I'm about to rip the Chapparel RAID controller out of the Fortra and see if I can see the disks as a JBOD, using VINUM for RAID 3 or 5. But before I do that and have to tell my boss that I wasted several thousand dollars, I thought I'd plead for help here. Attached are the output of my latest dmesg (boot -v) and kernel. I've just now enabled the SES driver and I'm in the middle of a kernel rebuild/install. Ok, that didn't help. Or else, more likely, I really don't know what I'm doing and what I'm missing. CAM_DEBUG is on in the kernel, for all Targets and LUNs. I'd be eternally grateful for all help or suggestions. The attached KERNEL config has all commented lines removed (originated from a LINT config file). --=-LTGeibQcQ+VGJfX3lirw Content-Disposition: attachment; filename=MYFTP.KERNEL Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=ISO-8859-1 machine i386 ident FTP maxusers 512 makeoptions CONF_CFLAGS=3D-fno-builtin #Don't allow use of memcmp, etc. options MAXDSIZ=3D"(512*1024*1024)" options MAXSSIZ=3D"(512*1024*1024)" options DFLDSIZ=3D"(128*1024*1024)" options BLKDEV_IOSIZE=3D8192 options INCLUDE_CONFIG_FILE # Include this file in kernel =0C options SMP # Symmetric MultiProcessor Kernel options APIC_IO # Symmetric (APIC) I/O =0C cpu I586_CPU # aka Pentium(tm) cpu I686_CPU # aka Pentium Pro(tm) options CPU_ENABLE_SSE options CPU_FASTER_5X86_FPU options NO_F00F_HACK #new math emulator =0C options COMPAT_43 options USER_LDT #allow user-level control of i386 ldt options SYSVSHM # include support for shared memory options SHMMAXPGS=3D10240 # max amount of shared memory pages (4k on i386) options SHMMAX=3D"(SHMMAXPGS*PAGE_SIZE+1)" # max shared memory segment size (bytes) options SHMMNI=3D4096 # max number of shared memory identifiers options SHMSEG=3D1024 # max shared memory segments per process options SYSVSEM # include support for semaphores options SEMMSL=3D1024 # max number of semaphores per id options SYSVMSG # include support for message queues =0C options UCONSOLE options USERCONFIG #boot -c editor options VISUAL_USERCONFIG #visual boot -c editor =0C options INET #Internet communications protocols pseudo-device ether #Generic Ethernet pseudo-device loop #Network loopback device pseudo-device bpf #Berkeley packet filter options RANDOM_IP_ID options TCP_DROP_SYNFIN #drop TCP packets with SYN+FIN options ICMP_BANDLIM =0C options FFS #Fast filesystem options NFS_NOSERVER #Disable the NFS-server code. options KERNFS #Kernel filesystem options PROCFS #Process filesystem options SOFTUPDATES options UFS_DIRHASH =0C options P1003_1B options _KPOSIX_PRIORITY_SCHEDULING options _KPOSIX_VERSION=3D199309L =0C =0C device scbus #base SCSI code device da #SCSI direct access devices (aka disks) device cd #SCSI CD-ROMs device ses #SCSI SES/SAF-TE driver options CAMDEBUG options CAM_DEBUG_BUS=3D-1 options CAM_DEBUG_TARGET=3D-1 options CAM_DEBUG_LUN=3D-1 =0C pseudo-device pty #Pseudo ttys pseudo-device speaker #Play IBM BASIC-style noises out your speaker pseudo-device gzip #Exec gzipped a.out's pseudo-device vn #Vnode driver (turns a file into a device) pseudo-device snp 3 #Snoop device - to look at pty/vty/etc.. =0C device isa options AUTO_EOI_1 options MAXMEM=3D"(2048*1024)" device atkbdc0 at isa? port IO_KBD device atkbd0 at atkbdc? irq 1 device psm0 at atkbdc? irq 12 #for some laptops device vga0 at isa? options VGA_NO_FONT_LOADING # don't save/load font options VGA_NO_MODE_CHANGE # don't change video modes options VESA device sc0 at isa? options MAXCONS=3D16 # number of virtual consoles options SC_DFLT_FONT # compile font in makeoptions SC_DFLT_FONT=3Dcp850 options SC_HISTORY_SIZE=3D200 # number of history buffer lines options SC_NORM_ATTR=3D"(FG_GREEN|BG_BLACK)" options SC_NORM_REV_ATTR=3D"(FG_YELLOW|BG_GREEN)" options SC_KERNEL_CONS_ATTR=3D"(FG_RED|BG_BLACK)" options SC_KERNEL_CONS_REV_ATTR=3D"(FG_BLACK|BG_RED)" device npx0 at nexus? port IO_NPX flags 0x0 irq 13 device aac device ata device atadisk # ATA disk drives device atapicd # ATAPI CDROM drives options ATA_STATIC_ID device fdc0 at isa? port IO_FD1 irq 6 drq 2 device fd0 at fdc0 drive 0 device fd1 at fdc0 drive 1 device sio0 at isa? port IO_COM1 flags 0x10 irq 4 device sio1 at isa? port IO_COM2 flags 0x10 irq 3 device sio2 at isa? port IO_COM3 flags 0x10 irq 4 #DDB, if available. options CONSPEED=3D9600 # speed for serial console # (default 9600) device pca0 at isa? port IO_TIMER1 device pci device ahc # AHA2940 and onboard AIC7xxx devices device isp # Qlogic family device ispfw # Firmware for QLogic HBAs # Allows the ncr to take precedence # 1 (1<<0) -> 810a, 860 # 2 (1<<1) -> 825a, 875, 885, 895 # 4 (1<<2) -> 895a, 896, 1510d=20 # disabled:0 (default), enabled:1 # disabled:0, enabled:1 (default) # default:8, range:[1..64] device miibus device fxp # Intel EtherExpress PRO/100B (82557, 82558) device xl # 3Com 3c90x (``Boomerang'', ``Cyclone'') device txp # 3Com 3cR990 (``Typhoon'') device vx # 3Com 3c590, 3c595 (``Vortex'') device bge # Broadcom BCM570x (``Tigon III'') device gx # Intel Pro/1000 (82542, 82543) device ti # Alteon (``Tigon I'', ``Tigon II'') device wx options PPC_PROBE_CHIPSET # Enable chipset specific detection # (see flags in ppc(4)) # compliant peripheral options PANIC_REBOOT_WAIT_TIME=3D5 device uhci device ohci device usb device ukbd device ulpt device umass device umodem device ums --=-LTGeibQcQ+VGJfX3lirw Content-Disposition: attachment; filename=ftpdmesg Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=ISO-8859-1 Copyright (c) 1992-2002 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD 4.5-STABLE #2: Sat Feb 2 18:36:21 GMT 2002 root@:/usr/obj/usr/src/sys/FTP Calibrating clock(s) ... TSC clock: 1680754112 Hz, i8254 clock: 1193139 Hz CLK_USE_I8254_CALIBRATION not specified - using default frequency Timecounter "i8254" frequency 1193182 Hz CLK_USE_TSC_CALIBRATION not specified - using old calibration method CPU: Pentium 4 (1680.83-MHz 686-class CPU) Origin =3D "GenuineIntel" Id =3D 0xf12 Stepping =3D 2 Features=3D0x3febfbff,ACC> real memory =3D 2147483648 (2097152K bytes) Physical memory chunk(s): 0x00001000 - 0x0009efff, 647168 bytes (158 pages) 0x00412000 - 0x7fff7fff, 2143182848 bytes (523238 pages) avail memory =3D 2087559168 (2038632K bytes) Changing APIC ID for IO APIC #0 from 0 to 2 on chip Programming 24 pins in IOAPIC #0 IOAPIC #0 intpin 2 -> irq 0 SMP: CPU0 apic_initialize(): lint0: 0x00000700 lint1: 0x00010400 TPR: 0x00000010 SVR: 0x000001ff FreeBSD/SMP: Multiprocessor motherboard cpu0 (BSP): apic id: 0, version: 0x00050014, at 0xfee00000 cpu1 (AP): apic id: 1, version: 0x00050014, at 0xfee00000 io0 (APIC): apic id: 2, version: 0x00178020, at 0xfec00000 bios32: Found BIOS32 Service Directory header at 0xc00ffe80 bios32: Entry =3D 0xffe90 (c00ffe90) Rev =3D 0 Len =3D 1 pcibios: PCI BIOS entry at 0xbe6e pnpbios: Found PnP BIOS data at 0xc00fe2d0 pnpbios: Entry =3D f0000:e2f4 Rev =3D 1.0 Other BIOS signatures found: ACPI: 000fd560 Preloaded elf kernel "kernel" at 0xc03e8000. SMP: CPU0 bsp_apic_configure(): lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000010 SVR: 0x000001ff pci_open(1): mode 1 addr port (0x0cf8) is 0x80000090 pci_open(1a): mode1res=3D0x80000000 (0x80000000) pci_cfgcheck: device 0 [class=3D060000] [hdr=3D00] is there (id=3D25318086) Using $PIR table, 12 entries at 0xc00fb9c0 npx0: on motherboard npx0: INT 16 interface pcib0: on motherboard found-> vendor=3D0x8086, dev=3D0x2531, revid=3D0x04 class=3D06-00-00, hdrtype=3D0x00, mfdev=3D0 subordinatebus=3D0 secondarybus=3D0 map[10]: type 1, range 32, base e8000000, size 27 found-> vendor=3D0x8086, dev=3D0x2532, revid=3D0x04 class=3D06-04-00, hdrtype=3D0x01, mfdev=3D0 subordinatebus=3D1 secondarybus=3D1 found-> vendor=3D0x8086, dev=3D0x2533, revid=3D0x04 class=3D06-04-00, hdrtype=3D0x01, mfdev=3D0 subordinatebus=3D3 secondarybus=3D2 found-> vendor=3D0x8086, dev=3D0x244e, revid=3D0x04 class=3D06-04-00, hdrtype=3D0x01, mfdev=3D0 subordinatebus=3D4 secondarybus=3D4 found-> vendor=3D0x8086, dev=3D0x2440, revid=3D0x04 class=3D06-01-00, hdrtype=3D0x00, mfdev=3D1 subordinatebus=3D0 secondarybus=3D0 found-> vendor=3D0x8086, dev=3D0x244b, revid=3D0x04 class=3D01-01-80, hdrtype=3D0x00, mfdev=3D0 subordinatebus=3D0 secondarybus=3D0 map[20]: type 1, range 32, base 0000ffa0, size 4 IOAPIC #0 intpin 19 -> irq 2 Freeing (NOT implemented) redirected PCI irq 14. found-> vendor=3D0x8086, dev=3D0x2442, revid=3D0x04 class=3D0c-03-00, hdrtype=3D0x00, mfdev=3D0 subordinatebus=3D0 secondarybus=3D0 intpin=3Dd, irq=3D2 map[20]: type 1, range 32, base 0000ff80, size 5 IOAPIC #0 intpin 17 -> irq 13 Freeing (NOT implemented) redirected PCI irq 11. found-> vendor=3D0x8086, dev=3D0x2443, revid=3D0x04 class=3D0c-05-00, hdrtype=3D0x00, mfdev=3D0 subordinatebus=3D0 secondarybus=3D0 intpin=3Db, irq=3D13 map[20]: type 1, range 32, base 0000bcd0, size 4 IOAPIC #0 intpin 23 -> irq 16 Freeing (NOT implemented) redirected PCI irq 10. found-> vendor=3D0x8086, dev=3D0x2444, revid=3D0x04 class=3D0c-03-00, hdrtype=3D0x00, mfdev=3D0 subordinatebus=3D0 secondarybus=3D0 intpin=3Dc, irq=3D16 map[20]: type 1, range 32, base 0000ff60, size 5 Freeing (NOT implemented) redirected PCI irq 11. found-> vendor=3D0x8086, dev=3D0x2445, revid=3D0x04 class=3D04-01-00, hdrtype=3D0x00, mfdev=3D0 subordinatebus=3D0 secondarybus=3D0 intpin=3Db, irq=3D13 map[10]: type 1, range 32, base 0000b800, size 8 map[14]: type 1, range 32, base 0000bc40, size 6 pci0: on pcib0 pcib1: at device 1.0 on p= ci0 IOAPIC #0 intpin 16 -> irq 17 Freeing (NOT implemented) redirected PCI irq 9. found-> vendor=3D0x1002, dev=3D0x5159, revid=3D0x00 class=3D03-00-00, hdrtype=3D0x00, mfdev=3D0 subordinatebus=3D0 secondarybus=3D0 intpin=3Da, irq=3D17 map[10]: type 1, range 32, base f0000000, size 27 map[14]: type 1, range 32, base 0000ec00, size 8 map[18]: type 1, range 32, base ff9f0000, size 16 pci1: on pcib1 pci1: (vendor=3D0x1002, dev=3D0x5159)= at 0.0 irq 17 pcib2: at device 2.0 on p= ci0 found-> vendor=3D0x8086, dev=3D0x1360, revid=3D0x03 class=3D06-04-00, hdrtype=3D0x01, mfdev=3D0 subordinatebus=3D3 secondarybus=3D3 pci2: on pcib2 pcib3: at device 31.0 on = pci2 found-> vendor=3D0x8086, dev=3D0x1161, revid=3D0x01 class=3D08-00-20, hdrtype=3D0x00, mfdev=3D1 subordinatebus=3D0 secondarybus=3D0 IOAPIC #0 intpin 21 -> irq 18 Freeing (NOT implemented) redirected PCI irq 14. found-> vendor=3D0x1077, dev=3D0x2200, revid=3D0x05 class=3D01-00-00, hdrtype=3D0x00, mfdev=3D0 subordinatebus=3D0 secondarybus=3D0 intpin=3Da, irq=3D18 map[10]: type 1, range 32, base 0000dc00, size 8 map[14]: type 1, range 32, base ff7fe000, size 12 IOAPIC #0 intpin 22 -> irq 19 Freeing (NOT implemented) redirected PCI irq 14. found-> vendor=3D0x9005, dev=3D0x008f, revid=3D0x02 class=3D01-00-00, hdrtype=3D0x00, mfdev=3D0 subordinatebus=3D0 secondarybus=3D0 intpin=3Da, irq=3D19 map[10]: type 1, range 32, base 0000d800, size 8 map[14]: type 1, range 64, base ff7fd000, size 12 pci3: on pcib3 pci3: (vendor=3D0x8086, dev=3D0x1161) at 0.0 Qlogic ISP Driver, FreeBSD Version 4.16, Core Version 2.5 isp0: port 0xdc00-0xdcff mem 0xff7fe000= -0xff7fefff irq 18 at device 13.0 on pci3 isp0: using I/O space register mapping isp0: Board Type 2200, Chip Revision 0x5, loaded F/W Revision 2.1.36 isp0: Installed in 64-Bit PCI slot isp0: Last F/W revision was 2.1.12 isp0: 985 max I/O commands supported isp0: NVRAM Port WWN 0x210000e08b0413fb isp0: LIP Received ahc0: port 0xd800-0xd8ff mem 0xff7f= d000-0xff7fdfff irq 19 at device 14.0 on pci3 ahc0: Reading SEEPROM...done. ahc0: Manual SE Termination ahc0: Manual LVD Termination ahc0: BIOS eeprom is present ahc0: Primary Low Byte termination Enabled ahc0: Primary High Byte termination Enabled ahc0: Downloading Sequencer Program... 419 instructions downloaded aic7892: Ultra160 Wide Channel A, SCSI Id=3D7, 32/255 SCBs pcib4: at device 30.0 on pci0 Freeing (NOT implemented) redirected PCI irq 10. found-> vendor=3D0x10b7, dev=3D0x9200, revid=3D0x78 class=3D02-00-00, hdrtype=3D0x00, mfdev=3D0 subordinatebus=3D0 secondarybus=3D0 intpin=3Da, irq=3D16 map[10]: type 1, range 32, base 0000cc80, size 7 map[14]: type 1, range 32, base ff4ffc00, size 7 Freeing (NOT implemented) redirected PCI irq 9. found-> vendor=3D0x104c, dev=3D0x8020, revid=3D0x00 class=3D0c-00-10, hdrtype=3D0x00, mfdev=3D0 subordinatebus=3D0 secondarybus=3D0 intpin=3Da, irq=3D17 map[10]: type 1, range 32, base ff4ff000, size 11 map[14]: type 1, range 32, base ff4f8000, size 14 pci4: on pcib4 xl0: <3Com 3c905C-TX Fast Etherlink XL> port 0xcc80-0xccff mem 0xff4ffc00-0= xff4ffc7f irq 16 at device 11.0 on pci4 xl0: Ethernet address: 00:06:5b:83:e2:99 xl0: media options word: a xl0: found MII/AUTO miibus0: on xl0 ukphy0: on miibus0 ukphy0: OUI 0x00105a, model 0x0000, rev. 0 ukphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto bpf: xl0 attached pci4: (vendor=3D0x104c, dev=3D0x8020) at 12.0 irq 17 isab0: at device 31.0 on pci0 isa0: on isab0 atapci0: port 0xffa0-0xffaf at device 31.1 o= n pci0 ata0: iobase=3D0x01f0 altiobase=3D0x03f6 bmaddr=3D0xffa0 ata0: mask=3D00 status0=3Dff status1=3Dff ata0: probe allocation failed ata1: iobase=3D0x0170 altiobase=3D0x0376 bmaddr=3D0xffa8 ata1: mask=3D03 status0=3D50 status1=3D00 ata1: mask=3D03 ostat0=3D50 ostat2=3D00 ata1-master: ATAPI probe a=3D14 b=3Deb ata1-slave: ATAPI probe a=3D7f b=3D7f ata1: mask=3D03 status0=3D00 status1=3D00 ata1: devices=3D04 ata1: at 0x170 irq 15 on atapci0 uhci0: port 0xff80-0xff9f i= rq 2 at device 31.2 on pci0 usb0: on uhci0 usb0: USB revision 1.0 uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub0: 2 ports with 2 removable, self powered pci0: (vendor=3D0x8086, dev=3D0x2443) at 31.3 irq 13 uhci1: port 0xff60-0xff7f i= rq 16 at device 31.4 on pci0 using shared irq16. usb1: on uhci1 usb1: USB revision 1.0 uhub1: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub1: 2 ports with 2 removable, self powered pci0: (vendor=3D0x8086, dev=3D0x2445) at 31.5 irq 13 Trying Read_Port at 203 Trying Read_Port at 243 Trying Read_Port at 283 Trying Read_Port at 2c3 Trying Read_Port at 303 Trying Read_Port at 343 Trying Read_Port at 383 Trying Read_Port at 3c3 isa_probe_children: disabling PnP devices isa_probe_children: probing non-PnP devices orm0: