From owner-freebsd-scsi@FreeBSD.ORG Wed Sep 24 06:20:37 2003 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id EC1BA16A4B3 for ; Wed, 24 Sep 2003 06:20:37 -0700 (PDT) Received: from smtp.easynet.es (smtp.easynet.es [213.139.0.70]) by mx1.FreeBSD.org (Postfix) with ESMTP id 871F743FCB for ; Wed, 24 Sep 2003 06:20:36 -0700 (PDT) (envelope-from anthony.stanton@es.easynet.net) Received: from atana.noc.es.easynet.net ([213.139.2.223]) by smtp.easynet.es with esmtp (Exim 4.22) id 1A29ZJ-000E4E-B3 for freebsd-scsi@freebsd.org; Wed, 24 Sep 2003 15:20:33 +0200 Received: from atana.noc.es.easynet.net (localhost [127.0.0.1]) h8ODKctD095419 for ; Wed, 24 Sep 2003 15:20:38 +0200 (CEST) (envelope-from anthony.stanton@es.easynet.net) Received: (from stanton@localhost) by atana.noc.es.easynet.net (8.12.8p1/8.12.3/Submit) id h8ODKcMf095418 for freebsd-scsi@freebsd.org; Wed, 24 Sep 2003 15:20:38 +0200 (CEST) X-Authentication-Warning: atana.noc.es.easynet.net: stanton set sender to anthony.stanton@es.easynet.net using -f Date: Wed, 24 Sep 2003 15:20:38 +0200 From: Anthony Stanton To: freebsd-scsi@freebsd.org Message-ID: <20030924132038.GD94794@es.easynet.net> Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="ZPt4rx8FFjLCG7dd" Content-Disposition: inline Content-Transfer-Encoding: 8bit User-Agent: Mutt/1.4.1i Organization: Easynet Group plc X-NCC-RegId: es.easynet Subject: Problem with ciss(4) in production system X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: Anthony Stanton List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Sep 2003 13:20:38 -0000 --ZPt4rx8FFjLCG7dd Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit Hello, This morning I moved a server I've been running for over a year now, a Compaq (HP!) Proliant DL360 with a 4314 StorageWorks external SCSI disk box connected to it. The server has one internal disk on its Integrated Smart Array (ida(4) driver) and a RAID 5 using all of the disks in the external box on a Smart Array 5300 (ciss(4) driver). Uname: FreeBSD brooklyn.mail.es.easynet.net 4.8-RELEASE-p8 FreeBSD 4.8-RELEASE-p8 #1: Wed Sep 24 13:37:08 CEST 2003 root@brooklyn.mail.es.easynet.net:/usr/obj/usr/src/sys/BROOKLYN i386 Upon reinstalling in its new rack, I mistakenly plugged the disk box into the Integrated array, making it believe it had 2 logical volumes; I rebooted with the cable properly connected and deleted the bogus volume, but now it was the 5300 which had a phantom logical volume corresponding to the internal disk. I deleted that. After this, I can get FreeBSD to boot, and the ciss0 initialization seems OK, but it cannot find da0 (which used to represent the external RAID 5 on the disk box). Using camcontrol I get this: brooklyn# camcontrol devlist -v scbus0 on ciss0 bus 0: scbus-1 on xpt0 bus 0: < > at scbus-1 target -1 lun -1 (xpt0) brooklyn# camcontrol rescan 0:0:0 (probe0:ciss0:0:0:0): INQUIRY. CDB: 12 0 0 0 24 0 (probe0:ciss0:0:0:0): ILLEGAL REQUEST asc:68,0 (probe0:ciss0:0:0:0): Logical unit not configured Re-scan of 0:0:0 was successful The same "probe0" errors show up in the boot sequence where it should have detected da0. (see attached dmesg output). Any attempt to use mount(8) or disklabel(8) with da0 or any of its slices fail with a "Device not configured" error. Booting with a Debian GNU/Linux install CD reveals a BSD/386 /dev/cciss/codop1 partition, but I cannot get fdisk under FreeBSD to see it. I am at a loss for what to do. I can think of nothing that will set things right... Compaq support have assured me that there is nothing more they can do if the array configuration is there, this is an OS issue. Attached is the output to pciconf -lv, the dmesg from today's (broken) boot and a diff of that to the previous (good) boot. Can anyone help me? Thanks in advance, -- Anthony Stanton +34 91 789 46 00 Systems Manager, Easynet Espaņa S.A.U. http://www.es.easynet.net/ --ZPt4rx8FFjLCG7dd Content-Type: text/plain; charset=us-ascii Content-Disposition: attachment; filename=pciconf chip0@pci0:0:0: class=0x060000 card=0x00000000 chip=0x00091166 rev=0x05 hdr=0x00 vendor = 'Reliance Computer Corp./ServerWorks' device = 'NB6536 (CNB20-LE) AGP interface' class = bridge subclass = HOST-PCI chip1@pci0:0:1: class=0x060000 card=0x00000000 chip=0x00091166 rev=0x05 hdr=0x00 vendor = 'Reliance Computer Corp./ServerWorks' device = 'NB6536 (CNB20-LE) AGP interface' class = bridge subclass = HOST-PCI ida0@pci0:1:0: class=0x010400 card=0x40400e11 chip=0x00101000 rev=0x02 hdr=0x00 vendor = 'LSI Logic (Was: Symbios Logic, NCR)' device = 'LSI53C1510 I2O-Ready PCI RAID Ultra2 SCSI Controller (Intelligent mode)' class = mass storage subclass = RAID none0@pci0:3:0: class=0x030000 card=0x47561002 chip=0x47561002 rev=0x7a hdr=0x00 vendor = 'ATI Technologies' device = 'Rage 3D IIC PCI [Mach64 GT IIC] (PQFP Package)' class = display subclass = VGA none1@pci0:4:0: class=0x088000 card=0xb0f30e11 chip=0xa0f00e11 rev=0x00 hdr=0x00 vendor = 'Compaq Computer Corp (Now owned by Hewlett-Packard)' device = 'Advanced System Management Controller' class = base peripheral ciss0@pci0:5:0: class=0x010400 card=0x40700e11 chip=0xb0600e11 rev=0x02 hdr=0x00 vendor = 'Compaq Computer Corp (Now owned by Hewlett-Packard)' device = 'CISS SMART2 Array Controller' class = mass storage subclass = RAID isab0@pci0:15:0: class=0x060100 card=0x02001166 chip=0x02001166 rev=0x51 hdr=0x00 vendor = 'Reliance Computer Corp./ServerWorks' device = 'OSB4 PCI to ISA Bridge' class = bridge subclass = PCI-ISA atapci0@pci0:15:1: class=0x01018a card=0x00000000 chip=0x02111166 rev=0x00 hdr=0x00 vendor = 'Reliance Computer Corp./ServerWorks' device = 'OSB4 PCI EIDE Controller' class = mass storage subclass = ATA fxp0@pci3:4:0: class=0x020000 card=0xb1340e11 chip=0x12298086 rev=0x08 hdr=0x00 vendor = 'Intel Corporation' device = '82557/8/9 EtherExpress PRO/100(B) Ethernet Adapter' class = network subclass = ethernet fxp1@pci3:5:0: class=0x020000 card=0xb1340e11 chip=0x12298086 rev=0x08 hdr=0x00 vendor = 'Intel Corporation' device = '82557/8/9 EtherExpress PRO/100(B) Ethernet Adapter' class = network subclass = ethernet --ZPt4rx8FFjLCG7dd Content-Type: text/plain; charset=us-ascii Content-Disposition: attachment; filename="dmesg.broken" Copyright (c) 1992-2003 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD 4.8-RELEASE-p8 #1: Wed Sep 24 13:37:08 CEST 2003 root@brooklyn.mail.es.easynet.net:/usr/obj/usr/src/sys/BROOKLYN Timecounter "i8254" frequency 1193182 Hz CPU: Intel Pentium III (863.94-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0x686 Stepping = 6 Features=0x383fbff real memory = 1207943168 (1179632K bytes) avail memory = 1170554880 (1143120K bytes) Changing APIC ID for IO APIC #0 from 0 to 8 on chip Programming 35 pins in IOAPIC #0 IOAPIC #0 intpin 2 -> irq 0 FreeBSD/SMP: Multiprocessor motherboard cpu0 (BSP): apic id: 3, version: 0x00040011, at 0xfee00000 cpu1 (AP): apic id: 0, version: 0x00040011, at 0xfee00000 io0 (APIC): apic id: 8, version: 0x00220011, at 0xfec00000 Preloaded elf kernel "kernel" at 0xc0328000. Pentium Pro MTRR support enabled md0: Malloc disk npx0: on motherboard npx0: INT 16 interface pcib0: on motherboard pci0: on pcib0 ida0: port 0x2000-0x20ff mem 0xc4000000-0xc4ffffff,0xc5000000-0xc5ffffff irq 5 at device 1.0 on pci0 ida0: drives=1 firm_rev=1.50 idad0: on ida0 idad0: 17359MB (35553120 sectors), blocksize=512 pci0: at 3.0 pci0: (vendor=0x0e11, dev=0xa0f0) at 4.0 ciss0: port 0x2800-0x28ff mem 0xc3e00000-0xc3efffff,0xc3f80000-0xc3fbffff irq 3 at device 5.0 on pci0 ciss0: using 256 of 1024 available commands ciss0: 1 logical drive configured ciss0: firmware 2.92 ciss0: 2 SCSI channels ciss0: signature 'CISS' ciss0: valence 1 ciss0: supported I/O methods 0xe ciss0: active I/O method 0x3 ciss0: 4G page base 0x00000000 ciss0: interrupt coalesce delay 1000us ciss0: interrupt coalesce count 0 ciss0: max outstanding commands 1024 ciss0: bus types 0x2 ciss0: server name '' ciss0: heartbeat 0xe0000027 ciss0: 1 logical drive ciss0: logical drive 1: RAID 5, 381952MB online isab0: at device 15.0 on pci0 isa0: on isab0 atapci0: port 0x2c00-0x2c0f at device 15.1 on pci0 ata0: at 0x1f0 irq 14 on atapci0 ata1: at 0x170 irq 15 on atapci0 pcib3: on motherboard pci3: on pcib3 fxp0: port 0x3000-0x303f mem 0xc6e00000-0xc6efffff,0xc6fff000-0xc6ffffff irq 7 at device 4.0 on pci3 fxp0: Ethernet address 00:02:a5:8a:83:c0 inphy0: on miibus0 inphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto fxp1: port 0x3040-0x307f mem 0xc6c00000-0xc6cfffff,0xc6dff000-0xc6dfffff irq 10 at device 5.0 on pci3 fxp1: Ethernet address 00:02:a5:8a:83:bf inphy1: on miibus1 inphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto eisa0: on motherboard mainboard0: on eisa0 slot 0 orm0: