From owner-freebsd-scsi@FreeBSD.ORG Wed Sep 24 17:14:01 2003 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 244FB16A4B3 for ; Wed, 24 Sep 2003 17:14:01 -0700 (PDT) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.FreeBSD.org (Postfix) with ESMTP id 4455844008 for ; Wed, 24 Sep 2003 17:14:00 -0700 (PDT) (envelope-from ps@mu.org) Received: by elvis.mu.org (Postfix, from userid 1000) id 2FA7D2ED48D; Wed, 24 Sep 2003 17:14:00 -0700 (PDT) Date: Wed, 24 Sep 2003 17:14:00 -0700 From: Paul Saab To: Anthony Stanton Message-ID: <20030925001400.GA91560@elvis.mu.org> References: <20030924132038.GD94794@es.easynet.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20030924132038.GD94794@es.easynet.net> User-Agent: Mutt/1.4.1i cc: freebsd-scsi@freebsd.org Subject: Re: Problem with ciss(4) in production system X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Sep 2003 00:14:01 -0000 dmesg from a boot verbose please. Anthony Stanton (anthony.stanton@es.easynet.net) wrote: > Hello, > > This morning I moved a server I've been running for over a year now, > a Compaq (HP!) Proliant DL360 with a 4314 StorageWorks external SCSI > disk box connected to it. The server has one internal disk on its > Integrated Smart Array (ida(4) driver) and a RAID 5 using all of the disks > in the external box on a Smart Array 5300 (ciss(4) driver). Uname: > > FreeBSD brooklyn.mail.es.easynet.net 4.8-RELEASE-p8 FreeBSD 4.8-RELEASE-p8 #1: Wed Sep 24 13:37:08 CEST 2003 root@brooklyn.mail.es.easynet.net:/usr/obj/usr/src/sys/BROOKLYN i386 > > Upon reinstalling in its new rack, I mistakenly plugged the disk box > into the Integrated array, making it believe it had 2 logical volumes; > I rebooted with the cable properly connected and deleted the bogus volume, > but now it was the 5300 which had a phantom logical volume corresponding > to the internal disk. I deleted that. > > After this, I can get FreeBSD to boot, and the ciss0 initialization > seems OK, but it cannot find da0 (which used to represent the external > RAID 5 on the disk box). Using camcontrol I get this: > > brooklyn# camcontrol devlist -v > scbus0 on ciss0 bus 0: > scbus-1 on xpt0 bus 0: > < > at scbus-1 target -1 lun -1 (xpt0) > > brooklyn# camcontrol rescan 0:0:0 > (probe0:ciss0:0:0:0): INQUIRY. CDB: 12 0 0 0 24 0 > (probe0:ciss0:0:0:0): ILLEGAL REQUEST asc:68,0 > (probe0:ciss0:0:0:0): Logical unit not configured > Re-scan of 0:0:0 was successful > > The same "probe0" errors show up in the boot sequence where it should > have detected da0. (see attached dmesg output). Any attempt to use mount(8) > or disklabel(8) with da0 or any of its slices fail with a "Device not > configured" error. Booting with a Debian GNU/Linux install CD reveals a > BSD/386 /dev/cciss/codop1 partition, but I cannot get fdisk under FreeBSD > to see it. > > I am at a loss for what to do. I can think of nothing that will set things > right... Compaq support have assured me that there is nothing more they > can do if the array configuration is there, this is an OS issue. > > Attached is the output to pciconf -lv, the dmesg from today's (broken) > boot and a diff of that to the previous (good) boot. > > Can anyone help me? > > Thanks in advance, > > -- > Anthony Stanton +34 91 789 46 00 > Systems Manager, Easynet Espa?a S.A.U. http://www.es.easynet.net/ > chip0@pci0:0:0: class=0x060000 card=0x00000000 chip=0x00091166 rev=0x05 hdr=0x00 > vendor = 'Reliance Computer Corp./ServerWorks' > device = 'NB6536 (CNB20-LE) AGP interface' > class = bridge > subclass = HOST-PCI > chip1@pci0:0:1: class=0x060000 card=0x00000000 chip=0x00091166 rev=0x05 hdr=0x00 > vendor = 'Reliance Computer Corp./ServerWorks' > device = 'NB6536 (CNB20-LE) AGP interface' > class = bridge > subclass = HOST-PCI > ida0@pci0:1:0: class=0x010400 card=0x40400e11 chip=0x00101000 rev=0x02 hdr=0x00 > vendor = 'LSI Logic (Was: Symbios Logic, NCR)' > device = 'LSI53C1510 I2O-Ready PCI RAID Ultra2 SCSI Controller (Intelligent mode)' > class = mass storage > subclass = RAID > none0@pci0:3:0: class=0x030000 card=0x47561002 chip=0x47561002 rev=0x7a hdr=0x00 > vendor = 'ATI Technologies' > device = 'Rage 3D IIC PCI [Mach64 GT IIC] (PQFP Package)' > class = display > subclass = VGA > none1@pci0:4:0: class=0x088000 card=0xb0f30e11 chip=0xa0f00e11 rev=0x00 hdr=0x00 > vendor = 'Compaq Computer Corp (Now owned by Hewlett-Packard)' > device = 'Advanced System Management Controller' > class = base peripheral > ciss0@pci0:5:0: class=0x010400 card=0x40700e11 chip=0xb0600e11 rev=0x02 hdr=0x00 > vendor = 'Compaq Computer Corp (Now owned by Hewlett-Packard)' > device = 'CISS SMART2 Array Controller' > class = mass storage > subclass = RAID > isab0@pci0:15:0: class=0x060100 card=0x02001166 chip=0x02001166 rev=0x51 hdr=0x00 > vendor = 'Reliance Computer Corp./ServerWorks' > device = 'OSB4 PCI to ISA Bridge' > class = bridge > subclass = PCI-ISA > atapci0@pci0:15:1: class=0x01018a card=0x00000000 chip=0x02111166 rev=0x00 hdr=0x00 > vendor = 'Reliance Computer Corp./ServerWorks' > device = 'OSB4 PCI EIDE Controller' > class = mass storage > subclass = ATA > fxp0@pci3:4:0: class=0x020000 card=0xb1340e11 chip=0x12298086 rev=0x08 hdr=0x00 > vendor = 'Intel Corporation' > device = '82557/8/9 EtherExpress PRO/100(B) Ethernet Adapter' > class = network > subclass = ethernet > fxp1@pci3:5:0: class=0x020000 card=0xb1340e11 chip=0x12298086 rev=0x08 hdr=0x00 > vendor = 'Intel Corporation' > device = '82557/8/9 EtherExpress PRO/100(B) Ethernet Adapter' > class = network > subclass = ethernet > Copyright (c) 1992-2003 The FreeBSD Project. > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 > The Regents of the University of California. All rights reserved. > FreeBSD 4.8-RELEASE-p8 #1: Wed Sep 24 13:37:08 CEST 2003 > root@brooklyn.mail.es.easynet.net:/usr/obj/usr/src/sys/BROOKLYN > Timecounter "i8254" frequency 1193182 Hz > CPU: Intel Pentium III (863.94-MHz 686-class CPU) > Origin = "GenuineIntel" Id = 0x686 Stepping = 6 > Features=0x383fbff > real memory = 1207943168 (1179632K bytes) > avail memory = 1170554880 (1143120K bytes) > Changing APIC ID for IO APIC #0 from 0 to 8 on chip > Programming 35 pins in IOAPIC #0 > IOAPIC #0 intpin 2 -> irq 0 > FreeBSD/SMP: Multiprocessor motherboard > cpu0 (BSP): apic id: 3, version: 0x00040011, at 0xfee00000 > cpu1 (AP): apic id: 0, version: 0x00040011, at 0xfee00000 > io0 (APIC): apic id: 8, version: 0x00220011, at 0xfec00000 > Preloaded elf kernel "kernel" at 0xc0328000. > Pentium Pro MTRR support enabled > md0: Malloc disk > npx0: on motherboard > npx0: INT 16 interface > pcib0: on motherboard > pci0: on pcib0 > ida0: port 0x2000-0x20ff mem 0xc4000000-0xc4ffffff,0xc5000000-0xc5ffffff irq 5 at device 1.0 on pci0 > ida0: drives=1 firm_rev=1.50 > idad0: on ida0 > idad0: 17359MB (35553120 sectors), blocksize=512 > pci0: at 3.0 > pci0: (vendor=0x0e11, dev=0xa0f0) at 4.0 > ciss0: port 0x2800-0x28ff mem 0xc3e00000-0xc3efffff,0xc3f80000-0xc3fbffff irq 3 at device 5.0 on pci0 > ciss0: using 256 of 1024 available commands > ciss0: 1 logical drive configured > ciss0: firmware 2.92 > ciss0: 2 SCSI channels > ciss0: signature 'CISS' > ciss0: valence 1 > ciss0: supported I/O methods 0xe > ciss0: active I/O method 0x3 > ciss0: 4G page base 0x00000000 > ciss0: interrupt coalesce delay 1000us > ciss0: interrupt coalesce count 0 > ciss0: max outstanding commands 1024 > ciss0: bus types 0x2 > ciss0: server name '' > ciss0: heartbeat 0xe0000027 > ciss0: 1 logical drive > ciss0: logical drive 1: RAID 5, 381952MB online > isab0: at device 15.0 on pci0 > isa0: on isab0 > atapci0: port 0x2c00-0x2c0f at device 15.1 on pci0 > ata0: at 0x1f0 irq 14 on atapci0 > ata1: at 0x170 irq 15 on atapci0 > pcib3: on motherboard > pci3: on pcib3 > fxp0: port 0x3000-0x303f mem 0xc6e00000-0xc6efffff,0xc6fff000-0xc6ffffff irq 7 at device 4.0 on pci3 > fxp0: Ethernet address 00:02:a5:8a:83:c0 > inphy0: on miibus0 > inphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto > fxp1: port 0x3040-0x307f mem 0xc6c00000-0xc6cfffff,0xc6dff000-0xc6dfffff irq 10 at device 5.0 on pci3 > fxp1: Ethernet address 00:02:a5:8a:83:bf > inphy1: on miibus1 > inphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto > eisa0: on motherboard > mainboard0: on eisa0 slot 0 > orm0: