Date: Wed, 24 Sep 2003 17:14:00 -0700 From: Paul Saab <ps@mu.org> To: Anthony Stanton <anthony.stanton@es.easynet.net> Cc: freebsd-scsi@freebsd.org Subject: Re: Problem with ciss(4) in production system Message-ID: <20030925001400.GA91560@elvis.mu.org> In-Reply-To: <20030924132038.GD94794@es.easynet.net> References: <20030924132038.GD94794@es.easynet.net>
next in thread | previous in thread | raw e-mail | index | archive | help
dmesg from a boot verbose please. Anthony Stanton (anthony.stanton@es.easynet.net) wrote: > Hello, > > This morning I moved a server I've been running for over a year now, > a Compaq (HP!) Proliant DL360 with a 4314 StorageWorks external SCSI > disk box connected to it. The server has one internal disk on its > Integrated Smart Array (ida(4) driver) and a RAID 5 using all of the disks > in the external box on a Smart Array 5300 (ciss(4) driver). Uname: > > FreeBSD brooklyn.mail.es.easynet.net 4.8-RELEASE-p8 FreeBSD 4.8-RELEASE-p8 #1: Wed Sep 24 13:37:08 CEST 2003 root@brooklyn.mail.es.easynet.net:/usr/obj/usr/src/sys/BROOKLYN i386 > > Upon reinstalling in its new rack, I mistakenly plugged the disk box > into the Integrated array, making it believe it had 2 logical volumes; > I rebooted with the cable properly connected and deleted the bogus volume, > but now it was the 5300 which had a phantom logical volume corresponding > to the internal disk. I deleted that. > > After this, I can get FreeBSD to boot, and the ciss0 initialization > seems OK, but it cannot find da0 (which used to represent the external > RAID 5 on the disk box). Using camcontrol I get this: > > brooklyn# camcontrol devlist -v > scbus0 on ciss0 bus 0: > scbus-1 on xpt0 bus 0: > < > at scbus-1 target -1 lun -1 (xpt0) > > brooklyn# camcontrol rescan 0:0:0 > (probe0:ciss0:0:0:0): INQUIRY. CDB: 12 0 0 0 24 0 > (probe0:ciss0:0:0:0): ILLEGAL REQUEST asc:68,0 > (probe0:ciss0:0:0:0): Logical unit not configured > Re-scan of 0:0:0 was successful > > The same "probe0" errors show up in the boot sequence where it should > have detected da0. (see attached dmesg output). Any attempt to use mount(8) > or disklabel(8) with da0 or any of its slices fail with a "Device not > configured" error. Booting with a Debian GNU/Linux install CD reveals a > BSD/386 /dev/cciss/codop1 partition, but I cannot get fdisk under FreeBSD > to see it. > > I am at a loss for what to do. I can think of nothing that will set things > right... Compaq support have assured me that there is nothing more they > can do if the array configuration is there, this is an OS issue. > > Attached is the output to pciconf -lv, the dmesg from today's (broken) > boot and a diff of that to the previous (good) boot. > > Can anyone help me? > > Thanks in advance, > > -- > Anthony Stanton +34 91 789 46 00 > Systems Manager, Easynet Espa?a S.A.U. http://www.es.easynet.net/ > chip0@pci0:0:0: class=0x060000 card=0x00000000 chip=0x00091166 rev=0x05 hdr=0x00 > vendor = 'Reliance Computer Corp./ServerWorks' > device = 'NB6536 (CNB20-LE) AGP interface' > class = bridge > subclass = HOST-PCI > chip1@pci0:0:1: class=0x060000 card=0x00000000 chip=0x00091166 rev=0x05 hdr=0x00 > vendor = 'Reliance Computer Corp./ServerWorks' > device = 'NB6536 (CNB20-LE) AGP interface' > class = bridge > subclass = HOST-PCI > ida0@pci0:1:0: class=0x010400 card=0x40400e11 chip=0x00101000 rev=0x02 hdr=0x00 > vendor = 'LSI Logic (Was: Symbios Logic, NCR)' > device = 'LSI53C1510 I2O-Ready PCI RAID Ultra2 SCSI Controller (Intelligent mode)' > class = mass storage > subclass = RAID > none0@pci0:3:0: class=0x030000 card=0x47561002 chip=0x47561002 rev=0x7a hdr=0x00 > vendor = 'ATI Technologies' > device = 'Rage 3D IIC PCI [Mach64 GT IIC] (PQFP Package)' > class = display > subclass = VGA > none1@pci0:4:0: class=0x088000 card=0xb0f30e11 chip=0xa0f00e11 rev=0x00 hdr=0x00 > vendor = 'Compaq Computer Corp (Now owned by Hewlett-Packard)' > device = 'Advanced System Management Controller' > class = base peripheral > ciss0@pci0:5:0: class=0x010400 card=0x40700e11 chip=0xb0600e11 rev=0x02 hdr=0x00 > vendor = 'Compaq Computer Corp (Now owned by Hewlett-Packard)' > device = 'CISS SMART2 Array Controller' > class = mass storage > subclass = RAID > isab0@pci0:15:0: class=0x060100 card=0x02001166 chip=0x02001166 rev=0x51 hdr=0x00 > vendor = 'Reliance Computer Corp./ServerWorks' > device = 'OSB4 PCI to ISA Bridge' > class = bridge > subclass = PCI-ISA > atapci0@pci0:15:1: class=0x01018a card=0x00000000 chip=0x02111166 rev=0x00 hdr=0x00 > vendor = 'Reliance Computer Corp./ServerWorks' > device = 'OSB4 PCI EIDE Controller' > class = mass storage > subclass = ATA > fxp0@pci3:4:0: class=0x020000 card=0xb1340e11 chip=0x12298086 rev=0x08 hdr=0x00 > vendor = 'Intel Corporation' > device = '82557/8/9 EtherExpress PRO/100(B) Ethernet Adapter' > class = network > subclass = ethernet > fxp1@pci3:5:0: class=0x020000 card=0xb1340e11 chip=0x12298086 rev=0x08 hdr=0x00 > vendor = 'Intel Corporation' > device = '82557/8/9 EtherExpress PRO/100(B) Ethernet Adapter' > class = network > subclass = ethernet > Copyright (c) 1992-2003 The FreeBSD Project. > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 > The Regents of the University of California. All rights reserved. > FreeBSD 4.8-RELEASE-p8 #1: Wed Sep 24 13:37:08 CEST 2003 > root@brooklyn.mail.es.easynet.net:/usr/obj/usr/src/sys/BROOKLYN > Timecounter "i8254" frequency 1193182 Hz > CPU: Intel Pentium III (863.94-MHz 686-class CPU) > Origin = "GenuineIntel" Id = 0x686 Stepping = 6 > Features=0x383fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE> > real memory = 1207943168 (1179632K bytes) > avail memory = 1170554880 (1143120K bytes) > Changing APIC ID for IO APIC #0 from 0 to 8 on chip > Programming 35 pins in IOAPIC #0 > IOAPIC #0 intpin 2 -> irq 0 > FreeBSD/SMP: Multiprocessor motherboard > cpu0 (BSP): apic id: 3, version: 0x00040011, at 0xfee00000 > cpu1 (AP): apic id: 0, version: 0x00040011, at 0xfee00000 > io0 (APIC): apic id: 8, version: 0x00220011, at 0xfec00000 > Preloaded elf kernel "kernel" at 0xc0328000. > Pentium Pro MTRR support enabled > md0: Malloc disk > npx0: <math processor> on motherboard > npx0: INT 16 interface > pcib0: <ServerWorks NB6635 3.0LE host to PCI bridge> on motherboard > pci0: <PCI bus> on pcib0 > ida0: <Compaq Integrated Array controller> port 0x2000-0x20ff mem 0xc4000000-0xc4ffffff,0xc5000000-0xc5ffffff irq 5 at device 1.0 on pci0 > ida0: drives=1 firm_rev=1.50 > idad0: <Compaq Logical Drive> on ida0 > idad0: 17359MB (35553120 sectors), blocksize=512 > pci0: <ATI Mach64-GV graphics accelerator> at 3.0 > pci0: <unknown card> (vendor=0x0e11, dev=0xa0f0) at 4.0 > ciss0: <Compaq Smart Array 5300> port 0x2800-0x28ff mem 0xc3e00000-0xc3efffff,0xc3f80000-0xc3fbffff irq 3 at device 5.0 on pci0 > ciss0: using 256 of 1024 available commands > ciss0: 1 logical drive configured > ciss0: firmware 2.92 > ciss0: 2 SCSI channels > ciss0: signature 'CISS' > ciss0: valence 1 > ciss0: supported I/O methods 0xe<simple,performant,MEMQ> > ciss0: active I/O method 0x3<simple> > ciss0: 4G page base 0x00000000 > ciss0: interrupt coalesce delay 1000us > ciss0: interrupt coalesce count 0 > ciss0: max outstanding commands 1024 > ciss0: bus types 0x2<ultra3> > ciss0: server name '' > ciss0: heartbeat 0xe0000027 > ciss0: 1 logical drive > ciss0: logical drive 1: RAID 5, 381952MB online > isab0: <ServerWorks IB6566 PCI to ISA bridge> at device 15.0 on pci0 > isa0: <ISA bus> on isab0 > atapci0: <ServerWorks ROSB4 ATA33 controller> port 0x2c00-0x2c0f at device 15.1 on pci0 > ata0: at 0x1f0 irq 14 on atapci0 > ata1: at 0x170 irq 15 on atapci0 > pcib3: <ServerWorks NB6635 3.0LE host to PCI bridge> on motherboard > pci3: <PCI bus> on pcib3 > fxp0: <Intel Pro 10/100B/100+ Ethernet> port 0x3000-0x303f mem 0xc6e00000-0xc6efffff,0xc6fff000-0xc6ffffff irq 7 at device 4.0 on pci3 > fxp0: Ethernet address 00:02:a5:8a:83:c0 > inphy0: <i82555 10/100 media interface> on miibus0 > inphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto > fxp1: <Intel Pro 10/100B/100+ Ethernet> port 0x3040-0x307f mem 0xc6c00000-0xc6cfffff,0xc6dff000-0xc6dfffff irq 10 at device 5.0 on pci3 > fxp1: Ethernet address 00:02:a5:8a:83:bf > inphy1: <i82555 10/100 media interface> on miibus1 > inphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto > eisa0: <EISA bus> on motherboard > mainboard0: <CPQ0685 (System Board)> on eisa0 slot 0 > orm0: <Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xcbfff,0xcc000-0xcffff,0xe8000-0xedfff,0xee000-0xeffff on isa0 > fdc0: <NEC 72065B or clone> at port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on isa0 > fdc0: FIFO enabled, 8 bytes threshold > fd0: <1440-KB 3.5" drive> on fdc0 drive 0 > atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0 > atkbd0: <AT Keyboard> irq 1 on atkbdc0 > kbd0 at atkbd0 > psm0: <PS/2 Mouse> irq 12 on atkbdc0 > psm0: model Generic PS/2 mouse, device ID 0 > vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 > sc0: <System console> at flags 0x100 on isa0 > sc0: VGA <16 virtual consoles, flags=0x300> > sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0 > sio0: type 16550A > sio1: configured irq 3 not in bitmap of probed irqs 0 > ppc0: parallel port not found. > APIC_IO: Testing 8254 interrupt delivery > APIC_IO: Broken MP table detected: 8254 is not connected to IOAPIC #0 intpin 2 > APIC_IO: routing 8254 via 8259 and IOAPIC #0 intpin 0 > ata1-slave: ATAPI identify retries exceeded > SMP: AP CPU #1 Launched! > acd0: CDROM <CD-224E> at ata1-master PIO4 > (probe0:ciss0:0:0:0): INQUIRY. CDB: 12 0 0 0 24 0 > (probe0:ciss0:0:0:0): ILLEGAL REQUEST asc:68,0 > (probe0:ciss0:0:0:0): Logical unit not configured > (probe0:ciss0:0:0:0): INQUIRY. CDB: 12 0 0 0 24 0 > (probe0:ciss0:0:0:0): ILLEGAL REQUEST asc:68,0 > (probe0:ciss0:0:0:0): Logical unit not configured > Mounting root from ufs:/dev/idad0s1a > --- dmesg.yesterday Wed Sep 24 14:53:33 2003 > +++ dmesg.broken Wed Sep 24 15:18:37 2003 > @@ -1,8 +1,8 @@ > Copyright (c) 1992-2003 The FreeBSD Project. > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 > The Regents of the University of California. All rights reserved. > -FreeBSD 4.8-RELEASE #0: Tue Aug 26 17:20:41 CEST 2003 > - ewen@brooklyn.mail.es.easynet.net:/usr/src/sys/compile/BROOKLYN > +FreeBSD 4.8-RELEASE-p8 #1: Wed Sep 24 13:37:08 CEST 2003 > + root@brooklyn.mail.es.easynet.net:/usr/obj/usr/src/sys/BROOKLYN > Timecounter "i8254" frequency 1193182 Hz > CPU: Intel Pentium III (863.94-MHz 686-class CPU) > Origin = "GenuineIntel" Id = 0x686 Stepping = 6 > @@ -44,7 +44,7 @@ > ciss0: max outstanding commands 1024 > ciss0: bus types 0x2<ultra3> > ciss0: server name '' > -ciss0: heartbeat 0x20000059 > +ciss0: heartbeat 0xe0000027 > ciss0: 1 logical drive > ciss0: logical drive 1: RAID 5, 381952MB online > isab0: <ServerWorks IB6566 PCI to ISA bridge> at device 15.0 on pci0 > @@ -71,6 +71,8 @@ > atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0 > atkbd0: <AT Keyboard> irq 1 on atkbdc0 > kbd0 at atkbd0 > +psm0: <PS/2 Mouse> irq 12 on atkbdc0 > +psm0: model Generic PS/2 mouse, device ID 0 > vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 > sc0: <System console> at flags 0x100 on isa0 > sc0: VGA <16 virtual consoles, flags=0x300> > @@ -84,12 +86,10 @@ > ata1-slave: ATAPI identify retries exceeded > SMP: AP CPU #1 Launched! > acd0: CDROM <CD-224E> at ata1-master PIO4 > +(probe0:ciss0:0:0:0): INQUIRY. CDB: 12 0 0 0 24 0 > +(probe0:ciss0:0:0:0): ILLEGAL REQUEST asc:68,0 > +(probe0:ciss0:0:0:0): Logical unit not configured > +(probe0:ciss0:0:0:0): INQUIRY. CDB: 12 0 0 0 24 0 > +(probe0:ciss0:0:0:0): ILLEGAL REQUEST asc:68,0 > +(probe0:ciss0:0:0:0): Logical unit not configured > Mounting root from ufs:/dev/idad0s1a > -da0 at ciss0 bus 0 target 0 lun 0 > -da0: <COMPAQ RAID 5 VOLUME OK> Fixed Direct Access SCSI-0 device > -da0: 135.168MB/s transfers > -da0: 382045MB (782429760 512 byte sectors: 255H 63S/T 48704C) > -WARNING: / was not properly dismounted > -fxp0: Microcode loaded, int_delay: 1000 usec bundle_max: 6 > -fxp1: Microcode loaded, int_delay: 1000 usec bundle_max: 6 > -fxp0: Microcode loaded, int_delay: 1000 usec bundle_max: 6 > _______________________________________________ > freebsd-scsi@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-scsi > To unsubscribe, send any mail to "freebsd-scsi-unsubscribe@freebsd.org" -- -ps
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20030925001400.GA91560>