From owner-freebsd-current@FreeBSD.ORG Wed Sep 29 20:44:45 2004 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 586DA16A4CF for ; Wed, 29 Sep 2004 20:44:45 +0000 (GMT) Received: from froody.rupture.net (froody.rupture.net [216.22.46.119]) by mx1.FreeBSD.org (Postfix) with ESMTP id DBB2E43D3F for ; Wed, 29 Sep 2004 20:44:44 +0000 (GMT) (envelope-from jon@rupture.net) Received: from froody.rupture.net (localhost [127.0.0.1]) by froody.rupture.net (8.12.10/8.12.10) with ESMTP id i8TKiiHT056325 for ; Wed, 29 Sep 2004 16:44:44 -0400 (EDT) (envelope-from jon@rupture.net) Received: (from jon@localhost) by froody.rupture.net (8.12.10/8.12.10/Submit) id i8TKiiiV056324 for freebsd-current@freebsd.org; Wed, 29 Sep 2004 16:44:44 -0400 (EDT) (envelope-from jon@rupture.net) X-Authentication-Warning: froody.rupture.net: jon set sender to jon@rupture.net using -f Received: by froody.rupture.net (tmda-sendmail, from uid 500); Wed, 29 Sep 2004 16:44:43 -0400 (EDT) Date: Wed, 29 Sep 2004 16:44:39 -0400 To: freebsd-current@freebsd.org Message-ID: <20040929204439.GA56251@froody.rupture.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.6i From: Jon Nathan Mail-Followup-To: freebsd-current@freebsd.org X-Delivery-Agent: TMDA/1.0.3 (Seattle Slew) X-Primary-Address: jon@rupture.net Subject: 3ware 7006-2 RAID degradation on reboot X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: Jon Nathan List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Sep 2004 20:44:45 -0000 Hi, I'm running BETA6 with a 3ware 7006-2 SATA RAID controller. On reboot (also shutdown -r now), it loses its RAID integrity each time. I can rebuild it, but it takes a long time and is generally a hassle. Is this a known problem? Below find local info: root@zen:~> uname -a FreeBSD zen.rupture.net 5.3-BETA6 FreeBSD 5.3-BETA6 #12: Wed Sep 29 17:57:25 EDT 2004 root@zen.rupture.net:/usr/obj/usr/src/sys/ZEN i386 root@zen:~> root@zen:~> tw_cli info c0 Controller: c0 ------------- Driver: 1.50.01.002 Model: 7006-2 FW: FE7X 1.05.00.063 BIOS: BE7X 1.08.00.048 Monitor: ME7X 1.01.00.038 Serial #: F14802A4170244 PCB: Rev4 PCHIP: 1.30-66 ACHIP: 3.20 # of units: 1 Unit 0: RAID 1 186.31 GB ( 390719920 blocks): DEGRADED # of ports: 2 Port 0: ST3200822A 3LJ18AKZ 186.31 GB (390721968 blocks): OK(unit 0) Port 1: ST3200822A 3LJ1977D 186.31 GB (390721968 blocks): OK(unit 0) root@zen:~> tw_cli info c0 u0 Unit /c0/u0 --------------------- Status: DEGRADED Unit Type: RAID 1 Stripe Size: N/A Size: 186.31 GB (390719920 blocks) # of subunits: 2 Subunit 0: CBOD: OK Physical Port: 1 Logical Port: 0 Subunit 1: CBOD: DEGRADED Physical Port: 0 Logical Port: 1 root@zen:~> tw_cli maint remove c0 p0 Removing port /c0/p0 ... Done. root@zen:~> tw_cli maint rescan c0 Rescanning controller /c0 for units and drives ...Done. root@zen:~> tw_cli maint rebuild c0 u0 p0 Rebuild started on unit /c0/u0 root@zen:~> tw_cli info c0 u0 Unit /c0/u0 --------------------- Status: REBUILDING (0%) Unit Type: RAID 1 Stripe Size: N/A Size: 186.31 GB (390719920 blocks) # of subunits: 2 Subunit 0: CBOD: OK Physical Port: 1 Logical Port: 0 Subunit 1: CBOD: DEGRADED Physical Port: 0 Logical Port: 1 root@zen:~> tw_cli info c0 Controller: c0 ------------- Driver: 1.50.01.002 Model: 7006-2 FW: FE7X 1.05.00.063 BIOS: BE7X 1.08.00.048 Monitor: ME7X 1.01.00.038 Serial #: F14802A4170244 PCB: Rev4 PCHIP: 1.30-66 ACHIP: 3.20 # of units: 1 Unit 0: RAID 1 186.31 GB ( 390719920 blocks): REBUILDING (1%) # of ports: 2 Port 0: ST3200822A 3LJ18AKZ 186.31 GB (390721968 blocks): OK(unit 0) Port 1: ST3200822A 3LJ1977D 186.31 GB (390721968 blocks): OK(unit 0) root@zen:~> root@zen:~> dmesg Copyright (c) 1992-2004 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD 5.3-BETA6 #12: Wed Sep 29 17:57:25 EDT 2004 root@zen.rupture.net:/usr/obj/usr/src/sys/ZEN ACPI APIC Table: Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel Pentium III (866.70-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0x686 Stepping = 6 Features=0x383fbff real memory = 2147463168 (2047 MB) avail memory = 2099101696 (2001 MB) FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs cpu0 (BSP): APIC ID: 3 cpu1 (AP): APIC ID: 0 ioapic0 irqs 0-15 on motherboard ioapic1 irqs 16-31 on motherboard npx0: [FAST] npx0: on motherboard npx0: INT 16 interface acpi0: on motherboard acpi0: Power Button (fixed) Timecounter "ACPI-safe" frequency 3579545 Hz quality 1000 acpi_timer0: <32-bit timer at 3.579545MHz> port 0xe408-0xe40b on acpi0 cpu0: on acpi0 cpu1: on acpi0 acpi_button0: on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 fxp0: port 0xd800-0xd83f mem 0xfd800000-0xfd8fffff,0xfe000000-0xfe000fff irq 20 at device 2.0 on pci0 miibus0: on fxp0 inphy0: on miibus0 inphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto fxp0: Ethernet address: 00:e0:18:02:c7:ea twe0: <3ware Storage Controller. Driver version 1.50.01.002> port 0xd400-0xd40f mem 0xfc800000-0xfcffffff irq 18 at device 5.0 on pci0 twe0: [GIANT-LOCKED] twe0: AEN: twe0: 2 ports, Firmware FE7X 1.05.00.063, BIOS BE7X 1.08.00.048 pci0: at device 7.0 (no driver attached) isab0: port 0xe800-0xe80f at device 15.0 on pci0 isa0: on isab0 atapci0: port 0xb800-0xb80f,0x376,0x170-0x177,0x3f6,0x1f0-0x1f7 at device 15.1 on pci0 ata0: channel #0 on atapci0 ata1: channel #1 on atapci0 pcib1: on acpi0 pci1: on pcib1 fxp1: port 0xb400-0xb43f mem 0xf9000000-0xf90fffff,0xf9800000-0xf9800fff irq 23 at device 4.0 on pci1 miibus1: on fxp1 inphy1: on miibus1 inphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto fxp1: Ethernet address: 00:02:b3:11:33:32 pci1: at device 5.0 (no driver attached) pci1: at device 5.1 (no driver attached) speaker0 port 0x61 on acpi0 atkbdc0: port 0x64,0x60 irq 1 on acpi0 sio0 port 0x3f8-0x3ff irq 4 on acpi0 sio0: type 16550A sio1 port 0x2f8-0x2ff irq 3 on acpi0 sio1: type 16550A ppc0 port 0x778-0x77a,0x378-0x37f irq 7 drq 3 on acpi0 ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode ppc0: FIFO with 16/16/8 bytes threshold ppbus0: on ppc0 lpt0: on ppbus0 lpt0: Interrupt-driven port ppi0: on ppbus0 orm0: at iomem 0xd4000-0xd4fff,0xd0000-0xd0fff,0xc0000-0xca7ff on isa0 sc0: on isa0 sc0: VGA <8 virtual consoles, flags=0x200> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 Timecounters tick every 1.000 msec Profiling kernel, textsize=2570960 [c042b140..c069ec10] cputime 5039, empty_loop 7, nullfunc_loop_profiled -89048, mcount 124477, mexitcount 17269 Profiling overheads: mcount: 5028+119435, -142430+266894; mexitcount: 5028+12230, -36123+53382 nsec Profiling overheads: mcount: 768+18241, -21753+40762; mexitcount: 768+1868, -5517+8153 cycles ATAPI_RESET time = 70us acd0: CDROM at ata1-master UDMA33 twed0: on twe0 twed0: 190781MB (390719920 sectors) SMP: AP CPU #1 Launched! Mounting root from ufs:/dev/twed0s1a twe0: AEN: twe0: AEN: root@zen:~> This is a 2xPIII 866 host. Any advice on SMP options that I should use would be appreciated as well. The below seems stable and happy, with the 3ware exception. Stripped Kernel config: machine i386 profile 2 device apic # I/O apic cpu I686_CPU # aka Pentium Pro(tm) options PERFMON options DEVICE_POLLING options HZ=1000 device speaker #Play IBM BASIC-style noises out your speaker device isa # Required by npx(4) options AUTO_EOI_1 device pci device npx device io hints "ZEN.hints" # Default places to look for devices. ident ZEN maxusers 0 makeoptions CONF_CFLAGS=-fno-builtin #Don't allow use of memcmp, etc. options MAXDSIZ=(1024UL*1024*1024) options MAXSSIZ=(128UL*1024*1024) options DFLDSIZ=(1024UL*1024*1024) options BLKDEV_IOSIZE=8192 options PQ_CACHESIZE=512 # color for 512k cache options INCLUDE_CONFIG_FILE # Include this file in kernel options GEOM_BDE # Disk encryption. options GEOM_BSD # BSD disklabels options ROOTDEVNAME=\"ufs:twed0s1a\" options SCHED_4BSD options SMP # Symmetric MultiProcessor Kernel options ADAPTIVE_GIANT options PREEMPTION options COMPAT_43 options COMPAT_FREEBSD4 options SYSVSHM options SYSVSEM options SYSVMSG options KTRACE #kernel tracing options COMPILING_LINT options INET #Internet communications protocols device ether #Generic Ethernet device loop #Network loopback device device bpf #Berkeley packet filter device pf #PF OpenBSD packet-filter firewall device pflog #logging support interface for PF options ETHER_8022 # enable Ethernet_802.2 frame options ACCEPT_FILTER_DATA options ACCEPT_FILTER_HTTP options FFS #Fast filesystem options CD9660 #ISO 9660 filesystem options PROCFS #Process filesystem (requires PSEUDOFS) options PSEUDOFS #Pseudo-filesystem framework options SOFTUPDATES options UFS_DIRHASH options QUOTA #enable disk quotas device random device mem options _KPOSIX_PRIORITY_SCHEDULING device scbus #base SCSI code device pass #CAM passthrough driver device pty #Pseudo ttys options MSGBUF_SIZE=40960 device atkbdc device atkbd device vga device sc options MAXCONS=8 # number of virtual consoles options SC_NO_SYSMOUSE device asr device twe # 3ware ATA RAID device ata device atadisk # ATA disk drives device atapicd # ATAPI CDROM drives options ATA_STATIC_ID device fdc device sio device miibus device fxp # Intel EtherExpress PRO/100B (82557, 82558) device ppc device ppbus device lpt device ppi options INIT_PATH=/sbin/init:/stand/sysinstall options SEMMAP=31 options SEMMNI=11 options SEMMNS=61 options SEMMNU=31 options SEMMSL=61 options SEMOPM=101 options SEMUME=11 options SHMALL=1025 options SHMMAX=(SHMMAXPGS*PAGE_SIZE+1) options SHMMAXPGS=1025 options SHMMIN=2 options SHMMNI=33 options SHMSEG=9 options MSGMNB=2049 # Max number of chars in queue options MSGMNI=41 # Max number of message queue identifiers options MSGSEG=2049 # Max number of message segments options MSGSSZ=16 # Size of a message segment options MSGTQL=41 # Max number of messages in system options NBUF=512 # Number of buffer headers options NMBCLUSTERS=16384 # Number of mbuf clusters One final question: How do I increase the number of available pty's in 5.x? It seems to max out at about 40. -jon -- Jon Nathan jon@rupture.net