From owner-freebsd-stable@FreeBSD.ORG Thu Oct 7 12:16:03 2010 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9F3FA106566C for ; Thu, 7 Oct 2010 12:16:03 +0000 (UTC) (envelope-from jhay@meraka.csir.co.za) Received: from zibbi.meraka.csir.co.za (unknown [IPv6:2001:4200:7000:2::1]) by mx1.freebsd.org (Postfix) with ESMTP id B998D8FC13 for ; Thu, 7 Oct 2010 12:16:00 +0000 (UTC) Received: by zibbi.meraka.csir.co.za (Postfix, from userid 3973) id 698AA39824; Thu, 7 Oct 2010 14:15:58 +0200 (SAST) Date: Thu, 7 Oct 2010 14:15:58 +0200 From: John Hay To: freebsd-stable@freebsd.org Message-ID: <20101007121558.GA70199@zibbi.meraka.csir.co.za> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.2.3i Subject: zfs hang in zio->io_cv) with dd read X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 Oct 2010 12:16:03 -0000 Hi, I got hold of a SunFire X4500 with 48 X 500G disks and thought to try FreeBSD 8-stable with zfs on it. I have setup the two boot disks in a zfs mirror and then the rest in a pool of 6 X raidz2 of 7 disks each. I have created a 10G file with dd in the second pool, but if I try to read it with dd, dd will hang in "zio->io_cv)" according to ^T. This happens everytime. The first time I saw messages about an interrupt storm, so I have put "hw.intr_storm_threshold=10000" in /etc/sysctl.conf. According to "systat -vm 1" there is atapci for 2-3 seconds and then it is quiet. The commandline that I use: > cd /export/bonnie/ > ls -l total 43812978 -rw------- 1 jhay jhay 34359738368 Oct 5 20:06 Bonnie.20252 -rw-r--r-- 1 jhay jhay 10485760000 Oct 5 20:20 tst.dd > dd if=tst.dd of=/dev/null bs=64k ^T load: 0.98 cmd: dd 1391 [zio->io_cv)] 17.77r 0.00u 0.88s 0% 880k ^T load: 0.00 cmd: dd 1391 [zio->io_cv)] 4473.68r 0.00u 0.88s 0% 880k thumper1# procstat -k 1391 PID TID COMM TDNAME KSTACK 1391 100205 dd - mi_switch sleepq_wait _cv_wait zio_wait dmu_buf_hold_array_by_dnode dmu_buf_hold_array dmu_read_uio zfs_freebsd_read vn_read dofileread kern_readv read syscall Xfast_syscall thumper1# thumper1# zfs list NAME USED AVAIL REFER MOUNTPOINT dam 12.9G 436G 21K none dam/ROOT 12.9G 436G 21K legacy dam/ROOT/amd64 12.9G 436G 12.9G legacy dam/tmp 22.2M 436G 22.2M /tmp dam/usr_local 2.19M 436G 2.19M /usr/local dam/var 10.4M 436G 10.4M /var meer 41.8G 13.2T 44.8K none meer/export 41.8G 13.2T 41.8G /export thumper1# zpool status pool: dam state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM dam ONLINE 0 0 0 mirror ONLINE 0 0 0 gptid/3c3167d3-cc45-11df-b85d-00144f211378 ONLINE 0 0 0 gptid/3c6eeb97-cc45-11df-b85d-00144f211378 ONLINE 0 0 0 errors: No known data errors pool: meer state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM meer ONLINE 0 0 0 raidz2 ONLINE 0 0 0 gptid/6e4ae922-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/6e647dae-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/6e7c905b-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/6e961440-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/6ed0304d-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/6ee9d7cb-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/6f0341a4-d067-11df-bc29-00144f211378 ONLINE 0 0 0 raidz2 ONLINE 0 0 0 gptid/6f1fbb2b-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/6f3530cc-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/6f4f7635-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/6f6342f8-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/6f78bd12-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/6f8ec2d0-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/6fa35b89-d067-11df-bc29-00144f211378 ONLINE 0 0 0 raidz2 ONLINE 0 0 0 gptid/6fd319f7-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/6fefa464-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/70084d1a-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/70225bd7-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/703b892d-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/705649a0-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/706f0a93-d067-11df-bc29-00144f211378 ONLINE 0 0 0 raidz2 ONLINE 0 0 0 gptid/7087f6c9-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/70a04cca-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/70bbdc2d-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/70d4b6ed-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/70eabeba-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/7100fc20-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/71165baa-d067-11df-bc29-00144f211378 ONLINE 0 0 0 raidz2 ONLINE 0 0 0 gptid/716a084d-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/71853bf5-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/719e0201-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/71b74306-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/71d1c11d-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/71ea1b93-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/7203c8d9-d067-11df-bc29-00144f211378 ONLINE 0 0 0 raidz2 ONLINE 0 0 0 gptid/721b5a67-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/723a30d3-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/7256a502-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/72707600-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/7289edd1-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/72a21a0f-d067-11df-bc29-00144f211378 ONLINE 0 0 0 gptid/72be2559-d067-11df-bc29-00144f211378 ONLINE 0 0 0 spares gptid/6e378541-d067-11df-bc29-00144f211378 AVAIL gptid/6fb986d9-d067-11df-bc29-00144f211378 AVAIL gptid/712f8225-d067-11df-bc29-00144f211378 AVAIL gptid/72d70248-d067-11df-bc29-00144f211378 AVAIL errors: No known data errors thumper1# dmesg Copyright (c) 1992-2010 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 8.1-STABLE #0: Thu Oct 7 10:43:27 UTC 2010 jhay@thumper1:/usr/obj/usr/src/sys/THUMPER1 amd64 Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Dual Core AMD Opteron(tm) Processor 285 (2592.63-MHz K8-class CPU) Origin = "AuthenticAMD" Id = 0x20f12 Family = f Model = 21 Stepping = 2 Features=0x178bfbff Features2=0x1 AMD Features=0xe2500800 AMD Features2=0x3 real memory = 17179869184 (16384 MB) avail memory = 16476504064 (15713 MB) ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs FreeBSD/SMP: 2 package(s) x 2 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 2 cpu3 (AP): APIC ID: 3 MADT: Forcing active-low polarity and level trigger for SCI ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-30 on motherboard ioapic2 irqs 31-37 on motherboard ioapic3 irqs 38-44 on motherboard ioapic4 irqs 45-51 on motherboard ioapic5 irqs 52-58 on motherboard ioapic6 irqs 59-65 on motherboard ioapic7 irqs 66-72 on motherboard ioapic8 irqs 73-79 on motherboard ioapic9 irqs 80-86 on motherboard ioapic10 irqs 87-93 on motherboard kbd1 at kbdmux0 acpi0: on motherboard acpi0: [ITHREAD] acpi0: Power Button (fixed) acpi0: reservation of 0, a0000 (3) failed acpi0: reservation of 100000, f9f00000 (3) failed Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1808-0x180b on acpi0 cpu0: on acpi0 cpu1: on acpi0 cpu2: on acpi0 cpu3: on acpi0 pcib0: on acpi0 pci0: on pcib0 pcib1: at device 1.0 on pci0 pci1: on pcib1 atapci0: port 0x7c00-0x7cff mem 0xfae00000-0xfaefffff irq 24 at device 1.0 on pci1 atapci0: [ITHREAD] ata2: on atapci0 ata2: [ITHREAD] ata3: on atapci0 ata3: [ITHREAD] ata4: on atapci0 ata4: [ITHREAD] ata5: on atapci0 ata5: [ITHREAD] ata6: on atapci0 ata6: [ITHREAD] ata7: on atapci0 ata7: [ITHREAD] ata8: on atapci0 ata8: [ITHREAD] ata9: on atapci0 ata9: [ITHREAD] pcib2: at device 2.0 on pci0 pci2: on pcib2 atapci1: port 0x8c00-0x8cff mem 0xfb000000-0xfb0fffff irq 32 at device 1.0 on pci2 atapci1: [ITHREAD] ata10: on atapci1 ata10: [ITHREAD] ata11: on atapci1 ata11: [ITHREAD] ata12: on atapci1 ata12: [ITHREAD] ata13: on atapci1 ata13: [ITHREAD] ata14: on atapci1 ata14: [ITHREAD] ata15: on atapci1 ata15: [ITHREAD] ata16: on atapci1 ata16: [ITHREAD] ata17: on atapci1 ata17: [ITHREAD] pcib3: at device 6.0 on pci0 pci3: on pcib3 ohci0: mem 0xfd1fe000-0xfd1fefff irq 19 at device 0.0 on pci3 ohci0: [ITHREAD] usbus0: on ohci0 ohci1: mem 0xfd1fd000-0xfd1fdfff irq 19 at device 0.1 on pci3 ohci1: [ITHREAD] usbus1: on ohci1 vgapci0: port 0x9800-0x98ff mem 0xfc000000-0xfcffffff,0xfd1ff000-0xfd1fffff irq 16 at device 3.0 on pci3 ohci2: mem 0xfd1fc000-0xfd1fcfff irq 17 at device 4.0 on pci3 ohci2: [ITHREAD] usbus2: on ohci2 ohci3: mem 0xfd1fb000-0xfd1fbfff irq 18 at device 4.1 on pci3 ohci3: [ITHREAD] usbus3: on ohci3 ehci0: mem 0xfd1fac00-0xfd1facff irq 19 at device 4.2 on pci3 ehci0: [ITHREAD] usbus4: EHCI version 1.0 usbus4: on ehci0 isab0: at device 7.0 on pci0 isa0: on isab0 atapci2: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xffa0-0xffaf at device 7.1 on pci0 ata0: on atapci2 ata0: [ITHREAD] ata1: on atapci2 ata1: [ITHREAD] pci0: at device 7.2 (no driver attached) pci0: at device 7.3 (no driver attached) pcib4: on acpi0 pci4: on pcib4 pcib5: at device 3.0 on pci4 pci5: on pcib5 atapci3: port 0xac00-0xacff mem 0xfd700000-0xfd7fffff irq 38 at device 1.0 on pci5 atapci3: [ITHREAD] ata18: on atapci3 ata18: [ITHREAD] ata19: on atapci3 ata19: [ITHREAD] ata20: on atapci3 ata20: [ITHREAD] ata21: on atapci3 ata21: [ITHREAD] ata22: on atapci3 ata22: [ITHREAD] ata23: on atapci3 ata23: [ITHREAD] ata24: on atapci3 ata24: [ITHREAD] ata25: on atapci3 ata25: [ITHREAD] pcib6: at device 4.0 on pci4 pci6: on pcib6 atapci4: port 0xbc00-0xbcff mem 0xfd900000-0xfd9fffff irq 46 at device 1.0 on pci6 atapci4: [ITHREAD] ata26: on atapci4 ata26: [ITHREAD] ata27: on atapci4 ata27: [ITHREAD] ata28: on atapci4 ata28: [ITHREAD] ata29: on atapci4 ata29: [ITHREAD] ata30: on atapci4 ata30: [ITHREAD] ata31: on atapci4 ata31: [ITHREAD] ata32: on atapci4 ata32: [ITHREAD] ata33: on atapci4 ata33: [ITHREAD] pcib7: at device 5.0 on pci4 pci7: on pcib7 em0: port 0xcc00-0xcc3f mem 0xfdae0000-0xfdafffff irq 52 at device 1.0 on pci7 em0: [FILTER] em0: Ethernet address: 00:14:4f:21:13:78 em1: port 0xc800-0xc83f mem 0xfdac0000-0xfdadffff irq 53 at device 1.1 on pci7 em1: [FILTER] em1: Ethernet address: 00:14:4f:21:13:79 pcib8: at device 6.0 on pci4 pci8: on pcib8 em2: port 0xdc00-0xdc3f mem 0xfdbe0000-0xfdbfffff irq 61 at device 1.0 on pci8 em2: [FILTER] em2: Ethernet address: 00:14:4f:21:13:7a em3: port 0xd800-0xd83f mem 0xfdbc0000-0xfdbdffff irq 62 at device 1.1 on pci8 em3: [FILTER] em3: Ethernet address: 00:14:4f:21:13:7b pcib9: on acpi0 pci12: on pcib9 pcib10: at device 9.0 on pci12 pci13: on pcib10 pcib11: at device 10.0 on pci12 pci14: on pcib11 pcib12: on acpi0 pci9: on pcib12 pcib13: at device 7.0 on pci9 pci10: on pcib13 atapci5: port 0xec00-0xecff mem 0xfe300000-0xfe3fffff irq 68 at device 1.0 on pci10 atapci5: [ITHREAD] ata34: on atapci5 ata34: [ITHREAD] ata35: on atapci5 ata35: [ITHREAD] ata36: on atapci5 ata36: [ITHREAD] ata37: on atapci5 ata37: [ITHREAD] ata38: on atapci5 ata38: [ITHREAD] ata39: on atapci5 ata39: [ITHREAD] ata40: on atapci5 ata40: [ITHREAD] ata41: on atapci5 ata41: [ITHREAD] pcib14: at device 8.0 on pci9 pci11: on pcib14 atapci6: port 0xfc00-0xfcff mem 0xfe500000-0xfe5fffff irq 76 at device 1.0 on pci11 atapci6: [ITHREAD] ata42: on atapci6 ata42: [ITHREAD] ata43: on atapci6 ata43: [ITHREAD] ata44: on atapci6 ata44: [ITHREAD] ata45: on atapci6 ata45: [ITHREAD] ata46: on atapci6 ata46: [ITHREAD] ata47: on atapci6 ata47: [ITHREAD] ata48: on atapci6 ata48: [ITHREAD] ata49: on atapci6 ata49: [ITHREAD] acpi_button0: on acpi0 atrtc0: port 0x70-0x71 on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart0: [FILTER] acpi_hpet0: iomem 0xfec01000-0xfec013ff irq 0,8 on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 900 orm0: at iomem 0xc0000-0xc9fff,0xca000-0xcafff,0xcb000-0xcbfff,0xcc000-0xccfff,0xcd000-0xcdfff,0xce000-0xcefff,0xcf000-0xd57ff on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 atkbdc0: at port 0x60,0x64 on isa0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] atkbd0: [ITHREAD] ppc0: cannot reserve I/O port range powernow0: on cpu0 powernow1: on cpu1 powernow2: on cpu2 powernow3: on cpu3 ZFS filesystem version 4 ZFS storage pool version 15 Timecounters tick every 1.000 msec usbus0: 12Mbps Full Speed USB v1.0 usbus1: 12Mbps Full Speed USB v1.0 usbus2: 12Mbps Full Speed USB v1.0 usbus3: 12Mbps Full Speed USB v1.0 usbus4: 480Mbps High Speed USB v2.0 ugen0.1: at usbus0 uhub0: on usbus0 ugen1.1: at usbus1 uhub1: on usbus1 ugen2.1: at usbus2 uhub2: on usbus2 ugen3.1: at usbus3 uhub3: on usbus3 ugen4.1: at usbus4 uhub4: on usbus4 ad4: 476940MB at ata2-master UDMA100 SATA 3Gb/s ad6: 476940MB at ata3-master UDMA100 SATA 3Gb/s ad8: 476940MB at ata4-master UDMA100 SATA 3Gb/s ad10: 476940MB at ata5-master UDMA100 SATA 3Gb/s ad12: 476940MB at ata6-master UDMA100 SATA 3Gb/s ad14: 476940MB at ata7-master UDMA100 SATA 3Gb/s uhub0: 3 ports with 3 removable, self powered uhub1: 3 ports with 3 removable, self powered ad16: 476940MB at ata8-master UDMA100 SATA 3Gb/s uhub3: 2 ports with 2 removable, self powered ad18: 476940MB at ata9-master UDMA100 SATA 3Gb/s ad20: 476940MB at ata10-master UDMA100 SATA 3Gb/s uhub2: 3 ports with 3 removable, self powered ad22: 476940MB at ata11-master UDMA100 SATA 3Gb/s ad24: 476940MB at ata12-master UDMA100 SATA 3Gb/s ad26: 476940MB at ata13-master UDMA100 SATA 3Gb/s ad28: 476940MB at ata14-master UDMA100 SATA 3Gb/s ad30: 476940MB at ata15-master UDMA100 SATA 3Gb/s ad32: 476940MB at ata16-master UDMA100 SATA 3Gb/s ad34: 476940MB at ata17-master UDMA100 SATA 3Gb/s ad36: 476940MB at ata18-master UDMA100 SATA 3Gb/s ad38: 476940MB at ata19-master UDMA100 SATA 3Gb/s ad40: 476940MB at ata20-master UDMA100 SATA 3Gb/s ad42: 476940MB at ata21-master UDMA100 SATA 3Gb/s ad44: 476940MB at ata22-master UDMA100 SATA 3Gb/s ad46: 476940MB at ata23-master UDMA100 SATA 3Gb/s ad48: 476940MB at ata24-master UDMA100 SATA 3Gb/s ad50: 476940MB at ata25-master UDMA100 SATA 3Gb/s ad52: 476940MB at ata26-master UDMA100 SATA 3Gb/s ad54: 476940MB at ata27-master UDMA100 SATA 3Gb/s ad56: 476940MB at ata28-master UDMA100 SATA 3Gb/s ad58: 476940MB at ata29-master UDMA100 SATA 3Gb/s ad60: 476940MB at ata30-master UDMA100 SATA 3Gb/s ad62: 476940MB at ata31-master UDMA100 SATA 3Gb/s ad64: 476940MB at ata32-master UDMA100 SATA 3Gb/s ad66: 476940MB at ata33-master UDMA100 SATA 3Gb/s ad68: 476940MB at ata34-master UDMA100 SATA 3Gb/s ad70: 476940MB at ata35-master UDMA100 SATA 3Gb/s ad72: 476940MB at ata36-master UDMA100 SATA 3Gb/s ad74: 476940MB at ata37-master UDMA100 SATA 3Gb/s ad76: 476940MB at ata38-master UDMA100 SATA 3Gb/s ad78: 476940MB at ata39-master UDMA100 SATA 3Gb/s ad80: 476940MB at ata40-master UDMA100 SATA 3Gb/s ad82: 476940MB at ata41-master UDMA100 SATA 3Gb/s ad84: 476940MB at ata42-master UDMA100 SATA 3Gb/s ugen0.2: at usbus0 ukbd0: on usbus0 ad86: 476940MB at ata43-master UDMA100 SATA 3Gb/s kbd2 at ukbd0 ums0: on usbus0 ums0: 3 buttons and [XY] coordinates ID=0 ad88: 476940MB at ata44-master UDMA100 SATA 3Gb/s ad90: 476940MB at ata45-master UDMA100 SATA 3Gb/s ad92: 476940MB at ata46-master UDMA100 SATA 3Gb/s ad94: 476940MB at ata47-master UDMA100 SATA 3Gb/s ad96: 476940MB at ata48-master UDMA100 SATA 3Gb/s ad98: 476940MB at ata49-master UDMA100 SATA 3Gb/s SMP: AP CPU #1 Launched! SMP: AP CPU #2 Launched! SMP: AP CPU #3 Launched! Root mount waiting for: usbus4 uhub4: 5 ports with 5 removable, self powered ugen4.2: at usbus4 uhub5: on usbus4 Root mount waiting for: usbus4 uhub5: 4 ports with 4 removable, self powered ugen4.3: at usbus4 umass0: on usbus4 umass0: SCSI over Bulk-Only; quirks = 0x0000 Root mount waiting for: usbus4 umass0:0:0:-1: Attached to scbus0 Trying to mount root from zfs:dam/ROOT/amd64 (probe0:umass-sim0:0:0:0): TEST UNIT READY. CDB: 0 0 0 0 0 0 (probe0:umass-sim0:0:0:0): CAM status: SCSI Status Error (probe0:umass-sim0:0:0:0): SCSI status: Check Condition (probe0:umass-sim0:0:0:0): SCSI sense: UNIT ATTENTION asc:28,0 (Not ready to ready change, medium may have changed) da0 at umass-sim0 bus 0 scbus0 target 0 lun 0 da0: Removable Direct Access SCSI-0 device da0: 40.000MB/s transfers da0: 7636MB (15638528 512 byte sectors: 255H 63S/T 973C) em0: link state changed to UP lagg0: link state changed to UP lagg0.6: link state changed to UP em2: link state changed to UP em1: link state changed to UP em3: link state changed to UP thumper1# glabel status Name Status Components gptid/6e378541-d067-11df-bc29-00144f211378 N/A ad4p1 gptid/6e4ae922-d067-11df-bc29-00144f211378 N/A ad6p1 gptid/6e647dae-d067-11df-bc29-00144f211378 N/A ad8p1 gptid/6e7c905b-d067-11df-bc29-00144f211378 N/A ad10p1 gptid/6e961440-d067-11df-bc29-00144f211378 N/A ad12p1 gptid/6ed0304d-d067-11df-bc29-00144f211378 N/A ad14p1 gptid/6ee9d7cb-d067-11df-bc29-00144f211378 N/A ad16p1 gptid/6f0341a4-d067-11df-bc29-00144f211378 N/A ad18p1 gptid/6f1fbb2b-d067-11df-bc29-00144f211378 N/A ad20p1 gptid/6f3530cc-d067-11df-bc29-00144f211378 N/A ad22p1 gptid/6f4f7635-d067-11df-bc29-00144f211378 N/A ad24p1 gptid/6f6342f8-d067-11df-bc29-00144f211378 N/A ad26p1 gptid/6f78bd12-d067-11df-bc29-00144f211378 N/A ad28p1 gptid/6f8ec2d0-d067-11df-bc29-00144f211378 N/A ad30p1 gptid/6fa35b89-d067-11df-bc29-00144f211378 N/A ad32p1 gptid/6fb986d9-d067-11df-bc29-00144f211378 N/A ad34p1 gptid/6fd319f7-d067-11df-bc29-00144f211378 N/A ad36p1 gptid/6fefa464-d067-11df-bc29-00144f211378 N/A ad38p1 gptid/70084d1a-d067-11df-bc29-00144f211378 N/A ad40p1 gptid/70225bd7-d067-11df-bc29-00144f211378 N/A ad42p1 gptid/703b892d-d067-11df-bc29-00144f211378 N/A ad44p1 gptid/705649a0-d067-11df-bc29-00144f211378 N/A ad46p1 gptid/706f0a93-d067-11df-bc29-00144f211378 N/A ad48p1 gptid/7087f6c9-d067-11df-bc29-00144f211378 N/A ad50p1 gptid/3c0ebfcf-cc45-11df-b85d-00144f211378 N/A ad52p1 gptid/3c3167d3-cc45-11df-b85d-00144f211378 N/A ad52p3 gptid/70a04cca-d067-11df-bc29-00144f211378 N/A ad54p1 gptid/70bbdc2d-d067-11df-bc29-00144f211378 N/A ad56p1 gptid/70d4b6ed-d067-11df-bc29-00144f211378 N/A ad58p1 gptid/3c4c7865-cc45-11df-b85d-00144f211378 N/A ad60p1 gptid/3c635efe-cc45-11df-b85d-00144f211378 N/A ad60p2 gptid/3c6eeb97-cc45-11df-b85d-00144f211378 N/A ad60p3 gptid/70eabeba-d067-11df-bc29-00144f211378 N/A ad62p1 gptid/7100fc20-d067-11df-bc29-00144f211378 N/A ad64p1 gptid/71165baa-d067-11df-bc29-00144f211378 N/A ad66p1 gptid/712f8225-d067-11df-bc29-00144f211378 N/A ad68p1 gptid/716a084d-d067-11df-bc29-00144f211378 N/A ad70p1 gptid/71853bf5-d067-11df-bc29-00144f211378 N/A ad72p1 gptid/719e0201-d067-11df-bc29-00144f211378 N/A ad74p1 gptid/71b74306-d067-11df-bc29-00144f211378 N/A ad76p1 gptid/71d1c11d-d067-11df-bc29-00144f211378 N/A ad78p1 gptid/71ea1b93-d067-11df-bc29-00144f211378 N/A ad80p1 gptid/7203c8d9-d067-11df-bc29-00144f211378 N/A ad82p1 gptid/721b5a67-d067-11df-bc29-00144f211378 N/A ad84p1 gptid/723a30d3-d067-11df-bc29-00144f211378 N/A ad86p1 gptid/7256a502-d067-11df-bc29-00144f211378 N/A ad88p1 gptid/72707600-d067-11df-bc29-00144f211378 N/A ad90p1 gptid/7289edd1-d067-11df-bc29-00144f211378 N/A ad92p1 gptid/72a21a0f-d067-11df-bc29-00144f211378 N/A ad94p1 gptid/72be2559-d067-11df-bc29-00144f211378 N/A ad96p1 gptid/72d70248-d067-11df-bc29-00144f211378 N/A ad98p1 ufsid/49a828ef1a6a2de8 N/A da0s1a ufs/flash1 N/A da0s1a ufsid/49a8c69e60e10953 N/A da0s2a ufs/flash2 N/A da0s2a ufsid/49b383f54383bf0d N/A da0s3a ufs/flash3 N/A da0s3a ufsid/49b383fca9c7233b N/A da0s4a ufs/flash4 N/A da0s4a thumper1# vmstat -i interrupt total rate irq17: ohci2 451815 98 irq18: ohci3 167391 36 irq19: ohci0 ohci1+ 137556 30 irq24: atapci0 19644 4 irq32: atapci1 15102 3 irq38: atapci3 19532 4 irq46: atapci4 23575 5 irq52: em0 452 0 irq53: em1 7582 1 irq61: em2 2319 0 irq62: em3 1427 0 irq68: atapci5 17632 3 irq76: atapci6 18112 3 cpu0: timer 9133048 1999 cpu1: timer 9126434 1998 cpu2: timer 9130320 1999 cpu3: timer 9130448 1999 Total 37402389 8189 John -- John Hay -- jhay@meraka.csir.co.za / jhay@FreeBSD.org