From owner-freebsd-current@FreeBSD.ORG Thu Jan 15 23:57:13 2009 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DC4B81065745 for ; Thu, 15 Jan 2009 23:57:13 +0000 (UTC) (envelope-from dylan@dylex.net) Received: from datura.dylex.net (datura.dylex.net [216.27.141.80]) by mx1.freebsd.org (Postfix) with ESMTP id 998998FC1C for ; Thu, 15 Jan 2009 23:57:13 +0000 (UTC) (envelope-from dylan@dylex.net) Received: from dylan by datura.dylex.net with local (Exim 4.69) (envelope-from ) id 1LNbkf-0006R0-Fv for freebsd-current@freebsd.org; Thu, 15 Jan 2009 18:35:53 -0500 Date: Thu, 15 Jan 2009 18:35:53 -0500 From: Dylan Alex Simon To: freebsd-current@freebsd.org Message-ID: <20090115233553.GA24679@datura.dylex.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Subject: SATA DMA errors on second ICH10 bus X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 Jan 2009 23:57:14 -0000 I have four identical SATA300 disks on a Supermicro C2SEA which has 6 total SATA ports on an ICH10. This is from 20090114 CURRENT sources with a custom kernel (no PREEMPTION, INVARIANTS, WITNESS, and many drivers removed, but otherwise same as GENERIC). The first two disks (ad6 ad7) seem to work fine, and I've done buildworld, zfs, and nfs tests on both of them together and separately. The second two disks (ad8 ad9) work okay for some things (labeling, zpool creation, gmirror creation, dd slice), but as soon as I start doing anything more complicated involving at least one of them (gmirror write access, cp to ufs partition, cp to zfs over nfs, etc.) I get the following errors on all involved disks (including the first two): Jan 15 17:35:07 lust kernel: ad8: FAILURE - load data Jan 15 17:35:07 lust kernel: ad8: setting up DMA failed Jan 15 17:35:07 lust kernel: ad8: FAILURE - load data Jan 15 17:35:07 lust kernel: ad8: setting up DMA failed Jan 15 17:35:07 lust kernel: g_vfs_done():ad8s1e[WRITE(offset=1881014272, length=131072)]error = 5 Jan 15 17:35:07 lust kernel: ad6: FAILURE - load data Jan 15 17:35:07 lust kernel: ad6: setting up DMA failed Jan 15 17:35:07 lust kernel: g_vfs_done():ad6s1e[READ(offset=4117364736, length=32768)]error = 5 Jan 15 17:35:07 lust kernel: vnode_pager_getpages: I/O read error Jan 15 17:35:07 lust kernel: vm_fault: pager read error, pid 985 (cp) This continues for a while and then with ufs panics pretty soon. With zfs it starts hanging most processes after awhile. (7.1 found the disks but failed to complete booting, freezing up right after probing. The only related issue I could find is kern/125859.) I'm happy to provide any information needed or try patches. I would also like to know if there's a way to turn off DMA on just these two disks (atacontrol mode won't seem to set anything but SATA300). Thanks, :-Dylan FreeBSD lust.cns.nyu.edu 8.0-CURRENT FreeBSD 8.0-CURRENT #0: Wed Jan 14 19:58:58 EST 2009 dylan@lust.cns.nyu.edu:/usr/obj/usr/src/sys/SIN amd64 dmesg (partial): lust kernel: pcib3: at device 30.0 on pci0 lust kernel: pci3: on pcib3 lust kernel: atapci0: port 0xec00-0xec07,0xe880-0xe883,0xe800-0xe807,0xe480-0xe483,0xe400-0xe40f irq 22 at device 4.0 on pci3 lust kernel: atapci0: [ITHREAD] lust kernel: ata2: on atapci0 lust kernel: ata2: [ITHREAD] lust kernel: pci3: at device 8.0 (no driver attached) lust kernel: isab0: at device 31.0 on pci0 lust kernel: isa0: on isab0 lust kernel: atapci1: port 0xc400-0xc407,0xc080-0xc083,0xc000-0xc007,0xbc00-0xbc03,0xb880-0xb88f,0xb800-0xb80f irq 19 at device 31.2 on pci0 lust kernel: atapci1: [ITHREAD] lust kernel: ata3: on atapci1 lust kernel: ata3: [ITHREAD] lust kernel: ata4: on atapci1 lust kernel: ata4: [ITHREAD] lust kernel: pci0: at device 31.3 (no driver attached) lust kernel: atapci2: port 0xb400-0xb407,0xb080-0xb083,0xb000-0xb007,0xac00-0xac03,0xa880-0xa88f,0xa800-0xa80f irq 19 at device 31.5 on pci0 lust kernel: atapci2: [ITHREAD] lust kernel: ata5: on atapci2 lust kernel: ata5: [ITHREAD] lust kernel: ata6: on atapci2 lust kernel: ata6: [ITHREAD] lust kernel: est: CPU supports Enhanced Speedstep, but is not recognized. lust kernel: est: cpu_vendor GenuineIntel, msr 61a0a2006000a20 lust kernel: acd0: DVDROM at ata2-master UDMA33 lust kernel: ad6: 953869MB at ata3-master SATA300 lust kernel: ad7: 953869MB at ata3-slave SATA300 lust kernel: ad8: 953869MB at ata4-master SATA300 lust kernel: ad9: 953869MB at ata4-slave SATA300 atacontrol list: ATA channel 2: Master: acd0 ATA/ATAPI revision 7 Slave: no device present ATA channel 3: Master: ad6 Serial ATA II Slave: ad7 Serial ATA II ATA channel 4: Master: ad8 Serial ATA II Slave: ad9 Serial ATA II ATA channel 5: Master: no device present Slave: no device present ATA channel 6: Master: no device present Slave: no device present pciconf -lv (partial): pcib3@pci0:0:30:0: class=0x060401 card=0xb88015d9 chip=0x244e8086 rev=0x90 hdr=0x01 vendor = 'Intel Corporation' device = '82801 Family (ICH2/3/4/4/5/5/6/7/8/9,63xxESB) Hub Interface to PCI Bridge' class = bridge subclass = PCI-PCI isab0@pci0:0:31:0: class=0x060100 card=0xb88015d9 chip=0x3a188086 rev=0x00 hdr=0x00 vendor = 'Intel Corporation' class = bridge subclass = PCI-ISA atapci1@pci0:0:31:2: class=0x01018f card=0xb88015d9 chip=0x3a208086 rev=0x00 hdr=0x00 vendor = 'Intel Corporation' class = mass storage subclass = ATA atapci2@pci0:0:31:5: class=0x010185 card=0xb88015d9 chip=0x3a268086 rev=0x00 hdr=0x00 vendor = 'Intel Corporation' class = mass storage subclass = ATA