From owner-freebsd-current@FreeBSD.ORG Wed Sep 7 10:09:23 2011 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 61A1D1065677 for ; Wed, 7 Sep 2011 10:09:23 +0000 (UTC) (envelope-from matt.thyer@gmail.com) Received: from mail-ww0-f50.google.com (mail-ww0-f50.google.com [74.125.82.50]) by mx1.freebsd.org (Postfix) with ESMTP id E0D248FC25 for ; Wed, 7 Sep 2011 10:09:22 +0000 (UTC) Received: by wwi36 with SMTP id 36so7348992wwi.31 for ; Wed, 07 Sep 2011 03:09:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=3GkPbpW7GJHOBwOTxy2T3esl0kAWPpLQ3e/N1mP6NHs=; b=QHGaRREr0moAbYmuse8vM4W3lxiv3pv8Q29ZahtD2hz0khzzVx6Ww3XtLIZaB6x75e BK56klAJrgVQdPl2mhaLeRwNpF3f2+pBmLFWp0KLxExwyLY5lQPdlzWEToXw3XsB2guJ J3K0Fml01xv9DspskuiFDAxd+b+HlMh71+g14= MIME-Version: 1.0 Received: by 10.216.18.130 with SMTP id l2mr4500710wel.74.1315390161697; Wed, 07 Sep 2011 03:09:21 -0700 (PDT) Received: by 10.216.11.9 with HTTP; Wed, 7 Sep 2011 03:09:21 -0700 (PDT) In-Reply-To: References: <799446056.115188.1315369441902.JavaMail.root@mail-01.cse.ucsc.edu> Date: Wed, 7 Sep 2011 19:39:21 +0930 Message-ID: From: Matt Thyer To: Tim Gustafson Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-current@freebsd.org Subject: Re: RELENG_8 / mpt / zpool Errors X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Sep 2011 10:09:23 -0000 On 7 September 2011 19:07, Matt Thyer wrote: > On 7 September 2011 13:54, Tim Gustafson wrote: > >> > What are the drives exactly? You may have issues like TLER or >> > frequent head parking. Are these SATA, SCSI or SAS and are port >> > multipliers in use? >> >> root@bsd-03: dmesg | grep da6 >> da6 at mpt0 bus 0 scbus1 target 1 lun 0 >> da6: Fixed Direct Access SCSI-5 device >> da6: 300.000MB/s transfers >> da6: Command Queueing enabled >> da6: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C) >> >> The drives are housed in two of the following enclosures: >> >> ses0 at mpt0 bus 0 scbus1 target 32 lun 0 >> ses0: Fixed Enclosure Services SCSI-5 device >> ses0: 300.000MB/s transfers >> ses0: Command Queueing enabled >> ses0: SCSI-3 SES Device >> >> Each enclosure is directly connected by a dedicated cable to the 2-port >> controller: >> >> mps0: port 0xfc00-0xfcff mem >> 0xef5f0000-0xef5fffff,0xef580000-0xef5bffff irq 44 at device 0.0 on pci1 >> mps0: Firmware: 07.15.04.00 >> mps0: IOCCapabilities: >> 185c >> mps0: [ITHREAD] >> >> >> -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- >> Tim Gustafson >> tjg@soe.ucsc.edu >> Baskin School of Engineering >> 831-459-5354 >> UC Santa Cruz Baskin Engineering >> 317B >> >> -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- >> > > You'll be interested in the thread "PCIe SATA HBA for ZFS on -STABLE" on > the FreeBSD-STABLE list between 31 May 2011 and 12 June 2011. > > Jeremy Chadwick's post on the 1st of June is particularly enlightening. > > Advice is: > > Use -STABLE and not -RELEASE > Upgrade firmware > Avoid port multipliers > > I'm having no troubles but with 8 identical SATA disks instead of SAS. > > As I'm using cheap 4K green drives I had to use wdidle3.exe to fix the 8 > second head parking and I also had to use gnop to force my ZFS pool to use > 4K transfers. > > mps0: port 0xee00-0xeeff mem > 0xfbdfc000-0xfbdfffff,0xfbd80000-0xfbdbffff irq 16 at device 0.0 on pci1 > mps0: Firmware: 07.00.00.00 > da0 at mps0 bus 0 scbus0 target 0 lun 0 > da0: Fixed Direct Access SCSI-5 device > da0: 300.000MB/s transfers > da0: Command Queueing enabled > da0: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C) > > A bit more info... The mps driver has problems with the LSI SAS2008 when using port multipliers (which are in the enclosures). If you go to the previous SAS 3G version of that chip I think you'll be OK. Either that or run Solaris Express or fix the driver.