From owner-freebsd-scsi@freebsd.org Sun Jan 7 02:40:49 2018 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5F43BE5E6B3 for ; Sun, 7 Jan 2018 02:40:49 +0000 (UTC) (envelope-from leeb@ratnaling.org) Received: from mail-it0-x22a.google.com (mail-it0-x22a.google.com [IPv6:2607:f8b0:4001:c0b::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 20A056F8C2 for ; Sun, 7 Jan 2018 02:40:49 +0000 (UTC) (envelope-from leeb@ratnaling.org) Received: by mail-it0-x22a.google.com with SMTP id d137so5788977itc.2 for ; Sat, 06 Jan 2018 18:40:49 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ratnaling-org.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:cc; bh=RHLRlK1H9wKDTO5gCe/g1Q9D/x4pJ6/DOfSIjjh760E=; b=1vUzhw134crnQ0qJwmap5Uc61A764KSVyvp8ajtbKci2Qf4HYlL7NuQ3rerd9J79TP rVERyu7FqehFnvJLqdS3+I+j9+W3332edrcFI3JGEsdZ2Zxy/1ScA6As/VZ9qDETtKkN XfqtpN3QuNs/irsu+iabnYAdrHoY3/Qq9Rdv/N60YjnAFt1l3d5h8ufxOP+o6DQe21aj /J46BaMmC1BgcOYFfHqFZa8h+FcZ9eAN82HO1MnIkpdrCEoLRANhtRkTaDDcLeX1jDjq n0Aj9YQIZK8lEiQTbUACGCxYT9nmPdXIsMiKYYYqFPyFRO2YoDWM5ZibcDP4N9x8/0ox 5CsA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:cc; bh=RHLRlK1H9wKDTO5gCe/g1Q9D/x4pJ6/DOfSIjjh760E=; b=AsdiHqmVZCzPWJix/aX9gXaKoZGYs5l9Re2Pj83am1lijiJNoEUfSMsurehdvuKj2+ SdgbFtjq5rx28a8AlafMvcGUis4bUvUVz0YptPaavOyG4EX/feq2cxKGznPvJJlQmpNW RjxJ1T/GiImVnuWNVsp2axPtsPDQhMyr87IKdTpTfiHVwhHB+A9DVzXo9n+h5ROItpGs W9G3HMnlu2dv9PeCzzUg2Nk/9EfnZrS4O5Szq/RzVHG9MHlyGavLPTZvA4dLGERrkI4C QaaxfX7v6c70c0za8Gg2nx1WTTN3fqE911JfCAfAiJqWJy4Wz+XlctZaa4tp4gJo4MQ+ B7Qw== X-Gm-Message-State: AKwxytdrFKzqgn3GhneyMdfPNFjlXzeVOl6NNmTBECBiOdJUQnP3E+gm XML21NhVJIQSVW9mr1Fsn+FjalPAhmYTbI/1wMA2bA== X-Received: by 10.36.177.5 with SMTP id o5mt3171389itf.50.1515292848037; Sat, 06 Jan 2018 18:40:48 -0800 (PST) MIME-Version: 1.0 Received: by 10.79.157.200 with HTTP; Sat, 6 Jan 2018 18:40:47 -0800 (PST) In-Reply-To: References: <20171116142843.GA25563@mithlond.kdm.org> From: Lee Brown Date: Sat, 6 Jan 2018 18:40:47 -0800 Message-ID: Subject: Re: Does anybody have experience with a MD1420, mpr(4) Cc: freebsd-scsi@freebsd.org, freebsd-hardware@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 07 Jan 2018 02:40:49 -0000 On Thu, Nov 16, 2017 at 10:43 AM, Lee Brown wrote: > > > On Thu, Nov 16, 2017 at 6:28 AM, Kenneth D. Merry wrote: > >> On Wed, Nov 15, 2017 at 12:24:47 -0800, Lee Brown wrote: >> > Hi, >> > >> > This is my for foray into DAS, so please be gentle :) Apologies if the >> > cross-post is inappropriate, let me know. >> > >> > I'm looking to build a SAS array with a Dell MD1420. It will be >> attached >> > via a SAS 9300-414E HBA in a Dell R330. >> > >> > I've verified that the server / SAS card should be fine, but just >> wanted to >> > know if anybody has set this up before, or if there's any obvious reason >> > why it wouldn't work. Dell can be a bit weird sometimes. >> > >> > Any information is most welcome. >> >> In theory it should be fine. I haven't used a Dell enclosure recently, >> but >> from posts here, it seems that they like to turn on Type 2 Protection >> Information on the drives. (Assuming you buy the drives from Dell.) >> >> If they do that, you can either reformat, or see the patch here for the >> mpr(4) driver to disable using protection information: >> >> https://docs.freebsd.org/cgi/getmsg.cgi?fetch=308820+0+archi >> ve/2017/freebsd-scsi/20171022.freebsd-scsi >> >> I haven't gotten around to changing things so that we detect the PI in the >> da(4) driver and use 32 byte CDBs when type 2 protection is enabled. (So >> if someone else has time and wants to do it, feel free. It will be >> somewhat messy because we only allocate enough space for 16 byte CDBs >> inside >> the CCB, so you'll need to allocate the CDB separately...) >> >> If you use ZFS, you'll have checksum protection on your data anyway, so PI >> would just be additional protection. >> >> I would also suggest that you update to the latest firmware (currently >> Phase 15) for the SAS controller. You can do that with LSI's sas3flash or >> the FreeBSD mprutil(8) utility. >> >> Ken >> -- >> Kenneth Merry >> ken@FreeBSD.ORG >> > Thanks Ken, > > I'm going to purchase the system. I had no idea about PI, that's a nice > feature for sure. > > This will probably just be iSCSI and NFS4 over a 10Gb NIC (Xen cluster), > so having PI detection is certainly of interest to me. I'll figure out > what I can do to contribute (code/testing) when things have settled. > > Assuming all is well I'll get the 1420 added to the hardware compatibility > list. > > Much appreciated -- lee > Following up, I have the MD1420 installed and attached. The kernel patch works as expected, errors with the flag set to zero, no errors when set to 1. First problem I am having is saving firmware from the card to local storage: root@svr-nas-rl:~ # mprutil flash save firmware mprutil: Fail to save firmware Second problem is performance, 20MB/s sequential write to a single spindle, 200MB/s read. I was expecting at least 100MB/s for the write, maybe my expectations were wrong? root@svr-nas-rl:~ # cp /dev/zero /dev/da0 dT: 1.058s w: 1.000s L(q) ops/s r/s kBps ms/r w/s kBps ms/w %busy Name 1 158 0 0 0.0 158 20206 6.3 99.8| da0 root@svr-nas-rl:~ # cp /dev/da0 /dev/null dT: 1.001s w: 1.000s L(q) ops/s r/s kBps ms/r w/s kBps ms/w %busy Name 1 1587 1587 203171 0.6 0 0 0.0 99.4| da0 root@svr-nas-rl:~ # mprutil show adapter mpr0 Adapter: Board Name: SAS9300-4i4e Board Assembly: H3-25515-00G Chip Name: LSISAS3008 Chip Revision: ALL BIOS Revision: 6.00.00.00 Firmware Revision: 5.00.00.00 Integrated RAID: no root@svr-nas-rl:~ # geom disk list da0 Geom name: da0 Providers: 1. Name: da0 Mediasize: 300000000000 (279G) Sectorsize: 512 Mode: r0w0e0 descr: SEAGATE ST300MM0078 lunid: 5000c500a0f3f977 ident: W0K1BE3R rotationrate: 10000 fwsectors: 63 fwheads: 255