From owner-freebsd-questions@freebsd.org Mon Nov 21 08:00:14 2016 Return-Path: Delivered-To: freebsd-questions@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 429D6C4CB10 for ; Mon, 21 Nov 2016 08:00:14 +0000 (UTC) (envelope-from trond@fagskolen.gjovik.no) Received: from smtp.fagskolen.gjovik.no (smtp.fagskolen.gjovik.no [IPv6:2001:700:1100:1:200:ff:fe00:b]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smtp.fagskolen.gjovik.no", Issuer "Fagskolen i Gj??vik" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id B4F091836 for ; Mon, 21 Nov 2016 08:00:13 +0000 (UTC) (envelope-from trond@fagskolen.gjovik.no) Received: from mail.fig.ol.no (localhost [127.0.0.1]) by mail.fig.ol.no (8.15.2/8.15.2) with ESMTPS id uAL807xk042190 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Mon, 21 Nov 2016 09:00:07 +0100 (CET) (envelope-from trond@fagskolen.gjovik.no) Received: from localhost (trond@localhost) by mail.fig.ol.no (8.15.2/8.15.2/Submit) with ESMTP id uAL8061N042187; Mon, 21 Nov 2016 09:00:07 +0100 (CET) (envelope-from trond@fagskolen.gjovik.no) X-Authentication-Warning: mail.fig.ol.no: trond owned process doing -bs Date: Mon, 21 Nov 2016 09:00:06 +0100 (CET) From: =?ISO-8859-1?Q?Trond_Endrest=F8l?= Sender: Trond.Endrestol@fagskolen.gjovik.no To: Paul Macdonald cc: freebsd-questions@freebsd.org Subject: Re: Dell R230's + ZFS via PERC In-Reply-To: <5c6f8cf9-3b10-f631-7a14-986ce08f8b54@ifdnrg.com> Message-ID: References: <5c6f8cf9-3b10-f631-7a14-986ce08f8b54@ifdnrg.com> User-Agent: Alpine 2.20 (BSF 67 2015-01-07) Organization: Fagskolen Innlandet OpenPGP: url=http://fig.ol.no/~trond/trond.key MIME-Version: 1.0 X-Spam-Status: No, score=-2.1 required=5.0 tests=ALL_TRUSTED,AWL,BAYES_00 autolearn=ham autolearn_force=no version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail.fig.ol.no Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8BIT X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 21 Nov 2016 08:00:14 -0000 On Fri, 18 Nov 2016 20:10-0000, Paul Macdonald wrote: > Hi, > > We're buying a few of theDell R230's now, > > The R230's however, whilst having nice 4 x hotswappable bays) have only a > single sata port on the borard and everything goes via the PERC card. > > ( the R220's had awful ACPI problems which muck up serial access) > > A lot of these are single SSD systems with a few mirrored sata + L2 SSD's for > caching > > I've read that ZFS prefers direct access to the disks, does anyone have > info/insight as to running zfs via these percs? We bought a R320 with the H310 Mini PERC last year. The server runs stable/10 amd64. I managed to convince the PERC to run in JBOD mode. The four drives are exposed as /dev/mfisyspd0, /dev/mfisyspd1, /dev/mfisyspd2, and /dev/mfisyspd3. ZFS hasn't complained so far, but the mfi driver complains every now and then about not being allowed to run patrol read: mfi0: 1063 (531025200s/0x0020/WARN) - Patrol Read can't be started, as PDs are either not ONLINE, or are in a VD with an active process, or are in an excluded VD -- +-------------------------------+------------------------------------+ | Vennlig hilsen, | Best regards, | | Trond Endrestøl, | Trond Endrestøl, | | IT-ansvarlig, | System administrator, | | Fagskolen Innlandet, | Gjøvik Technical College, Norway, | | tlf. mob. 952 62 567, | Cellular...: +47 952 62 567, | | sentralbord 61 14 54 00. | Switchboard: +47 61 14 54 00. | +-------------------------------+------------------------------------+ From owner-freebsd-questions@freebsd.org Mon Nov 21 13:58:25 2016 Return-Path: Delivered-To: freebsd-questions@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3B74BC4C881; Mon, 21 Nov 2016 13:58:25 +0000 (UTC) (envelope-from dweimer@dweimer.net) Received: from webmail.dweimer.net (24-240-198-187.static.stls.mo.charter.com [24.240.198.187]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E6073FBA; Mon, 21 Nov 2016 13:58:24 +0000 (UTC) (envelope-from dweimer@dweimer.net) Received: from webmail.dweimer.local (localhost [10.9.5.2]) by webmail.dweimer.net (8.15.2/8.15.2) with ESMTPS id uALDejxS014998 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Mon, 21 Nov 2016 07:40:45 -0600 (CST) (envelope-from dweimer@dweimer.net) Received: (from www@localhost) by webmail.dweimer.local (8.15.2/8.15.2/Submit) id uALDeiYu014977; Mon, 21 Nov 2016 07:40:44 -0600 (CST) (envelope-from dweimer@dweimer.net) X-Authentication-Warning: webmail.dweimer.local: www set sender to dweimer@dweimer.net using -f To: Trond Endrestøl Subject: Re: Dell R230's + ZFS via PERC MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Date: Mon, 21 Nov 2016 07:40:44 -0600 From: "Dean E. Weimer" Cc: Paul Macdonald , freebsd-questions@freebsd.org, owner-freebsd-questions@freebsd.org Organization: dweimer.net Reply-To: dweimer@dweimer.net Mail-Reply-To: dweimer@dweimer.net In-Reply-To: References: <5c6f8cf9-3b10-f631-7a14-986ce08f8b54@ifdnrg.com> Message-ID: <82a1999d3684263c611b4e607ba6c851@dweimer.net> X-Sender: dweimer@dweimer.net User-Agent: Roundcube Webmail/1.2.2 X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 21 Nov 2016 13:58:25 -0000 On 2016-11-21 2:00 am, Trond Endrestøl wrote: > On Fri, 18 Nov 2016 20:10-0000, Paul Macdonald wrote: > >> Hi, >> >> We're buying a few of theDell R230's now, >> >> The R230's however, whilst having nice 4 x hotswappable bays) have >> only a >> single sata port on the borard and everything goes via the PERC card. >> >> ( the R220's had awful ACPI problems which muck up serial access) >> >> A lot of these are single SSD systems with a few mirrored sata + L2 >> SSD's for >> caching >> >> I've read that ZFS prefers direct access to the disks, does anyone >> have >> info/insight as to running zfs via these percs? > > We bought a R320 with the H310 Mini PERC last year. The server runs > stable/10 amd64. I managed to convince the PERC to run in JBOD mode. > The four drives are exposed as /dev/mfisyspd0, /dev/mfisyspd1, > /dev/mfisyspd2, and /dev/mfisyspd3. > > ZFS hasn't complained so far, but the mfi driver complains every now > and then about not being allowed to run patrol read: > > mfi0: 1063 (531025200s/0x0020/WARN) - Patrol Read can't be started, as > PDs are either not ONLINE, or are in a VD with an active process, or > are in an excluded VD Patrol read is a diagnostic procedure it attempts to verify all data can be read, its probably safe to ignore the message, though it should be able to run. I have a couple of machines running on Dell PERC H700, with zfs running on JBOD setup, looks like they are successfully running it. mfi0: 14748 (532234800s/0x0020/info) - Patrol Read started mfi0: 14789 (532250323s/0x0020/info) - Patrol Read complete mfi0: 14790 (532839600s/0x0020/info) - Patrol Read started mfi0: 14835 (532854948s/0x0020/info) - Patrol Read complete These machines are under fairly low load outside of 6am to 6pm time frame. -- Thanks, Dean E. Weimer http://www.dweimer.net/