From owner-freebsd-fs@freebsd.org Tue Sep 29 18:22:11 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 272EFA0BEEC for ; Tue, 29 Sep 2015 18:22:11 +0000 (UTC) (envelope-from jg@internetx.com) Received: from mx1.internetx.com (mx1.internetx.com [62.116.129.39]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D70781C70 for ; Tue, 29 Sep 2015 18:22:10 +0000 (UTC) (envelope-from jg@internetx.com) Received: from localhost (localhost [127.0.0.1]) by mx1.internetx.com (Postfix) with ESMTP id 0FB1C147200A; Tue, 29 Sep 2015 20:22:07 +0200 (CEST) X-Virus-Scanned: InterNetX GmbH amavisd-new at ix-mailer.internetx.de Received: from mx1.internetx.com ([62.116.129.39]) by localhost (ix-mailer.internetx.de [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 2QxAQxgRCI9Z; Tue, 29 Sep 2015 20:22:04 +0200 (CEST) Received: from [192.168.100.26] (pizza.internetx.de [62.116.129.3]) (using TLSv1 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by mx1.internetx.com (Postfix) with ESMTPSA id 7AC701472006; Tue, 29 Sep 2015 20:22:00 +0200 (CEST) Reply-To: jg@internetx.com Subject: Re: Cannot replace broken hard drive with LSI HBA References: <1443447383.5271.66.camel@data-b104.adm.slu.se> <5609578E.1050606@physics.umn.edu> <560A4640.3030200@internetx.com> <560A9461.8090300@physics.umn.edu> <560A977C.1070102@internetx.com> <560AD2B9.5040706@fuckner.net> To: Michael Fuckner , Graham Allan , =?UTF-8?Q?Karli_Sj=c3=b6berg?= , "freebsd-fs@freebsd.org" From: InterNetX - Juergen Gotteswinter X-Enigmail-Draft-Status: N1110 Message-ID: <560AD6C7.80800@internetx.com> Date: Tue, 29 Sep 2015 20:21:59 +0200 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: <560AD2B9.5040706@fuckner.net> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Sep 2015 18:22:11 -0000 Am 29.09.2015 um 20:04 schrieb Michael Fuckner: > On 9/29/2015 3:51 PM, InterNetX - Juergen Gotteswinter wrote: >> From my Experience using SATA Disks on SAS Controllers, no matter if >> theres an Expander between or not or mixed, those Setups keep on beeing >> flakey / unreliable. I might work under certain conditions, but its >> nothing you can bet on. >> >> Garret Damore (Illumos Project) describes the problem more detailed here >> >> http://garrett.damore.org/2010/08/why-sas-sata-is-not-such-great-idea.html >> >> > > come on, the article is 5 years old, some things changed since then! > > - MUX Boards are unreliable and expensive- long time since I last saw > those boards i am not talking about sata multiplexers, i am talking about sas expanders. no one ever should think that sata multiplexers are a reliable piece of hardware. they arent. this problems are design related, since Natacount on disks cant talk native with sas controllers. they still exist and occour. like you can see here. a few months ago i had a setup which had exactly what one whould expect from sata/sas mix. bus resets, device hangs and so on. in the end, it turned out that the indel dcs 3500 ssd wich where connected via a lsi sas 2008 where the root cause of all. after they where hooked onto the onboard sata ports, everything was fine. on the other side the intel dcs 3700 sata ssd works fine in sas/sata mix. you see, its nothing you can count on. stay with sas, or with sata and use proper controllers. except you like hunting server gremlins > - SAS Disks are not just 10/15k high performance Disks anymore, most > Nearline Disks are available with native SAS interface as well nearline sas disks are equipped with a real sas interface, they just work with less rpm. > - if you pick the right disk there is no trouble using SATA Disks on SAS > Expanders or SAS Controllers (they should have R/V sensors, optimized > FW...). yes, but still russian roulette with data > - if you use desktop drives in a shelf with lets say 24 slots you should > not expect it to work ;-) well, depends on the usecase, controllers and cabling. look at backblaze... > > Regards, > Michael!