From owner-freebsd-amd64@FreeBSD.ORG Fri Mar 3 21:44:01 2006 Return-Path: X-Original-To: freebsd-amd64@freebsd.org Delivered-To: freebsd-amd64@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id BE7AD16A420 for ; Fri, 3 Mar 2006 21:44:01 +0000 (GMT) (envelope-from fcash@ocis.net) Received: from smtp.sd73.bc.ca (mailtest.sd73.bc.ca [142.24.13.140]) by mx1.FreeBSD.org (Postfix) with ESMTP id 53DBC43D6D for ; Fri, 3 Mar 2006 21:43:19 +0000 (GMT) (envelope-from fcash@ocis.net) Received: from localhost (localhost [127.0.0.1]) by localhost.sd73.bc.ca (Postfix) with ESMTP id 291658A0042 for ; Fri, 3 Mar 2006 13:46:47 -0800 (PST) Received: from smtp.sd73.bc.ca ([127.0.0.1]) by localhost (smtp.sd73.bc.ca [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 31534-01-61 for ; Fri, 3 Mar 2006 13:46:40 -0800 (PST) Received: from [192.168.0.10] (s10.sbo [192.168.0.10]) by smtp.sd73.bc.ca (Postfix) with ESMTP id 413FE8A0021 for ; Fri, 3 Mar 2006 13:46:39 -0800 (PST) From: Freddie Cash To: freebsd-amd64@freebsd.org Date: Fri, 3 Mar 2006 13:43:09 -0800 User-Agent: KMail/1.9.1 References: <20060303133844.451cb4f7.kgunders@teamcool.net> In-Reply-To: <20060303133844.451cb4f7.kgunders@teamcool.net> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200603031343.10334.fcash@ocis.net> X-Virus-Scanned: by amavisd-new using ClamAV at sd73.bc.ca Subject: Re: major pita w/LSI Tyan TA26 combo X-BeenThere: freebsd-amd64@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Porting FreeBSD to the AMD64 platform List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 03 Mar 2006 21:44:01 -0000 On Friday 03 March 2006 12:38 pm, Ken Gunderson wrote: > Been there and done that w/this before but I'm exasperated and don't > know where to go from here. > Anyways, system details: > FreeBSD 5.4 and 6.0 > Tyan TA26 > 2 x Opteron 252 > 4 x 1GB DDR400 ECC Registered Ram > LSI 320-2x and LSI 320-1 > Fujitsu U320 SCSI drives, both 10K and 15K rpm > Problem: > Create an array, subject it to some moderate I/O and the logical drive > becomes "degraded" w/a "failed" drive. The logical drive cannot be > rebuilt. The physical drive is in fact fine, e.g. can format and > consistency check. Same problem if swap in a different drive, etc., > e.g.: Would this controller happen to be plugged into a riser card? Or is it plugged directly into the motherboard? We just returned a whole mess of LSI MegaRAID boards with similar issues (lose a drive on a regular basis, I/O drops down into the KB/s range, CPU spends 75%+ time in iowait state, controller not properly identified during install preventing any OS from being installed). On Tyan Thunder K8SD-Pro (S2882) motherboards. The 2U rackmount systems that used an approved Tyan riser card for the PCI-X slot had all the problems. The tower systerms that plugged the RAID controller directly into the PCI-X slot onthe motherboard have been working for months without issues. We tested FreeBSD 6.0, 6.1-beta1, and 6.1-beta2, Debian Linux stable (2.6.8 and 2.6.15 kernels), testing (2.6.11, 2.6.12, 2.6.13, 2.6.14 kernels), and unstable (2.6.14 and 2.6.15 kernels). With the included megaraid drivers and the custom drivers direct from LSI. The official word from LSI Support is: they do not support any RAID controllers connected to riser cards, no matter what the OS. Go that via e-mail from one of their support techs and one of their RAID engineers. > Does anybody have ideas and/or receommend anything that actually > works?!?! Switch to 3Ware and/or Areca cards. :) We replaced all the LSI MegaRAID cards in the 2U rackmounts with 3Ware Escalade 9550SX cards and have been chugging along nicely ever since (FreeBSD 6.1-beta2 i386 and amd64, and Debian Linux stable custom install with 2.6.15 kernel 64-bit). Besides, the management tools from LSI are pure crud compared to 3DM2. -- Freddie Cash fcash@ocis.net