From owner-freebsd-stable@FreeBSD.ORG Sat Oct 11 17:45:49 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 02D5C106568A; Sat, 11 Oct 2008 17:45:49 +0000 (UTC) (envelope-from mcdouga9@egr.msu.edu) Received: from mx.egr.msu.edu (surfnturf.egr.msu.edu [35.9.37.164]) by mx1.freebsd.org (Postfix) with ESMTP id B6B0C8FC22; Sat, 11 Oct 2008 17:45:48 +0000 (UTC) (envelope-from mcdouga9@egr.msu.edu) Received: from localhost (localhost [127.0.0.1]) by mx.egr.msu.edu (Postfix) with ESMTP id F197171FC14; Sat, 11 Oct 2008 13:45:47 -0400 (EDT) X-Virus-Scanned: amavisd-new at egr.msu.edu Received: from mx.egr.msu.edu ([127.0.0.1]) by localhost (surfnturf.egr.msu.edu [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Fqlpb0UPOoto; Sat, 11 Oct 2008 13:45:47 -0400 (EDT) Received: from [10.0.0.234] (c-208-53-102-126.chrlmi.cablespeed.com [208.53.102.126]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: mcdouga9) by mx.egr.msu.edu (Postfix) with ESMTPSA id AA78C71FC13; Sat, 11 Oct 2008 13:45:47 -0400 (EDT) Message-ID: <48F0E649.20808@egr.msu.edu> Date: Sat, 11 Oct 2008 13:45:45 -0400 From: Adam McDougall User-Agent: Thunderbird 2.0.0.17 (Windows/20080914) MIME-Version: 1.0 To: Jeremy Chadwick References: <200810101429.37244.joao@matik.com.br> <20081011113057.7402300c@ernst.jennejohn.org> <20081011101316.GA58119@icarus.home.lan> <20081011164529.198f32c6@ernst.jennejohn.org> <20081011144817.GB64861@icarus.home.lan> <48F0D3B5.6070602@egr.msu.edu> <20081011165250.GA67552@icarus.home.lan> In-Reply-To: <20081011165250.GA67552@icarus.home.lan> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-stable@freebsd.org, freebsd-amd64@freebsd.org Subject: Re: am2 MBs - 4g + SCSI wipes out root partition X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Oct 2008 17:45:49 -0000 Jeremy Chadwick wrote: > On Sat, Oct 11, 2008 at 12:26:29PM -0400, Adam McDougall wrote: >> Jeremy Chadwick wrote: >>> On Sat, Oct 11, 2008 at 04:45:29PM +0200, Gary Jennejohn wrote: >>>> On Sat, 11 Oct 2008 03:13:16 -0700 >>>> Jeremy Chadwick wrote: >>>> >>>>> On Sat, Oct 11, 2008 at 11:30:57AM +0200, Gary Jennejohn wrote: >>>>>> On Fri, 10 Oct 2008 14:29:37 -0300 >>>>>> JoaoBR wrote: >>>>>> >>>>>>> I tried MBs as Asus, Abit and Gigabyte all same result >>>>>>> >>>>>>> Same hardware with SATA works perfect >>>>>>> >>>>>>> Same hardware with scsi up to 3.5Gigs installed works perfect >>>>>>> >>>>>>> what calls my attention that all this MBs do not have the >>>>>>> memroy hole remapping feature so the complete 4gigs are >>>>>>> available what normally was not the case with amd64 Mbs for the >>>>>>> Athlon 64 CPUs >>>>>>> >>>>>>> some has an opinion if this is a freebsd issue or MB falure or >>>>>>> scsi drv problem? >>>>>>> >>>>>> It's a driver problem. If you want to use SCSI then you'll have to limit >>>>>> memory to 3.5 GB. >>>>> What you're saying is that Adaptec and LSI Logic SCSI controllers behave >>>>> badly (and can cause data loss) on amd64 systems which contain more than >>>>> 3.5GB of RAM. This is a very big claim. >>>>> >>>>> Have you talked to Scott Long about this? >>>>> >>>>> Please expand on this, and provide evidence or references. I need to >>>>> document this in my Wiki if it is indeed true. >>>>> >>>> See the freebsd-scsi thread with Subject "data corruption with ahc driver >>>> and 4GB of memory using a FBSD-8 64-bit installation?" from Wed, 30 Jan >>>> 2008. >>>> >>>> This was for ahc, but the bit-rot which Scott mentions in his reply might >>>> also apply to the LSI Logic controllers. >>>> >>>> Basically the driver doesn't correctly handle DMA above 4GB. Since the PCI >>>> hole gets mapped above 4GB it causes problems. the (S)ATA drivers don't seem >>>> to have this problem. >>> Thank you -- this is the exact information I was looking for. >>> >>> I will update my Wiki page to reflect this quite major problem. >>> >> I am using some LSI (mpt driver) ultra4 (U320 scsi) and LSI SAS >> controllers in FreeBSD 7.x amd64 with 20G of ram, and Adaptec (aac >> driver) with a 5th generation RAID card with 8G of ram, both have no >> such corruption problems. Providing this as a counter-example just to >> document some evidence of which products seem to work fine. > > Is your LSI SAS controller driven by mpt(4) or mfi(4)? > > Let's break down what we know for sure at this point: > > aac(4) - not affected > aha(4) - unknown > ahb(4) - unknown > ahc(4) - affected > ahd(4) - unknown; no one answered the OP's question in the thread > asr(4) - unknown > ips(4) - unknown > mpt(4) - not affected > mfi(4) - unknown > sym(4) - unknown > > Could the problem be specific to certain firmware revisions on the > cards? > > Also adding Scott Long to the CC list. > All the LSI I reported is driven by mpt, I have no mfi devices.