From owner-freebsd-scsi@FreeBSD.ORG Wed Sep 29 05:42:26 2004 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 48C4016A4CE for ; Wed, 29 Sep 2004 05:42:26 +0000 (GMT) Received: from forrie.com (forrie.ne.client2.attbi.com [24.147.45.106]) by mx1.FreeBSD.org (Postfix) with ESMTP id B0EDA43D53 for ; Wed, 29 Sep 2004 05:42:25 +0000 (GMT) (envelope-from forrie@forrie.com) Received: from [127.0.0.1] (i-99.forrie.net. [192.168.1.99]) by forrie.com with ESMTP id i8T5gHmV068440 for ; Wed, 29 Sep 2004 01:42:19 -0400 (EDT) (envelope-from forrie@forrie.com) Message-ID: <415A4BB3.3070107@forrie.com> Date: Wed, 29 Sep 2004 01:44:19 -0400 From: Forrest Aldrich User-Agent: Mozilla Thunderbird 0.8 (Windows/20040928) X-Accept-Language: en-us, en MIME-Version: 1.0 To: freebsd-scsi@freebsd.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-RAVMilter-Version: 8.3.0(snapshot 20010925) (forrie.ne.client2.attbi.com) X-MailScanner-LocalNet: Found to be clean Subject: Re: Status of iSCSI X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Sep 2004 05:42:26 -0000 [ John, *.east.verizon.net is a painful source of spam for me, so it's blocked here; sorry ] We've considered the NFS route, too; and it's been a while since I've used it. I forgot about mount limitations within NFS. There are some arguments against this scenario (internally) which I will have to further gather data upon. Another concern in the design is allocating the accounts in a balanced way across the various mount points. Delicate matter - since not every user is going to have the same email habits. I'd be curious of performance stats you may have experience with on this scenario. We could could also get a NAS-type device that isn't as high-end as Netapp (Snap Appliance?). Thanks! Forrest (Forrest - Had to post to list too as my mail also bounced back) Not sure if your budget can handle it, but if I where you.... I would stick with NFS over GigE network. But go with a very robust hardened NFS soluton, like a NetApp FAS960 Fileserver. Throughput is very good, SPOF is non-existent, the disk shelves are fiber channel so you can start with 0.5Tb and scale as high (30Tb) as you want on the fly (within nfs filesystem mount limits). A good NetApp system with 1/2 a terabyte will run you around $70,000 (last time I checked). Can be lower through refurb and/or second hand markets. There are cheaper alternatives but these are no where near the performance level of the NetApp units. -john On Sep 28, 2004, at 11:47 PM, Forrest Aldrich wrote: > [Scott, sorry about the bounced mail - it was an old IP block I had, > it's fixed now.] > > I'm working on a project that requires a scalable mail store, which is > poised to support 25k users initially, but scale to 100's of thousands > of users. > > The budget won't provide for a SAN right now; iSCSI is a little new, > but unfortunately it's not supported in FreeBSD at this time. > > I've been looking into the storage market areas specifically of Linux > and/vs FreeBSD. A Linux/NAS/iSCSI model and that of a > FreeBSD/NAS/NFS model -- not sure we want to do direct storage at this > time, if we did, we'd need to plan how that purchased hardware would > fit into a larger plan. > > NAS has the advantage of being independent; some have their own OS and > most have redundancies in place. I'm not sure if it's possible to > dual-attach Linux or FreeBSD boxes to a FC fabric; a while ago, that > wasn't possible. > > The front-end servers will be split up into scalable groups - ie: some > servers doing SpamAssassin, some antivirus, some MTA-in and MTA-out, > etc. > > The common denomenator, and driving factor of this design, is the > backend mail store. I'd like to explore what (realistic) options > FreeBSD may have here - as I dread the thought of Linux-anything in > this scenario. > > All input/feedback welcomed. > > > > Forrest > > > > > > There was an implementation done by Lucent last year for 4.x, but it > has > a sticky license and is probably out of date. I and several others see > iSCSI as something that really needs to get done, but the 3-4 months of > development time is more than can be done on evenings and weekends. I > would also want to do it 'right' and implement new infrastructure in > CAM > to accompany it rather than making it monolithic like the Lucent > implementation. > > What kind of project do you need it for, and what kind of resources do > you have right now? > > Scott > > > Forrest Aldrich wrote: > > I read the April 2004 report (on freebsd.org); presuming that's > > up-to-date, it may be a while before we have iSCSI support in > FreeBSD. > > I wanted to verify here, etc. > > > > I'm involved in a project that will require something of that nature. > > > > > > Thanks, > > Forrest > > > > > _______________________________________________ > freebsd-scsi@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-scsi > To unsubscribe, send any mail to "freebsd-scsi-unsubscribe@freebsd.org" > > John Von Essen (john@essenz.com) President, Essenz Consulting (www.essenz.com) Phone: (800) 248-1736 Fax: (800) 852-3387