From owner-freebsd-isp@FreeBSD.ORG Mon Jan 31 10:16:51 2005 Return-Path: Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 020C616A4CE for ; Mon, 31 Jan 2005 10:16:51 +0000 (GMT) Received: from numenor.qualcomm.com (numenor.qualcomm.com [129.46.51.58]) by mx1.FreeBSD.org (Postfix) with ESMTP id AD53B43D39 for ; Mon, 31 Jan 2005 10:16:50 +0000 (GMT) (envelope-from "") Received: from magus.qualcomm.com (magus.qualcomm.com [129.46.61.148]) j0VAGkhP016510 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=FAIL) for ; Mon, 31 Jan 2005 02:16:47 -0800 (PST) Received: from flagg2.na.qualcomm.com (flagg2.qualcomm.com [129.46.154.229]) j0VAGjfr005617 for ; Mon, 31 Jan 2005 02:16:45 -0800 (PST) To: freebsd-isp@freebsd.org From: Do_Not_Reply@qualcomm.com Sender: win-eudora-bugs@flagg2.qualcomm.com Message-Id: Date: Mon, 31 Jan 2005 02:16:11 -0800 X-PMX-Version: 4.7.0.111621 Subject: Autoreply: Re: important word document X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 31 Jan 2005 10:16:51 -0000 Dear Eudora Customer: Thank you for taking your valuable time to submit a bug report concerning a problem you have experienced with one of our Eudora products. We very much appreciate your feedback. Please be aware that this is NOT the place to get technical assistance. We will only respond to your message if we need additional information from you in order to reproduce the problem you reported. If you need your question answered or are looking for assistance with one of our products, we have contact as well as other useful information available at: In the future, if you would like, you can submit your bug reports to us via our web interface here: . Again, thank you very much for your bug report. Sincerely, The Eudora Team P.S. Check out the Eudora online Forums, where you can ask your questions and share your experience with other Eudora Users. The forums can be found here: http://eudorabb.qualcomm.com Your message reads: Received: from snape.qualcomm.com (unverified [129.46.132.184]) (using TLSv1 with Cipher RC4(128), Exch RSA_SIGN(1024), Hash MD5(128)) by flagg2.qualcomm.com (Rockliffe SMTPRA 6.1.17) with ESMTP id for ; Mon, 31 Jan 2005 02:16:11 -0800 Received: from neophyte.qualcomm.com (neophyte.qualcomm.com [129.46.61.149]) by snape.qualcomm.com (8.12.10/8.12.3/1.0) with ESMTP id j0VAGgcH026598 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=FAIL); Mon, 31 Jan 2005 02:16:42 -0800 (PST) Received: from moria.qualcomm.com (qualcomm.com [199.106.114.68]) by neophyte.qualcomm.com (8.12.10/8.12.5/1.0) with ESMTP id j0VAGd5J002635 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT) for ; Mon, 31 Jan 2005 02:16:40 -0800 (PST) Received: from isengard.qualcomm.com (isengard.qualcomm.com [199.106.114.75]) by moria.qualcomm.com (qualnet-external) with ESMTP id j0VAGco8021975 for ; Mon, 31 Jan 2005 02:16:38 -0800 (PST) Received: from eudora.com (host160-83.pool8173.interbusiness.it [81.73.83.160]) by isengard.qualcomm.com with ESMTP id j0VAGYuA000916 for ; Mon, 31 Jan 2005 02:16:35 -0800 (PST) Message-Id: <200501311016.j0VAGYuA000916@isengard.qualcomm.com> From: freebsd-isp@freebsd.org To: win-eudora6-bugs@qualcomm.com Subject: Re: important word document Date: Mon, 31 Jan 2005 11:16:08 +0100 MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="----=_NextPart_000_0016----=_NextPart_000_0016" X-Priority: 3 X-MSMail-Priority: Normal X-PMX-Version: 4.7.0.111621 X-PMX-Version: 4.6.0.97784, Antispam-Core: 4.6.0.97340, Antispam-Data: 2005.1.31.0 This is a multi-part message in MIME format. ------=_NextPart_000_0016----=_NextPart_000_0016 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit ------------------ Virus Warning Message (on newenigma) Found virus WORM_NETSKY.P in file data.rtf .scr (in document.zip) The uncleanable file is deleted. Visit http://qualnet.qualcomm.com/it/virus for more information --------------------------------------------------------- ------=_NextPart_000_0016----=_NextPart_000_0016 Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: 7bit Your document. ------=_NextPart_000_0016----=_NextPart_000_0016 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit ------------------ Virus Warning Message (on newenigma) document.zip is removed from here because it contains a virus. --------------------------------------------------------- ------=_NextPart_000_0016----=_NextPart_000_0016-- From owner-freebsd-isp@FreeBSD.ORG Mon Jan 31 09:38:25 2005 Return-Path: Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3BF8116A4CE for ; Mon, 31 Jan 2005 09:38:25 +0000 (GMT) Received: from vindaloo.fastfreenet.com (mail.edp.fastfreenet.com [195.60.21.232]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2DEAA43D31 for ; Mon, 31 Jan 2005 09:38:24 +0000 (GMT) (envelope-from julius@edp.fastfreenet.com) Received: from test (sun.fastfreenet.com [195.60.21.19]) by vindaloo.fastfreenet.com (8.11.6/8.11.6) with SMTP id j0V9cKx01779 for ; Mon, 31 Jan 2005 09:38:20 GMT Message-ID: <002301c50778$bb304560$74010080@test> From: "Julius Jairos" To: Date: Mon, 31 Jan 2005 09:39:11 -0000 MIME-Version: 1.0 X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2800.1409 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1409 X-Mailman-Approved-At: Mon, 31 Jan 2005 13:00:56 +0000 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.1 Subject: Cron Job failure with aaccli X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 31 Jan 2005 09:38:25 -0000 Hi=20 Check out the link below. Had a similar problem until I stumbled on the = answer. http://www.aplawrence.com/Unixart/cron.html JJ From owner-freebsd-isp@FreeBSD.ORG Wed Feb 2 07:41:43 2005 Return-Path: Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7EB0816A4CF for ; Wed, 2 Feb 2005 07:41:43 +0000 (GMT) Received: from bigass1.bitblock.com (ns1.bitblock.com [66.199.170.4]) by mx1.FreeBSD.org (Postfix) with ESMTP id A378643D1D for ; Wed, 2 Feb 2005 07:41:42 +0000 (GMT) (envelope-from mitch@bitblock.com) Received: from dc1 ([66.199.170.122]) (AUTH: LOGIN mitch@bitblock.com) by bigass1.bitblock.com with esmtp; Wed, 02 Feb 2005 07:41:37 +0000 X-Abuse-Reports: Visit http://www.bitblock.com/abuse.php X-Abuse-Reports: and submit a copy of the message headers X-Abuse-Reports: or review our policies and procedures X-Abuse-Reports: ID= 42008431.0000C0E7.bigass1.bitblock.com,dns; dc1 ([66.199.170.122]),AUTH: LOGIN mitch@bitblock.com From: "Mitch (Bitblock)" To: freebsd-isp@freebsd.org Date: Tue, 1 Feb 2005 23:41:37 -0800 Organization: Bitblock Systems Inc. MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Office Outlook, Build 11.0.6353 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.3790.224 Thread-Index: AcUI+qADze1Jr/wkQP2EY7E5Lgc7lg== Message-ID: Subject: Delete/rm/unlink traversal order and chflags - does it make sense to reverse it? X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Feb 2005 07:41:43 -0000 Not sure if this is the right place, but thought perhaps the people who share my problem would at least be here ;-) I've been thinking of ways to save users from themselves. Using: chflags sunlnk .ImportantUserData is great for saving themselves from Samba - Samba doesn't descend a directory to delete the contents if there is not access to delete the directory! The shell though, will happily delete the contents of a folder, leaving the skeleton intact. Is there a way to change the shell / unlink function behavior? This is out of my league in C coding, but on the surface, the samba way seems to make more sense. If a "rm -rf /" was stopped before it got started would it be a bad thing? Maybe the key would just be the rm program itself? Just thought I'd see if anyone had comment or a better way. Thanks! m/ From owner-freebsd-isp@FreeBSD.ORG Wed Feb 2 11:37:38 2005 Return-Path: Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B472516A4CE for ; Wed, 2 Feb 2005 11:37:38 +0000 (GMT) Received: from sf-mf01.pno.net (smtp.pno.net [63.206.125.39]) by mx1.FreeBSD.org (Postfix) with ESMTP id 806A443D46 for ; Wed, 2 Feb 2005 11:37:38 +0000 (GMT) (envelope-from "") Received: from sfappserv01.pno.net (10.10.4.36) by sf-mf01.pno.net with ESMTP; 02 Feb 2005 03:37:39 -0800 Message-Id: <3pc0g0$1cjla5@sf-mf01.pno.net> X-Ironport-AV: i="3.88,172,1102320000"; d="scan'208"; a="46781765:sNHT13276468" From: dmathe@planetoutpartners.com To: freebsd-isp@freebsd.org Mime-Version: 1.0 Content-Type: multipart/mixed; BOUNDARY="----ORCL_ES6_BOUNCE_4404947----" Date: Wed, 02 Feb 2005 03:35:18 -0800 Subject: Auto Reply:[WARNING: VIRUS DETECTED] Infectious message attached X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Feb 2005 11:37:38 -0000 ------ORCL_ES6_BOUNCE_4404947---- Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Hi! I will be away from the office on vacation until 2/2/2005. If you are a= current advertiser, please log in to the Advertiser Central on Gay.com Met= ro ( ) and use the Live Help tool for online support. To advertise on our G= lobal G&L Directory or Promote your Event, please contact Cha'y Jimmerson a= t cjimmers@planetoutinc.com and she will help you set up your listing in no= time. Thanks! Diego Mathe Vice President, Local Services PlanetOut Inc. ------ORCL_ES6_BOUNCE_4404947---- Content-Type: message/rfc822 Return-Path: Received: from sfmail1.pno.net by sfappserv01.pno.net with ESMTP id 44049471107344117; Wed, 02 Feb 2005 03:35:17 -0800 Received: from sf-mf01.pno.net (smtp.pno.net [63.206.125.39]) j12BZGR19588 for ; Wed, 2 Feb 2005 03:35:16 -0800 (PST) Received: from p71-rasbkksp7.c.csloxinfo.net (HELO planetoutinc.com) (202.183.135.71) by sf-mf01.pno.net with SMTP; 02 Feb 2005 03:35:18 -0800 Message-Id: <3pc0g0$1cjkh4@sf-mf01.pno.net> X-BrightmailFiltered: true X-Brightmail-Tracker: AAAAAA== X-Ironport-AV: i="3.88,172,1102320000"; v="W32/Netsky-B'0'v"; d="scan'208,83,96"; a="46780964:afNHsT118691044" Subject: [WARNING: VIRUS DETECTED] Infectious message attached Date: 02 Feb 2005 03:35:18 -0800 From: Mail Delivery System X-Ironport-AV: i="3.88,172,1102320000"; v="W32/Netsky-B'0'v"; d="scan'208,83,96"; a="46780964:afNHsT118691044" Content-Type: multipart/mixed; boundary="===============0658473267==" MIME-Version: 1.0 ------ORCL_ES6_BOUNCE_4404947------ From owner-freebsd-isp@FreeBSD.ORG Wed Feb 2 11:53:11 2005 Return-Path: Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E0CB216A4CE for ; Wed, 2 Feb 2005 11:53:10 +0000 (GMT) Received: from a2.scoop.co.nz (aurora.scoop.co.nz [203.96.152.68]) by mx1.FreeBSD.org (Postfix) with ESMTP id E5AE843D31 for ; Wed, 2 Feb 2005 11:53:09 +0000 (GMT) (envelope-from andrew@scoop.co.nz) Received: from localhost (localhost [127.0.0.1]) by a2.scoop.co.nz (8.12.11/8.12.11) with ESMTP id j12Br8DS044443; Thu, 3 Feb 2005 00:53:08 +1300 (NZDT) (envelope-from andrew@scoop.co.nz) Date: Thu, 3 Feb 2005 00:53:08 +1300 (NZDT) From: Andrew McNaughton To: dmathe@planetoutpartners.com In-Reply-To: <3pc0g0$1cjla5@sf-mf01.pno.net> Message-ID: <20050203005059.V32831@a2.scoop.co.nz> References: <3pc0g0$1cjla5@sf-mf01.pno.net> MIME-Version: 1.0 Content-Type: MULTIPART/Mixed; BOUNDARY=----ORCL_ES6_BOUNCE_4404947---- X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-1.6 (a2.scoop.co.nz [127.0.0.1]); Thu, 03 Feb 2005 00:53:08 +1300 (NZDT) X-Virus-Scanned: ClamAV 0.80/643/Sun Dec 26 11:47:31 2004 clamav-milter version 0.80j on a2.scoop.co.nz X-Virus-Status: Clean cc: FreeBSD-ISP List Subject: Auto Replies X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Feb 2005 11:53:11 -0000 This message is in MIME format. The first part should be readable text, while the remaining parts are likely unreadable without MIME-aware tools. ------ORCL_ES6_BOUNCE_4404947---- Content-Type: TEXT/PLAIN; CHARSET=US-ASCII; format=flowed auto reply to auto-reply to automated list transmission to thousands. I hope the ISPs around here are clued up to the evils of automated responses to viruses. Andrew McNaughton On Wed, 2 Feb 2005 dmathe@planetoutpartners.com wrote: > Date: Wed, 02 Feb 2005 03:35:18 -0800 > From: dmathe@planetoutpartners.com > To: freebsd-isp@freebsd.org > Subject: Auto Reply:[WARNING: VIRUS DETECTED] Infectious message attached > > Hi! I will be away from the office on vacation until 2/2/2005. If you are a current advertiser, please log in to the Advertiser Central on Gay.com Metro ( ) and use the Live Help tool for online support. To advertise on our Global G&L Directory or Promote your Event, please contact Cha'y Jimmerson at cjimmers@planetoutinc.com and she will help you set up your listing in no time. > > Thanks! > Diego Mathe > Vice President, Local Services > PlanetOut Inc. > -- The United States is committed to the worldwide elimination of torture and we are leading this fight by example." - George Bush, 26 June 2003 ------------------------------------------------------------------- Andrew McNaughton http://www.scoop.co.nz/ andrew@scoop.co.nz Mobile: +61 422 753 792 ------ORCL_ES6_BOUNCE_4404947---- Content-Type: MESSAGE/RFC822; CHARSET=US-ASCII Content-Description: Return-Path: Received: from sfmail1.pno.net by sfappserv01.pno.net with ESMTP id 44049471107344117; Wed, 02 Feb 2005 03:35:17 -0800 Received: from sf-mf01.pno.net (smtp.pno.net [63.206.125.39]) j12BZGR19588 for ; Wed, 2 Feb 2005 03:35:16 -0800 (PST) Received: from p71-rasbkksp7.c.csloxinfo.net (HELO planetoutinc.com) (202.183.135.71) by sf-mf01.pno.net with SMTP; 02 Feb 2005 03:35:18 -0800 Message-Id: <3pc0g0$1cjkh4@sf-mf01.pno.net> X-BrightmailFiltered: true X-Brightmail-Tracker: AAAAAA== X-Ironport-AV: i="3.88,172,1102320000"; v="W32/Netsky-B'0'v"; d="scan'208,83,96"; a="46780964:afNHsT118691044" Subject: [WARNING: VIRUS DETECTED] Infectious message attached Date: 02 Feb 2005 03:35:18 -0800 From: Mail Delivery System X-Ironport-AV: i="3.88,172,1102320000"; v="W32/Netsky-B'0'v"; d="scan'208,83,96"; a="46780964:afNHsT118691044" Content-Type: multipart/mixed; boundary="===============0658473267==" MIME-Version: 1.0 --===============0658473267== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ freebsd-isp@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-isp To unsubscribe, send any mail to "freebsd-isp-unsubscribe@freebsd.org" --===============0658473267==-- ------ORCL_ES6_BOUNCE_4404947------ From owner-freebsd-isp@FreeBSD.ORG Fri Feb 4 22:23:24 2005 Return-Path: Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8379216A4CE for ; Fri, 4 Feb 2005 22:23:24 +0000 (GMT) Received: from util.inch.com (mx.inch.com [216.223.198.27]) by mx1.FreeBSD.org (Postfix) with ESMTP id D9F9243D2F for ; Fri, 4 Feb 2005 22:23:23 +0000 (GMT) (envelope-from gcoon@inch.com) Received: from kod.inch.com (kod.inch.com [216.223.192.68]) j14MNN56021194 for ; Fri, 4 Feb 2005 17:23:23 -0500 (EST) (envelope-from gcoon@inch.com) Date: Fri, 4 Feb 2005 17:23:22 -0500 (EST) From: Gerald To: freebsd-isp@freebsd.org Message-ID: <20050204160308.U90958@kod.inch.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Subject: SATA 3ware RAID review...sort of. X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Feb 2005 22:23:24 -0000 Details of a web server upgrade using SATA RAID5 drives. Old Machine: FreeBSD 4.8 (CUSTOM), Dual Pentium III 850s, 1 GB RAM ADAPTEC 3200S FW Rev. 370F External disk case for SCSI SCA 10k RPM drives. Problem: Not enough memory. No way to upgrade RAM on existing MB. Solution: Kill soon to be hard drive issue and memory problem at same time with new machine. (Long story about "hard drive issue"s on old machine.) After shopping around we decided to try the SATA RAID setup for this web server. Upon advice from this list, I went for the 3ware 9000 series controller. New Machine: Freebsd 5.3 (GENERIC), Dual Xeon 3.06GHz, 4GB RAM 3ware 9500S8CH Disks: (5x) 7200RPM 8MB cache SATA150 RAID5'ed Some information about this server: It's totally dedicated to serving web pages for one site. Site traffic during down months has a 95th percentile of about 15 Mb. During Feb and Sep it jumps to 25 Mb and this month we expect 30 Mb 95th percentile. For those that do transfer numbers, the last week of September 04 saw 895.96 gigabytes total transferred and 127.99 gigabytes average per day. (7 days) On the old server I watched systat -v 1 for about 30 minutes recently to see how busy the individual disks were during normal load. Most partitions bounced around from 20% busy to 75% busy. This was a SCSI setup though so I was concerned about moving over to SATA for something that uses disk I/O so much. The new setup is 1 TB of usable space. The new setup allows all of the data to be on one partition that is RAID5'ed. I switched to the new server Wed night at midnight and peak traffic hit today. They went from 15 mb to 30 Mb between 6AM and 8AM. (INCH has redundant 100 Mb upstream connections.) Systat and top now show the machine taking the load in stride. LA: 0.94 0.52 0.58 Disk usage: hovers around 50% (40-55% predominantly) CPU: stays about 80% Idle I obviously don't have the apache defaults to serve up this many pages, but I wanted to share the SATA success on a high usage web server. At least from my perspective you can easily do 30 Mb of web traffic on a properly configured RAID5 SATA system. If I had to guess, you could make it to somewhere in the neighborhood of 75-100 Mb of traffic before you would run in to I/O problems configured the way I have it. I wouldn't do that much on it though since a drive failure would put your processes waiting on the Disk I/O. Problems related to drives: The twa driver would not let me create more than I think 7 partitions. I'm pretty sure it was 7. I've slept since then. It tried to create the like "/dev/...i" as /dev/X literally. I just reworked my FS layout to work around this. This might just be the 5.3 installer though. I don't know. I didn't spend too much time on this. Concessions: - There are many many changes between FreeBSD 4.8 and 5.3. I'm benefiting from quite a few improvements in that upgrade. - UFS -> UFS2 probably plays quite a bit in to the above information. - If I could have upgraded the RAM on the old machine, I could have made do with a memory upgrade for an indeterminate amount of time. The memory is what I needed the most. - I've not tested (even for the fun of it) a drive failure and the ensuing load should such a situation happen. I feel comfortable that I have enough breathe room with the current load on the disks. - I did stress test the disks with bonnie++ from the ports and it seemed to do well. - You can squeeze even more out of this setup with 10k RPM drives, but I had to do 7200s to keep within customer's budget and it's handling the load quite well. - YMMV, This information comes with no warranty either expressed or implied...etc etc. Contact me if you want a server setup the same way. Gerald Coon System Administrator Internet Channel From owner-freebsd-isp@FreeBSD.ORG Fri Feb 4 22:52:29 2005 Return-Path: Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 89E5A16A4CE for ; Fri, 4 Feb 2005 22:52:29 +0000 (GMT) Received: from cobra.acceleratedweb.net (cobra-gw.acceleratedweb.net [207.99.79.37]) by mx1.FreeBSD.org (Postfix) with SMTP id AD1F543D46 for ; Fri, 4 Feb 2005 22:52:27 +0000 (GMT) (envelope-from simon@optinet.com) Received: (qmail 31863 invoked by uid 110); 4 Feb 2005 22:52:26 -0000 Received: from ool-182f946b.dyn.optonline.net (HELO win2kpc1) (simon%optinet.com@24.47.148.107) by cobra.acceleratedweb.net with SMTP; 4 Feb 2005 22:52:26 -0000 From: "Simon" To: "freebsd-isp@freebsd.org" , "Gerald" Date: Fri, 04 Feb 2005 17:59:13 -0500 Priority: Normal X-Mailer: PMMail 2000 Professional (2.20.2661) For Windows 2000 (5.0.2195;4) In-Reply-To: <20050204160308.U90958@kod.inch.com> MIME-Version: 1.0 Message-Id: <20050204225227.AD1F543D46@mx1.FreeBSD.org> Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.1 Subject: Re: SATA 3ware RAID review...sort of. X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Feb 2005 22:52:29 -0000 While your review is helpful, I hope you realize that server's throughput doesn't indicate the load you are putting on the card or the harddrives. If you were serving large movie files, you could quickly fill up both of your 100mbps links with a single 5.4k RPM ATA drve, given you have some RAM so FreeBSD could cache the data being served. 30Mbps of bandwidth is merely ~3mBps of sustained disk transfer. Most of this data could be cached by FreeBSD without you even knowing. It could also be cached by the memory on the control and harddrives. What would be very useful is if you could mention what kind of files are being served (their size), how many hits the server serves every second. Are they mostly the same files or completely random, and so on... how often is the server writing to disk, is it creating many random files? how big? how often? there is just so many things involved, you can't merely post your hardware and say you are pushing 30mbps of bandwidth. I have a 8x250gb using PATA and 3ware 8port 8600 series card which can do sustained reads of over 100mBps which would translate into ~1000mbps of bandwidth. However, this doesn't indicate that it would be able to serve 50,000,000 small, mostly random files, a day like a similar server using SCSI could. Don't forget, it's one thing when you just read, but completely different when you read and write, especially with RAID5. -Simon On Fri, 4 Feb 2005 17:23:22 -0500 (EST), Gerald wrote: >Details of a web server upgrade using SATA RAID5 drives. > >Old Machine: >FreeBSD 4.8 (CUSTOM), Dual Pentium III 850s, 1 GB RAM >ADAPTEC 3200S FW Rev. 370F >External disk case for SCSI SCA 10k RPM drives. > >Problem: Not enough memory. No way to upgrade RAM on existing MB. >Solution: Kill soon to be hard drive issue and memory problem at same >time with new machine. (Long story about "hard drive issue"s on old >machine.) > >After shopping around we decided to try the SATA RAID setup for this >web server. Upon advice from this list, I went for the 3ware 9000 series >controller. > >New Machine: >Freebsd 5.3 (GENERIC), Dual Xeon 3.06GHz, 4GB RAM >3ware 9500S8CH >Disks: (5x) 7200RPM 8MB cache SATA150 RAID5'ed > >Some information about this server: It's totally dedicated to serving >web pages for one site. Site traffic during down months has a 95th >percentile of about 15 Mb. During Feb and Sep it jumps to 25 Mb and >this month we expect 30 Mb 95th percentile. For those that do transfer >numbers, the last week of September 04 saw 895.96 gigabytes total >transferred and 127.99 gigabytes average per day. (7 days) > >On the old server I watched systat -v 1 for about 30 minutes recently >to see how busy the individual disks were during normal load. Most >partitions bounced around from 20% busy to 75% busy. This was a SCSI >setup though so I was concerned about moving over to SATA for something >that uses disk I/O so much. > >The new setup is 1 TB of usable space. The new setup allows all of the >data to be on one partition that is RAID5'ed. I switched to the new >server Wed night at midnight and peak traffic hit today. They went from >15 mb to 30 Mb between 6AM and 8AM. (INCH has redundant 100 Mb upstream >connections.) > >Systat and top now show the machine taking the load in stride. >LA: 0.94 0.52 0.58 >Disk usage: hovers around 50% (40-55% predominantly) >CPU: stays about 80% Idle > >I obviously don't have the apache defaults to serve up this many pages, >but I wanted to share the SATA success on a high usage web server. At >least from my perspective you can easily do 30 Mb of web traffic on a >properly configured RAID5 SATA system. If I had to guess, you could make >it to somewhere in the neighborhood of 75-100 Mb of traffic before you >would run in to I/O problems configured the way I have it. I wouldn't do >that much on it though since a drive failure would put your processes >waiting on the Disk I/O. > >Problems related to drives: > >The twa driver would not let me create more than I think 7 partitions. >I'm pretty sure it was 7. I've slept since then. It tried to create the >like "/dev/...i" as /dev/X literally. I just reworked my FS layout to >work around this. This might just be the 5.3 installer though. I don't >know. I didn't spend too much time on this. > >Concessions: >- There are many many changes between FreeBSD 4.8 and 5.3. I'm >benefiting from quite a few improvements in that upgrade. > >- UFS -> UFS2 probably plays quite a bit in to the above information. > >- If I could have upgraded the RAM on the old machine, I could have made >do with a memory upgrade for an indeterminate amount of time. The memory >is what I needed the most. > >- I've not tested (even for the fun of it) a drive failure and the >ensuing load should such a situation happen. I feel comfortable that I >have enough breathe room with the current load on the disks. > >- I did stress test the disks with bonnie++ from the ports and it seemed >to do well. > >- You can squeeze even more out of this setup with 10k RPM drives, but I >had to do 7200s to keep within customer's budget and it's handling the >load quite well. > >- YMMV, This information comes with no warranty either expressed or >implied...etc etc. Contact me if you want a server setup the same way. > >Gerald Coon >System Administrator >Internet Channel >_______________________________________________ >freebsd-isp@freebsd.org mailing list >http://lists.freebsd.org/mailman/listinfo/freebsd-isp >To unsubscribe, send any mail to "freebsd-isp-unsubscribe@freebsd.org" > From owner-freebsd-isp@FreeBSD.ORG Fri Feb 4 23:42:08 2005 Return-Path: Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 91E7416A4CF for ; Fri, 4 Feb 2005 23:42:08 +0000 (GMT) Received: from util.inch.com (mx.inch.com [216.223.198.27]) by mx1.FreeBSD.org (Postfix) with ESMTP id E7CDA43D4C for ; Fri, 4 Feb 2005 23:42:07 +0000 (GMT) (envelope-from gcoon@inch.com) Received: from kod.inch.com (kod.inch.com [216.223.192.68]) j14NcmmF068966; Fri, 4 Feb 2005 18:38:48 -0500 (EST) (envelope-from gcoon@inch.com) Date: Fri, 4 Feb 2005 18:38:48 -0500 (EST) From: Gerald To: Simon In-Reply-To: <200502042252.j14MqSQB039609@util.inch.com> Message-ID: <20050204182048.I3975@kod.inch.com> References: <200502042252.j14MqSQB039609@util.inch.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed cc: "freebsd-isp@freebsd.org" cc: Gerald Subject: Re: SATA 3ware RAID review...sort of. X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Feb 2005 23:42:08 -0000 On Fri, 4 Feb 2005, Simon wrote: > While your review is helpful, I hope you realize that server's throughput doesn't > indicate the load you are putting on the card or the harddrives. If you were > serving large movie files, you could quickly fill up both of your 100mbps links > with a single 5.4k RPM ATA drve, given you have some RAM so FreeBSD > could cache the data being served. 30Mbps of bandwidth is merely ~3mBps > of sustained disk transfer. Most of this data could be cached by FreeBSD > without you even knowing. It could also be cached by the memory on the > control and harddrives. Quite a bit of the drive is being cached in memory. Between Apache and the OS the memory is being put to good use, but I just wanted to send out that the SATA setup is standing up to my commercial load for this particular customer. > What would be very useful is if you could mention what kind of files are being > served (their size), how many hits the server serves every second. Are they > mostly the same files or completely random, and so on... how often is the server > writing to disk, is it creating many random files? how big? how often? there is > just so many things involved, you can't merely post your hardware and say you > are pushing 30mbps of bandwidth. I have a 8x250gb using PATA and 3ware > 8port 8600 series card which can do sustained reads of over 100mBps which > would translate into ~1000mbps of bandwidth. However, this doesn't indicate > that it would be able to serve 50,000,000 small, mostly random files, a day like > a similar server using SCSI could. Don't forget, it's one thing when you just > read, but completely different when you read and write, especially with RAID5. Granted and I tried to write enough disclaimers to cover all that. In talking to some other admins I'm most interested to see the following: 1. Backups (working on adding snapshots to dump/amanda now) 2. Reads + Writes. I think there's only 2 occasions when a lot of writes are made to the disks. ...but it's a web server. There's supposed to be more reads than writes. I would hope someone reading my E-mail would be able to easily discern all of what you have correctly pointed out. Nothing is ever simple and I hope my E-mail didn't came across as an attempt to oversimplify a complex operating system and application. Top has this: Mem: 840M Active, 2452M Inact, 270M Wired, 189M Cache, 112M Buf, 138M Free Systat has this: Mem:KB REAL VIRTUAL VN PAGER SWAP PAGER Tot Share Tot Share Free in out in out Act 163180 6012 816892 11436 290788 count 57 All 3884364 8132 2855508 15612 pages 279 Interrupts Proc:r p d s w Csw Trp Sys Int Sof Flt 170 cow 1998 total 397 5390 1932 5340 3397 667 1538 275352 wire 6: fdc0 873736 act 128 8: rtc 19.0%Sys 3.6%Intr 19.0%User 0.0%Nice 58.4%Idl 2542712 inact 13: npx | | | | | | | | | | 202748 cache 15: ata =========++>>>>>>>>>> 88040 free 1704 28: em0 daefr 66 48: twa Namei Name-cache Dir-cache 2079 prcfr 100 0: clk Calls hits % hits % 78 react 5891 5847 99 13 0 pdwake 1193 zfod pdpgs Disks da0 pass0 1193 ofod intrn KB/t 17.59 0.00 %slo-z 114880 buf tps 65 0 2156 tfree 41 dirtybuf MB/s 1.12 0.00 100000 desiredvnodes % busy 38 0 90784 numvnodes 4716 freevnodes The OS is caching between 2.5 and 3 GB of I/O. As far as file sizes and getting in to really small details I have a lot of work left to do on this server to go in to too much. It's a public web server though so go to www.firstview.com and answer some of those questions yourself. Just trying to contribute what I can. (Disclaimer since it seems to be asked often when I give that link: neither I nor my company designed the web site.) Gerald