From owner-freebsd-isp Sun Dec 8 20:54:30 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 368C837B401 for ; Sun, 8 Dec 2002 20:54:29 -0800 (PST) Received: from ns3.unixmexico.net (ns3.unixmexico.net [64.141.69.184]) by mx1.FreeBSD.org (Postfix) with SMTP id 9C6D343ED1 for ; Sun, 8 Dec 2002 20:54:28 -0800 (PST) (envelope-from nbari@unixmexico.com) Received: (qmail 49322 invoked by uid 85); 9 Dec 2002 04:55:54 -0000 Received: from nbari@unixmexico.com by ns3.unixmexico.net by uid 82 with qmail-scanner-1.15 (hbedv: 6.16.0.0/6.16.0.17. Clear:. Processed in 0.200717 secs); 09 Dec 2002 04:55:54 -0000 Received: from unknown (HELO unixmexico.com) (127.0.0.1) by localhost.unixmexico.net with SMTP; 9 Dec 2002 04:55:54 -0000 Received: from 148.243.211.1 (SquirrelMail authenticated user nbari@unixmexico.com) by mail.unixmexico.com with HTTP; Sun, 8 Dec 2002 22:55:54 -0600 (CST) Message-ID: <26647.148.243.211.1.1039409754.squirrel@mail.unixmexico.com> Date: Sun, 8 Dec 2002 22:55:54 -0600 (CST) Subject: tail -f on webpage From: To: , X-Priority: 3 Importance: Normal X-Mailer: SquirrelMail (version 1.2.9) MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Hi all How can i make a tail -f and show the results in a web page with out having to reload the page every N seconds i am using PHP in a script like: but i have to relaod the page to view new results. any ideas ? thanks. To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Sun Dec 8 21:27:18 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6119C37B401; Sun, 8 Dec 2002 21:27:17 -0800 (PST) Received: from midway.uchicago.edu (midway.uchicago.edu [128.135.12.12]) by mx1.FreeBSD.org (Postfix) with ESMTP id B424943EBE; Sun, 8 Dec 2002 21:27:16 -0800 (PST) (envelope-from dsyphers@uchicago.edu) Received: from Yggdrasil (adsl-68-20-22-119.dsl.chcgil.ameritech.net [68.20.22.119]) by midway.uchicago.edu (8.12.5/8.12.5) with ESMTP id gB95R5MU010035; Sun, 8 Dec 2002 23:27:05 -0600 (CST) Content-Type: text/plain; charset="iso-8859-1" From: David Syphers Reply-To: dsyphers@uchicago.edu To: Subject: Re: tail -f on webpage Date: Sun, 8 Dec 2002 23:27:05 -0600 User-Agent: KMail/1.4.3 References: <26647.148.243.211.1.1039409754.squirrel@mail.unixmexico.com> In-Reply-To: <26647.148.243.211.1.1039409754.squirrel@mail.unixmexico.com> Cc: , MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Message-Id: <200212082327.05038.dsyphers@uchicago.edu> Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Sunday 08 December 2002 10:55 pm, nbari@unixmexico.com wrote: > Hi all > > How can i make a tail -f and show the results in a web page with > out having to reload the page every N seconds > > i am using PHP in a script like: > > $error_log = '/var/log/apache/log'; > passthru ("tail -f $error_log"); > ?> > > but i have to relaod the page to view new results. First of all, this is off-topic for any FreeBSD list. They're cc'd only to let them know someone has told you this. I would suggest trying a PHP list, but... ... you can't do this with PHP. You're viewing a (pure HTML) page generated by PHP, and for anything to change on it, the page needs to be regenerated, e.g. reloaded. -David -- On the whole I am against mass murder. I rarely commit it myself, and often find myself quite out of sympathy with those who make a habit of it. -Bernard Levin Astronomy and Astrophysics Center The University of Chicago To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Sun Dec 8 21:45:32 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8C2DE37B401; Sun, 8 Dec 2002 21:45:31 -0800 (PST) Received: from dan.emsphone.com (dan.emsphone.com [199.67.51.101]) by mx1.FreeBSD.org (Postfix) with ESMTP id EDADD43EC5; Sun, 8 Dec 2002 21:45:30 -0800 (PST) (envelope-from dan@dan.emsphone.com) Received: (from dan@localhost) by dan.emsphone.com (8.12.6/8.12.6) id gB95jM9m097981; Sun, 8 Dec 2002 23:45:22 -0600 (CST) (envelope-from dan) Date: Sun, 8 Dec 2002 23:45:22 -0600 From: Dan Nelson To: nbari@unixmexico.com Cc: freebsd-isp@FreeBSD.ORG, hackers@FreeBSD.ORG Subject: Re: tail -f on webpage Message-ID: <20021209054521.GB20704@dan.emsphone.com> References: <26647.148.243.211.1.1039409754.squirrel@mail.unixmexico.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <26647.148.243.211.1.1039409754.squirrel@mail.unixmexico.com> X-OS: FreeBSD 5.0-RC X-message-flag: Outlook Error User-Agent: Mutt/1.5.1i Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org In the last episode (Dec 08), nbari@unixmexico.com said: > Hi all > > How can i make a tail -f and show the results in a web page with > out having to reload the page every N seconds > > i am using PHP in a script like: > > $error_log = '/var/log/apache/log'; > passthru ("tail -f $error_log"); > ?> The following 3-line CGI works fine: #! /bin/sh printf "Content-type: text/plain\r\n\r\n" tail -f /var/log/messages If you want a PHP solution, try a php mailinglist. -- Dan Nelson dnelson@allantgroup.com To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Mon Dec 9 4: 0:44 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 1272A37B401 for ; Mon, 9 Dec 2002 04:00:42 -0800 (PST) Received: from ns1.via-net-works.net.ar (ns1.via-net-works.net.ar [200.10.100.10]) by mx1.FreeBSD.org (Postfix) with ESMTP id 3FB3E43EA9 for ; Mon, 9 Dec 2002 04:00:40 -0800 (PST) (envelope-from hnunez@vianetworks.com.ar) Received: from pchnunez (pc-hnunez.vianetworks.com.ar [200.10.101.5] (may be forged)) by ns1.via-net-works.net.ar (8.12.6/8.12.6) with SMTP id gB9C0GDV058972 for ; Mon, 9 Dec 2002 09:00:17 -0300 (ART) (envelope-from hnunez@vianetworks.com.ar) From: Hernan Nunez Message-ID: <009301c29f7a$a08d3370$92660ac8@ms.vianetworks.net.ar> Reply-To: To: References: <3DF29239.1080800@tacni.com> Subject: Re: FP 2002 cookbook? Date: Mon, 9 Dec 2002 09:00:53 -0300 MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2800.1106 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1106 Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Try this site http://www.rtr.com/fpsupport/ ----- Original Message ----- From: "Tom ONeil" To: "Free" Sent: Saturday, December 07, 2002 9:28 PM Subject: FP 2002 cookbook? > I thought I saw asomeone post a FP 2002 extensions cookbook here and I > had saved it. > > Any clues would be useful (besides "don't" ) > > > To Unsubscribe: send mail to majordomo@FreeBSD.org > with "unsubscribe freebsd-isp" in the body of the message > To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Mon Dec 9 7:30:13 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5653937B401 for ; Mon, 9 Dec 2002 07:30:12 -0800 (PST) Received: from glow.dt1.slik.org (glow.binity.net [213.84.201.224]) by mx1.FreeBSD.org (Postfix) with ESMTP id 438A143EBE for ; Mon, 9 Dec 2002 07:30:10 -0800 (PST) (envelope-from freebsd+20021209@walter.slik.org) Received: from silver.dt1.slik.org (silver.dt1.slik.org [172.24.7.10]) by glow.dt1.slik.org (Postfix) with ESMTP id DF8E7AAF1 for ; Mon, 9 Dec 2002 16:30:43 +0100 (CET) Date: Mon, 9 Dec 2002 16:30:11 +0100 From: Walter Hop X-Mailer: The Bat! (v1.61) Educational X-Priority: 3 (Normal) Message-ID: <3487689390.20021209163011@slik.org> To: FreeBSD ISP Subject: Loaded mysql box: best hardware? MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-15 Content-Transfer-Encoding: 8bit Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Hi all, I currently maintain a fairly loaded FreeBSD box (dual P3/866), running a busy MySQL 3.23 database with its Apache/PHP web interface. It has SCSI disks and enough RAM to keep the whole MySQL database paged in, and the bottleneck is now really the CPU's. The scripts are fairly optimized (use their own caching) so I am now looking at hardware. The machine itself is keeping up nicely for now (loads from 1 to 4), but system usage will probably double, so I have to make a plan now for the increased load next year. My question is: given that I now have a dual 866MHz box, is there any performance to be gained from upgrading to, for instance, a faster dual system? What setup is generally preferred for loaded database boxes? Last month I read a doc that argues that MySQL is not able to profit from an SMP setup using the FreeBSD 4.x userland threads - saved it here: http://www.skydancer.nl/dl/etc/20021119.freebsd.mysql.problems.mht - Considering this, would an expensive dual box still be worth the money, or would it be more effective to switch to a single-CPU system with the fastest clock instead? I want to prepare for when the machine REALLY gets abused, and I'd like input from people who have experience in this field, anything will help. :) What choice did you make for your high-end database servers? (If absolutely necessary I would consider installing another OS on the server if it would use the hardware more effectively, but seeing that FreeBSD 5.x is at the horizon, I'd rather throw money at the problem than spend the time on switching to L*n*x or S*l*r*s/x86...) Thanks in advance for your input 8) walter -- Walter Hop | +31 6 2445 2020 | http://www.skydancer.nl/ To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Mon Dec 9 9: 0:28 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 651AD37B401 for ; Mon, 9 Dec 2002 09:00:26 -0800 (PST) Received: from cobra.acceleratedweb.net (cobra-gw.acceleratedweb.net [207.99.79.37]) by mx1.FreeBSD.org (Postfix) with SMTP id 79B0443EEA for ; Mon, 9 Dec 2002 09:00:25 -0800 (PST) (envelope-from simon@optinet.com) Received: (qmail 37173 invoked by uid 106); 9 Dec 2002 17:04:40 -0000 Received: from 24-90-121-13.nyc.rr.com (HELO station1) (24.90.121.13) by cobra.acceleratedweb.net with SMTP; 9 Dec 2002 17:04:40 -0000 From: "Simon" To: "FreeBSD ISP" , "Walter Hop" Date: Mon, 09 Dec 2002 12:01:58 -0500 Reply-To: "Simon" X-Mailer: PMMail 2000 Professional (2.10.2010) For Windows 2000 (5.0.2195;2) In-Reply-To: <3487689390.20021209163011@slik.org> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Subject: Re: Loaded mysql box: best hardware? Message-Id: <20021209170025.79B0443EEA@mx1.FreeBSD.org> Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org If I were you, I would upgrade to dual Xeon 2.4-8Ghz board and get RAID if you don't already have one. While you may think MySQL will cache everything in RAM, it still has to read and write to the drives. Check your HD IO to make sure it's not causing any bottleneck. Also, while dual setup may not benefit MySQL right now, when FBSD 5.x comes out, it should greatly. When you use top, mysqld uses most CPU? or do your PHP scripts? how many queries a sec are you doing? Also, you can try optimizing your queries. Finally, make sure you always keep persistent connection to mysqld. -Simon On Mon, 9 Dec 2002 16:30:11 +0100, Walter Hop wrote: >Hi all, > >I currently maintain a fairly loaded FreeBSD box (dual P3/866), running= a >busy MySQL 3.23 database with its Apache/PHP web interface. It has SCSI= >disks and enough RAM to keep the whole MySQL database paged in, and the= >bottleneck is now really the CPU's. The scripts are fairly optimized (u= se >their own caching) so I am now looking at hardware. The machine itself = is >keeping up nicely for now (loads from 1 to 4), but system usage will >probably double, so I have to make a plan now for the increased load ne= xt >year. > >My question is: given that I now have a dual 866MHz box, is there any >performance to be gained from upgrading to, for instance, a faster dual= >system? What setup is generally preferred for loaded database boxes? > >Last month I read a doc that argues that MySQL is not able to profit fr= om >an SMP setup using the FreeBSD 4.x userland threads - saved it here: >http://www.skydancer.nl/dl/etc/20021119.freebsd.mysql.problems.mht - >Considering this, would an expensive dual box still be worth the money,= or >would it be more effective to switch to a single-CPU system with the >fastest clock instead? > >I want to prepare for when the machine REALLY gets abused, and I'd like= >input from people who have experience in this field, anything will help= . :) >What choice did you make for your high-end database servers? > >(If absolutely necessary I would consider installing another OS on the >server if it would use the hardware more effectively, but seeing that >FreeBSD 5.x is at the horizon, I'd rather throw money at the problem th= an >spend the time on switching to L*n*x or S*l*r*s/x86...) > >Thanks in advance for your input 8) >walter > >-- > Walter Hop | +31 6 2445 2020 | http://www.skydancer.nl/ > > >To Unsubscribe: send mail to majordomo@FreeBSD.org >with "unsubscribe freebsd-isp" in the body of the message > To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Mon Dec 9 13: 7:57 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 482D837B401 for ; Mon, 9 Dec 2002 13:07:56 -0800 (PST) Received: from mx3.irl.cri.nz (mx3.irl.cri.nz [131.203.18.3]) by mx1.FreeBSD.org (Postfix) with ESMTP id E91F643F32 for ; Mon, 9 Dec 2002 13:07:53 -0800 (PST) (envelope-from c.bates@comnet.co.nz) Received: from orbital.comnet.co.nz (orbital.comnet.co.nz [131.203.10.11]) by mx3.irl.cri.nz (8.12.6/8.12.6) with ESMTP id gB9L83Tk025907 for ; Tue, 10 Dec 2002 10:08:04 +1300 (NZDT) Content-Type: text/plain; charset="us-ascii" From: Craig Bates Organization: ComNet To: freebsd-isp@freebsd.org Subject: Sendmail, MailScanner, file descriptors Date: Tue, 10 Dec 2002 10:05:39 +1300 User-Agent: KMail/1.4.3 MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Message-Id: <200212101005.39510.c.bates@comnet.co.nz> X-MailScanner: Found to be clean X-MailScanner-SpamCheck: not spam (whitelisted), SpamAssassin (score=-2.9, required 5, AWL, NOSPAM_INC, SPAM_PHRASE_00_01, USER_AGENT, USER_AGENT_KMAIL) Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Hi, I'm running two sendmail processes, MailScanner, RAZOR, Spam Assassin on = a MX=20 box, running FreeBSD 4.7. /var/log/maillog has the following entry: Dec 10 08:37:06 mx3 sendmail[25140]: File descriptors missing on startup:= =20 stdin, stdout, stderr; Bad file descriptor MailScanner is also randomly dying. The two problems seem to be one and = the=20 same. I put the following in /etc/sysctl.conf: kern.maxfiles=3D65536 # System-wide limit kern.maxfilesperproc=3D32768 # Per-process limit and ulimit -n 32768 in my sendmail and MailScanner startup scripts. I th= en=20 rebooted the box and all seemed ok. 5-6 hours later the problem is back.= So=20 it look like the file descriptors are being used up? Note that this does= not=20 happen on every email, but often enough. lsof does not show anything=20 suspicious. I've looked high and low over the web, but found no definite answer to th= is=20 problem. Thanks, Craig To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Tue Dec 10 3:22:41 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3132C37B401 for ; Tue, 10 Dec 2002 03:22:40 -0800 (PST) Received: from pop3.psconsult.nl (ps226.psconsult.nl [193.67.147.226]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9B20D43E4A for ; Tue, 10 Dec 2002 03:22:35 -0800 (PST) (envelope-from paul@pop3.psconsult.nl) Received: (from paul@localhost) by pop3.psconsult.nl (8.9.2/8.9.2) id MAA42471; Tue, 10 Dec 2002 12:22:30 +0100 (CET) (envelope-from paul) Date: Tue, 10 Dec 2002 12:22:29 +0100 From: Paul Schenkeveld To: Walter Hop Cc: FreeBSD ISP Subject: Re: Loaded mysql box: best hardware? Message-ID: <20021210122229.A42380@psconsult.nl> References: <3487689390.20021209163011@slik.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Mailer: Mutt 1.0i In-Reply-To: <3487689390.20021209163011@slik.org>; from freebsd+20021209@walter.slik.org on Mon, Dec 09, 2002 at 04:30:11PM +0100 Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Mon, Dec 09, 2002 at 04:30:11PM +0100, Walter Hop wrote: > Hi all, > > I currently maintain a fairly loaded FreeBSD box (dual P3/866), running a > busy MySQL 3.23 database with its Apache/PHP web interface. It has SCSI > disks and enough RAM to keep the whole MySQL database paged in, and the > bottleneck is now really the CPU's. The scripts are fairly optimized (use > their own caching) so I am now looking at hardware. The machine itself is > keeping up nicely for now (loads from 1 to 4), but system usage will > probably double, so I have to make a plan now for the increased load next > year. > > My question is: given that I now have a dual 866MHz box, is there any > performance to be gained from upgrading to, for instance, a faster dual > system? What setup is generally preferred for loaded database boxes? > > Last month I read a doc that argues that MySQL is not able to profit from > an SMP setup using the FreeBSD 4.x userland threads - saved it here: > http://www.skydancer.nl/dl/etc/20021119.freebsd.mysql.problems.mht - > Considering this, would an expensive dual box still be worth the money, or > would it be more effective to switch to a single-CPU system with the > fastest clock instead? Even if MySQL doesn't benefit from a second CPU, the second CPU will pick up other processes (httpd for example) leaving more cycles to mysqld on its 'own' processor. Also, think about things you as a sysadmin do from the shell, with only one CPU, the commands you type will compete for that single CPU with mysqld so if you like to have reasonable interactive response you'll be happy to have dual CPUs. > I want to prepare for when the machine REALLY gets abused, and I'd like > input from people who have experience in this field, anything will help. :) > What choice did you make for your high-end database servers? > > (If absolutely necessary I would consider installing another OS on the > server if it would use the hardware more effectively, but seeing that > FreeBSD 5.x is at the horizon, I'd rather throw money at the problem than > spend the time on switching to L*n*x or S*l*r*s/x86...) My $0.02 -- Paul Schenkeveld, Consultant PSconsult ICT Services BV To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Tue Dec 10 4:15:15 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 020C537B401 for ; Tue, 10 Dec 2002 04:15:14 -0800 (PST) Received: from relay.kiev.sovam.com (relay.kiev.sovam.com [212.109.32.5]) by mx1.FreeBSD.org (Postfix) with ESMTP id DCEA743EBE for ; Tue, 10 Dec 2002 04:15:10 -0800 (PST) (envelope-from dimitry@al.org.ua) Received: from [212.109.32.116] (helo=dimitry.kiev.sovam.com) by relay.kiev.sovam.com with esmtp (Exim 3.34 #1) id 18LjHt-000Fv3-00; Tue, 10 Dec 2002 14:14:57 +0200 Content-Type: text/plain; charset="us-ascii" From: Dmitry Alyabyev Reply-To: dimitry@al.org.ua To: Paul Schenkeveld Subject: Re: Loaded mysql box: best hardware? Date: Tue, 10 Dec 2002 14:14:56 +0200 User-Agent: KMail/1.4.3 Cc: FreeBSD ISP References: <3487689390.20021209163011@slik.org> <20021210122229.A42380@psconsult.nl> In-Reply-To: <20021210122229.A42380@psconsult.nl> X-NCC-RegID: ua.svitonline MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Message-Id: <200212101414.56930.dimitry@al.org.ua> Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Tuesday 10 December 2002 13:22, Paul Schenkeveld wrote: > On Mon, Dec 09, 2002 at 04:30:11PM +0100, Walter Hop wrote: > > Last month I read a doc that argues that MySQL is not able to profit from > > an SMP setup using the FreeBSD 4.x userland threads - saved it here: > > http://www.skydancer.nl/dl/etc/20021119.freebsd.mysql.problems.mht - > > Considering this, would an expensive dual box still be worth the money, > > or would it be more effective to switch to a single-CPU system with the > > fastest clock instead? > > Even if MySQL doesn't benefit from a second CPU, the second CPU will > pick up other processes (httpd for example) leaving more cycles to > mysqld on its 'own' processor. Also, think about things you as a > sysadmin do from the shell, with only one CPU, the commands you type > will compete for that single CPU with mysqld so if you like to have > reasonable interactive response you'll be happy to have dual CPUs. not very reasonable way to have dedicated CPU for this stuff, yes ? > > I want to prepare for when the machine REALLY gets abused, and I'd like > > input from people who have experience in this field, anything will help. > > :) What choice did you make for your high-end database servers? > > > > (If absolutely necessary I would consider installing another OS on the > > server if it would use the hardware more effectively, but seeing that > > FreeBSD 5.x is at the horizon, I'd rather throw money at the problem than > > spend the time on switching to L*n*x or S*l*r*s/x86...) i'm worried if FreeBSD 5 will dramatically improve this situation and let me and lots of ppl around move from linux/solaris to fbsd on database servers. -- Dimitry To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Tue Dec 10 4:34:30 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 1594037B401 for ; Tue, 10 Dec 2002 04:34:30 -0800 (PST) Received: from mail.arc.net.my (nagano.arc.net.my [203.115.225.22]) by mx1.FreeBSD.org (Postfix) with ESMTP id DA6EF43ED8 for ; Tue, 10 Dec 2002 04:34:28 -0800 (PST) (envelope-from nick@arc.net.my) Received: from roponggi (roppongi.arc.net.my [203.115.225.83]) by mail.arc.net.my (iPlanet Messaging Server 5.1 Patch 1 (built Jun 6 2002)) with SMTP id <0H6W00JPQLLAPF@mail.arc.net.my> for freebsd-isp@FreeBSD.org; Tue, 10 Dec 2002 20:34:22 +0800 (SGT) Date: Tue, 10 Dec 2002 20:20:01 +0800 From: Nick Kraal Subject: OTT: SMTP settings on FreeBSD To: freebsd-isp@FreeBSD.org Reply-To: Nick Kraal Message-id: <018a01c2a046$76b4a3e0$53e173cb@arc.net.my> MIME-version: 1.0 X-MIMEOLE: Produced By Microsoft MimeOLE V6.00.2800.1106 X-Mailer: Microsoft Outlook Express 6.00.2800.1106 Content-type: text/plain; charset=iso-8859-1 Content-transfer-encoding: 7BIT X-Priority: 3 X-MSMail-priority: Normal References: <3DD1FEF4.F727D6@FreeBSD.org> Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Perhaps slightly OTT. I would like to send mail out from my FreeBSD box via an external SMTP server and if possible retrieve mail via POP3. For whatever reason I don't want to use the local inbuilt sendmail. Any ideas or pointers? Thanks in advance. -nick/ To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Tue Dec 10 6:43:19 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 606B637B401 for ; Tue, 10 Dec 2002 06:43:18 -0800 (PST) Received: from gabriel.day-light.net (118-203.bestdsl.net [216.162.118.203]) by mx1.FreeBSD.org (Postfix) with ESMTP id A803E43EC5 for ; Tue, 10 Dec 2002 06:43:17 -0800 (PST) (envelope-from john@day-light.com) Received: from w1 (unknown [10.1.5.201]) by gabriel.day-light.net (Postfix) with SMTP id 4C7FD5198C; Tue, 10 Dec 2002 08:43:06 -0600 (CST) Reply-To: From: "John Brooks" To: "'Nick Kraal'" , Subject: RE: SMTP settings on FreeBSD Date: Tue, 10 Dec 2002 08:44:00 -0600 Message-ID: <000f01c2a05a$94350a40$c905010a@daylight.net> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit X-Priority: 3 (Normal) X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook CWS, Build 9.0.2416 (9.0.2911.0) Importance: Normal In-Reply-To: <018a01c2a046$76b4a3e0$53e173cb@arc.net.my> X-MIMEOLE: Produced By Microsoft MimeOLE V5.00.2615.200 Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org for SMTP: install postfix from ports, in the 'main.cf' file set "relayhost = external.smtp.xxx" retrieving POP3 'to' the FreeBSD box: setup will depend upon your email client retrieving POP3 'from' the FreeBSD box: setup will depend upon the POP3 server you use, ports collection has a bunch of them -- John Brooks john@stlbsd.org > -----Original Message----- > From: owner-freebsd-isp@FreeBSD.ORG > [mailto:owner-freebsd-isp@FreeBSD.ORG]On Behalf Of Nick Kraal > Sent: Tuesday, December 10, 2002 6:20 AM > To: freebsd-isp@FreeBSD.org > Subject: OTT: SMTP settings on FreeBSD > > > Perhaps slightly OTT. I would like to send mail out from my > FreeBSD box via > an external SMTP server and if possible retrieve mail via > POP3. For whatever > reason I don't want to use the local inbuilt sendmail. > > Any ideas or pointers? > > Thanks in advance. > > -nick/ > > > To Unsubscribe: send mail to majordomo@FreeBSD.org > with "unsubscribe freebsd-isp" in the body of the message > To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Tue Dec 10 8:23:28 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B37DD37B401 for ; Tue, 10 Dec 2002 08:23:27 -0800 (PST) Received: from ns.yogotech.com (ns.yogotech.com [206.127.123.66]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7FFBB43EB2 for ; Tue, 10 Dec 2002 08:23:24 -0800 (PST) (envelope-from nate@yogotech.com) Received: from emerger.yogotech.com (emerger.yogotech.com [206.127.123.131]) by ns.yogotech.com (8.9.3/8.9.3) with ESMTP id JAA20435; Tue, 10 Dec 2002 09:23:12 -0700 (MST) (envelope-from nate@yogotech.com) Received: (from nate@localhost) by emerger.yogotech.com (8.12.6/8.12.6) id gBAGN7HP003272; Tue, 10 Dec 2002 09:23:07 -0700 (MST) (envelope-from nate) From: Nate Williams MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-ID: <15862.5355.202128.207106@emerger.yogotech.com> Date: Tue, 10 Dec 2002 09:23:07 -0700 To: Nick Kraal Cc: freebsd-isp@FreeBSD.ORG Subject: Re: OTT: SMTP settings on FreeBSD In-Reply-To: <018a01c2a046$76b4a3e0$53e173cb@arc.net.my> References: <3DD1FEF4.F727D6@FreeBSD.org> <018a01c2a046$76b4a3e0$53e173cb@arc.net.my> X-Mailer: VM 7.07 under 21.1 (patch 14) "Cuyahoga Valley" XEmacs Lucid Reply-To: nate@yogotech.com (Nate Williams) Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org > Perhaps slightly OTT. I would like to send mail out from my FreeBSD box via > an external SMTP server and if possible retrieve mail via POP3. For whatever > reason I don't want to use the local inbuilt sendmail. It works fine. This is how I setup my mail server on my box, which allows me to use better mail filtering tools (using fetchmail which delivers things locally so I can use procmail), while still leaving the box safe from external hacking. You must do a couple of things. * Add a SMART_HOST entry to your sendmail MC file. define(`SMART_HOST', `smarthost.do.main') * Make sure that your host has an MX record for your box that points to the SMART host with DNS, so that mail will be delivered to it instead of your box. * (optional) Depending on your configuration, you may also need to add an mail alias to your box for 'SMART_HOST'. I have both my internal and external boxes masquarade as my entire domain, so it all works right, but you may have to mess with /etc/mail/sendmail.cw. Nate To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Tue Dec 10 11:13:21 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8131A37B401; Tue, 10 Dec 2002 11:13:20 -0800 (PST) Received: from dan.emsphone.com (dan.emsphone.com [199.67.51.101]) by mx1.FreeBSD.org (Postfix) with ESMTP id F336743EB2; Tue, 10 Dec 2002 11:13:19 -0800 (PST) (envelope-from dan@dan.emsphone.com) Received: (from dan@localhost) by dan.emsphone.com (8.12.6/8.12.6) id gBAJDCdI033631; Tue, 10 Dec 2002 13:13:13 -0600 (CST) (envelope-from dan) Date: Tue, 10 Dec 2002 13:13:12 -0600 From: Dan Nelson To: George Georgalis Cc: nbari@unixmexico.com, freebsd-isp@FreeBSD.ORG, hackers@FreeBSD.ORG Subject: Re: tail -f on webpage Message-ID: <20021210191312.GG48182@dan.emsphone.com> References: <26647.148.243.211.1.1039409754.squirrel@mail.unixmexico.com> <20021209054521.GB20704@dan.emsphone.com> <20021210185212.GC23550@trot.local> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20021210185212.GC23550@trot.local> X-OS: FreeBSD 5.0-RC X-message-flag: Outlook Error User-Agent: Mutt/1.5.1i Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org In the last episode (Dec 10), George Georgalis said: > On Sun, Dec 08, 2002 at 11:45:22PM -0600, Dan Nelson wrote: > > #! /bin/sh > > printf "Content-type: text/plain\r\n\r\n" > > tail -f /var/log/messages > > > > Unfortunatly if you try that your webserver will quickly fail because > the connection never closes. If your customers can create cgi scripts > they can bring down your server too. > > How fast depends on httpd.conf MaxSpareServers, and how quickly you > hit reload. The connection does close, but it looks like tail does not correctly exit: kevent(0x4,0x0,0x0,0xbfbff410,0x1,0x0) = 1 (0x1) read(0x3,0x804d000,0x2000) = 90 (0x5a) read(0x3,0x804d000,0x2000) = 0 (0x0) write(1,0x804f000,90) ERR#32 'Broken pipe' kevent(0x4,0x0,0x0,0xbfbff410,0x1,0x0) = 1 (0x1) read(0x3,0x804d000,0x2000) = 85 (0x55) read(0x3,0x804d000,0x2000) = 0 (0x0) write(1,0x804f000,85) ERR#32 'Broken pipe' kevent(0x4,0x0,0x0,0xbfbff410,0x1,0x0) = 1 (0x1) read(0x3,0x804d000,0x2000) = 34 (0x22) read(0x3,0x804d000,0x2000) = 0 (0x0) write(1,0x804f000,34) ERR#32 'Broken pipe' Not sure why though. The error-checking code in tail looks fine. -- Dan Nelson dnelson@allantgroup.com To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Tue Dec 10 15:16:51 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B73E337B404 for ; Tue, 10 Dec 2002 15:16:50 -0800 (PST) Received: from glow.dt1.slik.org (glow.binity.net [213.84.201.224]) by mx1.FreeBSD.org (Postfix) with ESMTP id 92F5C43EC2 for ; Tue, 10 Dec 2002 15:16:49 -0800 (PST) (envelope-from freebsd+20021211@walter.slik.org) Received: from silver.dt1.slik.org (silver.dt1.slik.org [172.24.7.10]) by glow.dt1.slik.org (Postfix) with ESMTP id EBBF3AAF1 for ; Wed, 11 Dec 2002 00:17:17 +0100 (CET) Date: Wed, 11 Dec 2002 00:16:38 +0100 From: Walter Hop X-Mailer: The Bat! (v1.61) Educational X-Priority: 3 (Normal) Message-ID: <80202079344.20021211001638@slik.org> To: FreeBSD ISP Subject: Re[2]: Loaded mysql box: best hardware? In-Reply-To: <20021210122229.A42380@psconsult.nl> References: <3487689390.20021209163011@slik.org> <20021210122229.A42380@psconsult.nl> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-15 Content-Transfer-Encoding: 8bit Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org [in reply to fb-isp@psconsult.nl, 10-12-2002] > Even if MySQL doesn't benefit from a second CPU, the second CPU will > pick up other processes (httpd for example) leaving more cycles to > mysqld on its 'own' processor. Also, think about things you as a > sysadmin do from the shell, with only one CPU, the commands you type > will compete for that single CPU with mysqld so if you like to have > reasonable interactive response you'll be happy to have dual CPUs. That is true, but at Xeon prices that's hardly worth spending all that money for, where in this setup a Linux machine would benefit from far more MySQL power. To stay safe I will probably install Linux on it for now and switch back to FreeBSD 5.x when the optimizations have sank in a bit and the new code has received some testing. There is great work going on now, and as I convert Linux machines to FreeBSD all the time for a living ;) the switch back will probably be no problem at all and it would give a good opportunity to get some experience with tuning myself. I've also received the suggestion of trying MySQL 4 which has many improvements for tables with a large number of updates. I'll check that out as well. Thanks for the help everybody! -- Walter Hop | +31 6 2445 2020 | http://www.skydancer.nl/ To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Tue Dec 10 15:33: 2 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 2912D37B401 for ; Tue, 10 Dec 2002 15:33:02 -0800 (PST) Received: from mx6.mail.ru (mx6.mail.ru [194.67.57.16]) by mx1.FreeBSD.org (Postfix) with ESMTP id 238E943EB2 for ; Tue, 10 Dec 2002 15:33:01 -0800 (PST) (envelope-from 1alia@mail.ru) Received: from [212.248.7.25] (helo=1alia) by mx6.mail.ru with smtp (Exim SMTP.6) id 18Lspf-0000Aj-00 for freebsd-isp@freebsd.org; Wed, 11 Dec 2002 01:26:27 +0300 From: 1alia <1alia@mail.ru> To: freebsd-isp@freebsd.org Subject: Работа для Вас X-Mailer: Microsoft Outlook Express 5.00.2615.200 Reply-To: alia@mail.ru Date: Wed, 11 Dec 2002 01:26:23 +0300 Mime-Version: 1.0 Content-Type: text/plain; charset=Windows-1251 Message-Id: Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Здравствуйте! Работа в сети для Вас http://www.getjob.boom.ru Извините за беспокойство. To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Tue Dec 10 15:46:54 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4965837B401 for ; Tue, 10 Dec 2002 15:46:53 -0800 (PST) Received: from hotmail.com (oe70.pav1.hotmail.com [64.4.30.205]) by mx1.FreeBSD.org (Postfix) with ESMTP id 09E3243EB2 for ; Tue, 10 Dec 2002 15:46:53 -0800 (PST) (envelope-from jack_xiao99@hotmail.com) Received: from mail pickup service by hotmail.com with Microsoft SMTPSVC; Tue, 10 Dec 2002 15:46:52 -0800 X-Originating-IP: [66.185.85.77] From: "Jack Xiao" To: Subject: mppp questions Date: Tue, 10 Dec 2002 18:46:54 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2720.3000 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2600.0000 Message-ID: X-OriginalArrivalTime: 10 Dec 2002 23:46:52.0842 (UTC) FILETIME=[6A4FB8A0:01C2A0A6] Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Hi, I am using ppp to setup an MPPP link for one customer with FreeBSD 4.5 Release. I also enabled NATd on this box for the internal Windows clients to access Internet instead of using ppp nat. Everything works well excpet that I can't go to one https website. I have thought it's MTU issue, but it still doesn't work after trying a bunch of different MTU values on tun0 interface. By the way, the initial MTU value is 1524, it's got from the negotiation between this box and ISP server, I think. Does anybody experience similar caeses? Any help will be greatly appreciated. Thanks. Jack To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Tue Dec 10 21:55:28 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D563B37B401 for ; Tue, 10 Dec 2002 21:55:26 -0800 (PST) Received: from dynamic.galis.org (ool-4350143e.dyn.optonline.net [67.80.20.62]) by mx1.FreeBSD.org (Postfix) with SMTP id BC78A43ED1 for ; Tue, 10 Dec 2002 21:55:25 -0800 (PST) (envelope-from quack@galis.org) Received: (qmail 24046 invoked by uid 1010); 10 Dec 2002 18:52:12 -0000 Date: Tue, 10 Dec 2002 13:52:12 -0500 From: George Georgalis To: Dan Nelson Cc: nbari@unixmexico.com, freebsd-isp@FreeBSD.ORG, hackers@FreeBSD.ORG Subject: Re: tail -f on webpage Message-ID: <20021210185212.GC23550@trot.local> References: <26647.148.243.211.1.1039409754.squirrel@mail.unixmexico.com> <20021209054521.GB20704@dan.emsphone.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20021209054521.GB20704@dan.emsphone.com> User-Agent: Mutt/1.3.28i Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Sun, Dec 08, 2002 at 11:45:22PM -0600, Dan Nelson wrote: >In the last episode (Dec 08), nbari@unixmexico.com said: >> Hi all >> >> How can i make a tail -f and show the results in a web page with >> out having to reload the page every N seconds >> >> i am using PHP in a script like: >> >> > $error_log = '/var/log/apache/log'; >> passthru ("tail -f $error_log"); >> ?> > >The following 3-line CGI works fine: > >#! /bin/sh >printf "Content-type: text/plain\r\n\r\n" >tail -f /var/log/messages > Unfortunatly if you try that your webserver will quickly fail because the connection never closes. If your customers can create cgi scripts they can bring down your server too. How fast depends on httpd.conf MaxSpareServers, and how quickly you hit reload. // George -- GEORGE GEORGALIS, System Admin/Architect cell: 347-451-8229 Security Services, Web, Mail, mailto:george@galis.org Multimedia, DB, DNS and Metrics. http://www.galis.org/george To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Wed Dec 11 18:50:59 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7EC2237B401 for ; Wed, 11 Dec 2002 18:50:58 -0800 (PST) Received: from zephir.primus.ca (mail.tor.primus.ca [216.254.136.21]) by mx1.FreeBSD.org (Postfix) with ESMTP id 75BA443EE6 for ; Wed, 11 Dec 2002 18:50:54 -0800 (PST) (envelope-from leth@primus.ca) Received: from dialin-155-91.tor.primus.ca ([216.254.155.91]) by boreas1.primus.ca with esmtp (Exim 3.36 #3) id 18LmT1-0002KR-0A; Tue, 10 Dec 2002 10:38:39 -0500 Date: Tue, 10 Dec 2002 10:38:50 -0500 (EST) From: Jason Hunt X-X-Sender: leth@lethargic.dyndns.org To: Nick Kraal Cc: freebsd-isp@FreeBSD.ORG Subject: Re: OTT: SMTP settings on FreeBSD In-Reply-To: <018a01c2a046$76b4a3e0$53e173cb@arc.net.my> Message-ID: <20021210095413.P6497-100000@lethargic.dyndns.org> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Tue, 10 Dec 2002, Nick Kraal wrote: > Perhaps slightly OTT. I would like to send mail out from my FreeBSD box via > an external SMTP server and if possible retrieve mail via POP3. For whatever > reason I don't want to use the local inbuilt sendmail. > > Any ideas or pointers? > Firstly, and sorrying for trolling, but unless you are running a mail server, I personally think you might as well just use sendmail on a workstation. I'm not going to start yet another debate over MTAs, but that is my opinion. If you put 'sendmail_enable="NO"' in your /etc/rc.conf, sendmail will not accept mail from anyone other than localhost. If you're really paranoid because you think sendmail is some kind of big bad evil program and is a risk to your system just because of a bad track record in the 1990's, even though it now runs as a non-privileged user, install a different MTA :) Chapter 20.4 of the handbook can help you with this. Better yet, block incoming port 25 connections. However, most people will likely agree that simply setting sendmail_enable="NO" should suffice. Anyways, as for suggestions, I have my MUA (which is pine) configured to send outgoing mail directly to my ISPs SMTP server, instead of giving it to the local sendmail program. It was easier to tell pine which SMTP server to use, rather than giving all my mail to sendmail and configuring it to forward all outgoing mail to the ISPs SMTP server. I then configured fetchmail to download all my mail from my ISPs POP3 server. I created a .fetchmailrc in my home directory, and then configured a crontab to run fetchmail every 15 mins. You can tell fetchmail to either pass the messages to sendmail or to put them into your mail spool directly. I put them through sendmail so that I can use procmail for sorting. Hope this helps. To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Wed Dec 11 19: 4:17 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id C007A37B401 for ; Wed, 11 Dec 2002 19:04:16 -0800 (PST) Received: from mandala-designs.com (rinpoche.mandala-designs.com [216.237.97.131]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2D23A43EC5 for ; Wed, 11 Dec 2002 19:04:14 -0800 (PST) (envelope-from ljacobs@mail.mandala-designs.com) Received: from dharma.mandala-designs.com [66.30.178.8] by mandala-designs.com with ESMTP (SMTPD32-7.13) id ACA26AC051E; Wed, 11 Dec 2002 22:04:02 -0500 From: "Leonard Jacobs" To: freebsd-isp@FreeBSD.ORG Date: Wed, 11 Dec 2002 22:07:16 -0500 MIME-Version: 1.0 Subject: the mail server debate Reply-To: lj@mandala-designs.com Message-ID: <3DF7B714.14133.4FDB185@localhost> X-mailer: Pegasus Mail for Windows (v4.02) Content-type: text/plain; charset=US-ASCII Content-transfer-encoding: 7BIT Content-description: Mail message body Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Are there any benchmarks comparing the various MTAs on FreeBSD? How do people make their coices? Is it fair to say the comparisons are between: Sendmail, Qmail, Postfix and Courier? For 3 - 5,000 (or more) users, requiring POP3 & IMAP & web messaging, what have people found to be their favorite and most reliable MTA? Thanks. ------------------ Leonard Jacobs www.mandala-designs.com (508) 359-5753 --- [This E-mail scanned for viruses by Declude Virus] To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Wed Dec 11 20: 4: 9 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0A18237B401 for ; Wed, 11 Dec 2002 20:04:08 -0800 (PST) Received: from mtiwmhc12.worldnet.att.net (mtiwmhc12.worldnet.att.net [204.127.131.116]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6216E43E4A for ; Wed, 11 Dec 2002 20:04:07 -0800 (PST) (envelope-from cswiger@mac.com) Received: from prime ([12.88.93.216]) by mtiwmhc12.worldnet.att.net (InterMail vM.5.01.05.12 201-253-122-126-112-20020820) with SMTP id <20021212040406.OFJU20575.mtiwmhc12.worldnet.att.net@prime> for ; Thu, 12 Dec 2002 04:04:06 +0000 Message-ID: <00bb01c2a193$83e1e840$0301a8c0@prime> From: "Charles Swiger" To: References: <3DF7B714.14133.4FDB185@localhost> Subject: Re: the mail server debate Date: Wed, 11 Dec 2002 23:03:46 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2800.1106 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1106 Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Leonard Jacobs wrote: > Are there any benchmarks comparing the various MTAs on FreeBSD? Plenty. How meaningful they are is another question. Anyway, for many common circumstances, the system is bottlenecked by I/O bandwidth to the disks or via the network to remote clients, and not by the MTA software being used. > How do people make their c[h]oices? My observation has been that most people pay a lot of attention to their personal preferences. Whether an individual also pays attention to facts which might contradict one's opinion is somewhat less common. Use something that suits your requirements. > Is it fair to say the comparisons are between: Sendmail, Qmail, Postfix and Courier? Sure, if those are the ones you want to consider. For me, I've never heard or Courier....so my definition of "fair" would be different. Have you heard of zmail, smail, smtpd, or even a product called Communigate Pro? [ The latter might provide an integrated solution along the lines you've been asking about and decent tech support, which might be closer to what you want. No connection, but some people I've worked with had liked their product. ] > For 3 - 5,000 (or more) users, requiring POP3 & IMAP & web messaging, > what have people found to be their favorite and most reliable MTA? I've been running sendmail for ~14 years, with up to 22,000 users in one case; but someone else can undoubtedly say the same for the other programs. For instance, I had a conversation about the utility of multiple queue runners and so forth (now in sendmail-8.12) who was using postfix to do around 3 million messages a day...but he didn't want or need some of the features that sendmail provides. Something like UWash IMAP or AMS-2/Cyrus + MailMan + squirrelmail would probably be my route for the non-MTA aspect of your question. If you want to be proactive about security, make sure to link with SSL to provide STARTTLS and secure versions of the IMAP/POP3 protocols. Perhaps you should also consider your backup situation, hardware details like amount of disk storage and system capacity growth you plan for, getting hot-swappable SCSI or fibre-channel disks, things like that.... -Chuck To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Thu Dec 12 4:20:55 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7E0C537B401 for ; Thu, 12 Dec 2002 04:20:54 -0800 (PST) Received: from marklar.blazingdot.com (marklar.blazingdot.com [207.154.84.83]) by mx1.FreeBSD.org (Postfix) with SMTP id 1662D43EA9 for ; Thu, 12 Dec 2002 04:20:54 -0800 (PST) (envelope-from marcus@blazingdot.com) Received: (qmail 48796 invoked by uid 503); 12 Dec 2002 12:20:45 -0000 Date: Thu, 12 Dec 2002 04:20:45 -0800 From: Marcus Reid To: Leonard Jacobs Cc: freebsd-isp@FreeBSD.ORG Subject: Re: the mail server debate Message-ID: <20021212122045.GA48456@blazingdot.com> References: <3DF7B714.14133.4FDB185@localhost> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <3DF7B714.14133.4FDB185@localhost> User-Agent: Mutt/1.4i Coffee-Level: high Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Wed, Dec 11, 2002 at 10:07:16PM -0500, Leonard Jacobs wrote: > Are there any benchmarks comparing the various MTAs on FreeBSD? How > do people make their coices? Is it fair to say the comparisons are between: > Sendmail, Qmail, Postfix and Courier? The main religious war is between qmail and Postfix. Whether they can handle the load of 5,000 average users is not a question. Both have high emphasis on security and reliability. Postfix changes more often and has more emphasis on the feature-of-the-week. But then again, Postfix changes more often and has more emphasis on the feature-of-the-week. Both are quite capable. It comes down to a matter of personal taste, and I recommend that you play with both, though I'd venture that you might have to spend a good deal of time with either system to really understand why people like it so much. Marcus > > For 3 - 5,000 (or more) users, requiring POP3 & IMAP & web messaging, > what have people found to be their favorite and most reliable MTA? > > Thanks. To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Thu Dec 12 4:29:42 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 25B3E37B401 for ; Thu, 12 Dec 2002 04:29:41 -0800 (PST) Received: from relay.kiev.sovam.com (relay.kiev.sovam.com [212.109.32.5]) by mx1.FreeBSD.org (Postfix) with ESMTP id E027443EB2 for ; Thu, 12 Dec 2002 04:29:39 -0800 (PST) (envelope-from dimitry@al.org.ua) Received: from [212.109.32.116] (helo=dimitry.kiev.sovam.com) by relay.kiev.sovam.com with esmtp (Exim 3.34 #1) id 18MST7-000AIg-00 for freebsd-isp@FreeBSD.ORG; Thu, 12 Dec 2002 14:29:33 +0200 Content-Type: text/plain; charset="us-ascii" From: Dmitry Alyabyev Reply-To: dimitry@al.org.ua To: freebsd-isp@FreeBSD.ORG Subject: Re: the mail server debate Date: Thu, 12 Dec 2002 14:29:32 +0200 User-Agent: KMail/1.4.3 References: <3DF7B714.14133.4FDB185@localhost> <20021212122045.GA48456@blazingdot.com> In-Reply-To: <20021212122045.GA48456@blazingdot.com> X-NCC-RegID: ua.svitonline MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Message-Id: <200212121429.32807.dimitry@al.org.ua> Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Thursday 12 December 2002 14:20, Marcus Reid wrote: > On Wed, Dec 11, 2002 at 10:07:16PM -0500, Leonard Jacobs wrote: > > Are there any benchmarks comparing the various MTAs on FreeBSD? How > > do people make their coices? Is it fair to say the comparisons are > > between: Sendmail, Qmail, Postfix and Courier? > > The main religious war is between qmail and Postfix. Whether they can > handle the load of 5,000 average users is not a question. Both have high > emphasis on security and reliability. Postfix changes more often and has > more emphasis on the feature-of-the-week. But then again, Postfix changes > more often and has more emphasis on the feature-of-the-week. Both are > quite capable. It comes down to a matter of personal taste, and I recommend > that you play with both, though I'd venture that you might have to spend > a good deal of time with either system to really understand why people like > it so much. guys, why you do not mind Exim ? -- Dimitry To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Thu Dec 12 6:12:51 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 83FD537B401 for ; Thu, 12 Dec 2002 06:12:49 -0800 (PST) Received: from psknet.com (voyager.psknet.com [63.171.251.15]) by mx1.FreeBSD.org (Postfix) with SMTP id 6A9EA43ED1 for ; Thu, 12 Dec 2002 06:12:48 -0800 (PST) (envelope-from troy@psknet.com) Received: (qmail 79945 invoked by uid 85); 12 Dec 2002 14:12:37 -0000 Received: from troy@psknet.com by voyager.psknet.com with qmail-scanner-1.02 (uvscan: v4.1.40/v4100. . Clean. Processed in 0.495603 secs); 12 Dec 2002 14:12:37 -0000 Received: from rad-va-20-pc-178.cablenet-va.com (HELO abyss) (24.197.20.178) by voyager.psknet.com with SMTP; 12 Dec 2002 14:12:36 -0000 From: "Troy Settle" To: , Subject: RE: the mail server debate Date: Thu, 12 Dec 2002 09:12:40 -0500 Message-ID: <001201c2a1e8$887e5320$b214c518@abyss> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Priority: 3 (Normal) X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook, Build 10.0.2616 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1106 Importance: Normal In-Reply-To: <3DF7B714.14133.4FDB185@localhost> Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org I've been using Qmail/Vpopmail/Courier-IMAP/Squirrelmail for nearly 2 years now, and find that it's a very good set of tools to work with. Combined with qmail-scanner and a patch to reject unknown users, you've got a great email solution. I've used postfix in the past, and was quite pleased with it, but found that Qmail was a better solution for me (though I intend to check back into Postix again some day). I've heard great things about Exim, but have no personal experience with it. As I understand it, it's speed and security are on par with Qmail and Postfix, and it's feature set just might blow both of them away (think embedded perl). -- Troy Settle Pulaski Networks http://www.psknet.com 540.994.4254 ~ 866.477.5638 Pulaski Chamber 2002 Small Business Of The Year > -----Original Message----- > From: owner-freebsd-isp@FreeBSD.ORG > [mailto:owner-freebsd-isp@FreeBSD.ORG] On Behalf Of Leonard Jacobs > Sent: Wednesday, December 11, 2002 10:07 PM > To: freebsd-isp@FreeBSD.ORG > Subject: the mail server debate > > > Are there any benchmarks comparing the various MTAs on FreeBSD? How > do people make their coices? Is it fair to say the > comparisons are between: > Sendmail, Qmail, Postfix and Courier? > > For 3 - 5,000 (or more) users, requiring POP3 & IMAP & web messaging, > what have people found to be their favorite and most reliable MTA? > > Thanks. > > > ------------------ > > Leonard Jacobs > www.mandala-designs.com > (508) 359-5753 > > > --- > [This E-mail scanned for viruses by Declude Virus] > > > To Unsubscribe: send mail to majordomo@FreeBSD.org > with "unsubscribe freebsd-isp" in the body of the message > > To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Thu Dec 12 6:33:17 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id EE76F37B401 for ; Thu, 12 Dec 2002 06:33:16 -0800 (PST) Received: from marklar.blazingdot.com (marklar.blazingdot.com [207.154.84.83]) by mx1.FreeBSD.org (Postfix) with SMTP id 0869443EC5 for ; Thu, 12 Dec 2002 06:33:16 -0800 (PST) (envelope-from marcus@blazingdot.com) Received: (qmail 51588 invoked by uid 503); 12 Dec 2002 14:33:15 -0000 Date: Thu, 12 Dec 2002 06:33:15 -0800 From: Marcus Reid To: Troy Settle Cc: lj@mandala-designs.com, freebsd-isp@FreeBSD.ORG Subject: Re: the mail server debate Message-ID: <20021212143315.GB48456@blazingdot.com> References: <3DF7B714.14133.4FDB185@localhost> <001201c2a1e8$887e5320$b214c518@abyss> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <001201c2a1e8$887e5320$b214c518@abyss> User-Agent: Mutt/1.4i Coffee-Level: high Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Thu, Dec 12, 2002 at 09:12:40AM -0500, Troy Settle wrote: > > Combined with qmail-scanner and a patch to reject unknown users, you've > got a great email solution. Where does one find this patch to reject unknown users? Does it just work on local system account users, or users defined in qmail/users? Someone recently asked me if there was a way to reject unknown users in the SMTP dialogue. On a busy system, most of the mail in the queue are undeliverable spam bounces, and it would be nice to cut those out.. Marcus To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Thu Dec 12 6:36:32 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 31A2A37B401 for ; Thu, 12 Dec 2002 06:36:31 -0800 (PST) Received: from Thanatos.Shenton.Org (chris.shenton.org [209.31.144.77]) by mx1.FreeBSD.org (Postfix) with SMTP id 19CBE43EC5 for ; Thu, 12 Dec 2002 06:36:29 -0800 (PST) (envelope-from chris@Shenton.Org) Received: (qmail 9349 invoked by uid 1000); 12 Dec 2002 14:36:25 -0000 To: "Charles Swiger" Cc: Subject: Re: the mail server debate References: <3DF7B714.14133.4FDB185@localhost> <00bb01c2a193$83e1e840$0301a8c0@prime> From: Chris Shenton Date: Thu, 12 Dec 2002 09:36:25 -0500 In-Reply-To: <00bb01c2a193$83e1e840$0301a8c0@prime> ("Charles Swiger"'s message of "Wed, 11 Dec 2002 23:03:46 -0500") Message-ID: <87smx3z4ly.fsf@thanatos.shenton.org> User-Agent: Gnus/5.090008 (Oort Gnus v0.08) Emacs/21.2 (i386--freebsd) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org "Charles Swiger" writes: > Have you heard of zmail, smail, smtpd, or even a product called > Communigate Pro? > > [ The latter might provide an integrated solution along the lines > you've been asking about and decent tech support, which might be > closer to what you want. No connection, but some people I've worked > with had liked their product. ] I've used their product in an ISP setting (on Slowaris) and really like it. Robust, excellent support, feature-rich. Not expensive. See www.stalker.com For another ISP, I'm using qmail with the vpopmail suite and get much of what Communigate offers in the way of email, lists, virtual domains, web mail GUI, web admin, etc, using qmail, vpopmail, qmailadmin, sqwebmail, courier-imap, exmlm-idx, etc. See http://inter7.com/freesoftware/ Inter7 says they also sell pre-configured systems. http://www.inter7.com/hardware/ To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Thu Dec 12 6:52:56 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id CCF5337B401 for ; Thu, 12 Dec 2002 06:52:55 -0800 (PST) Received: from marklar.blazingdot.com (marklar.blazingdot.com [207.154.84.83]) by mx1.FreeBSD.org (Postfix) with SMTP id 8538B43E4A for ; Thu, 12 Dec 2002 06:52:55 -0800 (PST) (envelope-from marcus@blazingdot.com) Received: (qmail 52057 invoked by uid 503); 12 Dec 2002 14:52:55 -0000 Date: Thu, 12 Dec 2002 06:52:55 -0800 From: Marcus Reid To: Dmitry Alyabyev Cc: freebsd-isp@FreeBSD.ORG Subject: Re: the mail server debate Message-ID: <20021212145255.GC48456@blazingdot.com> References: <3DF7B714.14133.4FDB185@localhost> <20021212122045.GA48456@blazingdot.com> <200212121429.32807.dimitry@al.org.ua> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <200212121429.32807.dimitry@al.org.ua> User-Agent: Mutt/1.4i Coffee-Level: high Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Thu, Dec 12, 2002 at 02:29:32PM +0200, Dmitry Alyabyev wrote: > > guys, why you do not mind Exim ? Just ignorance, really. I wish I knew more about it, but their web server seems to be refusing questions at the moment. For all I know if I used it I'd never look back. Marcus To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Thu Dec 12 6:54: 6 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 938F637B401 for ; Thu, 12 Dec 2002 06:54:04 -0800 (PST) Received: from psknet.com (voyager.psknet.com [63.171.251.15]) by mx1.FreeBSD.org (Postfix) with SMTP id 96C4843EB2 for ; Thu, 12 Dec 2002 06:54:03 -0800 (PST) (envelope-from troy@psknet.com) Received: (qmail 89857 invoked by uid 85); 12 Dec 2002 14:54:02 -0000 Received: from troy@psknet.com by voyager.psknet.com with qmail-scanner-1.02 (uvscan: v4.1.40/v4100. . Clean. Processed in 0.857495 secs); 12 Dec 2002 14:54:02 -0000 Received: from rad-va-20-pc-178.cablenet-va.com (HELO abyss) (24.197.20.178) by voyager.psknet.com with SMTP; 12 Dec 2002 14:54:01 -0000 From: "Troy Settle" To: "'Marcus Reid'" Cc: , Subject: RE: the mail server debate Date: Thu, 12 Dec 2002 09:54:05 -0500 Message-ID: <001301c2a1ee$51f82320$b214c518@abyss> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Priority: 3 (Normal) X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook, Build 10.0.2616 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1106 Importance: Normal In-Reply-To: <20021212143315.GB48456@blazingdot.com> Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org http://www.interazioni.it/qmail/ It's written to work against vpopmail (http://www.inter7.com/vpopmail), but can surely be hacked to work against the system passwd file. -- Troy Settle Pulaski Networks http://www.psknet.com 540.994.4254 ~ 866.477.5638 Pulaski Chamber 2002 Small Business Of The Year > -----Original Message----- > From: Marcus Reid [mailto:marcus@blazingdot.com] > Sent: Thursday, December 12, 2002 9:33 AM > To: Troy Settle > Cc: lj@mandala-designs.com; freebsd-isp@FreeBSD.ORG > Subject: Re: the mail server debate > > > On Thu, Dec 12, 2002 at 09:12:40AM -0500, Troy Settle wrote: > > > > Combined with qmail-scanner and a patch to reject unknown users, > > you've got a great email solution. > > Where does one find this patch to reject unknown users? Does > it just work on local system account users, or users defined > in qmail/users? Someone recently asked me if there was a way > to reject unknown users in the SMTP dialogue. On a busy > system, most of the mail in the queue are undeliverable spam > bounces, and it would be nice to cut those out.. > > Marcus > > To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Thu Dec 12 8:46:11 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E0F9E37B401 for ; Thu, 12 Dec 2002 08:46:10 -0800 (PST) Received: from usenet.isot.com (usenet.isot.com [63.161.224.13]) by mx1.FreeBSD.org (Postfix) with ESMTP id 3FCE143E4A for ; Thu, 12 Dec 2002 08:46:10 -0800 (PST) (envelope-from freebsd@isot.com) Received: (from www@localhost) by usenet.isot.com (8.11.6/8.11.6) id gBCGoTK64112 for freebsd-isp@freebsd.org; Thu, 12 Dec 2002 10:50:29 -0600 (CST) (envelope-from freebsd@isot.com) X-Authentication-Warning: usenet.isot.com: www set sender to freebsd@isot.com using -f Received: from 64.123.132.32 ( [64.123.132.32]) as user freebsd@isot.com by webmail.isot.com with HTTP; Thu, 12 Dec 2002 10:50:29 -0600 Message-ID: <1039711829.3df8be558d756@webmail.isot.com> Date: Thu, 12 Dec 2002 10:50:29 -0600 From: itchibahn To: freebsd-isp@freebsd.org Subject: copy user's home directories, passwd, and mail MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit User-Agent: Internet Messaging Program (IMP) 3.1-cvs X-Originating-IP: 64.123.132.32 Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Hi everyone, I just finish my new mail server. Anybody know how to copy user's files to a new mail server. Thanks Amy ------------------------------------------------- This mail sent through ISOT. To find out more about ISOT, visit http://isot.com To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Thu Dec 12 21: 0:54 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6283537B404 for ; Thu, 12 Dec 2002 21:00:53 -0800 (PST) Received: from ns3.unixmexico.net (ns3.unixmexico.net [64.141.69.184]) by mx1.FreeBSD.org (Postfix) with SMTP id 73A8043EA9 for ; Thu, 12 Dec 2002 21:00:52 -0800 (PST) (envelope-from nbari@unixmexico.com) Received: (qmail 4886 invoked by uid 85); 13 Dec 2002 05:00:42 -0000 Received: from nbari@unixmexico.com by ns3.unixmexico.net by uid 82 with qmail-scanner-1.15 (hbedv: 6.16.0.0/6.16.0.17. Clear:. Processed in 0.24938 secs); 13 Dec 2002 05:00:42 -0000 Received: from unknown (HELO unixmexico.com) (127.0.0.1) by localhost.unixmexico.net with SMTP; 13 Dec 2002 05:00:41 -0000 Received: from 148.243.211.187 (SquirrelMail authenticated user nbari@unixmexico.com) by mail.unixmexico.com with HTTP; Thu, 12 Dec 2002 23:00:41 -0600 (CST) Message-ID: <34042.148.243.211.187.1039755641.squirrel@mail.unixmexico.com> Date: Thu, 12 Dec 2002 23:00:41 -0600 (CST) Subject: network backup From: To: , X-Priority: 3 Importance: Normal X-Mailer: SquirrelMail (version 1.2.9) MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Hi all How can i make a backup of some dirs and send them to another server what is the best tool for doing that? rsync netcat or wich one do you recomend for making a huge backup ? thanks. To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Thu Dec 12 21:26:46 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4F71B37B401 for ; Thu, 12 Dec 2002 21:26:45 -0800 (PST) Received: from scan.pnc.com.au (scan.pnc.com.au [203.13.174.123]) by mx1.FreeBSD.org (Postfix) with SMTP id 72FBB43ED1 for ; Thu, 12 Dec 2002 21:26:44 -0800 (PST) (envelope-from peterh@criten.org) Received: (qmail 20742 invoked by uid 84); 13 Dec 2002 16:37:27 +1100 Received: from unknown (HELO dialup-241.158.220.203.acc01-high-pen.comindico.com.au) (203.13.174.1) by scan.pnc.com.au with SMTP; 13 Dec 2002 16:37:22 +1100 Date: Fri, 13 Dec 2002 05:27:48 +0000 (GMT) From: Peter Hoskin X-X-Sender: peterh@extortion.peterh.dropbear.id.au To: nbari@unixmexico.com Cc: freebsd-isp@FreeBSD.ORG, "" Subject: Re: network backup In-Reply-To: <34042.148.243.211.187.1039755641.squirrel@mail.unixmexico.com> Message-ID: <20021213052738.T5723-100000@extortion.peterh.dropbear.id.au> References: <34042.148.243.211.187.1039755641.squirrel@mail.unixmexico.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org rsync :) Regards, Peter Hoskin On Thu, 12 Dec 2002 nbari@unixmexico.com wrote: > Date: Thu, 12 Dec 2002 23:00:41 -0600 (CST) > From: nbari@unixmexico.com > To: freebsd-isp@FreeBSD.ORG, hackers@FreeBSD.ORG > Subject: network backup > > Hi all > > How can i make a backup of some dirs and send them to another server > > what is the best tool for doing that? > > rsync netcat or wich one do you recomend for making a huge backup ? > > > > > thanks. > > > > > To Unsubscribe: send mail to majordomo@FreeBSD.org > with "unsubscribe freebsd-isp" in the body of the message > To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Thu Dec 12 21:27:37 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0CF3437B401 for ; Thu, 12 Dec 2002 21:27:36 -0800 (PST) Received: from bilver.wjv.com (user38.net339.fl.sprint-hsd.net [65.40.24.38]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2544143EC5 for ; Thu, 12 Dec 2002 21:27:30 -0800 (PST) (envelope-from bv@wjv.com) Received: from bilver.wjv.com (localhost.wjv.com [127.0.0.1]) by bilver.wjv.com (8.12.6/8.12.6) with ESMTP id gBD5REP5031510; Fri, 13 Dec 2002 00:27:15 -0500 (EST) (envelope-from bv@wjv.com) Received: (from bv@localhost) by bilver.wjv.com (8.12.6/8.12.6/Submit) id gBD5RDSG031509; Fri, 13 Dec 2002 00:27:13 -0500 (EST) Date: Fri, 13 Dec 2002 00:27:13 -0500 From: Bill Vermillion To: nbari@unixmexico.com Cc: freebsd-isp@freebsd.org Subject: Re: network backup Message-ID: <20021213052713.GC29892@wjv.com> Reply-To: bv@wjv.com References: <34042.148.243.211.187.1039755641.squirrel@mail.unixmexico.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <34042.148.243.211.187.1039755641.squirrel@mail.unixmexico.com> Organization: W.J.Vermillion / Orlando - Winter Park User-Agent: Mutt/1.5.1i X-Spam-Status: No, hits=-2.0 required=5.0 tests=IN_REP_TO,NOSPAM_INC,QUOTED_EMAIL_TEXT,REFERENCES, SPAM_PHRASE_05_08,TO_BE_REMOVED_REPLY,USER_AGENT, USER_AGENT_MUTT version=2.43 Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org While nbari@unixmexico.com was trying to figure out why data written to /dev/null on Thu, Dec 12, 2002 at 23:00 was not readable, he gave up and decided to grace us with this: > How can i make a backup of some dirs and send them to another server > what is the best tool for doing that? > rsync netcat or wich one do you recomend for making a huge backup ? Best tool depends on just what you need to do for the backup. If you need to constanly update if the source changes, rsync is much faster after the first is done. If you just need an archive of the directories you might use gtar. I've just done both tonight and am currently rsync'ing a tree to a local machine as the far system doesn't have the gtar with the --rsh-command=ssh option as the target machine requires ssh. So it depends on what you need to do. Bill > > > > > To Unsubscribe: send mail to majordomo@FreeBSD.org > with "unsubscribe freebsd-isp" in the body of the message -- Bill Vermillion - bv @ wjv . com To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Fri Dec 13 0:20:21 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3E18637B404 for ; Fri, 13 Dec 2002 00:20:20 -0800 (PST) Received: from cobra.acceleratedweb.net (cobra-gw.acceleratedweb.net [207.99.79.37]) by mx1.FreeBSD.org (Postfix) with SMTP id 0A50D43ED8 for ; Fri, 13 Dec 2002 00:20:19 -0800 (PST) (envelope-from simon@optinet.com) Received: (qmail 39494 invoked by uid 106); 13 Dec 2002 08:24:46 -0000 Received: from 24-90-121-13.nyc.rr.com (HELO station1) (24.90.121.13) by cobra.acceleratedweb.net with SMTP; 13 Dec 2002 08:24:46 -0000 From: "Simon" To: "freebsd-isp@FreeBSD.ORG" Cc: "hackers@FreeBSD.ORG" Date: Fri, 13 Dec 2002 03:22:06 -0500 Reply-To: "Simon" X-Mailer: PMMail 2000 Professional (2.10.2010) For Windows 2000 (5.0.2195;2) In-Reply-To: <20021213052738.T5723-100000@extortion.peterh.dropbear.id.au> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Subject: Re: network backup Message-Id: <20021213082019.0A50D43ED8@mx1.FreeBSD.org> Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org rsync is nice, but it can't (afaik) compress data being synced on the fly to save disk space :-( Is there anything out there which works like rsync and can compress on the fly to space disk space? having 100GB of text files compressed can save quite a few gigs. Thanks, Simon On Fri, 13 Dec 2002 05:27:48 +0000 (GMT), Peter Hoskin wrote: >rsync :) > >Regards, >Peter Hoskin > >On Thu, 12 Dec 2002 nbari@unixmexico.com wrote: > >> Date: Thu, 12 Dec 2002 23:00:41 -0600 (CST) >> From: nbari@unixmexico.com >> To: freebsd-isp@FreeBSD.ORG, hackers@FreeBSD.ORG >> Subject: network backup >> >> Hi all >> >> How can i make a backup of some dirs and send them to another server >> >> what is the best tool for doing that? >> >> rsync netcat or wich one do you recomend for making a huge backup ? >> >> >> >> >> thanks. >> >> >> >> >> To Unsubscribe: send mail to majordomo@FreeBSD.org >> with "unsubscribe freebsd-isp" in the body of the message >> > >To Unsubscribe: send mail to majordomo@FreeBSD.org >with "unsubscribe freebsd-isp" in the body of the message > To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Fri Dec 13 0:52:23 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D5FE837B40F for ; Fri, 13 Dec 2002 00:52:17 -0800 (PST) Received: from boreas.primus.ca (mail.tor.primus.ca [216.254.136.21]) by mx1.FreeBSD.org (Postfix) with ESMTP id F058A43ED1 for ; Fri, 13 Dec 2002 00:52:16 -0800 (PST) (envelope-from leth@primus.ca) Received: from dialin-155-91.tor.primus.ca ([216.254.155.91]) by boreas1.primus.ca with esmtp (Exim 3.36 #3) id 18LmT1-0002KR-0A; Tue, 10 Dec 2002 10:38:39 -0500 Date: Tue, 10 Dec 2002 10:38:50 -0500 (EST) From: Jason Hunt X-X-Sender: leth@lethargic.dyndns.org To: Nick Kraal Cc: freebsd-isp@FreeBSD.ORG Subject: Re: OTT: SMTP settings on FreeBSD In-Reply-To: <018a01c2a046$76b4a3e0$53e173cb@arc.net.my> Message-ID: <20021210095413.P6497-100000@lethargic.dyndns.org> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Tue, 10 Dec 2002, Nick Kraal wrote: > Perhaps slightly OTT. I would like to send mail out from my FreeBSD box via > an external SMTP server and if possible retrieve mail via POP3. For whatever > reason I don't want to use the local inbuilt sendmail. > > Any ideas or pointers? > Firstly, and sorrying for trolling, but unless you are running a mail server, I personally think you might as well just use sendmail on a workstation. I'm not going to start yet another debate over MTAs, but that is my opinion. If you put 'sendmail_enable="NO"' in your /etc/rc.conf, sendmail will not accept mail from anyone other than localhost. If you're really paranoid because you think sendmail is some kind of big bad evil program and is a risk to your system just because of a bad track record in the 1990's, even though it now runs as a non-privileged user, install a different MTA :) Chapter 20.4 of the handbook can help you with this. Better yet, block incoming port 25 connections. However, most people will likely agree that simply setting sendmail_enable="NO" should suffice. Anyways, as for suggestions, I have my MUA (which is pine) configured to send outgoing mail directly to my ISPs SMTP server, instead of giving it to the local sendmail program. It was easier to tell pine which SMTP server to use, rather than giving all my mail to sendmail and configuring it to forward all outgoing mail to the ISPs SMTP server. I then configured fetchmail to download all my mail from my ISPs POP3 server. I created a .fetchmailrc in my home directory, and then configured a crontab to run fetchmail every 15 mins. You can tell fetchmail to either pass the messages to sendmail or to put them into your mail spool directly. I put them through sendmail so that I can use procmail for sorting. Hope this helps. To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Fri Dec 13 2:32:27 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9BA8737B404 for ; Fri, 13 Dec 2002 02:32:25 -0800 (PST) Received: from straylight.ringlet.net (office.sbnd.net [217.75.140.130]) by mx1.FreeBSD.org (Postfix) with SMTP id 87A0643EC5 for ; Fri, 13 Dec 2002 02:32:22 -0800 (PST) (envelope-from roam@straylight.ringlet.net) Received: (qmail 25737 invoked by uid 1000); 13 Dec 2002 10:31:54 -0000 Date: Fri, 13 Dec 2002 12:31:54 +0200 From: Peter Pentchev To: Simon Cc: freebsd-isp@FreeBSD.org, freebsd-hackers@FreeBSD.org Subject: Re: network backup Message-ID: <20021213103154.GA2398@straylight.oblivion.bg> Mail-Followup-To: Simon , freebsd-isp@FreeBSD.org, freebsd-hackers@FreeBSD.org References: <20021213052738.T5723-100000@extortion.peterh.dropbear.id.au> <20021213082019.0A66B43EDC@mx1.FreeBSD.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="HlL+5n6rz5pIUxbD" Content-Disposition: inline In-Reply-To: <20021213082019.0A66B43EDC@mx1.FreeBSD.org> User-Agent: Mutt/1.5.1i Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org --HlL+5n6rz5pIUxbD Content-Type: text/plain; charset=windows-1251 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Dec 13, 2002 at 03:22:06AM -0500, Simon wrote: > On Fri, 13 Dec 2002 05:27:48 +0000 (GMT), Peter Hoskin wrote: > >On Thu, 12 Dec 2002 nbari@unixmexico.com wrote: > > > >> Date: Thu, 12 Dec 2002 23:00:41 -0600 (CST) > >> From: nbari@unixmexico.com > >> To: freebsd-isp@FreeBSD.ORG, hackers@FreeBSD.ORG > >> Subject: network backup > >> > >> Hi all > >> > >> How can i make a backup of some dirs and send them to another server > >> > >> what is the best tool for doing that? > >> > >> rsync netcat or wich one do you recomend for making a huge backup ? > > > >rsync :) > > >=20 > rsync is nice, but it can't (afaik) compress data being synced on the fly= to > save disk space :-( Is there anything out there which works like rsync and > can compress on the fly to space disk space? having 100GB of text files > compressed can save quite a few gigs. Take a look at the rsync manual page, specifically at the '-z' option :) G'luck, Peter --=20 Peter Pentchev roam@ringlet.net roam@FreeBSD.org PGP key: http://people.FreeBSD.org/~roam/roam.key.asc Key fingerprint FDBA FD79 C26F 3C51 C95E DF9E ED18 B68D 1619 4553 The rest of this sentence is written in Thailand, on --HlL+5n6rz5pIUxbD Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.1 (FreeBSD) iD8DBQE9+bcZ7Ri2jRYZRVMRAri8AJ0e7guhg18RtxJMSdFcqpK0BBfa4gCfQigM Z9JRSeghB2leB7yKtxls4a8= =6jke -----END PGP SIGNATURE----- --HlL+5n6rz5pIUxbD-- To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Fri Dec 13 6:27:37 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 2B83037B401 for ; Fri, 13 Dec 2002 06:27:36 -0800 (PST) Received: from marklar.blazingdot.com (marklar.blazingdot.com [207.154.84.83]) by mx1.FreeBSD.org (Postfix) with SMTP id AFBB243EB2 for ; Fri, 13 Dec 2002 06:27:35 -0800 (PST) (envelope-from marcus@blazingdot.com) Received: (qmail 94295 invoked by uid 503); 13 Dec 2002 14:27:29 -0000 Date: Fri, 13 Dec 2002 06:27:29 -0800 From: Marcus Reid To: Simon Cc: "freebsd-isp@FreeBSD.ORG" Subject: Re: network backup Message-ID: <20021213142728.GA92171@blazingdot.com> References: <20021213052738.T5723-100000@extortion.peterh.dropbear.id.au> <20021213082019.0A50D43ED8@mx1.FreeBSD.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20021213082019.0A50D43ED8@mx1.FreeBSD.org> User-Agent: Mutt/1.4i Coffee-Level: high Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Fri, Dec 13, 2002 at 03:22:06AM -0500, Simon wrote: > > rsync is nice, but it can't (afaik) compress data being synced on the fly to > save disk space :-( Is there anything out there which works like rsync and > can compress on the fly to space disk space? having 100GB of text files > compressed can save quite a few gigs. The -z option for rsync will compress for the transfer, but the file will be decompressed before it is written to the disk (having the same file at both ends being the point of rsync..) If the files change a lot and you need to do a lot of incremental backups, I'd use rsync and just give up the space to store the uncompressed files if you can. Otherwise, if the files are generally small or rarely change, you could pipe the output of dump over ssh and through gzip and into an archive, and then do incremental dumps the same way. Can be automated nicely if you set up an authorized keypair so you don't need to enter a password. Note that I've removed the hackers list from the recipients. This is totally off-topic for that list. Marcus > > Thanks, > Simon To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Fri Dec 13 6:40:54 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 66E1437B401 for ; Fri, 13 Dec 2002 06:40:53 -0800 (PST) Received: from marklar.blazingdot.com (marklar.blazingdot.com [207.154.84.83]) by mx1.FreeBSD.org (Postfix) with SMTP id 0030A43EA9 for ; Fri, 13 Dec 2002 06:40:52 -0800 (PST) (envelope-from marcus@blazingdot.com) Received: (qmail 94693 invoked by uid 503); 13 Dec 2002 14:40:52 -0000 Date: Fri, 13 Dec 2002 06:40:52 -0800 From: Marcus Reid To: itchibahn Cc: freebsd-isp@freebsd.org Subject: Re: copy user's home directories, passwd, and mail Message-ID: <20021213144052.GB92171@blazingdot.com> References: <1039711829.3df8be558d756@webmail.isot.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1039711829.3df8be558d756@webmail.isot.com> User-Agent: Mutt/1.4i Coffee-Level: high Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Thu, Dec 12, 2002 at 10:50:29AM -0600, itchibahn wrote: > Hi everyone, > > I just finish my new mail server. Anybody know how to copy user's files to a > new mail server. That's what the copy_all_pertinent_data_and_configuration command is for. Example: copy_all_pertinent_data_and_configuration oldserver newserver > Thanks Glad to be of service. :) Marcus > Amy > > > > ------------------------------------------------- > This mail sent through ISOT. To find out more > about ISOT, visit http://isot.com > > To Unsubscribe: send mail to majordomo@FreeBSD.org > with "unsubscribe freebsd-isp" in the body of the message To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Fri Dec 13 7:35: 3 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5208837B401 for ; Fri, 13 Dec 2002 07:35:02 -0800 (PST) Received: from sl.pt (mail.sl.pt [212.55.140.13]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9FCB343E4A for ; Fri, 13 Dec 2002 07:35:00 -0800 (PST) (envelope-from japc@co.sapo.pt) Received: (qmail 11553 invoked by uid 0); 13 Dec 2002 15:34:49 -0000 Received: from unknown (HELO morgoth.sl.pt) ([172.28.229.169]) (envelope-sender ) by mail.sl.pt (qmail-ldap-1.03) with SMTP for ; 13 Dec 2002 15:34:49 -0000 Received: (qmail 4984 invoked by uid 500); 13 Dec 2002 15:32:33 -0000 Date: Fri, 13 Dec 2002 15:32:33 +0000 From: Jose Celestino To: freebsd-isp@FreeBSD.ORG Subject: Re: the mail server debate Message-ID: <20021213153233.GM846@co.sapo.pt> Mail-Followup-To: freebsd-isp@FreeBSD.ORG References: <3DF7B714.14133.4FDB185@localhost> <001201c2a1e8$887e5320$b214c518@abyss> <20021212143315.GB48456@blazingdot.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20021212143315.GB48456@blazingdot.com> X-GPG-key-ID/Fingerprint: 0x07B1363B / D3F3 B47B F20C 3B1E 488C B949 1B8B 8141 07B1 363B X-URL: http://xpto.org/~japc X-System: Linux morgoth.sl.pt 2.4.19 i686 X-By: japc@morgoth.sl.pt X-Location: Ericeira, Portugal User-Agent: Mutt/1.5.1i Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Words by Marcus Reid [Thu, Dec 12, 2002 at 06:33:15AM -0800]: > On Thu, Dec 12, 2002 at 09:12:40AM -0500, Troy Settle wrote: > > > > Combined with qmail-scanner and a patch to reject unknown users, you've > > got a great email solution. > > Where does one find this patch to reject unknown users? Does it just > work on local system account users, or users defined in qmail/users? > Someone recently asked me if there was a way to reject unknown users > in the SMTP dialogue. On a busy system, most of the mail in the queue > are undeliverable spam bounces, and it would be nice to cut those out.. > If you use LDAP you can use this one: http://www.xpto.org/~japc/soft/patches/qmail-verifyrcpt.patch or (the original, by John Morrissey): http://horde.net/~jwm/software/qmail/ -- Jose Celestino | http://xpto.org/~japc/files/japc-pgpkey.asc ---------------------------------------------------------------- "Don't summarize. Don't abbreviate. Don't interpret." -- djb To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Fri Dec 13 8:39:54 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9F2D637B401 for ; Fri, 13 Dec 2002 08:39:52 -0800 (PST) Received: from cobra.acceleratedweb.net (cobra-gw.acceleratedweb.net [207.99.79.37]) by mx1.FreeBSD.org (Postfix) with SMTP id D433343EE6 for ; Fri, 13 Dec 2002 08:39:49 -0800 (PST) (envelope-from simon@optinet.com) Received: (qmail 34900 invoked by uid 106); 13 Dec 2002 16:44:19 -0000 Received: from 24-90-121-13.nyc.rr.com (HELO station1) (24.90.121.13) by cobra.acceleratedweb.net with SMTP; 13 Dec 2002 16:44:19 -0000 From: "Simon" To: "Peter Pentchev" Cc: "freebsd-hackers@FreeBSD.org" , "freebsd-isp@FreeBSD.org" Date: Fri, 13 Dec 2002 11:41:37 -0500 Reply-To: "Simon" X-Mailer: PMMail 2000 Professional (2.10.2010) For Windows 2000 (5.0.2195;2) In-Reply-To: <20021213103154.GA2398@straylight.oblivion.bg> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Subject: Re: network backup Message-Id: <20021213163949.D433343EE6@mx1.FreeBSD.org> Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org I have before I sent this email. And unless I misread it, -z is to compress on sending side to make rsync use less bandwidth in remote backups, not to compress data (on the fly) on the receiving (backup) end. -Simon On Fri, 13 Dec 2002 12:31:54 +0200, Peter Pentchev wrote: >On Fri, Dec 13, 2002 at 03:22:06AM -0500, Simon wrote: >> On Fri, 13 Dec 2002 05:27:48 +0000 (GMT), Peter Hoskin wrote: >> >On Thu, 12 Dec 2002 nbari@unixmexico.com wrote: >> > >> >> Date: Thu, 12 Dec 2002 23:00:41 -0600 (CST) >> >> From: nbari@unixmexico.com >> >> To: freebsd-isp@FreeBSD.ORG, hackers@FreeBSD.ORG >> >> Subject: network backup >> >> >> >> Hi all >> >> >> >> How can i make a backup of some dirs and send them to another server >> >> >> >> what is the best tool for doing that? >> >> >> >> rsync netcat or wich one do you recomend for making a huge backup ? >> > >> >rsync :) >> > >>=20 >> rsync is nice, but it can't (afaik) compress data being synced on the fly= > to >> save disk space :-( Is there anything out there which works like rsync and >> can compress on the fly to space disk space? having 100GB of text files >> compressed can save quite a few gigs. > >Take a look at the rsync manual page, specifically at the '-z' option :) > >G'luck, >Peter > >--=20 >Peter Pentchev roam@ringlet.net roam@FreeBSD.org >PGP key: http://people.FreeBSD.org/~roam/roam.key.asc >Key fingerprint FDBA FD79 C26F 3C51 C95E DF9E ED18 B68D 1619 4553 >The rest of this sentence is written in Thailand, on To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Fri Dec 13 8:43:41 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0EFDB37B401 for ; Fri, 13 Dec 2002 08:43:40 -0800 (PST) Received: from cobra.acceleratedweb.net (cobra-gw.acceleratedweb.net [207.99.79.37]) by mx1.FreeBSD.org (Postfix) with SMTP id 5420343ED1 for ; Fri, 13 Dec 2002 08:43:39 -0800 (PST) (envelope-from simon@optinet.com) Received: (qmail 35685 invoked by uid 106); 13 Dec 2002 16:48:14 -0000 Received: from 24-90-121-13.nyc.rr.com (HELO station1) (24.90.121.13) by cobra.acceleratedweb.net with SMTP; 13 Dec 2002 16:48:14 -0000 From: "Simon" To: "Marcus Reid" Cc: "freebsd-isp@FreeBSD.ORG" Date: Fri, 13 Dec 2002 11:45:31 -0500 Reply-To: "Simon" X-Mailer: PMMail 2000 Professional (2.10.2010) For Windows 2000 (5.0.2195;2) In-Reply-To: <20021213142728.GA92171@blazingdot.com> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Subject: Re: network backup Message-Id: <20021213164339.5420343ED1@mx1.FreeBSD.org> Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org They don't change a whole lot, but they do change and new ones are uploaded. What I'm trying to do is build massive network backup server, backing up 6+ servers simultaneously. Each server has about 50-100gb worth of data to be backed up daily. I did look at dump, looks great, the only problem is that it can't backup individual directories, rather whole filesystems, if I didn't misread something. -Simon On Fri, 13 Dec 2002 06:27:29 -0800, Marcus Reid wrote: >On Fri, Dec 13, 2002 at 03:22:06AM -0500, Simon wrote: >> >> rsync is nice, but it can't (afaik) compress data being synced on the fly to >> save disk space :-( Is there anything out there which works like rsync and >> can compress on the fly to space disk space? having 100GB of text files >> compressed can save quite a few gigs. > >The -z option for rsync will compress for the transfer, but the file will be >decompressed before it is written to the disk (having the same file at both >ends being the point of rsync..) > >If the files change a lot and you need to do a lot of incremental backups, >I'd use rsync and just give up the space to store the uncompressed files if >you can. > >Otherwise, if the files are generally small or rarely change, you could pipe >the output of dump over ssh and through gzip and into an archive, and then do >incremental dumps the same way. Can be automated nicely if you set up an >authorized keypair so you don't need to enter a password. > >Note that I've removed the hackers list from the recipients. This is totally >off-topic for that list. > >Marcus > >> >> Thanks, >> Simon > To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Fri Dec 13 8:56:33 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0D30337B401; Fri, 13 Dec 2002 08:56:32 -0800 (PST) Received: from dan.emsphone.com (dan.emsphone.com [199.67.51.101]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6BC3243EDA; Fri, 13 Dec 2002 08:56:31 -0800 (PST) (envelope-from dan@dan.emsphone.com) Received: (from dan@localhost) by dan.emsphone.com (8.12.6/8.12.6) id gBDGuPjT021663; Fri, 13 Dec 2002 10:56:25 -0600 (CST) (envelope-from dan) Date: Fri, 13 Dec 2002 10:56:25 -0600 From: Dan Nelson To: Simon Cc: Peter Pentchev , "freebsd-hackers@FreeBSD.org" , "freebsd-isp@FreeBSD.org" Subject: Re: network backup Message-ID: <20021213165625.GB91604@dan.emsphone.com> References: <20021213103154.GA2398@straylight.oblivion.bg> <20021213163949.D46E643EEA@mx1.FreeBSD.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20021213163949.D46E643EEA@mx1.FreeBSD.org> X-OS: FreeBSD 5.0-RC X-message-flag: Outlook Error User-Agent: Mutt/1.5.1i Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org In the last episode (Dec 13), Simon said: > I have before I sent this email. And unless I misread it, -z is to > compress on sending side to make rsync use less bandwidth in remote > backups, not to compress data (on the fly) on the receiving (backup) > end. rsync is for synchronizing two directories, and needs to be able to read the files on both sides for the sync algorithm to work. If you just want to back directories up, use tar, and add the 'z' flag to compress the tarball. -- Dan Nelson dnelson@allantgroup.com To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Fri Dec 13 9:11:24 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B83BE37B404 for ; Fri, 13 Dec 2002 09:11:22 -0800 (PST) Received: from marklar.blazingdot.com (marklar.blazingdot.com [207.154.84.83]) by mx1.FreeBSD.org (Postfix) with SMTP id 4F5A043EA9 for ; Fri, 13 Dec 2002 09:11:22 -0800 (PST) (envelope-from marcus@blazingdot.com) Received: (qmail 312 invoked by uid 503); 13 Dec 2002 17:11:22 -0000 Date: Fri, 13 Dec 2002 09:11:22 -0800 From: "Marcus L. Reid" To: Simon Cc: "freebsd-isp@FreeBSD.ORG" Subject: Re: network backup Message-ID: <20021213171122.GA99250@blazingdot.com> References: <20021213142728.GA92171@blazingdot.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4i Coffee-Level: high Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Fri, Dec 13, 2002 at 11:45:31AM -0500, Simon wrote: > > They don't change a whole lot, but they do change and new ones are > uploaded. What I'm trying to do is build massive network backup server, > backing up 6+ servers simultaneously. Each server has about 50-100gb > worth of data to be backed up daily. I did look at dump, looks great, the > only problem is that it can't backup individual directories, rather whole > filesystems, if I didn't misread something. Is there some reason that you don't want to back up all of your data? You can use tar to similar effect, but dump/restore works really well when it comes to making full backups of your system. If you use something else to back up your text files, I still recommend using dump for the rest. You are backing up the rest, aren't you? ;) A system that I've used in the past works as follows. On each machine to be backed up: The operator user (the one with read access to the /dev disk devices, can vary with Linux, etc.) on each server is given a home directory and a valid shell (just * for the password field in your passwd file though.) Place the public key of the user on the backup machine into the .ssh/authorized_keys file of the operator user. On the backup machine: Run dump remotely on the server to back up over ssh. The command looks like: ssh yourserver dump -$DUMPLEVEL -u -a -h 0 -f - /dev/$DEVICE | \ gzip > $ARCHIVES/$MACHINE-$DEVICE-$DATE-$DUMPLEVEL.dump.gz The dump output goes out stdout, through ssh, through gzip, and neatly into a file on your backup server. All diagnostic messages go out stderr and are easily mailed to you separately. The backup machine is the one that does the compression here, but that's changed by adding a \ before the |. If you've got a tape library things will look a little different, but you get the idea. > > -Simon To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Fri Dec 13 10: 5:29 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 663D037B401 for ; Fri, 13 Dec 2002 10:05:28 -0800 (PST) Received: from cobra.acceleratedweb.net (cobra-gw.acceleratedweb.net [207.99.79.37]) by mx1.FreeBSD.org (Postfix) with SMTP id 6B64543EA9 for ; Fri, 13 Dec 2002 10:05:27 -0800 (PST) (envelope-from simon@optinet.com) Received: (qmail 53928 invoked by uid 106); 13 Dec 2002 18:10:01 -0000 Received: from 24-90-121-13.nyc.rr.com (HELO station1) (24.90.121.13) by cobra.acceleratedweb.net with SMTP; 13 Dec 2002 18:10:01 -0000 From: "Simon" To: "Dan Nelson" Cc: "freebsd-isp@FreeBSD.org" Date: Fri, 13 Dec 2002 13:07:18 -0500 Reply-To: "Simon" X-Mailer: PMMail 2000 Professional (2.10.2010) For Windows 2000 (5.0.2195;2) In-Reply-To: <20021213165625.GB91604@dan.emsphone.com> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Subject: Re: network backup Message-Id: <20021213180527.6B64543EA9@mx1.FreeBSD.org> Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org I don't *just* want to make a backup. I want to back it up using an efficient method because I'm dealing with terabytes of data. I can't just back so much data daily over network and compress it. I have to do incremental backups and compression on the fly is a must to save disk space. I understand that rsync needs to be able to read local copy of the backup in order to sync files correctly, however, this can be done using on-fly compression, I just don't have/know the right tool. Tools like rar and zip can do this only locally and don't support large archive files; you have to break them up into many smaller ones, unless I missed something (i tried to zip/rar a lot of files and once the archive grew over gig or so in size, it errored out on me). Dump is a mess to work with, it doesn't work with directories nor with single archive file. You need to keep creating new dumps using different backup levels and I don't know how you will restore files for x user using all those little dumps when you need to efficiently. -Simon On Fri, 13 Dec 2002 10:56:25 -0600, Dan Nelson wrote: >In the last episode (Dec 13), Simon said: >> I have before I sent this email. And unless I misread it, -z is to >> compress on sending side to make rsync use less bandwidth in remote >> backups, not to compress data (on the fly) on the receiving (backup) >> end. > >rsync is for synchronizing two directories, and needs to be able to >read the files on both sides for the sync algorithm to work. If you >just want to back directories up, use tar, and add the 'z' flag to >compress the tarball. > >-- > Dan Nelson > dnelson@allantgroup.com > To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Fri Dec 13 11:28:11 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9B20F37B401 for ; Fri, 13 Dec 2002 11:28:10 -0800 (PST) Received: from testmail.wolves.k12.mo.us (testmail.wolves.k12.mo.us [207.160.214.10]) by mx1.FreeBSD.org (Postfix) with ESMTP id E5CFC43EC2 for ; Fri, 13 Dec 2002 11:28:09 -0800 (PST) (envelope-from cdillon@wolves.k12.mo.us) Received: by testmail.wolves.k12.mo.us (Postfix, from userid 1001) id C25FFCCC9; Fri, 13 Dec 2002 13:28:03 -0600 (CST) Received: from localhost (localhost [127.0.0.1]) by testmail.wolves.k12.mo.us (Postfix) with ESMTP id BDE48CCC8; Fri, 13 Dec 2002 13:28:03 -0600 (CST) Date: Fri, 13 Dec 2002 13:28:03 -0600 (CST) From: Chris Dillon To: Simon Cc: Dan Nelson , "freebsd-isp@FreeBSD.org" Subject: Re: network backup In-Reply-To: <20021213180527.6B64543EA9@mx1.FreeBSD.org> Message-ID: <20021213130840.Q13951-100000@duey.wolves.k12.mo.us> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Fri, 13 Dec 2002, Simon wrote: > I don't *just* want to make a backup. I want to back it up using an > efficient method because I'm dealing with terabytes of data. I can't > just back so much data daily over network and compress it. I have to > do incremental backups and compression on the fly is a must to save > disk space. It sounds like you're really looking for a commercial tool like Veritas NetBackup. The server part of NetBackup won't run on FreeBSD (maybe the Linux version would run under the Linuxulator), but they do have a FreeBSD-native backup agent. The server can run on many differerent Unix platforms, as well as Windows and Linux. I'm not sure which other commercial backup tools out there have FreeBSD-native backup agents, but I know there are at least a couple of others that do. -- Chris Dillon - cdillon(at)wolves.k12.mo.us FreeBSD: The fastest and most stable server OS on the planet - Available for IA32 (Intel x86) and Alpha architectures - IA64, PowerPC, UltraSPARC, ARM, and S/390 under development - http://www.freebsd.org No trees were harmed in the composition of this message, although some electrons were mildly inconvenienced. To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Fri Dec 13 11:37:43 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 771B137B401 for ; Fri, 13 Dec 2002 11:37:42 -0800 (PST) Received: from pendragon.tacni.net (radius.tacni.net [64.247.218.2]) by mx1.FreeBSD.org (Postfix) with SMTP id BFA8843EC5 for ; Fri, 13 Dec 2002 11:37:41 -0800 (PST) (envelope-from tom.oneil@tacni.com) Received: (qmail 15818 invoked by alias); 13 Dec 2002 19:37:30 -0000 Received: from unknown (HELO tacni.com) (66.169.172.133) by pendragon.tacni.net with SMTP; 13 Dec 2002 19:37:30 -0000 Message-ID: <3DFA370B.8080102@tacni.com> Date: Fri, 13 Dec 2002 13:37:47 -0600 From: Tom ONeil User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.2.1) Gecko/20021130 X-Accept-Language: en-us, en MIME-Version: 1.0 To: Free Subject: Re: network backup References: <20021213130840.Q13951-100000@duey.wolves.k12.mo.us> In-Reply-To: <20021213130840.Q13951-100000@duey.wolves.k12.mo.us> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Chris Dillon wrote: > On Fri, 13 Dec 2002, Simon wrote: > It sounds like you're really looking for a commercial tool like > Veritas NetBackup. My thoughts exactly - having designed and run a 2+ terabyte per cycle backup network for a RFBFI(1), one of the big boys is the way to go. Personally I hate Veritas, which is why I left, but if Omniback (HP) is an option I'd use it. All of them are serious $$$, tho. Tom "No one cares about backups - they only care about restores." -Me 1) Really Big Financial Institution To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Fri Dec 13 12:32:39 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 82D8337B401; Fri, 13 Dec 2002 12:32:37 -0800 (PST) Received: from mice.XGforce.COM (mice.XGforce.COM [63.203.118.74]) by mx1.FreeBSD.org (Postfix) with ESMTP id EAFBE43EC2; Fri, 13 Dec 2002 12:32:36 -0800 (PST) (envelope-from mattl3@earthlink.net) Received: from brams (brams.XGforce.COM [63.203.118.78]) by mice.XGforce.COM (8.11.6/8.11.6) with SMTP id gBDKWYv47389; Fri, 13 Dec 2002 12:32:35 -0800 (PST) (envelope-from mattl3@earthlink.net) Message-ID: <00f401c2a2e5$e69e74f0$4e76cb3f@brams> From: "Matt" To: , , References: <34042.148.243.211.187.1039755641.squirrel@mail.unixmexico.com> Subject: Re: network backup Date: Fri, 13 Dec 2002 12:26:20 -0800 MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2600.0000 Disposition-Notification-To: "Matt" X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2600.0000 Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org You may check out http://www.xgforce.com/news_CFS.html. If you don't have too huge number of files, this works great for FreeBSD. Best Regards Matt http://www.xgforce.com/product.html ____________________________________________ High Performance Gigabit Load Balancer http://www.xgforce.com/loadbalancer.html High Performance Gigabit Firewall + VPN http://www.xgforce.com/firewall.html Gigabit Tera Servers http://www.xgforce.com/teraserver.html Gigabit Workstation HE http://www.xgforce.com/workstation.html (Dual Xeon CPU Workstations) __________________________________________________ ----- Original Message ----- From: To: ; Sent: Thursday, December 12, 2002 9:00 PM Subject: network backup > Hi all > > How can i make a backup of some dirs and send them to another server > > what is the best tool for doing that? > > rsync netcat or wich one do you recomend for making a huge backup ? > > > > > thanks. > > > > > To Unsubscribe: send mail to majordomo@FreeBSD.org > with "unsubscribe freebsd-hackers" in the body of the message To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Fri Dec 13 12:33:53 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 21B1837B401 for ; Fri, 13 Dec 2002 12:33:49 -0800 (PST) Received: from mtiwmhc12.worldnet.att.net (mtiwmhc12.worldnet.att.net [204.127.131.116]) by mx1.FreeBSD.org (Postfix) with ESMTP id 3D58343EC2 for ; Fri, 13 Dec 2002 12:33:48 -0800 (PST) (envelope-from cswiger@mac.com) Received: from prime ([12.88.88.40]) by mtiwmhc12.worldnet.att.net (InterMail vM.5.01.05.12 201-253-122-126-112-20020820) with SMTP id <20021213203346.NMRR20575.mtiwmhc12.worldnet.att.net@prime>; Fri, 13 Dec 2002 20:33:46 +0000 Message-ID: <013501c2a2e6$f0d9ab50$0301a8c0@prime> From: "Charles Swiger" To: Cc: "Simon" References: <20021213180527.6B64543EA9@mx1.FreeBSD.org> Subject: Re: network backup Date: Fri, 13 Dec 2002 15:33:47 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2800.1106 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1106 Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Simon wrote: > I don't *just* want to make a backup. I want to back it up using an > efficient method because I'm dealing with terabytes of data. I can't > just back so much data daily over network and compress it. I have > to do incremental backups and compression on the fly is a must to > save disk space. I understand that rsync needs to be able to read > local copy of the backup in order to sync files correctly, however, > this can be done using on-fly compression, I just don't have/know the > right tool. [ ... ] I have several considerations which you might want to go over in more detail: 1) Is the client representation of the data fixed, or can you do things like compress the data files beforehand? 2) What changes would be typical in a daily incremental backup? How much data changes per day? And are old files changing; being appended to; or are new files being created (ala the output of rotatelogs on a webserver's log files)? 3) Are you using sparse files? 4) Do you want to copy the data to a central server and then backup that one place, or do you want to backup data directly from the client machines? Give us some idea of the scope, although the notion of TB worth of data implies you should be considering commercial backup software-- eg, Legato Networker, or Veritas as others have mentioned. 5) Is the security of the backup network traffic important? 6) Hardware: You're also probably looking for at least a multitape silo loader, more probably a full roboticized tape library, if you need to backup all data at one complete central point. If you can backup individual clients (lets say you have a dozen webservers), you can divide up the problem and use a dozen tape drives (say 200 GB capacity per tape), you've got 2.4 TB of local tape storage available, which would save you from having to architect a backup network to handle all of the backup traffic. > Dump is a mess to work with, it doesn't work with directories nor with > single archive file. You need to keep creating new dumps using different > backup levels and I don't know how you will restore files for x user > using all those little dumps when you need to efficiently. Um. You don't want to do a full backup of terabytes worth of data every night, correct? The reason why dump has different levels is so that you can take incremental dumps, which is what you asked for. Maybe these scripts will help you understand: In crontab: 1 2 * * * /export/Backups/Scripts/pong_inc.sh #1 2 * * * /export/Backups/Scripts/pong_full.sh I switch which script runs when a tape fills up or when I want to take a full backup (to take offsite or before making a big change, etc). 2-pong# cd /export/Backups/Scripts backup_freebsd.sh* nohup.out pong_inc.sh* intent_push.sh* pong_full.sh* # Here is the full dump at level 0, plus a few useful commands # commented out so that the other admins I work with don't have # to figure things out. This is for a Solaris 8 system; under FreeBSD # one would use dump instead of 'ufsdump', etc. 4-pong# cat pong_full.sh #! /bin/sh #mt -f /dev/rmt/0ubn erase mt -f /dev/rmt/0ubn rewind /usr/sbin/ufsdump 0cfu /dev/rmt/0ubn /dev/md/rdsk/d10 mt -f /dev/rmt/0ubn asf 1 /usr/sbin/ufsdump 0cfu /dev/rmt/0ubn /dev/md/rdsk/d20 mt -f /dev/rmt/0ubn asf 2 /usr/sbin/ufsdump 0cfu /dev/rmt/0ubn /dev/md/rdsk/d30 mt -f /dev/rmt/0ubn asf 3 /usr/sbin/ufsdump 0cfu /dev/rmt/0ubn /dev/md/rdsk/d40 mt -f /dev/rmt/0ubn asf 4 /usr/sbin/ufsdump 0cfu /dev/rmt/0ubn /dev/md/rdsk/d60 mt -f /dev/rmt/0ubn asf 5 /usr/sbin/ufsdump 0cfu /dev/rmt/0ubn /dev/md/rdsk/d70 # mt -f /dev/rmt/0ubn asf 4 # ufsrestore ib 126 /dev/rmt/0ub Here's the incremental backup script: #! /bin/sh mt -f /dev/rmt/0ubn eom /usr/sbin/ufsdump 1cfu /dev/rmt/0ubn /dev/md/rdsk/d10 mt -f /dev/rmt/0ubn eom /usr/sbin/ufsdump 1cfu /dev/rmt/0ubn /dev/md/rdsk/d20 mt -f /dev/rmt/0ubn eom /usr/sbin/ufsdump 1cfu /dev/rmt/0ubn /dev/md/rdsk/d30 mt -f /dev/rmt/0ubn eom /usr/sbin/ufsdump 1cfu /dev/rmt/0ubn /dev/md/rdsk/d40 mt -f /dev/rmt/0ubn eom /usr/sbin/ufsdump 1cfu /dev/rmt/0ubn /dev/md/rdsk/d60 mt -f /dev/rmt/0ubn eom /usr/sbin/ufsdump 1cfu /dev/rmt/0ubn /dev/md/rdsk/d70 # mt -f /dev/rmt/0ubn asf 4 # ufsrestore ib 126 /dev/rmt/0ub # There was a problem with non-rewind semantics for my tape drive, so I # worked around it (thus all of the mt eom and mt asf stuff). # I think it's been fixed since, but I'm not going to rock that boat again. Also, a freebsd backup script which handles all of the parts of the servers which I customize: 6-pong# cat backup_freebsd.sh #! /bin/sh PATH=/usr/local/bin:/usr/bin:/usr/sbin:/usr/libexec:/usr/lib:/bin:/sbin FROM=${1-pi} echo "Backing up ${FROM}" DEST=/export/Backups/${FROM}/ mkdir ${DEST} mkdir ${DEST}var mkdir ${DEST}usr mkdir ${DEST}usr/src mkdir ${DEST}usr/src/sys mkdir ${DEST}usr/src/sys/i386 mkdir ${DEST}usr/local mkdir ${DEST}usr/local/etc rsync -a ${FROM}:/etc ${DEST} rsync -a ${FROM}:/var/log ${DEST}var/ rsync -a ${FROM}:/var/named ${DEST}var/ rsync -a ${FROM}:/usr/local/etc/rc.d ${DEST}usr/local/etc/ rsync -a ${FROM}:/usr/src/sys/i386/conf ${DEST}usr/src/sys/i386/ For what it's worth, this is backing up about two dozen machines to a backup server which has 10 disks (four 15K RPM 36GB in a RAID-1,0; four 10K RPM 18GB @ -1,0; two 10K RPM 9's @ RAID-1 for the OS) and is using a Quantum sDLT 110/220 GB tape drive; via four SCSI channels over 66MHz/wide PCI. A Sun E450, specificly. -Chuck To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Fri Dec 13 13:20:10 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 47B1B37B476 for ; Fri, 13 Dec 2002 13:20:08 -0800 (PST) Received: from mail.tcworks.net (mail.tcworks.net [216.61.218.4]) by mx1.FreeBSD.org (Postfix) with ESMTP id F278643EC5 for ; Fri, 13 Dec 2002 13:20:04 -0800 (PST) (envelope-from ccook@tcworks.net) Received: from tcworks.net (stp.tcworks.net [216.61.218.6]) by mail.tcworks.net (8.11.6/8.11.6) with ESMTP id gBDLIgx26704; Fri, 13 Dec 2002 15:18:42 -0600 (CST) Message-ID: <3DFA4F55.A70AF71F@tcworks.net> Date: Fri, 13 Dec 2002 15:21:25 -0600 From: Chris Cook X-Mailer: Mozilla 4.78 [en] (X11; U; Linux 2.4.2 i386) X-Accept-Language: en MIME-Version: 1.0 To: Simon Cc: Dan Nelson , "freebsd-isp@FreeBSD.org" Subject: Re: network backup References: <20021213180527.6B64543EA9@mx1.FreeBSD.org> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-RAVMilter-Version: 8.4.1(snapshot 20020920) (mail.tcworks.net) Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Simon wrote: > > I don't *just* want to make a backup. I want to back it up using an > efficient method because I'm dealing with terabytes of data. I can't > just back so much data daily over network and compress it. I have > to do incremental backups and compression on the fly is a must to > save disk space. I understand that rsync needs to be able to read > local copy of the backup in order to sync files correctly, however, this > can be done using on-fly compression, I just don't have/know the right > tool. Tools like rar and zip can do this only locally and don't support > large archive files; you have to break them up into many smaller ones, > unless I missed something (i tried to zip/rar a lot of files and once the > archive grew over gig or so in size, it errored out on me). Dump is a > mess to work with, it doesn't work with directories nor with single > archive file. You need to keep creating new dumps using different > backup levels and I don't know how you will restore files for x user > using all those little dumps when you need to efficiently. > AMANDA (The Advanced Maryland Automatic Network Disk Archiver) http://www.amanda.org -- Chris o----< ccook@tcworks.net >------------------------------------o |Chris Cook - Admin |TCWORKS.NET - http://www.tcworks.net | |The Computer Works ISP |FreeBSD - http://www.freebsd.org | o-------------------------------------------------------------o To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Fri Dec 13 15:15:46 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id ED54137B401 for ; Fri, 13 Dec 2002 15:15:44 -0800 (PST) Received: from bilver.wjv.com (user38.net339.fl.sprint-hsd.net [65.40.24.38]) by mx1.FreeBSD.org (Postfix) with ESMTP id DCC5743EC2 for ; Fri, 13 Dec 2002 15:15:38 -0800 (PST) (envelope-from bv@wjv.com) Received: from bilver.wjv.com (localhost.wjv.com [127.0.0.1]) by bilver.wjv.com (8.12.6/8.12.6) with ESMTP id gBDNFEup003367; Fri, 13 Dec 2002 18:15:14 -0500 (EST) (envelope-from bv@wjv.com) Received: (from bv@localhost) by bilver.wjv.com (8.12.6/8.12.6/Submit) id gBDNFCvY003366; Fri, 13 Dec 2002 18:15:12 -0500 (EST) Date: Fri, 13 Dec 2002 18:15:12 -0500 From: Bill Vermillion To: Chris Dillon Cc: Simon , Dan Nelson , "freebsd-isp@FreeBSD.org" Subject: Re: network backup Message-ID: <20021213231512.GD2513@wjv.com> Reply-To: bv@wjv.com References: <20021213180527.6B64543EA9@mx1.FreeBSD.org> <20021213130840.Q13951-100000@duey.wolves.k12.mo.us> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20021213130840.Q13951-100000@duey.wolves.k12.mo.us> Organization: W.J.Vermillion / Orlando - Winter Park User-Agent: Mutt/1.5.1i X-Spam-Status: No, hits=-3.2 required=5.0 tests=IN_REP_TO,NOSPAM_INC,QUOTED_EMAIL_TEXT,REFERENCES, SPAM_PHRASE_02_03,USER_AGENT,USER_AGENT_MUTT version=2.43 Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org "Ang utong ko ay sasabog sa sarap!" exclaimed Chris Dillon while reading this message on Fri, Dec 13, 2002 at 13:28 and then responded with: > On Fri, 13 Dec 2002, Simon wrote: > > I don't *just* want to make a backup. I want to back it up using an > > efficient method because I'm dealing with terabytes of data. I can't > > just back so much data daily over network and compress it. I have to > > do incremental backups and compression on the fly is a must to save > > disk space. > It sounds like you're really looking for a commercial tool like > Veritas NetBackup. The server part of NetBackup won't run on FreeBSD > (maybe the Linux version would run under the Linuxulator), but they do > have a FreeBSD-native backup agent. The server can run on many > differerent Unix platforms, as well as Windows and Linux. > I'm not sure which other commercial backup tools out there have > FreeBSD-native backup agents, but I know there are at least a couple > of others that do. I have a 'supertar' that runs on BSD - called LoneTar. It's an enhanced tar and you can backup to remote devices. What I like for local backups is that it rewinds the tape and does a bit level compare of the tape with the disk and then emails me a copy. I have a site in DC that mails to the local people, the guy who sold them the system [he's in Atlanta] and a copy to me, here in Florida. That way I'll always see it and let the guy in Atlanta know about it, even if the DC folks don't see it. I had it on several client's machines on SCO in the past. But it's not like a network backup but works for single machines backing up to far files or devices. Bill -- Bill Vermillion - bv @ wjv . com To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Fri Dec 13 15:39:22 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A2ABF37B401 for ; Fri, 13 Dec 2002 15:39:21 -0800 (PST) Received: from marklar.blazingdot.com (marklar.blazingdot.com [207.154.84.83]) by mx1.FreeBSD.org (Postfix) with SMTP id 320E843ED4 for ; Fri, 13 Dec 2002 15:39:21 -0800 (PST) (envelope-from marcus@blazingdot.com) Received: (qmail 15828 invoked by uid 503); 13 Dec 2002 23:39:20 -0000 Date: Fri, 13 Dec 2002 15:39:20 -0800 From: "Marcus L. Reid" To: Chris Cook Cc: Simon , Dan Nelson , "freebsd-isp@FreeBSD.org" Subject: Re: network backup Message-ID: <20021213233920.GA13094@blazingdot.com> References: <20021213180527.6B64543EA9@mx1.FreeBSD.org> <3DFA4F55.A70AF71F@tcworks.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <3DFA4F55.A70AF71F@tcworks.net> User-Agent: Mutt/1.4i Coffee-Level: high Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Fri, Dec 13, 2002 at 03:21:25PM -0600, Chris Cook wrote: > > AMANDA (The Advanced Maryland Automatic Network Disk Archiver) > > http://www.amanda.org AMANDA is nice, and does a pretty good job. The major limitation that it has (or rather had when I last used it about a year ago) is that it can't span a single dump/tar/whatever archive over multiple tapes. If your partition doesn't fit on a tape, you're pretty SOL. You might be able to hack around it by splitting things up a bit, but at the scale this guy's talking about it might not make a whole lot of sense. Marcus > > -- > Chris To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Fri Dec 13 18:12:24 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 1A94937B401 for ; Fri, 13 Dec 2002 18:12:22 -0800 (PST) Received: from dynamic.galis.org (ool-4350143e.dyn.optonline.net [67.80.20.62]) by mx1.FreeBSD.org (Postfix) with SMTP id 2920943E4A for ; Fri, 13 Dec 2002 18:12:21 -0800 (PST) (envelope-from quack@galis.org) Received: (qmail 30060 invoked by uid 1010); 14 Dec 2002 02:16:08 -0000 Date: Fri, 13 Dec 2002 21:16:08 -0500 From: George Georgalis To: Simon Cc: Marcus Reid , "freebsd-isp@FreeBSD.ORG" Subject: Re: network backup Message-ID: <20021214021608.GA29015@trot.local> References: <20021213142728.GA92171@blazingdot.com> <20021213164339.5420343ED1@mx1.FreeBSD.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20021213164339.5420343ED1@mx1.FreeBSD.org> User-Agent: Mutt/1.3.28i Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Hi - I'd use an actual db or a flat text file index on the source side. For the daily backups archive and compress the files that have changed, send them over, and update the db. At some threshold, extract the remote and rsync the whole thing (ugh), it might be sensible to rsync sections of the filesystem. Some versions of rsync require --block-size on command line to make that work properly, I think the default is way too small too. Another approach might be compressed file systems. In linux I think there is a module/mount parameter so the kernel compresses/extracts as it writes to disk, then you could just rsync -z the whole thing and have a compressed remote too. Not sure if that is available in FBSD. I've never used this but another feature you might want to incorporate are snapshots, the rsync might take a 'long' time... http://www.au.freebsd.org/doc/en_US.ISO8859-1/books/handbook/snapshots.html // George On Fri, Dec 13, 2002 at 11:45:31AM -0500, Simon wrote: > >They don't change a whole lot, but they do change and new ones are >uploaded. What I'm trying to do is build massive network backup server, >backing up 6+ servers simultaneously. Each server has about 50-100gb >worth of data to be backed up daily. I did look at dump, looks great, the >only problem is that it can't backup individual directories, rather whole >filesystems, if I didn't misread something. > >-Simon > > >On Fri, 13 Dec 2002 06:27:29 -0800, Marcus Reid wrote: > >>On Fri, Dec 13, 2002 at 03:22:06AM -0500, Simon wrote: >>> >>> rsync is nice, but it can't (afaik) compress data being synced on the fly to >>> save disk space :-( Is there anything out there which works like rsync and >>> can compress on the fly to space disk space? having 100GB of text files >>> compressed can save quite a few gigs. >> >>The -z option for rsync will compress for the transfer, but the file will be >>decompressed before it is written to the disk (having the same file at both >>ends being the point of rsync..) >> >>If the files change a lot and you need to do a lot of incremental backups, >>I'd use rsync and just give up the space to store the uncompressed files if >>you can. >> >>Otherwise, if the files are generally small or rarely change, you could pipe >>the output of dump over ssh and through gzip and into an archive, and then do >>incremental dumps the same way. Can be automated nicely if you set up an >>authorized keypair so you don't need to enter a password. >> >>Note that I've removed the hackers list from the recipients. This is totally >>off-topic for that list. >> >>Marcus >> >>> >>> Thanks, >>> Simon >> > > > > > >To Unsubscribe: send mail to majordomo@FreeBSD.org >with "unsubscribe freebsd-isp" in the body of the message > -- GEORGE GEORGALIS, System Admin/Architect cell: 347-451-8229 Security Services, Web, Mail, mailto:george@galis.org Multimedia, DB, DNS and Metrics. http://www.galis.org/george To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message From owner-freebsd-isp Fri Dec 13 20:56: 7 2002 Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 13B3237B401 for ; Fri, 13 Dec 2002 20:56:06 -0800 (PST) Received: from mail.lambertfam.org (www.lambertfam.org [216.223.196.6]) by mx1.FreeBSD.org (Postfix) with ESMTP id 735DC43ED8 for ; Fri, 13 Dec 2002 20:56:05 -0800 (PST) (envelope-from lambert@lambertfam.org) Received: from laptop.lambertfam.org (unknown [10.1.0.2]) by mail.lambertfam.org (Postfix) with ESMTP id 5E990351CA for ; Fri, 13 Dec 2002 23:55:53 -0500 (EST) Received: by laptop.lambertfam.org (Postfix, from userid 1000) id 0FC0E28B09; Fri, 13 Dec 2002 23:55:52 -0500 (EST) Date: Fri, 13 Dec 2002 23:55:52 -0500 From: Scott Lambert To: FreeBSD -STABLE list Subject: Re: network backup Message-ID: <20021214045551.GA9611@laptop.lambertfam.org> Mail-Followup-To: FreeBSD -STABLE list References: <20021213180527.6B64543EA9@mx1.FreeBSD.org> <3DFA4F55.A70AF71F@tcworks.net> <20021213233920.GA13094@blazingdot.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20021213233920.GA13094@blazingdot.com> User-Agent: Mutt/1.4i Sender: owner-freebsd-isp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Fri, Dec 13, 2002 at 03:39:20PM -0800, Marcus L. Reid wrote: > On Fri, Dec 13, 2002 at 03:21:25PM -0600, Chris Cook wrote: > > > > AMANDA (The Advanced Maryland Automatic Network Disk Archiver) > > > > http://www.amanda.org > > AMANDA is nice, and does a pretty good job. The major limitation > that it has (or rather had when I last used it about a year ago) > is that it can't span a single dump/tar/whatever archive over > multiple tapes. If your partition doesn't fit on a tape, you're > pretty SOL. You might be able to hack around it by splitting things > up a bit, but at the scale this guy's talking about it might not make > a whole lot of sense. Using tar you can manually break the file system into smaller chunks using several starting directories combined with exclude files. -- Scott Lambert KC5MLE Unix SysAdmin lambert@lambertfam.org To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-isp" in the body of the message