From owner-freebsd-isp@FreeBSD.ORG Thu Jul 6 00:33:22 2006 Return-Path: X-Original-To: freebsd-isp@freebsd.org Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9C19916A4DD for ; Thu, 6 Jul 2006 00:33:22 +0000 (UTC) (envelope-from kwoody@citytel.net) Received: from mail.citytel.net (mail.citytel.net [209.145.111.46]) by mx1.FreeBSD.org (Postfix) with ESMTP id 60B1B43D45 for ; Thu, 6 Jul 2006 00:33:22 +0000 (GMT) (envelope-from kwoody@citytel.net) Received: from pop.citytel.net (pop.citytel.net [204.244.98.50]) by mail.citytel.net (Postfix) with ESMTP id A981167EC6 for ; Wed, 5 Jul 2006 17:33:21 -0700 (PDT) Date: Wed, 5 Jul 2006 17:33:21 -0700 (PDT) From: Keith Woodworth To: freebsd-isp@freebsd.org Message-ID: <20060705172226.I72183@pop.citytel.net> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Subject: DHCP error. X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 Jul 2006 00:33:22 -0000 Hi. Having an issue with dhcpd. Fairly new install of a FreeBSD 6.0 machine, not in production yet. Installed dhcp 3.0.3 from ports. Made it without jail and chroot and was getting: Jul 4 10:00:00 netreg dhcpd: unable to create icmp socket: Operation not permitted Jul 4 10:00:00 netreg dhcpd: Can't open /var/db/dhcpd.leases for append. Dug around for a while and best I could find was that the icmp socket error was due to BPF, which was still in my kernel. All permissions were the same as Ive got two other dhcp servers, one under BSD/OS and one under FBSD 4.8, both with slightly older versions of dhcp running on them and have had for 3+ yrs. I'm putting in a new dhcp server to take the place of the other two. I deinstalled the port and installed the latest dhcp 3.0.4 from source. Was still getting the errors. Went back to the original generic kernel, still same errors. Since the day I installed dhcp and added it to rc.conf I'm getting messages from: From: Cron /usr/libexec/save-entropy Internet Systems Consortium DHCP Server V3.0.4 Copyright 2004-2006 Internet Systems Consortium. All rights reserved. For info, please visit http://www.isc.org/sw/dhcp/ unable to create icmp socket: Operation not permitted Can't open /var/db/dhcpd.leases for append. Anyone lend a clue or two here on why the append and icmp errors are coming up? Thanks, Keith From owner-freebsd-isp@FreeBSD.ORG Thu Jul 6 06:58:16 2006 Return-Path: X-Original-To: freebsd-isp@freebsd.org Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id CEB9E16A4DA for ; Thu, 6 Jul 2006 06:58:16 +0000 (UTC) (envelope-from ernie@puremail.eis.net.au) Received: from puremail.eis.net.au (puremail.eis.net.au [203.12.171.128]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2110143D46 for ; Thu, 6 Jul 2006 06:58:15 +0000 (GMT) (envelope-from ernie@puremail.eis.net.au) Received: (from ernie@localhost) by puremail.eis.net.au (8.13.4/8.13.4) id k6675V3C018470 for freebsd-isp@freebsd.org; Thu, 6 Jul 2006 17:05:31 +1000 (EST) (envelope-from ernie) From: User Ernie Message-Id: <200607060705.k6675V3C018470@puremail.eis.net.au> To: freebsd-isp@freebsd.org Date: Thu, 6 Jul 2006 17:05:31 +1000 (EST) X-Mailer: ELM [version 2.4ME+ PL122g (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="US-ASCII" Subject: ng_netflow with several ethernets X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 Jul 2006 06:58:16 -0000 Does anyone have an example on how to configure ng_netflow to capture data from say 6 ethernet interfaces at once? I am not a netgraph guru so the man page has me confused. Previously I have just used fprobe, but it is CPU intensive. - Ernie. From owner-freebsd-isp@FreeBSD.ORG Thu Jul 6 12:17:24 2006 Return-Path: X-Original-To: freebsd-isp@freebsd.org Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 1684516A4DE for ; Thu, 6 Jul 2006 12:17:24 +0000 (UTC) (envelope-from b.candler@pobox.com) Received: from rune.pobox.com (rune.pobox.com [208.210.124.79]) by mx1.FreeBSD.org (Postfix) with ESMTP id 4F4F043D64 for ; Thu, 6 Jul 2006 12:17:20 +0000 (GMT) (envelope-from b.candler@pobox.com) Received: from rune (localhost [127.0.0.1]) by rune.pobox.com (Postfix) with ESMTP id 5F0F478905; Thu, 6 Jul 2006 08:17:41 -0400 (EDT) Received: from mappit.local.linnet.org (212-74-113-67.static.dsl.as9105.com [212.74.113.67]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by rune.sasl.smtp.pobox.com (Postfix) with ESMTP id 1BC921CBA4; Thu, 6 Jul 2006 08:17:39 -0400 (EDT) Received: from lists by mappit.local.linnet.org with local (Exim 4.61 (FreeBSD)) (envelope-from ) id 1FySnE-0008Nl-Cv; Thu, 06 Jul 2006 13:17:16 +0100 Date: Thu, 6 Jul 2006 13:17:16 +0100 From: Brian Candler To: Keith Woodworth Message-ID: <20060706121716.GA32208@uk.tiscali.com> References: <20060705172226.I72183@pop.citytel.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20060705172226.I72183@pop.citytel.net> User-Agent: Mutt/1.4.2.1i Cc: freebsd-isp@freebsd.org Subject: Re: DHCP error. X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 Jul 2006 12:17:24 -0000 On Wed, Jul 05, 2006 at 05:33:21PM -0700, Keith Woodworth wrote: > Jul 4 10:00:00 netreg dhcpd: unable to create icmp socket: Operation not > permitted > Jul 4 10:00:00 netreg dhcpd: Can't open /var/db/dhcpd.leases for append. You are running dhcpd as root, aren't you? It's just that: > From: Cron /usr/libexec/save-entropy > > Internet Systems Consortium DHCP Server V3.0.4 > Copyright 2004-2006 Internet Systems Consortium. > All rights reserved. > For info, please visit http://www.isc.org/sw/dhcp/ > unable to create icmp socket: Operation not permitted > Can't open /var/db/dhcpd.leases for append. It seems that this cronjob is running as user 'operator'. But why would /usr/libexec/save-entropy be invoking the DHCP server? I can only guess that the filesystem is seriously toasted. Perhaps you should reinstall from scratch, and using a fresh CD-ROM or over FTP (you could install 6.1, although I use isc-dhcpd under 6.0 without any problem) $ pkg_info -I isc\* isc-dhcp3-server-3.0.3_1 The ISC Dynamic Host Configuration Protocol server Regards, Brian. From owner-freebsd-isp@FreeBSD.ORG Thu Jul 6 16:42:30 2006 Return-Path: X-Original-To: freebsd-isp@freebsd.org Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 900E816A4DA for ; Thu, 6 Jul 2006 16:42:30 +0000 (UTC) (envelope-from kwoody@citytel.net) Received: from mail.citytel.net (mail.citytel.net [209.145.111.46]) by mx1.FreeBSD.org (Postfix) with ESMTP id 509E943D70 for ; Thu, 6 Jul 2006 16:42:30 +0000 (GMT) (envelope-from kwoody@citytel.net) Received: from pop.citytel.net (pop.citytel.net [204.244.98.50]) by mail.citytel.net (Postfix) with ESMTP id B161167EBA; Thu, 6 Jul 2006 09:42:29 -0700 (PDT) Date: Thu, 6 Jul 2006 09:42:29 -0700 (PDT) From: Keith Woodworth To: Brian Candler In-Reply-To: <20060706121716.GA32208@uk.tiscali.com> Message-ID: <20060706092851.D50369@pop.citytel.net> References: <20060705172226.I72183@pop.citytel.net> <20060706121716.GA32208@uk.tiscali.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Cc: freebsd-isp@freebsd.org Subject: Re: DHCP error. X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 Jul 2006 16:42:30 -0000 On Thu, 6 Jul 2006, Brian Candler wrote: |->On Wed, Jul 05, 2006 at 05:33:21PM -0700, Keith Woodworth wrote: |->> Jul 4 10:00:00 netreg dhcpd: unable to create icmp socket: Operation not |->> permitted |->> Jul 4 10:00:00 netreg dhcpd: Can't open /var/db/dhcpd.leases for append. |-> |->You are running dhcpd as root, aren't you? |-> |->It's just that: |-> |->> From: Cron /usr/libexec/save-entropy |->> |->> Internet Systems Consortium DHCP Server V3.0.4 |->> Copyright 2004-2006 Internet Systems Consortium. |->> All rights reserved. |->> For info, please visit http://www.isc.org/sw/dhcp/ |->> unable to create icmp socket: Operation not permitted |->> Can't open /var/db/dhcpd.leases for append. |-> |->It seems that this cronjob is running as user 'operator'. But why would |->/usr/libexec/save-entropy be invoking the DHCP server? |-> |->I can only guess that the filesystem is seriously toasted. Perhaps you |->should reinstall from scratch, and using a fresh CD-ROM or over FTP (you |->could install 6.1, although I use isc-dhcpd under 6.0 without any problem) |-> |->$ pkg_info -I isc\* |->isc-dhcp3-server-3.0.3_1 The ISC Dynamic Host Configuration Protocol server Ive run into a config issue that I have now worked out. It used to be that you could put: /usr/sbin/dhcpd or any other command line to start a daemon in rc.conf, and there used to be rc.local to start local daemons too years ago and I am still used to putting the whole path, including command line args directly in rc.conf. Now /usr/libexec/save-entropy runs from cron every 11 mins running as operator, which has no root privs and it reads in rc.conf. So I think what it does is when /usr/libexec/save-entropy runs it reads in rc.conf and sees: /usr/sbin/dhcpd then tries to run it as operator. Operator has no root privs, hence the error. /usr/libexec/save-entropy has something to do with generating randomness, I'm not exactly sure as Ive not read up on it yet and there is no manpage. I suppose I could just comment that line in cron but I'm not sure what else it might break, nor do I want to as it was put there for a reason I'm sure. :) So now I have to invoke the daemons properly with: dhcpd_enable="yes" in rc.conf. Thanks, Keith From owner-freebsd-isp@FreeBSD.ORG Thu Jul 6 20:41:25 2006 Return-Path: X-Original-To: freebsd-isp@freebsd.org Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3C1FE16A4DD for ; Thu, 6 Jul 2006 20:41:25 +0000 (UTC) (envelope-from b.candler@pobox.com) Received: from proof.pobox.com (proof.pobox.com [207.106.133.28]) by mx1.FreeBSD.org (Postfix) with ESMTP id B833943D45 for ; Thu, 6 Jul 2006 20:41:24 +0000 (GMT) (envelope-from b.candler@pobox.com) Received: from proof (localhost [127.0.0.1]) by proof.pobox.com (Postfix) with ESMTP id 0D9142B3AD; Thu, 6 Jul 2006 16:41:23 -0400 (EDT) Received: from mappit.local.linnet.org (212-74-113-67.static.dsl.as9105.com [212.74.113.67]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by proof.sasl.smtp.pobox.com (Postfix) with ESMTP id BFBA362074; Thu, 6 Jul 2006 16:41:21 -0400 (EDT) Received: from brian by mappit.local.linnet.org with local (Exim 4.61 (FreeBSD)) (envelope-from ) id 1Fyaf1-0008l1-Tz; Thu, 06 Jul 2006 21:41:20 +0100 Date: Thu, 6 Jul 2006 21:41:19 +0100 From: Brian Candler To: Keith Woodworth Message-ID: <20060706204119.GA33559@uk.tiscali.com> References: <20060705172226.I72183@pop.citytel.net> <20060706121716.GA32208@uk.tiscali.com> <20060706092851.D50369@pop.citytel.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20060706092851.D50369@pop.citytel.net> User-Agent: Mutt/1.4.2.1i Cc: freebsd-isp@freebsd.org Subject: Re: DHCP error. X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 Jul 2006 20:41:25 -0000 On Thu, Jul 06, 2006 at 09:42:29AM -0700, Keith Woodworth wrote: > It used to be that you could put: > > /usr/sbin/dhcpd > > or any other command line to start a daemon in rc.conf, and there used to > be rc.local to start local daemons too years ago and I am still used to > putting the whole path, including command line args directly in rc.conf. > > Now /usr/libexec/save-entropy runs from cron every 11 mins running as > operator, which has no root privs and it reads in rc.conf. > > So I think what it does is when /usr/libexec/save-entropy runs it > reads in rc.conf and sees: > > /usr/sbin/dhcpd > > then tries to run it as operator. Operator has no root privs, hence the > error. Ah. That would certainly explain it :-) /etc/rc.local does still exists though (well, you need to create it yourself, but if you do it is run at system startup time) In the new world order, for isc-dhcpd installed from packages, all you do is dhcpd_enable="YES" in rc.conf. All the scripts in /usr/local/etc/rc.d/* are run at bootup time, but they only start the daemon if they have a corresponding foo_enable="YES" in rc.conf. (Or _should_ ... maybe not all scripts have been converted over yet) > /usr/libexec/save-entropy has something to do with generating randomness, > I'm not exactly sure as Ive not read up on it yet and there is no manpage. It's just a shell script - you can read it. It saves state from the entropy gathering, so if the machine is rebooted it the random number generator doesn't start up in a predictable state. > I suppose I could just comment that line in cron but I'm not sure what > else it might break, nor do I want to as it was put there for a reason I'm > sure. :) Other things run from cron, and you don't want those attempting to start dhcpd as different users either. The solution is to move your "/usr/sbin/dhcpd" command to /etc/rc.local > So now I have to invoke the daemons properly with: > > dhcpd_enable="yes" > > in rc.conf. Yes if you are using ports, which have startup scripts in /usr/local/etc/rc.d/. However if you are using isc-dhcpd compiled from source, then rc.local is probably the right place, unless you put a suitable script in /usr/local/etc/rc.d/ But this still doesn't explain the "permission denied" error you see if you start dhcpd as root (assuming you *are* trying to start it as root, that is) Regards, Brian. From owner-freebsd-isp@FreeBSD.ORG Thu Jul 6 21:10:43 2006 Return-Path: X-Original-To: freebsd-isp@freebsd.org Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7F4A316A4E2 for ; Thu, 6 Jul 2006 21:10:43 +0000 (UTC) (envelope-from kwoody@citytel.net) Received: from mail.citytel.net (mail.citytel.net [209.145.111.46]) by mx1.FreeBSD.org (Postfix) with ESMTP id 418D543D49 for ; Thu, 6 Jul 2006 21:10:43 +0000 (GMT) (envelope-from kwoody@citytel.net) Received: from pop.citytel.net (pop.citytel.net [204.244.98.50]) by mail.citytel.net (Postfix) with ESMTP id 8A3A267EE2; Thu, 6 Jul 2006 14:10:42 -0700 (PDT) Date: Thu, 6 Jul 2006 14:10:42 -0700 (PDT) From: Keith Woodworth To: Brian Candler In-Reply-To: <20060706204119.GA33559@uk.tiscali.com> Message-ID: <20060706135732.B72198@pop.citytel.net> References: <20060705172226.I72183@pop.citytel.net> <20060706121716.GA32208@uk.tiscali.com> <20060706092851.D50369@pop.citytel.net> <20060706204119.GA33559@uk.tiscali.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Cc: freebsd-isp@freebsd.org Subject: Re: DHCP error. X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 Jul 2006 21:10:43 -0000 On Thu, 6 Jul 2006, Brian Candler wrote: |->On Thu, Jul 06, 2006 at 09:42:29AM -0700, Keith Woodworth wrote: |-> |->/etc/rc.local does still exists though (well, you need to create it |->yourself, but if you do it is run at system startup time) Hmm, I thought it had gone away. |-> |->In the new world order, for isc-dhcpd installed from packages, all you do is |-> |->dhcpd_enable="YES" Yes, as Ive come to find. |->in rc.conf. All the scripts in /usr/local/etc/rc.d/* are run at bootup time, |->but they only start the daemon if they have a corresponding foo_enable="YES" |->in rc.conf. (Or _should_ ... maybe not all scripts have been converted over |->yet) I knew that, but I was not doing it right in this case and it was the cron job for save-entropy that was causing grief. |->It's just a shell script - you can read it. It saves state from the entropy |->gathering, so if the machine is rebooted it the random number generator |->doesn't start up in a predictable state. Knew it had something to do with that, just wasnt quite sure of the details. |->> I suppose I could just comment that line in cron but I'm not sure what |->> else it might break, nor do I want to as it was put there for a reason I'm |->> sure. :) |-> |->Other things run from cron, and you don't want those attempting to start |->dhcpd as different users either. The solution is to move your |->"/usr/sbin/dhcpd" command to /etc/rc.local Aye, that I will try now that I know. |->Yes if you are using ports, which have startup scripts in |->/usr/local/etc/rc.d/. However if you are using isc-dhcpd compiled from |->source, then rc.local is probably the right place, unless you put a suitable |->script in /usr/local/etc/rc.d/ |-> |->But this still doesn't explain the "permission denied" error you see if you |->start dhcpd as root (assuming you *are* trying to start it as root, that is) I do some stuff from ports, some from source, and now that I know for sure what to do that will fix that. As for the permission denied, that would show up in the dhcpd log every 11 minutes. :) Dhcpd was starting fine and running, but operator would try to start it again every 11 mins from cron. Its been running fine now since I got the rc.conf issue worked out. Thanks muchly for this. Keith From owner-freebsd-isp@FreeBSD.ORG Fri Jul 7 02:52:26 2006 Return-Path: X-Original-To: freebsd-isp@freebsd.org Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B739716A4DA for ; Fri, 7 Jul 2006 02:52:26 +0000 (UTC) (envelope-from lists@stringsutils.com) Received: from zoraida.natserv.net (p65-147.acedsl.com [66.114.65.147]) by mx1.FreeBSD.org (Postfix) with ESMTP id 5806143D45 for ; Fri, 7 Jul 2006 02:52:26 +0000 (GMT) (envelope-from lists@stringsutils.com) Received: from zoraida.natserv.net (localhost.natserv.net [127.0.0.1]) by zoraida.natserv.net (Postfix) with ESMTP id 0CEC1B833 for ; Thu, 6 Jul 2006 22:52:23 -0400 (EDT) X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on zoraida.natserv.net X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=failed version=3.1.3 Received: from zoraida.natserv.net (zoraida.natserv.net [66.114.65.147]) by zoraida.natserv.net (Postfix) with ESMTP id C3370B822 for ; Thu, 6 Jul 2006 22:52:22 -0400 (EDT) Message-ID: X-Mailer: http://www.courier-mta.org/cone/ From: Francisco Reyes To: FreeBSD ISP Date: Thu, 06 Jul 2006 22:52:22 -0400 Mime-Version: 1.0 Content-Type: text/plain; format=flowed; charset="US-ASCII" Content-Disposition: inline Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV using ClamSMTP Subject: IAMP servers in FreeBSD for ISP X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Jul 2006 02:52:26 -0000 Anyone care to share what IMAP servers they have found to scale best? We are currently using courier and at times it seems it really will not scale well into thousands of emails. We have basically one setup with self contained machines that do all the work and a second setup where we break the load into MX machines, NFS to store the maildir for courier and front end machines to run courier and NFS. We can handle hundreds of accounts in the self contained, more or less ok (depending on the mix of pop or imap). The second setup is more complex to meassure since the load is distributed. The biggest problem with this second setup is that the front end machines end up needing to mount several of the Maildir NFS servers and we have found that one of the NFS servers going down can affect all of the front end machines. What have others found to scale well and what kind of hardware are you using? From owner-freebsd-isp@FreeBSD.ORG Fri Jul 7 03:00:21 2006 Return-Path: X-Original-To: freebsd-isp@freebsd.org Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 66E5816A4DA for ; Fri, 7 Jul 2006 03:00:21 +0000 (UTC) (envelope-from freebsd@hub.org) Received: from hub.org (hub.org [200.46.204.220]) by mx1.FreeBSD.org (Postfix) with ESMTP id BA02543D45 for ; Fri, 7 Jul 2006 03:00:20 +0000 (GMT) (envelope-from freebsd@hub.org) Received: from localhost (wm.hub.org [200.46.204.128]) by hub.org (Postfix) with ESMTP id B3B03290C29; Fri, 7 Jul 2006 00:00:19 -0300 (ADT) Received: from hub.org ([200.46.204.220]) by localhost (mx1.hub.org [200.46.204.128]) (amavisd-new, port 10024) with ESMTP id 92623-10; Fri, 7 Jul 2006 03:00:19 +0000 (UTC) Received: from ganymede.hub.org (blk-222-80-186.eastlink.ca [24.222.80.186]) by hub.org (Postfix) with ESMTP id 21A7C290C25; Fri, 7 Jul 2006 00:00:18 -0300 (ADT) Received: by ganymede.hub.org (Postfix, from userid 1027) id 4678C4A473; Fri, 7 Jul 2006 00:00:17 -0300 (ADT) Received: from localhost (localhost [127.0.0.1]) by ganymede.hub.org (Postfix) with ESMTP id 45AEF49018; Fri, 7 Jul 2006 00:00:17 -0300 (ADT) Date: Fri, 7 Jul 2006 00:00:17 -0300 (ADT) From: User Freebsd To: Francisco Reyes In-Reply-To: Message-ID: <20060706235712.A1171@ganymede.hub.org> References: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: FreeBSD ISP Subject: Re: IAMP servers in FreeBSD for ISP X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Jul 2006 03:00:21 -0000 On Thu, 6 Jul 2006, Francisco Reyes wrote: > Anyone care to share what IMAP servers they have found to scale best? By far, IMHO, the best is cyrus-imapd ... it was originally developed by Carnegie-Mellon University to handle their on campus email, and grew quickly out of that ... If I recall your environment at all, one nice feature of it is that it supports something called MURDER, which, effectively, is a way of having your mailboxes literally spread out over multiple backend servers ... all the mail comes in through ServerA, but, as an example, mailboxes a-m get stored on ServerB, and n-z go to ServerC ... They've also just recently added a replication ability, so that you can have backup servers ... ServerD is a backup of ServerB, ServerE is a backup of ServerC ... The thing is, it would most likely eliminate, or greatly reduce, your NFS requirements ... ---- Marc G. Fournier Hub.Org Networking Services (http://www.hub.org) Email . scrappy@hub.org MSN . scrappy@hub.org Yahoo . yscrappy Skype: hub.org ICQ . 7615664 From owner-freebsd-isp@FreeBSD.ORG Fri Jul 7 03:15:21 2006 Return-Path: X-Original-To: freebsd-isp@freebsd.org Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 10A1416A4DA for ; Fri, 7 Jul 2006 03:15:21 +0000 (UTC) (envelope-from lists@stringsutils.com) Received: from zoraida.natserv.net (p65-147.acedsl.com [66.114.65.147]) by mx1.FreeBSD.org (Postfix) with ESMTP id A676C43D45 for ; Fri, 7 Jul 2006 03:15:20 +0000 (GMT) (envelope-from lists@stringsutils.com) Received: from zoraida.natserv.net (localhost.natserv.net [127.0.0.1]) by zoraida.natserv.net (Postfix) with ESMTP id 4499EB833; Thu, 6 Jul 2006 23:15:18 -0400 (EDT) X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on zoraida.natserv.net X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=failed version=3.1.3 Received: from zoraida.natserv.net (zoraida.natserv.net [66.114.65.147]) by zoraida.natserv.net (Postfix) with ESMTP id 19A10B822; Thu, 6 Jul 2006 23:15:18 -0400 (EDT) References: Message-ID: X-Mailer: http://www.courier-mta.org/cone/ From: Francisco Reyes To: Francisco Reyes Date: Thu, 06 Jul 2006 23:15:18 -0400 Mime-Version: 1.0 Content-Type: text/plain; format=flowed; charset="US-ASCII" Content-Disposition: inline Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV using ClamSMTP Cc: FreeBSD ISP Subject: Re: IAMP servers in FreeBSD for ISP X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Jul 2006 03:15:21 -0000 Francisco Reyes writes: s/IAMP/IMAP/ :-) From owner-freebsd-isp@FreeBSD.ORG Fri Jul 7 03:24:57 2006 Return-Path: X-Original-To: freebsd-isp@freebsd.org Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 2C28B16A4DD for ; Fri, 7 Jul 2006 03:24:57 +0000 (UTC) (envelope-from lists@stringsutils.com) Received: from zoraida.natserv.net (p65-147.acedsl.com [66.114.65.147]) by mx1.FreeBSD.org (Postfix) with ESMTP id 8FBC243D4C for ; Fri, 7 Jul 2006 03:24:56 +0000 (GMT) (envelope-from lists@stringsutils.com) Received: from zoraida.natserv.net (localhost.natserv.net [127.0.0.1]) by zoraida.natserv.net (Postfix) with ESMTP id 14482B833; Thu, 6 Jul 2006 23:24:54 -0400 (EDT) X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on zoraida.natserv.net X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=failed version=3.1.3 Received: from zoraida.natserv.net (zoraida.natserv.net [66.114.65.147]) by zoraida.natserv.net (Postfix) with ESMTP id C17CCB822; Thu, 6 Jul 2006 23:24:53 -0400 (EDT) References: <20060706235712.A1171@ganymede.hub.org> Message-ID: X-Mailer: http://www.courier-mta.org/cone/ From: Francisco Reyes To: User Freebsd Date: Thu, 06 Jul 2006 23:24:53 -0400 Mime-Version: 1.0 Content-Type: text/plain; format=flowed; charset="US-ASCII" Content-Disposition: inline Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV using ClamSMTP Cc: FreeBSD ISP Subject: Re: IAMP servers in FreeBSD for ISP X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Jul 2006 03:24:57 -0000 User Freebsd writes: > If I recall your environment at all, one nice feature of it is that it > supports something called MURDER, which, effectively, is a way of having > your mailboxes literally spread out over multiple backend servers ... > all the mail comes in through ServerA, but, as an example, mailboxes a-m > get stored on ServerB, and n-z go to ServerC ... What happens if Server A dies? > They've also just recently added a replication ability, so that you can > have backup servers ... ServerD is a backup of ServerB, ServerE is a > backup of ServerC ... These backup servers are they for what you call A above or the storage machines? > The thing is, it would most likely eliminate, or greatly reduce, your NFS > requirements ... Now that you mention they have replication, it definitely is worth re-looking at it. I inheritted courier and at the time we were not growing as fast as we are now.. We used to get smaller accounts so the increase in load was always fairly small and we could extremely easily plan adding more capacity. Now that we have larger orders coming in it's a whole different game.. Eliminating NFS will be one great added bonus.. Will read up on Cyrus.. This replication feature, is it brand new or has it been been tested well by now? From owner-freebsd-isp@FreeBSD.ORG Fri Jul 7 03:29:03 2006 Return-Path: X-Original-To: freebsd-isp@freebsd.org Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 194FB16A4DA for ; Fri, 7 Jul 2006 03:29:03 +0000 (UTC) (envelope-from ormandj@corenode.com) Received: from zone2.corenode.com (zone2.corenode.com [66.91.129.184]) by mx1.FreeBSD.org (Postfix) with ESMTP id BD61443D45 for ; Fri, 7 Jul 2006 03:29:02 +0000 (GMT) (envelope-from ormandj@corenode.com) Received: from [10.0.1.22] ([66.8.217.8]) by zone2.corenode.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTPA id <0J2000KARKF50S00@zone2.corenode.com> for freebsd-isp@freebsd.org; Thu, 06 Jul 2006 17:30:41 -1000 (HST) Date: Thu, 06 Jul 2006 17:28:55 -1000 From: "David J. Orman" In-reply-to: To: Francisco Reyes Message-id: MIME-version: 1.0 X-Mailer: Apple Mail (2.752.2) Content-type: text/plain; charset=US-ASCII; delsp=yes; format=flowed Content-transfer-encoding: 7BIT References: Cc: FreeBSD ISP Subject: Re: IAMP servers in FreeBSD for ISP X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Jul 2006 03:29:03 -0000 I had good luck with Dovecot and a few thousand accounts (some with over 5 gigs of mail) prior to switching over to JES (JES is great, but wait for version 5 if you are interested. 4 is very, very complex to get working properly.) So, Dovecot for now, JES5 if you are interested once it's released (I believe 4th quarter '06). http://www.sun.com/software/javaenterprisesystem/ Yes, JES is free now (without support.) David On Jul 6, 2006, at 4:52 PM, Francisco Reyes wrote: > Anyone care to share what IMAP servers they have found to scale best? > > We are currently using courier and at times it seems it really will > not scale well into thousands of emails. > > We have basically one setup with self contained machines that do > all the work and a second setup where we break the load into MX > machines, NFS to store the maildir for courier and front end > machines to run courier and NFS. > > We can handle hundreds of accounts in the self contained, more or > less ok (depending on the mix of pop or imap). > > The second setup is more complex to meassure since the load is > distributed. The biggest problem with this second setup is that the > front end machines end up needing to mount several of the Maildir > NFS servers and we have found that one of the NFS servers going > down can affect all of the front end machines. > > What have others found to scale well and what kind of hardware are > you using? _______________________________________________ > freebsd-isp@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-isp > To unsubscribe, send any mail to "freebsd-isp-unsubscribe@freebsd.org" From owner-freebsd-isp@FreeBSD.ORG Fri Jul 7 03:30:38 2006 Return-Path: X-Original-To: isp@freebsd.org Delivered-To: freebsd-isp@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id C839416A4E8 for ; Fri, 7 Jul 2006 03:30:38 +0000 (UTC) (envelope-from fcash@ocis.net) Received: from smtp.sd73.bc.ca (smtp.sd73.bc.ca [142.24.13.140]) by mx1.FreeBSD.org (Postfix) with ESMTP id 0817D43D5D for ; Fri, 7 Jul 2006 03:30:36 +0000 (GMT) (envelope-from fcash@ocis.net) Received: from localhost (localhost [127.0.0.1]) by localhost.sd73.bc.ca (Postfix) with ESMTP id A8B018A0021; Thu, 6 Jul 2006 20:37:55 -0700 (PDT) Received: from smtp.sd73.bc.ca ([127.0.0.1]) by localhost (smtp.sd73.bc.ca [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 25614-02-16; Thu, 6 Jul 2006 20:37:48 -0700 (PDT) Received: from webmail.sd73.bc.ca (unknown [10.10.10.17]) by smtp.sd73.bc.ca (Postfix) with ESMTP id 54A4D8A0034; Thu, 6 Jul 2006 20:37:40 -0700 (PDT) Received: from webmail.sd73.bc.ca (localhost.localdomain [127.0.0.1]) by webmail.sd73.bc.ca (Postfix) with ESMTP id 140859000607; Thu, 6 Jul 2006 20:30:20 -0700 (PDT) Received: from 24.71.118.34 (SquirrelMail authenticated user fcash) by webmail.sd73.bc.ca with HTTP; Thu, 6 Jul 2006 20:30:20 -0700 (PDT) Message-ID: <63675.24.71.118.34.1152243020.squirrel@webmail.sd73.bc.ca> In-Reply-To: References: Date: Thu, 6 Jul 2006 20:30:20 -0700 (PDT) From: "Freddie Cash" To: "Francisco Reyes" User-Agent: SquirrelMail/1.5.1 MIME-Version: 1.0 Content-Type: text/plain;charset=iso-8859-1 Content-Transfer-Encoding: 8bit X-Virus-Scanned: by amavisd-new using ClamAV at sd73.bc.ca Cc: isp@freebsd.org Subject: Re: IAMP servers in FreeBSD for ISP X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: fcash@ocis.net List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Jul 2006 03:30:38 -0000 On Thu, July 6, 2006 7:52 pm, Francisco Reyes wrote: > Anyone care to share what IMAP servers they have found to scale best? > > > We are currently using courier and at times it seems it really will > not scale well into thousands of emails. > > We have basically one setup with self contained machines that do all > the work and a second setup where we break the load into MX machines, > NFS to store the maildir for courier and front end machines to run > courier and NFS. > > We can handle hundreds of accounts in the self contained, more or > less ok (depending on the mix of pop or imap). > > The second setup is more complex to meassure since the load is > distributed. The biggest problem with this second setup is that the > front end machines end up needing to mount several of the Maildir NFS > servers and we have found that one of the NFS servers going down can > affect all of the front end machines. > > What have others found to scale well and what kind of hardware are > you using? We used to use Courier IMAP, but then we found that it didn't handle directories with more than 15,000 messages too well. Especially with lots of threads in there. We moved to Cyrus IMAP, and haven't had issues since. Some of our users have 1.5 GB message stores, others are pushing 25,000 messages in single folders. We currently have less than 100 users on the mail server, but we hope to move over all 1600 from the other three servers they are currently on. The really nice thing about Cyrus is that you can cluster mail servers using the MURDER protocol to get a single unified account namespace across distributed systems. Sounds very cool, and gives you an upgrade path (just add servers as needed). Our IMAP server is currently running 64-bit Debian testing, Postfix, Cyrus IMAP, IMAP Proxy, Apache2, PHP, and SquirrelMail. Hardware is a Tyan K8SD-Pro (S2882) motherboard, 4 GB ECC DDR-SDRAM, 3Ware Escalade 9550SX 4-port RAID controller, 4x 150 GB SATA HD in RAID5, Broadcom Tygon3 GigE NIC. We initially had issues with Apache hogging all the RAM, but after tuning things we haven't had any issues. Don't expect we'll have issues until all 1600 accounts are on there, and then we can start moving services off to other servers (move SquirrelMail to a separate box, add IMAP servers using MURDER, etc). ---- Freddie Cash fcash@ocis.net From owner-freebsd-isp@FreeBSD.ORG Fri Jul 7 03:36:23 2006 Return-Path: X-Original-To: freebsd-isp@freebsd.org Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id AC97A16A4DD for ; Fri, 7 Jul 2006 03:36:23 +0000 (UTC) (envelope-from lists@stringsutils.com) Received: from zoraida.natserv.net (p65-147.acedsl.com [66.114.65.147]) by mx1.FreeBSD.org (Postfix) with ESMTP id 476C943D49 for ; Fri, 7 Jul 2006 03:36:23 +0000 (GMT) (envelope-from lists@stringsutils.com) Received: from zoraida.natserv.net (localhost.natserv.net [127.0.0.1]) by zoraida.natserv.net (Postfix) with ESMTP id 57767B833; Thu, 6 Jul 2006 23:36:20 -0400 (EDT) X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on zoraida.natserv.net X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=failed version=3.1.3 Received: from zoraida.natserv.net (zoraida.natserv.net [66.114.65.147]) by zoraida.natserv.net (Postfix) with ESMTP id 089B0B822; Thu, 6 Jul 2006 23:36:20 -0400 (EDT) References: Message-ID: X-Mailer: http://www.courier-mta.org/cone/ From: Francisco Reyes To: David =?ISO-8859-1?B?Si4=?= Orman Date: Thu, 06 Jul 2006 23:36:19 -0400 Mime-Version: 1.0 Content-Type: text/plain; format=flowed; charset="US-ASCII" Content-Disposition: inline Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV using ClamSMTP Cc: FreeBSD ISP Subject: Re: IAMP servers in FreeBSD for ISP X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Jul 2006 03:36:23 -0000 David J. Orman writes: > http://www.sun.com/software/javaenterprisesystem/ > > Yes, JES is free now (without support.) I thought FreeBSD's java performance was less than stellar.. Have you actually had a chance to use it in FreeBSD under heavy load? Just looked at their page and it's all "corporate speak" without any actual info that I would usefull.. Maybe I am not finding it.. but don't even see anywhere mention of IMAP/POP.. or what protocols their server supports. From owner-freebsd-isp@FreeBSD.ORG Fri Jul 7 03:46:09 2006 Return-Path: X-Original-To: freebsd-isp@freebsd.org Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 1349216A4DA for ; Fri, 7 Jul 2006 03:46:09 +0000 (UTC) (envelope-from ormandj@corenode.com) Received: from zone2.corenode.com (zone2.corenode.com [66.91.129.184]) by mx1.FreeBSD.org (Postfix) with ESMTP id AC61243D45 for ; Fri, 7 Jul 2006 03:46:08 +0000 (GMT) (envelope-from ormandj@corenode.com) Received: from [10.0.1.22] ([66.8.217.8]) by zone2.corenode.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTPA id <0J2000KBBL7Q0S00@zone2.corenode.com> for freebsd-isp@freebsd.org; Thu, 06 Jul 2006 17:47:51 -1000 (HST) Date: Thu, 06 Jul 2006 17:46:05 -1000 From: "David J. Orman" In-reply-to: To: Francisco Reyes Message-id: MIME-version: 1.0 X-Mailer: Apple Mail (2.752.2) Content-type: text/plain; charset=US-ASCII; delsp=yes; format=flowed Content-transfer-encoding: 7BIT References: Cc: FreeBSD ISP Subject: Re: IAMP servers in FreeBSD for ISP X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Jul 2006 03:46:09 -0000 I use it on Solaris machines (now that Solaris is also free), because I couldn't find anything on FBSD that was even close to comparable. I still use FreeBSD for all my webserving needs, but Solaris is 100% better from the NFS standpoint (they invented NFS, if I'm not mistaken!) and my own tests showed the NFS performance was absolutely superior. As you'll commonly hear, pick the best tool for the job. FreeBSD makes a better apache platform, so that's what I run apache on. All of my java web apps are on Solaris using parts of the JES stack. My identity management is on Solaris (JES - great LDAP server) as well as my file stores (ZFS... if you've kept up with things, you should understand) as well as the much improved NFS performance. My mail is Solaris, I've seen 100,000+ mail accounts on JES servers with no issues. But again, wait for JES5 if you're interested in giving it a shot, JES4 really is too much of a pain to learn at this point. In the meantime, I highly suggest Dovecot. There are some features that might not be there that you're looking for, I haven't kept up with Dovecot since I stopped using it. Cyrus as everybody mentioned is excellent as well. I had bad experiences with mailstore corruption a long while ago with Cyrus, it left a bad taste in my mouth, but those things have likely been ironed out by now (and were recoverable even then.) The only thing I'll warn you about, it uses a proprietary mailstore format, so if you ever migrate you'll need a converter. Just a heads up so you know what you're getting into! It was quite fast and handled heavy load well (until I experienced the corruption.) Cheers, David On Jul 6, 2006, at 5:36 PM, Francisco Reyes wrote: > David J. Orman writes: > >> http://www.sun.com/software/javaenterprisesystem/ >> Yes, JES is free now (without support.) > > I thought FreeBSD's java performance was less than stellar.. > Have you actually had a chance to use it in FreeBSD under heavy load? > > Just looked at their page and it's all "corporate speak" without > any actual info that I would usefull.. Maybe I am not finding it.. > but don't even see anywhere mention of IMAP/POP.. or what protocols > their server supports. > _______________________________________________ > freebsd-isp@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-isp > To unsubscribe, send any mail to "freebsd-isp-unsubscribe@freebsd.org" From owner-freebsd-isp@FreeBSD.ORG Fri Jul 7 04:06:46 2006 Return-Path: X-Original-To: freebsd-isp@freebsd.org Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7E69E16A4DA for ; Fri, 7 Jul 2006 04:06:46 +0000 (UTC) (envelope-from lists@stringsutils.com) Received: from zoraida.natserv.net (p65-147.acedsl.com [66.114.65.147]) by mx1.FreeBSD.org (Postfix) with ESMTP id A1BB843D77 for ; Fri, 7 Jul 2006 04:06:35 +0000 (GMT) (envelope-from lists@stringsutils.com) Received: from zoraida.natserv.net (localhost.natserv.net [127.0.0.1]) by zoraida.natserv.net (Postfix) with ESMTP id 42804B838; Fri, 7 Jul 2006 00:06:32 -0400 (EDT) X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on zoraida.natserv.net X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=failed version=3.1.3 Received: from zoraida.natserv.net (zoraida.natserv.net [66.114.65.147]) by zoraida.natserv.net (Postfix) with ESMTP id 05361B822; Fri, 7 Jul 2006 00:06:32 -0400 (EDT) References: Message-ID: X-Mailer: http://www.courier-mta.org/cone/ From: Francisco Reyes To: David =?ISO-8859-1?B?Si4=?= Orman Date: Fri, 07 Jul 2006 00:06:31 -0400 Mime-Version: 1.0 Content-Type: text/plain; format=flowed; charset="US-ASCII" Content-Disposition: inline Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV using ClamSMTP Cc: FreeBSD ISP Subject: Re: IAMP servers in FreeBSD for ISP X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Jul 2006 04:06:46 -0000 David J. Orman writes: > with Dovecot since I stopped using it. Cyrus as everybody mentioned > is excellent as well. I had bad experiences with mailstore corruption > a long while ago with Cyrus Heck I have had Maildir folders corruption with Courier.. if you can believe that is possible. It took me 3 days to figure out what was wrong. Thankfully it was my home setup, but if it had happened at work it would have been very problematic.. > it left a bad taste in my mouth, but > those things have likely been ironed out by now (and were recoverable > even then.) Yes I have read of simmilar experiences. No program is without fault. One can only pick the one closest to what one needs. >The only thing I'll warn you about, it uses a proprietary > mailstore format, so if you ever migrate you'll need a converter. Thanks for the warning. I aware of it. That special format is likely what allows it to be as efficient as mentioned by others. Thanks for all your feedback. From owner-freebsd-isp@FreeBSD.ORG Fri Jul 7 12:18:52 2006 Return-Path: X-Original-To: freebsd-isp@freebsd.org Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8A23116A4DE for ; Fri, 7 Jul 2006 12:18:52 +0000 (UTC) (envelope-from b.candler@pobox.com) Received: from proof.pobox.com (proof.pobox.com [207.106.133.28]) by mx1.FreeBSD.org (Postfix) with ESMTP id E75BE43D73 for ; Fri, 7 Jul 2006 12:18:51 +0000 (GMT) (envelope-from b.candler@pobox.com) Received: from proof (localhost [127.0.0.1]) by proof.pobox.com (Postfix) with ESMTP id C50F52A312; Fri, 7 Jul 2006 08:18:50 -0400 (EDT) Received: from mappit.local.linnet.org (212-74-113-67.static.dsl.as9105.com [212.74.113.67]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by proof.sasl.smtp.pobox.com (Postfix) with ESMTP id 716CB62558; Fri, 7 Jul 2006 08:18:48 -0400 (EDT) Received: from lists by mappit.local.linnet.org with local (Exim 4.61 (FreeBSD)) (envelope-from ) id 1FypIF-0009QO-0L; Fri, 07 Jul 2006 13:18:47 +0100 Date: Fri, 7 Jul 2006 13:18:46 +0100 From: Brian Candler To: User Freebsd Message-ID: <20060707121846.GA36201@uk.tiscali.com> References: <20060706235712.A1171@ganymede.hub.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20060706235712.A1171@ganymede.hub.org> User-Agent: Mutt/1.4.2.1i Cc: FreeBSD ISP , Francisco Reyes Subject: Re: IAMP servers in FreeBSD for ISP X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Jul 2006 12:18:52 -0000 On Fri, Jul 07, 2006 at 12:00:17AM -0300, User Freebsd wrote: > >Anyone care to share what IMAP servers they have found to scale best? > > By far, IMHO, the best is cyrus-imapd ... it was originally developed by > Carnegie-Mellon University to handle their on campus email, and grew > quickly out of that ... > > If I recall your environment at all, one nice feature of it is that it > supports something called MURDER, which, effectively, is a way of having > your mailboxes literally spread out over multiple backend servers ... > all the mail comes in through ServerA, but, as an example, mailboxes a-m > get stored on ServerB, and n-z go to ServerC ... > > They've also just recently added a replication ability, so that you can > have backup servers ... ServerD is a backup of ServerB, ServerE is a > backup of ServerC ... > > The thing is, it would most likely eliminate, or greatly reduce, your NFS > requirements ... Conversely, it also means that it is not safe to use with NFS backends. So if you already have a good and/or expensive NFS appliance, you won't want to use Cyrus. Remember that Courier has a proxy front-end built in, so you can use a proxy cluster instead of an NFS cluster (or even have some accounts on Courier and proxy others to Cyrus; a very nice migration tool) If you do want to go the Cyrus route, there are some good papers from Cambridge University in the UK describing their setup: http://www-uxsup.csx.cam.ac.uk/~fanf2/hermes/doc/talks/2004-02-ukuug/ http://www-uxsup.csx.cam.ac.uk/~fanf2/hermes/doc/talks/2005-02-eximconf/ Actually I have very good experience of courier-imap + exim in a large ISP environment, but the vast majority of users were POP3, not IMAP. Also, although Courier's sqwebmail has a not particularly pretty interface, it *does* perform very well under heavy usage (I suspect much better than a PHP->IMAP solution) since it accesses the Maildirs directly. Regards, Brian. From owner-freebsd-isp@FreeBSD.ORG Fri Jul 7 12:23:31 2006 Return-Path: X-Original-To: freebsd-isp@freebsd.org Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 659A116A4DE for ; Fri, 7 Jul 2006 12:23:31 +0000 (UTC) (envelope-from darren.pilgrim@bitfreak.org) Received: from mail.twinthornes.com (mail.twinthornes.com [65.75.198.147]) by mx1.FreeBSD.org (Postfix) with ESMTP id 17C7743D60 for ; Fri, 7 Jul 2006 12:23:30 +0000 (GMT) (envelope-from darren.pilgrim@bitfreak.org) Received: from [10.242.169.24] (c-67-171-135-169.hsd1.or.comcast.net [67.171.135.169]) by mail.twinthornes.com (Postfix) with ESMTP id 912D877; Fri, 7 Jul 2006 05:23:29 -0700 (PDT) Message-ID: <44AE5240.2080200@bitfreak.org> Date: Fri, 07 Jul 2006 05:23:28 -0700 From: Darren Pilgrim User-Agent: Thunderbird 1.5.0.4 (Windows/20060516) MIME-Version: 1.0 To: User Freebsd References: <20060706235712.A1171@ganymede.hub.org> In-Reply-To: <20060706235712.A1171@ganymede.hub.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: FreeBSD ISP , Francisco Reyes Subject: Re: IAMP servers in FreeBSD for ISP X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Jul 2006 12:23:31 -0000 User Freebsd wrote: > By far, IMHO, the best is cyrus-imapd ... it was originally developed by > Carnegie-Mellon University to handle their on campus email, and grew > quickly out of that ... > > If I recall your environment at all, one nice feature of it is that it > supports something called MURDER, which, effectively, is a way of having > your mailboxes literally spread out over multiple backend servers ... FWIW, Courier-IMAP 4 has a proxy feature wherein a single front-end IMAP server hands does the inital authentication, then determines the server handling the account and invisibly hands off the connection. -- Darren Pilgrim From owner-freebsd-isp@FreeBSD.ORG Fri Jul 7 14:56:24 2006 Return-Path: X-Original-To: freebsd-isp@freebsd.org Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9CD7716A4E1 for ; Fri, 7 Jul 2006 14:56:24 +0000 (UTC) (envelope-from lists@stringsutils.com) Received: from zoraida.natserv.net (p65-147.acedsl.com [66.114.65.147]) by mx1.FreeBSD.org (Postfix) with ESMTP id 31C7643D4C for ; Fri, 7 Jul 2006 14:56:24 +0000 (GMT) (envelope-from lists@stringsutils.com) Received: from zoraida.natserv.net (localhost.natserv.net [127.0.0.1]) by zoraida.natserv.net (Postfix) with ESMTP id 6402EB838; Fri, 7 Jul 2006 10:56:21 -0400 (EDT) X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on zoraida.natserv.net X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=failed version=3.1.3 Received: from zoraida.natserv.net (zoraida.natserv.net [66.114.65.147]) by zoraida.natserv.net (Postfix) with ESMTP id 23332B833; Fri, 7 Jul 2006 10:56:21 -0400 (EDT) References: <20060706235712.A1171@ganymede.hub.org> <44AE5240.2080200@bitfreak.org> Message-ID: X-Mailer: http://www.courier-mta.org/cone/ From: Francisco Reyes To: Darren Pilgrim Date: Fri, 07 Jul 2006 10:56:20 -0400 Mime-Version: 1.0 Content-Type: text/plain; format=flowed; charset="US-ASCII" Content-Disposition: inline Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV using ClamSMTP Cc: FreeBSD ISP , User Freebsd Subject: Re: IAMP servers in FreeBSD for ISP X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Jul 2006 14:56:24 -0000 Darren Pilgrim writes: > FWIW, Courier-IMAP 4 has a proxy feature wherein a single front-end IMAP > server hands does the inital authentication, then determines the server > handling the account and invisibly hands off the connection. We tried that. The proxy did not seem to "hand off" the connection. Instead for each connection there was one process running in the proxy and another on the actual machine doing the actual serving. So if we had Machine A as proxy. Machine B doing work Machine C doing work. We saw that if 500 connections came to B and 500 to C... there would be 1000 connections on A. Is that how it's supposed to work or perhaps we didn't configure it properly? From owner-freebsd-isp@FreeBSD.ORG Fri Jul 7 15:03:53 2006 Return-Path: X-Original-To: freebsd-isp@freebsd.org Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id C036316A4DE for ; Fri, 7 Jul 2006 15:03:53 +0000 (UTC) (envelope-from lists@stringsutils.com) Received: from zoraida.natserv.net (p65-147.acedsl.com [66.114.65.147]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6C9FE43D5A for ; Fri, 7 Jul 2006 15:03:46 +0000 (GMT) (envelope-from lists@stringsutils.com) Received: from zoraida.natserv.net (localhost.natserv.net [127.0.0.1]) by zoraida.natserv.net (Postfix) with ESMTP id 2D6D9B86F; Fri, 7 Jul 2006 11:03:43 -0400 (EDT) X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on zoraida.natserv.net X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=failed version=3.1.3 Received: from zoraida.natserv.net (zoraida.natserv.net [66.114.65.147]) by zoraida.natserv.net (Postfix) with ESMTP id E6A20B84D; Fri, 7 Jul 2006 11:03:42 -0400 (EDT) References: <20060706235712.A1171@ganymede.hub.org> <20060707121846.GA36201@uk.tiscali.com> Message-ID: X-Mailer: http://www.courier-mta.org/cone/ From: Francisco Reyes To: Brian Candler Date: Fri, 07 Jul 2006 11:03:42 -0400 Mime-Version: 1.0 Content-Type: text/plain; format=flowed; charset="US-ASCII" Content-Disposition: inline Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV using ClamSMTP Cc: FreeBSD ISP , User Freebsd Subject: Re: IAMP servers in FreeBSD for ISP X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Jul 2006 15:03:53 -0000 Brian Candler writes: > Conversely, it also means that it is not safe to use with NFS backends. So > if you already have a good and/or expensive NFS appliance, you won't want to > use Cyrus. Thankfully we don't have any big investment in an expensive NFS appliance. > Remember that Courier has a proxy front-end built in, so you can use a proxy > cluster instead of an NFS cluster (or even have some accounts on Courier and > proxy others to Cyrus; a very nice migration tool) We tried the proxy once.. but the proxy machine was keeping an instance running during the connection. Basically we saw a connection on the proxy machine and another in the destination machine. Not sure if this is how it is supposed to work or if we missconfigured. > If you do want to go the Cyrus route, there are some good papers from > Cambridge University in the UK describing their setup: Will check them up. Thanks. > Actually I have very good experience of courier-imap + exim in a large ISP > environment, but the vast majority of users were POP3, not IMAP. We have a mix and some users large directories with thousands of files. > although Courier's sqwebmail has a not particularly pretty interface, it > *does* perform very well under heavy usage Even with Inbox with large number of files? Say 5,000+ Unfortunately it's common for our users to let their mail pile up.. Specially the Spam folder. Sometimes they can't even clean their spam folder and we had to write a program to delete mail from the spam folder after so many days (based on customer setting). From owner-freebsd-isp@FreeBSD.ORG Fri Jul 7 15:08:43 2006 Return-Path: X-Original-To: freebsd-isp@freebsd.org Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 529CE16A4DD for ; Fri, 7 Jul 2006 15:08:43 +0000 (UTC) (envelope-from b.candler@pobox.com) Received: from rune.pobox.com (rune.pobox.com [208.210.124.79]) by mx1.FreeBSD.org (Postfix) with ESMTP id 0F80E43D6D for ; Fri, 7 Jul 2006 15:08:34 +0000 (GMT) (envelope-from b.candler@pobox.com) Received: from rune (localhost [127.0.0.1]) by rune.pobox.com (Postfix) with ESMTP id D83AB79CE6; Fri, 7 Jul 2006 11:08:55 -0400 (EDT) Received: from mappit.local.linnet.org (212-74-113-67.static.dsl.as9105.com [212.74.113.67]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by rune.sasl.smtp.pobox.com (Postfix) with ESMTP id 648F878A41; Fri, 7 Jul 2006 11:08:53 -0400 (EDT) Received: from brian by mappit.local.linnet.org with local (Exim 4.61 (FreeBSD)) (envelope-from ) id 1FyrwT-0009XV-BF; Fri, 07 Jul 2006 16:08:29 +0100 Date: Fri, 7 Jul 2006 16:08:29 +0100 From: Brian Candler To: Francisco Reyes Message-ID: <20060707150829.GA36657@uk.tiscali.com> References: <20060706235712.A1171@ganymede.hub.org> <20060707121846.GA36201@uk.tiscali.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.1i Cc: FreeBSD ISP , User Freebsd Subject: Re: IAMP servers in FreeBSD for ISP X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Jul 2006 15:08:43 -0000 On Fri, Jul 07, 2006 at 11:03:42AM -0400, Francisco Reyes wrote: > >Remember that Courier has a proxy front-end built in, so you can use a > >proxy > >cluster instead of an NFS cluster (or even have some accounts on Courier > >and > >proxy others to Cyrus; a very nice migration tool) > > We tried the proxy once.. but the proxy machine was keeping an instance > running during the connection. Basically we saw a connection on the proxy > machine and another in the destination machine. Not sure if this is how it > is supposed to work or if we missconfigured. You will see a process running on the proxy machine for the duration of the connection; all it is doing is copying messages back and forth. There will be one process per connection, and this is how it's supposed to work. A process in the process table is not particularly expensive, and its RAM usage should be very low; however I'd agree that a single-process threaded proxy would be cheaper. > >although Courier's sqwebmail has a not particularly pretty interface, it > >*does* perform very well under heavy usage > > Even with Inbox with large number of files? > Say 5,000+ Most users had a 10MB quota :-) We also bounced incoming mail for mailboxes which had not been logged into for 6 weeks. Regards, Brian. From owner-freebsd-isp@FreeBSD.ORG Fri Jul 7 15:31:38 2006 Return-Path: X-Original-To: isp@freebsd.org Delivered-To: freebsd-isp@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 70A6C16A4DA for ; Fri, 7 Jul 2006 15:31:38 +0000 (UTC) (envelope-from fcash@ocis.net) Received: from smtp.sd73.bc.ca (smtp.sd73.bc.ca [142.24.13.140]) by mx1.FreeBSD.org (Postfix) with ESMTP id 039F043D46 for ; Fri, 7 Jul 2006 15:31:37 +0000 (GMT) (envelope-from fcash@ocis.net) Received: from localhost (localhost [127.0.0.1]) by localhost.sd73.bc.ca (Postfix) with ESMTP id 4190A8A007E; Fri, 7 Jul 2006 08:38:59 -0700 (PDT) Received: from smtp.sd73.bc.ca ([127.0.0.1]) by localhost (smtp.sd73.bc.ca [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 53213-01-33; Fri, 7 Jul 2006 08:38:52 -0700 (PDT) Received: from webmail.sd73.bc.ca (unknown [10.10.10.17]) by smtp.sd73.bc.ca (Postfix) with ESMTP id 50D348A00B2; Fri, 7 Jul 2006 08:38:44 -0700 (PDT) Received: from webmail.sd73.bc.ca (localhost.localdomain [127.0.0.1]) by webmail.sd73.bc.ca (Postfix) with ESMTP id 3DBE8900060F; Fri, 7 Jul 2006 08:31:22 -0700 (PDT) Received: from 192.168.0.10 (SquirrelMail authenticated user fcash) by webmail.sd73.bc.ca with HTTP; Fri, 7 Jul 2006 08:31:22 -0700 (PDT) Message-ID: <37556.192.168.0.10.1152286282.squirrel@webmail.sd73.bc.ca> In-Reply-To: References: Date: Fri, 7 Jul 2006 08:31:22 -0700 (PDT) From: "Freddie Cash" To: "David J. Orman" User-Agent: SquirrelMail/1.5.1 MIME-Version: 1.0 Content-Type: text/plain;charset=iso-8859-1 Content-Transfer-Encoding: 8bit X-Virus-Scanned: by amavisd-new using ClamAV at sd73.bc.ca Cc: isp@freebsd.org Subject: Re: IAMP servers in FreeBSD for ISP X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: fcash@ocis.net List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Jul 2006 15:31:38 -0000 On Thu, July 6, 2006 8:46 pm, David J. Orman wrote: > The only thing I'll warn you about, it uses a proprietary > mailstore format, so if you ever migrate you'll need a converter. Just > a heads up so you know what you're getting into! It was quite fast and > handled heavy load well (until I experienced the corruption.) I used to think that, until someone told me to actually look at the messages on disk. Cyrus uses Maildir format for the actual messages. It keeps a bunch of extra databases for things like message status, message count, indexing and the like. But the actual messages are stored as plain Maildir. You can view all the messages with any text editor. To "convert" messages between any two IMAP servers, I've found the imapsync program to work the best. It sync any two accounts on any two IMAP servers (or any two accounts on one IMAP server). Since it uses IMAP to do the sync, the actual message storage format doesn't matter. The IMAP servers just pass plain text around. :) Works like a hot damn, and is a lot simpler, easier, better than all those mbox2maildir-type perl scripts. ---- Freddie Cash fcash@ocis.net From owner-freebsd-isp@FreeBSD.ORG Fri Jul 7 20:45:53 2006 Return-Path: X-Original-To: freebsd-isp@freebsd.org Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9667C16A4DD for ; Fri, 7 Jul 2006 20:45:53 +0000 (UTC) (envelope-from darren.pilgrim@bitfreak.org) Received: from mail.twinthornes.com (mail.twinthornes.com [65.75.198.147]) by mx1.FreeBSD.org (Postfix) with ESMTP id 46B6643D69 for ; Fri, 7 Jul 2006 20:45:53 +0000 (GMT) (envelope-from darren.pilgrim@bitfreak.org) Received: from [10.242.169.24] (c-67-171-135-169.hsd1.or.comcast.net [67.171.135.169]) by mail.twinthornes.com (Postfix) with ESMTP id 5A7BB21; Fri, 7 Jul 2006 13:45:52 -0700 (PDT) Message-ID: <44AEC800.8050509@bitfreak.org> Date: Fri, 07 Jul 2006 13:45:52 -0700 From: Darren Pilgrim User-Agent: Thunderbird 1.5.0.4 (Windows/20060516) MIME-Version: 1.0 To: Francisco Reyes References: <20060706235712.A1171@ganymede.hub.org> <44AE5240.2080200@bitfreak.org> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: FreeBSD ISP Subject: Re: IAMP servers in FreeBSD for ISP X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Jul 2006 20:45:53 -0000 Francisco Reyes wrote: > Darren Pilgrim writes: > >> FWIW, Courier-IMAP 4 has a proxy feature wherein a single front-end >> IMAP server hands does the inital authentication, then determines the >> server handling the account and invisibly hands off the connection. > > We tried that. The proxy did not seem to "hand off" the connection. > Instead for each connection there was one process running in the proxy > and another on the actual machine doing the actual serving. > > So if we had > Machine A as proxy. > > Machine B doing work > > Machine C doing work. > > We saw that if 500 connections came to B and 500 to C... there would be > 1000 connections on A. > > Is that how it's supposed to work or perhaps we didn't configure it > properly? That's exactly how it's supposed to work. After the initial authentication, A isn't doing any real work, just passing packets between the client and the backend server. -- Darren Pilgrim From owner-freebsd-isp@FreeBSD.ORG Fri Jul 7 22:31:08 2006 Return-Path: X-Original-To: freebsd-isp@freebsd.org Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id CF08F16A4E5 for ; Fri, 7 Jul 2006 22:31:08 +0000 (UTC) (envelope-from lists@stringsutils.com) Received: from zoraida.natserv.net (p65-147.acedsl.com [66.114.65.147]) by mx1.FreeBSD.org (Postfix) with ESMTP id 1F22243D53 for ; Fri, 7 Jul 2006 22:31:08 +0000 (GMT) (envelope-from lists@stringsutils.com) Received: from zoraida.natserv.net (localhost.natserv.net [127.0.0.1]) by zoraida.natserv.net (Postfix) with ESMTP id 8B4F7B840; Fri, 7 Jul 2006 18:31:05 -0400 (EDT) X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on zoraida.natserv.net X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=failed version=3.1.3 Received: from 35st-server.simplicato.com (static-71-249-233-130.nycmny.east.verizon.net [71.249.233.130]) by zoraida.natserv.net (Postfix) with ESMTP id 1D01AB838; Fri, 7 Jul 2006 18:31:05 -0400 (EDT) References: <20060706235712.A1171@ganymede.hub.org> <44AE5240.2080200@bitfreak.org> <44AEC800.8050509@bitfreak.org> Message-ID: X-Mailer: http://www.courier-mta.org/cone/ From: Francisco Reyes To: Darren Pilgrim Date: Fri, 07 Jul 2006 18:31:04 -0400 Mime-Version: 1.0 Content-Type: text/plain; format=flowed; charset="US-ASCII" Content-Disposition: inline Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV using ClamSMTP Cc: FreeBSD ISP Subject: Re: IAMP servers in FreeBSD for ISP X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Jul 2006 22:31:08 -0000 Darren Pilgrim writes: > That's exactly how it's supposed to work. After the initial > authentication, A isn't doing any real work, just passing packets > between the client and the backend server. If I recall correctly the one thing I found dissapointing was that the proxy machine used just as much memory for the proxy service as a the real imap connections. Right now I am leaning towards Cyrus.. Specially now that it has replication. Going to switch my home/test bed to Cyrus.. From owner-freebsd-isp@FreeBSD.ORG Fri Jul 7 22:47:20 2006 Return-Path: X-Original-To: freebsd-isp@freebsd.org Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 615EE16A4E0 for ; Fri, 7 Jul 2006 22:47:20 +0000 (UTC) (envelope-from fcash@ocis.net) Received: from smtp.sd73.bc.ca (smtp.sd73.bc.ca [142.24.13.140]) by mx1.FreeBSD.org (Postfix) with ESMTP id E58F343D45 for ; Fri, 7 Jul 2006 22:47:19 +0000 (GMT) (envelope-from fcash@ocis.net) Received: from localhost (localhost [127.0.0.1]) by localhost.sd73.bc.ca (Postfix) with ESMTP id E0DFC8A00C4 for ; Fri, 7 Jul 2006 15:54:41 -0700 (PDT) Received: from smtp.sd73.bc.ca ([127.0.0.1]) by localhost (smtp.sd73.bc.ca [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 45296-03-34 for ; Fri, 7 Jul 2006 15:54:34 -0700 (PDT) Received: from webmail.sd73.bc.ca (unknown [10.10.10.17]) by smtp.sd73.bc.ca (Postfix) with ESMTP id 83B2A8A00C8 for ; Fri, 7 Jul 2006 15:54:33 -0700 (PDT) Received: from webmail.sd73.bc.ca (localhost.localdomain [127.0.0.1]) by webmail.sd73.bc.ca (Postfix) with ESMTP id 7A83A9000615 for ; Fri, 7 Jul 2006 15:47:10 -0700 (PDT) Received: from 192.168.0.10 (SquirrelMail authenticated user fcash) by webmail.sd73.bc.ca with HTTP; Fri, 7 Jul 2006 15:47:10 -0700 (PDT) Message-ID: <50082.192.168.0.10.1152312430.squirrel@webmail.sd73.bc.ca> In-Reply-To: References: <20060706235712.A1171@ganymede.hub.org> <44AE5240.2080200@bitfreak.org> <44AEC800.8050509@bitfreak.org> Date: Fri, 7 Jul 2006 15:47:10 -0700 (PDT) From: "Freddie Cash" To: "FreeBSD ISP" User-Agent: SquirrelMail/1.5.1 MIME-Version: 1.0 Content-Type: text/plain;charset=iso-8859-1 Content-Transfer-Encoding: 8bit X-Virus-Scanned: by amavisd-new using ClamAV at sd73.bc.ca Subject: Re: IAMP servers in FreeBSD for ISP X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: fcash@ocis.net List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Jul 2006 22:47:20 -0000 On Fri, July 7, 2006 3:31 pm, Francisco Reyes wrote: > Darren Pilgrim writes: >> That's exactly how it's supposed to work. After the initial >> authentication, A isn't doing any real work, just passing packets >> between the client and the backend server. > > If I recall correctly the one thing I found dissapointing was that > the proxy machine used just as much memory for the proxy service as a > the real imap connections. > > Right now I am leaning towards Cyrus.. > Specially now that it has replication. > > Going to switch my home/test bed to Cyrus.. If you (or anyone out there) get a Cyrus cluster working using MURDER, I'd like to pick your brain, if you don't mind. :) We'll be moving down that road at some point in the next year or so, and it's still all cloudy and fuzzy in my head how it all works. There's lots of documentation out there, but there's not a lot of good documentation with examples (that I can understand, anyway). ---- Freddie Cash fcash@ocis.net From owner-freebsd-isp@FreeBSD.ORG Sat Jul 8 21:42:49 2006 Return-Path: X-Original-To: isp@freebsd.org Delivered-To: freebsd-isp@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 984E816A4E7 for ; Sat, 8 Jul 2006 21:42:49 +0000 (UTC) (envelope-from b.candler@pobox.com) Received: from rune.pobox.com (rune.pobox.com [208.210.124.79]) by mx1.FreeBSD.org (Postfix) with ESMTP id 85A5043D79 for ; Sat, 8 Jul 2006 21:42:30 +0000 (GMT) (envelope-from b.candler@pobox.com) Received: from rune (localhost [127.0.0.1]) by rune.pobox.com (Postfix) with ESMTP id 7AB40792D4; Sat, 8 Jul 2006 17:42:51 -0400 (EDT) Received: from mappit.local.linnet.org (212-74-113-67.static.dsl.as9105.com [212.74.113.67]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by rune.sasl.smtp.pobox.com (Postfix) with ESMTP id 20C217325F; Sat, 8 Jul 2006 17:42:49 -0400 (EDT) Received: from lists by mappit.local.linnet.org with local (Exim 4.61 (FreeBSD)) (envelope-from ) id 1FzKZF-000Aj6-3X; Sat, 08 Jul 2006 22:42:25 +0100 Date: Sat, 8 Jul 2006 22:42:25 +0100 From: Brian Candler To: Freddie Cash Message-ID: <20060708214225.GB41178@uk.tiscali.com> References: <37556.192.168.0.10.1152286282.squirrel@webmail.sd73.bc.ca> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <37556.192.168.0.10.1152286282.squirrel@webmail.sd73.bc.ca> User-Agent: Mutt/1.4.2.1i Cc: "David J. Orman" , isp@freebsd.org Subject: Re: IAMP servers in FreeBSD for ISP X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 Jul 2006 21:42:49 -0000 On Fri, Jul 07, 2006 at 08:31:22AM -0700, Freddie Cash wrote: > > The only thing I'll warn you about, it uses a proprietary > > mailstore format, so if you ever migrate you'll need a converter. Just > > a heads up so you know what you're getting into! It was quite fast and > > handled heavy load well (until I experienced the corruption.) > > I used to think that, until someone told me to actually look at the > messages on disk. Cyrus uses Maildir format for the actual messages. No, it doesn't. Certainly it keeps each message in a separate file; but that by itself is not enough to be Maildir. djb's original spec for Maildir is at http://cr.yp.to/proto/maildir.html > It keeps a bunch of extra databases for things like message status, > message count, indexing and the like. But the actual messages are > stored as plain Maildir. No. > You can view all the messages with any text editor. Yes. Regards, Brian.