Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 14 Feb 2006 22:40:59 -0500
From:      Benjamin D Adams <adams.benjamin@gmail.com>
To:        freebsd-current@freebsd.org
Subject:   IMAP problem I found on another mailing list
Message-ID:  <1139974859.1416.1.camel@7Current.FreeBSDWorld.NET>

next in thread | raw e-mail | index | archive | help

--=-yfs8DPFKG+GyWmG1hwUe
Content-Type: text/plain
Content-Transfer-Encoding: 7bit

I saw this problem on the cyrus-imap mailing list.  Thought I would pass
on the information

--=-yfs8DPFKG+GyWmG1hwUe
Content-Disposition: inline
Content-Description: Forwarded message - RE: slow IMAP data transfer (SOLVED)
Content-Type: message/rfc822

Return-Path: <info-cyrus-bounces@lists.andrew.cmu.edu>
Received: from murder ([unix socket]) by localhost (Cyrus v2.2.12-OS X
	10.4.0) with LMTPA; Tue, 14 Feb 2006 10:12:04 -0500
X-Sieve: CMU Sieve 2.2
Received: from localhost (localhost [127.0.0.1]) by ambrosiasw.com
	(Postfix) with ESMTP id 0DDFA34831A1 for <badams@ambrosiasw.com>;
	Tue, 14 Feb 2006 10:12:04 -0500 (EST)
Received: from ambrosiasw.com ([127.0.0.1]) by localhost
	(xanadu.ambrosiasw.com [127.0.0.1]) (amavisd-new,
	port 10024) with ESMTP id 09243-07 for <badams@ambrosiasw.com>;
	Tue, 14 Feb 2006 10:12:00 -0500 (EST)
Received: from lists2.andrew.cmu.edu (lists2.andrew.cmu.edu [128.2.10.216])
	by ambrosiasw.com (Postfix) with ESMTP id 3E76D3483189 for
	<badams@ambrosiasw.com>; Tue, 14 Feb 2006 10:12:00 -0500 (EST)
Received: from LISTS2.andrew.cmu.edu (localhost [127.0.0.1]) by
	lists2.andrew.cmu.edu (8.13.4/8.13.4) with ESMTP id k1EF7RGN016488;
	Tue, 14 Feb 2006 10:07:43 -0500
X-Mailman-Handler: $Id: mm-handler,v 1.2 2002/04/05 19:41:09 bwarsaw Exp $
Received: from mail2.one.lv (mail2.one.lv [62.85.54.8] (may be forged)) by
	lists2.andrew.cmu.edu (8.13.4/8.13.4) with SMTP id k1EF7Olv016479 for
	<info-cyrus@lists.andrew.cmu.edu>; Tue, 14 Feb 2006 10:07:25 -0500
Received: (qmail 5637 invoked from network); 14 Feb 2006 15:07:23 -0000
Received: from localhost (HELO mail2.one.lv) (127.0.0.1) by mail2.one.lv
	with SMTP; 14 Feb 2006 15:07:23 -0000
Message-ID: <11584526.1139929643096.JavaMail.root@mail2.one.lv>
Date: Tue, 14 Feb 2006 17:07:23 +0200 (GMT+02:00)
From: Juris Orlovs <jollyroger@one.lv>
To: "info-cyrus@lists.andrew.cmu.edu" <info-cyrus@lists.andrew.cmu.edu>
Mime-Version: 1.0
Content-Type: text/plain; charset=utf-8
X-Spam-Clean: 7% (__C230066_P5 0, __CT 0, __CTE 0, __CT_TEXT_PLAIN 0,
	__HAS_MSGID 0, __HIGHBITS 0, __MIME_TEXT_ONLY 0, __MIME_VERSION 0,
	__SANE_MSGID 0, __STOCK_CRUFT 0)
X-Greylist: Message is not spam, not delayed by milter-greylist-2.0.2
	(lists2.andrew.cmu.edu [0.0.0.0]); Tue, 14 Feb 2006 10:08:00 -0500 (EST)
X-Greylist: Message is not spam, not delayed by milter-greylist-2.0.2
	(lists2.andrew.cmu.edu [128.2.10.216]); Tue, 14 Feb 2006 10:07:25 -0500
	(EST)
Subject: RE: slow IMAP data transfer (SOLVED)
X-BeenThere: info-cyrus@lists.andrew.cmu.edu
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Discussion group for Cyrus email system
	<info-cyrus.lists.andrew.cmu.edu>
List-Unsubscribe: <https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus>, 
	<mailto:info-cyrus-request@lists.andrew.cmu.edu?subject=unsubscribe>
List-Archive: <https://lists.andrew.cmu.edu/mailman/private/info-cyrus>;
List-Post: <mailto:info-cyrus@lists.andrew.cmu.edu>
List-Help: <mailto:info-cyrus-request@lists.andrew.cmu.edu?subject=help>
List-Subscribe: <https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus>,
	<mailto:info-cyrus-request@lists.andrew.cmu.edu?subject=subscribe>
Sender: info-cyrus-bounces@lists.andrew.cmu.edu
Errors-To: info-cyrus-bounces@lists.andrew.cmu.edu
X-Spam-Notice: Not scanning again because message was previously scanned
X-Virus-Scanned: by amavisd-new at ambrosiasw.com
X-Spam-Status: No, hits=0 tagged_above=-999 required=5 tests=
X-Spam-Level: 
Content-Transfer-Encoding: 8bit

Problem solved!

"sysctl -w net.inet.tcp.delayed_ack=0" solves problem for IMAP and also Postfix, so mainly fsync() was no issue. I had no time to searh why this so drastically affects performance, but maybe somebody will know the answer.


-----Sākotnējā ziņa-----
No: "Juris Orlovs" <jollyroger@one.lv>
Sūtīts: 2006-02-09 12:26:13.68
Kam: "info-cyrus@lists.andrew.cmu.edu" <info-cyrus@lists.andrew.cmu.edu>
Par: slow IMAP data transfer

Hello

I'm trying to set up Cyrus IMAP on freebsd 6.0, but i have problems with performance of it. There is a big issue with message writing to IMAP folders and also with reading a large quantities of messages. Reading of 8MB message takes a bit less than a second, but in that time 8MB message write to IMAP folder over 100Mbit/s connection takes ~6 seconds longer. Also, as I am only one by now who uses this server there could be no chance of big resouce utilization.

Reading/writing ~650 messages, each 1KB) from/to imap folder sends huge amounts of data to RAID 1 arrays. It can be seen using an iostat in that process.

Hardware (2x 3GHx Xeon, 2GB RAM, Adaptec 2410SA,
2x WD RAPTOR 74GB (aacd0)(system), 2x SEAGATE 300GB (aacd1)(mail storage))

Before that I was setting up Cyrus IMAP mail servers on Linux and there was no such problems. Maybe it's OS issue? I also have set up such system on Celeron 800MHz, 256MB RAM and 80GB SEAGATE (FreeBSD 4.11), the results are aproximately the same.
For SMTP i'm using Postfix, and it also shows bad results on data transfer. Seems that the biggest problems I have with mail software, because other services like FTP doesn't show such bad results.

--------------------------------------------------------------------
READING 650 messages
--------------------------------------------------------------------
mx# iostat -Iw 3
      tty           aacd0            aacd1             cpu
 tin tout  KB/t xfrs   MB   KB/t xfrs   MB  us ni sy in id
   0   50 17.54 390334 6687.51  22.46 296070 6492.93   0  0  0  0 100
   0   64 16.00  41  0.64  16.00   1  0.02   0  0  0  0 100
   0   20 13.00   8  0.10   0.00   0  0.00   1  0  0  0 99
   0   20  0.00   0  0.00   0.00   0  0.00   0  0  0  0 100
   0   20 13.78 130  1.75  14.67 117  1.68   0  0  1  1 98
   0   20 14.64 171  2.45  14.67 120  1.72   0  0  0  0 99
   0   20 10.18 201  2.00  14.66 131  1.88   0  0  2  1 98
   0   20 12.02 185  2.17  15.25 134  2.00   0  0  1  0 99
   0   20 14.23 179  2.49  15.85 135  2.09   0  0  0  0 99
   0   20 12.28 215  2.58  16.00 132  2.06   0  0  1  0 99
   0   20 10.82 196  2.07  16.00 133  2.08   0  0  1  0 99
   0   20 12.80 183  2.29  16.00 135  2.11   0  0  1  0 99
   0   20 15.10 178  2.62  16.00 133  2.08   0  0  1  0 99
   0   20 10.53 205  2.11  16.00 132  2.06   0  0  1  0 99
   0   20 11.19 178  1.95  16.00 132  2.06   0  0  1  0 99
   0   20 13.61 179  2.38  16.00 132  2.06   0  0  1  1 99
   0   20 13.85 195  2.64  16.00 135  2.11   0  0  1  0 98
   0   20 10.07 189  1.86  16.00 133  2.08   0  0  1  0 98
--------------------------------------------------------------------

--------------------------------------------------------------------
WRITING 650 messages
--------------------------------------------------------------------
mx# iostat -Iw 3
      tty           aacd0            aacd1             cpu
 tin tout  KB/t xfrs   MB   KB/t xfrs   MB  us ni sy in id
   0   50 17.50 393390 6724.61  22.40 298277 6526.03   0  0  0  0 100
   0   64  9.00 100  0.88  12.90 309  3.89   0  0  0  0 99
   0   20  9.00 100  0.88  13.03 303  3.86   0  0  1  0 99
   0   20  9.28 100  0.91  12.49 304  3.71   0  0  1  0 99
   0   20  9.00 100  0.88  11.99 305  3.57   0  0  1  0 98
   0   20  9.00 100  0.88  12.23 310  3.70   1  0  1  0 99
   0   20  9.00 100  0.88  12.43 312  3.79   0  0  1  0 99
   0   20  8.66 109  0.92  12.60 309  3.80   0  0  0  0 99
   0   20  9.00 100  0.88  12.72 305  3.79   0  0  1  0 98
   0   20 10.35 124  1.25  12.96 315  3.99   0  0  0  0 99
   0   20  9.00 100  0.88  13.18 310  3.99   0  0  1  0 99
   0   20  9.00  96  0.84  13.25 299  3.87   0  0  0  0 99
   0   20  9.33 105  0.96  13.42 309  4.05   0  0  0  0 99
   0   20  9.00 100  0.88  13.41 309  4.05   0  0  1  0 99
   0   20  9.00 100  0.88  13.40 308  4.03   0  0  0  0 99
   0   20  9.00 100  0.88  13.43 309  4.05   0  0  1  0 99
   0   20  9.00 100  0.88  13.52 311  4.11   0  0  1  0 99
   0   20  8.83 103  0.89  13.56 308  4.08   1  0  1  0 99
   0   20  9.00 100  0.88  13.60 301  4.00   0  0  1  0 99
   0   20  9.00  96  0.84  13.56 306  4.05   0  0  1  0 99
--------------------------------------------------------------------



-------------------------------------------------------------------------------
http://www.one.lv - Tavs mobilais e-pasts!

Tagad lasi savu e-pastu ar mobilo telefonu - wap.one.lv!

-------------------------------------------------------------------------------
http://www.one.lv - Tavs mobilais e-pasts!

Tagad lasi savu e-pastu ar mobilo telefonu - wap.one.lv!
----
Cyrus Home Page: http://asg.web.cmu.edu/cyrus
Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


--=-yfs8DPFKG+GyWmG1hwUe--




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1139974859.1416.1.camel>