From owner-freebsd-stable@FreeBSD.ORG Mon Mar 28 08:10:16 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6BE4C1065673; Mon, 28 Mar 2011 08:10:16 +0000 (UTC) (envelope-from eugene@home.wdc.spb.ru) Received: from mail.wdc.spb.ru (mail.wdc.spb.ru [89.223.110.23]) by mx1.freebsd.org (Postfix) with ESMTP id C41528FC13; Mon, 28 Mar 2011 08:10:15 +0000 (UTC) Received: from mail.wdc.spb.ru (localhost [127.0.0.1]) by mail.wdc.spb.ru (Postfix) with ESMTP id 681F87FF490; Mon, 28 Mar 2011 11:55:08 +0400 (MSD) Received: by mail.wdc.spb.ru (Postfix, from userid 66) id 672637FF76A; Mon, 28 Mar 2011 11:55:08 +0400 (MSD) Received: from home.my.intranet (localhost [127.0.0.1]) by home.my.intranet (Postfix) with ESMTP id 8F8CD416BBB; Mon, 28 Mar 2011 11:52:22 +0400 (MSD) Received: from home.my.intranet (home.my.intranet [192.168.2.1]) by home.my.intranet (Postfix) with ESMTP id 4A20E416BB9; Mon, 28 Mar 2011 11:52:22 +0400 (MSD) Message-ID: <4D903E36.9060004@home.wdc.spb.ru> Date: Mon, 28 Mar 2011 11:52:22 +0400 From: "Eugene V. Boontseff" Organization: warm home company User-Agent: Mozilla/5.0 (X11; U; FreeBSD amd64; en-US; rv:1.9.2.15) Gecko/20110306 Lightning/1.0b2 Thunderbird/3.1.9 MIME-Version: 1.0 To: freebsd-geom@freebsd.org References: In-Reply-To: Content-Type: multipart/mixed; boundary="------------090001080509020001010909" X-Virus-Scanned: ClamAV using ClamSMTP X-Virus-Scanned: ClamAV using ClamSMTP X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-stable@freebsd.org Subject: Long =?utf-8?q?=C2=ABSuspend_time=C2=BB_when_reading_large_files_?= =?utf-8?q?from_gjournal_partions=2E?= X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: eugene@wdc.spb.ru List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Mar 2011 08:10:16 -0000 This is a multi-part message in MIME format. --------------090001080509020001010909 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Hello, freebsd-geom. On FreeBSD 8.2-RELEASE long periods of «Suspend time» have been detected - tens of seconds - while reading large files from gjournal partition: For example: root@mail [/var/tmp]# du -h /var/tmp/access.log 8.3G /var/tmp/access.log root@mail[/var/tmp]# dd if=/var/tmp/access.log of=/dev/null 17417604 +1 records in 17417604 +1 records out 8917813440 bytes transferred in 50.760701 secs (175,683,418 bytes/sec) root@mail[/var/tmp] # grep \/var/var/log/messages ... Mar 27 14:48:08 mail kernel: GEOM_JOURNAL [1]: Suspend time of /var: 0.018053s Mar 27 14:48:18 mail kernel: GEOM_JOURNAL [1]: Msync time of /var: 0.020182s Mar 27 14:49:03 mail kernel: GEOM_JOURNAL [1]: Sync time of /var: 0.022150s Mar 27 14:49:03 mail kernel: GEOM_JOURNAL [1]: Suspend time of /var: 45.187463s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Mar 27 14:49:13 mail kernel: GEOM_JOURNAL [1]: Msync time of /var: 0.014821s Mar 27 14:49:13 mail kernel: GEOM_JOURNAL [1]: Sync time of /var: 0.017499s Mar 27 14:49:13 mail kernel: GEOM_JOURNAL [1]: Suspend time of /var: 0.016974s ... At the time when «Suspend time» = 45.187463s, all operations on the disk (gjournal partition) are blocked. All processes (htttp, squid, sshd, pop3d, imapd, and even login) are waiting for the expiration of this time. And only after that continue to operate normally. This does not happen if not only read but also simultaneously write to the partition with gjournal. (dd if=/var/tmp/access.log of=/var/tmp/a.log or cp /var/tmp /access.log /var/spool/uucppublic) Partion with gjournal is located on a hardware RAID 10 - driver aac. I put a ordinary sata disk in the computer and create a gjournal partition on it.. On the sata drive it worked fine. So I guess that the problem is in the driver aac. Could it be so because the aac driver does not support BIO_FLUSH? PS. root@mail[/var/tmp]# gjournal list Geom name: gjournal 609973015 ID: 609973015 Providers: 1. Name: ad6p4.journal Mediasize: 456084396032 (425G) Sectorsize: 512 Mode: r0w0e0 Consumers: 1. Name: ad6p4 Mediasize: 494739102208 (461G) Sectorsize: 512 Mode: r1w1e1 Jend: 494739101696 Jstart: 456084396032 Role: Data, Journal Geom name: gjournal 2757859993 ID: 2757859993 Providers: 1. Name: aacd0p5.journal Mediasize: 498216205824 (464G) Sectorsize: 512 Mode: r1w1e2 Consumers: 1. Name: aacd0p5 Mediasize: 536870912000 (500G) Sectorsize: 512 Mode: r1w1e1 Jend: 536870911488 Jstart: 498216205824 Role: Data, Journal Server uses 12 G memory. --------------090001080509020001010909--