From owner-freebsd-fs@FreeBSD.ORG Mon Nov 26 14:17:24 2007 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 532B216A498 for ; Mon, 26 Nov 2007 14:17:24 +0000 (UTC) (envelope-from gergely.czuczy@harmless.hu) Received: from marvin.harmless.hu (marvin.harmless.hu [195.56.55.204]) by mx1.freebsd.org (Postfix) with ESMTP id A3A0413C45A for ; Mon, 26 Nov 2007 14:17:23 +0000 (UTC) (envelope-from gergely.czuczy@harmless.hu) Received: from localhost (marvin-mail [192.168.0.2]) by marvin.harmless.hu (Postfix) with ESMTP id D42357C0CE8 for ; Mon, 26 Nov 2007 14:56:51 +0100 (CET) X-Virus-Scanned: by amavisd-new-2.4.2 (20060627) (Debian) at harmless.hu Received: from marvin.harmless.hu ([192.168.0.2]) by localhost (marvin.harmless.hu [192.168.0.2]) (amavisd-new, port 10024) with ESMTP id c1FthZV4w2al for ; Mon, 26 Nov 2007 14:56:51 +0100 (CET) Received: from marvin.harmless.hu (localhost [127.0.0.1]) by marvin.harmless.hu (Postfix) with ESMTP id 28F907C0CE6 for ; Mon, 26 Nov 2007 14:56:50 +0100 (CET) Date: Mon, 26 Nov 2007 14:56:50 +0100 From: Gergely CZUCZY To: freebsd-fs@freebsd.org Message-ID: <20071126135650.GA97352@harmless.hu> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=x-unknown; protocol="application/pgp-signature"; boundary="YiEDa0DAkWCtVeE4" Content-Disposition: inline User-Agent: mutt-ng/devel-r804 (FreeBSD) Subject: mysql on ZFS hangs X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Nov 2007 14:17:24 -0000 --YiEDa0DAkWCtVeE4 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hello, I'm trying to test a MySQL on ZFS setup, and I'm having some troubles. At first I've copied all the mysql data files from the UFS filesystem to the ZFS one, started mysqld and launched sysbench at it. On the UFS mysql was using around 100-180% CPU and did the benchmark tasks pretty quick (in 60-120 seconds), and now it just stands there for at least 10 minutes. In top I see mysql in zfs state: PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 6244 mysql 3 45 0 2071M 202M zfs:(& 1 0:47 0.98% mysqld In gstat I see the ZFS is reading all both disks in the zmirror like a madman, but mysql pretty does nothing it seems. mysqladmin says it has around 23qps while on UFS it used to report 6-800qps. vmstats shows if the system weren't on load entirely: r b w avm fre flt re pi po fr sr ad2 da0 in sy cs us= sy id 0 0 0 2242452 3224164 180 0 0 0 2862 0 0 0 407 1097 3299 = 0 5 95 FreeBSD sees 6G memory in this box (i've got 14G in it, I haven't had the time to check yet why it doesn't see the rest. it used to see all the memory). FreeBSD sqltest.in.publishing.hu 7.0-BETA2 FreeBSD 7.0-BETA2 #3: Mon Nov 5= 10:49:48 CET 2007 toor@sqltest.in.publishing.hu:/usr/obj/usr/src/sys/S= QLTEST amd64 mysql-server-5.0.45_1 Multithreaded SQL database (server) pool: zm state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM zm ONLINE 0 0 0 mirror ONLINE 0 0 0 da1 ONLINE 0 0 0 da2 ONLINE 0 0 0 errors: No known data errors Filesystem Size Used Avail Capacity Mounted on zm 40G 128K 40G 0% /zm zm/qemu 40G 128K 40G 0% /zm/qemu zm/mysql 42G 2.0G 40G 5% /zm/mysql /zm/mysql 42G 2.0G 40G 5% /var/db/mysql (yes, i'm using it through a nullmount) In mysql I'm using myisam (no chance for innodb). I think this behaviour is quite abnormal. Did anybody met this issue, is this known? Where should I start digging around to solve this (tried google, not much help)? Where can be the bottleneck that gives this whole thing? What have I done wrong during the setup? I need a bit of help to make this scenario work... Sincerely, Gergely Czuczy mailto: gergely.czuczy@harmless.hu --=20 Weenies test. Geniuses solve problems that arise. --YiEDa0DAkWCtVeE4 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4 (FreeBSD) owGNVk2LI8cZXntxDgXG+OoQ8oKxdwaPvnqkGUlmWI8141llV7PrkYZNbLBdUpek 8nRXaaqqpe25G3LIIeRqQ8gPCCSQQ8hPcCAfkLtJyCG3kH+Q5+3umZ0EjLeEuruq 3q963q/6+at377z8+p9+87uP3/nZL7586dfix9PtNAvBLGqpdGttaq1ms1Xr7e92 otpubdZq9eY9td9td5vdzsmP/vKrgTVBmVCb5CvVp6CehcYqkdq8S7OldF6FgyzM a11xTXek/cp6HbQ1fdIm0Ubd7E2cNH6uXO3YzGyszaJPl5kNKq6tnDZBThMlxAOV JHZHiOG9lILLQUXBQrEPJGmUjz98RNbQRx+MCcqz1Q5JExMTL+Waib1NlQjOZpDm 63QYaK4dmIf31opmdqVVTDJJKCwVpbm/TCiWQYII5DR3NuUdcQ75xVLug0oLC0DP Wq1RO+SDdLC7FBAXJiQyM7Ml1sAyVfgUMpAOdSEem4KZRZYKN9JT5tlYCTvBCx/U Wt3mWzR4cl4Ii3Vc8BSC4KgLEaS/8LRyKoQcqOnZBW1pQ3tgjJqAYmZN7LdLNIzd QDN9nuHYsBQbLMwpMbeOYFWiJHZaTUq1yYAsbBzCRruiISRdwwLpV3PPAoLqC6In wyM6Hx+fnR6OjokmD87oydmQTocDzGg8/IhfdHY8pvHkcILJANPJkGnpKZ9r8Hg0 Ojw9ErQXtduVjnLsErU7/NEkipr7rRHxOxqx/v7W29TirX57H896r/tWhXph9ILN q8y+9pD25JSMC3zh6KkNSwDK8OnSE1epdg5QJPpCCUmpjFNpdmiahcqsCubYIiQM 2FkUAIWSFCFV0IAH0rzMITWIJTxa+TLavVx52iwRPByo7HWwZh6RgShyamVdoL1a t9kEHZBfp3wE4Ly0G8iaFxZWYbeB08y9wHISK2NCEmmnkhzucDSlTYGeXKf8mjvF zyQQ8ddK42/LDSIPv8cRIh0IMwpYyfGYcRweCJ7oWAB+/kVRO2p3ItrFR2uvDTKE Zumc63/U3Yv+d6Xd3EdA9fbB1esRHQisdajXEeIDp9T74yMGz9PeCaUqtS4vXQFP Te0zBDLn5sIiJtsnvKPDDnyKhC5Ov5SxYFCCThVjiCxD9OcqAOWcwWU/MeF1EDgU i/pt1HmjynlR6t+u37LsMuHyUtemvkLV0J79XV9mtF9v1t4/nhxGdE36fOXN3T6N 4JdTu8ZJgWELEdrrt7s0OJ4geoEHj2Cte+/bFPQbmXcNO/28eHs3a8DvjfGB+PDR 5Hg8gWvTeK8tinireeXWKJ2derPe7nzaolGWBB2WHOk4JJdFrmNT6RVtlbTbQnAM 2KSPiBdVItPj00fD02NMZy6b9hHehgG7zGCgigXKyFwv+sxZjjLby1EldpHmh0f0 9GyI6eDh+Hx0Q36V0s0oNVWT5u2neE5UpeKLkhNO2Xpx6UwefRe5UGyC78OXdIHa acqOUK4iTJ63gQIEfcWJRuccW0SHa6kTGsiVnGmUDMREZrgzWCNuY8Gj3TzhVyvq Prw9J9R9jAZ8dJU2LlWavThHQc5st8sptaOCLKpX5NdsnRu2glw0/o/xO/jW0jXi acUrtnLld0ij8ZatDOmGaLTZYok+bbIkSRmJ7aJKl0qGN7Rprr1MactwMkszU8Sd SRtj4+l2HanPJfeiKhCKG7vNnMAEjS8glafGulQmyOEjzd03n9o4R2UJJYv2PkOT 1r6cFj69T0+5BXKZzdCxh2ULR19YLGCRqIo31wqbrFXJuBUc3xYW1i4SyEMnoDSb LWmpktX2fVEKnEkDG8tubUNIlOHqFJZoSwu9VpUNm6VNCqlmwZbIUFQ3mBEj/8TG WaASZ6647XD956vNfWBHRvF9haaA184LzWxkKi8qG/1MGem0pY11F/U6IBlrAMpd ApeoE+UW+KLBVTa7ykWKWA22T4tyuT4rlt/DRS5FjHuUJCFqtYOoKZ4qZTQbX5TS E0xQS30FzspZXK5SX54S2r2qi5/ev/vKHb4xXl82X3/5J+LOV68t/vDF96bf/PXN v3/ytzfc14/Cv/91984vH3724J//+M83v//463e//9v+D/88fPaDP/4X =nrZ4 -----END PGP SIGNATURE----- --YiEDa0DAkWCtVeE4--