From owner-freebsd-current@FreeBSD.ORG Mon Jul 13 20:20:58 2009 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AC9231065672 for ; Mon, 13 Jul 2009 20:20:58 +0000 (UTC) (envelope-from nick@desert.net) Received: from tao.desert.net (tao.desert.net [209.104.5.188]) by mx1.freebsd.org (Postfix) with ESMTP id 532C88FC22 for ; Mon, 13 Jul 2009 20:20:58 +0000 (UTC) (envelope-from nick@desert.net) Received: from motoko.office.desert.net (motoko.office.desert.net [10.24.1.32]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by tao.desert.net (Postfix) with ESMTP id 8175F5D0A; Mon, 13 Jul 2009 13:03:25 -0700 (MST) Message-Id: <69315F2B-3F55-45B7-93AC-B75E678AB5C6@desert.net> From: Nick Esborn To: freebsd-current@freebsd.org Content-Type: multipart/signed; protocol="application/pgp-signature"; micalg=pgp-sha1; boundary="Apple-Mail-3-772744607" Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v935.3) Date: Mon, 13 Jul 2009 13:03:20 -0700 X-Pgp-Agent: GPGMail 1.2.0 (v56) X-Mailer: Apple Mail (2.935.3) X-Mailman-Approved-At: Mon, 13 Jul 2009 20:36:50 +0000 Subject: MySQL thread deadlock, even after r195403 libthr fix X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 13 Jul 2009 20:20:59 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --Apple-Mail-3-772744607 Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Hello, I am working with a 16-core Opteron server which runs five different MySQL 5.0 processes, each with different data sets on MyISAM tables, in jails. It ran flawlessly for about six months under 7.0. After upgrading from 7.0 to 7.2, one of the MySQL processes has begun exhibiting a serious problem. Within anywhere from several hours to a day or two after starting the process, a query thread will lock up. Output from procstat -k for such a thread: 3896 100795 mysqld - mi_switch sleepq_catch_signals sleepq_wait_sig _sleep do_rw_rdlock __umtx_op_rw_rdlock syscall Xfast_syscall Once this thread locks up, replication grinds to a halt, as the thread holds read locks. To unwedge the situation, I have to kill -9 the mysqld process, myisamchk the tables, and start the process back up again. 7.2-RELEASE-p2 did not resolve the problem. Late last week I upgraded to 8.0-BETA1 with the r195403 libthr fix, but that also failed to resolve the problem. Mind you, in every other way, 8.0 is amazing on this 16-core server. I had initially filed a bug report here: http://www.freebsd.org/cgi/query-pr.cgi?pr=ports/135673 This was before the 16-core upgrade, and before trying 8.0. Subsequently, though, a conversation with Jeff Roberson helped me realize that it's more likely a kernel issue than a MySQL one. I hope this deadlock can be resolved. We really need 8.0's performance on this class of server. Thanks, -nick -- nick@desert.net - all messages cryptographically signed --Apple-Mail-3-772744607 content-type: application/pgp-signature; x-mac-type=70674453; name=PGP.sig content-description: This is a digitally signed message part content-disposition: inline; filename=PGP.sig content-transfer-encoding: 7bit -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (Darwin) iEYEARECAAYFAkpbkwgACgkQw1bX5UNr2ADrtgCfQC3/Yws0Sr134+SZOow0cEpR ebYAnjCLCxcbVWNkr5Fg/0U3Fwm5qgLb =fZle -----END PGP SIGNATURE----- --Apple-Mail-3-772744607--