From owner-freebsd-java@FreeBSD.ORG Sat Jun 21 11:41:24 2014 Return-Path: Delivered-To: freebsd-java@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id DFE12205 for ; Sat, 21 Jun 2014 11:41:24 +0000 (UTC) Received: from mail-lb0-x236.google.com (mail-lb0-x236.google.com [IPv6:2a00:1450:4010:c04::236]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 644982B6A for ; Sat, 21 Jun 2014 11:41:24 +0000 (UTC) Received: by mail-lb0-f182.google.com with SMTP id c11so3030198lbj.13 for ; Sat, 21 Jun 2014 04:41:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=content-type:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=3/93g+25NPtLiqZq3rJpfqEa3tQVrJ/Yf9EjU7CIVBg=; b=r2KES6PEDJWm9B7kJSzOcK9LcN59xjx0m4Yi/vf+h7TgLJxSLPWcTIZY/CDxNdu/Rk gewcdkWrGkz1pLcAHVYsuYFv8rV6RnyAHcqZV6+VXvBV6AVg13D3jjyhoOspo0McUe9S kDf+bbcApCqiT4uSoJjzuwy+B5KZmA7AP2KzetBAXJoRGJinzneLUyx8y/UmuofD9Wqz m3QEnsyNj3uYjqNT/n2XbBvQF5jOmMK9a9q6P9GkwlohEn3BGSQQSwNqTiEGcacmCLLd mmZUZOmUxVqfIf4MD4dRKa4kzx5vZUSPQ7GJwwEOX4w9Iic7W5zTkvpSGR6/DaL+AxfI cZJQ== X-Received: by 10.152.8.165 with SMTP id s5mr871421laa.80.1403350882266; Sat, 21 Jun 2014 04:41:22 -0700 (PDT) Received: from [10.0.1.4] ([176.193.87.214]) by mx.google.com with ESMTPSA id i10sm8757552lbc.16.2014.06.21.04.41.20 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Sat, 21 Jun 2014 04:41:21 -0700 (PDT) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.2\)) Subject: Re: JVM BUG(s) - Hadoop's threads hanging From: Dmitry Sivachenko In-Reply-To: Date: Sat, 21 Jun 2014 15:41:19 +0400 Content-Transfer-Encoding: quoted-printable Message-Id: References: <1B53E600-B745-459E-98F8-7CEF9FDE77CC@gmail.com> <601C3B4A-8002-4B9C-9B11-01DF32750021@gmail.com> To: Ronald Klop X-Mailer: Apple Mail (2.1878.2) Cc: freebsd-java@freebsd.org X-BeenThere: freebsd-java@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Porting Java to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 21 Jun 2014 11:41:24 -0000 On 21 =D0=B8=D1=8E=D0=BD=D1=8F 2014 =D0=B3., at 14:17, Ronald Klop = wrote: >=20 >=20 > Mmm, that makes it more though to solve. It would still be nice to = know if running Hadoop on another OS has the same problem. That gives a = pointer where to look. > And it would be nice to reduce your setup to a reproducible testcase, = so people can replay it. Otherwise it is just a lot of guessing from my = side what is happening internally in the application. I don't know how = easy it is to create that. > Any news on the mailing-lists of Hadoop? >=20 No news from Hadoop mailing-list. I will have test results with Linux soon (next week). If anyone want to dig into it, I can send my config files for hadoop = (almost no special tuning) and a command to run hadoop's bundled = TeraSort benchmark. I have a cluster with 40 machines (1 for namenode, 1 for = secondarynamenode and the rest are task nodes), but I am sure you don't = need as much h/w to reproduce this.