From owner-freebsd-java@FreeBSD.ORG Wed Jun 25 13:35:50 2014 Return-Path: Delivered-To: freebsd-java@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id DDFE68A1 for ; Wed, 25 Jun 2014 13:35:50 +0000 (UTC) Received: from mail-lb0-x232.google.com (mail-lb0-x232.google.com [IPv6:2a00:1450:4010:c04::232]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6143228A6 for ; Wed, 25 Jun 2014 13:35:50 +0000 (UTC) Received: by mail-lb0-f178.google.com with SMTP id 10so1838471lbg.37 for ; Wed, 25 Jun 2014 06:35:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=content-type:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=gM0/zlATyaaU3PAEa8DBkXLcRDZm9JH0qkuQ1/UPYHs=; b=WsCuNCKQreA7XAlx3p/LlgFeAGxU19Ds3J8u1dVmHroabbxYENEFsxtaRgeXJgUEhD 58pUjuvrPukWHSGz0kHllRdUGPHRF0MCujcKAtyo5GFiGNt3gmg7wswzjD55Zo9UJDsq LtJ8CBjEJP0B+b2Yx3vlTyXzVG9Xy75idWNHgf/J6SWBfGt6TyqTpZn+/EPCRNYiNtEn Pp9277J9qWB9HAYW1cOnnF23PE2hBkEaSJgj+2LzlFCEJ9mSFsSELK7noqwg9aDXczPN WYMzGrr7yOFEdJ58lS0d9JbT2QxwN3gMWdMVQuUQWF6d8CJtaQChLPc8f7zs74ENQa3j gYBw== X-Received: by 10.112.34.243 with SMTP id c19mr5475796lbj.57.1403703348228; Wed, 25 Jun 2014 06:35:48 -0700 (PDT) Received: from ?IPv6:2a02:6b8::408:d079:e4c8:ebd4:957f? ([2a02:6b8:0:408:d079:e4c8:ebd4:957f]) by mx.google.com with ESMTPSA id qv5sm3595354lbb.19.2014.06.25.06.35.46 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Wed, 25 Jun 2014 06:35:46 -0700 (PDT) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.2\)) Subject: Re: JVM BUG(s) - Hadoop's threads hanging From: Dmitry Sivachenko In-Reply-To: Date: Wed, 25 Jun 2014 17:35:45 +0400 Content-Transfer-Encoding: quoted-printable Message-Id: <8FEE8345-E918-474D-BC85-2BD79493DC4D@gmail.com> References: <1B53E600-B745-459E-98F8-7CEF9FDE77CC@gmail.com> <601C3B4A-8002-4B9C-9B11-01DF32750021@gmail.com> To: Ronald Klop X-Mailer: Apple Mail (2.1878.2) Cc: freebsd-java@freebsd.org X-BeenThere: freebsd-java@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Porting Java to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Jun 2014 13:35:50 -0000 On 21 =D0=B8=D1=8E=D0=BD=D1=8F 2014 =D0=B3., at 15:41, Dmitry Sivachenko = wrote: >=20 > On 21 =D0=B8=D1=8E=D0=BD=D1=8F 2014 =D0=B3., at 14:17, Ronald Klop = wrote: >>=20 >>=20 >> Mmm, that makes it more though to solve. It would still be nice to = know if running Hadoop on another OS has the same problem. That gives a = pointer where to look. >> And it would be nice to reduce your setup to a reproducible testcase, = so people can replay it. Otherwise it is just a lot of guessing from my = side what is happening internally in the application. I don't know how = easy it is to create that. >> Any news on the mailing-lists of Hadoop? >>=20 >=20 > No news from Hadoop mailing-list. > I will have test results with Linux soon (next week). Okay, I tried Linux: no surprise it just works. I tested hadoop-1.2.1 with Oracle JDK-1.7, OpenJDK-1.6, OpenJDK-1.7. >=20 > If anyone want to dig into it, I can send my config files for hadoop = (almost no special tuning) and a command to run hadoop's bundled = TeraSort benchmark. > I have a cluster with 40 machines (1 for namenode, 1 for = secondarynamenode and the rest are task nodes), but I am sure you don't = need as much h/w to reproduce this. >=20