Skip site navigation (1)Skip section navigation (2)
Date:      Sat, 21 Jun 2014 15:41:19 +0400
From:      Dmitry Sivachenko <trtrmitya@gmail.com>
To:        Ronald Klop <ronald-lists@klop.ws>
Cc:        freebsd-java@freebsd.org
Subject:   Re: JVM BUG(s) - Hadoop's threads hanging
Message-ID:  <C040C17A-4FD4-471A-9FA7-E43C7BF657CC@gmail.com>
In-Reply-To: <op.xhsuv5pwkndu52@82-171-231-144.ip.telfort.nl>
References:  <E14F86A5-C7FE-49B5-8A11-F5237C557AE2@gmail.com> <op.xhjxxemtkndu52@ronaldradial.radialsg.local> <1B53E600-B745-459E-98F8-7CEF9FDE77CC@gmail.com> <601C3B4A-8002-4B9C-9B11-01DF32750021@gmail.com> <op.xhsuv5pwkndu52@82-171-231-144.ip.telfort.nl>

next in thread | previous in thread | raw e-mail | index | archive | help


On 21 июня 2014 г., at 14:17, Ronald Klop <ronald-lists@klop.ws> wrote:
> 
> 
> Mmm, that makes it more though to solve. It would still be nice to know if running Hadoop on another OS has the same problem. That gives a pointer where to look.
> And it would be nice to reduce your setup to a reproducible testcase, so people can replay it. Otherwise it is just a lot of guessing from my side what is happening internally in the application. I don't know how easy it is to create that.
> Any news on the mailing-lists of Hadoop?
> 

No news from Hadoop mailing-list.
I will have test results with Linux soon (next week).

If anyone want to dig into it, I can send my config files for hadoop (almost no special tuning) and a command to run hadoop's bundled TeraSort benchmark.
I have a cluster with 40 machines (1 for namenode, 1 for secondarynamenode and the rest are task nodes), but I am sure you don't need as much h/w to reproduce this.




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?C040C17A-4FD4-471A-9FA7-E43C7BF657CC>