From owner-freebsd-stable@FreeBSD.ORG Mon Feb 24 16:23:32 2014 Return-Path: Delivered-To: stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 10DEF3F2 for ; Mon, 24 Feb 2014 16:23:32 +0000 (UTC) Received: from mho-02-ewr.mailhop.org (mho-02-ewr.mailhop.org [204.13.248.72]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id CF46B1935 for ; Mon, 24 Feb 2014 16:23:31 +0000 (UTC) Received: from c-24-8-230-52.hsd1.co.comcast.net ([24.8.230.52] helo=damnhippie.dyndns.org) by mho-02-ewr.mailhop.org with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.72) (envelope-from ) id 1WHyJR-000DIa-79; Mon, 24 Feb 2014 16:23:25 +0000 Received: from [172.22.42.240] (revolution.hippie.lan [172.22.42.240]) by damnhippie.dyndns.org (8.14.3/8.14.3) with ESMTP id s1OGNLDs036965; Mon, 24 Feb 2014 09:23:21 -0700 (MST) (envelope-from ian@FreeBSD.org) X-Mail-Handler: Dyn Standard SMTP by Dyn X-Originating-IP: 24.8.230.52 X-Report-Abuse-To: abuse@dyndns.com (see http://www.dyndns.com/services/sendlabs/outbound_abuse.html for abuse reporting information) X-MHO-User: U2FsdGVkX18/++YyjtkOLd5UFeQ5xgXf Subject: Re: fsck dumps core From: Ian Lepore To: Dmitry Sivachenko In-Reply-To: <831076C1-0DF7-41BF-B8C5-57583DC92586@gmail.com> References: <417919B7-C4D7-4003-9A71-64C4C9E73678@gmail.com> <20140224155018.GA21738@zxy.spb.ru> <831076C1-0DF7-41BF-B8C5-57583DC92586@gmail.com> Content-Type: text/plain; charset="koi8-r" Date: Mon, 24 Feb 2014 09:23:21 -0700 Message-ID: <1393259001.1149.36.camel@revolution.hippie.lan> Mime-Version: 1.0 X-Mailer: Evolution 2.32.1 FreeBSD GNOME Team Port Content-Transfer-Encoding: quoted-printable X-MIME-Autoconverted: from 8bit to quoted-printable by damnhippie.dyndns.org id s1OGNLDs036965 Cc: stable@FreeBSD.org, Slawa Olhovchenkov X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Feb 2014 16:23:32 -0000 On Mon, 2014-02-24 at 19:52 +0400, Dmitry Sivachenko wrote: > On 24 =C6=C5=D7=D2. 2014 =C7., at 19:50, Slawa Olhovchenkov wrote: >=20 > > On Mon, Feb 24, 2014 at 06:27:15PM +0400, Dmitry Sivachenko wrote: > >=20 > >> Forgot to mention that it is ~90TB partition and this server has 24G= B of RAM. > >>> Is there any way to complete fsck to get this drive working? > >=20 > > Try to add some swap space. >=20 >=20 > I have 48GB of swap. >=20 > It dumps core almost immediately on start, not that it is running out o= f swap. It looks to me like it's trying to allocate an insanely large amount of memory, perhaps in response to some insane value it found while trying to walk the filesystem data. I had something like that happen back in the 90s, and I was eventually able to track it down to garbage written into one inode block. I manually zero'd that block with dd and lost a few files in the process, but was able to recover most of the filesystem. I'm not recommending that you start zeroing out blocks on your disk at this point, just mentioning one possibility of how much difficulty you may face. fsck does an amazing job, but it can't cope with every possible type of insanity it may encounter. -- Ian