From owner-freebsd-stable@freebsd.org Wed Feb 3 01:04:11 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8117AA9AB0E for ; Wed, 3 Feb 2016 01:04:11 +0000 (UTC) (envelope-from ume@mahoroba.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 67F1E1DB4 for ; Wed, 3 Feb 2016 01:04:11 +0000 (UTC) (envelope-from ume@mahoroba.org) Received: by mailman.ysv.freebsd.org (Postfix) id 652BEA9AB0D; Wed, 3 Feb 2016 01:04:11 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4AD48A9AB0C for ; Wed, 3 Feb 2016 01:04:11 +0000 (UTC) (envelope-from ume@mahoroba.org) Received: from mail.mahoroba.org (ent.mahoroba.org [IPv6:2001:2f0:104:8010::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "asuka.mahoroba.org", Issuer "ca.mahoroba.org" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id DF8901DB3; Wed, 3 Feb 2016 01:04:10 +0000 (UTC) (envelope-from ume@mahoroba.org) Received: from asuka.mahoroba.org (ume@ent.mahoroba.org [IPv6:2001:2f0:104:8010::1]) (user=ume mech=CRAM-MD5 bits=0) by mail.mahoroba.org (8.15.2/8.15.2) with ESMTPSA/inet6 id u1313wwb000827 (version=TLSv1.2 cipher=AES128-GCM-SHA256 bits=128 verify=NO); Wed, 3 Feb 2016 10:04:03 +0900 (JST) (envelope-from ume@mahoroba.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mahoroba.org; s=20081103; t=1454461443; bh=oMUh9kT5stYlcEJ301llMjpoXMVzgs/97DjmMhSz1EM=; h=Date:From:To:Cc:Subject:In-Reply-To:References; b=STpnjfrLQgn6h+2gnOqx0RGv0TlWAlMm8fdv3MvzAFQtTB7T9rHWY62B8LG0rocJW H4ulTeLp62JX9yfV7zBrQxCL5T+PA4UJVUF72zzY9sPU3phlKTChG1vdqbiS4fFYYK Uny295gU6SfUuTBOXh6KvZdIJLAfsUTu8ocUSHRA= Date: Wed, 03 Feb 2016 10:03:58 +0900 Message-ID: From: Hajimu UMEMOTO To: Peter Jeremy Cc: stable@FreeBSD.org, mckusick@FreeBSD.org Subject: Re: 10-STABLE hangups frequently In-Reply-To: <20160202200738.GA78969@server.rulingia.com> References: <20160202200738.GA78969@server.rulingia.com> User-Agent: xcite1.60> Wanderlust/2.15.9 (Almost Unreal) Emacs/24.5 Mule/6.0 (HANACHIRUSATO) X-Operating-System: FreeBSD 10.3-PRERELEASE X-PGP-Key: http://www.mahoroba.org/~ume/publickey.asc X-PGP-Fingerprint: 1F00 0B9E 2164 70FC 6DC5 BF5F 04E9 F086 BF90 71FE MIME-Version: 1.0 (generated by SEMI 1.14.6 - "Maruoka") Content-Type: text/plain; charset=US-ASCII X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.6a2 (mail.mahoroba.org [IPv6:2001:2f0:104:8010::1]); Wed, 03 Feb 2016 10:04:03 +0900 (JST) X-Virus-Scanned: clamav-milter 0.99 at asuka.mahoroba.org X-Virus-Status: Clean X-Spam-Status: No, score=-3.6 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,RP_MATCHES_RCVD autolearn=ham autolearn_force=no version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on asuka.mahoroba.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 03 Feb 2016 01:04:11 -0000 Hi, >>>>> On Wed, 3 Feb 2016 07:07:38 +1100 >>>>> Peter Jeremy said: peter> As others have said, you need to provide lots more detail on your peter> configuration. CPU: AMD Athlon(tm) 64 Processor 3500+ Memory: 4GB HDD: 3TB I'm using ZFS only setup. peter> There were no problems at r290231 but after I upgraded to r295005, I peter> started seeing "out of swap" errors and hangs during the periodic peter> daily runs. I'm not seeing this on 1GB instances - though they are peter> all running UFS. r292875 runs well: FreeBSD asuka.mahoroba.org 10.2-STABLEFreeBSD 10.2-STABLE #5 r292875: Tue Feb 2 07:08:29 JST 2016 root@asuka.mahoroba.org:/usr/obj/usr/src/sys/ASUKA amd6 r292895 hangs: FreeBSD asuka.mahoroba.org 10.2-STABLE FreeBSD 10.2-STABLE #6 r292895: Tue Feb 2 10:17:28 JST 2016 root@asuka.mahoroba.org:/usr/obj/usr/src/sys/ASUKA amd64 I tried latest stable (r295137) with the sys/kern/vfs_subr.c part of r292895 reverted, and it seems running well, here: FreeBSD asuka.mahoroba.org 10.3-PRERELEASE FreeBSD 10.3-PRERELEASE #0 r295137M: Tue Feb 2 20:39:11 JST 2016 root@asuka.mahoroba.org:/usr/obj/usr/src/sys/ASUKA amd64 peter> Some experimentation suggested that just "find /" was enough to wedge peter> my system. I did some experimenting and found that the following peter> loader config was enough to prevent it hanging: peter> vfs.zfs.arc_max="128M" peter> vfs.zfs.arc_meta_limit="50M" peter> vfs.zfs.arc_min="25M" peter> (previously, I had no ZFS tuning at all). I had ZFS tuning before. However, after this problem was occur, I removed all of ZFS tuning. The FS related setting is only kern.maxvnodes=400000, now. Sincerely, -- Hajimu UMEMOTO ume@mahoroba.org ume@FreeBSD.org http://www.mahoroba.org/~ume/