From owner-freebsd-stable@freebsd.org Wed Jan 27 07:22:46 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4541FA6EFC0 for ; Wed, 27 Jan 2016 07:22:46 +0000 (UTC) (envelope-from alexander@leidinger.net) Received: from mail.ebusiness-leidinger.de (mail.ebusiness-leidinger.de [217.11.53.44]) (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E2EBE1978 for ; Wed, 27 Jan 2016 07:22:45 +0000 (UTC) (envelope-from alexander@leidinger.net) Received: from outgoing.leidinger.net (p57BB930D.dip0.t-ipconnect.de [87.187.147.13]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mail.ebusiness-leidinger.de (Postfix) with ESMTPSA id 8D82183E43D; Wed, 27 Jan 2016 08:22:18 +0100 (CET) Received: from localhost (Titan.Leidinger.net [192.168.1.17]) (using TLSv1.2 with cipher DHE-RSA-CAMELLIA128-SHA (128/128 bits)) (Client did not present a certificate) (Authenticated sender: Alexander@Leidinger.net) by outgoing.leidinger.net (Postfix) with ESMTPSA id DE6EF2031; Wed, 27 Jan 2016 08:22:15 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=leidinger.net; s=outgoing-alex; t=1453879335; bh=GoSOEvtrcCOl1R4y/6DOfYbgu80gp6w70exjzojKu9c=; h=Date:From:To:Cc:Subject:In-Reply-To:References; b=zZWnZAX1071SkB5J13ZDNzikn1aNMDVUYdmgDhVd1iRWF3nPLO+32IhE8298DW3+n X/9tkeCAKQR1uoJH5jxDq3RjhAo6hBtHZZkRjyTFvzcexMeIjgddQoGuTl9APiMKy6 tVPCG5qP15U+ugTqFvcoyKfgeyJ99RyggPALrQcPgzWqdGZPvqZ2LXTmtCaG8JZpOj jCX8sot1O1PEk/VY/jmj5lWpI4Fj+hT40MPUGnKOZDJJ43AO/a7V8MT3UYuSIpQDVR f++acvTiUsLmYbpH2CEdejetPw+VgBYrUbQ5fDo+SQFAoS2yxP+HCU0kGj2zp6+Mf1 k/11flrkryKqw== Date: Wed, 27 Jan 2016 08:22:12 +0100 From: Alexander Leidinger To: Karl Denninger Cc: freebsd-stable@freebsd.org Subject: Re: Something in r291926 (and earlier) causes reboots during periodic daily (14 jails on system) Message-ID: <20160127082212.0000457e@Leidinger.net> In-Reply-To: <566AC592.80106@denninger.net> References: <20151209090049.000003db@Leidinger.net> <5667E86F.3050906@quip.cz> <20151209105144.000035be@Leidinger.net> <3923D6D6-E907-4B6C-931A-12CD7B863415@ebureau.com> <20151210120326.00005928@Leidinger.net> <56697E1F.6050604@denninger.net> <20151211085642.0000652e@Leidinger.net> <566AC592.80106@denninger.net> X-Mailer: Claws Mail 3.13.0 (GTK+ 2.24.28; i686-w64-mingw32) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-EBL-MailScanner-Information: Please contact the ISP for more information X-EBL-MailScanner-ID: 8D82183E43D.A498D X-EBL-MailScanner: Found to be clean X-EBL-MailScanner-SpamCheck: not spam, spamhaus-ZEN, SpamAssassin (not cached, score=-1.023, required 6, autolearn=disabled, ALL_TRUSTED -1.00, DKIM_SIGNED 0.10, DKIM_VALID -0.10, DKIM_VALID_AU -0.10, TW_SV 0.08) X-EBL-MailScanner-From: alexander@leidinger.net X-EBL-MailScanner-Watermark: 1454484141.27623@th8Cmu26MgHzn+TClrYa1Q X-EBL-Spam-Status: No X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jan 2016 07:22:46 -0000 On Fri, 11 Dec 2015 06:46:10 -0600 Karl Denninger wrote: > That's sorta what I expected..... > > First thing I'd try -- turn off UMA for ZFS. It will have a > performance impact but it eliminates one of the issues that I had to > do a lot of work to get around in the patch I developed. > > In /boot/loader.conf: > > vfs.zfs.zio.use_uma=0 FYI: Since my report it was mostly stable. Since a week or two it exhibits again reboots during the periodic runs (it survives 1-3 days ATM). I now disabled the use of uma for ZFS in loader.conf, next "automatic" reboot will make the change active. Bye, Alexander. > And reboot. > > On 12/11/2015 01:56, Alexander Leidinger wrote: > > On Thu, 10 Dec 2015 07:29:03 -0600 > > Karl Denninger wrote: > > > >> On 12/10/2015 05:03, Alexander Leidinger wrote: > >>> On Wed, 9 Dec 2015 15:15:10 -0600 > >>> Dustin Wenz wrote: > >>> > >>>> Are you by chance using the ARC patch from this PR? > >>>> > >>>> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=187594 > >>> No (despite the fact that I would like to have it hit the tree). > >>> > >>>> Do you have a vfs.zfs.dynamic_write_buffer tunable defined, if > >>>> so, what is it set to? > >>> No. > >>> > >>> Bye, > >>> Alexander. > >>> > >> Wait a minute... you have a panic coming out of running the > >> periodic jobs and you do _*not*_ have the patch loaded? Got a > >> dump available from that? > >> > > To make it explicit about what is patched on this system or not: > > # svnlite status > > M etc/rc.d/localpkg > > M lib/libc/Makefile > > M lib/libutil/Makefile > > M lib/msun/Makefile > > M libexec/rtld-elf/Makefile > > M sbin/dump/dumprmt.c > > M sbin/dump/itime.c > > M sbin/dump/optr.c > > M sbin/dump/tape.c > > M sbin/restore/dirs.c > > M sbin/restore/symtab.c > > M sbin/restore/tape.c > > ? sys/amd64/conf/ANDROMEDA > > M sys/dev/drm/drmP.h > > M sys/dev/e1000/if_igb.c > > M sys/dev/usb/serial/ulpt.c > > M sys/fs/cd9660/cd9660_vfsops.c > > M sys/fs/msdosfs/msdosfs_vfsops.c > > M sys/fs/smbfs/smbfs_vfsops.c > > M sys/fs/udf/udf_vfsops.c > > M sys/fs/unionfs/union_vfsops.c > > M sys/gnu/fs/reiserfs/reiserfs_vfsops.c > > M sys/kern/kern_jail.c > > M sys/kern/kern_sig.c > > M sys/kern/subr_bus.c > > M sys/sys/jail.h > > M usr.sbin/adduser/adduser.sh > > M usr.sbin/adduser/rmuser.sh > > M usr.sbin/nfsd/nfsd.c > > M usr.sbin/watchdogd/Makefile > > > > Unfortunately I don't have a dump. Every crash so far didn't lead > > to a core in the dump device (the thread on stable has a stacktrace: > > https://lists.freebsd.org/pipermail/freebsd-stable/2015-December/083807.html). > > No idea why I don't get a dump. > > > > # grep dump /etc/rc.conf /boot/loader.conf > > /etc/rc.conf:dumpdev="/dev/ada3p2" > > /boot/loader.conf:dumpdev="/dev/ada3p2" > > > > # savecore -C /dev/ada3p2 > > > > # ll /var/crash > > total 9 > > -rw-r--r-- 1 root wheel 3B Nov 11 08:45 bounds > > -rw-r--r-- 1 root wheel 5B Apr 28 2011 minfree > > > > Bye, > > Alexander. > > > -- http://www.Leidinger.net Alexander@Leidinger.net: PGP 0xC773696B3BAC17DC http://www.FreeBSD.org netchild@FreeBSD.org : PGP 0xC773696B3BAC17DC