From owner-freebsd-questions@freebsd.org Thu Oct 1 14:16:42 2015 Return-Path: Delivered-To: freebsd-questions@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F3451A0D40A for ; Thu, 1 Oct 2015 14:16:41 +0000 (UTC) (envelope-from doroseracledes@gmail.com) Received: from mail-wi0-x22f.google.com (mail-wi0-x22f.google.com [IPv6:2a00:1450:400c:c05::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CA231873 for ; Thu, 1 Oct 2015 14:16:41 +0000 (UTC) (envelope-from doroseracledes@gmail.com) Received: by wicfx3 with SMTP id fx3so30750541wic.0 for ; Thu, 01 Oct 2015 07:16:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=date:from:to:subject:message-id:mime-version:content-type :content-disposition:company:user-agent; bh=bLXtz8dVPl51Ye9AP2lG9+x1ziVbQSsGecwAruBCFv0=; b=rMRYSLaExcgyZh4M16fajynIFjNYZsYisd0/i3Vy3TraLn2FGEUEdGPPCRHhToO4aS /BEp/KT2ZwtBVGzXJaOloTyELjCZj6dSxsA6Ot3Rj+Cs1a51hYvzXBeVXSxLsMS0f+oy QDgzNK5zgDJQModKsSMeV5dA3DMOOtEzw1sItq6fGH+zYqKk+kzrAvTv8oavvXdVCBIF grsoO1v0cwfx0Mc+tszlhKSHxIzmz1UDYKerasHaE1z+CMEeAUgl1Z1KaZ7XlQDvdChn j8GdfReNQUbdBHFxo9ljTkVU+nOKynn67tqGLUk/P+XfUmb7lhuI7/hhslfbyQIHquPD s1og== X-Received: by 10.194.91.193 with SMTP id cg1mr12812582wjb.88.1443708999813; Thu, 01 Oct 2015 07:16:39 -0700 (PDT) Received: from rhino.ops.albourne.com ([213.140.204.96]) by smtp.gmail.com with ESMTPSA id fv13sm3421944wic.7.2015.10.01.07.16.38 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 01 Oct 2015 07:16:39 -0700 (PDT) Date: Thu, 1 Oct 2015 17:16:35 +0300 From: Doros Eracledes To: freebsd-questions@freebsd.org Subject: HAST + ZFS reboot hang with 'All buffers synced' on 10.2-RELEASE Message-ID: <20151001141634.GA29959@rhino.ops.albourne.com> MIME-Version: 1.0 X-Operating-System: OpenBSD 5.7 Company: Albourne America LLC X-URL: http://www.albourne.com User-Agent: Mutt/1.5.23 (2014-03-12) Content-Type: text/plain; charset=utf-8; format=flowed Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Oct 2015 14:16:42 -0000 Hi all, I have a setup with two SuperMicro machines with an X10SRH mobo. The O/S is running on ZFS root plus a set of two HGST drives on each machine that are configured as disk0 and disk1 sets replicated with HAST and I created a raidz1 zfs pool onto those. The setup works fine otherwise and I can change between primary and backup depending on the carp status (MASTER/BACKUP) using devd. The issue I have is when I try to reboot the machine that has the zpool mounted (the primary) it gets to "All buffers synced" and it stays there.. because the machine still replies to pings the other node carp never takes over and I have to power cycle the rebooted primary to get the secondary to take over. Note that there's no difference if I do a "reboot" or a "shutdown -r now" and if the machine doesn't have the hast zpool mounted or if I disable hast it will reboot fine. I did found several posts with ZFS issues and "all buffers synced" but it looks like the issue was with upgraded systems from 9.x to 10.x, these are freshly installed 10.2 systems. https://www.reddit.com/r/freebsd/comments/2mmzzy/101release_restart_problems_anyone/ https://forums.freebsd.org/threads/all-buffers-synced-hang-on-freebsd9.31932/ I did find this post describing that the issue may be due to the shutdown order with hastd stoping before the zfs unmount) http://tuxnetworks.blogspot.com.cy/2011/12/shutdown-stalls-using-hast-zfs.html I did add a zfs unmount zpool0 in the precmd in /etc/rc.d/hastd but that didn't help (the zfs volume didn't unmount) Any help or guidance will be greatly appreciated My setup was based on this guide: http://www.aisecure.net/2012/02/07/hast-freebsd-zfs-with-carp-failover/ Best Theodoros -- --