From owner-freebsd-questions@FreeBSD.ORG  Fri Mar  1 17:39:33 2013
Return-Path: <owner-freebsd-questions@FreeBSD.ORG>
Delivered-To: freebsd-questions@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 by hub.freebsd.org (Postfix) with ESMTP id F3819E28
 for <freebsd-questions@freebsd.org>; Fri,  1 Mar 2013 17:39:32 +0000 (UTC)
 (envelope-from cms@balius.com)
Received: from in.mx.balius.com (68-189-209-140.static.ftwo.tx.charter.com
 [68.189.209.140]) by mx1.freebsd.org (Postfix) with ESMTP id C2620B6F
 for <freebsd-questions@freebsd.org>; Fri,  1 Mar 2013 17:39:31 +0000 (UTC)
Received: from [10.0.0.82] (68-189-209-142.static.ftwo.tx.charter.com
 [68.189.209.142])
 by in.mx.balius.com (Postfix) with ESMTPSA id CE98878887;
 Fri,  1 Mar 2013 17:39:24 +0000 (GMT)
Content-Type: text/plain; charset=us-ascii
Mime-Version: 1.0 (Apple Message framework v1283)
Subject: hast, zfs, unable to flush disk cache
From: Chad M Stewart <cms@balius.com>
X-Mac: It Just Works!
Date: Fri, 1 Mar 2013 11:39:23 -0600
Content-Transfer-Encoding: quoted-printable
Message-Id: <3367E416-493C-44EC-9259-89877EDF6DE8@balius.com>
To: freebsd-questions@freebsd.org
X-Mailer: Apple Mail (2.1283)
X-BeenThere: freebsd-questions@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: User questions <freebsd-questions.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-questions>, 
 <mailto:freebsd-questions-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-questions>
List-Post: <mailto:freebsd-questions@freebsd.org>
List-Help: <mailto:freebsd-questions-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-questions>, 
 <mailto:freebsd-questions-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 01 Mar 2013 17:39:33 -0000


I've setup a 2 node cluster using HAST.  I'd previously had this running =
9.0 and then rebuilt the nodes using 9.1.  Under 9.0 I used =
vfs.zfs.vdev.bio_flush_disable=3D1 but that setting does not appear to =
work in 9.1.  The other difference, previous build had root disk on UFS, =
while this build has only ZFS based file systems.


FreeBSD node1.san 9.1-RELEASE FreeBSD 9.1-RELEASE #0 r243826: Tue Dec  4 =
06:55:39 UTC 2012     =
root@obrian.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC  i386


Mar  1 17:07:25 node1 hastd[1446]: [disk5] (primary) Unable to flush =
disk cache on activemap update: Operation not supported by device.
Mar  1 17:07:28 node1 hastd[1440]: [disk3] (primary) Unable to flush =
disk cache on activemap update: Operation not supported by device.
Mar  1 17:07:28 node1 hastd[1437]: [disk2] (primary) Unable to flush =
disk cache on activemap update: Operation not supported by device.
Mar  1 17:07:28 node1 hastd[1434]: [disk1] (primary) Unable to flush =
disk cache on activemap update: Operation not supported by device.
Mar  1 17:07:28 node1 hastd[1446]: [disk5] (primary) Unable to flush =
disk cache on activemap update: Operation not supported by device.
Mar  1 17:07:28 node1 hastd[1443]: [disk4] (primary) Unable to flush =
disk cache on activemap update: Operation not supported by device.


I tried setting zfs set zfs:zfs_nocacheflush=3D1 <pool> but that diddn't =
appear to work either.  I get a lot of lines in my log file because of =
this.  I have also tried  zfs set sync=3Ddisabled <pool> but HAST still =
outputs those lines in the log file.

Any suggestions?


Thank you,
Chad