From owner-freebsd-fs@FreeBSD.ORG Wed Dec 19 10:59:32 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id B5D1976F for ; Wed, 19 Dec 2012 10:59:32 +0000 (UTC) (envelope-from joh.hendriks@gmail.com) Received: from mail-la0-f41.google.com (mail-la0-f41.google.com [209.85.215.41]) by mx1.freebsd.org (Postfix) with ESMTP id 2B50B8FC13 for ; Wed, 19 Dec 2012 10:59:31 +0000 (UTC) Received: by mail-la0-f41.google.com with SMTP id m15so1468318lah.28 for ; Wed, 19 Dec 2012 02:59:30 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:message-id:date:from:user-agent:mime-version:to:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=xQ73qHyoMQorm+UVkTyrPginjmX/BdeTalA8TpE9Xe8=; b=PQz594JD8LTsxaMkJEBHEQmnkw8/lxa7J+/WBHry5L3Uug4X/d4fyurq9rWUryGtlh 9zAnAisDvGGiV8In2QtHs04aKb3tPPF3vR68qGqTHvzMofGhuW/T2oIZcDmGMNtRi6Cp V8r05AMtWohTX3Ieu81470qQcbA9mYGTHIP8RX7G+UxPQc5Ek00IgXvefAhUEFagjHtQ iuGY6R8APCgDgK9SuzamVIPEEzWiS927sE0qP5GoOKsWve3gdypSD3eIA5QHywBCHDoQ uNX+UuaC+unLKykFwDe/3IaukOiPVfBS0NxtJSpkvk8e7A6C+G1kHfG5eeHtpxPLzWSc 8uPA== X-Received: by 10.152.146.39 with SMTP id sz7mr2332390lab.28.1355914770684; Wed, 19 Dec 2012 02:59:30 -0800 (PST) Received: from [192.168.50.105] (double-l.xs4all.nl. [80.126.205.144]) by mx.google.com with ESMTPS id v7sm1976866lbj.13.2012.12.19.02.59.28 (version=SSLv3 cipher=OTHER); Wed, 19 Dec 2012 02:59:29 -0800 (PST) Message-ID: <50D19E13.8020609@gmail.com> Date: Wed, 19 Dec 2012 11:59:31 +0100 From: Johan Hendriks User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:17.0) Gecko/17.0 Thunderbird/17.0 MIME-Version: 1.0 To: jg@internetx.com, freebsd-fs@freebsd.org Subject: Re: HAST + ZFS Problem References: <50D036D7.4040206@internetx.com> In-Reply-To: <50D036D7.4040206@internetx.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Dec 2012 10:59:32 -0000 Juergen Gotteswinter schreef: > Hello, > > Currently I try to realize a Filer Setup, based up on FreeBSD 9 with > Carp, HAST and ZFS. Failover etc works fine so far, but when I start > writing data on the ZFS device the following error pops up continuously: > > Dec 17 14:59:06 filer1 hastd[2211]: [disk7] (primary) Remote request > failed (Operation not supported by device): FLUSH. > Dec 17 14:59:06 filer1 hastd[2205]: [disk5] (primary) Remote request > failed (Operation not supported by device): FLUSH. > Dec 17 14:59:06 filer1 hastd[2202]: [disk4] (primary) Remote request > failed (Operation not supported by device): FLUSH. > Dec 17 14:59:06 filer1 hastd[2193]: [disk1] (primary) Remote request > failed (Operation not supported by device): FLUSH. > Dec 17 14:59:06 filer1 hastd[2220]: [disk10] (primary) Remote request > failed (Operation not supported by device): FLUSH. > Dec 17 14:59:06 filer1 hastd[2208]: [disk6] (primary) Remote request > failed (Operation not supported by device): FLUSH. > Dec 17 14:59:06 filer1 hastd[2193]: [disk1] (primary) Local request > failed (Operation not supported by device): FLUSH. > Dec 17 14:59:06 filer1 hastd[2199]: [disk3] (primary) Local request > failed (Operation not supported by device): FLUSH. > Dec 17 14:59:06 filer1 hastd[2208]: [disk6] (primary) Local request > failed (Operation not supported by device): FLUSH. > Dec 17 14:59:06 filer1 hastd[2220]: [disk10] (primary) Local request > failed (Operation not supported by device): FLUSH. > Dec 17 14:59:06 filer1 hastd[2217]: [disk9] (primary) Local request > failed (Operation not supported by device): FLUSH. > Dec 17 14:59:06 filer1 hastd[2196]: [disk2] (primary) Remote request > failed (Operation not supported by device): FLUSH. > > > I already found threads where setting vfs.zfs.vdev.bio_flush_disable=1 > seemed to fix this, for me it had no effect. Also i tried setting > metaflush off in hast.conf, which doesnt change anything, too > > > Hardware Platform is a Dell Poweredge R515, with Perc H700 Controller > (configured to 10 Raid-0 Devices to get the single Disks). > > Any Ideas how to fix this? > > Cheers, > > Juergen > _______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" I am no expert on this, but nobody answered, so i will try. :D It seems to be a known issue is FreeBSD 9.0 i found the following on the net. ################## start r225832 has been merged to 9-STABLE on 4 Jan 2012 as r229509 and you shouldn't observe 'FLUSH: Operation not supported by device' constantly repeating. If you do this is very strange and you should recheck your build. Please provide the output of ident /sbin/hastd command. JK> and hast.conf configuration from both machines: JK> I've decided to put metaflush option on every single level just to be JK> sure. No effect. No need in disabling metaflush in your case. It will disable automatically after the first attempt failed. #################### end FreeBSD 9.0 was also released in january!, but i can not tell if this patch has made it into release 9.0 I think it does not. So if time permits, maybe try FreeBSD 9.1 which will proberbly be released any time now! regards and best wishes Johan Hendriks Neuteboom Automatisering