From owner-freebsd-stable@freebsd.org  Wed Aug 30 12:54:29 2017
Return-Path: <owner-freebsd-stable@freebsd.org>
Delivered-To: freebsd-stable@mailman.ysv.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 by mailman.ysv.freebsd.org (Postfix) with ESMTP id 51545E01217
 for <freebsd-stable@mailman.ysv.freebsd.org>;
 Wed, 30 Aug 2017 12:54:29 +0000 (UTC)
 (envelope-from emz@norma.perm.ru)
Received: from elf.hq.norma.perm.ru (mail.norma.perm.ru [128.127.144.4])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client CN "mail.norma.perm.ru",
 Issuer "Vivat-Trade UNIX Root CA" (not verified))
 by mx1.freebsd.org (Postfix) with ESMTPS id C47A26B8C1
 for <freebsd-stable@freebsd.org>; Wed, 30 Aug 2017 12:54:27 +0000 (UTC)
 (envelope-from emz@norma.perm.ru)
Received: from bsdrookie.norma.com. (net206-94.perm.ertelecom.ru
 [46.146.206.94] (may be forged))
 by elf.hq.norma.perm.ru (8.15.2/8.15.2) with ESMTPS id v7U9jFAN006816
 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO)
 for <freebsd-stable@freebsd.org>; Wed, 30 Aug 2017 14:45:18 +0500 (YEKT)
 (envelope-from emz@norma.perm.ru)
To: freebsd-stable@freebsd.org
From: "Eugene M. Zheganin" <emz@norma.perm.ru>
Subject: zfs, iSCSI and volmode=dev
Message-ID: <ece540ba-8039-424f-8bad-c4266d70d84b@norma.perm.ru>
Date: Wed, 30 Aug 2017 14:45:15 +0500
User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101
 Thunderbird/52.1.1
MIME-Version: 1.0
Content-Type: text/plain; charset=koi8-r; format=flowed
Content-Transfer-Encoding: 7bit
Content-Language: en-US
X-Spamd-Result: default: False [2.92 / 25.00] BAYES_HAM(-1.58)[92.33%]
 HFILTER_HOSTNAME_UNKNOWN(2.50)[]
 RBL_SPAMHAUS_PBL(2.00)[94.206.146.46.zen.spamhaus.org : 127.0.0.10]
 RCVD_COUNT_1(0.00)[] MID_RHS_MATCH_FROM(0.00)[]
 FROM_EQ_ENVFROM(0.00)[] RCPT_COUNT_1(0.00)[]
 ONCE_RECEIVED(0.10)[] MIME_GOOD(-0.10)[text/plain]
 TO_DN_NONE(0.00)[] DMARC_NA(0.00)[norma.perm.ru]
 RECEIVED_SPAMHAUS(0.00)[94.206.146.46.zen.spamhaus.org]
 R_DKIM_NA(0.00)[] FROM_HAS_DN(0.00)[]
 TO_MATCH_ENVRCPT_ALL(0.00)[] R_SPF_SOFTFAIL(0.00)[~all]
X-Rspamd-Server: localhost
X-Rspamd-Scan-Time: 0.98
X-Rspamd-Queue-ID: v7U9jFAN006816
X-BeenThere: freebsd-stable@freebsd.org
X-Mailman-Version: 2.1.23
Precedence: list
List-Id: Production branch of FreeBSD source code <freebsd-stable.freebsd.org>
List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-stable>, 
 <mailto:freebsd-stable-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-stable/>
List-Post: <mailto:freebsd-stable@freebsd.org>
List-Help: <mailto:freebsd-stable-request@freebsd.org?subject=help>
List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-stable>,
 <mailto:freebsd-stable-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 30 Aug 2017 12:54:29 -0000

Hi,


I have an iSCSI production system that exports a large number of zvols 
as the iSCSI targets. System is running FreeBSD 11.0-RELEASE-p7 and 
initially all of the zvols were confugured with default volmode. I've 
read that it's recommended to use them in dev mode, so the system isn't 
bothered with all of these geom structures, so I've switched all of the 
zvols to dev mode, then I exported/imported the pools back. 
Surprisingly, the performance has fallen down like 10 times (200-300 
Mbits/sec against 3-4 Gbits/sec previously). After observing for 5 
minutes the ESXes trying to boot up, and doing this extremely slowly, I 
switched the volmode back to default, then again exported/imported the 
pools. The performance went back to normal.


So... why did this happen ? The result seems to be counter-intuitive. At 
least not obvious to me.


Thanks.

Eugene.