From owner-freebsd-stable@FreeBSD.ORG  Tue Nov 20 15:46:07 2012
Return-Path: <owner-freebsd-stable@FreeBSD.ORG>
Delivered-To: freebsd-stable@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52])
 by hub.freebsd.org (Postfix) with ESMTP id E3F5F349
 for <freebsd-stable@freebsd.org>; Tue, 20 Nov 2012 15:46:07 +0000 (UTC)
 (envelope-from peter@pean.org)
Received: from velox.its.uu.se (velox.its.uu.se [130.238.7.74])
 by mx1.freebsd.org (Postfix) with ESMTP id 990D18FC08
 for <freebsd-stable@freebsd.org>; Tue, 20 Nov 2012 15:46:06 +0000 (UTC)
X-Virus-Scanned: amavisd-new at uu.se
Received: from nyx.uppmax.uu.se (nyx.uppmax.uu.se [130.238.137.40])
 by velox.its.uu.se (Postfix) with ESMTP id 4413234F0B
 for <freebsd-stable@freebsd.org>; Tue, 20 Nov 2012 16:45:59 +0100 (CET)
Message-ID: <50ABA5B7.80500@pean.org>
Date: Tue, 20 Nov 2012 16:45:59 +0100
From: =?ISO-8859-1?Q?Peter_Ankerst=E5l?= <peter@pean.org>
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
 rv:10.0.10) Gecko/20121030 Thunderbird/10.0.10
MIME-Version: 1.0
To: freebsd-stable@freebsd.org
Subject: Re: Poor iSCSI performance with istgt.
References: <E1TaRi4-0006IH-8u@kabab.cs.huji.ac.il>
 <50AA3FCD.7030808@pean.org> <E1TaSuu-0007V2-TQ@kabab.cs.huji.ac.il>
In-Reply-To: <E1TaSuu-0007V2-TQ@kabab.cs.huji.ac.il>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-BeenThere: freebsd-stable@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Production branch of FreeBSD source code <freebsd-stable.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-stable>,
 <mailto:freebsd-stable-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-stable>
List-Post: <mailto:freebsd-stable@freebsd.org>
List-Help: <mailto:freebsd-stable-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-stable>,
 <mailto:freebsd-stable-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 20 Nov 2012 15:46:08 -0000

On 11/19/2012 04:05 PM, Daniel Braniss wrote:
>>
>> On 11/19/2012 02:48 PM, Daniel Braniss wrote:
>>> try increasing the tag opening - see camcontrol(8)
>>>
>>> danny
>>>
>>>
>>>
>> I tried camcontrol tags daX -N 32 (and a few different values) but cant
>> see any change in speeds.
>>
>> (pass25:iscsi0:0:0:0): dev_openings  30
>> (pass25:iscsi0:0:0:0): dev_active    2
>> (pass25:iscsi0:0:0:0): devq_openings 30
>> (pass25:iscsi0:0:0:0): devq_queued   0
>> (pass25:iscsi0:0:0:0): held          0
>> (pass25:iscsi0:0:0:0): mintags       2
>> (pass25:iscsi0:0:0:0): maxtags       255
>
> I think there is some magic to allow istgt to do tagging, but at the moment
> can't find it, sorry.

Hm!

When increasing the tag openings to 8 (for example) I get extremley good 
reads. I saturate the network (arount 550MB/s). But writes becomes even 
more slow (around 1-2MB/s). So it seems the iscsi setup is capable of 
hadling the speeds I want but for some reason writes are f*ed up.