Skip site navigation (1)Skip section navigation (2)
Date:      Sun, 14 Aug 2016 23:11:10 +0200
From:      Ben RUBSON <ben.rubson@gmail.com>
To:        "freebsd-scsi@freebsd.org" <freebsd-scsi@freebsd.org>
Cc:        Max Gurtovoy <maxg@mellanox.com>, Oren Duer <oren@mellanox.com>, Oded Shanoon <odeds@mellanox.com>, Meny Yossefi <menyy@mellanox.com>, Roy Shterman <roysh@mellanox.com>, Hans Petter Selasky <hanss@mellanox.com>
Subject:   Re: Help to make iSER working
Message-ID:  <CE602A11-DB42-43CE-8B06-EFE4B21938ED@gmail.com>
In-Reply-To: <CB6301B8-7A37-45BF-A019-8CACA3D4219A@gmail.com>
References:  <71E4886B-61C3-4091-A7FF-E5A4F59AEACE@gmail.com> <64d8bc44-b6a3-4c0a-6d13-f919bf26685a@mellanox.com> <41CCC244-A781-4087-A811-B33847EDEC01@gmail.com> <6a464f2c-c048-d29c-e602-c129b35a5d4a@mellanox.com> <B3B47B30-D253-4543-A813-1AEDD3EE2656@gmail.com> <a8b1cd70-3e96-2dd6-20ae-1bf3b315ff89@mellanox.com> <621BCC32-4612-410F-B658-D1086A7A3A09@gmail.com> <8207D6A0-3647-48B4-A4E0-3F1FCF3A6723@gmail.com> <beeb0b05-98a0-6c9b-cc37-fd9876477558@mellanox.com> <AM5PR0501MB2580F57429494795D97005E3C21F0@AM5PR0501MB2580.eurprd05.prod.outlook.com> <AC9F5113-0909-4B90-9E89-8841F4060E2F@gmail.com> <CB6301B8-7A37-45BF-A019-8CACA3D4219A@gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help

> On 13 Aug 2016, at 15:12, Ben RUBSON <ben.rubson@gmail.com> wrote:
>=20
> Benchmarks will of course follow.

(also posted @freebsd-fs)

I then used Linux TGT as a test target.

### Target : local disk throughput, one thread :
# dd if=3D/dev/da8 of=3D/dev/null bs=3D$((128*1024)) count=3D81920
10737418240 bytes (11 GB) copied, 21.3898 s, 502 MB/s

### Initiator : iscsi disk throughput, one thread :
# dd if=3D/dev/da8 of=3D/dev/null bs=3D$((128*1024)) count=3D81920
10737418240 bytes transferred in 34.938676 secs (307321843 bytes/sec) - =
293 MB/s

### Initiator : iSER disk throughput, one thread :
# dd if=3D/dev/da8 of=3D/dev/null bs=3D$((128*1024)) count=3D81920
10737418240 bytes transferred in 20.371947 secs (527068838 bytes/sec) - =
502 MB/s

In my example, iSER allows to reach the raw disk throughput (on one =
thread), whereas iSCSI/TCP is a bottleneck.

I also tested with a target RAM device :

### Initiator : iscsi RAM throughput, one thread :
# dd if=3D/dev/da8 of=3D/dev/null bs=3D$((128*1024)) count=3D81920
10737418240 bytes transferred in 24.194665 secs (443792803 bytes/sec) - =
423 MB/s

### Initiator : iSER RAM throughput, one thread :
# dd if=3D/dev/da8 of=3D/dev/null bs=3D$((128*1024)) count=3D81920
10737418240 bytes transferred in 10.991094 secs (976919873 bytes/sec) - =
932 MB/s
(just don't know what is the bottleneck here, of course not the RAM, and =
network on one thread is around 30GB/s)

> On 11 Aug 2016, at 01:13, Max Gurtovoy <maxg@mellanox.com> wrote:
>=20
> Regarding plans for the target side, it's not on my plate for the near =
future (but obviously can be later on :)).
> I'm not aware of other contributers plans.


Can't wait to see this then :)

Many thanks again !

Best regards,

Ben





Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CE602A11-DB42-43CE-8B06-EFE4B21938ED>