From owner-freebsd-net@FreeBSD.ORG Wed Jul 3 06:00:54 2013 Return-Path: Delivered-To: net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id C707D61B for ; Wed, 3 Jul 2013 06:00:54 +0000 (UTC) (envelope-from jfvogel@gmail.com) Received: from mail-vb0-x22d.google.com (mail-vb0-x22d.google.com [IPv6:2607:f8b0:400c:c02::22d]) by mx1.freebsd.org (Postfix) with ESMTP id 8D6081ECF for ; Wed, 3 Jul 2013 06:00:54 +0000 (UTC) Received: by mail-vb0-f45.google.com with SMTP id p14so5254280vbm.4 for ; Tue, 02 Jul 2013 23:00:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=qU7TvWo6eH9FokUvmry56R4gVNdOLGKBsH2QAbByMMg=; b=jkmo/+NYdjjJqW6PlSrMK5cybgKGKAch3EsN8czHhD/9GAAJwuMqAkLk566Lw4NnQC vcCsm7qphJq4utaBajQdVm7mvhURZh4tAW+6kf1AAg2f4L06ncur85zYgBIoS6LqluGe 4kTz+B99iW7wC7IzR1hSobEsMySkesbtjm24S2zFK2nQZTJx4eN5GsYmZ4RkvpMblUFY gfuPcTu2ow68vOgZi1xH8Zr358gCXk6pJwPnReRyZS59vniBxoELhePirhwQwUWbZWFO j7xqdb4l2qJ7jy93JFSexeA5d8cqMaQvWa8wqYwCzOLm38OyHmXZw4/d4y3oPE+3BxbE Jl5A== MIME-Version: 1.0 X-Received: by 10.52.233.234 with SMTP id tz10mr3877690vdc.26.1372831254003; Tue, 02 Jul 2013 23:00:54 -0700 (PDT) Received: by 10.220.52.200 with HTTP; Tue, 2 Jul 2013 23:00:53 -0700 (PDT) In-Reply-To: References: Date: Tue, 2 Jul 2013 23:00:53 -0700 Message-ID: Subject: Re: Terrible ix performance From: Jack Vogel To: Outback Dingo Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.14 Cc: net@freebsd.org X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 03 Jul 2013 06:00:54 -0000 ix is just the device name, it is using the ixgbe driver. The driver should print some kind of banner when it loads, what version of the OS and driver are you using?? I have little experience testing nfs or samba so I am not sure right off what might be the problem. Jack On Tue, Jul 2, 2013 at 9:28 PM, Outback Dingo wrote: > Ive got a high end storage server here, iperf shows decent network io > > iperf -i 10 -t 20 -c 10.0.96.1 -w 2.5M -l 2.5M > ------------------------------------------------------------ > Client connecting to 10.0.96.1, TCP port 5001 > TCP window size: 2.50 MByte (WARNING: requested 2.50 MByte) > ------------------------------------------------------------ > [ 3] local 10.0.96.2 port 34753 connected with 10.0.96.1 port 5001 > [ ID] Interval Transfer Bandwidth > [ 3] 0.0-10.0 sec 9.78 GBytes 8.40 Gbits/sec > [ 3] 10.0-20.0 sec 8.95 GBytes 7.69 Gbits/sec > [ 3] 0.0-20.0 sec 18.7 GBytes 8.05 Gbits/sec > > > the card has a 3 meter twinax cable from cisco connected to it, going > through a fujitsu switch. We have tweaked various networking, and kernel > sysctls, however from a sftp and nfs session i cant get better then 100MBs > from a zpool with 8 mirrored vdevs. We also have an identical box that will > get 1.4Gbs with a 1 meter cisco twinax cables that writes 2.4Gbs compared > to reads only 1.4Gbs... > > does anyone have an idea of what the bottle neck could be?? This is a > shared storage array with dual LSI controllers connected to 32 drives via > an enclosure, local dd and other tests show the zpool performs quite well. > however as soon as we introduce any type of protocol, sftp, samba, nfs > performance plummets. Im quite puzzled and have run out of ideas. so now > curiousity has me........ its loading the ix driver and working but not up > to speed, > it is feasible it should be using the ixgbe driver?? > > ix0@pci0:2:0:0: class=0x020000 card=0x000c8086 chip=0x10fb8086 rev=0x01 > hdr=0x00 > vendor = 'Intel Corporation' > device = '82599EB 10-Gigabit SFI/SFP+ Network Connection' > class = network > subclass = ethernet > ix1@pci0:2:0:1: class=0x020000 card=0x000c8086 chip=0x10fb8086 rev=0x01 > hdr=0x00 > vendor = 'Intel Corporation' > device = '82599EB 10-Gigabit SFI/SFP+ Network Connection' > class = network > subclass = ethernet > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >