From owner-freebsd-stable@freebsd.org Mon Aug 17 10:41:54 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3DD409BBD5E; Mon, 17 Aug 2015 10:41:54 +0000 (UTC) (envelope-from csforgeron@gmail.com) Received: from mail-io0-x22d.google.com (mail-io0-x22d.google.com [IPv6:2607:f8b0:4001:c06::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0A3171CBC; Mon, 17 Aug 2015 10:41:54 +0000 (UTC) (envelope-from csforgeron@gmail.com) Received: by iodt126 with SMTP id t126so146649979iod.2; Mon, 17 Aug 2015 03:41:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=+vFQ/mA59UR3Ela9yMxgaI2A+vddpfy13o0C64efML4=; b=PA62iMuS76ELRZCw5Z+OKwSBhg5yW0f4KL4io6R6F1J3CsPqAHRsMq5dGMwRfz5N5C ugakzYcXPr030nLuwLC6fnyHlYCWCXidjQLPcMfJrAbVE8Exs3Au6Zzf/U1+tzG3qC1U cne/0fdY5Fn/ig9cWyPbDIFnt0AsCxBfHztdn7p/Ci9WwWcPooMhag8DBIazJoxYS7Bf ItWhnlKLXrTSYMTilxcgp2CpZVrxt7xZ2/ATrmrX5DYUaSErIAJJrG+ewYnRBDFF8cuR vevpmROUtPiXiJz4qznsS/hQp31wtyVuFiINuu12YY4aHTbTlx98hxy3NfZZQpnqzUgB KMtA== MIME-Version: 1.0 X-Received: by 10.107.14.84 with SMTP id 81mr603388ioo.188.1439808113168; Mon, 17 Aug 2015 03:41:53 -0700 (PDT) Received: by 10.36.34.77 with HTTP; Mon, 17 Aug 2015 03:41:53 -0700 (PDT) In-Reply-To: <20150817094145.GB3158@zxy.spb.ru> References: <1D52028A-B39F-4F9B-BD38-CB1D73BF5D56@cs.huji.ac.il> <20150817094145.GB3158@zxy.spb.ru> Date: Mon, 17 Aug 2015 07:41:53 -0300 Message-ID: Subject: Re: ix(intel) vs mlxen(mellanox) 10Gb performance From: Christopher Forgeron To: Slawa Olhovchenkov Cc: Daniel Braniss , FreeBSD Net , FreeBSD stable Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Aug 2015 10:41:54 -0000 FYI, I can regularly hit 9.3 Gib/s with my Intel X520-DA2's and FreeBSD 10.1. Before 10.1 it was less. I used to tweak the card settings, but now it's just stock. You may want to check your settings, the Mellanox may just have better defaults for your switch. On Mon, Aug 17, 2015 at 6:41 AM, Slawa Olhovchenkov wrote: > On Mon, Aug 17, 2015 at 10:27:41AM +0300, Daniel Braniss wrote: > > > hi, > > I have a host (Dell R730) with both cards, connected to an HP8200 > switch at 10Gb. > > when writing to the same storage (netapp) this is what I get: > > ix0: ~130MGB/s > > mlxen0 ~330MGB/s > > this is via nfs/tcpv3 > > > > I can get similar (bad) performance with the mellanox if I > increase the file size > > to 512MGB. > > Look like mellanox have internal beffer for caching and do ACK acclerating. > > > so at face value, it seems the mlxen does a better use of > resources than the intel. > > Any ideas how to improve ix/intel's performance? > > Are you sure about netapp performance? > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >