From owner-freebsd-net@freebsd.org Mon Jun 29 12:47:37 2015 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 75D0098F171 for ; Mon, 29 Jun 2015 12:47:37 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from esa-annu.net.uoguelph.ca (esa-annu.mail.uoguelph.ca [131.104.91.36]) by mx1.freebsd.org (Postfix) with ESMTP id 26320191F for ; Mon, 29 Jun 2015 12:47:36 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2CxBACbPZFV/61jaINbg2VfBoMYu2UKhS5KAoFuEAEBAQEBAQGBCoQiAQEBAwEBAQEgKyALBQsCAQgYAgINGQICJwEJJgIECAcEARwEiAYIDbB1lgwBAQEBAQEBAwEBAQEBAQEbgSGKKYQ0AQEcNAeCaIFDBYcEhRiHaIRZhDGEBUKGXI9hAiZjgzMiMQeBBTqBAgEBAQ X-IronPort-AV: E=Sophos;i="5.13,698,1427774400"; d="scan'208";a="222625063" Received: from nipigon.cs.uoguelph.ca (HELO zcs1.mail.uoguelph.ca) ([131.104.99.173]) by esa-annu.net.uoguelph.ca with ESMTP; 29 Jun 2015 08:47:29 -0400 Received: from localhost (localhost [127.0.0.1]) by zcs1.mail.uoguelph.ca (Postfix) with ESMTP id D1B2E15F533; Mon, 29 Jun 2015 08:47:29 -0400 (EDT) Received: from zcs1.mail.uoguelph.ca ([127.0.0.1]) by localhost (zcs1.mail.uoguelph.ca [127.0.0.1]) (amavisd-new, port 10032) with ESMTP id tOkWMybJTlVI; Mon, 29 Jun 2015 08:47:29 -0400 (EDT) Received: from localhost (localhost [127.0.0.1]) by zcs1.mail.uoguelph.ca (Postfix) with ESMTP id 35CEA15F538; Mon, 29 Jun 2015 08:47:29 -0400 (EDT) X-Virus-Scanned: amavisd-new at zcs1.mail.uoguelph.ca Received: from zcs1.mail.uoguelph.ca ([127.0.0.1]) by localhost (zcs1.mail.uoguelph.ca [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id c5MsQwnhzprp; Mon, 29 Jun 2015 08:47:29 -0400 (EDT) Received: from zcs1.mail.uoguelph.ca (zcs1.mail.uoguelph.ca [172.17.95.18]) by zcs1.mail.uoguelph.ca (Postfix) with ESMTP id 1913315F533; Mon, 29 Jun 2015 08:47:29 -0400 (EDT) Date: Mon, 29 Jun 2015 08:47:29 -0400 (EDT) From: Rick Macklem To: Gerrit =?utf-8?B?S8O8aG4=?= Cc: freebsd-net@freebsd.org, Scott Larson , carsten aulbert Message-ID: <1713078020.915257.1435582049079.JavaMail.zimbra@uoguelph.ca> In-Reply-To: <1542755683.900028.1435580547450.JavaMail.zimbra@uoguelph.ca> References: <20150625145238.12cf9da3b368ef0b9a30f193@aei.mpg.de> <1629011632.413406.1435365728977.JavaMail.zimbra@uoguelph.ca> <20150629091958.af9720d478a8903ab28adc1d@aei.mpg.de> <1542755683.900028.1435580547450.JavaMail.zimbra@uoguelph.ca> Subject: Re: NFS on 10G interface terribly slow MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [172.17.95.11] X-Mailer: Zimbra 8.0.9_GA_6191 (ZimbraWebClient - FF34 (Win)/8.0.9_GA_6191) Thread-Topic: NFS on 10G interface terribly slow Thread-Index: HnBAz0huaZkDwiWq8+/pb3yRQP3HJtOfKSxL X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 29 Jun 2015 12:47:37 -0000 I wrote: > Gerrit Kuhn wrote: > > On Fri, 26 Jun 2015 20:42:08 -0400 (EDT) Rick Macklem > > wrote about Re: NFS on 10G interface terribly slow: > > > > RM> Btw, can you tell us what Intel chip(s) you're using? > > > > I have > > > > ix0@pci0:5:0:0: class=0x020000 card=0x00028086 chip=0x15288086 rev=0x01 > > hdr=0x00 vendor = 'Intel Corporation' > > device = 'Ethernet Controller 10-Gigabit X540-AT2' > > class = network > > subclass = ethernet > > > Yea, I don't know how to decode this either. I took a look at the driver and, if I read it correctly, most chips (including all the X540 ones) use IXGBE_82599_SCATTER. As such, you will be doing lots of m_defrag() calls, but since disabling TSO didn't help, that doesn't seem to be the bottleneck. rick > I was actually interested in > what chip Scott was using and getting wire speed. > As noted in the other reply, since disabling TSO didn't help, you probably > aren't affected by this issue. > > rick > > > RM> For example, from the "ix" driver: > > RM> #define IXGBE_82598_SCATTER 100 > > RM> #define IXGBE_82599_SCATTER 32 > > > > Hm, I cannot find out into which chipset number this translates for my > > device... > > > > RM> Btw, it appears that the driver in head/current now sets > > RM> if_hw_tsomaxsegcount, but the driver in stable/10 does not. This means > > RM> that the 82599 chip will end up doing the m_defrag() calls for 10.x. > > > > So the next step could even be updating to -current... > > OTOH, I get the same (bad) resulsts, no matter if TSO is enabled or > > disabled on the interface. > > > > > > cu > > Gerrit > > _______________________________________________ > > freebsd-net@freebsd.org mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-net > > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" > > > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >