From owner-freebsd-net@freebsd.org Sat Jan 23 15:40:59 2016 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 211A2A8E3EC for ; Sat, 23 Jan 2016 15:40:59 +0000 (UTC) (envelope-from nparhar@gmail.com) Received: from mail-pa0-x229.google.com (mail-pa0-x229.google.com [IPv6:2607:f8b0:400e:c03::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E70BE194E for ; Sat, 23 Jan 2016 15:40:58 +0000 (UTC) (envelope-from nparhar@gmail.com) Received: by mail-pa0-x229.google.com with SMTP id ho8so57167704pac.2 for ; Sat, 23 Jan 2016 07:40:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=date:from:to:cc:subject:message-id:mail-followup-to:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=qIqrKnp0o/lMZdW9DqC22OH3Ot6VXK9iQCyRE93gkMA=; b=uYAdIjPd62HBSg1o1uGVw/nJTbI6VTAhCowFfSVKi9TOot60wVUq7zM584/cYixenI 1bBu+xIHfyWXGJ66D+bFvUmoufUcnER+7wKHfNNGQUFZ1mVEYe2AkNzYMxYqF4q3lrXh wIBe9fMMjfb5ZcBvW4saLBDhCV5apgGYeaoV6Oak8P9PegUHaQrl/7x/JNTzwij2uVT+ AQbIdoHS5pZCq/BkYEHL8SY2YFKeityMEuiWtlcuSbNrW9lZpGlHvuonkLfUqxIdr81w pllvw5ddPoAUu9M/6Lxeyqybuiai6m81+XyOhnayfFz0/br0fZWi7/Xr4ClyM7+us89Z jtSA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:date:from:to:cc:subject:message-id :mail-followup-to:references:mime-version:content-type :content-disposition:in-reply-to:user-agent; bh=qIqrKnp0o/lMZdW9DqC22OH3Ot6VXK9iQCyRE93gkMA=; b=bynJPWPf4WqvGg8hNPCiEwl2q+wCHbhyYVlIpgyZ7LZhIOJ4w6PKn6PlHD3YbV/CWO TDEeFUB4G9pa8Xw/N3BSRu8GV61eveCFK9mUu7StZjQIiaGbiwziFVRYG9Hw6pAh/tUd CiuAftuhXiqecj98Pi8tfVKp+4O2pxmDPpntvOCFAUzJXg+NQt+x8anktk5ACX6A9Dae 3fdfsM6BSPR9PQjQK/yGkiKd7b7tUb1JIH4sOObdAAm/1e2l865hQzwzNbH76yMVygdN 1hvWOG4mfzWlJs7HYU+338e4RLLG66XDuuDyIYrRWaouPlB6NQmUsFu1Ea+hXyrOhYb6 Khxw== X-Gm-Message-State: AG10YOTecjkbpl6Yn0AOI4C38mrwqqvKaT5LjM/SIObcteoktpSobZq6mEkt0HMVk50xkA== X-Received: by 10.67.1.164 with SMTP id bh4mr12859513pad.118.1453563658591; Sat, 23 Jan 2016 07:40:58 -0800 (PST) Received: from ox ([2601:641:c001:8a00:591d:d471:ff4a:b8bf]) by smtp.gmail.com with ESMTPSA id qj8sm17160300pac.40.2016.01.23.07.40.56 (version=TLS1_2 cipher=AES128-SHA bits=128/128); Sat, 23 Jan 2016 07:40:57 -0800 (PST) Date: Sat, 23 Jan 2016 07:40:52 -0800 From: Navdeep Parhar To: Marcus Cenzatti Cc: freebsd-net@freebsd.org Subject: Re: Chelsio T520-SO-CR low performance (netmap tested) for RX Message-ID: <20160123154052.GA4574@ox> Mail-Followup-To: Marcus Cenzatti , freebsd-net@freebsd.org References: <20160123053428.2091EA0121@smtp.hushmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20160123053428.2091EA0121@smtp.hushmail.com> User-Agent: Mutt/1.5.21 (2010-09-15) X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 23 Jan 2016 15:40:59 -0000 On Sat, Jan 23, 2016 at 03:34:27AM -0200, Marcus Cenzatti wrote: > hello, > > I am testing a chelsio t520-so-cr connected to a Intel card with ix(4) > driver, I can get the ncxl0 interface to transmit at 14Mpps to another > chelsio or to a Intel card. However I can only get 800Kpps-1Mpps for > RX tests from both chelsio or Intel. > > I have test with both FreeBSD 11 and FreeBSD 10.3-PRERELEASE. > > I tested it untuned first and later I have applied tuning > recommendations I found on BSDRP[1] website. Results still ranging > from 800Kpps to 1Mpps for RX. > > Tests are done w/ with pkt-gen in netmap mode on ncxl interface with > both IP address and MAC address source/dest. The ncxl interfaces have their own MAC addresses. Make sure the sender uses the MAC of the receiver's ncxl interface as the destination MAC. (netmap's pkt-gen -f tx transmits L2 broadcasts by default). Check for PAUSE frames coming out of the receiver (sysctl dev.cxl | grep tx_pause). If it's receiving frames on netmap interface the tx_pause counter should not move. Regards, Navdeep > > I have tested ix-ix and I can confirm 14Mpps for both RX and TX > directions. I have tested with two different chelsio T520 and both > have the very same results. > > What particular loader/sysctl or ifconfig options I should > investigate? > > I also tested disabling txcsum, rxcsum and TSO. Results are different > but still on the much lower mentioned 800K-1M pps rate. > > thank you > > [1]http://bsdrp.net/documentation/examples/forwarding_performance_lab_of_a_hp_proliant_dl360p_gen8_with_10-gigabit_with_10-gigabit_chelsio_t540-cr > > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"