From owner-freebsd-net@freebsd.org Tue Mar 7 22:07:58 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D0C4FD02290 for ; Tue, 7 Mar 2017 22:07:58 +0000 (UTC) (envelope-from nparhar@gmail.com) Received: from mail-pf0-x22c.google.com (mail-pf0-x22c.google.com [IPv6:2607:f8b0:400e:c00::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A285216DB for ; Tue, 7 Mar 2017 22:07:58 +0000 (UTC) (envelope-from nparhar@gmail.com) Received: by mail-pf0-x22c.google.com with SMTP id w189so5790228pfb.0 for ; Tue, 07 Mar 2017 14:07:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=pRgj2xXkevcPFZdwM2zKAw9rKGCKRzIiG1nm4s47se8=; b=efb9Jg44fncrN4ALIrR0psXX/nsMWjO3WHaPzheke8kzDw2fU4RcGEwbRmf2AEeQPL z93f6WvDSOKvIKyYe5vcn8c46w/nWFJNRgwhk8/KdfDFyOiUIxRbufHCvrZw4UI5n4d5 Fo1wxhPFGVXOUBvihSdjT1QIg7/wBAG6kIFqa1DAc0FYT3xeKO/YhyzDo9uPrjoLNNCx b38RuIMA/4slBH4sH3ZDwRfeWQME6K7idLvh9b3rzEsjMqe3HnMPWNb+XaSrXShJj/1P 5Xc2EXcrwmWMgFIils/cer1mo+nmXdro1kPDAdeE+x92YFbxDYGhDgkgbCmea0OTBVcl eNmg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=pRgj2xXkevcPFZdwM2zKAw9rKGCKRzIiG1nm4s47se8=; b=kPGZwwczLxIdZWi0WsFCD9jcPr/6WU6wNE6ZdY4wJJp8I5B/lJE7vdfOb5IPpU7wis zekG9bz+aEFQDa/bPlq1yeNEBfgVFpAPbc2augXcNFVjemWq5B52h5oPvvDxg3OO2eHW f6RVlJzZ74OxG2surGgo6z9OQf6IilCE1T6qL44RkzK3Ofolh6OAoR95XoaGq9USaYOK gOFctpwsntxJ4bNQNogzGiXXiXBaHSu8izR5hoAjI4CH/AxnnykKgml0H/gPQXz9hVM4 lYKhCP0i3ciZZU2UjHZjuhea7iSxOZ+S2LtCx/HS7XBdfTTejSnkcKpMiUeaLyrQUrJV PSPw== X-Gm-Message-State: AMke39lmE+4erQ2SY6H100sNq0ghMlsjc8JmjLg3b3t6iDDqyr8L5ysOw+Dbcf14O/jRkHwkxBDB29f4ipwtow== X-Received: by 10.98.138.132 with SMTP id o4mr2934727pfk.70.1488924478179; Tue, 07 Mar 2017 14:07:58 -0800 (PST) MIME-Version: 1.0 Received: by 10.100.182.172 with HTTP; Tue, 7 Mar 2017 14:07:57 -0800 (PST) In-Reply-To: References: <93e10699-ecc7-c062-bf85-a26de0de9633@sentex.net> From: Navdeep Parhar Date: Tue, 7 Mar 2017 14:07:57 -0800 Message-ID: Subject: Re: Chelsio netmap support ? (RELENG_11) To: Mike Tancsa Cc: "freebsd-net@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Mar 2017 22:07:58 -0000 On Tue, Mar 7, 2017 at 1:53 PM, Mike Tancsa wrote: ... > > Using netsend, I cant seem to blast through a single flow of packets > greater than 800Kpps without packet loss. Can you point me to any > performance tweaks for forwarding / routing ? > > I have 3 boxes, with one in the middle > > (netsend box) <----> (router with chelsio nics) <---> (netreceive box) How is the router configured -- is this something netmap based? Please provide more details of the configuration. What kind of CPU/chipset is it? Do you see any PAUSE frames out of the T5? "sysctl dev.cxl dev.vcxl | grep _pause" Is any CPU core pegged at 100% during the test? Regards, Navdeep > #./netsend 10.151.10.3 500 100 800000 20 > Sending packet of payload size 100 every 0.000001250s for 20 seconds > calling time every 100 cycles > > start: 1488952041.000000000 > finish: 1488952061.000000837 > send calls: 16000000 > send errors: 0 > approx send rate: 800000 pps > time/packet: 1250 ns > approx error rate: 0 > waited: 333086341 > approx waits/sec: 16654317 > approx wait rate: 20 > >