From owner-freebsd-net@freebsd.org Fri Mar 17 19:32:11 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 495F2D10705 for ; Fri, 17 Mar 2017 19:32:11 +0000 (UTC) (envelope-from nparhar@gmail.com) Received: from mail-pf0-x232.google.com (mail-pf0-x232.google.com [IPv6:2607:f8b0:400e:c00::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 165121C8B for ; Fri, 17 Mar 2017 19:32:11 +0000 (UTC) (envelope-from nparhar@gmail.com) Received: by mail-pf0-x232.google.com with SMTP id x63so36123745pfx.2 for ; Fri, 17 Mar 2017 12:32:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=8LzFum1E5WpqrGQG/I6mWWMlH2Zsh8NeOu0UQsIgA74=; b=JaTiaDNtLuHDdXnWOKttFh0+b48hVXRTBLgaAWXmxRLB2YAocA830u0dsQ+41aCkOX 8yT5gOWKmN0ycL9OgXN8oicll+BTr0fp3QQJUnR6rcK3uYmYhjjJmbI6l97sbD3oYsrL sbV5jmrmtKUpCFibk6341s3pEdat71N7NPYIG+dbBuilzHbAbDMsdnWSR/Bkyj/SfY+U oK5TFtSsATA+7VU3EUAAjuw83cX9XKG3pZ099aD5w/lmyPW5hMdmIdQ3EMDTfL90BcJm BCvrLetUx/op8pPIGHFZf//VANmlv9Vfs3+ffue4P3//poocC/cNcd+O33ZTbCh/gE6q Ibvw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=8LzFum1E5WpqrGQG/I6mWWMlH2Zsh8NeOu0UQsIgA74=; b=Y6BKUKFx5rUBeALDxI1Fw44hST501uJsT5/ZddQSXD/5xQE52f9llyD3f3EcL7ccDY E5BD6x5He/aI24ZVk6Nh8QWkotYmWMkxRgkK2iX5cfSD5xPhATa/0R0pDXyTdwVHYDGY kOo+uBfrpQpDrif6PKyxkWU6BAyE08blUaQaFOTVumZQrqRG6xnktbFwEKDQfyM8VG8n DdQYcEvfiuRbkdnMYk5kOhE2E2t+aRYeSJy+zovjC07VIufcoLZzvDjC4oRxFlPzpegj PqoeNHg9kRsYg+tuFJMPZkfklsDgzqsS+oHCj8Y6V3wyReZKAH1R8LEKO+wf1EfEwyMf srjQ== X-Gm-Message-State: AFeK/H1Q9w6UVMX19sPz2z+DdlVLIZR8Uq3To7sIuIKB3ZlPGbsG2jHrzv2+TqMICDbTHhQq7uyIkPXnfZAY+Q== X-Received: by 10.98.77.131 with SMTP id a125mr18966590pfb.90.1489779130584; Fri, 17 Mar 2017 12:32:10 -0700 (PDT) MIME-Version: 1.0 Received: by 10.100.168.13 with HTTP; Fri, 17 Mar 2017 12:32:10 -0700 (PDT) In-Reply-To: <9924b2d5-4a72-579c-96c6-4dbdacc07c95@gmail.com> References: <7d349edd-0c81-2e3f-d3b9-27af232de76d@gmail.com> <20170209153409.GG41673@dwarf> <6ad029e0-86c6-af3d-8fc3-694d4bcdc683@gmail.com> <20170312231826.GV15630@zxy.spb.ru> <74654520-b8b6-6118-2e46-902a8ea107ac@gmail.com> <173fffac-7ae2-786a-66c0-e9cd7ab78f44@gmail.com> <20170317100814.GN70430@zxy.spb.ru> <9924b2d5-4a72-579c-96c6-4dbdacc07c95@gmail.com> From: Navdeep Parhar Date: Fri, 17 Mar 2017 12:32:10 -0700 Message-ID: Subject: Re: bad throughput performance on multiple systems: Re: Fwd: Re: Disappointing packets-per-second performance results on a Dell,PE R530 To: John Jasen Cc: Slawa Olhovchenkov , "freebsd-net@freebsd.org" , "Caraballo-vega, Jordan A." Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 17 Mar 2017 19:32:11 -0000 On Fri, Mar 17, 2017 at 12:21 PM, John Jasen wrote: > On 03/17/2017 06:08 AM, Slawa Olhovchenkov wrote: > >> On Thu, Mar 16, 2017 at 03:50:42PM -0400, John Jasen wrote: >> >>> As a few points of note, partial resolution, and curiosity: >>> >>> Following down leads that 11-STABLE had tryforward improvements over >>> 11-RELENG, I upgraded. The same tests (24 client streams over UDP with >>> small packets), the system went from passing 1.7m pps to about 2.5m. >>> >>> Following indications from Navdeep Parhar that UDP queue hashing is not as >>> efficient as it could be, we started running the tests with various powers >>> of 2 streams (2,4,8,16,32) -- and were able to push the system up to 5m pps. >>> >>> We are currently seeing in the tests approximately 10-11m pps on the >>> outside interface, around 5-6m dropped, and 5 million passed. >> You want more? > > Yes. > > We were hopeful, initially, to be able to achieve higher packet > forwarding rates through either netmap-fwd or due to enhancements based > off https://wiki.freebsd.org/ProjectsRoutingProposal Have you tried netmap-fwd? I'd be interested in how that did in your tests. Sadly, projects/routing couldn't make it into 11. I'm trying to find out what's keeping it from getting merged into head. Regards, Navdeep