From owner-freebsd-net@freebsd.org Mon Mar 27 17:30:36 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7C7FAD2077C for ; Mon, 27 Mar 2017 17:30:36 +0000 (UTC) (envelope-from jjasen@gmail.com) Received: from mail-qk0-x22a.google.com (mail-qk0-x22a.google.com [IPv6:2607:f8b0:400d:c09::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2F021F6A; Mon, 27 Mar 2017 17:30:36 +0000 (UTC) (envelope-from jjasen@gmail.com) Received: by mail-qk0-x22a.google.com with SMTP id r142so15965248qke.2; Mon, 27 Mar 2017 10:30:36 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:to:references:cc:from:message-id:date:user-agent :mime-version:in-reply-to:content-transfer-encoding; bh=8kmpfTKIjcAnZXO9FgWhfUkKioDiLOFx5A9qjPsLHQU=; b=cRCCw5oVLyEpZ40GkH4PaDfmyLyUZmTrfgjY112ayfoH13SnBkkO1Crut/4Uwp+SID seJSfwfXuTC67aSaXlstW9Gj3YEEXdC4Gu+dcAvCSJOzsSvupe30OY/o01TY7ZG9ubAa uCeGdB8WqATTfNfjKrJm4a4qLc8XofuJKM9RqRVu3snctndNRRcXZX3XClN0c/mP3CWH bqRYr7zUyqm+SB9KqAB5FQ/KLvxdKkqXEmQxeKmcRE0NjwdodT362cfuhvqYxTwWOyjP CKOz1ER7eGxi4OZUqqC05Wrbnzq9Pp+HEc95hQQv5PtENZWYysTdvdwu/an7zyILbcdk xHXg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:cc:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding; bh=8kmpfTKIjcAnZXO9FgWhfUkKioDiLOFx5A9qjPsLHQU=; b=faTTmMbC5WRjK854MtY84sHnhz1i2kpEvk9MmX5/PzE59XbijE4Q2eRNv2SGsZdQE3 CPskFhPdoW//Hp/sSEmGBnai1THC7XDkcXW08ymXekM5NsrPT77I3l6Pg4xJ4/7lIZdH Ca+h+CRewpV3kaoAnpNN5MIJ2U9yzoGHD+cdpKwcRdRwxnMROHn6XRJeA+aPCUaNArdp Bv/K6RoBMmFmJStzm3WK3UyQclsE4Cwn8qvfW+JaPmKSMzVw2Hq6DCggWQ7mebkbLwKI KUVCsFU4UwYLYZDjl+8umS9o/AKQfVhZ7uV5pWeJgJs7mwjXm5DPxGyRsn4ZUqetVeQM E+sg== X-Gm-Message-State: AFeK/H18rZPe+CWt+ZyC58Nt3Bh2wVm1sF03MgOC5DMbP2mtkiKy20BlqzejEJoJQFf1fw== X-Received: by 10.55.105.6 with SMTP id e6mr20423311qkc.252.1490635835243; Mon, 27 Mar 2017 10:30:35 -0700 (PDT) Received: from [10.1.28.127] ([198.119.59.10]) by smtp.googlemail.com with ESMTPSA id p184sm805754qkb.17.2017.03.27.10.30.34 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 27 Mar 2017 10:30:34 -0700 (PDT) Subject: Re: bad throughput performance on multiple systems: Re: Fwd: Re: Disappointing packets-per-second performance results on a Dell,PE R530 To: Navdeep Parhar , "Caraballo-vega, Jordan A. (GSFC-6062)[COMPUTER SCIENCE CORP]" References: <20170312231826.GV15630@zxy.spb.ru> <74654520-b8b6-6118-2e46-902a8ea107ac@gmail.com> <173fffac-7ae2-786a-66c0-e9cd7ab78f44@gmail.com> <20170317100814.GN70430@zxy.spb.ru> <9924b2d5-4a72-579c-96c6-4dbdacc07c95@gmail.com> <9694e9f2-daec-924d-e9f6-7b22a634acb5@gmail.com> <20170318052837.GA21730@ox> <0a4e3073-bf5f-9bf8-533f-bd9ec3c0f60c@FreeBSD.org> Cc: freebsd-net@freebsd.org, slw@zxy.spb.ru From: John Jasen Message-ID: <06a0309b-8e5a-8857-4394-3a714d251cda@gmail.com> Date: Mon, 27 Mar 2017 13:30:34 -0400 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Mar 2017 17:30:36 -0000 On 03/24/2017 08:51 PM, Navdeep Parhar wrote: > On 03/24/2017 16:53, Caraballo-vega, Jordan A. (GSFC-6062)[COMPUTER > SCIENCE CORP] wrote: >> It looks like netmap is there; however, is there a way of figuring out >> if netmap is being used? > > If you're not running netmap-fwd or some other netmap application, > it's not being used. You have just 1 txq/rxq and that would explain > the difference between cxl and vcxl. Using netmap-fwd, we seem to hover between 2.2m and 3.6m pps, depending on luck and how many streams. netmap-fwd does complain often about running out of tx rings and/or buffer space during these runs. CPU usage clocks in at about 10%-12% across CPUs engaged with a queue. > > # sysctl -a | grep tx_pause Pause was enabled, but allegedly silent during the netmap tests.