From owner-freebsd-net@freebsd.org Mon Mar 13 17:03:30 2017 Return-Path: <owner-freebsd-net@freebsd.org> Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3D5EBD0AAD2 for <freebsd-net@mailman.ysv.freebsd.org>; Mon, 13 Mar 2017 17:03:30 +0000 (UTC) (envelope-from nparhar@gmail.com) Received: from mail-pg0-x235.google.com (mail-pg0-x235.google.com [IPv6:2607:f8b0:400e:c05::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1908512DA for <freebsd-net@freebsd.org>; Mon, 13 Mar 2017 17:03:30 +0000 (UTC) (envelope-from nparhar@gmail.com) Received: by mail-pg0-x235.google.com with SMTP id 25so65974128pgy.0 for <freebsd-net@freebsd.org>; Mon, 13 Mar 2017 10:03:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=o1DwKh/y2W91FWhOnepSRFXF7asC6UoEEJX67+V4VH0=; b=MdadXFlWAocSxJqboaOvLGKT4cjQRCZ9QNkr9mJIW2aqURiPiAaVSV76K9RkW8z7W3 +e003iSzSsgMyXWfzmvo80glROtYQCbmRQVAuoLE1eRyuPnWgJnhHWUbQW4TsRWFvQ70 Qwq7oXQeBwm4M3ZMGgf1weg5sjzdwbmiTMQ6wOyp1LJbxOTWlwQg5pMEffgvwksiAByq QrUI3RIk/YJ1sQVBM8BG4C5pXJCNXMFN70UBsuFdMFvh52lsxs51ZVZyKAVYj0Fle0QF DE6ZlSQrTW6aYFyr+myOO/htiVChF69FjqOYRH2lrmy6WFbY89gOrgqjLs3lXqC6kcuK qc6w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=o1DwKh/y2W91FWhOnepSRFXF7asC6UoEEJX67+V4VH0=; b=Jo6mz1MI0D0AorFWlYzNqRzepJPQ/QDeZgO4OFi8Cv8fovZn0p++3r35M5Trg3I3in KQP9eFokkpYD0EI/102EioMaCQJItc+OwfHi7olXvdD/n5jeIzST4QFg8Y1Xn/UQXBKQ dmDTN8F7DuDLw//I/Nq3JEp1T/i3j+tvCLN5H612ztexyWxnPHmmu4MAzX8Vu3sC9nk+ i7Q4dL6kRW7G5Y7vmq5+wE2eRZRLYXNruWRLpTZcAhjKcxavEqGTIAyhKHN9HsvHX1a+ khdtjMr9P6kekYOmmLKFaZrLoauzzbJ+fnBJaPTGYpyCfwIha+aX8IPO8PYSKwA0G8fT r29w== X-Gm-Message-State: AMke39mwvIBw/O/Ysik/CwGXrm6BWdc9pAYkkqkikS6DVsJWhudPx3S8uUZzQJZO9d0tkrQpBSyIir6O3leMXg== X-Received: by 10.98.75.221 with SMTP id d90mr39235161pfj.107.1489424609433; Mon, 13 Mar 2017 10:03:29 -0700 (PDT) MIME-Version: 1.0 Received: by 10.100.182.172 with HTTP; Mon, 13 Mar 2017 10:03:28 -0700 (PDT) In-Reply-To: <74654520-b8b6-6118-2e46-902a8ea107ac@gmail.com> References: <ebb04a3e-bcde-6d50-af63-348e8d06fcba@gmail.com> <40a413f3-2c44-ee9d-9961-67114d8dffca@gmail.com> <20170205175531.GA20287@dwarf> <7d349edd-0c81-2e3f-d3b9-27af232de76d@gmail.com> <20170209153409.GG41673@dwarf> <6ad029e0-86c6-af3d-8fc3-694d4bcdc683@gmail.com> <b460cc49-364a-34fb-e212-582730546dee@gmail.com> <20170312231826.GV15630@zxy.spb.ru> <74654520-b8b6-6118-2e46-902a8ea107ac@gmail.com> From: Navdeep Parhar <nparhar@gmail.com> Date: Mon, 13 Mar 2017 10:03:28 -0700 Message-ID: <CAPFoGT9k4HfDCQ7wJPDFMTrJTtDyc9uK_ma9ubneDhVSsS-jcA@mail.gmail.com> Subject: Re: bad throughput performance on multiple systems: Re: Fwd: Re: Disappointing packets-per-second performance results on a Dell,PE R530 To: John Jasen <jjasen@gmail.com> Cc: Slawa Olhovchenkov <slw@zxy.spb.ru>, "freebsd-net@freebsd.org" <freebsd-net@freebsd.org>, "Caraballo-vega, Jordan A." <jordancaraballo87@gmail.com> Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD <freebsd-net.freebsd.org> List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-net>, <mailto:freebsd-net-request@freebsd.org?subject=unsubscribe> List-Archive: <http://lists.freebsd.org/pipermail/freebsd-net/> List-Post: <mailto:freebsd-net@freebsd.org> List-Help: <mailto:freebsd-net-request@freebsd.org?subject=help> List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-net>, <mailto:freebsd-net-request@freebsd.org?subject=subscribe> X-List-Received-Date: Mon, 13 Mar 2017 17:03:30 -0000 On Sun, Mar 12, 2017 at 5:35 PM, John Jasen <jjasen@gmail.com> wrote: > > UDP traffic. dmesg reports 16 txq, 8 rxq -- which is the default for > Chelsio. > I don't recall offhand, but UDP might be using 2-tuple hashing by default and that might affect the distribution of flows across queues. Are there senders generating IP fragments by any chance (that'll depend on the "send size" that your UDP application is using)? Have you tried limiting the adapter's rx ithreads to the CPU that the PCIe slot with the adapter is wired to? Regards, Navdeep