From owner-freebsd-net@freebsd.org Mon Mar 13 17:31:24 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6652DD0A641 for ; Mon, 13 Mar 2017 17:31:24 +0000 (UTC) (envelope-from nparhar@gmail.com) Received: from mail-pg0-x230.google.com (mail-pg0-x230.google.com [IPv6:2607:f8b0:400e:c05::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 345821E7E for ; Mon, 13 Mar 2017 17:31:24 +0000 (UTC) (envelope-from nparhar@gmail.com) Received: by mail-pg0-x230.google.com with SMTP id 25so66271289pgy.0 for ; Mon, 13 Mar 2017 10:31:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=UXJX+Iigrwm6UmUMahDy68mzYMGp1fcMMbTT+6i/WjE=; b=OanqKUN2ylRa5EIVb918XpJV2+v9MF2nm5yhNczgcdKIRY7aHAlsQDEcjT+f1MUb78 veXb9WFyTAS50XBIElXoDcunDr4qLHkootE5lVCLL1enm2o+6glO7yMWmIc8CCgsFuE7 Bhz5KVEhQsY8t2PWD5QkBzYv/PjNs3TA3AiR/+UIHEBKC12fvkKOqIri+Tuh9w/R8ldJ tJEzcq9CscGjsXUoT3xB3UuDbtaT8jisWU9EXcBYmpaE0KkQW3h5srwfF8Q5McTLQo5l wxeARtHEoJYEnYnoRxF9kM9bLQQdjmQIi/xolWCf4r5AZlj/rOTOZSigBWTso1ivqyga wKGw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=UXJX+Iigrwm6UmUMahDy68mzYMGp1fcMMbTT+6i/WjE=; b=jLefr03v5WHnf4nslSXmr2lyoKp++eqve5DlhT9898nb2GkCfw7S8JDKtsmS1Y1tkj 2OAQF54rNu+hUB2v71v06Nqe74KNkM3U3zDStEeZaZGCKujNbDWuQjtdYG53ZT0VwHjl fVqnt0Pd2odWjfCfLORjXGKXk96Gj29n38e4qLhTlFSC5Or/nQymsA+Ewijhe8x4U0/R EuU9ms8G8SQFHE34Kd+jytE6qSMjP/fcWatkaB6FWWyb8fATuzpuGPsbjih8/EseeUZb FQUTrE6f8D7YmyVElGfzVI7w+XmlWUuw5n2bTUWiyBdxfyCt4/DgAUmNJ4RFrDZIo95A 1r6Q== X-Gm-Message-State: AMke39lWpvALTyjFNeY+gT+DbMGi6LsxvopjRUshHUOgostAOhJi6V3Qg+/AbaLYk2dtK1EPGMgJf1ugO6MThA== X-Received: by 10.98.138.132 with SMTP id o4mr38456548pfk.70.1489426283736; Mon, 13 Mar 2017 10:31:23 -0700 (PDT) MIME-Version: 1.0 Received: by 10.100.182.172 with HTTP; Mon, 13 Mar 2017 10:31:23 -0700 (PDT) In-Reply-To: <173fffac-7ae2-786a-66c0-e9cd7ab78f44@gmail.com> References: <40a413f3-2c44-ee9d-9961-67114d8dffca@gmail.com> <20170205175531.GA20287@dwarf> <7d349edd-0c81-2e3f-d3b9-27af232de76d@gmail.com> <20170209153409.GG41673@dwarf> <6ad029e0-86c6-af3d-8fc3-694d4bcdc683@gmail.com> <20170312231826.GV15630@zxy.spb.ru> <74654520-b8b6-6118-2e46-902a8ea107ac@gmail.com> <173fffac-7ae2-786a-66c0-e9cd7ab78f44@gmail.com> From: Navdeep Parhar Date: Mon, 13 Mar 2017 10:31:23 -0700 Message-ID: Subject: Re: bad throughput performance on multiple systems: Re: Fwd: Re: Disappointing packets-per-second performance results on a Dell,PE R530 To: John Jasen Cc: Slawa Olhovchenkov , "freebsd-net@freebsd.org" , "Caraballo-vega, Jordan A." Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 13 Mar 2017 17:31:24 -0000 On Mon, Mar 13, 2017 at 10:13 AM, John Jasen wrote: > On 03/13/2017 01:03 PM, Navdeep Parhar wrote: > >> On Sun, Mar 12, 2017 at 5:35 PM, John Jasen wrote: >>> UDP traffic. dmesg reports 16 txq, 8 rxq -- which is the default for >>> Chelsio. >>> >> I don't recall offhand, but UDP might be using 2-tuple hashing by >> default and that might affect the distribution of flows across queues. >> Are there senders generating IP fragments by any chance (that'll >> depend on the "send size" that your UDP application is using)? > > No, they're not fragmenting. > >> Have you tried limiting the adapter's rx ithreads to the CPU that the >> PCIe slot with the adapter is wired to? > > Above and beyond the use of cpuset, you mean? I meant cpuset. If possible, try your experiments on a single socket system. Regards, Navdeep