From owner-freebsd-current@freebsd.org Fri Oct 12 16:52:28 2018 Return-Path: Delivered-To: freebsd-current@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A38B910C3C8B for ; Fri, 12 Oct 2018 16:52:28 +0000 (UTC) (envelope-from nparhar@gmail.com) Received: from mail-wm1-x32b.google.com (mail-wm1-x32b.google.com [IPv6:2a00:1450:4864:20::32b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 12EC28C064 for ; Fri, 12 Oct 2018 16:52:28 +0000 (UTC) (envelope-from nparhar@gmail.com) Received: by mail-wm1-x32b.google.com with SMTP id y11-v6so12928075wma.3 for ; Fri, 12 Oct 2018 09:52:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to:content-language:content-transfer-encoding; bh=HYTkhYsQdrNsPvTzj/XKAp0yzRZzq/1lvDLq4Jr2/Ko=; b=RzV6Z5EJXf/XP4zH06i/0iLPwY2NYcDFlJ+TgOUmrp+yLdYxOg8G0mTUop1j7uGmQJ s+5emNbtzPRQM3gvle0d7kEcLFgrCZASrYRRjKNLRTzieswohsQQtK5cRJktBWLwcPGo lUOzWYV0qk0OuE+U89uR1MgR2WMNk6nUkjdLYRj2DAauSj08ylrDNqUhQtgWOea3ZCG/ Jluef2/i1CCX8yqfe90iCqVBRYn0hnL7qP55CaC2sB1Iww640PQraEI+KD7LviU2Wgq7 t5KDZNmx12iT8EtKo7lConL4uADsHdRT3uRXkJfZYIoQaktMi5YghLwGWFoTzrCzlqL2 lXGg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=HYTkhYsQdrNsPvTzj/XKAp0yzRZzq/1lvDLq4Jr2/Ko=; b=mPzKXrB+NogIc+n+5Sf1qGfqpHVXiF451bEX4O0Izp7gPuvIato3fHmeZFaBH4fZIN YdlVVcfpIcHx6jKIcpZWDfbm747nizZvxWH2il3Ww+lQd/WUNmRzHTlBtOyIkg08B7jX jsYY7BogS6RXeeKybHp/3nwpaNwDhKRltDEVV7oPPJR38ZwKOQRVV+sc4OvPVzF1mO5x YUfmhZjH/O+GtlCkEFfGa2+Kr7pABkZuVep36kXPDBGTjmf2EDYS4RA7pSfBOSNdRY7D ujl+TFJd15eJPvdEmEZWYqmTVvcZ1pZM3LvOy0Awp0OFcDeik1Q1y1Hl4LDIQm6K+n3W ZLng== X-Gm-Message-State: ABuFfoigLy1vOmD2aA3iHUlumpXsDiBPb0jZq6hsTjIEqZv+jMCtSjDl ZU2JNINq2GDWWYOeY8sw57lguEOa X-Google-Smtp-Source: ACcGV635OC7+JdlynHV8aYxKRbQwiUj7V7UNvATcOP3xV4nQdNOCRO3H0OdfSfN+PKVwntz1kT9Q7A== X-Received: by 2002:a1c:a794:: with SMTP id q142-v6mr6138146wme.77.1539363146660; Fri, 12 Oct 2018 09:52:26 -0700 (PDT) Received: from [10.192.166.0] (stargate.chelsio.com. [12.32.117.8]) by smtp.googlemail.com with ESMTPSA id l70-v6sm2776203wma.0.2018.10.12.09.52.25 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 12 Oct 2018 09:52:25 -0700 (PDT) Subject: Re: 10G performance regression / difference cxl and ix RELENG11 vs HEAD To: Mike Tancsa , FreeBSD-Current References: <19e8a60d-e2a4-691c-c208-48c123c66bb7@sentex.net> From: Navdeep Parhar Message-ID: Date: Fri, 12 Oct 2018 09:52:23 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.2.1 MIME-Version: 1.0 In-Reply-To: <19e8a60d-e2a4-691c-c208-48c123c66bb7@sentex.net> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 12 Oct 2018 16:52:29 -0000 On 10/12/18 8:37 AM, Mike Tancsa wrote: > I was doing a quick iperf test with=C2=A0 r339328 GENERIC-NODEBUG=C2=A0= amd64, and > noticed=C2=A0 I can no longer saturate a 10G nic with iperf3.=C2=A0 I t= ried first > with the ix adapter, but was not sure if it was the driver or not. I > tried as well with a Chelsio and got similar numbers. >=20 > # iperf3 -c 192.168.242.3 > Connecting to host 192.168.242.3, port 5201 > [=C2=A0 5] local 192.168.242.2 port 50474 connected to 192.168.242.3 po= rt 5201 > [ ID] Interval=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 Transfer=C2=A0=C2=A0=C2=A0=C2=A0 Bitrate=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0 Retr=C2=A0 Cwnd > [=C2=A0 5]=C2=A0=C2=A0 0.00-1.00=C2=A0=C2=A0 sec=C2=A0=C2=A0 997 MBytes= =C2=A0 8.36 Gbits/sec=C2=A0 717=C2=A0=C2=A0=C2=A0 175 > KBytes=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 > [=C2=A0 5]=C2=A0=C2=A0 1.00-2.00=C2=A0=C2=A0 sec=C2=A0=C2=A0 975 MBytes= =C2=A0 8.18 Gbits/sec=C2=A0 668=C2=A0=C2=A0 41.1 > KBytes=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 > [=C2=A0 5]=C2=A0=C2=A0 2.00-3.00=C2=A0=C2=A0 sec=C2=A0=C2=A0 880 MBytes= =C2=A0 7.38 Gbits/sec=C2=A0 846=C2=A0=C2=A0 25.6 > KBytes=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 > [=C2=A0 5]=C2=A0=C2=A0 3.00-4.00=C2=A0=C2=A0 sec=C2=A0=C2=A0 523 MBytes= =C2=A0 4.39 Gbits/sec=C2=A0 802=C2=A0=C2=A0 59.8 > KBytes=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 > [=C2=A0 5]=C2=A0=C2=A0 4.00-5.00=C2=A0=C2=A0 sec=C2=A0=C2=A0 520 MBytes= =C2=A0 4.36 Gbits/sec=C2=A0 882=C2=A0=C2=A0 48.4 > KBytes=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 > [=C2=A0 5]=C2=A0=C2=A0 5.00-6.00=C2=A0=C2=A0 sec=C2=A0=C2=A0 543 MBytes= =C2=A0 4.55 Gbits/sec=C2=A0 838=C2=A0=C2=A0 56.9 > KBytes=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 > [=C2=A0 5]=C2=A0=C2=A0 6.00-7.00=C2=A0=C2=A0 sec=C2=A0=C2=A0 556 MBytes= =C2=A0 4.66 Gbits/sec=C2=A0 850=C2=A0=C2=A0 11.4 > KBytes=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 > [=C2=A0 5]=C2=A0=C2=A0 7.00-8.00=C2=A0=C2=A0 sec=C2=A0=C2=A0 538 MBytes= =C2=A0 4.51 Gbits/sec=C2=A0 795=C2=A0=C2=A0 39.9 > KBytes=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 > [=C2=A0 5]=C2=A0=C2=A0 8.00-9.00=C2=A0=C2=A0 sec=C2=A0=C2=A0 540 MBytes= =C2=A0 4.53 Gbits/sec=C2=A0 853=C2=A0=C2=A0 57.0 > KBytes=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 > [=C2=A0 5]=C2=A0=C2=A0 9.00-10.00=C2=A0 sec=C2=A0=C2=A0 503 MBytes=C2=A0= 4.22 Gbits/sec=C2=A0 814=C2=A0=C2=A0 59.8 > KBytes=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 > - - - - - - - - - - - - - - - - - - - - - - - - - > [ ID] Interval=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 Transfer=C2=A0=C2=A0=C2=A0=C2=A0 Bitrate=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0 Retr > [=C2=A0 5]=C2=A0=C2=A0 0.00-10.00=C2=A0 sec=C2=A0 6.42 GBytes=C2=A0 5.5= 2 Gbits/sec=C2=A0 8065=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0 > sender > [=C2=A0 5]=C2=A0=C2=A0 0.00-10.00=C2=A0 sec=C2=A0 6.42 GBytes=C2=A0 5.5= 2 Gbits/sec=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 > receiver The number of retries (the "Retr" column) should have been 0 in a controlled test like this. Is this the default stack with all default parameters or have you tuned TCP and/or sockets in any way? Regards, Navdeep