From owner-freebsd-net@freebsd.org Tue Apr 25 09:09:07 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BB64CD4FFB3 for ; Tue, 25 Apr 2017 09:09:07 +0000 (UTC) (envelope-from Joe@stream-technologies.com) Received: from EUR01-HE1-obe.outbound.protection.outlook.com (mail-he1eur01on0048.outbound.protection.outlook.com [104.47.0.48]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT SSL SHA2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 01B88A69; Tue, 25 Apr 2017 09:09:06 +0000 (UTC) (envelope-from Joe@stream-technologies.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=streamtechnologiesuk.onmicrosoft.com; s=selector1-streamtechnologies-com01e; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=yDthW2cqT74AfswGXG6wpb+m7kbN5Ya8X7Z/I5OecLs=; b=fnhDkKLfv/RN3/0hZkIVuqTzQodufD2bOj2Gzv22SresN71RMs0161BRwuhT71RttoEFxxy9XJqop8rsfmhC8/SSPUvL1SQZLyHq1Qzsta1rtF506dlMaCX0vQxPDDygZiTvrbvgUO+sVspojSgThqOldCg7xtb4bZ83V0dXvLQ= Authentication-Results: freebsd.org; dkim=none (message not signed) header.d=none;freebsd.org; dmarc=none action=none header.from=stream-technologies.com; Received: from [192.168.6.128] (212.20.240.118) by AM2PR07MB1025.eurprd07.prod.outlook.com (2a01:111:e400:8444::22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256_P256) id 15.1.1061.6; Tue, 25 Apr 2017 09:09:02 +0000 Subject: Re: cxgbe netmap promiscuous mode? To: Navdeep Parhar References: <58D3C6F4.6010500@stream-technologies.com> <58D521C0.1000804@stream-technologies.com> <58F0E683.7050806@stream-technologies.com> <20170414163215.GA9358@ox> <58F49246.801@stream-technologies.com> <20170419001836.GA4461@ox> <58F72DE2.40503@stream-technologies.com> <20170419143745.GB4461@ox> <58F782DA.6060007@stream-technologies.com> <2529e545-fdca-eb51-3290-d5ecbc81ffcb@FreeBSD.org> CC: "freebsd-net@freebsd.org" From: Joe Jones Message-ID: <58FF122B.1060605@stream-technologies.com> Date: Tue, 25 Apr 2017 10:08:59 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Thunderbird/38.5.1 MIME-Version: 1.0 In-Reply-To: <2529e545-fdca-eb51-3290-d5ecbc81ffcb@FreeBSD.org> Content-Type: text/plain; charset="windows-1252"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [212.20.240.118] X-ClientProxiedBy: DB6PR0201CA0011.eurprd02.prod.outlook.com (2603:10a6:4:3f::21) To AM2PR07MB1025.eurprd07.prod.outlook.com (2a01:111:e400:8444::22) X-MS-Office365-Filtering-Correlation-Id: 33b4777c-522d-4b89-58ec-08d48bbab7a5 X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:(22001)(201703131423075)(201703031133081); SRVR:AM2PR07MB1025; X-Microsoft-Exchange-Diagnostics: 1; AM2PR07MB1025; 3:Vny67r2G0muFJTv8qwt5/KP4f4nCS90bJKACSMIznhAZc+AkTasvT1gepVetJ2MeRUzyghMg7EPLQLCH9cqpgnRGBQvm/73SDXmuHMEqZPR+MJt6o66ZMy3VvnDyZdr8pkVt5vQvl6f/ge4Or9uYeOTJDxve2im60OOffg3XocBqiO96OEZ8N7f8Q3fFrcDcqaAuSVgU0Dzv3jZc/Xeo82Io5mdctrTAyAhSsyFCUvjdjdyuNsCjJt+Ol54DlHKVv1GmYJv7W+hpAF0/UPhKNa+PkEn0dWMTEYTleGGceXZtlJklLpcuyIiZyU87s6aFqLHjrQb4HannnJzyaPajYQ==; 25:TNp56+Y5xvDz/EpF9P6xcDE0zPdif7pA4qX9v4KOQinF1SSAfjMJvG0H/5OPvaXoFYDd9BAIMiNz8vMNYvlrteya9QTq/nXlS1daSpMBTU2b+3PTIK4Q2IjEU2dM5C68DNKuQIC9ugd7FB2S5EcqgbixN6ufxl3qUC1g/CIOvGACHKo49ZiAlehQPYdYv9tUmyJFyBG7BL/hU+4fDfsGukMrLnRc5Zu62cEygcghdk9xmZtTw4RgJDtg45fSNfRRTLRZj8GDHKEiFM9q7pxDcn+UshpL2F+6fSeODXthe5A8cV+n+ou05csYHPNx6zivKhKUGKBK8It5YGN2BqULSfyOvtZ+qLa6KEy975+VU4UYkko8dqb4KeMR915D1XxrMGI+F8FLx0PjaJmkveSFIR9ZITFqoFqW9PtSNB5/d3xlhE8t1xBGxLPp3IVzUx/XO/kvuq72BFhmB7w7N4wfg9nJcoIWGYqpQ/3ch2Utygo= X-Microsoft-Exchange-Diagnostics: 1; AM2PR07MB1025; 31:GPplxbXnofeTb0xssov858E2db7ae1lUfN2qYltAd7ABkktlNnCSLP7tQCjyHP/FtcM+2ora2MSnReBk+TiGsEtNWruHu9j8RGaq1dvE3a1PCwc434y81ZD47WCiluK+fC3iRUAH5EoLvs1ew8h0IZXkkM9+In98P6ZaWdT+zRTYRJSy6XqVdlzzeG1RlYSDY/6Zkrf3BsILoVtGTig//N8EqbCtUyXLfnq1vWl9TQoTU4miTIh1sqX4VjTQu5SV4Z7EDnyBNM0RNdt4FuUzeA== X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:(20558992708506)(75325880899374); X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(6040450)(601004)(2401047)(5005006)(8121501046)(10201501046)(3002001)(93006095)(93001095)(6041248)(20161123558100)(20161123555025)(20161123562025)(20161123560025)(20161123564025)(201703131423075)(201702281528075)(201703061421075)(201703061406153)(6072148); SRVR:AM2PR07MB1025; BCL:0; PCL:0; RULEID:; SRVR:AM2PR07MB1025; X-Microsoft-Exchange-Diagnostics: 1; AM2PR07MB1025; 4:iL7aXt2Sp3jOroa5kdYBss9cTf154yTsCmpGEgUIdFrwqkuvLC1OkHiYR7KsYcnzT2o/3v/8z0OWUfOWCV1aZaPtq2VCQr9m+vXmczxhIw0+0zgskT2X0c9qgGhe5TGzm8RCp6Z65Uw2WGRxZUuBdZx+6UAAQzqkeOIbNTs4BF04JCf0PKg0UCEde6F1MPNTEHPOrAtSsaUz0/0fMxdSuhcBX0oFq0w/vvtwRKEd5m78z4k5Zc10H7WPjsQFTTmrV93odsIJ1NByfPW7fgmUvAlyd+lmMsvze3AXY864MD1lzzKfBf6Aa89jgP5oRbhudPU/BNy3E5WKP7gyWXiHMpjaukqqvJ82yVcl6piBT9G/lhzB0i0cSVxMZqlC7elVqKBy1qNp8RXnA4dOTqMKZaZb5M6fX/G+BKQT9tIoLuah0Kw1iFVVapsPP0z8Nt6Hvgq2Zg7U+bjgO9F+m+ScJAIMgknVHwqPq825agkUJwBgkI9p6TX0cb5u/AVD2B8diV+O9lOb0e7TsO3DVmAHkiCr6Jddcmr8gaS0tIHUXUBInLeYxcIeLrBmYPjBWVPpg2B/eGxvlC1J1VgpgO+Na3XAkLMmNcNtTcecKlMMH9Aqx4VLS6Sbg1ZTAf9mbRbugbfaLROxKz7+/56/9ipshERKRTV61YXbuKkK3FP8Jk2OxPaNEKqFG2fis7naah0mfKCLNqBuOBuA9HsuWBpE8HBRsAik9ME6lbz//ZKqV1KOTOCj7uCjKBvvgh6tQS5iz8QnyLXMCC6Lvm0RpvWJAJgwBurtzCD7ikxiibv4YlWzzcemWImRwIMXC2glbL10wNaFkAfBCO/8emjl25mcJ/wHbuinaVYLboTStPrONhM= X-Forefront-PRVS: 0288CD37D9 X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(4630300001)(6009001)(6049001)(39830400002)(39450400003)(39400400002)(39410400002)(24454002)(6246003)(77096006)(6486002)(4326008)(110136004)(53936002)(93886004)(7736002)(47776003)(25786009)(450100002)(53546009)(80792005)(81166006)(86362001)(38730400002)(8676002)(83506001)(59896002)(6306002)(117156002)(23746002)(3480700004)(65956001)(65806001)(66066001)(54356999)(87266999)(65816999)(50986999)(4001350100001)(5660300001)(50466002)(2906002)(64126003)(6916009)(2950100002)(6666003)(76176999)(6116002)(305945005)(3846002)(36756003)(229853002)(189998001)(33656002)(230700001)(42186005); DIR:OUT; SFP:1101; SCL:1; SRVR:AM2PR07MB1025; H:[192.168.6.128]; FPR:; SPF:None; MLV:sfv; LANG:en; X-Microsoft-Exchange-Diagnostics: =?Windows-1252?Q?1; AM2PR07MB1025; 23:H56hcMGjnujyOWUElRmOHnOFyffekEAD2MVkE?= =?Windows-1252?Q?w90oG/rye4lcGz19sPbMcs3QYuw8afyP+1NCCVbVyqhGH4bs6afRJFAj?= =?Windows-1252?Q?G18ZmvRKN4AZRYrm5eNdL0DqEsO9AemaNeFSSuWMfW9BolwP9fr3w0rC?= =?Windows-1252?Q?+zRzm8jSv3srbmqzav0SPJi5mi3LLbErJlWjzrNAX6r3wMgP+nXH15rU?= =?Windows-1252?Q?w5xpNzlydAUAZ9vH+AlBzhg97bV/f8CC3fyIRE1DRewe57E8DwrprMOt?= =?Windows-1252?Q?4oEVRm0HbheqQINOeWuWXEqEMAZnYrJ5dQTd6Hf5WodGxpOrcHC9onDP?= =?Windows-1252?Q?eVtXwl9WGl3hy43peiK0UfmAaZ6qYXiS6qhMIZ1hyOj1+9ZsxkR//VG5?= =?Windows-1252?Q?FuKIyMEfAaU7/Cqa2dVMJ6jGfy5+ri+5c6yuwI++W+5AZqy89fQR88on?= =?Windows-1252?Q?KERt5KAwqYoNTqIUfL0BhujfeqfLluSoT4tsZMibTr+SEoLHqzBNOn3D?= =?Windows-1252?Q?v8gltuZViB1YKZ+buNITDnPbZSy698rV5tQ27puxVs3WS7SLgXrt7x1S?= =?Windows-1252?Q?CeCzCXWDmtpEBgk217pWifQtQ7d/xDUfHMuxH6lx008iDO2xN3RmwkgL?= =?Windows-1252?Q?3dIjN25h6F9hqSD83+9CmF6d7eiwCQ9uIQkl7qVCjdGnloYmhh9uU1JM?= =?Windows-1252?Q?dp2Pj/+0nFT+vjLSKtOp8LZUwqJnn0Qy8dSOlWukCRIDUcAvuSRlBeGs?= =?Windows-1252?Q?PBDXzpVZbrk2j6eoa7D/Qohst4AJ6vssA2MivvqeA+PZJJ+4VNUK26tW?= =?Windows-1252?Q?vQ0ryheBq7add9ndJGCbS+/F+CJv+BOGIiABAHlm+2pXb30VPmQ5Gm4o?= =?Windows-1252?Q?JFx5sFBg6xPVoC7Dmdng/ghyd5Mh6BsYxh4tTjS3f8ioIJQilZxxEgUi?= =?Windows-1252?Q?Q5e7Gz7aNbxiDwClyFI1u8FGPGZeaIZed6ldgt7SIeWZ1S1z/DzLpO0z?= =?Windows-1252?Q?HKiTZeaKxRcqjn1sxxWsdbMH4dn4I6hPMY6nDmzk3alwiq4lopRu9GeG?= =?Windows-1252?Q?DXlKVZqwtPzMhss98zS+3jv4FmvHVXaip7iYGrDlJxYfX4KbVu+S55pb?= =?Windows-1252?Q?vQZQhP8vbQ1UmJE8ZFau3LTiRIWbJzh67aLOjdM+cVTF5B21fwcsjNyi?= =?Windows-1252?Q?hOmh+S5BeilIMYSjpmlkqkel0mw53fBP5Hg8J2PcjJcgvauO4yMqs9wr?= =?Windows-1252?Q?HjCJseu9yUXP2YqWu4YthGct5e+DN8OzPxhlz3ngjfotlANmPlMkgpIt?= =?Windows-1252?Q?xRhBjEq/5kQujpqjAAzfB3ZAmXJLFwYJ/FFr2Sog7W2/croFmfo5DaW4?= =?Windows-1252?Q?SHfdba3x3u2bZO3t1tU6EJhBj/+f9BLT98bW7YlyRjdrcE+WDpjEUIhG?= =?Windows-1252?Q?s180o3dOuHcqlqRfn3gxmyZUYY4ajrrV79YlbstWg=3D=3D?= X-Microsoft-Exchange-Diagnostics: 1; AM2PR07MB1025; 6:yAV1FM9FQ6iEGDTS3LJnwXSQ/ynWTkdkCe9ec5PWXBh+ERBDqqKRT3+D6MBhMYaCs5mzBf++XIaHT4hoik1ppIvHejO457UR8+TEJcxNTwLQlXHPa7gCoBkLJ5h8hCye/D+rBpAGf0TTYP1xqywArQAdddY/KRNu4onbyMQfETyumtHKgNIa4gMvYYLUzyQWnQ+aa3RiNYrPqs54pb/rsq0OmXZb2P0TD6EDX6MC2YFwPnqCRtsquN6UYDEmxPoRNt4wTV1bfXQ8YnQxIYmln6ei+m91osqYbuCeVqabAKh0+5Q8p45909cIJySdVqv/eE/aiflT9XXczeS7AmAZ+X2LmfLFp/tkcW7p5pbilU0fs4kXaLbNMdDXajm9YePS6xkhZfobKxRDV0/I78NBc3Py3l8qrdxW4d8gQ4V89/tp6zk0bg2M1HqfjK6V6uuJsmk+3lCQGjTqNAToRPPDzi/w/v5pwYP6E+jMXKT659Iytjjv/0r/puCVSAYe4keteudwKpKcS9vrmcK0SdNdPg==; 5:TdFY1kz/3HitkHZmpC0Yi1nD6mq9/PXtxXyfWBBzxeS+GAfXQ4Vhznl2p4nRe5GvswXQ2912UyNpIhmHCtTX4jS8seLDZAe6B2gfGYPoJ8rKqCjqlTxqzUMKZ7xynXU1iBBk46OTFRzNik0ZevhbqA==; 24:h9vKsQdUlF1yumEvAv3UArJxorcEPnQcYYk4xsWg7GcOQMzsrC6S0jH3ILG3f+eX8sa8PlQs9+vKwObIOVsn0NA0LkGTgONYWMR/AJQBWIU= SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-Microsoft-Exchange-Diagnostics: 1; AM2PR07MB1025; 7:kKcUKyvb/+VphvrA9ETlINxeJLGcj8Sg0FWsQZ/NT+woJ3y8t6IuQZGP47WrE3Fm+8+5IjdXrdfipSDt2X4aL/G28fWYswu0SwnYg1hgrBkWW9bct/6inpoOux4oA9RxeGaZT2jpBszv+cFPEuFgVCdb0ZLIPPzCFA1jyZv1JPRnCkiuBOBQ7aZ+g09/7WhNocrKh9eXOvFQd3zH2rpeD8j2rKhjUIN7eXwUMhZJ2M97Vs832nHWjaHBNbKvETR+5rpk6lgFHKQzzYCg7X6fNUXetV8kWnU8UxiyiKBTtNP0RZYzIkFzEeHGf+lnXuQ8QIoGK9SC55ST5Mmqp4cbtA== X-OriginatorOrg: stream-technologies.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 25 Apr 2017 09:09:02.5295 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM2PR07MB1025 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 25 Apr 2017 09:09:07 -0000 Thanks Navdeep, I'll make sure we update firmware in future. Joe Jones On 25/04/17 00:55, Navdeep Parhar wrote: > On 04/19/2017 08:31, Joe Jones wrote: >> Hi Navdeep, >> >> I already got rid of the hw.cxgbe.num_vis line in loader.conf when I >> rebooted this morning. >> >> dev.t5nex.0.firmware_version: 1.15.37.0 > > I tried this exact firmware and was able to reproduce the problem. > This appears to be a firmware bug that has already been fixed in the > 1.16.x firmware available in 10-STABLE. > > Regards, > Navdeep > >> >> >> On 19/04/17 15:37, Navdeep Parhar wrote: >>> What is the firmware version? >>> >>> # sysctl dev.t5nex.0.firmware_version >>> >>> I'll try to repeat the experiment with a T520-SO with the firmware that >>> you have on your card. Does the card behave this way if the extra VIs >>> are not created? Can you please try without hw.cxgbe.num_vis in >>> loader.conf? >>> >>> Regards, >>> Navdeep >>> >>> On Wed, Apr 19, 2017 at 10:29:06AM +0100, Joe Jones wrote: >>>> uname -a >>>> FreeBSD goose2 11.0-RELEASE-p9 FreeBSD 11.0-RELEASE-p9 #0: Tue Apr 11 >>>> 08:48:40 UTC 2017 >>>> root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64 >>>> >>>> The card is a 'T520-SO Unified Wire Ethernet Controller' >>>> >>>> I ran the following with dtrace running in a separate window >>>> >>>> ifconfig cxl1 promisc up ( only see broadcast) >>>> ifconfig cxl1 -promisc >>>> ifconfig cxl1 promisc (now I see traffic) >>>> >>>> dtrace output was >>>> >>>> [root@goose2 /usr/home/joe]# dtrace -n 'fbt::t4_set_rxmode:entry >>>> {trace(arg4)}' >>>> dtrace: description 'fbt::t4_set_rxmode:entry ' matched 1 probe >>>> CPU ID FUNCTION:NAME >>>> 4 61078 t4_set_rxmode:entry 1 >>>> 7 61078 t4_set_rxmode:entry 0 >>>> 5 61078 t4_set_rxmode:entry 1 >>>> >>>> >>>> On 19/04/17 01:18, Navdeep Parhar wrote: >>>>> On Mon, Apr 17, 2017 at 11:00:38AM +0100, Joe Jones wrote: >>>>>> Hi Navdeep >>>>>> >>>>>> running "ifconfig up" and then "ifconfig promisc" works. Running >>>>>> "ifconfig >>>>>> promisc" and then "ifconfig up" does not work. Running "ifconfig >>>>>> up promisc" >>>>>> together does work. Running "ifconfig promisc up" does not work. >>>>> What version of FreeBSD is this? I couldn't reproduce this on >>>>> head with >>>>> a T6 card. Can you please run this in parallel with your ifconfig >>>>> commands, note what dtrace logs in response to what command(s), >>>>> and send >>>>> the output to me? >>>>> >>>>> # dtrace -n 'fbt::t4_set_rxmode:entry {trace(arg4)}' >>>>> >>>>>> The combination that does not work leaves the interface in a >>>>>> state where it >>>>>> reports it's self as being in promiscuous mode. >>>>> In my experiments the interface did function in promiscuous mode >>>>> whether >>>>> I did "ifconfig cc0 promisc up" or "ifconfig cc0 up promisc". >>>>> >>>>> Regards, >>>>> Navdeep >>>> _______________________________________________ >>>> freebsd-net@freebsd.org mailing list >>>> https://lists.freebsd.org/mailman/listinfo/freebsd-net >>>> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >> >