From owner-freebsd-net@freebsd.org Mon Mar 6 10:10:23 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BE37CCFAF4E for ; Mon, 6 Mar 2017 10:10:23 +0000 (UTC) (envelope-from milosz.kaniewski@gmail.com) Received: from mail-ua0-x22d.google.com (mail-ua0-x22d.google.com [IPv6:2607:f8b0:400c:c08::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7916D1D7B for ; Mon, 6 Mar 2017 10:10:23 +0000 (UTC) (envelope-from milosz.kaniewski@gmail.com) Received: by mail-ua0-x22d.google.com with SMTP id q7so126877196uaf.2 for ; Mon, 06 Mar 2017 02:10:23 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=n9i/P/EB2SzpCqzitENmIxsdbcP8NV2ewJRRUM6w+wA=; b=NK9/SgwwGZSs/XZo574igPcqCZ45fd/159JW6rMiJRNs3imOFhqHP2NZXhimRV5bry FOEK+F5en9MUwDKY5kItStbgl4MUFpAkFPG0T8BPdq4Gr5BM+1qtCGFAGx17BhL0pQxi IeACtPPHy6OuSXYJQja++GqlkDzL4VkaObhceglvIIWk12byDa+JGKJ+G2RJ8mga+YGp xTUfeHne46UmV2QsAwc0JOsbfXo/OiiWfE9wjTSOYLdCyYs/xe5xPgN7RV97Eo7wBI85 is+PKoEtz9wb6jVz+yXMzOi0K9T+Gj+dMkVF0e9On84lMxVxtvwbgg6u/MV1v7LrqPr7 +JJQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=n9i/P/EB2SzpCqzitENmIxsdbcP8NV2ewJRRUM6w+wA=; b=Co3z1/e70XCg8h1DUs2ja+j0FzZDWTTnw6hER6w5YorJF244khN8CGx3OSKFo4CsXk COYE13T5YNjMstT4RltsC4UJyYG1MaWDJKGuwTgiSPIwuUVduZbJ7F7XukzAxeR171pU hle2uaGL3tvHBSNgm5vhqYFU7WrdSOOpjbmsNIyC0TiQapTo/PG5mIwGVIXdBT4Flrzt 2yIkWoCNkkfzlIRa/t2Q/tUKbXZacqBL2px0i1kU/LcL73ZPPVz18KHWmndoAXkZudgj 93EcKUONXAQ1yqFIyvGyJw/2frneC0RoI3TM6f2+3jqiD0qLW/tyBH45jrfzfVUwksDh n+kA== X-Gm-Message-State: AMke39mOnn7i6kQhp+U75eR3d/UgUx3lMuG2rV8Q8zSPWfxVHGrph2U8Mb1tV0nRux9J/9xSNOSrwht8W80a8A== X-Received: by 10.31.86.3 with SMTP id k3mr1303890vkb.154.1488795022387; Mon, 06 Mar 2017 02:10:22 -0800 (PST) MIME-Version: 1.0 Received: by 10.31.60.144 with HTTP; Mon, 6 Mar 2017 02:10:21 -0800 (PST) From: =?UTF-8?Q?Mi=C5=82osz_Kaniewski?= Date: Mon, 6 Mar 2017 11:10:21 +0100 Message-ID: Subject: RSS, cxgbe, netmap and non-TCP traffic To: freebsd-net@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 06 Mar 2017 10:10:23 -0000 Hello, I am trying to split my traffic into two flows: 1. TCP traffic 2. Other traffic (non-TCP traffic) On my NIC (Chelsio T540-CR) I have configured 9 queues (these are Netmap queues configured with hw.cxgbe.nnmtx/rx sysctl) . Now I would like to direct TCP traffic to queues 0-7 and non-TCP traffic to queue number 8. To achieve this I have configured two filters using cxgbetool: cxgbetool t5nex0 filter 0 proto 6 hitcnts 1 cxgbetool t5nex0 filter 1 hitcnts 1 queue 8 tcbhash 1 And it seems ok because with such configuration non-TCP traffic is placed only at queue number 8 and TCP traffic is processed by RSS. But there is a problem because RSS uses all 9 queues and in result some TCP packets are also distibuted to queue number 8. My question is how to limit the number of queues that are used by RSS to 8 (queues 0-7)? I tried to set net.inet.rss.bits to "3" but it doesn't seems to changes anything. Thanks for your help. System information: freebsd-version: 11.0-STABLE hw.cxgbe.ntxq10g=1 hw.cxgbe.nrxq10g=1 hw.cxgbe.num_vis=2 hw.cxgbe.nnmtxq_vi=9 hw.cxgbe.nnmrxq_vi=9