From owner-freebsd-net@freebsd.org Sat Jan 23 15:31:23 2016 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 67BDFA8E083 for ; Sat, 23 Jan 2016 15:31:23 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-ig0-x22e.google.com (mail-ig0-x22e.google.com [IPv6:2607:f8b0:4001:c05::22e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3633512C6 for ; Sat, 23 Jan 2016 15:31:23 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by mail-ig0-x22e.google.com with SMTP id ik10so9733359igb.1 for ; Sat, 23 Jan 2016 07:31:23 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=ZkBA5PljA42QcjLgtuRKCrdPutpAqCZKrFFE/OfRUhY=; b=yfGAuwBFk5WpitpuOjQFzhnRZoocttP37cdWFquIXG2HRrFbdHQzXcbTp5ttfnI9Ok ioRbumrPfp2gsR8LSeb/btt1zP41nuH+/1SrI02hOF6QiHWosgabH1dZ1ge4Pk/saNka OF9LBdkE8NqPW74nvb/clEwHlCSTvaQWdDjqQLy+s82tX+4OxXbPBIySDUrdPzuGiM10 UEiOYJMf2cHqrd5aHEwz4DxxT/9SMGM5XolvFVLgu7EIUNoPR3ZtOLc44mMb1WeC+0dq OFGUfsTDWLb/X7XpL+viOh4x6aDuzQD9PAi+cfs9tNKc34Dmh8hNbsbLTM53A77TZbzi 4vug== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=ZkBA5PljA42QcjLgtuRKCrdPutpAqCZKrFFE/OfRUhY=; b=XqK1XyLDodn0NoSxsjXGWBnSDRb0Ke2O/stJdGXJEc0G5ZgnSYBhC5OxeJQ6I6PlgZ sTOj20g3XOi/755v3f8abehhhWG4KvcV6oXJ2wrZdSL2i5njYV2wY7tPfyS3/DdBOAwk bGvlnUu6Uv3lUHFzooTt0HgY4kqGLAxDpklbXFT7PCxBlphc4HMt6RmWa3Xos9Ry9sDs Q35CE3ajEEIbKambNYHcmvebFDj8zsVDaBGr18jEU3UXKHfBZmiimWd4zfrGqbCbPdOJ 8fy1zvUKKXfQeQ5RHUr/wu63AJiSEyIgK9BTaSpLMK7ly/kcWM6E0WB7KOdArIqs25Qk apPg== X-Gm-Message-State: AG10YORViX8OMwLjjSMsle4JpKGgwv5VL0V/Mt5gtgGqQMOkEtI9wagPUj7LmNqZ2bR07w4LLRm12hro4Ajl8Q== MIME-Version: 1.0 X-Received: by 10.50.178.178 with SMTP id cz18mr9348474igc.37.1453563082688; Sat, 23 Jan 2016 07:31:22 -0800 (PST) Received: by 10.36.121.16 with HTTP; Sat, 23 Jan 2016 07:31:22 -0800 (PST) In-Reply-To: References: Date: Sat, 23 Jan 2016 07:31:22 -0800 Message-ID: Subject: Re: netmap design question - accessing netmap:X-n individual queues on FreeBSD From: Adrian Chadd To: Pavel Odintsov Cc: Eduardo Meyer , "freebsd-net@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 23 Jan 2016 15:31:23 -0000 For random src/dst ports and IPs and on the chelsio t5 40gig hardware, I was getting what, uhm, 40mil tx pps and around 25ish mil rx pps? The chelsio rx path really wants to be coalescing rx buffers, which the netmap API currently doesn't support. I've no idea if luigi has plans to add that. So, it has the hilarious side effect of "adding more RX queues" translates to "drops in RX performance." :( Thanks, -a On 23 January 2016 at 01:31, Pavel Odintsov wrote: > Hi! > > Great job! Do you have performance estimations? > > > On Wednesday, 20 January 2016, Adrian Chadd wrote: >> >> Ok, so, I mostly did this already: >> >> https://github.com/erikarn/netmap-tools/ >> >> it has a multi-threaded, multi-queue bridge + ipv4 decap for testing. >> >> >> >> -a > > > > -- > Sincerely yours, Pavel Odintsov