From owner-freebsd-net@freebsd.org Thu Feb 23 03:40:23 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2439CCE7A08 for ; Thu, 23 Feb 2017 03:40:23 +0000 (UTC) (envelope-from sepherosa@gmail.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 032651C2C for ; Thu, 23 Feb 2017 03:40:23 +0000 (UTC) (envelope-from sepherosa@gmail.com) Received: by mailman.ysv.freebsd.org (Postfix) id 0287ECE7A06; Thu, 23 Feb 2017 03:40:23 +0000 (UTC) Delivered-To: net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 022B4CE7A05 for ; Thu, 23 Feb 2017 03:40:23 +0000 (UTC) (envelope-from sepherosa@gmail.com) Received: from mail-vk0-x242.google.com (mail-vk0-x242.google.com [IPv6:2607:f8b0:400c:c05::242]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A90631C29; Thu, 23 Feb 2017 03:40:22 +0000 (UTC) (envelope-from sepherosa@gmail.com) Received: by mail-vk0-x242.google.com with SMTP id h78so853549vkd.2; Wed, 22 Feb 2017 19:40:22 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=wu2wx5eUyrmt+PSsK+TFEULvbRAB/+i3NU3fCQExO6g=; b=RRaroOgErLdy6vwTfKmG3pUEJkWuzqWHPQHgQ8OjkeUPuZuyluThipA2al8jGkezCZ 0kwWHR/9aND8ccoVDI7CBIKhyPTTYHCbeHC2+zRzh071aHtCVgLMksqN+nf0G/ZR5A1x UVgy+JVOLuNd8KrzWi3ijCzbDE20LAneHZVy78+phHcIGYma7hwtm4RlNogaHNHXIm1m tsYy9OkPqPkph3XClSRE8lrDPbyhosto44i2jGGyN8kEJ0ydn6JFc2RwqgGHoivbw2Is PgPzlToccU96OKunY/WSX6CzVw2unWeFQ8lFFIKqKCf9GHASa8EKiDCEW/ZmGR/gT0Zq kU/A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=wu2wx5eUyrmt+PSsK+TFEULvbRAB/+i3NU3fCQExO6g=; b=l3N9kgMX5Jm47gwDphgVXi3SFqiPE88QBOnTcEJR4RwL37r6dXAdx4yD26LfP7lr9y +KopTYI3RmPEHIQqonoMLXUUeXb3y1E/GRiCFL67unQZJljz2F8wOuriWon6H1FN4FLe jR8wadujfB1WDay3kRnVPQR6nDylMvB4/nDqcI3mS4C42txqihhL+vlsCXYv4sBLaKWy lbNSfNwaleKiPR0UoxhRWJECN3eRl5R4gItgTFoCM+DfKlANLfCkYxr3l/TmisFrm8FB UASytVUXKsOfxnH9oSZL5VPmUkLK1A7GVUDr1OW4+6Iy0SPCPiBR6oA5bfM7rBeCW7nd EQxA== X-Gm-Message-State: AMke39meRCoXCKi9/d5moLnX+uYqYV2Z72rwfhnWgoE7zRX5ypkU9d1myz+rwOOLvsJxptV47TrwvIJYNShvOQ== X-Received: by 10.31.134.142 with SMTP id i136mr18954956vkd.56.1487821221759; Wed, 22 Feb 2017 19:40:21 -0800 (PST) MIME-Version: 1.0 Received: by 10.176.66.193 with HTTP; Wed, 22 Feb 2017 19:40:21 -0800 (PST) In-Reply-To: <20170222232704.GJ8899@FreeBSD.org> References: <20170127005251.GM2611@FreeBSD.org> <20170210063024.GE1973@FreeBSD.org> <20170216184903.GF58829@FreeBSD.org> <0858647a-ec3c-1a78-053f-d04397a82d8a@freebsd.org> <20170222232704.GJ8899@FreeBSD.org> From: Sepherosa Ziehau Date: Thu, 23 Feb 2017 11:40:21 +0800 Message-ID: Subject: Re: listening sockets as non sockets To: Gleb Smirnoff Cc: Julien Charbon , Jason Eggleston , "freebsd-net@freebsd.org" , hiren@freebsd.org, jtl@freebsd.org, rrs@freebsd.org Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Feb 2017 03:40:23 -0000 On Thu, Feb 23, 2017 at 7:27 AM, Gleb Smirnoff wrote: > On Tue, Feb 21, 2017 at 09:58:45AM +0100, Julien Charbon wrote: > J> > T> 1) The patch worked pretty okay, but the idea of separate file type is > J> > T> abandoned. With current filedescriptor code it is almost impossible > J> > T> to racelessly switch fileops and f_data. > J> > T> For more details read the commit message, URL below. > J> > T> > J> > T> 2) I moved the work to git. It allows for easier code sharing. > J> > T> > J> > T> https://github.com/glebius/FreeBSD/commit/3a52df429889ea9c6e61013f6913aad95939f159 > J> > > J> > The current 'solisten' branch at https://github.com/glebius/FreeBSD has > J> > been running successfully for 48 hours at Netflix. But as mentioned before, > J> > our connection rate is pretty low. > J> > > J> > So, testing from Julien and Hiren will be much appreciated. > J> > J> Sound good, I will have spare time to get performance results on our > J> side w/ and w/o your change before the end of this week. > > Thanks, Julien! Looking forward for your results. Meanwhile, the code has > been running for a week on a single Netflix box. And for 24 hours on a > set of boxes as A/B test against non-patched code. Since our connection > rate is low, and we never seen accept_mtx to be a major problem in our > profiling, the A/B test didn't show any statistically significant > improvements. But my biased eye of course sees some improvements in the > graphs :) You can use this to force clients to generate 1 request/connection (--connreqs 1) to test the accept queue contention for HTTP workload: https://github.com/sepherosa/wrk Checkout the sephe/wrk branch. pkg install wrk. Then gmake in the checked out directory. Thanks, sephe -- Tomorrow Will Never Die