From owner-freebsd-net@freebsd.org Sat Feb 25 15:09:31 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2362BCEC7C2 for ; Sat, 25 Feb 2017 15:09:31 +0000 (UTC) (envelope-from sepherosa@gmail.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 010D1CD9 for ; Sat, 25 Feb 2017 15:09:31 +0000 (UTC) (envelope-from sepherosa@gmail.com) Received: by mailman.ysv.freebsd.org (Postfix) id F1018CEC7C0; Sat, 25 Feb 2017 15:09:30 +0000 (UTC) Delivered-To: net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F09C8CEC7BF for ; Sat, 25 Feb 2017 15:09:30 +0000 (UTC) (envelope-from sepherosa@gmail.com) Received: from mail-vk0-x22d.google.com (mail-vk0-x22d.google.com [IPv6:2607:f8b0:400c:c05::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A8DB5CD8; Sat, 25 Feb 2017 15:09:30 +0000 (UTC) (envelope-from sepherosa@gmail.com) Received: by mail-vk0-x22d.google.com with SMTP id t8so25141251vke.3; Sat, 25 Feb 2017 07:09:30 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=J9qzbBgbSzdU0QBH+YCeS6yswpdkVonFzAzZhZbKRro=; b=nS8HJW9EBAdKw2SSgnxp/n2CaIFhr6pQ44VQ7hQM6ozrjUoBsk635nel8o9Yf8Xfts 3qxT/YInnFVbd/PtJpEuux4eHVoTucXHg9+W0RLdjvSyYsfg+MbPsgDJMpfsqNlXwxFK oSfYPBTppae8YBs2IavdFnD+vrElf5XZRQZnojmpi3LWv9gbGd33r0xLUKDgb6oPDKV5 zsOEeIYB6A/+Uu4m9WsupbtwWnxixceZfyoIUe04JD92T5H511JYXCiwK11Vn9pA2PwQ kzSeW9futRmJd6zff2y2nnbLR8sDmkRqzFp23g5DNcYwAGle0rhyvf+058XfeLnAZEh5 BDJA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=J9qzbBgbSzdU0QBH+YCeS6yswpdkVonFzAzZhZbKRro=; b=arITmQeGCnWlBtkHn2cOePiC1V82yUNod4X0ibhEqbx2T0DLOc6bBoAjNb6zFdWG1j EZeTK42qUH+T7VQA1gAA4MLqd9nPLkkvWOb9QEs7CPPnq0sAw+yw6D5l0+EucoUzOl9Q 4MfWe1gTXXiOLJsAce6ryEiZWrjp+MCxVkjSno8XhnPaPfP17io3iTvyyx7uawB+MM3o pKkGZzIsYJbGV7W248os/W3MocC4zV1V3yJVsvm7Z7oq0QWbYS1oaHcQslc/WON3b+6q aF5mYr99FaWeN3HeUJYk3PdNCRhb2I+rFH/Wl7XJRPBzGrxsysB9q01Qdsqk29YBTY7o OrSg== X-Gm-Message-State: AMke39k8TjlhA7NhPPriZFGs5ZiY3zB82ufxHQLlHKFgUJlw653G7q6bBCR+hnKfYXOMNza6D0WJUfCpMINuvA== X-Received: by 10.31.134.142 with SMTP id i136mr3698096vkd.56.1488035369682; Sat, 25 Feb 2017 07:09:29 -0800 (PST) MIME-Version: 1.0 Received: by 10.176.66.193 with HTTP; Sat, 25 Feb 2017 07:09:29 -0800 (PST) In-Reply-To: <20170224131349.GJ15630@zxy.spb.ru> References: <20170127005251.GM2611@FreeBSD.org> <20170210063024.GE1973@FreeBSD.org> <20170216184903.GF58829@FreeBSD.org> <0858647a-ec3c-1a78-053f-d04397a82d8a@freebsd.org> <20170222232704.GJ8899@FreeBSD.org> <20170223153636.GI15630@zxy.spb.ru> <20170224131349.GJ15630@zxy.spb.ru> From: Sepherosa Ziehau Date: Sat, 25 Feb 2017 23:09:29 +0800 Message-ID: Subject: Re: listening sockets as non sockets To: Slawa Olhovchenkov Cc: rrs@freebsd.org, hiren@freebsd.org, Jason Eggleston , Julien Charbon , "freebsd-net@freebsd.org" , jtl@freebsd.org Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 25 Feb 2017 15:09:31 -0000 On Fri, Feb 24, 2017 at 9:13 PM, Slawa Olhovchenkov wrote: > On Thu, Feb 23, 2017 at 06:36:36PM +0300, Slawa Olhovchenkov wrote: > >> On Thu, Feb 23, 2017 at 11:40:21AM +0800, Sepherosa Ziehau wrote: >> >> > On Thu, Feb 23, 2017 at 7:27 AM, Gleb Smirnoff wrote: >> > > On Tue, Feb 21, 2017 at 09:58:45AM +0100, Julien Charbon wrote: >> > > J> > T> 1) The patch worked pretty okay, but the idea of separate file type is >> > > J> > T> abandoned. With current filedescriptor code it is almost impossible >> > > J> > T> to racelessly switch fileops and f_data. >> > > J> > T> For more details read the commit message, URL below. >> > > J> > T> >> > > J> > T> 2) I moved the work to git. It allows for easier code sharing. >> > > J> > T> >> > > J> > T> https://github.com/glebius/FreeBSD/commit/3a52df429889ea9c6e61013f6913aad95939f159 >> > > J> > >> > > J> > The current 'solisten' branch at https://github.com/glebius/FreeBSD has >> > > J> > been running successfully for 48 hours at Netflix. But as mentioned before, >> > > J> > our connection rate is pretty low. >> > > J> > >> > > J> > So, testing from Julien and Hiren will be much appreciated. >> > > J> >> > > J> Sound good, I will have spare time to get performance results on our >> > > J> side w/ and w/o your change before the end of this week. >> > > >> > > Thanks, Julien! Looking forward for your results. Meanwhile, the code has >> > > been running for a week on a single Netflix box. And for 24 hours on a >> > > set of boxes as A/B test against non-patched code. Since our connection >> > > rate is low, and we never seen accept_mtx to be a major problem in our >> > > profiling, the A/B test didn't show any statistically significant >> > > improvements. But my biased eye of course sees some improvements in the >> > > graphs :) >> > >> > You can use this to force clients to generate 1 request/connection >> > (--connreqs 1) to test the accept queue contention for HTTP workload: >> > https://github.com/sepherosa/wrk >> > >> > Checkout the sephe/wrk branch. pkg install wrk. Then gmake in the >> > checked out directory. >> >> pkg install gcc gmake, may be? >> >> PANIC: unprotected error in call to Lua API (27) >> PANIC: unprotected error in call to Lua API (13) > > Ah, sorry, wrong branch. > > Can I use per-connection Lua script (for delays and url generation)? > Not per-thread. I am need to emulate many client connections (about > 10K-40K). > Currently I am have some trouble w/ >20K connections. I didn't try the Lua script. Make sure to low the MSL on the box running wrk, e.g. 10ms. Well, I'd recommend you to run 15K concurrent connections on one testing box. Thanks, sephe -- Tomorrow Will Never Die