From owner-freebsd-net@freebsd.org Sat Aug 6 18:22:48 2016 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 13E36BB0084 for ; Sat, 6 Aug 2016 18:22:48 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: from mail-wm0-x22f.google.com (mail-wm0-x22f.google.com [IPv6:2a00:1450:400c:c09::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9D1FE16AC for ; Sat, 6 Aug 2016 18:22:47 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: by mail-wm0-x22f.google.com with SMTP id i5so77581412wmg.0 for ; Sat, 06 Aug 2016 11:22:47 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=multiplay-co-uk.20150623.gappssmtp.com; s=20150623; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to; bh=LufnxqGQ5BSGkkYlJu3dZPddxtlbz4WKFhae6jNDp+M=; b=d1v7lI5f0Dkcizft+RJWOLbIKKGKrLVncUuxcayNqdMDAvrOIfsYpsbpIUsIQgd1XX F/76WQJk5ET1xrRN+I9k0Nld20yqyicetN/FluKDQxneQQU2gAW9uJkGWnnyccQ/Elb6 g3VkbAzBjwUlKo0Zr5BDQEXRsNEKyH5+ZFFZ34lXNIR6zZBjp9kbXHorhyzkQXJRSqGi mB0Ixv9zIu3b5llhZPcSqdbWOMpAR3oGixu8Q5/YQF3q9LpRwPOtDI/l/43VTAkvf3YT zaHGRTdncW5PXIw0xF7DOaAw17e5Kxh4LY2OreRkDFxMxnFq4rdmoBEonU9g6nbTJ+T7 nifQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to; bh=LufnxqGQ5BSGkkYlJu3dZPddxtlbz4WKFhae6jNDp+M=; b=jLFm4NeRxR7aV5XxqAbmLrIKFsyXUC6vXGzXT3+AWuUvTtus4VM6DpmyncV4nHhHWX qT7NYX1sHCa6Z6dUukdwc80xauBIbHqyF1aOR84HeRVDxDiJosUu0nIwVWCCOIdqFjuV rimisPV0Dw9RLpcFZJwvGNtGQxpkNO12CWO8XgiXrlLPFGCj7YEhoX7XExADhNZt5lMM xJ7WZSLFwXilJ/XAUQ7Xi92XXlpSVoZzoHzLkmTs4UAgeXjC60K9+eXH/vzjuLA1WFrJ vA2a5Hbc1zgGKMTuxLvbDcx2wFAnb4yr2DTFf3kVTusaUFsw2AntfQxrS37+Lm/ws4kN l7EQ== X-Gm-Message-State: AEkoouvKnxrC5I5LPDGcQ7bLNMXMFpWAeddrUvZ521q8Omt5gMyQi3EgF1QZv+l/o++cfiyv X-Received: by 10.195.12.77 with SMTP id eo13mr70566425wjd.142.1470507763960; Sat, 06 Aug 2016 11:22:43 -0700 (PDT) Received: from [10.10.1.58] (liv3d.labs.multiplay.co.uk. [82.69.141.171]) by smtp.gmail.com with ESMTPSA id 207sm14800785wmb.7.2016.08.06.11.22.42 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 06 Aug 2016 11:22:42 -0700 (PDT) Subject: Re: 40Gbps http client benchmark To: freebsd-net@freebsd.org References: <57A62668.7020309@grosbein.net> From: Steven Hartland Message-ID: Date: Sat, 6 Aug 2016 19:22:44 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.2.0 MIME-Version: 1.0 In-Reply-To: <57A62668.7020309@grosbein.net> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.22 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 06 Aug 2016 18:22:48 -0000 I'm not sure it will help you at those levels, but have you tried boom? https://github.com/rakyll/boom On 06/08/2016 19:03, Eugene Grosbein wrote: > Hi! > > Is there any high performance benchmark acting as http client for > outer http server > capable to receive 40Gbps without overwhelming CPU with insane number > of syscalls? > > I've tried benchmarks/wrk version 4.0.2 and it works just fine upto > 20Gbps > for my hardware: two 6-core (HT disabled) Intel(R) Xeon(R) CPU E5-2620 > v3 @ 2.40GHz > with two dual-port ix(4) 82599ES 10-Gigabit SFI/SFP+ Network Connection > combined to single lagg interface (lagghash l4). > > But each worker pthread of wrk generates too many kqueue() system calls > polling for incoming data and eats 100% of its CPU core and cannot > receive more. > Or, it may be some kqueue() kernel level lock contention, I do not know. > More worker threads, more overloaded CPU cores, no increase of > transfer over about 20Gbps. > > I transfer 1MByte-sized files for the benchmark (tried 8MB-sized too). > I set sysctl net.inet.tcp.recvspace=4194304 (4MB). > I've even patched wrk to to use read buffer sized 4MB instead of its > compiled-in > default 8k, as it does not change default socket options other than > TCP_NODELAY: > > --- src/wrk.h.orig 2016-08-06 23:20:16.205906000 +0700 > +++ src/wrk.h 2016-08-06 23:20:20.460579000 +0700 > @@ -18,7 +18,7 @@ > #include "ae.h" > #include "http_parser.h" > > -#define RECVBUF 8192 > +#define RECVBUF 4194304 > > #define MAX_THREAD_RATE_S 10000000 > #define SOCKET_TIMEOUT_MS 2000 > > Nothing helps to decrease consumed system time and ktrace(1) assures > that's because of kevent() calls. > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"