From owner-freebsd-stable@FreeBSD.ORG Fri Mar 20 00:27:18 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id ADD03E93 for ; Fri, 20 Mar 2015 00:27:18 +0000 (UTC) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 72F2C89 for ; Fri, 20 Mar 2015 00:27:18 +0000 (UTC) Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a]) by smarthost1.sentex.ca (8.14.9/8.14.9) with ESMTP id t2K0RGYc096579; Thu, 19 Mar 2015 20:27:16 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <550B6950.8060806@sentex.net> Date: Thu, 19 Mar 2015 20:26:56 -0400 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: John-Mark Gurney Subject: Re: 35-40% performance drop releng9 vs releng10 openvpn References: <5506250A.2000506@sentex.net> <20150316132055.GQ32288@funkthat.com> <5509D6C6.4050204@sentex.net> <20150318211457.GL51048@funkthat.com> In-Reply-To: <20150318211457.GL51048@funkthat.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.75 Cc: FreeBSD-STABLE Mailing List X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Mar 2015 00:27:18 -0000 On 3/18/2015 5:14 PM, John-Mark Gurney wrote: > # dtrace -x stackframes=100 -n 'profile-997 /arg0/ { @[stack()] = count(); } tick-60s { exit(0); }' -o out.kern_stacks > > Also, another thing you can do is to compare the two using differential > flame graphs: > http://www.brendangregg.com/blog/2014-11-09/differential-flame-graphs.html > > Which will highlight where the performances differ... OK, some more data points. It seems a performance regression happened in RELENG_10 somewhere between r277684 (late January 2015) and now. Using r277684 on RELENG_10, I can get about 75Mb/s of throughput on OpenVPN. Still not as good as the 83-85Mb on RELENG_9, but much better than the 61Mb using RELENG_10 from the start of this week, For the differential graph, see http://tancsa.com/diffgraph.svg and http://tancsa.com/10-r277684.svg http://tancsa.com/10-r277684-kern.svg ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/