From owner-freebsd-hackers@FreeBSD.ORG Sat Apr 4 11:15:03 2015 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id D89793BE; Sat, 4 Apr 2015 11:15:03 +0000 (UTC) Received: from mail-wi0-x22d.google.com (mail-wi0-x22d.google.com [IPv6:2a00:1450:400c:c05::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7439DA9E; Sat, 4 Apr 2015 11:15:03 +0000 (UTC) Received: by widjs5 with SMTP id js5so39372630wid.1; Sat, 04 Apr 2015 04:15:00 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=cJ0Kb0MOGy4rnKd4QrO+T8rFYmRVyAn0KYkOvBkB8F0=; b=RMzBZSqjFKBI5NYIpYMoqsr7eWazACPGLw7g192AW90olI9Fe7zjyPd52cEsWGjxfq 9idKOixfkeQh/i7H5UHZ2Bte+FTO+TrvJ+U0Uj2g9kojdkOFYSGB6atQ1kEa1o/oWsjH hM9kdnJ3RflgLK+HJTGMz1MFUBFCz/zlQz+Iu/MlRkNQHaPkga5+LWCeqqKpgi5rOsu7 Led8FDqSuiVXmntxwiSYsqq4pxTyqWazJph9ZqodVZebbQ1xyy1jpLiyTmNLtOyX9HxP bEYamT33DDb1ex7CconJn9JJnAalVw0NObUBshc5wx3GWQsmcd2kOZxgSxOo7WwnTGel 0m3Q== X-Received: by 10.180.75.233 with SMTP id f9mr41263061wiw.5.1428146100937; Sat, 04 Apr 2015 04:15:00 -0700 (PDT) Received: from [192.168.1.141] (ppp-46-244-230-77.dynamic.mnet-online.de. [46.244.230.77]) by mx.google.com with ESMTPSA id i10sm15232145wja.40.2015.04.04.04.14.59 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 04 Apr 2015 04:15:00 -0700 (PDT) Message-ID: <551FC7B3.80203@gmail.com> Date: Sat, 04 Apr 2015 13:14:59 +0200 From: Tobias Oberstein User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: Konstantin Belousov Subject: Re: NVMe performance 4x slower than expected References: <551BC57D.5070101@gmail.com> <551C5A82.2090306@gmail.com> <20150401212303.GB2379@kib.kiev.ua> <551C6B62.7080205@gmail.com> <551D4E5F.9090400@gmail.com> <20150402221029.GE2379@kib.kiev.ua> In-Reply-To: <20150402221029.GE2379@kib.kiev.ua> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit Cc: "freebsd-hackers@freebsd.org" , Michael Fuckner , Jim Harris , Alan Somers X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 04 Apr 2015 11:15:03 -0000 >> I was advised (off list) to run tests against a pure ramdisk. >> >> Here are results from a single socket E3: >> >> https://github.com/oberstet/scratchbox/blob/master/freebsd/cruncher/results/freebsd_ramdisk.md#xeon-e3-machine >> >> and here are results for the 48 core box >> >> https://github.com/oberstet/scratchbox/blob/master/freebsd/cruncher/results/freebsd_ramdisk.md#48-core-big-machine >> >> Performance with this box is 1/10 on this test compared to single socket E3! >> >> Something is severely wrong. It seems, there might be multiple issues >> (not only NVMe). And this is after already running with 3 patches to >> make it even boot. > The speed of dd already looks wrong. Yes. > > Check the CPU frequency settings in BIOS, and check what sysctl dev.cpu > reports. Ensure that cpufreq.ko is loaded from loader.conf. It's loaded now, and CPU clock is at maximum: dev.cpu.0.freq: 3000 Unfortuanetly, performance (randomio/fio) did not change ..