Skip site navigation (1)Skip section navigation (2)
Date:      Fri, 10 Apr 2015 18:07:48 +0200
From:      Tobias Oberstein <tobias.oberstein@gmail.com>
To:        Adrian Chadd <adrian@freebsd.org>
Cc:        Konstantin Belousov <kostikbel@gmail.com>, "freebsd-hackers@freebsd.org" <freebsd-hackers@freebsd.org>, Michael Fuckner <michael@fuckner.net>, Jim Harris <jim.harris@gmail.com>, Alan Somers <asomers@freebsd.org>
Subject:   Re: NVMe performance 4x slower than expected
Message-ID:  <5527F554.2030806@gmail.com>
In-Reply-To: <CAJ-VmonecBDemkfS=3nV2jiuJfOFJg7bZOacxOKXvTWktxBd9A@mail.gmail.com>
References:  <551BC57D.5070101@gmail.com>	<CAOtMX2jVwMHSnQfphAF%2Ba2%2Bo7eLp62nHmUo4t%2BEahrXLWReaFQ@mail.gmail.com>	<CAJP=Hc-RNVuhPePg7bnpmT4ByzyXs_CNvAs7Oy7ntXjqhZYhCQ@mail.gmail.com>	<551C5A82.2090306@gmail.com>	<20150401212303.GB2379@kib.kiev.ua>	<CAJP=Hc87FMYCrQYGfAtefQ8PLT3WtnvPfPSppp3zRF-0noQR9Q@mail.gmail.com>	<CAJP=Hc-WLKe3%2BDQ=2o21CY=aaQAjADrzEfnD7NVO1Cotu4vcGg@mail.gmail.com>	<5526EA33.6090004@gmail.com> <CAJ-VmonecBDemkfS=3nV2jiuJfOFJg7bZOacxOKXvTWktxBd9A@mail.gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
Hi Adrian,

 > Dell has graciously loaned me a bunch of hardware to continue doing

FWIW, Dell has a roughly comparable system: Dell R920. But they don't 
have Intel NVMe's on their menu, only Samsung (and FusionIO, but that's 
not NVMe).

> NUMA development on, but I have no NVMe hardware. I'm hoping people at

The 8 NVMe PCIe SSDs in the box we're deploying are a key feature of 
this system (will be a data-warehouse). A single NVMe probably won't 
have triggered (all) issues we experienced.

We are using the largest model (2TB), and this amounts to 50k bucks for 
all eight. The smallest model (400GB) is 1.5k, so 12k in total.

> Intel can continue kicking along any desires for NUMA that they
> require. (Which they have, fwiw.)

It's already awesome that Intel has senior engineers working on FreeBSD 
driver code! And it would underline Intel's Open-source commitment and 
tech leadership if they donated a couple of these beefy NVMes.

The specs are incredible, but extracing all the performance is 
non-trivial ..

Cheers,
/Tobias



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?5527F554.2030806>