From owner-freebsd-stable@FreeBSD.ORG Fri Jan 16 20:21:10 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 760F99B3 for ; Fri, 16 Jan 2015 20:21:10 +0000 (UTC) Received: from mail-lb0-x231.google.com (mail-lb0-x231.google.com [IPv6:2a00:1450:4010:c04::231]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id EB5A9B21 for ; Fri, 16 Jan 2015 20:21:09 +0000 (UTC) Received: by mail-lb0-f177.google.com with SMTP id b6so20234389lbj.8 for ; Fri, 16 Jan 2015 12:21:07 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=uctsunqbunNhA6PdJCOxV1MHpT6DBPsknJKqMVpeA+k=; b=X7tV1EQq06wNOoEidb1T06sjBhMQWMvVfkb1rKJ1lTs/LCAws5wIbT+4yMaOx7n+N5 aVTEvhnxQAsvB3mYBvQ7OFBHm+M5sbA6INXaXvH+4TMKC4uHNHs+QGPqV9QZhTUXj9yM Pb+w9B3tFwA2Yg9ilO8ktdTZykGQxOoIwYmoAKD6DOiy60n3pzMBhjMx1uGifehS/UzL yweqUy+qQxUMj/ga/DNSaw6rV0MAUq0wkIsqyuE4MfGx3HAmVUuh5pM1Ur0dgJHlaaFu NuWXyqMfOhyIWgcB7anzZucKE13f3Dl4UHVk7Jmv0Yzec+gPgNn7yABLB57aEOFNsHF9 j7Vw== MIME-Version: 1.0 X-Received: by 10.152.2.8 with SMTP id 8mr17062527laq.97.1421439667813; Fri, 16 Jan 2015 12:21:07 -0800 (PST) Received: by 10.112.155.229 with HTTP; Fri, 16 Jan 2015 12:21:07 -0800 (PST) In-Reply-To: References: <54B7F769.40605@gmail.com> <20150115175927.GA19071@zxy.spb.ru> <54B8C7E9.3030602@gmail.com> Date: Fri, 16 Jan 2015 22:21:07 +0200 Message-ID: Subject: Re: Poor performance on Intel P3600 NVME driver From: Mihai-Alexandru Vintila To: freebsd-stable@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 Jan 2015 20:21:10 -0000 @ Chuck Tuffli - error was caused by older firmware + the fact that the nvme controller didn't negotiate on x16 so i had to force the pcie to x16 from bios. With the update is fixed, i've just added it to be indexed since i couldn't find anything on google. @Barney Wolff it's a new pool with only changes recordsize=4k and compression=lz4 . On linux test is on ext4 with default values. Penalty is pretty high. Also there is a read penalty for read as well between ufs and zfs. Even on nvmecontrol perftest you can see the read penalty it's not normal to have same result for both write and read On Fri, Jan 16, 2015 at 8:19 PM, Chuck Tuffli wrote: > On Fri, Jan 16, 2015 at 12:12 AM, Mihai Vintila wrote: > > I've tried to increase it and obtained around 90k iops for write, but > now i > > only get : > > > > nvme0: WRITE sqid:6 cid:125 nsid:1 lba:3907028496 len:16 > > nvme0: WRITE FAULTS (02/80) sqid:6 cid:125 cdw0:0 > > nvme0: async event occurred (log page id=0x1) > > nvme0: WRITE sqid:6 cid:126 nsid:1 lba:528 len:16 > > nvme0: WRITE FAULTS (02/80) sqid:6 cid:126 cdw0:0 > > nvme0: async event occurred (log page id=0x1) > > nvme0: WRITE sqid:6 cid:127 nsid:1 lba:3907027984 len:16 > > nvme0: WRITE FAULTS (02/80) sqid:6 cid:127 cdw0:0 > > nvme0: async event occurred (log page id=0x1) > > If it helps, 02/80 means media error / LBA out of range, and log page > 0x1 contains command error information which will probably show that > the starting LBA field for the write command was the issue. > > --chuck >