From owner-freebsd-hackers@freebsd.org Fri Feb 22 09:29:43 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 641CF14E2B27 for ; Fri, 22 Feb 2019 09:29:43 +0000 (UTC) (envelope-from rajfbsd@gmail.com) Received: from mail-wr1-x430.google.com (mail-wr1-x430.google.com [IPv6:2a00:1450:4864:20::430]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 559F38B9FF for ; Fri, 22 Feb 2019 09:29:42 +0000 (UTC) (envelope-from rajfbsd@gmail.com) Received: by mail-wr1-x430.google.com with SMTP id t18so1593814wrx.2 for ; Fri, 22 Feb 2019 01:29:42 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=+yNbzOMDkdpGbpe9j29wbMKv+oiZg2KgfiLx/itIWwg=; b=S9pJTAcSdlU3y5aQmTZRGYx/eGUZpz/FMOKME01r4zSID1o/PEXALj4xitXxq0+Ra/ qltOMQOlHlqzVB9u0qFSZ3r4f3tdytZ6+aRWjwwghp9o60KBwtE7e2kHHNFKWWmlKa3Z 2uVuskETg0J48riiyqAQiESq4Ky2wnzRDA0+eOaQRBuqksWgA4lf39AzUJruzimTMR/K dgZRFYzVAoFVqqH9Td4xnsY0NmQy25ZX5dCsw122+Nfy6/LCJpjkEuslJuiQkHIS8EJ6 VT7/NycDmjf6LkZeqr4nXG5WTBhgDsBko73MTjLE4SXpcok5BdIBRydstU+cbX7LhbIO 0aFA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=+yNbzOMDkdpGbpe9j29wbMKv+oiZg2KgfiLx/itIWwg=; b=gcwTOs719oBSb7pxPvk/eLJxV/OHyCHOGqtsa4c2vGWt/+dUFExwgRXXzKenrRbPiN vviz9+EvSFuZ0TK1vBlO83eV7Ex+MF9WdHD7kn5NZTY6o/CC8Vo8JhGILFi5mbwv1mw6 Atb7uWi63xreX9QOl5I0u/dTEooLA0EBlPSpx9PqTtMWcj0NFkDzIyc4sgmfW8zBneXt rloKdorEaep2ljWKGHJInK/Dq8MRPQXUt6R8u2Pqt5Zk2h5asDQp0N34F41JfUR7fSCb zk8aYf5krBYiBNSOxgp7/jhbV8OS0l0lHnlosLSZ5CRnbJywj1DRr9UhrFw39k5tDnxS ULOw== X-Gm-Message-State: AHQUAuYA4AXDx2Im6UAM0L1yBI3icqaRWn/uOgsskCPM9PNBMyPULrO9 4v7tC5VJpYAvPCeY7gwUwT4SiG4y3H9wD8SDafI= X-Google-Smtp-Source: AHgI3IZRVYqxGsWkaLNPG9cVAER4pHxKbtRJh8YJvKnS3iTLeinfnldM2odTf1B/sFDgGTk3cdIYGjJlL1970v2M3Sw= X-Received: by 2002:a05:6000:1084:: with SMTP id y4mr2240562wrw.14.1550827780718; Fri, 22 Feb 2019 01:29:40 -0800 (PST) MIME-Version: 1.0 References: <0E136DED-C1AD-481C-B243-C943D4F8D9C5@gmail.com> In-Reply-To: <0E136DED-C1AD-481C-B243-C943D4F8D9C5@gmail.com> From: Rajesh Kumar Date: Fri, 22 Feb 2019 14:59:28 +0530 Message-ID: Subject: Re: Any ideal way to run FIO benchmarking for NVMEe devices in FreeBSD To: Enji Cooper Cc: FreeBSD Hackers X-Rspamd-Queue-Id: 559F38B9FF X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=S9pJTAcS; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of rajfbsd@gmail.com designates 2a00:1450:4864:20::430 as permitted sender) smtp.mailfrom=rajfbsd@gmail.com X-Spamd-Result: default: False [-6.36 / 15.00]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_SHORT(-0.60)[-0.602,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[0.3.4.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; IP_SCORE(-2.74)[ip: (-9.40), ipnet: 2a00:1450::/32(-2.26), asn: 15169(-1.99), country: US(-0.07)]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 22 Feb 2019 09:29:43 -0000 Hi Enji Cooper, I am using Samsung 960 PRO https://www.samsung.com/semiconductor/minisite/ssd/product/consumer/960pro/ On Fri, Feb 22, 2019 at 2:36 PM Enji Cooper wrote: > > > On Feb 22, 2019, at 12:51 AM, Rajesh Kumar wrote: > > > > Hi, > > > > I am trying to run FIO benchmark test with NVMe devices and see how > FreeBSD > > performs. There are lot of variables and combination. So, can anyone > > suggest a Ideal way to do FIO benchmarking in FreeBSD? My intent is to > > check what is the maximum throughput and IOPS the device delivers in > > FreeBSD. > > > > Few questions regarding the same, > > > > 1. Should we use "posixaio" as the ioengine (or) something else? > > 2. Should we use single thread (or) multiple threads for test? If > > multiple threads, how can we decide on the optimal thread count? > > 3. Should we use "raw device files" (Eg: nvme namespace file - > > /dev/nvme0ns1) without filesystem (or) use a mounted filesystem with a > > regular file (Eg: /mnt/nvme/test1). Looks like raw device files give > better > > numbers. > > 4. Should we use a shared file (or) one file per thread? > > 5. I believe 1Job should be fine for benchmarking. (or) should we try > > multiple jobs? > > > > Please let me know your suggestions. Also, please suggest performance > > tuning methods for NVMe and storage devices in general. > > Hi Rajesh, > Is there a data sheet for the NVMe device? > Cheers, > -Enji