From owner-freebsd-stable@freebsd.org Tue Sep 24 15:45:53 2019 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 32FC81291C7 for ; Tue, 24 Sep 2019 15:45:53 +0000 (UTC) (envelope-from john@spikefishsolutions.com) Received: from mail-lj1-x232.google.com (mail-lj1-x232.google.com [IPv6:2a00:1450:4864:20::232]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46d5BS0Rb8z4Zsc for ; Tue, 24 Sep 2019 15:45:51 +0000 (UTC) (envelope-from john@spikefishsolutions.com) Received: by mail-lj1-x232.google.com with SMTP id f5so2393598ljg.8 for ; Tue, 24 Sep 2019 08:45:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=spikefishsolutions.com; s=google; h=mime-version:from:date:message-id:subject:to; bh=2gabdRLSxtk1cYz7OjxV2kJRl0/SSrNh/eciUe0t7+Y=; b=G5xTlqpRELGhdUnPN0Ma+6Lfm6VuUTX6JZcS/OeX0uJCPB9ekQrF0NqS7DW0dQBs2Q dvQYHRMC5ANMsDMf9nn7tHBo4Avm99ZQu79Z9u1zLVnIfRimQwQwHI7FlThfLomeP95y r+6J8sPAdLSDNklsrd0ixU5y8RendjSOSBBE8= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=2gabdRLSxtk1cYz7OjxV2kJRl0/SSrNh/eciUe0t7+Y=; b=RPHdhgd5DmBeyt4ulBeVlrgC8KWtTwvWmTreXP6O9hUIDnCoh37ctFsophwkQJUVEM mjexGH6VkMs1G537sHMcTes6j2vY6rIAQPaKDyj52kbQdV3mbhbzsx38FfwSVA4p5/zn TmAjZY1rNrJ4LgsgaxLbiQTiCEqOhYDSCvUfJ6yASa5EErNu2dinhqBrLnpGuazZfKFg yvQHtsLYsdqGvM+IezkJ08cE9ieLRZ3ndT/SA4lRXeA/wVYC+Q1hwp8RdrEYnAECVZnF cKivzISqmorIdQYRz71JnWpKKxyo6lBc3ZBmh4UTb2YSqmGRaj0mScDyC6f50IeMZ2uP 01ow== X-Gm-Message-State: APjAAAVjNNNp7JNjI1o2W6LQEnYDMMkEY845WBLWwGspaePeDKcRs/Oe YiseF4cpO4vfPwReirWYjT/qEKwkV/E/d/xcH5rDVL2I X-Google-Smtp-Source: APXvYqxSZTteaDRQH51g8yI3A7IhHu89fjVCi0KxeCV0DvAJUHXkSudA8/TBeNKa3qqyphZFXhNyh3E1LOoz8qSGIvk= X-Received: by 2002:a2e:904c:: with SMTP id n12mr2485034ljg.139.1569339949375; Tue, 24 Sep 2019 08:45:49 -0700 (PDT) MIME-Version: 1.0 From: John Fleming Date: Tue, 24 Sep 2019 11:45:37 -0400 Message-ID: Subject: Question about bottle neck in storage To: freebsd-stable@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 46d5BS0Rb8z4Zsc X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=spikefishsolutions.com header.s=google header.b=G5xTlqpR; dmarc=none; spf=pass (mx1.freebsd.org: domain of john@spikefishsolutions.com designates 2a00:1450:4864:20::232 as permitted sender) smtp.mailfrom=john@spikefishsolutions.com X-Spamd-Result: default: False [-5.35 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[spikefishsolutions.com:s=google]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; DMARC_NA(0.00)[spikefishsolutions.com]; DKIM_TRACE(0.00)[spikefishsolutions.com:+]; RCVD_IN_DNSWL_NONE(0.00)[2.3.2.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; IP_SCORE(-2.85)[ip: (-9.09), ipnet: 2a00:1450::/32(-2.91), asn: 15169(-2.20), country: US(-0.05)]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Sep 2019 15:45:53 -0000 Is there anyway to see how busy a SAS/Sata controller is vs disks? I have a R720 with 14 Samsung 860 EVOs in it (its a lab server) in raid 10 ZFS. When firing off a dd I (bs=1G count=10) seems like the disks never go above %50 busy. I'm trying to figure out if i'm maxing out SATA 3 BW or if its something else (like terrible dd options). my setup is Dell R720 with 2 x LSI 9361 cards. Each card is going to a dedicated 8 drive board inside the front of the R720. Basically i'm just saying its not a single SAS cable to 14 drives. Don't have cpu info hand.. zeon something. DDR3-1600 (128GB) Both controllers are in 8x slots running PCIe gen 3. BTW i'm sure this has been asked a million times but what would be some decent benchmark tests while i'm at it?