From owner-freebsd-fs@freebsd.org Sun May 2 09:50:22 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0AC295FEAC4 for ; Sun, 2 May 2021 09:50:22 +0000 (UTC) (envelope-from njm@njm.me.uk) Received: from smtp002.apm-internet.net (smtp002.apm-internet.net [85.119.248.221]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FY1Yn0GYRz4VtR for ; Sun, 2 May 2021 09:50:20 +0000 (UTC) (envelope-from njm@njm.me.uk) Received: (qmail 79887 invoked from network); 2 May 2021 09:50:17 -0000 X-APM-Out-ID: 16199490177988 X-APM-Authkey: 18389/1(18389/1) 2 Received: from unknown (HELO meld.njm.me.uk) (86.179.69.31) by smtp002.apm-internet.net with SMTP; 2 May 2021 09:50:17 -0000 Received: from triton.njm.me.uk (triton.njm.me.uk [192.168.144.133]) by meld.njm.me.uk (8.16.1/8.16.1) with ESMTPS id 1429oGZf091891 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Sun, 2 May 2021 10:50:17 +0100 (BST) (envelope-from njm@njm.me.uk) Received: from localhost (localhost [127.0.0.1]) by triton.njm.me.uk (8.16.1/8.16.1) with ESMTP id 1429oGnj086540; Sun, 2 May 2021 10:50:16 +0100 (BST) (envelope-from njm@njm.me.uk) Date: Sun, 02 May 2021 10:50:16 +0100 From: "N.J. Mann" To: Ronald Klop cc: freebsd-fs@freebsd.org Subject: Re: readdir() -> d_type always zero on NFS v3 mounted filesystems Message-ID: <6A9568DA9DF89991BA30F63E@triton.njm.me.uk> In-Reply-To: <78c159ef-947a-8e2f-53bf-8d27b80193bf@klop.ws> References: <2E84A420CCC10A73504624DE@triton.njm.me.uk> <78c159ef-947a-8e2f-53bf-8d27b80193bf@klop.ws> X-Mailer: Mulberry/4.0.8 (Linux/x86) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Rspamd-Queue-Id: 4FY1Yn0GYRz4VtR X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of njm@njm.me.uk has no SPF policy when checking 85.119.248.221) smtp.mailfrom=njm@njm.me.uk X-Spamd-Result: default: False [-2.20 / 15.00]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[85.119.248.221:from]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[njm.me.uk]; AUTH_NA(1.00)[]; SPAMHAUS_ZRD(0.00)[85.119.248.221:from:127.0.2.255]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCPT_COUNT_TWO(0.00)[2]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:35259, ipnet:85.119.248.0/21, country:GB]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[freebsd-fs]; RCVD_IN_DNSWL_LOW(-0.10)[85.119.248.221:from] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 02 May 2021 09:50:22 -0000 Hi Ronald, On Thursday, April 29, 2021 13:14:53 +0200 Ronald Klop wrote: > On 4/29/21 10:24 AM, N.J. Mann wrote: [...] > > Nice analysis. The manual page dirent(5) says: > "BUGS > The usage of the member d_type of struct dirent is unportable as it is > FreeBSD-specific. It also may fail on certain file systems, for example > the cd9660 file system. > " I missed that somehow! Thanks for pointing it out. I have now got a working patch which uses stat() instead of d_type. I will send it to the author of gitup and see what he says. Regards, Nick. -- From owner-freebsd-fs@freebsd.org Sun May 2 09:57:52 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2055B5FF01C for ; Sun, 2 May 2021 09:57:52 +0000 (UTC) (envelope-from njm@njm.me.uk) Received: from smtp001-out.apm-internet.net (smtp001-out.apm-internet.net [85.119.248.222]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FY1kR0Hkdz4VyN for ; Sun, 2 May 2021 09:57:50 +0000 (UTC) (envelope-from njm@njm.me.uk) Received: (qmail 95190 invoked from network); 2 May 2021 09:57:49 -0000 X-APM-Out-ID: 16199494699518 X-APM-Authkey: 18389/1(18389/1) 4 Received: from unknown (HELO meld.njm.me.uk) (86.179.69.31) by smtp001.apm-internet.net with SMTP; 2 May 2021 09:57:49 -0000 Received: from triton.njm.me.uk (triton.njm.me.uk [192.168.144.133]) by meld.njm.me.uk (8.16.1/8.16.1) with ESMTPS id 1429vmMi095854 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Sun, 2 May 2021 10:57:48 +0100 (BST) (envelope-from njm@njm.me.uk) Received: from localhost (localhost [127.0.0.1]) by triton.njm.me.uk (8.16.1/8.16.1) with ESMTP id 1429vlQZ088724; Sun, 2 May 2021 10:57:48 +0100 (BST) (envelope-from njm@njm.me.uk) Date: Sun, 02 May 2021 10:57:47 +0100 From: "N.J. Mann" To: Rick Macklem cc: freebsd-fs@freebsd.org Subject: Re: readdir() -> d_type always zero on NFS v3 mounted filesystems Message-ID: <362D4A23EABEC786267883FF@triton.njm.me.uk> In-Reply-To: References: <2E84A420CCC10A73504624DE@triton.njm.me.uk> X-Mailer: Mulberry/4.0.8 (Linux/x86) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Rspamd-Queue-Id: 4FY1kR0Hkdz4VyN X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of njm@njm.me.uk has no SPF policy when checking 85.119.248.222) smtp.mailfrom=njm@njm.me.uk X-Spamd-Result: default: False [-2.20 / 15.00]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[85.119.248.222:from]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[njm.me.uk]; AUTH_NA(1.00)[]; SPAMHAUS_ZRD(0.00)[85.119.248.222:from:127.0.2.255]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCPT_COUNT_TWO(0.00)[2]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:35259, ipnet:85.119.248.0/21, country:GB]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[freebsd-fs]; RCVD_IN_DNSWL_LOW(-0.10)[85.119.248.222:from] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 02 May 2021 09:57:52 -0000 Hi Rick, On Thursday, April 29, 2021 14:39:10 +0000 Rick Macklem wrote: > N.J. Mann wrote: >> I recently changed over from using svn to gitup to update /usr/ports >> on my local system and have been experiencing problems since. At first >> either a kernel issue or a configuration issue. I originally posted >> about the problem to the freebsd-ports mailing list: >> https://lists.freebsd.org/pipermail/freebsd-ports/2021-April/120929.html >> >> Since then I have dug deeper and come to the conclusion that it is not a >> problem with gitup. >> >> The issue I am seeing is that gitup is unable to delete files and >> directories, even complete ports, which have been removed from the >> repository. gitup basically does the following: >> >> prune_tree(base_path) >> { >> if ((directory = opendir(base_path)) != NULL) { >> while ((entry = readdir(directory)) != NULL) { >> snprintf(full_path, sizeof(full_path), "%s/%s", base_path, entry->d_name); >> if (entry->d_type == DT_DIR) { >> prune_tree(full_path); >> } else { >> if ((remove(full_path) != 0) && (errno != ENOENT)) >> err(EXIT_FAILURE, "prune_tree: cannot remove %s", full_path); >> } >> } >> closedir(directory); >> if (rmdir(base_path) != 0) >> err(EXIT_FAILURE, "prune_tree: cannot remove %s", base_path); >> } >> } > > The code should check for d_type == DT_UNKNOWN and then do > stat() to find out the type, as Ronald noted. > --> The d_type is normally filled in if you use the "rdirplus" > NFS mount option, which might work around the issue. I tried adding "rdirplus" and indeed that fixes the issue. I was unaware of "rdirplus" since somehow I neglected to read the mount_nfs man page. :-( I always say you never stop learning. :-) I have made and tested a new patch for gitup which replaces the use of d_type with a call to stat(). It works fine in my setup without "rdirplus" set and so I think it is the best way forward. I will pass it on to the author of gitup and see what he says. Thanks for the help. Regards, Nick. -- From owner-freebsd-fs@freebsd.org Sun May 2 21:00:40 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3E5305F9EED for ; Sun, 2 May 2021 21:00:40 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4FYJRD0StVz3Kxl for ; Sun, 2 May 2021 21:00:40 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: by mailman.nyi.freebsd.org (Postfix) id 0D86E5F9DFB; Sun, 2 May 2021 21:00:40 +0000 (UTC) Delivered-To: fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 085B05F9DFA for ; Sun, 2 May 2021 21:00:40 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FYJRC5kPJz3L0v for ; Sun, 2 May 2021 21:00:39 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id AE74711E29 for ; Sun, 2 May 2021 21:00:39 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 142L0d7i085249 for ; Sun, 2 May 2021 21:00:39 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 142L0daf085248 for fs@FreeBSD.org; Sun, 2 May 2021 21:00:39 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202105022100.142L0daf085248@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 2 May 2021 21:00:39 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 02 May 2021 21:00:40 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- New | 203492 | mount_unionfs -o below causes panic Open | 144447 | [zfs] sharenfs fsunshare() & fsshare_main() non f Open | 211491 | System hangs after "Uptime" on reboot with ZFS Open | 221909 | [ZFS] Add a sysctl to toggle send_corrupt_data Open | 237067 | ZFS: Crash in vdev_dtl_reassess when using GELI w Open | 240831 | zfs: Panic during snapshot on 12.1-STABLE r352648 Open | 243973 | [zfs] rollback segmentation fault Open | 244656 | zfs: resilver doesn't provide enough information Open | 244692 | gjournal: Does not support TRIM Open | 244899 | [PATCH] zfs: xattr on a symlink target > 136 caus Open | 251035 | [zfs] Allow 64 bit ZFS to support 32 bit ioctls ( 11 problems total for which you should take action. From owner-freebsd-fs@freebsd.org Mon May 3 02:20:28 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4BD17624586 for ; Mon, 3 May 2021 02:20:28 +0000 (UTC) (envelope-from joe@via.net) Received: from smtp4.via.net (smtp4.via.net [209.81.0.254]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "via.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FYRXC3vDpz3qX6 for ; Mon, 3 May 2021 02:20:27 +0000 (UTC) (envelope-from joe@via.net) Received: from mail.via.net (mail.via.net [157.22.3.34]) by smtp4.via.net (8.15.2/8.14.1-VIANET) with ESMTPS id 1432KP2J008956 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Sun, 2 May 2021 19:20:25 -0700 (PDT) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.102.2 at smtp4.via.net Received: from [209.81.2.65] ([209.81.2.65]) by mail.via.net (8.15.2/8.14.1-VIANET) with ESMTP id 1432KP3q017888 for ; Sun, 2 May 2021 19:20:25 -0700 (PDT) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.102.2 at mail.via.net From: joe mcguckin Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.4\)) Subject: Faster uploads to a ZFS network filler? Message-Id: <52E8403F-2233-4C6A-8E6E-F99CBA04840E@via.net> Date: Sun, 2 May 2021 19:20:14 -0700 To: freebsd-fs@freebsd.org X-Mailer: Apple Mail (2.3608.120.23.2.4) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (smtp4.via.net [209.81.0.254]); Sun, 02 May 2021 19:20:25 -0700 (PDT) X-Rspamd-Queue-Id: 4FYRXC3vDpz3qX6 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of joe@via.net designates 209.81.0.254 as permitted sender) smtp.mailfrom=joe@via.net X-Spamd-Result: default: False [-1.79 / 15.00]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+MX]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[209.81.0.254:from]; MIME_TRACE(0.00)[0:+,1:+,2:~]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:7091, ipnet:209.81.0.0/18, country:US]; SUBJECT_ENDS_QUESTION(1.00)[]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[joe]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[via.net]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[209.81.0.254:from:127.0.2.255]; NEURAL_HAM_MEDIUM(-0.99)[-0.988]; RCVD_IN_DNSWL_NONE(0.00)[209.81.0.254:from]; MAILMAN_DEST(0.00)[freebsd-fs] Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 03 May 2021 02:20:28 -0000 I have a FreeBSD 12.2 system running with SAMBA. Up loading large files = (e.g. video files) I notice the first 700-800 Mb goes pretty quickly, = but around 800Mb, it pauses then proceeds at about half or 1/3=20 normal speed. Is there a tunable parameter I can change to improve this behavoir? The = server has plenty of memory, can I tell ZFS, SAMBA or the kernel to use = more memory for caching? Thanks! Joe Joe McGuckin ViaNet Communications joe@via.net 650-207-0372 cell 650-213-1302 office 650-969-2124 fax From owner-freebsd-fs@freebsd.org Mon May 3 04:15:19 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 605E76263C5 for ; Mon, 3 May 2021 04:15:19 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-ot1-f52.google.com (mail-ot1-f52.google.com [209.85.210.52]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FYV4k22wlz3w9M for ; Mon, 3 May 2021 04:15:17 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-ot1-f52.google.com with SMTP id 65-20020a9d03470000b02902808b4aec6dso3998299otv.6 for ; Sun, 02 May 2021 21:15:17 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=XGYmH3g1K7mIHpN4WRIssIWN1SdQQMcR1cAG5DJTpfE=; b=rcTMs3vkRDjcrPtSivKmu+nmyF1gZDk/q306bVyGCgDbYg0KVjSgjLrby02O9aLc7Y gPDk3xlvTquOProd6/clFfohka15lfmb2zuOYmFJC+AoW/4TndM35gCGIQVgroLDYoXx fYEUYFgbYhsx8aDpr7eru6jD9IyCi1TdBbKArchfv+VaSWP3kbJCERuO5tzPff8nkRHW yeeRX1teM/opWBGgNPcYz0lI3K85ixWcpDX3bBQDMBVl7Hv7CjbIVZP7EU7XV8PiX7h6 TokjbutxveNjWL6TOehdsJW6yqEZPywxQ/AzmcExa/fgL66DdSCAdrdzPWOb2bOuxs3+ VMxg== X-Gm-Message-State: AOAM5337cEmZfRRpKI9G6gVOGk7+g01awecOEcUWqEdMXMNPbwZCVGQo PidqLozvjI8vkFr9SslrvjZUs0KXOyKW+Iz9Z7k= X-Google-Smtp-Source: ABdhPJwjcXTiN6or7eM+sXw/7j7bBu1fEYT64krz133gabGUtM9yraNXHGOscnFDskaimVN1TBOLMyMkGZZ0Y3jmR0U= X-Received: by 2002:a05:6830:410e:: with SMTP id w14mr11929148ott.251.1620015316380; Sun, 02 May 2021 21:15:16 -0700 (PDT) MIME-Version: 1.0 References: <52E8403F-2233-4C6A-8E6E-F99CBA04840E@via.net> In-Reply-To: <52E8403F-2233-4C6A-8E6E-F99CBA04840E@via.net> From: Alan Somers Date: Sun, 2 May 2021 22:15:05 -0600 Message-ID: Subject: Re: Faster uploads to a ZFS network filler? To: joe mcguckin Cc: freebsd-fs X-Rspamd-Queue-Id: 4FYV4k22wlz3w9M X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.210.52 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-2.00 / 15.00]; RWL_MAILSPIKE_GOOD(0.00)[209.85.210.52:from]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCPT_COUNT_TWO(0.00)[2]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; SUBJECT_ENDS_QUESTION(1.00)[]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[209.85.210.52:from]; FREEFALL_USER(0.00)[asomers]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; SPAMHAUS_ZRD(0.00)[209.85.210.52:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[209.85.210.52:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-fs] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 03 May 2021 04:15:19 -0000 On Sun, May 2, 2021 at 8:20 PM joe mcguckin wrote: > I have a FreeBSD 12.2 system running with SAMBA. Up loading large files > (e.g. video files) I notice the first 700-800 Mb goes pretty quickly, but > around 800Mb, it pauses then proceeds at about half or 1/3 > normal speed. > > Is there a tunable parameter I can change to improve this behavoir? The > server has plenty of memory, can I tell ZFS, SAMBA or the kernel to use > more memory for caching? > > Thanks! > > Joe > By default ZFS is already very greedy with RAM. In fact, that's probably why you notice the speed cliff. That first 700-800 is probably going into RAM, and then it slows down when the server becomes limited by disk throughput. What does gstat show you. Are the disks saturated? -Alan From owner-freebsd-fs@freebsd.org Wed May 5 11:11:39 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A402963A5C3 for ; Wed, 5 May 2021 11:11:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4FZvDC43Hnz3kHT for ; Wed, 5 May 2021 11:11:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 8B08663A691; Wed, 5 May 2021 11:11:39 +0000 (UTC) Delivered-To: fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8AD3963A4CD for ; Wed, 5 May 2021 11:11:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FZvDC3Shcz3kSp for ; Wed, 5 May 2021 11:11:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 692B023F87 for ; Wed, 5 May 2021 11:11:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 145BBd0g030814 for ; Wed, 5 May 2021 11:11:39 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 145BBd6K030813 for fs@FreeBSD.org; Wed, 5 May 2021 11:11:39 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 255473] Infinite writes on UFS with SU+J filesystem Date: Wed, 05 May 2021 11:11:39 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 May 2021 11:11:39 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D255473 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Thu May 6 10:52:01 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DE6125FB1DA for ; Thu, 6 May 2021 10:52:01 +0000 (UTC) (envelope-from ben.rubson@gmx.com) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4FbVl54nj2z4Y8R for ; Thu, 6 May 2021 10:52:01 +0000 (UTC) (envelope-from ben.rubson@gmx.com) Received: by mailman.nyi.freebsd.org (Postfix) id A46D65FB1D7; Thu, 6 May 2021 10:52:01 +0000 (UTC) Delivered-To: fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A434A5FB3EB for ; Thu, 6 May 2021 10:52:01 +0000 (UTC) (envelope-from ben.rubson@gmx.com) Received: from mout.gmx.net (mout.gmx.net [212.227.15.19]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.gmx.net", Issuer "TeleSec ServerPass Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FbVl42rdNz4Y1X for ; Thu, 6 May 2021 10:51:56 +0000 (UTC) (envelope-from ben.rubson@gmx.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1620298315; bh=DDng/DwbSEOhrDmWASJMMbO4wlkyRc2q2EOl+ktvQaQ=; h=X-UI-Sender-Class:From:Subject:Date:To; b=I3/vEhCrrPfI8TkcOHTpB3jqju9FA+rCDsvTEa5X79EbUKOMwusPs0unQiMXH09PA zgN/7rFVqdVdnU5HbSZYPL5jE7K6z4JoKA2CesxbVTWE9EB7DsWT8Gjh1Sr9lrNqka TI2h3IZLOmbc3THb/j2tGc97bF5xVst/AmnGtvTU= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from smtpclient.apple ([185.101.28.209]) by mail.gmx.net (mrgmx004 [212.227.17.184]) with ESMTPSA (Nemesis) id 1MIdiZ-1ljt540LBt-00EcNM for ; Thu, 06 May 2021 12:51:55 +0200 From: Ben RUBSON Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.80.0.2.43\)) Subject: Dual-port SAS HDD ? Message-Id: <578487FF-1D89-4A9E-AD97-6B5DCD9F785A@gmx.com> Date: Thu, 6 May 2021 12:51:54 +0200 To: "fs@freebsd.org" X-Mailer: Apple Mail (2.3654.80.0.2.43) X-Provags-ID: V03:K1:Kyr0ItV8NBQny7NcsLOp4g0icSvzSxnK40JzistILduQ/KZz1/e 5cobmz8vwueY+5QemEwEHaPJW5cWwQtfzNUr/CsIfC1Zfl05SdN8VnE8udCEWwyJ2fwVNbS rK1ulA8TnLTsYRJSIJxYA5IBEYCeQZynafq/zer9rg+dfLkXWQ3fbhe09ItmkuafaD09N6J Yqh2uIizVUzSP33hquwbA== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:2dmN/8EXo0U=:X3XMs5y6WEwWm/RkWAuPPZ CdvlOJ9hS5kGlpj428OzLeXF8Q/8hR+IssETEajozKRdo7MAf5MfSuZh+KhJpbhmZvv1DVz1o 2mV2RaswspLsbnjsLxAqZMFrPuqcXZoV86aOEdN0WohF7j9BFGAMOLmXME4WN16uBiJz85ULI Txk3fdkomCLNxvQqFmI71HXJE+YszrNsdxWm1SaM8HmRS3QgWw8gClHKUo2HNzVDjZG6dt419 sRYuf0tzn7vQHJGlQGebDYpqNazAsMA4EF8I5up3RYRAqvoJii/ND0kCGdZAjbKyAMGVg1fCd zIXAwYXaS4WjWvCdlre1TekniNKbdjCbK+2Uo6nQvQ9kyzuOf9InBToXnj+iQfNsKKp7CFUXf J2NGkGXaxVAilCRCouF8sMGd0DDNDDmiEil58378M9FDfL/PWI067sN5WYmD3tQoAeIJW6G2O a7ETQ+EFqmu69tml9/nNtmDylyduvyhBq3jNsaRsMWeXP/qFVfy3zRAnuhiUk5BlwTshv+baX Z1plhov+hilWpgeHK+dF5OsECxfmxyJyFDOfHe3ccBI6H/fHTaRaHCz6A2Ehq4u6GW00MvEyf 6v9tefkJx0pItV/JqSd4HLPy1axnf+/9/TvYEpU/b+7lJIEDP7itpMYUg4gEMNJDr5sE6jzA8 Kk/3nCA6YxXMH7L/WjHonQaR04+DxL9v2bQuy+FGySWia6YrqE2oPvaTIe8wpd+o272J2R8qO AwTOimNZ+cUZ3esksyvI0nxr2teICsRz8CWCCVG2eSXULoWOvJwUuhs1SLgvsww3IE4dQ20tl 8ycOWMchHnyIxyXdSNGG5VMGIFXpc10QGIAJ3QnDf6xO2uz08ULzyNqnDmx2b9e0i4ttc2RjI ItNOJRfzgzfLNUyT0oXJzwD+g4Qw6kOVEH0RrBFUXeYiKxwwSIaYH+O3m6YuEDo67YdPGO1iJ Q7nQuI4H51XlfasCrkcsgg3xwVVnTw6i6hJ5f+3w4bS20I5ke3D18zZeE8j11IzQjhtIvv5gQ Gcip3PnjT4tpuOSHux+ExqsC86GMSJrip7H3nxCm032GurHeMKNfyupBs7JCNi7RqH/iUtl9f qhITEcjzqRLx/KIFmw1V3s9KYHFYkXReBigS6YpSVX3T+LuaVZqPOPSTm/Fdyv+zlBTrnXbMJ mn1pFPt5eRSgbYBED5kF8qPPHOueHEPM1FLwt0P9JF41eV9jJyIG+d+KPRsqAazYbjZO8= X-Rspamd-Queue-Id: 4FbVl42rdNz4Y1X X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmx.net header.s=badeba3b8450 header.b=I3/vEhCr; dmarc=pass (policy=none) header.from=gmx.com; spf=pass (mx1.freebsd.org: domain of ben.rubson@gmx.com designates 212.227.15.19 as permitted sender) smtp.mailfrom=ben.rubson@gmx.com X-Spamd-Result: default: False [-2.60 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:212.227.15.0/24]; FREEMAIL_FROM(0.00)[gmx.com]; MV_CASE(0.50)[]; DKIM_TRACE(0.00)[gmx.net:+]; DMARC_POLICY_ALLOW(-0.50)[gmx.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_IN_DNSWL_LOW(-0.10)[212.227.15.19:from]; SUBJECT_ENDS_QUESTION(1.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmx.com]; MID_RHS_MATCH_FROM(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[212.227.15.19:from]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmx.net:s=badeba3b8450]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[fs@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[212.227.15.19:from:127.0.2.255]; TO_DN_EQ_ADDR_ALL(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[212.227.15.19:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[fs] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 May 2021 10:52:01 -0000 Hi, I'm building a new ZFS pool from scratch, choosing my own hardware = etc... For sure I'll go for the standard SAS2008 / SAS3008 controller. However, I'm wondering whether or not I should absolutely go for = dual-port SAS HDD (with dual backplane, controller...). I have some difficulties to find enterprise grade dual port SAS HDD. HGST used to provide Ultrastar SAS HDD which were dual-port. However, strangely, Western Digital does not advertise their Ultrastar = DC SAS HDD as bringing dual-port, so I guess they're not. Any thoughts / advices regarding this topic ? Many thanks for your help, Kind regards, Ben From owner-freebsd-fs@freebsd.org Thu May 6 13:24:14 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8492A62183F for ; Thu, 6 May 2021 13:24:14 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4FbZ6k2WNfz4gZK for ; Thu, 6 May 2021 13:24:14 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mailman.nyi.freebsd.org (Postfix) id 5321B621C57; Thu, 6 May 2021 13:24:14 +0000 (UTC) Delivered-To: fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 52BE5621AEC for ; Thu, 6 May 2021 13:24:14 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-oo1-f45.google.com (mail-oo1-f45.google.com [209.85.161.45]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FbZ6k1NpPz4gch for ; Thu, 6 May 2021 13:24:13 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-oo1-f45.google.com with SMTP id i20-20020a4a8d940000b02901bc71746525so1247499ook.2 for ; Thu, 06 May 2021 06:24:13 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=g111RIj+kNSzn73Sw8H/HS8iq+k8XIuWGx9vuT5/+/c=; b=Xfs0U93P9M2FNuybZ/QZs6xuH0lM1OpBzP4S9q02/7/4jbJZlRldCWh8ut+DlTeldJ bB6NoEnw92jiodZ72iz8iD698XYx+Xu/E93v5cwJOFL/EKIjECp+tDtTQtvwVpVEMTYH PXB5Twk8IRo6iaA3/S+7UTPhR1cWIQ6goE6yp8BxgCbyGu1QhYl1UfzSd6kMxLREUx+e A9s1B8p2JtBjJKzYzrj0nCgAoIYNFiYdUj6SF5R6o3mHCNdR243l0mzPB1N2n5b1uoGp YPuxdkCnJR5Bp2NPUvAKerWUjrfBCBAGqGsID2crTfOYOeWKZ/JHvK9ZrDplSZAP/YnF MoMA== X-Gm-Message-State: AOAM531qvI0qvScO9Eje8szZkSB64TBuBJSCwOCLx5LBE2FMWHJi1RiY XswXmFRFOC1EOo66tNS2LCzQe4Wkm+v6q/Yg8fM= X-Google-Smtp-Source: ABdhPJxwvvIH+uIHMGDUB6pFbnXqfPZmVL0/8vwUe1Epe3oHIG4Bd4v0mTh/ydxJa5Gsk0NXWEvQ0/nL8qGaWVnxzF8= X-Received: by 2002:a4a:7506:: with SMTP id j6mr3392726ooc.79.1620307451468; Thu, 06 May 2021 06:24:11 -0700 (PDT) MIME-Version: 1.0 References: <578487FF-1D89-4A9E-AD97-6B5DCD9F785A@gmx.com> In-Reply-To: <578487FF-1D89-4A9E-AD97-6B5DCD9F785A@gmx.com> From: Alan Somers Date: Thu, 6 May 2021 07:24:00 -0600 Message-ID: Subject: Re: Dual-port SAS HDD ? To: Ben RUBSON Cc: "fs@freebsd.org" X-Rspamd-Queue-Id: 4FbZ6k1NpPz4gch X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 May 2021 13:24:14 -0000 On Thu, May 6, 2021 at 4:52 AM Ben RUBSON wrote: > Hi, > > I'm building a new ZFS pool from scratch, choosing my own hardware etc... > For sure I'll go for the standard SAS2008 / SAS3008 controller. > > However, I'm wondering whether or not I should absolutely go for dual-port > SAS HDD (with dual backplane, controller...). > I have some difficulties to find enterprise grade dual port SAS HDD. > HGST used to provide Ultrastar SAS HDD which were dual-port. > However, strangely, Western Digital does not advertise their Ultrastar DC > SAS HDD as bringing dual-port, so I guess they're not. > > Any thoughts / advices regarding this topic ? > > Many thanks for your help, > > Kind regards, > > Ben > It's just a matter of high availability. Can you tolerate an outage if a JBOD I/O controller fails? If so, then you don't need dual-port. But server crashes are more common than JBOD I/O controller failures. So you should worry more about that. From owner-freebsd-fs@freebsd.org Thu May 6 13:37:28 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id ED6256221D6 for ; Thu, 6 May 2021 13:37:28 +0000 (UTC) (envelope-from ben.rubson@gmx.com) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4FbZQ0594Nz4gwZ for ; Thu, 6 May 2021 13:37:28 +0000 (UTC) (envelope-from ben.rubson@gmx.com) Received: by mailman.nyi.freebsd.org (Postfix) id AF0306222B1; Thu, 6 May 2021 13:37:28 +0000 (UTC) Delivered-To: fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id AEC546221D5 for ; Thu, 6 May 2021 13:37:28 +0000 (UTC) (envelope-from ben.rubson@gmx.com) Received: from mout.gmx.net (mout.gmx.net [212.227.15.18]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.gmx.net", Issuer "TeleSec ServerPass Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FbZPz5XZQz4h7W for ; Thu, 6 May 2021 13:37:27 +0000 (UTC) (envelope-from ben.rubson@gmx.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1620308246; bh=M6ZWkZ0uHvOiLVWVcGv0rDrbeKH/gdBF1qJDFJ1O4lA=; h=X-UI-Sender-Class:From:Subject:Date:References:To:In-Reply-To; b=GnC4iskH/jM2SBAiX7xjkhlA7kXlNOdfYZiKMQM3MSHvpt487v9Tp7Cw+ElkZvJdM PnQ+YRRpeP47JbAOvuu1xJsrQCI2naFy12h86MnKQvkbNoxOTalYBmeVvsx7/1pdwL X7Q1K3OUEC44Bq1hGFIC011D9VtSe7j5rmtMJZrU= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from smtpclient.apple ([185.101.28.209]) by mail.gmx.net (mrgmx004 [212.227.17.184]) with ESMTPSA (Nemesis) id 1McpJg-1l4lTb43VK-00ZukF for ; Thu, 06 May 2021 15:37:26 +0200 From: Ben RUBSON Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.80.0.2.43\)) Subject: Re: Dual-port SAS HDD ? Date: Thu, 6 May 2021 15:37:25 +0200 References: <578487FF-1D89-4A9E-AD97-6B5DCD9F785A@gmx.com> To: "fs@freebsd.org" In-Reply-To: Message-Id: <62B46E11-A40C-4119-8525-20E3F3539D61@gmx.com> X-Mailer: Apple Mail (2.3654.80.0.2.43) X-Provags-ID: V03:K1:XdtoebEC1tEqhJ8lB6Ezlw/cNuwa9FariRXBVFSkRzmxQD4sUbf MZ7vbtx+2MCYRhQOrwglGIplWn+e5JmVlpjtts4ErmjuaFb77Z6WdreCAmaMgsJnJUemw6J 0DTkkETJ6+rFggT73KLyn6ff9MjfqDkDp3aiGXxcCJt/LiTG1PG2V7Fsl5aqmNOoNjUPbBd 2n03TMzJ+7BK9T05y7ptQ== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:7whzbWPgKtA=:TdUD2c0i1rb8A6VDEGh+BF tXZtUsYbZYMCsjaoLAlUWw29znTgNLRP1mvWnVXzhB7DEeVEjVm9QbGpC8ELHo3fpaqjMl2ft d765Gvp2XP86d5kzERmxNTsHkAcNfXIVxqkSVa9Uw4WC8E/+dAstOCZq/2y5tQv9khHklrX6T xjdZIbPvrMVGRDLa/+T5+YnJwYKqw6cMkTT1M8s0L0TPWVn7PRyk2G6cA7k192H1PHVhKjNgP +h/Ufl/URGr4949OpiJgN+IrNiOFpWUdUPV+GAUH4wXEzyccrliFtmwYhDVrHrWUwQb/CT9Hw SGqP9q3IjQ14PDOy88V04eHKoHfAqGm/1+mpW5dYGcbEv3KHELyqU/Nucj5h7z6gqhGXV3jC1 91pjQVmdxUTQOLZuqsdh825F06cFXiTumA3+ZTnOxAo/dci7w3gSYpUt5I/TlLO33p6aKbavN YyKZeuOJOpBOaYboDaEjJZE3AW2DkW7hIjyG85G3F3raYO51n1sPv5AfhmW6P4Cv9Ssr8ytTD uLNxvkp/gozWpEtqd7XLH6UcZYCGT5kn/wNtbiROe4Go/n0/yrYETAN1X7IlxobMdhgk04vr3 OJ9DhhN+P57wqCG5BJtyPlMm0l8MRzRpJriODdFBYaWYSah0h8vhyO8dNfj2wyuKH7HP/aZqS K1YJBLenANxbAk7hHt14CtJrbpT5sGgypHoy0ti1e995vpoGKzl5RiqzuYVqfuq/uPCQ/B2Rt UbG8AeVoQQ7LyP6AqwQ7y+l5+5+gcPdHAHvcKOK4ECqnanJvvEjQlA3m40/XmspO53Xek8otP 987mXTSLN2mMv4AT/DVsolfOezDp+M1ezat7pMguSz7swFZsBvc7ko4whMD3qVEPyGAwXQs9C XKjY5oy5v1FoNlJuBqGg5NQ+2ELa6xtJ0hbhjBon0qcIub/NOScVvyPTOxGDsME2EiNI0kpYR ipa2SnYqfQArYg3IxoWaZO/nKUU4PlV3LyIhGgEfWFvKw2OBkHmwHspk42J8qp3UA3w+IzrSm fsAV9eFKseK04VZl/LjC/kUx1ICOQ5KtUyV86okkOjL95pJvsh+erhIM34O7rYsLYVJevA5tp FhBkZulgKF2bGLR8LAWo4wG4bj5618JFniio+YqckmO8MmzSZjoZX5mYf+L70bzJy9/D216L/ XT8wViaOnycrtxY4xw5gm+3fKUncU7Vu1uHEGQF3cKZt5FTlikVP8uO0hSyH+7kld9FrU= X-Rspamd-Queue-Id: 4FbZPz5XZQz4h7W X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmx.net header.s=badeba3b8450 header.b=GnC4iskH; dmarc=pass (policy=none) header.from=gmx.com; spf=pass (mx1.freebsd.org: domain of ben.rubson@gmx.com designates 212.227.15.18 as permitted sender) smtp.mailfrom=ben.rubson@gmx.com X-Spamd-Result: default: False [-2.60 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:212.227.15.0/24]; FREEMAIL_FROM(0.00)[gmx.com]; MV_CASE(0.50)[]; DKIM_TRACE(0.00)[gmx.net:+]; DMARC_POLICY_ALLOW(-0.50)[gmx.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_IN_DNSWL_LOW(-0.10)[212.227.15.18:from]; SUBJECT_ENDS_QUESTION(1.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmx.com]; MID_RHS_MATCH_FROM(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[212.227.15.18:from]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmx.net:s=badeba3b8450]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[fs@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[212.227.15.18:from:127.0.2.255]; TO_DN_EQ_ADDR_ALL(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[212.227.15.18:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[fs] Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 May 2021 13:37:29 -0000 > On 6 May 2021, at 15:24, Alan Somers wrote: >=20 > On Thu, May 6, 2021 at 4:52 AM Ben RUBSON > wrote: > Hi, >=20 > I'm building a new ZFS pool from scratch, choosing my own hardware = etc... > For sure I'll go for the standard SAS2008 / SAS3008 controller. >=20 > However, I'm wondering whether or not I should absolutely go for = dual-port SAS HDD (with dual backplane, controller...). > I have some difficulties to find enterprise grade dual port SAS HDD. > HGST used to provide Ultrastar SAS HDD which were dual-port. > However, strangely, Western Digital does not advertise their Ultrastar = DC SAS HDD as bringing dual-port, so I guess they're not. >=20 > Any thoughts / advices regarding this topic ? >=20 > Many thanks for your help, >=20 > Kind regards, >=20 > Ben >=20 > It's just a matter of high availability. Can you tolerate an outage = if a JBOD I/O controller fails? If so, then you don't need dual-port. = But server crashes are more common than JBOD I/O controller failures. = So you should worry more about that. Thank you Alan. Of course you're right, JBOD IO controller is not the first outage = cause, and disks themselves are more prone to fail... I even wonder whether or not dual path is actively used for HDDs, as = dual-port ones are rather hard to find... Not sure then it's really worth it... Of course feel free if I'm wrong / I missed something / one actively = uses it and has some experience / references to share ! Thank you again, Ben From owner-freebsd-fs@freebsd.org Thu May 6 13:52:02 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A35EC6224E5 for ; Thu, 6 May 2021 13:52:02 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4FbZkp28gFz4htF for ; Thu, 6 May 2021 13:52:02 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mailman.nyi.freebsd.org (Postfix) id 49F0A622671; Thu, 6 May 2021 13:52:02 +0000 (UTC) Delivered-To: fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 49B2B622670 for ; Thu, 6 May 2021 13:52:02 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-ot1-f53.google.com (mail-ot1-f53.google.com [209.85.210.53]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FbZkp1bKSz4j58 for ; Thu, 6 May 2021 13:52:01 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-ot1-f53.google.com with SMTP id i23-20020a9d68d70000b02902dc19ed4c15so913951oto.0 for ; Thu, 06 May 2021 06:52:01 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=5bDjjaLejB/FFxFO86S0e21vO14fqvuR//weUKIG7Ro=; b=oAB5mwFr8KSnsNTZiejbdncXCFqrOvuXndP72qyfsKZPw7sWTDM/RIciNhXdF3uZB7 qa0ONdsemHS+tygiwIX40LzJFH1gHUo3BDM3DRoIfO2NlzhuNnXurDvxml3d/c+sdOgR bpyzEks8kmkJDg72dXWSLjL1lihhIqqpi6kYINkty6W9ipAuFv94srLtX2sL4dWjhWy4 YaUpwxH1XQP2TDPzbH7zvFDgaIRT7rbIP/8r3FfXeUK7cIoA4jAwplDj8LvFMOl+Cy87 sbMbobIIrKHrnNmI9dH9Gk4fX4z6ZS11ROGNVhdUoV01EbAivyYO/z0C9/SvQQFD1tFS 0Lhw== X-Gm-Message-State: AOAM5317BXJZ9cye7STDHuOlm6ihcrpyJGyxT5z+z6s2f+CEiHl56nM0 6J/1sTDWG1HYw8ui+CKmdocS3G7bzlX2PslkrGE= X-Google-Smtp-Source: ABdhPJxSn3aQ4j7MXJ21Mq379zT4bOdvPDwbZFUbpEAkMFlqJs47tDNVlIUewJA8X7tTJ+L5EJNNFbEr1BI44esl7TU= X-Received: by 2002:a9d:7d90:: with SMTP id j16mr3751641otn.18.1620309120905; Thu, 06 May 2021 06:52:00 -0700 (PDT) MIME-Version: 1.0 References: <578487FF-1D89-4A9E-AD97-6B5DCD9F785A@gmx.com> <62B46E11-A40C-4119-8525-20E3F3539D61@gmx.com> In-Reply-To: <62B46E11-A40C-4119-8525-20E3F3539D61@gmx.com> From: Alan Somers Date: Thu, 6 May 2021 07:51:49 -0600 Message-ID: Subject: Re: Dual-port SAS HDD ? To: Ben RUBSON Cc: "fs@freebsd.org" X-Rspamd-Queue-Id: 4FbZkp1bKSz4j58 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 May 2021 13:52:02 -0000 On Thu, May 6, 2021 at 7:37 AM Ben RUBSON wrote: > > On 6 May 2021, at 15:24, Alan Somers wrote: > > > > On Thu, May 6, 2021 at 4:52 AM Ben RUBSON ben.rubson@gmx.com>> wrote: > > Hi, > > > > I'm building a new ZFS pool from scratch, choosing my own hardware etc... > > For sure I'll go for the standard SAS2008 / SAS3008 controller. > > > > However, I'm wondering whether or not I should absolutely go for > dual-port SAS HDD (with dual backplane, controller...). > > I have some difficulties to find enterprise grade dual port SAS HDD. > > HGST used to provide Ultrastar SAS HDD which were dual-port. > > However, strangely, Western Digital does not advertise their Ultrastar > DC SAS HDD as bringing dual-port, so I guess they're not. > > > > Any thoughts / advices regarding this topic ? > > > > Many thanks for your help, > > > > Kind regards, > > > > Ben > > > > It's just a matter of high availability. Can you tolerate an outage if > a JBOD I/O controller fails? If so, then you don't need dual-port. But > server crashes are more common than JBOD I/O controller failures. So you > should worry more about that. > > Thank you Alan. > Of course you're right, JBOD IO controller is not the first outage cause, > and disks themselves are more prone to fail... > > I even wonder whether or not dual path is actively used for HDDs, as > dual-port ones are rather hard to find... > Not sure then it's really worth it... > > Of course feel free if I'm wrong / I missed something / one actively uses > it and has some experience / references to share ! > > Thank you again, > > Ben > Sure, dual paths are actively used. They work well with gmultipath, which is how I use them. And AFAIK all SAS drives are dual-ported. Western Digital describes their drives as "dual port" on this site: https://www.westerndigital.com/products/data-center-platforms/ultrastar-sas-series-ssd From owner-freebsd-fs@freebsd.org Thu May 6 15:14:53 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9A46A624A21 for ; Thu, 6 May 2021 15:14:53 +0000 (UTC) (envelope-from ben.rubson@gmx.com) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4FbcZP2hB8z4mJ3 for ; Thu, 6 May 2021 15:14:53 +0000 (UTC) (envelope-from ben.rubson@gmx.com) Received: by mailman.nyi.freebsd.org (Postfix) id 5C14A62497A; Thu, 6 May 2021 15:14:53 +0000 (UTC) Delivered-To: fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5BA006249E9 for ; Thu, 6 May 2021 15:14:53 +0000 (UTC) (envelope-from ben.rubson@gmx.com) Received: from mout.gmx.net (mout.gmx.net [212.227.15.15]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.gmx.net", Issuer "TeleSec ServerPass Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FbcZN1j7Zz4mSp for ; Thu, 6 May 2021 15:14:51 +0000 (UTC) (envelope-from ben.rubson@gmx.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1620314090; bh=2y8S7mQNQrNTsffruCQLen5+EngTXPTAbaXJsGDUko0=; h=X-UI-Sender-Class:From:Subject:Date:References:To:In-Reply-To; b=H/LnwHBEg+R6glBL2jwUyf2yW/jbu+kKObWQXyMlTUPQYiraaEQcoEydC1oeSc5/O fkgOV9UnAeeJlIR8H9a2gDtVkdsqVbxLjlr5yKVpraWYWNqHGakA/nHl9puPj7wlip Nm72WQtmrQCwbEmbd1B8KnOKhENZ+SSoUia1w2ew= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from smtpclient.apple ([185.101.28.209]) by mail.gmx.net (mrgmx004 [212.227.17.184]) with ESMTPSA (Nemesis) id 1MWzk3-1m3Gy30UbB-00XNot for ; Thu, 06 May 2021 17:14:50 +0200 From: Ben RUBSON Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.80.0.2.43\)) Subject: Re: Dual-port SAS HDD ? Date: Thu, 6 May 2021 17:14:49 +0200 References: <578487FF-1D89-4A9E-AD97-6B5DCD9F785A@gmx.com> <62B46E11-A40C-4119-8525-20E3F3539D61@gmx.com> To: "fs@freebsd.org" In-Reply-To: Message-Id: X-Mailer: Apple Mail (2.3654.80.0.2.43) X-Provags-ID: V03:K1:Jsr2Cd1RBD5KW58rbjx5KD+/KL3pSMfPwlvQx7jHAgcrbcNdPuZ Um4I/8p/NUPJNlewNXjzBt5b8BTaJAZRgGVtGNu0/NB66zQsLE8uvnQMBGNR/lJkqXRnxWO SyhHYI94+hgfo6k380oUEGo/yIXkH4pibCVo/HnCieW3jEXK0jhm4Se/o+Xp6jWD2KNLLVI I2BYfJX9DZ/nxoBqd6fig== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:tyRRUgTPCr8=:zcC3lq6ZLGmK7TQd578snz 6N8BB/S/psOv1sQDl17bPLCgJftDUHcSUN7tbObgRanFBc3X/zphNaAiADDBL7LEWsSlIU0a0 b5v+k32o1k53aVelf1rewU/UVO8+1G3xijlo2ivxrPyaj5BV6f/PRnRGuxC4ynllI4cBaWqk6 Yd5ayZ1SZsHLKyDstVq8mhbFaqZXtHzdRgBn9OWE7Ta9ZWqKHO24E0C8FIxW9BoBtjPuyzonp n61Q4HB+9b7AchOVaFkGoQtx/2Z8Qk+Q8EIebA8ExeylAkns1xvbnUkxQdmi+PIzZglq3Txrw PPCVozCfjYgBz+LAi5X2jH0FcSBfmmhXNXwiGmWeBZmo7iST0UgT/pqCH37VgaP+lwFK+H6+Z z1kk8Y01J6b4ooyUX8Z1GrDJuLDu4mP8YOEGDfIereCTiRyz7vOXFQNxcLzEGNBFLbfMaHXqW Lq2jd94QiDpYnoMgkUkzQ9At2rk22ftSMqatXgCfajwR7nZpehO+4QcmGMHlWuW4NH4AO0ZvD np/l9Ib1NlQYWYzK59Kg5LMvB61E0PEDjUvDFpxztcc3nZhVxp9kJD3N0EwFzbdeYaSuQQaYT 1lOwNxMgnpTWqmuuQjoECncnt2iCmcLfePR9kVR2gyEWYIixPdgfxllEVC2eA20aNi0VitX2A lWXYMmzGGWynZH+7JEJrWN+WDum5w3q+VrwD07ce0mCUDPfSQQ2z/jkOM3xLBUK+xxfSAgQOf R8HecdESdQ3xZa8i02u4e9CACINaz9p8O7mN4hOQmOUDDxKbXKUO0fBgLLu6xE6F/6e1Yovtq hJBvYE/72ABPlxWT9ZIrQUvXd89WnLNz+plEegN8ILbqmyR36Ni0cLVOpgXMRhzf/E2O2aZcL Nufre0+Smqi9USrwCrL85lupPRKS3N64gpZ/EF7dSQ0QpsPJHbg3K3I78eZlMbjiyzEGBjbvL gr8GujjZUaOiVj+Ck4ScooUpTRbBWSJ1aAnzvUjM9ZquuyNk+SaqTD74PtUJGTXpm1czRLJzZ BhKnd9TMSR9PHTWpcLI5VxDoJgdvbJPACax4d+7vbavZ0nMnOvrm5/A1BClTiAAq21aLeqWL5 4JRYavboy8V4HOx/KlnADS42dBWKPoH7zP0rDxhhRxp453wqWRClHkezqH34UkCzHB/iNAXM5 O5F/4EzRIAKkeHsOS2AaiM5A23vxHZVd480jy9hxIimzonzYdS0hL1RFd/eF1x7dYe0zs= X-Rspamd-Queue-Id: 4FbcZN1j7Zz4mSp X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmx.net header.s=badeba3b8450 header.b=H/LnwHBE; dmarc=pass (policy=none) header.from=gmx.com; spf=pass (mx1.freebsd.org: domain of ben.rubson@gmx.com designates 212.227.15.15 as permitted sender) smtp.mailfrom=ben.rubson@gmx.com X-Spamd-Result: default: False [-2.50 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:212.227.15.0/24]; FREEMAIL_FROM(0.00)[gmx.com]; MV_CASE(0.50)[]; DKIM_TRACE(0.00)[gmx.net:+]; DMARC_POLICY_ALLOW(-0.50)[gmx.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmx.com]; MID_RHS_MATCH_FROM(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[212.227.15.15:from]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmx.net:s=badeba3b8450]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[fs@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[212.227.15.15:from:127.0.2.255]; RCVD_IN_DNSWL_NONE(0.00)[212.227.15.15:from]; TO_DN_EQ_ADDR_ALL(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[212.227.15.15:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[fs] Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 May 2021 15:14:53 -0000 > On 6 May 2021, at 15:51, Alan Somers wrote: >=20 > On Thu, May 6, 2021 at 7:37 AM Ben RUBSON > wrote: > > On 6 May 2021, at 15:24, Alan Somers > wrote: > >=20 > > On Thu, May 6, 2021 at 4:52 AM Ben RUBSON >> wrote: > > Hi, > >=20 > > I'm building a new ZFS pool from scratch, choosing my own hardware = etc... > > For sure I'll go for the standard SAS2008 / SAS3008 controller. > >=20 > > However, I'm wondering whether or not I should absolutely go for = dual-port SAS HDD (with dual backplane, controller...). > > I have some difficulties to find enterprise grade dual port SAS HDD. > > HGST used to provide Ultrastar SAS HDD which were dual-port. > > However, strangely, Western Digital does not advertise their = Ultrastar DC SAS HDD as bringing dual-port, so I guess they're not. > >=20 > > Any thoughts / advices regarding this topic ? > >=20 > > Many thanks for your help, > >=20 > > Kind regards, > >=20 > > Ben > >=20 > > It's just a matter of high availability. Can you tolerate an outage = if a JBOD I/O controller fails? If so, then you don't need dual-port. = But server crashes are more common than JBOD I/O controller failures. = So you should worry more about that. >=20 > Thank you Alan. > Of course you're right, JBOD IO controller is not the first outage = cause, and disks themselves are more prone to fail... >=20 > I even wonder whether or not dual path is actively used for HDDs, as = dual-port ones are rather hard to find... > Not sure then it's really worth it... >=20 > Of course feel free if I'm wrong / I missed something / one actively = uses it and has some experience / references to share ! >=20 > Thank you again, >=20 > Ben >=20 > Sure, dual paths are actively used. They work well with gmultipath, = which is how I use them. And AFAIK all SAS drives are dual-ported. = Western Digital describes their drives as "dual port" on this site: > = https://www.westerndigital.com/products/data-center-platforms/ultrastar-sa= s-series-ssd = You're right, SAS SSDs are dual-port. However, their SAS HDDs are not advertised as such : = https://www.westerndigital.com/products/data-center-platforms/ultrastar-dc= -hc600-series-hdd = https://www.westerndigital.com/products/data-center-platforms/ultrastar-dc= -hc500-series-hdd So I wonder. Ben From owner-freebsd-fs@freebsd.org Thu May 6 15:19:22 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 684CF624E6D for ; Thu, 6 May 2021 15:19:22 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4FbcgZ171Mz4mXR for ; Thu, 6 May 2021 15:19:22 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mailman.nyi.freebsd.org (Postfix) id 267D5624D7B; Thu, 6 May 2021 15:19:22 +0000 (UTC) Delivered-To: fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 263E5624D7A for ; Thu, 6 May 2021 15:19:22 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-oo1-f44.google.com (mail-oo1-f44.google.com [209.85.161.44]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FbcgZ0YG7z4mVp for ; Thu, 6 May 2021 15:19:21 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-oo1-f44.google.com with SMTP id c6-20020a4aacc60000b02901e6260b12e2so1316551oon.3 for ; Thu, 06 May 2021 08:19:21 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=SipB3WoNN29rdus1UhBUalZlNJs9myXkem8hT81/6FQ=; b=AbHqSRAcdkfvL+55keuVYQmxtcEdlkzA8MUY+ulBGLTfd2D5bM7npJbPi0GrivQ1kv yKPRoZl9maCG15I8utoK8PNfL2sUJkgxYx+DvmHJycM7F/dex9r9+2ZWPeWUKAXvkhml oX4xgmYFhl3kXhQUc66w8vDk5uH40qsBJ0Q5E2kbJ/+i/nytKa6nUUQeTJouF7mXVq6L SuHUnYhC8Ona7KK1yZZb4F+XQfj3L+H07/w9TYBKfkqdJ6f0LTh0swxg5gJeA1Qj2jdW sQumtMfTWM9yjwBg+yhMe2CKWgKlMBPBKdsLX++ZTbssfJR8Np0pLfJ0C2jw/zj0C2+2 Zxeg== X-Gm-Message-State: AOAM532CNeNZhS81HhXscBpBeXHSYa9xZC8ehx3oGh6/6zyH7Ybi+19x Dhuh0l02pP3KOBvCHRDP21KALLCxl05NHvniu8E= X-Google-Smtp-Source: ABdhPJyddxSt4r1oNtNs2a+CiRAOq0K/knJMzN+RnpLD8X7eMjmEBG7+hUFUfJAqZJ/F3oNEWVKqmjKx6hw4aeVs1Ng= X-Received: by 2002:a4a:8dd6:: with SMTP id a22mr3923623ool.74.1620314360113; Thu, 06 May 2021 08:19:20 -0700 (PDT) MIME-Version: 1.0 References: <578487FF-1D89-4A9E-AD97-6B5DCD9F785A@gmx.com> <62B46E11-A40C-4119-8525-20E3F3539D61@gmx.com> In-Reply-To: From: Alan Somers Date: Thu, 6 May 2021 09:19:09 -0600 Message-ID: Subject: Re: Dual-port SAS HDD ? To: Ben RUBSON Cc: "fs@freebsd.org" X-Rspamd-Queue-Id: 4FbcgZ0YG7z4mVp X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 May 2021 15:19:22 -0000 On Thu, May 6, 2021 at 9:14 AM Ben RUBSON wrote: > > > > On 6 May 2021, at 15:51, Alan Somers wrote: > > > > On Thu, May 6, 2021 at 7:37 AM Ben RUBSON ben.rubson@gmx.com>> wrote: > > > On 6 May 2021, at 15:24, Alan Somers asomers@freebsd.org>> wrote: > > > > > > On Thu, May 6, 2021 at 4:52 AM Ben RUBSON ben.rubson@gmx.com> >> > wrote: > > > Hi, > > > > > > I'm building a new ZFS pool from scratch, choosing my own hardware > etc... > > > For sure I'll go for the standard SAS2008 / SAS3008 controller. > > > > > > However, I'm wondering whether or not I should absolutely go for > dual-port SAS HDD (with dual backplane, controller...). > > > I have some difficulties to find enterprise grade dual port SAS HDD. > > > HGST used to provide Ultrastar SAS HDD which were dual-port. > > > However, strangely, Western Digital does not advertise their Ultrastar > DC SAS HDD as bringing dual-port, so I guess they're not. > > > > > > Any thoughts / advices regarding this topic ? > > > > > > Many thanks for your help, > > > > > > Kind regards, > > > > > > Ben > > > > > > It's just a matter of high availability. Can you tolerate an outage > if a JBOD I/O controller fails? If so, then you don't need dual-port. But > server crashes are more common than JBOD I/O controller failures. So you > should worry more about that. > > > > Thank you Alan. > > Of course you're right, JBOD IO controller is not the first outage > cause, and disks themselves are more prone to fail... > > > > I even wonder whether or not dual path is actively used for HDDs, as > dual-port ones are rather hard to find... > > Not sure then it's really worth it... > > > > Of course feel free if I'm wrong / I missed something / one actively > uses it and has some experience / references to share ! > > > > Thank you again, > > > > Ben > > > > Sure, dual paths are actively used. They work well with gmultipath, > which is how I use them. And AFAIK all SAS drives are dual-ported. > Western Digital describes their drives as "dual port" on this site: > > > https://www.westerndigital.com/products/data-center-platforms/ultrastar-sas-series-ssd > < > https://www.westerndigital.com/products/data-center-platforms/ultrastar-sas-series-ssd > > > You're right, SAS SSDs are dual-port. > However, their SAS HDDs are not advertised as such : > > https://www.westerndigital.com/products/data-center-platforms/ultrastar-dc-hc600-series-hdd > > https://www.westerndigital.com/products/data-center-platforms/ultrastar-dc-hc500-series-hdd > So I wonder. > > Ben > Oh, good point. I don't know. You could always ask. I use mostly Seagate dual-ported HDDs. -Alan From owner-freebsd-fs@freebsd.org Sat May 8 12:09:43 2021 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1F50C633CF8 for ; Sat, 8 May 2021 12:09:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4FcmMq0BvSz4q8x for ; Sat, 8 May 2021 12:09:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 06D49634110; Sat, 8 May 2021 12:09:43 +0000 (UTC) Delivered-To: fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 06A19633D4D for ; Sat, 8 May 2021 12:09:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FcmMp6jYVz4pq0 for ; Sat, 8 May 2021 12:09:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id D9F681E73D for ; Sat, 8 May 2021 12:09:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 148C9gZh042413 for ; Sat, 8 May 2021 12:09:42 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 148C9gZs042412 for fs@FreeBSD.org; Sat, 8 May 2021 12:09:42 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 254177] When ZFS is recognized, An i386 machine with a lot of memory hangs. Date: Sat, 08 May 2021 12:09:42 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: yasu@utahime.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 May 2021 12:09:43 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D254177 --- Comment #3 from Yasuhiro Kimura --- Created attachment 224770 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D224770&action= =3Dedit Patch file The problem also happens with 13-STABLE and 14-CURRENT. Referencing comment #0, I applied attached patch to base d474440ab33 of main (14-CURRENT). built install image and tried install of ZFS root i386 system with it. Then it completed successfully with 8GB memory. Additionally GENERIC kernel recognizes 8GB of memory. And ZFS root system w= orks fine without any tuning. --=20 You are receiving this mail because: You are the assignee for the bug.=