From owner-freebsd-fs@freebsd.org Sun Nov 11 00:15:04 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 78B2B11212BB for ; Sun, 11 Nov 2018 00:15:04 +0000 (UTC) (envelope-from joe@via.net) Received: from smtp3.via.net (smtp3.via.net [157.22.3.7]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9415083753 for ; Sun, 11 Nov 2018 00:15:02 +0000 (UTC) (envelope-from joe@via.net) Received: from mail.via.net (mail.via.net [157.22.3.34]) by smtp3.via.net (8.15.2/8.14.1-VIANET) with ESMTPS id wAB07BAG009462 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Sat, 10 Nov 2018 16:07:11 -0800 (PST) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.97.3 at smtp3.via.net Received: from [209.81.2.65] ([209.81.2.65]) (authenticated bits=0) by mail.via.net (8.15.2/8.14.1-VIANET) with ESMTPSA id wAB07A3m011847 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO) for ; Sat, 10 Nov 2018 16:07:10 -0800 (PST) From: joe mcguckin Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 12.0 \(3445.100.39\)) Subject: ZFS flash systems Message-Id: Date: Sat, 10 Nov 2018 16:07:00 -0800 To: freebsd-fs@freebsd.org X-Mailer: Apple Mail (2.3445.100.39) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (smtp3.via.net [157.22.3.7]); Sat, 10 Nov 2018 16:07:11 -0800 (PST) X-Rspamd-Queue-Id: 9415083753 X-Spamd-Result: default: False [-1.19 / 200.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.994,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+MX]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.99)[-0.991,0]; RCVD_COUNT_THREE(0.00)[3]; DMARC_NA(0.00)[via.net]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MX_GOOD(-0.01)[smtp3.via.net,smtp2.via.net,smtp4.via.net,smtp1.via.net]; NEURAL_SPAM_SHORT(0.73)[0.727,0]; RCVD_IN_DNSWL_LOW(-0.10)[7.3.22.157.list.dnswl.org : 127.0.5.1]; R_DKIM_NA(0.00)[]; IP_SCORE(-0.02)[country: US(-0.09)]; ASN(0.00)[asn:7091, ipnet:157.22.0.0/16, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 11 Nov 2018 00:15:04 -0000 NVMe drives are pretty cheap and there=E2=80=99s al least one = manufacturer that makes a JBOD that takes 24 or so NVMe drives. So, will ZFS on FreeBSD perform well if a made a largish ZFS filer with = all flash instead of spinning disks? Does ZFS have to have any special knowledge that the storage is flash = based? Thanks, joe From owner-freebsd-fs@freebsd.org Sun Nov 11 10:44:00 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6BBD011345A7 for ; Sun, 11 Nov 2018 10:44:00 +0000 (UTC) (envelope-from steven@multiplay.co.uk) Received: from mail-lf1-x134.google.com (mail-lf1-x134.google.com [IPv6:2a00:1450:4864:20::134]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 223797A663 for ; Sun, 11 Nov 2018 10:43:58 +0000 (UTC) (envelope-from steven@multiplay.co.uk) Received: by mail-lf1-x134.google.com with SMTP id p17so4227345lfh.4 for ; Sun, 11 Nov 2018 02:43:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=multiplay-co-uk.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=bpvN33k8eEE1TeT37BvnGdTtehEPaEaUR4zNLs0yfiA=; b=xI/oFwcIXXUEMojpq0bczekMlR1tg3dbD6vxm6YlFmzqolSAd2z7ik1IiQYdtl9jAw bmAIa3D58NJ+mdpsmpNBFvJfEKAP5blAiYnSj7ws1Qy3g777hqmO8GrYBft5sDD/eqzI /Td8AMEP1Fshxxc7P4wabN0r6YonWQMfKawYtioNsJtIrN+42GZtN93qrHnqd6BDEezw MCJe7DFWRE5neGdPiUNVUX2O/5dWywsJipw3tf9sf70u8QWs8ISqwKsG3IqFwvE1DVSl 1gI2IKTfLNMa6i5pKrvog/Q82R2cBntmKTk/wYrRy0r35VLqL/l/DJ35SNKT7/iluvqy 23dg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=bpvN33k8eEE1TeT37BvnGdTtehEPaEaUR4zNLs0yfiA=; b=tQ6q5B/OKufzHVYCHX3pG40f+ONyUSzasFXQiC04gaeTSQZ1wWQLruRbdlvfCG0rJa MFYdp1q+avkF8qTEFk1+7sTbdvG7luzrLfOmBbJ5mKanWwhmmKhXdhkFnDTJ6U4ktM7y gSEDHJ/13GafyUyE5goobT+tfKE7JYQxMN/jxrujHsaKrebo1ZYzYruNjVoQaNxt7rv6 MXbSUTwiw5hFl4CUo7uyY8xnImihRdQVIxZqoi8iLWcX5eG9zLBqUJ+ykB9VHqcGKn2K +uGzr5lGSmMTC0K5DZi1ZnE9wNH8du4vwNVIgEmgvdP0a7g/KVnG4IM47O02fCOFsVU9 NbNg== X-Gm-Message-State: AGRZ1gJtpWw0XTPcr2GapspNHg3dgllU+77F4pydKkEZW1a7dyBYgDZj 2jVzwPNvzahseTSBkG1yMVqu4xrLec9tqnvLTclT+tYaGh0= X-Google-Smtp-Source: AJdET5eIngpT8qEbPZJjqR3YEuHW9AXEL5CslPhekLKNr/TSudqaPayozysThhUf1lkdn7BCbPgwOTw+/Ye7ddB6MdQ= X-Received: by 2002:a19:4ace:: with SMTP id x197mr8780228lfa.39.1541933037061; Sun, 11 Nov 2018 02:43:57 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Steven Hartland Date: Sun, 11 Nov 2018 10:43:46 +0000 Message-ID: Subject: Re: ZFS flash systems To: joe mcguckin Cc: freebsd-fs@freebsd.org X-Rspamd-Queue-Id: 223797A663 X-Spamd-Result: default: False [-3.91 / 200.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.997,0]; R_DKIM_ALLOW(-0.20)[multiplay-co-uk.20150623.gappssmtp.com]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; NEURAL_HAM_LONG(-1.00)[-0.999,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[multiplay.co.uk]; NEURAL_HAM_SHORT(-0.89)[-0.893,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[multiplay-co-uk.20150623.gappssmtp.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[4.3.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; MX_GOOD(-0.01)[ASPMX.L.GOOGLE.COM,ALT2.ASPMX.L.GOOGLE.COM,ALT1.ASPMX.L.GOOGLE.COM,ASPMX2.GOOGLEMAIL.COM,ASPMX3.GOOGLEMAIL.COM]; FORGED_SENDER(0.30)[killing@multiplay.co.uk,steven@multiplay.co.uk]; RCVD_TLS_LAST(0.00)[]; IP_SCORE(-0.81)[ipnet: 2a00:1450::/32(-2.02), asn: 15169(-1.94), country: US(-0.09)]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[killing@multiplay.co.uk,steven@multiplay.co.uk]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 11 Nov 2018 10:44:00 -0000 It does perform well and it does have some specific knowledge when it comes to the underlying storage on FreeBSD specifically in knows rotating vs non-rotating media. Regards Steve On Sun, 11 Nov 2018 at 00:16, joe mcguckin wrote: > NVMe drives are pretty cheap and there=E2=80=99s al least one manufacture= r that > makes a JBOD that takes 24 or so NVMe drives. > So, will ZFS on FreeBSD perform well if a made a largish ZFS filer with > all flash instead of spinning disks? > > Does ZFS have to have any special knowledge that the storage is flash > based? > > Thanks, > > joe > > > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > From owner-freebsd-fs@freebsd.org Sun Nov 11 15:20:35 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 53D9E1108426 for ; Sun, 11 Nov 2018 15:20:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id C5C1684CC5 for ; Sun, 11 Nov 2018 15:20:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 8A5661108425; Sun, 11 Nov 2018 15:20:34 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 78FF51108424 for ; Sun, 11 Nov 2018 15:20:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0083A84CBB for ; Sun, 11 Nov 2018 15:20:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 2F5F4B2B1 for ; Sun, 11 Nov 2018 15:20:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wABFKXGq031398 for ; Sun, 11 Nov 2018 15:20:33 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wABFKX95031388 for fs@FreeBSD.org; Sun, 11 Nov 2018 15:20:33 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 229614] ZFS lockup in zil_commit_impl Date: Sun, 11 Nov 2018 15:20:33 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: grembo@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: allanjude@FreeBSD.org X-Bugzilla-Flags: mfc-stable11? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: C5C1684CC5 X-Spamd-Result: default: False [-105.88 / 200.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; ALLOW_DOMAIN_WHITELIST(-100.00)[freebsd.org]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; SPF_FAIL_FORWARDING(0.00)[]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; XAW_SERVICE_ACCT(1.00)[]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx66.freebsd.org]; NEURAL_HAM_SHORT(-1.00)[-1.000,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.67)[ip: (-9.83), ipnet: 2001:1900:2254::/48(-4.75), asn: 10310(-3.68), country: US(-0.09)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_NO_DN(0.00)[]; RCVD_COUNT_SEVEN(0.00)[7] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 11 Nov 2018 15:20:35 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D229614 --- Comment #40 from Michael Gmelin --- (In reply to Allan Jude from comment #38) Andreas managed to reproduce the issue with the patch (like predicted by avg and you), but it took days of hammering the system heavily. @Allan/avg: Do you have an overview of all the possible code paths in which this interlock can happen? I didn't look closely at the code myself yet. If it's just about reclaiming a vnode, we could just allow that to fail and either retry the operation or allow exceeding kern.maxvnodes temporarily (l= ike in a kind of soft-fail scenario). --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-fs@freebsd.org Sun Nov 11 21:01:35 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 40927112448C for ; Sun, 11 Nov 2018 21:01:35 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id AAEDE6DEC1 for ; Sun, 11 Nov 2018 21:01:34 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: by mailman.ysv.freebsd.org (Postfix) id 6ED071124481; Sun, 11 Nov 2018 21:01:34 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 348551124477 for ; Sun, 11 Nov 2018 21:01:34 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 62A376DEA3 for ; Sun, 11 Nov 2018 21:01:33 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 789B6E42B for ; Sun, 11 Nov 2018 21:01:32 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wABL1W66058915 for ; Sun, 11 Nov 2018 21:01:32 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wABL1Wu7058908 for fs@FreeBSD.org; Sun, 11 Nov 2018 21:01:32 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <201811112101.wABL1Wu7058908@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: fs@FreeBSD.org Subject: Problem reports for fs@FreeBSD.org that need special attention Date: Sun, 11 Nov 2018 21:01:32 +0000 MIME-Version: 1.0 X-Rspamd-Queue-Id: AAEDE6DEC1 X-Spamd-Result: default: False [-105.89 / 200.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; ALLOW_DOMAIN_WHITELIST(-100.00)[FreeBSD.org]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; SPF_FAIL_FORWARDING(0.00)[]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; URI_COUNT_ODD(1.00)[13]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx1.FreeBSD.org]; NEURAL_HAM_SHORT(-1.00)[-1.000,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.68)[ip: (-9.84), ipnet: 2001:1900:2254::/48(-4.76), asn: 10310(-3.69), country: US(-0.09)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; DMARC_NA(0.00)[FreeBSD.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_NO_DN(0.00)[]; RCVD_COUNT_SEVEN(0.00)[7] X-Rspamd-Server: mx1.freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 11 Nov 2018 21:01:35 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- New | 203492 | mount_unionfs -o below causes panic New | 217062 | for file systems mounted with -o noexec, exec=off New | 221909 | [ZFS] Add a sysctl to toggle send_corrupt_data Open | 140068 | [smbfs] [patch] smbfs does not allow semicolon in Open | 144447 | [zfs] sharenfs fsunshare() & fsshare_main() non f Open | 211491 | System hangs after "Uptime" on reboot with ZFS 6 problems total for which you should take action. From owner-freebsd-fs@freebsd.org Mon Nov 12 07:30:31 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 518F411330D1 for ; Mon, 12 Nov 2018 07:30:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id C15CA81A0A for ; Mon, 12 Nov 2018 07:30:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 82A7F11330D0; Mon, 12 Nov 2018 07:30:30 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5EDDD11330CF for ; Mon, 12 Nov 2018 07:30:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D127181A09 for ; Mon, 12 Nov 2018 07:30:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id E70A213A7D for ; Mon, 12 Nov 2018 07:30:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wAC7USRo063586 for ; Mon, 12 Nov 2018 07:30:28 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wAC7USrG063585 for fs@FreeBSD.org; Mon, 12 Nov 2018 07:30:28 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 195485] [ufs] mksnap_ffs(8) cannot create snapshot with journaled soft updates enabled Date: Mon, 12 Nov 2018 07:30:26 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 10.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: C15CA81A0A X-Spamd-Result: default: False [-105.89 / 200.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; ALLOW_DOMAIN_WHITELIST(-100.00)[freebsd.org]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; SPF_FAIL_FORWARDING(0.00)[]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; XAW_SERVICE_ACCT(1.00)[]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx66.freebsd.org]; NEURAL_HAM_SHORT(-1.00)[-0.999,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.68)[ip: (-9.84), ipnet: 2001:1900:2254::/48(-4.77), asn: 10310(-3.70), country: US(-0.09)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_NO_DN(0.00)[]; RCVD_COUNT_SEVEN(0.00)[7] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 12 Nov 2018 07:30:31 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D195485 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Open CC| |mckusick@FreeBSD.org --- Comment #2 from Kirk McKusick --- (In reply to t_uemura from comment #1) Short answer: snapshots work while SU+J is running. The problem arises beca= use the fsck code that does the journal recovery does not know how to repair snapshots. Thus after a crash recovery all the snapshots that were on the filesystem are possibly corrupted and will cause a panic if used. Long answer: when files are deleted, the blocks are normally returned to the list of free blocks so that they can be allocated to new files. When a filesystem contains snapshots, each freed blocks is first offered to each of the snapshots so that they can claim it if it is part of one of the files in the snapshot. By claiming a block they prevent it from being put on the lis= t of free blocks and thus its contents will be preserved for the snapshotted fil= e. The journal recovery code has never had the logic added to it to do these checks. Hence, when it frees blocks, it does not check the snapshots to see= if they want to claim these blocks. Thus blocks that should be claimed by the snapshots are instead put on the list of free blocks and will eventually be reused. If one of these blocks is part of the metadata of a file in a snaps= hot (such as a block of indirect pointers) and that block gets overwritten with other data, then attempts to access that file in the snapshot will cause a = data inconsistency leading to a kernel panic. The correct solution is to extract the code from the kernel that handles freeing of blocks and add it to the journal recovery code in fsck. This is a lot of complicated code and would take a lot of effort to do. As ZFS provid= es cheap snapshots, that is the filesystem of preference for folks that want snapshot functionality. The only remaining use for snapshots in UFS is the ability to do live dumps. Thus I have not been motivated to go to the effo= rt to migrate the kernel code to fsck (and nobody has offered to pay me the $2= 5K to have me do it). An easier solution would be to simply delete all the snapshots as part of d= oing the filesystem recovery. The problem is that while there is a list of all t= he inode numbers for the active snapshots in the superblock, we do not know the pathnames for all of these snapshots, so we would have to do a complete traversal of the filesystem to find them which would largely negate the spe= ed benefit of journaling. Another easy solution would be to truncate all the snapshots to zero length= and stop offering them as snapshots. This would be much quicker as we have the = list of inode number that need to be truncated and all we would be left to clean= up would be a list of zero-length files which could be handled by a find after= the system is up and running. I am happy to review changes if someone wants to implement this solution (or the more difficult correct solution noted above). --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Mon Nov 12 08:42:27 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 94F31113468B for ; Mon, 12 Nov 2018 08:42:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 0A3E38413F for ; Mon, 12 Nov 2018 08:42:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id BFE85113468A; Mon, 12 Nov 2018 08:42:26 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9DE961134689 for ; Mon, 12 Nov 2018 08:42:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 21ACE8413A for ; Mon, 12 Nov 2018 08:42:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 6764814552 for ; Mon, 12 Nov 2018 08:42:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wAC8gPdp044696 for ; Mon, 12 Nov 2018 08:42:25 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wAC8gPh4044695 for fs@FreeBSD.org; Mon, 12 Nov 2018 08:42:25 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 229614] ZFS lockup in zil_commit_impl Date: Mon, 12 Nov 2018 08:42:22 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.2-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: andreas.sommer87@googlemail.com X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: allanjude@FreeBSD.org X-Bugzilla-Flags: mfc-stable11? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: 0A3E38413F X-Spamd-Result: default: False [-105.89 / 200.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; ALLOW_DOMAIN_WHITELIST(-100.00)[freebsd.org]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; SPF_FAIL_FORWARDING(0.00)[]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; XAW_SERVICE_ACCT(1.00)[]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx66.freebsd.org]; NEURAL_HAM_SHORT(-1.00)[-0.996,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.68)[ip: (-9.84), ipnet: 2001:1900:2254::/48(-4.77), asn: 10310(-3.70), country: US(-0.09)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_NO_DN(0.00)[]; RCVD_COUNT_SEVEN(0.00)[7] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 12 Nov 2018 08:42:27 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D229614 --- Comment #41 from Andreas Sommer --- (In reply to Michael Gmelin from comment #40) Here are the things I tried to capture the latest issue I found. As Michael noted, this happened with the patched kernel (on 11.2), after days of stomp= ing the system with I/O-heavy infinite background loops. Interesting fact: `top` does not update anymore once per second, but can be updated with the Space key as usual. Also, my `screen` processes seem gone = =E2=80=93 the ones I used to run the background loops. Please note that we now have two processes in zil_commit_impl, and possibly those two are interlocked?! I'm keeping the system in this state for now, j= ust in case someone has an idea which debug information we should collect apart from the below. ----------------- root@asommer-devpm-ci:/usr/home/asommer # top last pid: 58504; load averages: 2.42, 3.37, 3.19=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20 =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20= =20=20=20=20 up 3+10:22:17 02:49:54 61 processes: 1 running, 59 sleeping, 1 zombie CPU: % user, % nice, % system, % interrupt, % idle Mem: 69M Active, 1650M Inact, 10G Wired, 3544M Free ARC: 4243M Total, 1624M MFU, 1829M MRU, 2539K Anon, 111M Header, 775M Other 2517M Compressed, 4824M Uncompressed, 1.92:1 Ratio Swap: 1024M Total, 1024M Free PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 1326 1001 3 44 0 177M 169M select 3 197:02 53.96% python3.6 # <------------ 1777 1001 1 52 0 38216K 33724K select 0 1:09 0.00% python3.6 23006 root 1 20 0 10352K 6592K select 0 0:55 0.00% ssh 833 root 1 20 0 6464K 2396K nanslp 0 0:23 0.00% cr= on 1220 root 1 20 0 6336K 2016K nanslp 1 0:10 0.00% sv= scan 1047 root 1 20 0 6336K 2016K nanslp 3 0:10 0.00% sv= scan 1066 root 1 20 0 10444K 6260K select 1 0:06 0.00% sendmail 1240 root 1 20 0 6464K 2404K nanslp 3 0:04 0.00% cr= on 816 root 1 20 0 10452K 6300K select 0 0:04 0.00% sendmail 1233 root 1 20 0 10444K 6264K select 0 0:04 0.00% sendmail 1073 root 1 20 0 6464K 2400K nanslp 2 0:03 0.00% cr= on 513 root 1 20 0 9180K 5120K select 2 0:02 0.00% de= vd 596 root 1 20 0 6412K 2420K select 0 0:01 0.00% syslogd 999 root 1 20 0 6420K 2464K select 0 0:01 0.00% syslogd 1167 root 1 20 0 6420K 2524K select 1 0:01 0.00% syslogd 1236 smmsp 1 20 0 10444K 5960K pause 3 0:00 0.00% sendmail 778 www 1 20 0 13332K 8668K kqread 0 0:00 0.00% ng= inx 461 root 1 42 0 6544K 2380K select 0 0:00 0.00% dhclient 23003 root 1 44 0 7596K 3616K select 0 0:00 0.00% su= do 1069 smmsp 1 20 0 10444K 5556K pause 2 0:00 0.00% sendmail 819 smmsp 1 20 0 10452K 5912K pause 2 0:00 0.00% sendmail 885 root 1 52 0 6408K 2124K ttyin 1 0:00 0.00% ge= tty 507 _dhcp 1 20 0 6544K 2512K select 2 0:00 0.00% dhclient 58428 asommer 1 23 0 13160K 8012K select 0 0:00 0.00% ss= hd 58433 root 1 52 0 7412K 4048K pause 3 0:00 0.00% csh 58494 root 1 23 0 13160K 7956K select 3 0:00 0.00% ss= hd 58426 root 1 23 0 13160K 7956K select 0 0:00 0.00% ss= hd 1224 root 1 20 0 4244K 1976K select 0 0:00 0.00% supervise 1052 root 1 20 0 4244K 1976K select 0 0:00 0.00% supervise 58501 root 1 47 0 7412K 4068K pause 0 0:00 0.00% csh 1225 root 1 20 0 4244K 1976K select 2 0:00 0.00% supervise 1053 root 1 20 0 4244K 1976K select 3 0:00 0.00% supervise 58482 root 1 52 0 7064K 2868K wait 2 0:00 0.00% sh 58496 asommer 1 23 0 13160K 7968K select 2 0:00 0.00% ss= hd 58378 asommer 1 21 0 0K 16K vmo_de 2 0:00 0.00% ss= hd 797 root 1 21 0 12848K 7108K select 0 0:00 0.00% ss= hd 1776 root 1 20 0 7584K 3624K select 2 0:00 0.00% su= do 58497 asommer 1 26 0 7796K 3784K wait 2 0:00 0.00% ba= sh 58499 root 1 26 0 7596K 3616K select 1 0:00 0.00% su= do 58431 root 1 26 0 7596K 3616K select 3 0:00 0.00% su= do 58429 asommer 1 26 0 7796K 3784K wait 0 0:00 0.00% ba= sh 58381 asommer 1 20 0 4232K 1928K zcw->z 2 0:00 0.00% sy= nc # <------------ 1230 1001 1 20 0 4260K 1988K piperd 3 0:00 0.00% multilog 58432 root 1 26 0 6932K 2900K wait 2 0:00 0.00% su 23002 asommer 1 20 0 7600K 4132K select 1 0:00 0.00% sc= reen 58500 root 1 26 0 6932K 2900K wait 0 0:00 0.00% su 1059 1001 1 52 0 4260K 1984K piperd 1 0:00 0.00% multilog 58504 root 1 46 0 7916K 3140K CPU3 3 0:00 0.00% top 882 root 1 52 0 6408K 2128K ttyin 0 0:00 0.00% ge= tty 877 root 1 52 0 6408K 2128K ttyin 2 0:00 0.00% ge= tty 879 root 1 52 0 6408K 2128K ttyin 2 0:00 0.00% ge= tty 878 root 1 52 0 6408K 2128K ttyin 3 0:00 0.00% ge= tty 881 root 1 52 0 6408K 2128K ttyin 3 0:00 0.00% ge= tty 884 root 1 52 0 6408K 2128K ttyin 0 0:00 0.00% ge= tty 880 root 1 52 0 6408K 2128K ttyin 1 0:00 0.00% ge= tty 883 root 1 52 0 6408K 2128K ttyin 3 0:00 0.00% ge= tty 1048 root 1 52 0 4232K 1960K piperd 1 0:00 0.00% readproctitle root@asommer-devpm-ci:/usr/home/asommer # procstat -kk 1326 PID TID COMM TDNAME KSTACK 1326 100422 python3.6 - mi_switch+0xe6 sleepq_catch_signals+0x40c sleepq_timedwait_sig+0x14 _cv_timedwait_sig_sbt+0x18c seltdwait+0x7b kern_poll+0x3fd sys_poll+0x50 amd64_syscall+0xa38 fast_syscall_common+0x101 1326 100433 python3.6 - mi_switch+0xe6 sleepq_catch_signals+0x40c sleepq_wait_sig+0xf _sleep+0x231 umtxq_sleep+0x1= 43 do_sem2_wait+0x68a __umtx_op_sem2_wait+0x4b amd64_syscall+0xa38 fast_syscall_common+0x101 1326 100436 python3.6 - mi_switch+0xe6 sleepq_timedwait+0x2f _cv_timedwait_sbt+0x18c zil_commit_impl+0xcd3 zfs_freebsd_putpages+0x635 VOP_PUTPAGES_APV+0x82 vnode_pager_putpages+0x8e vm_pageout_flush+0xea vm_object_page_collect_flush+0x213 vm_object_page_clean+0x146 vm_object_terminate+0x93 zfs_freebsd_reclaim+0x1e VOP_RECLAIM_APV+0x82 vgonel+0x208 vrecycle+0x4a zfs_freebsd_inactive+0xd VOP_INACTIVE_APV+0x82 vinactive+0xfc root@asommer-devpm-ci:/usr/home/asommer # procstat 58381 PID PPID PGID SID TSID THR LOGIN WCHAN EMUL COMM 58381 1 58381 58379 58379 1 asommer zcw->zcw FreeBSD ELF64 sync root@asommer-devpm-ci:/usr/home/asommer # procstat -f 58381 PID COMM FD T V FLAGS REF OFFSET PRO NAME 58381 sync text v r r------- - - - /bin/sync 58381 sync cwd v d r------- - - - /usr/home/asommer 58381 sync root v d r------- - - - / 58381 sync 0 v x rw------ 3 40 - - 58381 sync 1 v x rw------ 3 40 - - 58381 sync 2 v x rw------ 3 40 - - root@asommer-devpm-ci:/usr/home/asommer # procstat -r 58381 PID COMM RESOURCE VALUE 58381 sync user time 00:00:00.000000 58381 sync system time 00:00:00.003656 58381 sync maximum RSS 0.0 KB 58381 sync integral shared memory 0.0 KB 58381 sync integral unshared data 0.0 KB 58381 sync integral unshared stack 0.0 KB 58381 sync page reclaims 89 58381 sync page faults 0 58381 sync swaps 0 58381 sync block reads 3 58381 sync block writes 0 58381 sync messages sent 0 58381 sync messages received 0 58381 sync signals received 0 58381 sync voluntary context switches 6 58381 sync involuntary context switches 0 root@asommer-devpm-ci:/usr/home/asommer # procstat -t 58381 PID TID COMM TDNAME CPU PRI STATE WCHAN 58381 101315 sync - -1 120 sleep zcw->= zcw root@asommer-devpm-ci:/usr/home/asommer # procstat -k 58381 PID TID COMM TDNAME KSTACK 58381 101315 sync - mi_switch sleepq_timed= wait _cv_timedwait_sbt zil_commit_impl zfs_sync sys_sync amd64_syscall fast_syscall_common root@asommer-devpm-ci:/usr/home/asommer # procstat -kk 58381 PID TID COMM TDNAME KSTACK 58381 101315 sync - mi_switch+0xe6 sleepq_timedwait+0x2f _cv_timedwait_sbt+0x18c zil_commit_impl+0xcd3 zfs_sync+0xa6 sys_sync+0x116 amd64_syscall+0xa38 fast_syscall_common+0x101 --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-fs@freebsd.org Mon Nov 12 08:49:00 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id ACA221134741 for ; Mon, 12 Nov 2018 08:49:00 +0000 (UTC) (envelope-from shilpanegi.ec@gmail.com) Received: from mail-wm1-x341.google.com (mail-wm1-x341.google.com [IPv6:2a00:1450:4864:20::341]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A0CF284261 for ; Mon, 12 Nov 2018 08:48:59 +0000 (UTC) (envelope-from shilpanegi.ec@gmail.com) Received: by mail-wm1-x341.google.com with SMTP id u13-v6so7284808wmc.4 for ; Mon, 12 Nov 2018 00:48:59 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=tnIwtZ0kwZlDoTy34wqIkKteO8gtiLGnGe+Tjvrcuuo=; b=A8qmRenCQWet2NP9nC/bC1AZJrqb332eoxpHUBL6WH1iv0VWN/Ec3TjbhTLluxw1hp T6wvhCDjXUJMICNHEr5mEwJTjqtol++GWz1QRZe2M1rIcWlnck+sO4vvZ8J5ANC+cZAr 5bhaY6Dpd5F9PHb/hTsQuCN8dgAb1lCRgEkB0lrpwLlIy2TSTmxkMePjqnukwC7P88te YcIqYsmKVPtVQrIB56pk72RHwRK0U/9u5I/tKiYKCWnNDp7pROXn1QlsvVjm/SfFIOTY zzrPxfdj+XYtEW/ofGWYZ2mgTxvd7R6enynikISeOHKdujqRVCZuPM/Z6Jl0FCtzFmEH EW0A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=tnIwtZ0kwZlDoTy34wqIkKteO8gtiLGnGe+Tjvrcuuo=; b=Bnqt6qPvYSNuJRghWN5Pd0RpMq07PjqyMQJakA018V4nxId72Ze/1ea47n2xaz5Y8n 9GUOHsAtYJNkpS2hzKnphNogrWQsyfsUuqencEbNiV6ui4jfk4I/1jD3ZRx69cVCUlV/ xmoYE2ehnLOJ4fVJOugCvxslUQvfYBjJP/kEZPmDHZsVEUdiTN+xGCptro7o8wVkKMv7 xYpAFupPUtxCd6uffVawHEJdAOc1F6xOzt4yVBXN2YeqRpao2Ik6ASoHaaI7Zx2JsRGd QEhWcU767jT3QTunhul5D2HMWMYK4CcpxLsRDgMXlycWSQuIx42Axnf5+78C3P66ovnV V+zQ== X-Gm-Message-State: AGRZ1gJ9AolQ7SMo3yeuy507hujNtqiFVxoppdMjaM+2uaD3alK0/g/Z H5OJK2FQlYK9UtO87Efb83lwIuVDfmIS3IzTIVryuw== X-Google-Smtp-Source: AJdET5fsuZIqrJfbQ376lX6YKvZ+buTIDdqrt6td2HbqB8frfg2OBvqrsFkl505pyqDzNBx7W8D0z0UTpG63GokcVsg= X-Received: by 2002:a1c:702:: with SMTP id 2-v6mr7102994wmh.113.1542012538487; Mon, 12 Nov 2018 00:48:58 -0800 (PST) Received: from 52669349336 named unknown by gmailapi.google.com with HTTPREST; Mon, 12 Nov 2018 00:48:57 -0800 MIME-Version: 1.0 From: Shilpa Negi Date: Mon, 12 Nov 2018 00:48:57 -0800 Message-ID: Subject: Translation and Transcription Services To: Freebsd-Fs X-Rspamd-Queue-Id: A0CF284261 X-Spamd-Result: default: False [-4.69 / 200.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; NEURAL_HAM_LONG(-1.00)[-0.999,0]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[3]; IP_SCORE(-0.82)[ipnet: 2a00:1450::/32(-2.02), asn: 15169(-1.96), country: US(-0.09)]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[1.4.3.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.87)[-0.866,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; TAGGED_FROM(0.00)[] X-Rspamd-Server: mx1.freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 12 Nov 2018 08:49:00 -0000 Respected Ma=E2=80=99am/Sir, *Do you need Translation, Interpretation or Website, Software, Mobile App. Localization Services?* *I am representing a company who have native language experts like Bengali, Malayalam, Marathi, Tamil, Urdu, Kannada, Gujarati, Odia, Punjabi*) and International Languages (*Russian, Spanish, Korean, German, Swedish, Arabic, Turkish, Portuguese, Italian, Thai, French, Greek, Japanese, French, Chinese, Dutch, African etc.*). *Major clientele: *Emenox Group, Global Sign, DTS, Interglobe Technologies, L&T, NISC Export Services, TCS, BHEL and Schneider Electric. So, if you have such requirement, please share with me. Warm Regards, *Shilpa Negi* Team (Tr & In) [image: beacon] From owner-freebsd-fs@freebsd.org Mon Nov 12 15:19:58 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4E33E110854E for ; Mon, 12 Nov 2018 15:19:58 +0000 (UTC) (envelope-from karl@denninger.net) Received: from colo1.denninger.net (colo1.denninger.net [104.236.120.189]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 957C0728D5 for ; Mon, 12 Nov 2018 15:19:56 +0000 (UTC) (envelope-from karl@denninger.net) Received: from denninger.net (ip68-1-57-197.pn.at.cox.net [68.1.57.197]) by colo1.denninger.net (Postfix) with ESMTP id 729A52115A6 for ; Mon, 12 Nov 2018 10:19:20 -0500 (EST) Received: from [192.168.10.21] (D11.Denninger.Net [192.168.10.21]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by denninger.net (Postfix) with ESMTPSA id 00A903469B3 for ; Mon, 12 Nov 2018 09:19:20 -0600 (CST) Subject: Re: ZFS flash systems To: freebsd-fs@freebsd.org References: From: Karl Denninger Openpgp: preference=signencrypt Message-ID: <1f1ba62a-1a9d-4430-d18f-65fade302f41@denninger.net> Date: Mon, 12 Nov 2018 09:19:19 -0600 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.9.1 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-512; boundary="------------ms080502080300090605020806" X-Rspamd-Queue-Id: 957C0728D5 X-Spamd-Result: default: False [1.04 / 200.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; SIGNED_SMIME(-2.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.82)[0.815,0]; HAS_ATTACHMENT(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_DN_NONE(0.00)[]; MIME_GOOD(-0.20)[multipart/signed,multipart/alternative,text/plain]; RCPT_COUNT_ONE(0.00)[1]; AUTH_NA(1.00)[]; RCVD_COUNT_THREE(0.00)[3]; DMARC_NA(0.00)[denninger.net]; MX_GOOD(-0.01)[px.denninger.net]; NEURAL_SPAM_LONG(0.34)[0.337,0]; NEURAL_SPAM_MEDIUM(0.39)[0.393,0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:14061, ipnet:104.236.64.0/18, country:US]; MID_RHS_MATCH_FROM(0.00)[]; IP_SCORE(0.71)[asn: 14061(3.64), country: US(-0.09)]; RECEIVED_SPAMHAUS_PBL(0.00)[197.57.1.68.zen.spamhaus.org : 127.0.0.11] X-Rspamd-Server: mx1.freebsd.org X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 12 Nov 2018 15:19:58 -0000 This is a cryptographically signed message in MIME format. --------------ms080502080300090605020806 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable On 11/10/2018 18:07, joe mcguckin wrote: > NVMe drives are pretty cheap and there=E2=80=99s al least one manufactu= rer that makes a JBOD that takes 24 or so NVMe drives. > So, will ZFS on FreeBSD perform well if a made a largish ZFS filer wit= h all flash instead of spinning disks? > > Does ZFS have to have any special knowledge that the storage is flash b= ased? > I am running a fairly-heavy transactional (Postgres) database backend on FreeBSD 11-STABLE with ZFS on top of flash-based drives and have had no problems.=C2=A0 In addition my "sandbox" machine has a similar configurat= ion but with a smaller number of units, also flash-based (although not NVMe; they're SATA attached on a JBOD LSI controller) and that's been stable as well. --=20 Karl Denninger karl@denninger.net /The Market Ticker/ /[S/MIME encrypted email preferred]/ --------------ms080502080300090605020806 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC DdgwggagMIIEiKADAgECAhMA5EiKghDOXrvfxYxjITXYDdhIMA0GCSqGSIb3DQEBCwUAMIGL MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJTmljZXZpbGxlMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExITAf BgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQTAeFw0xNzA4MTcxNjQyMTdaFw0yNzA4 MTUxNjQyMTdaMHsxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkwFwYDVQQKDBBD dWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExJTAjBgNVBAMMHEN1 ZGEgU3lzdGVtcyBMTEMgMjAxNyBJbnQgQ0EwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIK AoICAQC1aJotNUI+W4jP7xQDO8L/b4XiF4Rss9O0B+3vMH7Njk85fZ052QhZpMVlpaaO+sCI KqG3oNEbuOHzJB/NDJFnqh7ijBwhdWutdsq23Ux6TvxgakyMPpT6TRNEJzcBVQA0kpby1DVD 0EKSK/FrWWBiFmSxg7qUfmIq/mMzgE6epHktyRM3OGq3dbRdOUgfumWrqHXOrdJz06xE9NzY vc9toqZnd79FUtE/nSZVm1VS3Grq7RKV65onvX3QOW4W1ldEHwggaZxgWGNiR/D4eosAGFxn uYeWlKEC70c99Mp1giWux+7ur6hc2E+AaTGh+fGeijO5q40OGd+dNMgK8Es0nDRw81lRcl24 SWUEky9y8DArgIFlRd6d3ZYwgc1DMTWkTavx3ZpASp5TWih6yI8ACwboTvlUYeooMsPtNa9E 6UQ1nt7VEi5syjxnDltbEFoLYcXBcqhRhFETJe9CdenItAHAtOya3w5+fmC2j/xJz29og1KH YqWHlo3Kswi9G77an+zh6nWkMuHs+03DU8DaOEWzZEav3lVD4u76bKRDTbhh0bMAk4eXriGL h4MUoX3Imfcr6JoyheVrAdHDL/BixbMH1UUspeRuqQMQ5b2T6pabXP0oOB4FqldWiDgJBGRd zWLgCYG8wPGJGYgHibl5rFiI5Ix3FQncipc6SdUzOQIDAQABo4IBCjCCAQYwHQYDVR0OBBYE FF3AXsKnjdPND5+bxVECGKtc047PMIHABgNVHSMEgbgwgbWAFBu1oRhUMNEzjODolDka5k4Q EDBioYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJ TmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5 c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYIJAKxAy1WBo2kY MBIGA1UdEwEB/wQIMAYBAf8CAQAwDgYDVR0PAQH/BAQDAgGGMA0GCSqGSIb3DQEBCwUAA4IC AQCB5686UCBVIT52jO3sz9pKuhxuC2npi8ZvoBwt/IH9piPA15/CGF1XeXUdu2qmhOjHkVLN gO7XB1G8CuluxofOIUce0aZGyB+vZ1ylHXlMeB0R82f5dz3/T7RQso55Y2Vog2Zb7PYTC5B9 oNy3ylsnNLzanYlcW3AAfzZcbxYuAdnuq0Im3EpGm8DoItUcf1pDezugKm/yKtNtY6sDyENj tExZ377cYA3IdIwqn1Mh4OAT/Rmh8au2rZAo0+bMYBy9C11Ex0hQ8zWcvPZBDn4v4RtO8g+K uQZQcJnO09LJNtw94W3d2mj4a7XrsKMnZKvm6W9BJIQ4Nmht4wXAtPQ1xA+QpxPTmsGAU0Cv HmqVC7XC3qxFhaOrD2dsvOAK6Sn3MEpH/YrfYCX7a7cz5zW3DsJQ6o3pYfnnQz+hnwLlz4MK 17NIA0WOdAF9IbtQqarf44+PEyUbKtz1r0KGeGLs+VGdd2FLA0e7yuzxJDYcaBTVwqaHhU2/ Fna/jGU7BhrKHtJbb/XlLeFJ24yvuiYKpYWQSSyZu1R/gvZjHeGb344jGBsZdCDrdxtQQcVA 6OxsMAPSUPMrlg9LWELEEYnVulQJerWxpUecGH92O06wwmPgykkz//UmmgjVSh7ErNvL0lUY UMfunYVO/O5hwhW+P4gviCXzBFeTtDZH259O7TCCBzAwggUYoAMCAQICEwCg0WvVwekjGFiO 62SckFwepz0wDQYJKoZIhvcNAQELBQAwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3Jp ZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBD QTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExMQyAyMDE3IEludCBDQTAeFw0xNzA4MTcyMTIx MjBaFw0yMjA4MTYyMTIxMjBaMFcxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRswGQYDVQQDDBJrYXJsQGRlbm5pbmdlci5uZXQw ggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIKAoICAQC+HVSyxVtJhy3Ohs+PAGRuO//Dha9A 16l5FPATr6wude9zjX5f2lrkRyU8vhCXTZW7WbvWZKpcZ8r0dtZmiK9uF58Ec6hhvfkxJzbg 96WHBw5Fumd5ahZzuCJDtCAWW8R7/KN+zwzQf1+B3MVLmbaXAFBuKzySKhKMcHbK3/wjUYTg y+3UK6v2SBrowvkUBC+jxNg3Wy12GsTXcUS/8FYIXgVVPgfZZrbJJb5HWOQpvvhILpPCD3xs YJFNKEPltXKWHT7Qtc2HNqikgNwj8oqOb+PeZGMiWapsatKm8mxuOOGOEBhAoTVTwUHlMNTg 6QUCJtuWFCK38qOCyk9Haj+86lUU8RG6FkRXWgMbNQm1mWREQhw3axgGLSntjjnznJr5vsvX SYR6c+XKLd5KQZcS6LL8FHYNjqVKHBYM+hDnrTZMqa20JLAF1YagutDiMRURU23iWS7bA9tM cXcqkclTSDtFtxahRifXRI7Epq2GSKuEXe/1Tfb5CE8QsbCpGsfSwv2tZ/SpqVG08MdRiXxN 5tmZiQWo15IyWoeKOXl/hKxA9KPuDHngXX022b1ly+5ZOZbxBAZZMod4y4b4FiRUhRI97r9l CxsP/EPHuuTIZ82BYhrhbtab8HuRo2ofne2TfAWY2BlA7ExM8XShMd9bRPZrNTokPQPUCWCg CdIATQIDAQABo4IBzzCCAcswPAYIKwYBBQUHAQEEMDAuMCwGCCsGAQUFBzABhiBodHRwOi8v b2NzcC5jdWRhc3lzdGVtcy5uZXQ6ODg4ODAJBgNVHRMEAjAAMBEGCWCGSAGG+EIBAQQEAwIF oDAOBgNVHQ8BAf8EBAMCBeAwHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMEMDMGCWCG SAGG+EIBDQQmFiRPcGVuU1NMIEdlbmVyYXRlZCBDbGllbnQgQ2VydGlmaWNhdGUwHQYDVR0O BBYEFLElmNWeVgsBPe7O8NiBzjvjYnpRMIHKBgNVHSMEgcIwgb+AFF3AXsKnjdPND5+bxVEC GKtc047PoYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UE BwwJTmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRh IFN5c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYITAORIioIQ zl6738WMYyE12A3YSDAdBgNVHREEFjAUgRJrYXJsQGRlbm5pbmdlci5uZXQwDQYJKoZIhvcN AQELBQADggIBAJXboPFBMLMtaiUt4KEtJCXlHO/3ZzIUIw/eobWFMdhe7M4+0u3te0sr77QR dcPKR0UeHffvpth2Mb3h28WfN0FmJmLwJk+pOx4u6uO3O0E1jNXoKh8fVcL4KU79oEQyYkbu 2HwbXBU9HbldPOOZDnPLi0whi/sbFHdyd4/w/NmnPgzAsQNZ2BYT9uBNr+jZw4SsluQzXG1X lFL/qCBoi1N2mqKPIepfGYF6drbr1RnXEJJsuD+NILLooTNf7PMgHPZ4VSWQXLNeFfygoOOK FiO0qfxPKpDMA+FHa8yNjAJZAgdJX5Mm1kbqipvb+r/H1UAmrzGMbhmf1gConsT5f8KU4n3Q IM2sOpTQe7BoVKlQM/fpQi6aBzu67M1iF1WtODpa5QUPvj1etaK+R3eYBzi4DIbCIWst8MdA 1+fEeKJFvMEZQONpkCwrJ+tJEuGQmjoQZgK1HeloepF0WDcviiho5FlgtAij+iBPtwMuuLiL shAXA5afMX1hYM4l11JXntle12EQFP1r6wOUkpOdxceCcMVDEJBBCHW2ZmdEaXgAm1VU+fnQ qS/wNw/S0X3RJT1qjr5uVlp2Y0auG/eG0jy6TT0KzTJeR9tLSDXprYkN2l/Qf7/nT6Q03qyE QnnKiBXWAZXveafyU/zYa7t3PTWFQGgWoC4w6XqgPo4KV44OMYIFBzCCBQMCAQEwgZIwezEL MAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBM TEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExM QyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTANBglghkgBZQMEAgMFAKCCAkUw GAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMTgxMTEyMTUxOTE5 WjBPBgkqhkiG9w0BCQQxQgRA0a0EqD3aQDQoQ7LMc3a6Z4Ou0lxaRy+1kqL30Tn8cGUbDrsK 3eCuwrnHAzXVliz7Hrv/yhtgNJW6QPSusFFkujBsBgkqhkiG9w0BCQ8xXzBdMAsGCWCGSAFl AwQBKjALBglghkgBZQMEAQIwCgYIKoZIhvcNAwcwDgYIKoZIhvcNAwICAgCAMA0GCCqGSIb3 DQMCAgFAMAcGBSsOAwIHMA0GCCqGSIb3DQMCAgEoMIGjBgkrBgEEAYI3EAQxgZUwgZIwezEL MAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBM TEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExM QyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTCBpQYLKoZIhvcNAQkQAgsxgZWg gZIwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGExGTAXBgNVBAoMEEN1ZGEgU3lz dGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTElMCMGA1UEAwwcQ3VkYSBTeXN0 ZW1zIExMQyAyMDE3IEludCBDQQITAKDRa9XB6SMYWI7rZJyQXB6nPTANBgkqhkiG9w0BAQEF AASCAgBrv/XNZkSMGXm9ONMbK0wcgiMNCIfC7gEKrXe5Ll4HOzi8xXEC+Tk7fxj1BfTh9juG PV5GU+bX64nStR1x46pTR2n/pWbquvVNGTg+m9OAs/2ZHlveSLb1afG9QvFNd7lPltOQWmxK zFRhZCaTKb169MoIvKIdP1Os2g/fJgpYI1+A4KhMMJXsr+OVu0h7qk7Siv6vWjtPGXgOuUgz VP2Bx3EJ6cBE9iGlvFwVlGyaN9Kpdgcwc2tooAgdz+mLhi+YHDstsJV+HhMbx45SaVDe4USR mdNRlnCfjmwXEMnrViEbRT1AWRTq/sOARkmwso0BEXVPAJ/EM3pUZf3AhaXeRUNQLVg7tKyD MvR7htbq1gs0pWiFAV5l1xNYjWtZN2GcthY7Gj+OZZ76Z5k2BR6g5aEaNcO/qzN3Bu8gcHbS V/92+ghL8unkloQ/uxKIFfh/l0zjTD3FZHPekAjbZB6tIMhL6dUzvDuHAA3kJO43xKjQID12 Kq65POrW9Petc5sx3mrn7rTNvqSl/f/MJik1vzg6abYbz01Q8gD0oInU9GsFxcRS+cMGA0wK fcoFYcuMpq4/pI+sQX2eDQBXABH4QJPOt9iiMSC9tQ1aX5eDclktrC0EoR7cuF7E6PDk5GDC 9MM1u23X3tIw/89TMInCK662wbXFyS7p3GMs40wXbAAAAAAAAA== --------------ms080502080300090605020806-- From owner-freebsd-fs@freebsd.org Mon Nov 12 22:43:32 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 198CB1125CDA for ; Mon, 12 Nov 2018 22:43:32 +0000 (UTC) (envelope-from wingairak@gmail.com) Received: from mail-lf1-x132.google.com (mail-lf1-x132.google.com [IPv6:2a00:1450:4864:20::132]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id BBBCF88D31 for ; Mon, 12 Nov 2018 22:43:30 +0000 (UTC) (envelope-from wingairak@gmail.com) Received: by mail-lf1-x132.google.com with SMTP id c16so7382886lfj.8 for ; Mon, 12 Nov 2018 14:43:30 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=yKsaoXgS6A/+DgC8/s6hnkLJ3ohSHKsJJlUlwAKQbo4=; b=PgF0lz4ENMmZnou37HxlHiEi/x/76oFPQJybZ5rDijp3VIvzxBr06wJEGlHjmp5g9W ZMSPd1HegG9k/1q+IV6awFIy9wQJjYhu574u1eX8LZMqJ1MDltzEK9bZbOB/ctp7PVId isZZ3KeMtAECucQnzOz3sMHagyOZ6n2jt2ZXdyGFb8DMfYzZGUUXexViK3JvvxcM3gUY pNpTu/QK7XCPAcDvMgHTs5JDXRvSTRwKcO+N+1Pf4j6l81EGZtiWF95SFZPw3gevO1u0 zzopqyvwR/yYv2GnL+4KaLU1Za6ZaYqZZBGTkEC7Rq7wUVv2OJpcZHJGynBM2UDxo2Pr Y3HA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=yKsaoXgS6A/+DgC8/s6hnkLJ3ohSHKsJJlUlwAKQbo4=; b=tqbO3w57Ikwzq5eQtcQqdzvA3Zab9Cj7MKzUBMMKdh1JWkUCNXAawMG8K5gvV3WztL qA/SXpC8RFlkHP+gNJByKlN41zLtuamgNMHrcgpJeCnHcruDsy7dSC3WDFRmykrtWmqR bnUAnKABof7OWDf3hLVqPIVRl0Id2l2RsRgp8Vr+NBG8rFJ6ecZtfYQ0KLUcZ9Fjft0M k2DchQudbdmxI53ILPsl/BypMdexpZ6IzO9nu+6gIss86jZJDrwn96bVkXOzQjjPMwnZ UqRwiEA9dn9zD2+HYNQvKB81oQkyBWIQXuVBmJCazsxY6BFhN3IMKruFmgRqS0gJbukQ EJew== X-Gm-Message-State: AGRZ1gLw0w1P7Y8pcio1iZZQZ/BL30hyAQfcg/1BnsNOfKiO52695HBR HQdWIGVgwITtEwQYCj5YBbq6WAvZ5/cB+VfxQCZNTw== X-Google-Smtp-Source: AJdET5ch99ZoI5//C7lBhpSz4uEh9oh6iJniCDG3229XB4qg4i+8TeBEXgcAdMYqacssMTGwD7IHrPbe2wnzMcCPAOE= X-Received: by 2002:a19:d70f:: with SMTP id o15mr1731392lfg.134.1542062608974; Mon, 12 Nov 2018 14:43:28 -0800 (PST) MIME-Version: 1.0 From: Robert Wing Date: Mon, 12 Nov 2018 12:43:29 -0900 Message-ID: Subject: mount zpool from a zfs volume To: freebsd-fs@freebsd.org X-Rspamd-Queue-Id: BBBCF88D31 X-Spamd-Result: default: False [-4.68 / 200.00]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; TO_DN_NONE(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MIME_BASE64_TEXT(0.10)[]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.96)[-0.965,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; IP_SCORE(-0.81)[ipnet: 2a00:1450::/32(-1.99), asn: 15169(-1.94), country: US(-0.09)]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; RCVD_IN_DNSWL_NONE(0.00)[2.3.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 12 Nov 2018 22:43:32 -0000 I want to import a zpool from a freebsd-zfs partition that is backed by a zfs volume. Is this possible? The sequence of commands that result in success are eluding me. gpart show: => 40 33554352 zvol/zroot/vol GPT (16G) 40 1024 1 freebsd-boot (512K) 1064 984 - free - (492K) 2048 2097152 2 freebsd-swap (1.0G) 2099200 31453184 3 freebsd-zfs (15G) 33552384 2008 - free - (1.0M) zfs list (relevant parts): ... zroot datasets ... zroot/vol 16.5G 367G 672M - I've tried 'zpool import' which produces no results, also tried explicitly with the -d option. The results of this command lead me to believe that the pool from the zfs volume is not being exported. I tried using 'zfs mount zroot/vol', failed with: operation not applicable to datasets of this type. The zfs volume is the backer for a VM, this is what I'm trying to acheive: 1) shutdown the VM 2) import zpool from the VM 3) make changes to the VM zfs datasets 4) export the zpool 5) re-boot the VM. Anyone point me in the direction of enlightenment? -Rob From owner-freebsd-fs@freebsd.org Mon Nov 12 23:27:03 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B05B51126A22 for ; Mon, 12 Nov 2018 23:27:03 +0000 (UTC) (envelope-from tommyj27@gmail.com) Received: from mail-lf1-x135.google.com (mail-lf1-x135.google.com [IPv6:2a00:1450:4864:20::135]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E3DB889F68 for ; Mon, 12 Nov 2018 23:27:02 +0000 (UTC) (envelope-from tommyj27@gmail.com) Received: by mail-lf1-x135.google.com with SMTP id p17so7456805lfh.4 for ; Mon, 12 Nov 2018 15:27:02 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=ySQIIU4vv7LFzzutV4FJeLAR8XPPi5/BaE/lRXkJL5g=; b=oAmvEnSt+J07CCoD4c0PC1g2uVwYiQe5jVuvr19zlz5FcMWM+ss9MK2shKmw7FNiec fFlZfMg85sgGN54gTjwg2O5x5ZD9/RmUq4dkf6vsk8jdY9fxCa8jluRE2wMwEBYLiw8/ VdYe1ZwU2kFM72+ipuH+FEynNz6KSKLRRbk0QLaBZX4sQXSmuCqPR4AKRNPI/lAx+Ff0 xagkXNXol8UF05N3Feyxd4zaJUZ3oQ324q8ptYZ+8kWdaw5bk7X1wfIdygpn3hK84WPN 3dcY6C2VivKSBJ1EAPyjTAyt+lpFbf8lu25ht0LiK1FDnHqNOCh+eBafNiltjYjx1F4Q FkZQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=ySQIIU4vv7LFzzutV4FJeLAR8XPPi5/BaE/lRXkJL5g=; b=H1IVBKz7upxjPFiAhDhrLC1yCS5v24GgGY8IlgGbihGPhnp7ufeTqzOx2ywmxN4WdL hAfn26mWm51/7NG3HOoOH00BZh0AOtAQktogErzu4ZTGeMMTwOM19tjLVKlUCq01K6sV AjSu1oHJzCgskdNlMHzVriGn6b0tnt4JvbfEUtJXEibEoAYpYUJYH+oZFXhlq3yLDdeF rezIgbjQUTgrvUL/52zXvHb3Xh1omtK2QFBMpWbDXsLblTnRgWAdIXf8Jq54ZjT4n5zE y78xQKxOX6mumzSll/c6UDvtlVmn4fdriQDlneO+am1fdMWLL94a4SSxfoxzbLui5Vvf NVSA== X-Gm-Message-State: AGRZ1gKmRjatOPLg6x85D3MzTp7SWVZtw6xZDSwtmBvscmpgow+Gz69E 4LEwnKTJ+zACIZryfwgeXiiDwC/e5shHR8edPQ== X-Google-Smtp-Source: AJdET5dxTeTvMnO78vdVVKbTNKQsxgEWJ3z7fU6CBqyulxh/sPqxSxo72zO5VbWRBu9ZMpbyjsE42vEJqA4PyUxzDRI= X-Received: by 2002:a19:9dd1:: with SMTP id g200mr1625176lfe.127.1542065221136; Mon, 12 Nov 2018 15:27:01 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Thomas Johnson Date: Mon, 12 Nov 2018 17:26:49 -0600 Message-ID: Subject: Re: mount zpool from a zfs volume To: wingairak@gmail.com Cc: freebsd-fs@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: E3DB889F68 X-Spamd-Result: default: False [-4.68 / 200.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_DN_NONE(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.86)[-0.857,0]; RCVD_IN_DNSWL_NONE(0.00)[5.3.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; IP_SCORE(-0.81)[ipnet: 2a00:1450::/32(-2.00), asn: 15169(-1.95), country: US(-0.09)] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 12 Nov 2018 23:27:03 -0000 >From UPDATING... 20160129: Building ZFS pools on top of zvols is prohibited by default. That feature has never worked safely; it's always been prone to deadlocks. Using a zvol as the backing store for a VM guest's virtual disk will still work, even if the guest is using ZFS. Legacy behavior can be restored by setting vfs.zfs.vol.recursive=1. That said, I was using it with good results in 11.1. Not so much in 11.2; I get an immediate deadlock. My workaround on 11.2 has been to configure the zvol as an iscsi target and import it that way. If there is a better way, I would love to hear it too. On Mon, Nov 12, 2018 at 4:44 PM Robert Wing wrote: > > I want to import a zpool from a freebsd-zfs partition that is backed by a > zfs volume. Is this possible? The sequence of commands that result in > success are eluding me. > > gpart show: > => 40 33554352 zvol/zroot/vol GPT (16G) > 40 1024 1 freebsd-boot (512K) > 1064 984 - free - (492K) > 2048 2097152 2 freebsd-swap (1.0G) > 2099200 31453184 3 freebsd-zfs (15G) > 33552384 2008 - free - (1.0M) > > zfs list (relevant parts): > ... zroot datasets ... > zroot/vol 16.5G 367G 672M - > > I've tried 'zpool import' which produces no results, also tried explicitly > with the -d option. The results of this command lead me to believe that the > pool from the zfs volume is not being exported. > > I tried using 'zfs mount zroot/vol', failed with: operation not applicable > to datasets of this type. > > The zfs volume is the backer for a VM, this is what I'm trying to acheive: > 1) shutdown the VM > 2) import zpool from the VM > 3) make changes to the VM zfs datasets > 4) export the zpool > 5) re-boot the VM. > > Anyone point me in the direction of enlightenment? > > -Rob > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" From owner-freebsd-fs@freebsd.org Tue Nov 13 06:28:20 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3CF9D11058F8 for ; Tue, 13 Nov 2018 06:28:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id A496D74FC8 for ; Tue, 13 Nov 2018 06:28:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id EDF8211058F7; Tue, 13 Nov 2018 06:28:17 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DCC4C11058F6 for ; Tue, 13 Nov 2018 06:28:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4B03574F90 for ; Tue, 13 Nov 2018 06:28:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id DF4BF1F691 for ; Tue, 13 Nov 2018 06:28:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wAD6SF4B077614 for ; Tue, 13 Nov 2018 06:28:15 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wAD6SFfp077613 for fs@FreeBSD.org; Tue, 13 Nov 2018 06:28:15 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 227784] zfs: Fatal trap 9: general protection fault while in kernel mode on shutdown Date: Tue, 13 Nov 2018 06:28:15 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: wulf@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: A496D74FC8 X-Spamd-Result: default: False [-105.90 / 200.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; ALLOW_DOMAIN_WHITELIST(-100.00)[freebsd.org]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; SPF_FAIL_FORWARDING(0.00)[]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; XAW_SERVICE_ACCT(1.00)[]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx66.freebsd.org]; NEURAL_HAM_SHORT(-0.99)[-0.995,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.69)[ip: (-9.85), ipnet: 2001:1900:2254::/48(-4.79), asn: 10310(-3.72), country: US(-0.09)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_NO_DN(0.00)[]; RCVD_COUNT_SEVEN(0.00)[7] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Nov 2018 06:28:20 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D227784 --- Comment #18 from Vladimir Kondratyev --- (In reply to Mark Johnston from comment #17) No panics so far. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue Nov 13 11:40:27 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8A76F1121A01 for ; Tue, 13 Nov 2018 11:40:27 +0000 (UTC) (envelope-from borjam@sarenet.es) Received: from cu1176c.smtpx.saremail.com (cu1176c.smtpx.saremail.com [195.16.148.151]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3374D8022F for ; Tue, 13 Nov 2018 11:40:25 +0000 (UTC) (envelope-from borjam@sarenet.es) Received: from [172.16.8.5] (unknown [192.148.167.11]) by proxypop02.sare.net (Postfix) with ESMTPA id D52DA9DCF15; Tue, 13 Nov 2018 12:40:14 +0100 (CET) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 12.1 \(3445.101.1\)) Subject: Re: ZFS flash systems From: Borja Marcos In-Reply-To: Date: Tue, 13 Nov 2018 12:40:13 +0100 Cc: joe mcguckin , freebsd-fs@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: To: Steven Hartland X-Mailer: Apple Mail (2.3445.101.1) X-Rspamd-Queue-Id: 3374D8022F X-Spamd-Result: default: False [-2.54 / 200.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.995,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip4:195.16.148.0/24]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[sarenet.es]; NEURAL_HAM_LONG(-1.00)[-0.995,0]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[smtp.sarenet.es,smtp.sarenet.es,smtp.sarenet.es]; NEURAL_HAM_SHORT(-0.75)[-0.746,0]; RCVD_IN_DNSWL_NONE(0.00)[151.148.16.195.list.dnswl.org : 127.0.10.0]; IP_SCORE(0.00)[country: ES(0.02)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:3262, ipnet:195.16.128.0/19, country:ES]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Nov 2018 11:40:27 -0000 > On 11 Nov 2018, at 11:43, Steven Hartland = wrote: >=20 > It does perform well and it does have some specific knowledge when it = comes > to the underlying storage on FreeBSD specifically in knows rotating vs > non-rotating media. The worst issue is, unless I am wrong you won=E2=80=99t have hot swap. = At least when I tried the code for the =E2=80=9Cwarm swap=E2=80=9D ritual was not in place. You can=E2=80= =99t just unplug like you would a SAS disk. You need to put the device in quiescent mode before. Also, beware the NVMes and their TRIM implementation. Check firmware = versions and test in advance. I had a nasty surprise with Intel NVMEs some time ago. Borja.= From owner-freebsd-fs@freebsd.org Tue Nov 13 17:42:13 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A6EE6112BB1B for ; Tue, 13 Nov 2018 17:42:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 253016F36D for ; Tue, 13 Nov 2018 17:42:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id DDBF2112BB1A; Tue, 13 Nov 2018 17:42:12 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CC844112BB19 for ; Tue, 13 Nov 2018 17:42:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 55DBE6F364 for ; Tue, 13 Nov 2018 17:42:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 86CE354F8 for ; Tue, 13 Nov 2018 17:42:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wADHgB9s071671 for ; Tue, 13 Nov 2018 17:42:11 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wADHgBGI071661 for fs@FreeBSD.org; Tue, 13 Nov 2018 17:42:11 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 227784] zfs: Fatal trap 9: general protection fault while in kernel mode on shutdown Date: Tue, 13 Nov 2018 17:42:10 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: panic, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: markj@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: markj@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: 253016F36D X-Spamd-Result: default: False [-105.90 / 200.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; ALLOW_DOMAIN_WHITELIST(-100.00)[freebsd.org]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; SPF_FAIL_FORWARDING(0.00)[]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; XAW_SERVICE_ACCT(1.00)[]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx66.freebsd.org]; NEURAL_HAM_SHORT(-1.00)[-0.997,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.69)[ip: (-9.85), ipnet: 2001:1900:2254::/48(-4.79), asn: 10310(-3.73), country: US(-0.09)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_NO_DN(0.00)[]; RCVD_COUNT_SEVEN(0.00)[7] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Nov 2018 17:42:13 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D227784 Mark Johnston changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|fs@FreeBSD.org |markj@FreeBSD.org --- Comment #19 from Mark Johnston --- (In reply to Vladimir Kondratyev from comment #18) Thanks. https://reviews.freebsd.org/D17975 --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue Nov 13 22:09:46 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D9790113409E; Tue, 13 Nov 2018 22:09:45 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-lf1-f51.google.com (mail-lf1-f51.google.com [209.85.167.51]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 44ECE7ACF2; Tue, 13 Nov 2018 22:09:45 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-lf1-f51.google.com with SMTP id h192so10055903lfg.3; Tue, 13 Nov 2018 14:09:45 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=eVSb/6yWf5kfSUFGYd4VOZ0Zm6v+RP8IQB1hOBn/UUs=; b=dTqeIfyeDFK70ix6c3VncTBNCbV+D2YboKyaCWCfiCRmUdGNmwrGtduo8qqeH5zH36 K/09DtRDKFywHiM3EHNJsTwqnbR8FnyNQ883ry9AcQmnPzssktB10u7nCUzgabyGoMqd vhuAcEPrbZklMEW6ub+/Mm7WltNI0c4XPMK6u00r1evFF3Zy92VFzZ8chPpqNJuuLug6 7CMFMtAh5EByLtmZ+mio2SrgVuXr9NV7InvXYGgDuMt5j1B2LYXP5Q5XIkR+xhlLgsd5 QqFcfGpXXMi/C8jGx6cakMoKvKNme+OQ/89+SViYG97XrUVtghlEDU5Wr23VUIX+uwAy 9vog== X-Gm-Message-State: AGRZ1gJLpkKF8yHNTDZB5bMnt629704YbBktY6NzRxeYa+n3ZA8CsNsS V2rOs3BRejzBxlqxIcAJF/+d4fFWL4913HjHX+PYPw== X-Google-Smtp-Source: AJdET5c4NMBOKlpRUaMW5suYzwf7VLZr7ATJp7y6adlIpOLqhpcLEVNuUejTc+FTiXmCy+z5WenAM3ZkhQS7zDWnVX4= X-Received: by 2002:a19:d8ea:: with SMTP id r103mr4262631lfi.146.1542146977324; Tue, 13 Nov 2018 14:09:37 -0800 (PST) MIME-Version: 1.0 From: Alan Somers Date: Tue, 13 Nov 2018 15:09:24 -0700 Message-ID: Subject: Hole-punching, TRIM, etc To: freebsd-arch@freebsd.org, freebsd-fs , FreeBSD CURRENT X-Rspamd-Queue-Id: 44ECE7ACF2 X-Spamd-Result: default: False [-4.06 / 200.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[freebsd.org]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-1.00)[-0.999,0]; IP_SCORE(-1.10)[ipnet: 209.85.128.0/17(-3.50), asn: 15169(-1.91), country: US(-0.09)]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.95)[-0.946,0]; RCVD_IN_DNSWL_NONE(0.00)[51.167.85.209.list.dnswl.org : 127.0.5.0]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Nov 2018 22:09:46 -0000 Hole-punching has been discussed on these lists before[1]. It basically means to turn a dense file into a sparse file by deallocating storage for some of the blocks in the middle. There's no standard API for it. Linux uses fallocate(2); Solaris and OSX add a new opcode to fcntl(2). A related concept is telling a block device that some blocks are no longer used. SATA calls this "TRIM", SCSI calls it "UNMAP", NVMe calls it "Deallocate", ZBC and ZAC call it "Reset Write Pointer". They all do basically the same thing, and it's analogous to hole-punching for regular files. They are also all inaccessible from FreeBSD's userland except by using pass(4), which is inconvenient and protocol-specific. Linux has a BLKDISCARD ioctl for issuing TRIM-like commands from userland, but it's totally undocumented and doesn't work on regular files. I propose adding support for all of these things using the fcntl(2) API. Using the same syntax that Solaris defined, you would be able to punch a hole in a regular file or TRIM blocks from an SSD. ZFS already supports it (though FreeBSD's port never did, and the code was deleted in r303763). Here's what I would do: 1) Add the F_FREESP command to fcntl(2). 2) Add a .fo_space field for struct fileops 3) Add a devfs_space method that implements .fo_space 4) Add a .d_space field to struct cdevsw 5) Add a g_dev_space method for GEOM that implements .d_space using BIO_DELETE. 6) Add a VOP_SPACE vop 7) Implement VOP_SPACE for tmpfs 8) Add aio_freesp(2), an asynchronous version of fcntl(F_FREESP). The greatest beneficiaries of this work would be type 2 hypervisors like QEMU and VirtualBox with guests that use TRIM, and userland filesystems such as fusefs-ext2 and fusefs-exfat. High-performance storage systems using SPDK would also benefit. The last item, aio_freesp(2), may seem unnecessary but it would really benefit my application. Questions, objections, flames? -Alan [1] https://lists.freebsd.org/pipermail/freebsd-fs/2011-March/010881.html From owner-freebsd-fs@freebsd.org Tue Nov 13 22:50:49 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C78EC1135317 for ; Tue, 13 Nov 2018 22:50:48 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-it1-x129.google.com (mail-it1-x129.google.com [IPv6:2607:f8b0:4864:20::129]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B7C0E7C777 for ; Tue, 13 Nov 2018 22:50:47 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-it1-x129.google.com with SMTP id t189-v6so14644309itf.1 for ; Tue, 13 Nov 2018 14:50:47 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=Ws4zhpBlCIfAr0x3JvA2o1yRCxRrylKMoR6MwFPBvaE=; b=1R+KTNqoF1Z4nStNPyYG7CucyA2U+za7fsnNc3kheEpPciZIPQdOeFLzaS6+n//J60 HkBg+Or22y8O0VpoxKN0JbTrpyBMyPPQiubvrx0xSnI+7goCblXqzzt93fxn8JhcOm13 gelIb4gGLhpdy3XNBXKi/tR2SxFIk/l8DG/fOJ9p+kpEwIGRth5tCEVikXTYrhHLmIJW FdpISED3upbDFP9SB6SQSpQ1nfKd2bVLqRuHVcVDibd2JihJpLY2PcTucMYdMi0Mdkpz hHOq/ntYFjrRW9BjKWYBrA01guXDnXENkLsZ30dUoYxsQlo1vVXAa6ks0aQ6Vq+tsUxL jI2g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=Ws4zhpBlCIfAr0x3JvA2o1yRCxRrylKMoR6MwFPBvaE=; b=uU7NwO0czMgNn/BY/wgjSfJBfwDCCHU166pgpnex9aWmuIdSB+1V16+24C5xtKQHgi En/Bfq+wa6xQIvLHKLeXbgEZKrUccLWBenh/sMsJNc5mvKutlIqVJV/GUc+plcIR3Col cUvyncpmqvIYVfa7xNtULOxs0yDUSpkiHbFWyL0j/2fiPdA8IK0W5iiU5W+Wtl6k4/IS /G3iI5zmTjkwlFD+E56euANZ/OYaOEesq9s4grrddzVngqgmFLWQBrxWdTM9YBvriJGX CP/r8sAwTqtPkLmy/o6GtGIvQ3tp+7kOLM/mI3kaHlxVsZm2uJZvy3seYz5XfrZn00hY SgBQ== X-Gm-Message-State: AGRZ1gKVqWTC5MjkmZm1QMpYE/OBjV+CiM2u47bpFKEk71NA9JzxLv0L 3ufE8OsKmNCKEk2EMHCuM/SKrDNmS1E9pyCDNBbh2Q== X-Google-Smtp-Source: AJdET5cadNmAB1aQwTMDeQsVM8FPmwqWdweg09TChImN/MG1LLTwFQJbtIaUDzfr2Dbiof3Aak0RpVrTeJjhBuiB3VQ= X-Received: by 2002:a24:eb0b:: with SMTP id h11-v6mr5341529itj.47.1542149446783; Tue, 13 Nov 2018 14:50:46 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Warner Losh Date: Tue, 13 Nov 2018 15:50:35 -0700 Message-ID: Subject: Re: Hole-punching, TRIM, etc To: Alan Somers Cc: "freebsd-arch@freebsd.org" , FreeBSD FS , FreeBSD Current X-Rspamd-Queue-Id: B7C0E7C777 X-Spamd-Result: default: False [-5.41 / 200.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20150623.gappssmtp.com]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20150623.gappssmtp.com:+]; MX_GOOD(-0.01)[cached: ALT1.aspmx.l.google.com]; RCVD_IN_DNSWL_NONE(0.00)[9.2.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; NEURAL_HAM_SHORT(-0.98)[-0.977,0]; R_SPF_NA(0.00)[]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; RCVD_TLS_LAST(0.00)[]; IP_SCORE(-2.42)[ip: (-7.21), ipnet: 2607:f8b0::/32(-2.89), asn: 15169(-1.92), country: US(-0.09)]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Nov 2018 22:50:49 -0000 On Tue, Nov 13, 2018 at 3:10 PM Alan Somers wrote: > Hole-punching has been discussed on these lists before[1]. It basically > means to turn a dense file into a sparse file by deallocating storage for > some of the blocks in the middle. There's no standard API for it. Linux > uses fallocate(2); Solaris and OSX add a new opcode to fcntl(2). > > A related concept is telling a block device that some blocks are no longer > used. SATA calls this "TRIM", SCSI calls it "UNMAP", NVMe calls it > "Deallocate", ZBC and ZAC call it "Reset Write Pointer". They all do > basically the same thing, and it's analogous to hole-punching for regular > files. They are also all inaccessible from FreeBSD's userland except by > using pass(4), which is inconvenient and protocol-specific. > > Linux has a BLKDISCARD ioctl for issuing TRIM-like commands from userland, > but it's totally undocumented and doesn't work on regular files. > > I propose adding support for all of these things using the fcntl(2) API. > Using the same syntax that Solaris defined, you would be able to punch a > hole in a regular file or TRIM blocks from an SSD. ZFS already supports it > (though FreeBSD's port never did, and the code was deleted in r303763). > Here's what I would do: > > 1) Add the F_FREESP command to fcntl(2). > 2) Add a .fo_space field for struct fileops > 3) Add a devfs_space method that implements .fo_space > 4) Add a .d_space field to struct cdevsw > 5) Add a g_dev_space method for GEOM that implements .d_space using > BIO_DELETE. > 6) Add a VOP_SPACE vop > 7) Implement VOP_SPACE for tmpfs > 8) Add aio_freesp(2), an asynchronous version of fcntl(F_FREESP). > > The greatest beneficiaries of this work would be type 2 hypervisors like > QEMU and VirtualBox with guests that use TRIM, and userland filesystems > such as fusefs-ext2 and fusefs-exfat. High-performance storage systems > using SPDK would also benefit. The last item, aio_freesp(2), may seem > unnecessary but it would really benefit my application. > > Questions, objections, flames? > So the fcntl would deallocate blocks from a filesystem only. The filesystem may issue BIO_DELETE as a result, but that's up to the filesystem, correct? On a raw device it would be translated into a BIO_DELETE command directly, correct? Warner From owner-freebsd-fs@freebsd.org Tue Nov 13 22:51:55 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 03D1011355BA; Tue, 13 Nov 2018 22:51:55 +0000 (UTC) (envelope-from cse.cem@gmail.com) Received: from mail-io1-f65.google.com (mail-io1-f65.google.com [209.85.166.65]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6A01B7CA60; Tue, 13 Nov 2018 22:51:54 +0000 (UTC) (envelope-from cse.cem@gmail.com) Received: by mail-io1-f65.google.com with SMTP id r6-v6so7501029ioj.8; Tue, 13 Nov 2018 14:51:54 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:reply-to :from:date:message-id:subject:to:cc; bh=+PmeIs7zhpfoqy5mSMDcleez4OCZmHr4/DaKgEJgtmM=; b=czHGGn2GlZ9q0aVDLcW9FOk+mzVHdGEtauyTMcelEurB8qhIZVFw//mSOXbor7gDM5 P/11f3rnhB9g8iaPOAEUImZQe9t4Jyqs8Yf34lNLlAbJEzy2c7Cm5bv3N0H1ZdvFE2tF 4tH1rntE8D25UHeKDt97qmVLxj5xp7SaM/y0N9H37mW2GHlhx3pzIhZ3iAfZ45e8yKXs 2Fg31k/OmpOksQUkiP6Ruq3Hc1+muNlUi+g4iFelMRLfSN/BpeHsqThA2M446+qMBHUb CihbSe0WkUStwRPYB/N/AHz6WfpILe43Z10v1XdBD+T5ufbrmbu1+WdwizscLYAKtVbo /Dhw== X-Gm-Message-State: AGRZ1gKdF1/EF8ZPGrORpgcMbduIlJW//IewPWl2e0knDLh5Edsvdzyw CrTuEoK5Nz7SFvqkPX0b8fGXYSCG X-Google-Smtp-Source: AJdET5cR3tEbbKbErDV+4Ic0TxiSnOqcjbzm3WV1ETlka1uV8ZmW3Tk8Vsrygn5sFLNDCTTQn7bMfQ== X-Received: by 2002:a6b:bc86:: with SMTP id m128-v6mr4453692iof.212.1542149508211; Tue, 13 Nov 2018 14:51:48 -0800 (PST) Received: from mail-io1-f54.google.com (mail-io1-f54.google.com. [209.85.166.54]) by smtp.gmail.com with ESMTPSA id u68-v6sm5805177itd.1.2018.11.13.14.51.48 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 13 Nov 2018 14:51:48 -0800 (PST) Received: by mail-io1-f54.google.com with SMTP id w7so2584505iom.12; Tue, 13 Nov 2018 14:51:48 -0800 (PST) X-Received: by 2002:a6b:6119:: with SMTP id v25mr6119881iob.107.1542149507555; Tue, 13 Nov 2018 14:51:47 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: Reply-To: cem@freebsd.org From: Conrad Meyer Date: Tue, 13 Nov 2018 14:51:36 -0800 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Hole-punching, TRIM, etc To: Alan Somers Cc: "freebsd-arch@freebsd.org" , freebsd-fs , freebsd-current Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 6A01B7CA60 X-Spamd-Result: default: False [-4.03 / 200.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; HAS_REPLYTO(0.00)[cem@freebsd.org]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; REPLYTO_ADDR_EQ_FROM(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.93)[-0.926,0]; FORGED_SENDER(0.30)[cem@freebsd.org,csecem@gmail.com]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; TAGGED_FROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_NEQ_ENVFROM(0.00)[cem@freebsd.org,csecem@gmail.com]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; IP_SCORE(-1.10)[ipnet: 209.85.128.0/17(-3.47), asn: 15169(-1.92), country: US(-0.09)]; RCVD_IN_DNSWL_NONE(0.00)[65.166.85.209.list.dnswl.org : 127.0.5.0]; RWL_MAILSPIKE_POSSIBLE(0.00)[65.166.85.209.rep.mailspike.net : 127.0.0.17] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Nov 2018 22:51:55 -0000 Hi Alan, On Tue, Nov 13, 2018 at 2:10 PM Alan Somers wrote: > > Hole-punching has been discussed on these lists before[1]. It basically > means to turn a dense file into a sparse file by deallocating storage for > some of the blocks in the middle. There's no standard API for it. Linux > uses fallocate(2); Solaris and OSX add a new opcode to fcntl(2). > > A related concept is telling a block device that some blocks are no longer > used. SATA calls this "TRIM", SCSI calls it "UNMAP", NVMe calls it > "Deallocate", ZBC and ZAC call it "Reset Write Pointer". They all do > basically the same thing, and it's analogous to hole-punching for regular > files. They are also all inaccessible from FreeBSD's userland except by > using pass(4), which is inconvenient and protocol-specific. Geom devices have the DIOCGDELETE ioctl, which translates into BIO_DELETE (which is TRIM, as I understand it). It's available in libgeom as g_delete() and used by hastd, newfs_nandfs, and nandtool. > Linux has a BLKDISCARD ioctl for issuing TRIM-like commands from userland, > but it's totally undocumented and doesn't work on regular files. > > I propose adding support for all of these things using the fcntl(2) API. > Using the same syntax that Solaris defined, you would be able to punch a > hole in a regular file or TRIM blocks from an SSD. ZFS already supports it > (though FreeBSD's port never did, and the code was deleted in r303763). > Here's what I would do: > > 1) Add the F_FREESP command to fcntl(2). > 2) Add a .fo_space field for struct fileops > 3) Add a devfs_space method that implements .fo_space > 4) Add a .d_space field to struct cdevsw > 5) Add a g_dev_space method for GEOM that implements .d_space using > BIO_DELETE. > 6) Add a VOP_SPACE vop > 7) Implement VOP_SPACE for tmpfs > 8) Add aio_freesp(2), an asynchronous version of fcntl(F_FREESP). Why not just add DIOCGDELETE support to various VOP_IOCTL implementations? The file objects forward correctly through vn_ioctl to VOP_IOCTL for both regular files and devfs VCHR nodes. We can emulate the Linux API if we want to be compatible there, but I wouldn't bother with Solaris. Best, Conrad From owner-freebsd-fs@freebsd.org Tue Nov 13 22:52:59 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0817511357C3; Tue, 13 Nov 2018 22:52:58 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-lf1-f53.google.com (mail-lf1-f53.google.com [209.85.167.53]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2E8F17CD2D; Tue, 13 Nov 2018 22:52:58 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-lf1-f53.google.com with SMTP id b20so10083877lfa.12; Tue, 13 Nov 2018 14:52:58 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=ZK85MHLf8ksY8etL0PhkjbuwjI1pJ5lY+lQWrLz3F8M=; b=IQWi+OaheTkmYBao5MT7LwxvaVtSC6hXIyPnyu4/f/4AfWL3eoM9zPb0ryUXyVWFBj S0zvASIyUKu3WQVxYG+K2Rurkt1iaRScO3v7OME3RKqWSGjBP3hhgdZOdZ9YEqwwkDXv foGQcWQA+R9Vpi3SZPgsNyCi3WNw0IeAAvgv0kuNe2ItIQQl+PXeEDSk+Su/UGRoUOta ISWUcKjW8hXuEr7sUGgmcGR+nk8MNLYiZlEeSU3Y512EHuSrdgBXoD0gXzNF/4U/POXY GWkKXCnM1svCIRuqvhTLjrZ+zpZ24kvBb1iLmx057E6y5LE7noqeCTMI+B89JI9MLxcT 7aWQ== X-Gm-Message-State: AGRZ1gK3dfRiCHovLdPNCzKKYOlLjCxpoGB7HnWJCf/0G6nISTPmIiS1 fuMl9M5WxdltoosAFbGp93fcKKRS3kdyYRcXMT0= X-Google-Smtp-Source: AJdET5czx7NQnrqgZ9pOOzjLTTy4T92jKwtFHN/kNWaz2KeGw2ig9H0BqS7XSp/6UI5ZThwxo86DHbZJay1egIuGSgA= X-Received: by 2002:a19:c396:: with SMTP id t144mr3855397lff.110.1542149571269; Tue, 13 Nov 2018 14:52:51 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Alan Somers Date: Tue, 13 Nov 2018 15:52:39 -0700 Message-ID: Subject: Re: Hole-punching, TRIM, etc To: Warner Losh Cc: freebsd-arch@freebsd.org, freebsd-fs , FreeBSD CURRENT X-Rspamd-Queue-Id: 2E8F17CD2D X-Spamd-Result: default: False [-4.07 / 200.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[freebsd.org]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.97)[-0.968,0]; RCVD_IN_DNSWL_NONE(0.00)[53.167.85.209.list.dnswl.org : 127.0.5.0]; IP_SCORE(-1.10)[ipnet: 209.85.128.0/17(-3.47), asn: 15169(-1.91), country: US(-0.09)]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; RWL_MAILSPIKE_POSSIBLE(0.00)[53.167.85.209.rep.mailspike.net : 127.0.0.17]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Nov 2018 22:52:59 -0000 On Tue, Nov 13, 2018 at 3:51 PM Warner Losh wrote: > > > On Tue, Nov 13, 2018 at 3:10 PM Alan Somers wrote: > >> Hole-punching has been discussed on these lists before[1]. It basically >> means to turn a dense file into a sparse file by deallocating storage for >> some of the blocks in the middle. There's no standard API for it. Linux >> uses fallocate(2); Solaris and OSX add a new opcode to fcntl(2). >> >> A related concept is telling a block device that some blocks are no longer >> used. SATA calls this "TRIM", SCSI calls it "UNMAP", NVMe calls it >> "Deallocate", ZBC and ZAC call it "Reset Write Pointer". They all do >> basically the same thing, and it's analogous to hole-punching for regular >> files. They are also all inaccessible from FreeBSD's userland except by >> using pass(4), which is inconvenient and protocol-specific. >> >> Linux has a BLKDISCARD ioctl for issuing TRIM-like commands from userland, >> but it's totally undocumented and doesn't work on regular files. >> >> I propose adding support for all of these things using the fcntl(2) API. >> Using the same syntax that Solaris defined, you would be able to punch a >> hole in a regular file or TRIM blocks from an SSD. ZFS already supports >> it >> (though FreeBSD's port never did, and the code was deleted in r303763). >> Here's what I would do: >> >> 1) Add the F_FREESP command to fcntl(2). >> 2) Add a .fo_space field for struct fileops >> 3) Add a devfs_space method that implements .fo_space >> 4) Add a .d_space field to struct cdevsw >> 5) Add a g_dev_space method for GEOM that implements .d_space using >> BIO_DELETE. >> 6) Add a VOP_SPACE vop >> 7) Implement VOP_SPACE for tmpfs >> 8) Add aio_freesp(2), an asynchronous version of fcntl(F_FREESP). >> >> The greatest beneficiaries of this work would be type 2 hypervisors like >> QEMU and VirtualBox with guests that use TRIM, and userland filesystems >> such as fusefs-ext2 and fusefs-exfat. High-performance storage systems >> using SPDK would also benefit. The last item, aio_freesp(2), may seem >> unnecessary but it would really benefit my application. >> >> Questions, objections, flames? >> > > So the fcntl would deallocate blocks from a filesystem only. The > filesystem may issue BIO_DELETE as a result, but that's up to the > filesystem, correct? > Correct. > > On a raw device it would be translated into a BIO_DELETE command directly, > correct? > Correct, modulo edge cases. > > Warner > From owner-freebsd-fs@freebsd.org Tue Nov 13 22:58:48 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E293F1135C0B; Tue, 13 Nov 2018 22:58:47 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-lj1-f176.google.com (mail-lj1-f176.google.com [209.85.208.176]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2FEB47D331; Tue, 13 Nov 2018 22:58:47 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-lj1-f176.google.com with SMTP id z80-v6so12393409ljb.8; Tue, 13 Nov 2018 14:58:47 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=DPf/CmtPspLOBYHDGh2sS9n6Y0SVtBnwrdowwYhItZM=; b=BpBJK9R1xttSJT/keHXAH8MEM2cltEiVaoTZ21iId+iWx8/1SztvUmjsjoANzr/tHK 4oTtSJ18IwmwESH5ZyyCgKyP1cWuhtIL188XHwnpcEf65VM1KU01nwXkItDwpPuqdIXO +NTnS1W75n4yjwtDvh5veus8G4GA74VdUrjUlFXHpSq13qpDSyyogx0WZaP5mt9EpD1f GErts28fxym3DeBeX1wKgzCNhUJ74cK1EsjDjB90uLV6nHLFbUHBqm7Oq5ayDz59RnIh o08gUUZacAblqEiNOWmfhyVWkDPNi2Z2MWeSNCdKQ/vYNuEgNBOD4rH9Pbnrf6g+FF0w A97Q== X-Gm-Message-State: AGRZ1gIpIHEGXcwUYG+ZXLBzDkKYDlMORvZEeJcMyZv/28WLeDFe94vr AY5rW4HWyxJuFtMeM26bk1xd9ZM7dRFhEhlzL1iZqQ== X-Google-Smtp-Source: AJdET5fuShSOKx89sTzrkUQgE/J5ru2Muf3WOGoXRSpQmEVHfwxp8uRnFpK0hX+D9WBeHYMK1CQipXkC/E07ZH1uPzM= X-Received: by 2002:a2e:9356:: with SMTP id m22-v6mr4156127ljh.135.1542149918206; Tue, 13 Nov 2018 14:58:38 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Alan Somers Date: Tue, 13 Nov 2018 15:58:26 -0700 Message-ID: Subject: Re: Hole-punching, TRIM, etc To: "Conrad E. Meyer" Cc: freebsd-arch@freebsd.org, freebsd-fs , FreeBSD CURRENT X-Rspamd-Queue-Id: 2FEB47D331 X-Spamd-Result: default: False [-4.07 / 200.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[freebsd.org]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; IP_SCORE(-1.09)[ipnet: 209.85.128.0/17(-3.46), asn: 15169(-1.91), country: US(-0.09)]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.97)[-0.968,0]; RCVD_IN_DNSWL_NONE(0.00)[176.208.85.209.list.dnswl.org : 127.0.5.0]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Nov 2018 22:58:48 -0000 On Tue, Nov 13, 2018 at 3:51 PM Conrad Meyer wrote: > Hi Alan, > > On Tue, Nov 13, 2018 at 2:10 PM Alan Somers wrote: > > > > Hole-punching has been discussed on these lists before[1]. It basically > > means to turn a dense file into a sparse file by deallocating storage for > > some of the blocks in the middle. There's no standard API for it. Linux > > uses fallocate(2); Solaris and OSX add a new opcode to fcntl(2). > > > > A related concept is telling a block device that some blocks are no > longer > > used. SATA calls this "TRIM", SCSI calls it "UNMAP", NVMe calls it > > "Deallocate", ZBC and ZAC call it "Reset Write Pointer". They all do > > basically the same thing, and it's analogous to hole-punching for regular > > files. They are also all inaccessible from FreeBSD's userland except by > > using pass(4), which is inconvenient and protocol-specific. > > Geom devices have the DIOCGDELETE ioctl, which translates into > BIO_DELETE (which is TRIM, as I understand it). It's available in > libgeom as g_delete() and used by hastd, newfs_nandfs, and nandtool. > Ahh, I thought there must be such a thing, but I couldn't find it. > > > Linux has a BLKDISCARD ioctl for issuing TRIM-like commands from > userland, > > but it's totally undocumented and doesn't work on regular files. > > > > I propose adding support for all of these things using the fcntl(2) API. > > Using the same syntax that Solaris defined, you would be able to punch a > > hole in a regular file or TRIM blocks from an SSD. ZFS already supports > it > > (though FreeBSD's port never did, and the code was deleted in r303763). > > Here's what I would do: > > > > 1) Add the F_FREESP command to fcntl(2). > > 2) Add a .fo_space field for struct fileops > > 3) Add a devfs_space method that implements .fo_space > > 4) Add a .d_space field to struct cdevsw > > 5) Add a g_dev_space method for GEOM that implements .d_space using > > BIO_DELETE. > > 6) Add a VOP_SPACE vop > > 7) Implement VOP_SPACE for tmpfs > > 8) Add aio_freesp(2), an asynchronous version of fcntl(F_FREESP). > > Why not just add DIOCGDELETE support to various VOP_IOCTL > implementations? The file objects forward correctly through vn_ioctl > to VOP_IOCTL for both regular files and devfs VCHR nodes. > > We can emulate the Linux API if we want to be compatible there, but I > wouldn't bother with Solaris. > The only reason that I prefer the Solaris API is because it doesn't require adding another syscall, and because Linux's fallocate(2) does a whole bunch of other things besides hole-punching. What about an asynchronous version? ioctl(2) is still synchronous. Do you see any better way to hole-punch/TRIM asynchronously than with aio? > > Best, > Conrad > From owner-freebsd-fs@freebsd.org Tue Nov 13 22:58:57 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9B4101135C8C for ; Tue, 13 Nov 2018 22:58:57 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-io1-xd36.google.com (mail-io1-xd36.google.com [IPv6:2607:f8b0:4864:20::d36]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id CD96D7D3ED for ; Tue, 13 Nov 2018 22:58:56 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-io1-xd36.google.com with SMTP id b26-v6so9618392ioc.6 for ; Tue, 13 Nov 2018 14:58:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=CqMUpo493atzjgSsixYS/AHpw8MT4SJMAwHthPoo5oI=; b=eQOOhp1HL/CWvF3DBRFGqOp99pDToSgvqqzefes/wNDYPLo1yxHxnvQiXh1a1wUBXM IYnhDxwMzUvvaDW6Rvk6zw1MfDChRam6SNTXQO3cET1gwIJWN1m7fi2kVgUYF5f7b39c h8X4nW4mwgxJ3EBsKGQgzCsHPav8MlCyASO0tbONpW5Dh/bJs6HYfkD4XjHYPtT0VecU 2GlZKhm2ckgl2zZlnT1FYTWOT4/c4zIrOVBH39+NR/5pQIPrRYzCUvcsiIMrlHlcbRpB eUkjro2DfkHiAMxIyIguJGDWPBVZadXsMss5XIJkiiy8b7fLBwQtd5Aj9XjgmNcAt4EZ GR/g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=CqMUpo493atzjgSsixYS/AHpw8MT4SJMAwHthPoo5oI=; b=qaG8NIouWSYFmSCSwa7hVkLFG2Y9Aaa33lTaCj3T5uV+JxbNrHlV3QD1DqVsXtcaIH lZ+SSc80V5zFBXdvuW2w55zXNDQj2TzURUrpxRsJ3UheVI2v1WAA8MS87setY7CnNsLh sYqqWsGarGnHYyI6Ikua5ZJXX1OcdTb5zEHfbPma6+4FTR4jd4bl/mtnC5+YTF4Oo1d6 F4mFwmHLic6qzFyr6DAlpA9IQbFcNyWejbQLaNZhDDtFxP1JqyNtJsfTKFdeCAwCXwM9 LOLliZsdirY2MGibAFGup1GiS+gKax6F4Z7lUbdcPvJ54/d0k5ji62Y2PH2nkWmVE5Rs UHhw== X-Gm-Message-State: AGRZ1gIYwHnzyVR7QS1yAdJpTBagAyHkJPJS9y6PrfFJZp8ThWiax/p/ w8omkbd1VG03LEF5xw2w4y+Bbi09Q5aSyjNvSLKxJA== X-Google-Smtp-Source: AJdET5eu+7U4suaKglvNO4F0FtxTdgyrK2kOm2p4KnXNUA3T2fuVwgL45Duoe4g7HSmZz15N79zKm6ZMBEoaEuMgxkE= X-Received: by 2002:a6b:7809:: with SMTP id j9-v6mr5562930iom.299.1542149936083; Tue, 13 Nov 2018 14:58:56 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Warner Losh Date: Tue, 13 Nov 2018 15:58:45 -0700 Message-ID: Subject: Re: Hole-punching, TRIM, etc To: "Conrad E. Meyer" Cc: Alan Somers , FreeBSD FS , FreeBSD Current , "freebsd-arch@freebsd.org" X-Rspamd-Queue-Id: CD96D7D3ED X-Spamd-Result: default: False [-3.94 / 200.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20150623.gappssmtp.com]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; RCPT_COUNT_FIVE(0.00)[5]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20150623.gappssmtp.com:+]; MX_GOOD(-0.01)[cached: ALT1.aspmx.l.google.com]; RCVD_IN_DNSWL_NONE(0.00)[6.3.d.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; NEURAL_HAM_SHORT(-0.95)[-0.950,0]; R_SPF_NA(0.00)[]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; RCVD_TLS_LAST(0.00)[]; IP_SCORE(-0.98)[ipnet: 2607:f8b0::/32(-2.88), asn: 15169(-1.91), country: US(-0.09)]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Nov 2018 22:58:57 -0000 On Tue, Nov 13, 2018 at 3:52 PM Conrad Meyer wrote: > Geom devices have the DIOCGDELETE ioctl, which translates into > BIO_DELETE (which is TRIM, as I understand it). > Correct. TRIM is both the catch-all term people use, as well as the name of a specific DSM (data set management) command in the ATA command set. All FLASH technologies have it (thought what it means under the covers varies a bit). Thin provisioned resources like in VMs also have it. Warner From owner-freebsd-fs@freebsd.org Tue Nov 13 22:59:46 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 49EA81135D55; Tue, 13 Nov 2018 22:59:46 +0000 (UTC) (envelope-from phk@critter.freebsd.dk) Received: from phk.freebsd.dk (phk.freebsd.dk [130.225.244.222]) by mx1.freebsd.org (Postfix) with ESMTP id B331F7D581; Tue, 13 Nov 2018 22:59:45 +0000 (UTC) (envelope-from phk@critter.freebsd.dk) Received: from critter.freebsd.dk (unknown [192.168.55.3]) by phk.freebsd.dk (Postfix) with ESMTP id 11E4A14860; Tue, 13 Nov 2018 22:59:45 +0000 (UTC) Received: from critter.freebsd.dk (localhost [127.0.0.1]) by critter.freebsd.dk (8.15.2/8.15.2) with ESMTPS id wADMxirQ004237 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Tue, 13 Nov 2018 22:59:44 GMT (envelope-from phk@critter.freebsd.dk) Received: (from phk@localhost) by critter.freebsd.dk (8.15.2/8.15.2/Submit) id wADMxieR004236; Tue, 13 Nov 2018 22:59:44 GMT (envelope-from phk) To: Warner Losh cc: Alan Somers , FreeBSD FS , FreeBSD Current , "freebsd-arch@freebsd.org" Subject: Re: Hole-punching, TRIM, etc In-reply-to: From: "Poul-Henning Kamp" References: MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-ID: <4234.1542149984.1@critter.freebsd.dk> Content-Transfer-Encoding: quoted-printable Date: Tue, 13 Nov 2018 22:59:44 +0000 Message-ID: <4235.1542149984@critter.freebsd.dk> X-Rspamd-Queue-Id: B331F7D581 X-Spamd-Result: default: False [0.71 / 200.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-0.17)[-0.173,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_SPAM_SHORT(0.08)[0.076,0]; NEURAL_HAM_LONG(-0.48)[-0.481,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.dk]; AUTH_NA(1.00)[]; RCPT_COUNT_FIVE(0.00)[5]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: phk.freebsd.dk]; R_SPF_NA(0.00)[]; FORGED_SENDER(0.30)[phk@phk.freebsd.dk,phk@critter.freebsd.dk]; RCVD_NO_TLS_LAST(0.10)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-0.00)[country: EU(-0.00)]; ASN(0.00)[asn:1835, ipnet:130.225.0.0/16, country:EU]; FROM_NEQ_ENVFROM(0.00)[phk@phk.freebsd.dk,phk@critter.freebsd.dk] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Nov 2018 22:59:46 -0000 -------- In message , Warner Losh writes: >On a raw device it would be translated into a BIO_DELETE command directly= , >correct? We already have ioctl(DIOCGDELETE) for that. newfs(8) uses it. -- = Poul-Henning Kamp | UNIX since Zilog Zeus 3.20 phk@FreeBSD.ORG | TCP/IP since RFC 956 FreeBSD committer | BSD since 4.3-tahoe = Never attribute to malice what can adequately be explained by incompetence= . From owner-freebsd-fs@freebsd.org Tue Nov 13 23:09:05 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5F99E113658B; Tue, 13 Nov 2018 23:09:05 +0000 (UTC) (envelope-from cse.cem@gmail.com) Received: from mail-it1-f179.google.com (mail-it1-f179.google.com [209.85.166.179]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9D92B7E388; Tue, 13 Nov 2018 23:09:04 +0000 (UTC) (envelope-from cse.cem@gmail.com) Received: by mail-it1-f179.google.com with SMTP id v11so21183381itj.0; Tue, 13 Nov 2018 15:09:04 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:reply-to :from:date:message-id:subject:to:cc:content-transfer-encoding; bh=9stKphtTKlpfIWzZb+DMF+rZL4fj6TT/NCpcLOJ/7BA=; b=HrGqAB+OdmOXMmjltowy9196FACbdzsUom2W9Vj9Z1pPn6oa27yTzetGIfDPfQCEvj qeT1AO4yWAbwjJ1jBDoYADUW7jdKwt3b/jiUazfqwOx77FJrUQUTlxzJvz8PIk3aojNo E+om/W9QiscLWt/9paG5sqrqm0MCD+HG3DXc10SVTPT3VbSxgYRjIFQ7STvxFCZuiNCB dq5OmKLa6pqSOKqHRyIiIRV3yivw5Z2fPny9gbsleVlwjCSqlreIcWHAwd9slcDd0UjB 0vAq+toyX0g5Cenbm1cS57LFr7ffhtVSLL3AGVuF/TlE0YVsn/EoVWcrPKw37fPHgHY3 wCPA== X-Gm-Message-State: AGRZ1gIMhUVt7RTFkc6Vk18ExU/mLxh/f/hpvKXXqYC09hYuURh+3s5E q2uCwHymAFIf27rO7SKhCIWLTIqb X-Google-Smtp-Source: AJdET5eFJzKMYLTriBR2sKkjueOV5D2rIGNuIXTNiNCkHl+xPT2zC6mWTIDsilVkfm3+rekJqFvvxA== X-Received: by 2002:a02:12c5:: with SMTP id 66mr6091541jap.54.1542150543558; Tue, 13 Nov 2018 15:09:03 -0800 (PST) Received: from mail-io1-f41.google.com (mail-io1-f41.google.com. [209.85.166.41]) by smtp.gmail.com with ESMTPSA id n24-v6sm2786499ioc.65.2018.11.13.15.09.03 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 13 Nov 2018 15:09:03 -0800 (PST) Received: by mail-io1-f41.google.com with SMTP id h4so6178227iom.5; Tue, 13 Nov 2018 15:09:03 -0800 (PST) X-Received: by 2002:a6b:6119:: with SMTP id v25mr6169014iob.107.1542150542921; Tue, 13 Nov 2018 15:09:02 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: Reply-To: cem@freebsd.org From: Conrad Meyer Date: Tue, 13 Nov 2018 15:08:51 -0800 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Hole-punching, TRIM, etc To: Alan Somers Cc: "freebsd-arch@freebsd.org" , freebsd-fs , freebsd-current Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 9D92B7E388 X-Spamd-Result: default: False [-4.05 / 200.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; HAS_REPLYTO(0.00)[cem@freebsd.org]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; REPLYTO_ADDR_EQ_FROM(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.95)[-0.949,0]; FORGED_SENDER(0.30)[cem@freebsd.org,csecem@gmail.com]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; TAGGED_FROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_NEQ_ENVFROM(0.00)[cem@freebsd.org,csecem@gmail.com]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; IP_SCORE(-1.09)[ipnet: 209.85.128.0/17(-3.45), asn: 15169(-1.90), country: US(-0.09)]; RCVD_IN_DNSWL_NONE(0.00)[179.166.85.209.list.dnswl.org : 127.0.5.0] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Nov 2018 23:09:05 -0000 On Tue, Nov 13, 2018 at 2:59 PM Alan Somers wrote: > > On Tue, Nov 13, 2018 at 3:51 PM Conrad Meyer wrote: >> >> On Tue, Nov 13, 2018 at 2:10 PM Alan Somers wrote: >> > ... >> > 8) Add aio_freesp(2), an asynchronous version of fcntl(F_FREESP). >> >> Why not just add DIOCGDELETE support to various VOP_IOCTL >> implementations? The file objects forward correctly through vn_ioctl >> to VOP_IOCTL for both regular files and devfs VCHR nodes. >> >> We can emulate the Linux API if we want to be compatible there, but I >> wouldn't bother with Solaris. > > The only reason that I prefer the Solaris API is because it doesn't requi= re adding another syscall, and because Linux's fallocate(2) does a whole bu= nch of other things besides hole-punching. I am imagining that if we went this route, we would implement Linux fallocate as a library shim around the native FreeBSD ioctl (or whatever) rather than an independent system call. This would be for API compatibility, not ABI compatibility. But Linux compat can be set aside for now, I think =E2=80=94 it's a secondary concern. > What about an asynchronous version? ioctl(2) is still synchronous. Do y= ou see any better way to hole-punch/TRIM asynchronously than with aio? Yeah, this is a good consideration. No, I don't have any better suggestion for an asynchronous API. In general our VOPs tend to be synchronous. Aio does seem like the logical home for a new asynchronous API. Best regards, Conrad From owner-freebsd-fs@freebsd.org Wed Nov 14 17:04:32 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D6F4A112E6E2 for ; Wed, 14 Nov 2018 17:04:32 +0000 (UTC) (envelope-from Albert.Shih@obspm.fr) Received: from mx-p1.obspm.fr (mx-p1.obspm.fr [145.238.193.20]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "*.obspm.fr", Issuer "TERENA SSL CA 3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 37AF57FF58 for ; Wed, 14 Nov 2018 17:04:30 +0000 (UTC) (envelope-from Albert.Shih@obspm.fr) Received: from io.chezmoi.fr (io-p2.obspm.fr [145.238.197.205]) (authenticated bits=0) by mx-p1.obspm.fr (8.14.4/8.14.4/DIO Observatoire de Paris - 15/04/10) with ESMTP id wAEH2fKQ001213 (version=TLSv1/SSLv3 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Wed, 14 Nov 2018 18:02:42 +0100 Date: Wed, 14 Nov 2018 18:02:41 +0100 From: Albert Shih To: freebsd-fs@freebsd.org Subject: Some issue with ZFS Message-ID: <20181114170241.GD11480@io.chezmoi.fr> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit User-Agent: Mutt/1.10.1 (2018-07-13) X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.5.11 (mx-p1.obspm.fr [145.238.193.20]); Wed, 14 Nov 2018 18:02:42 +0100 (CET) X-Virus-Scanned: clamav-milter 0.100.2 at mx-p1.obspm.fr X-Virus-Status: Clean X-Rspamd-Queue-Id: 37AF57FF58 X-Spamd-Result: default: False [-2.46 / 200.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.998,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-0.996,0]; DMARC_NA(0.00)[obspm.fr]; NEURAL_SPAM_SHORT(0.25)[0.245,0]; RCVD_IN_DNSWL_MED(-0.20)[20.193.238.145.list.dnswl.org : 127.0.11.2]; MX_GOOD(-0.01)[mx-p1.obspm.fr,mx-m2.obspm.fr]; IP_SCORE(-0.20)[asn: 2200(-0.96), country: FR(-0.03)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:2200, ipnet:145.238.0.0/16, country:FR]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 14 Nov 2018 17:04:33 -0000 Hi, I'm running a server with FreeBSD 11.2-Release-p1. The only goal of this server is for storage, so the server got a lot (384Go) of RAM, and some (28x10To) of disk (going to increase soon to 84) Some zfs dataset are fill up with rsync. Some zfs dataset are fill up with zfs send/received Before this version of FreeBSD I already notice from time to time a dataset fill up with zfs send/received can just disapear. With FreeBSD 11.2 it's a little better, the dataset going not mounted, just need to umount and remount. So I've no idea why, and I'm totally unable to reproduce the problem. Is anyone have already experience this kind of problem ? Regards -- Albert SHIH DIO bâtiment 15 Observatoire de Paris xmpp: jas@obspm.fr Heure local/Local time: Wed Nov 14 17:53:11 CET 2018 From owner-freebsd-fs@freebsd.org Wed Nov 14 18:55:57 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3BF9B113180E for ; Wed, 14 Nov 2018 18:55:57 +0000 (UTC) (envelope-from mdesroch@hotmail.com) Received: from NAM02-SN1-obe.outbound.protection.outlook.com (mail-oln040092005097.outbound.protection.outlook.com [40.92.5.97]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5EB988531A for ; Wed, 14 Nov 2018 18:55:56 +0000 (UTC) (envelope-from mdesroch@hotmail.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hotmail.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=22jH7tADw6idLmjuZM0M+JAZqS072Ni8AmCfDwxnneA=; b=HbYZb1C5qC2VPBvbisyt7wHMahwFC9pMkeggHHZsGc/7loeitofz0MQu5UsWHsmzGmUkZqBtbNOhL2X0GaVzUNSlIddSGj935DlQaZ2GKosstbp3Rn3Em18RjfSxEn6+IY2a6/4cFINiDBcYdBOTHzZUSf5804OsMm/YooWDJyMEYaHZuABV4FTFLp/PrVSC1grKaOyWYUuZJ+ASYfTg54Pm5Q6Q/clpU7Z7ndjBgGsgOn1hGJ2jbsmXBkQgk33oJDBXivFl1nbVGWuHAydyVo/720bquHch6igNUnBB/yh4CK83sQlaJc0Y0eCTbG/IDuQLddRQbTs85IF1jXw+wg== Received: from SN1NAM02FT034.eop-nam02.prod.protection.outlook.com (10.152.72.59) by SN1NAM02HT243.eop-nam02.prod.protection.outlook.com (10.152.73.204) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.1339.15; Wed, 14 Nov 2018 18:55:55 +0000 Received: from DM5PR22MB0297.namprd22.prod.outlook.com (10.152.72.51) by SN1NAM02FT034.mail.protection.outlook.com (10.152.72.141) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.1339.15 via Frontend Transport; Wed, 14 Nov 2018 18:55:54 +0000 Received: from DM5PR22MB0297.namprd22.prod.outlook.com ([fe80::f151:a569:c8cd:83d2]) by DM5PR22MB0297.namprd22.prod.outlook.com ([fe80::f151:a569:c8cd:83d2%6]) with mapi id 15.20.1294.045; Wed, 14 Nov 2018 18:55:54 +0000 From: Mathieu To: "freebsd-fs@freebsd.org" Subject: Mount RW /var below RO / Thread-Topic: Mount RW /var below RO / Thread-Index: AQHUfEurZO0dv68iw0O8+p29GCGNYA== Date: Wed, 14 Nov 2018 18:55:54 +0000 Message-ID: Accept-Language: en-CA, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-clientproxiedby: BN6PR19CA0052.namprd19.prod.outlook.com (2603:10b6:404:e3::14) To DM5PR22MB0297.namprd22.prod.outlook.com (2603:10b6:3:a8::17) x-incomingtopheadermarker: OriginalChecksum:A3FC55E0F1B455A5D9429F06DF083730389974BBD8C544C46C0034084E305DA3; UpperCasedChecksum:B967D888606161B060CDCE83431F0E6A0D0EECB918AA68D867DC0196002C5304; SizeAsReceived:7229; Count:47 x-ms-exchange-messagesentrepresentingtype: 1 x-tmn: [cr2e0g+tfZEuVWE6CHYhjQCDTqdXgjGI] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; SN1NAM02HT243; 6:aDPHU/ctShacKIIn2yhrd3J8kRy8xrTltfO++1Oj5Qhy3+lfFlcR34Zg1BOPH9RzhFS2bZDyxG/Hz0I1ouBtL+8no31VIyX+/u1bO9e3dX9M3qR3B8uljgsFlGzFi9iwwiVmX/w5vpyoZG5WwGRslYYqYPsPIiU7mujc9CGb1FEKDFKL0AfgzPUqneBIXNZbwW5VycLOlE09gmPaBX/w6VtCpc/dUHhFpUwqtj0w+npuRWyjEo5p3GgQrOhkiGtCOMgpcUMH4UTdFeEUjrCmJl5V8q67HQQE7k+KhGsHFQ4njObvKyiLcz9zyayx9QPhCQxnTikr/QGkgnH1q5r1F8d6bPw2R1lknBSh0u2Ej3vPcVWq4trVUvDhIm2IVUi8oz7AiJbbS8HsGD/tLoCNvmT/jmOjdFT2NuNz+AoT8GByJj9dHYiAUVVU5pWRl4vMLuEfg5hDePiIsV3CcxEHYw==; 5:3prf396m16YSR/i8G2/PRTYGU3VYByneM43l6FxQdjivne5cEFEiX8TjLCFs5FomcGLkq/33eJ2s39OrZaJcrf80ghmmKhf4BnFGAvgO+60rdOSdeaHojtEyBMMaU1GQ8BFzppau6/uED2nQDENYq3veojKnGIFlYL4cjDkrctE=; 7:DgSEcsJA+qqQvH9EhIVsbgAciR+jrtDT9rqEcsMm9frfvTfIvlSSEBB/97a/s/wt9YYK/OFbDQTplXXQl4Y6UifIMXhilGqhw5bDLNdntj7U3gwrizGdPj/S+5qypijH3Bs8OSktby7dfKwRKwsvmQ== x-incomingheadercount: 47 x-eopattributedmessage: 0 x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390098)(7020095)(201702061078)(5061506573)(5061507331)(1603103135)(2017031320274)(2017031324274)(2017031323274)(2017031322404)(1603101475)(1601125500)(1701031045); SRVR:SN1NAM02HT243; x-ms-traffictypediagnostic: SN1NAM02HT243: x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(4566010)(82015058); SRVR:SN1NAM02HT243; BCL:0; PCL:0; RULEID:; SRVR:SN1NAM02HT243; x-microsoft-antispam-message-info: vhqI5iJpUu2hViqMEmPBWq3mVeyQy+/7JKUulQn7FQdjfto/Ey6Hin2c5R/O9/lv MIME-Version: 1.0 X-OriginatorOrg: hotmail.com X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 9bd8b953-1c55-4da7-b616-8bcad099ae8b X-MS-Exchange-CrossTenant-Network-Message-Id: a688c06c-5d64-4bda-4a46-08d64a62cd89 X-MS-Exchange-CrossTenant-rms-persistedconsumerorg: 9bd8b953-1c55-4da7-b616-8bcad099ae8b X-MS-Exchange-CrossTenant-originalarrivaltime: 14 Nov 2018 18:55:54.6840 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Internet X-MS-Exchange-CrossTenant-id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN1NAM02HT243 X-Rspamd-Queue-Id: 5EB988531A X-Spamd-Result: default: False [-4.18 / 200.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[hotmail.com]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.92.0.0/14]; FREEMAIL_FROM(0.00)[hotmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[hotmail.com:+]; MIME_BASE64_TEXT(0.10)[]; DMARC_POLICY_ALLOW(-0.50)[hotmail.com,none]; MX_GOOD(-0.01)[cached: hotmail-com.olc.protection.outlook.com]; TO_DN_EQ_ADDR_ALL(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[97.5.92.40.list.dnswl.org : 127.0.3.0]; NEURAL_HAM_SHORT(-0.61)[-0.605,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[hotmail.com]; ASN(0.00)[asn:8075, ipnet:40.64.0.0/10, country:US]; IP_SCORE(-0.66)[ipnet: 40.64.0.0/10(-1.36), asn: 8075(-1.85), country: US(-0.10)] X-Rspamd-Server: mx1.freebsd.org Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 14 Nov 2018 18:55:57 -0000 SGkgZ3V5cywNCg0KR2l2ZW4gYSBSTyByb290IHBhcnRpdGlvbiwgY2FuIG9uZSBwcm9jZWVkIHRv IG1vdW50IGEgUlcgcGFydGl0aW9uIHRvIC92YXIgPyBPciBpcyB0aGlzIGZvcmJpZGRlbiBieSB0 aGUgcmVhZG9ubHluZXNzIG9mIC8gPyBXYXMgcGxhbm5pbmcgdG8gZG8gc28gdXNpbmcgZnN0YWIu DQoNClRoYW5rcy4NCg== From owner-freebsd-fs@freebsd.org Wed Nov 14 19:15:42 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A97B4113225F for ; Wed, 14 Nov 2018 19:15:42 +0000 (UTC) (envelope-from karli@inparadise.se) Received: from mail.inparadise.se (h-112-105.A444.priv.bahnhof.se [158.174.112.105]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id CE63C8627F for ; Wed, 14 Nov 2018 19:15:41 +0000 (UTC) (envelope-from karli@inparadise.se) Received: from localhost (localhost [127.0.0.1]) by mail.inparadise.se (Postfix) with ESMTP id B05A043761 for ; Wed, 14 Nov 2018 20:15:30 +0100 (CET) Received: from mail.inparadise.se ([127.0.0.1]) by localhost (mail.inparadise.se [127.0.0.1]) (amavisd-new, port 10032) with ESMTP id cywzPpgbmZvA for ; Wed, 14 Nov 2018 20:15:29 +0100 (CET) Received: from localhost (localhost [127.0.0.1]) by mail.inparadise.se (Postfix) with ESMTP id 32D35437A2 for ; Wed, 14 Nov 2018 20:15:29 +0100 (CET) DKIM-Filter: OpenDKIM Filter v2.10.3 mail.inparadise.se 32D35437A2 X-Virus-Scanned: amavisd-new at inparadise.se Received: from mail.inparadise.se ([127.0.0.1]) by localhost (mail.inparadise.se [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id S0Sd-lB-83t5 for ; Wed, 14 Nov 2018 20:15:28 +0100 (CET) Received: from [172.16.1.131] (gametop-wl.inparadise.se [172.16.1.131]) by mail.inparadise.se (Postfix) with ESMTPSA id D2B2143761 for ; Wed, 14 Nov 2018 20:15:28 +0100 (CET) Subject: Re: Mount RW /var below RO / To: freebsd-fs@freebsd.org References: From: =?UTF-8?Q?Karli_Sj=c3=b6berg?= Message-ID: <0ccce417-ba23-84a7-b970-cdd0db5411c3@inparadise.se> Date: Wed, 14 Nov 2018 20:15:28 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.2.1 MIME-Version: 1.0 In-Reply-To: Content-Language: en-US X-Rspamd-Queue-Id: CE63C8627F X-Spamd-Result: default: False [-2.14 / 200.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[inparadise.se]; RCVD_COUNT_FIVE(0.00)[6]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+a]; TO_MATCH_ENVRCPT_ALL(0.00)[]; HAS_ATTACHMENT(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_DN_NONE(0.00)[]; MIME_GOOD(-0.10)[multipart/mixed,text/plain]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.99)[-0.989,0]; NEURAL_HAM_MEDIUM(-1.00)[-0.998,0]; NEURAL_SPAM_SHORT(0.76)[0.760,0]; DKIM_TRACE(0.00)[inparadise.se:+]; MX_GOOD(-0.01)[mail.inparadise.se]; DMARC_POLICY_ALLOW(-0.50)[inparadise.se,quarantine]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; IP_SCORE(-0.00)[country: SE(-0.02)]; ASN(0.00)[asn:8473, ipnet:158.174.0.0/16, country:SE]; MID_RHS_MATCH_FROM(0.00)[]; MIME_UNKNOWN(0.10)[application/pgp-keys] X-Rspamd-Server: mx1.freebsd.org Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 14 Nov 2018 19:15:42 -0000 Den 2018-11-14 kl. 19:55, skrev Mathieu: > Hi guys, > > Given a RO root partition, can one proceed to mount a RW partition to /= var ? Or is this forbidden by the readonlyness of / ? Was planning to do = so using fstab. > > Thanks. > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" Yeah man, no problem! Just don't have RO / while trying to edit fstab ;) /K From owner-freebsd-fs@freebsd.org Thu Nov 15 08:56:53 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2BC67112E015 for ; Thu, 15 Nov 2018 08:56:53 +0000 (UTC) (envelope-from maurizio@metaljonica.it) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id A16888AD7A for ; Thu, 15 Nov 2018 08:56:52 +0000 (UTC) (envelope-from maurizio@metaljonica.it) Received: by mailman.ysv.freebsd.org (Postfix) id 6623A112E00E; Thu, 15 Nov 2018 08:56:52 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 33A8D112E00C for ; Thu, 15 Nov 2018 08:56:52 +0000 (UTC) (envelope-from maurizio@metaljonica.it) Received: from mail-out-01.it.net (mailprofe01-156.it.net [151.1.195.156]) by mx1.freebsd.org (Postfix) with ESMTP id 81B3F8AD76 for ; Thu, 15 Nov 2018 08:56:51 +0000 (UTC) (envelope-from maurizio@metaljonica.it) Received: from mail-fe-avasout01.mail.int (10.213.52.33) by mail-out-01.it.net (8.6.060.05) id 5B363FBE003C18C8 for fs@freebsd.org; Thu, 15 Nov 2018 09:46:26 +0100 Received: from 93-41-96-205.ip80.fastwebnet.it (93.41.96.205) by mail-fe-avasout01.mail.int (9.0.019.22-1) (authenticated as maurizio@metaljonica.it) id 5B467FBE024D968A for fs@freebsd.org; Thu, 15 Nov 2018 09:46:23 +0100 Message-ID: <5B467FBE024D968A@mail-fe-avasout01.mail.int> (added by postmaster@mail-fe-avasout01.mail.int) From: "Maurizio Pisano" Subject: New EcoBeach - beach cleaner self-propelled - By Metaljonica To: "fs" MIME-Version: 1.0 Organization: Metaljonica srl Date: Thu, 15 Nov 2018 09:46:22 +0100 X-Rspamd-Queue-Id: A16888AD7A X-Spamd-Result: default: False [9.54 / 200.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; URI_COUNT_ODD(1.00)[19]; HAS_ORG_HEADER(0.00)[]; TO_DN_ALL(0.00)[]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mailin01.it.net]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MID_MISSING_BRACKETS(0.50)[]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@freebsd.org,freebsd-fs@freebsd.org]; RECEIVED_SPAMHAUS_PBL(0.00)[205.96.41.93.zen.spamhaus.org : 127.0.0.11]; ARC_NA(0.00)[]; RECEIVED_SPAMHAUS_XBL(3.00)[205.96.41.93.zen.spamhaus.org : 127.0.0.4]; SPAM_FLAG(5.00)[]; RCVD_COUNT_FIVE(0.00)[6]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.96)[0.960,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; DMARC_NA(0.00)[metaljonica.it]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(1.00)[0.998,0]; RCPT_COUNT_ONE(0.00)[1]; IP_SCORE(-3.70)[ip: (-9.87), ipnet: 2001:1900:2254::/48(-4.81), asn: 10310(-3.75), country: US(-0.10)]; NEURAL_SPAM_LONG(1.00)[1.000,0]; R_SPF_NA(0.00)[]; GREYLIST(0.00)[pass,body] X-Rspamd-Server: mx1.freebsd.org X-Spam: Yes Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 Nov 2018 08:56:53 -0000 =EF=BB=BFNewsletter MetaljonicaSe non leggi correttamente questa email= , clicca qu=C3=AC per la versione online. Aggiungi info@puliscispiaggia.com ai tuoi preferiti.=20 =20 ECOBEACH NEW MODEL 2018=20 =20 =20 Evolution HD =20 Read MoreEvolution =20 Read MoreSerie P =20 Read MoreSerie S =20 Read More METALJONICA MACHINE CLEAN BEACH =20 Welcome to METALJONICA =E2=80=93 Italy=E2=80=99s Leader in the product= ion of Beach cleaner machines. METALJONICA has been producing Beach cl= eaner machines for about 20 years. To satisfy the market=E2=80=99s nee= ds, we produce several types of beach cleaner machine. They all work according to an exclusive system planned by our company = which makes them strong and efficient. Our machine do not fear stones,= where the other ones stop, we go ahead. To make the difference contri= butes our consolidated experience like producers of beach cleaner mach= ines. We are already located in different geographic areas of the worl= d, always looking for new partnerships. GO TO NEW WEB SITESHOW VIDEODOWNLOAD CATALOG BUY DIRECTLY IN FACTORY SALES MANAGER Maurizio Pisano=20 TEL: +39 335.16 35 168 EMAIL: Info@puliscispiaggia.com Call with Skype METALJONICA S.R.L. A 14 exit (Zone Autoporto) 64026 Roseto degli Abruzzi (Italy) VAT: 01996220677=20 TEL: +39 085.89 37 973=20 EMAIL: Info@puliscispiaggia.com =20 METALJONICA SRL Zona Artigianale Autoporto ZIP CODE 64026 - Roseto deg= li Abruzzi ITALY PHONE/FAX +39 085 8937973 www.puliscispiaggia.com info@puliscispiaggia= =2Ecom - Unsubscribe by email=20 This message, for the D.lgs n.196 / 30.06.03 (Privacy Code), may conta= in confidential and/or privileged information. If you are not the addr= essee or authorized to receive this for the addressee, you must not us= e, copy, disclose or take any action based on this message or any info= rmation herein. If you have received this message in error, please adv= ise the sender immediately by reply e-mail and delete this message. Th= ank you for your cooperation. Your e-mail has been retrieved from the = web or from public directories. Our intention is only to provide infor= mation. If no you like our communications, with simple e-mail communic= ation and nothing more will be delivered. Guarantee of confidentiality= Metaljonica S.r.l.. guarantees the confidentiality of the data provid= ed pursuant to Legislative Decree 196/2003 (Privacy Code). At any time= you can exercise your rights under art. 7 of Legislative Decree 196/2= 003., Including those to rectify and delete data or to oppose the trea= tment, writing to info@puliscispiaggia.com The data controller is Meta= ljonica S.r.l..=20 From owner-freebsd-fs@freebsd.org Thu Nov 15 18:26:56 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0025A11053E2 for ; Thu, 15 Nov 2018 18:26:55 +0000 (UTC) (envelope-from daviddtthomas6@gmail.com) Received: from mail-pl1-x641.google.com (mail-pl1-x641.google.com [IPv6:2607:f8b0:4864:20::641]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2D06F77466 for ; Thu, 15 Nov 2018 18:26:55 +0000 (UTC) (envelope-from daviddtthomas6@gmail.com) Received: by mail-pl1-x641.google.com with SMTP id w22-v6so9878071plk.0 for ; Thu, 15 Nov 2018 10:26:55 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=return-receipt-to:from:to:subject:date:message-id:mime-version :thread-index:content-language:disposition-notification-to; bh=kJcA96pMHK22x69KqmnJU+GZvFykmaAWzyzVI9Q2NII=; b=PuFN0dPMM6iPHY3q1SKNurzQm2FGMadeYNjonff2jU3jTYoT+NA7QQGpLMjxPG9Kt/ 3NqD5DRgPUqWh4iE2RZR3Mf0x2JjIsOjhloKhAcYxoHO2GH+rNdAVRCqOZlUjrJfVe/6 kMBBJMqcpdL6g7GQ9MvE+kAIyKZ/m34K0mjHcCpcFj3twalC23t70M0QmrQKFrQ/EEt+ mtQTY4tcqCnXfzj4YFiJaUVZKELMA7FD+SIlfgdFLshdo1nf0qLh+NuejzcIkm/DD2bO eTsH95KEIUirYc22E68uC5Vmzqn/eaqxycsl1fTttBpdBL2W/xgihXC66QgJLMWcQ2Mj OsDQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:return-receipt-to:from:to:subject:date :message-id:mime-version:thread-index:content-language :disposition-notification-to; bh=kJcA96pMHK22x69KqmnJU+GZvFykmaAWzyzVI9Q2NII=; b=X+MhmNh66FdzIQHe7uSe9WBCfYnIyNWqfQMDvjePKDAWE4VOH6GjHyDNW7Vhhv/e0e YZ3Rsqy4pjwU5Am7gV5BN5L66Bgmp5BC7VOYdYRGkggQb+nTrgUNJe3IcyAKz/kwsMXN tOw/ugmqGkekBacbkcsvEzGENWMomCIlrm/R598tE1+7ZH8x6iyrtjcMw9lDL2EOAWzr kCR3V9fQOUV2wIVqKZWULYIMzpTV6W1NqhvqCLKPnq8yEKiev6mazZ5vrTAvkVCF0Tz9 73YYxH1BtLzfYK8wPUW4mLjlkNzsWR/Vmkp3cfUVT1JpcO38y1G6dVWRMnGQj4ZltO8d A6Ug== X-Gm-Message-State: AGRZ1gK6D9z/Ypo7foy8iYxVyTs1yaEUh07aIhIavOdjDNUjX4J+3yRj YGJRUPp2rY7VouMM6gzcdE2wJhLI X-Google-Smtp-Source: AJdET5dGz4q2HMx5exfJwQTRQnZD4XNPl1sMpxWIVX0FphmljkGszhLoKpZqYumqojqFfIIYZZxM1A== X-Received: by 2002:a17:902:5ac7:: with SMTP id g7mr7483791plm.212.1542306414040; Thu, 15 Nov 2018 10:26:54 -0800 (PST) Received: from IntelPC ([183.82.21.236]) by smtp.gmail.com with ESMTPSA id d197-v6sm36762269pga.1.2018.11.15.10.26.52 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Thu, 15 Nov 2018 10:26:53 -0800 (PST) From: "David Thomas" To: Subject: Unix Users list Date: Thu, 15 Nov 2018 13:26:47 -0500 Message-ID: <1a9201d47d10$c633cfa0$529b6ee0$@gmail.com> MIME-Version: 1.0 X-Mailer: Microsoft Outlook 15.0 Thread-Index: AdR9EMQhhFQKpTWMSgmpI+xetmJQaw== Content-Language: en-in X-Rspamd-Queue-Id: 2D06F77466 X-Spamd-Result: default: False [4.75 / 200.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(0.00)[+ip6:2607:f8b0:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(0.00)[gmail.com,none]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(0.19)[ip: (5.50), ipnet: 2607:f8b0::/32(-2.66), asn: 15169(-1.81), country: US(-0.10)]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[236.21.82.183.zen.spamhaus.org : 127.0.0.11]; ARC_NA(0.00)[]; RECEIVED_SPAMHAUS_XBL(3.00)[236.21.82.183.zen.spamhaus.org : 127.0.0.4]; R_DKIM_ALLOW(0.00)[gmail.com]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.32)[0.324,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; NEURAL_SPAM_MEDIUM(0.49)[0.495,0]; RCPT_COUNT_ONE(0.00)[1]; BAD_REP_POLICIES(0.10)[]; NEURAL_SPAM_LONG(0.75)[0.751,0]; RCVD_IN_DNSWL_NONE(0.00)[1.4.6.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0] X-Rspamd-Server: mx1.freebsd.org Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 Nov 2018 18:26:56 -0000 Hello, This is Jillian from the pre-sales team I would like to know if you are interested in acquiringUnix Users contact list with email, Let me know your exact target Industry you are trying to reach so that I can provide you more information accordingly for your marketing and other business Campaigns? Also, a quick note to inform you that currently, we are running an offer on all immediate purchases where you can avail the same list at much lesser cost. Let me know if want to know more about the discounted pricing. If you are not the right person, please forward it to the right person in your organization. Best Regards, David Thomas To opt out,please response Exit. From owner-freebsd-fs@freebsd.org Thu Nov 15 21:02:44 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F3D521109D1B for ; Thu, 15 Nov 2018 21:02:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 6ACD77EFFF for ; Thu, 15 Nov 2018 21:02:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 2F34C1109D12; Thu, 15 Nov 2018 21:02:43 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0D3B01109D11 for ; Thu, 15 Nov 2018 21:02:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 83CD27EFFB for ; Thu, 15 Nov 2018 21:02:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id BBDB61FC16 for ; Thu, 15 Nov 2018 21:02:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wAFL2fo0031649 for ; Thu, 15 Nov 2018 21:02:41 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wAFL2fvS031648 for fs@FreeBSD.org; Thu, 15 Nov 2018 21:02:41 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 225423] panic: softdep_deallocate_dependencies: dangling deps Date: Thu, 15 Nov 2018 21:02:41 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: vangyzen@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: 6ACD77EFFF X-Spamd-Result: default: False [-105.92 / 200.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; ALLOW_DOMAIN_WHITELIST(-100.00)[freebsd.org]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; SPF_FAIL_FORWARDING(0.00)[]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; XAW_SERVICE_ACCT(1.00)[]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx66.freebsd.org]; NEURAL_HAM_SHORT(-1.00)[-1.000,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.71)[ip: (-9.87), ipnet: 2001:1900:2254::/48(-4.81), asn: 10310(-3.75), country: US(-0.10)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_NO_DN(0.00)[]; RCVD_COUNT_SEVEN(0.00)[7] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 Nov 2018 21:02:44 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225423 --- Comment #13 from Eric van Gyzen --- I get the same panic on recent head (r340361) when force-unmounting /dev. = Does that fall under the same "hardening" umbrella, or should it be treated differently? # mount -t ufs /dev/gpt/scratch on /scratch (ufs, local, soft-updates) # echo hello > /scratch/hello # umount -f /dev fsync: giving up on dirty (error =3D 35) 0xfffff8002d19b000: tag devfs, typ= e VCHR usecount 1, writecount 0, refcount 7 rdev 0xfffff800035a2c00 flags (VI_DOOMED|VI_ACTIVE) v_object 0xfffff8002d9e6600 ref 0 pages 15 cleanbuf 3 dirtybuf 1 lock type devfs: EXCL by thread 0xfffff8002d014580 (pid 729, umount, tid 100397) dev gpt/scratch panic: softdep_deallocate_dependencies: dangling deps panic() at panic+0x43/frame 0xfffffe001beed4d0 softdep_deallocate_dependencies() at softdep_deallocate_dependencies+0x76/f= rame 0xfffffe001beed4f0 brelse() at brelse+0x176/frame 0xfffffe001beed540 flushbuflist() at flushbuflist+0x147/frame 0xfffffe001beed5a0 bufobj_invalbuf() at bufobj_invalbuf+0x9f/frame 0xfffffe001beed600 vgonel() at vgonel+0x15e/frame 0xfffffe001beed670 vflush() at vflush+0x22c/frame 0xfffffe001beed7c0 devfs_unmount() at devfs_unmount+0x43/frame 0xfffffe001beed800 dounmount() at dounmount+0x4b1/frame 0xfffffe001beed860 sys_unmount() at sys_unmount+0x310/frame 0xfffffe001beed980 amd64_syscall() at amd64_syscall+0x278/frame 0xfffffe001beedab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe001beedab0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip =3D 0x8002d6a3a, rsp =3D 0x7fffffffc628, rbp =3D 0x7fffffffcb60 --- --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Thu Nov 15 21:02:59 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8345A1109D37 for ; Thu, 15 Nov 2018 21:02:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id E51B77F024 for ; Thu, 15 Nov 2018 21:02:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id A9EEB1109D30; Thu, 15 Nov 2018 21:02:58 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 98BA51109D2F for ; Thu, 15 Nov 2018 21:02:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2020A7F019 for ; Thu, 15 Nov 2018 21:02:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 56F2F1FC1A for ; Thu, 15 Nov 2018 21:02:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wAFL2v3F032056 for ; Thu, 15 Nov 2018 21:02:57 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wAFL2vAA032055 for fs@FreeBSD.org; Thu, 15 Nov 2018 21:02:57 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 225423] panic: softdep_deallocate_dependencies: dangling deps Date: Thu, 15 Nov 2018 21:02:57 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: vangyzen@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_severity version Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: E51B77F024 X-Spamd-Result: default: False [-105.92 / 200.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; ALLOW_DOMAIN_WHITELIST(-100.00)[freebsd.org]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; SPF_FAIL_FORWARDING(0.00)[]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; XAW_SERVICE_ACCT(1.00)[]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx66.freebsd.org]; NEURAL_HAM_SHORT(-1.00)[-1.000,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.71)[ip: (-9.87), ipnet: 2001:1900:2254::/48(-4.81), asn: 10310(-3.75), country: US(-0.10)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_NO_DN(0.00)[]; RCVD_COUNT_SEVEN(0.00)[7] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 Nov 2018 21:02:59 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225423 Eric van Gyzen changed: What |Removed |Added ---------------------------------------------------------------------------- Severity|Affects Only Me |Affects Some People Version|11.0-RELEASE |CURRENT --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Thu Nov 15 21:10:30 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7238E1109F94 for ; Thu, 15 Nov 2018 21:10:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id E5BB27F34F for ; Thu, 15 Nov 2018 21:10:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id A751D1109F93; Thu, 15 Nov 2018 21:10:29 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9450C1109F92 for ; Thu, 15 Nov 2018 21:10:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 089787F347 for ; Thu, 15 Nov 2018 21:10:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 258771FC2C for ; Thu, 15 Nov 2018 21:10:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wAFLAS3S063921 for ; Thu, 15 Nov 2018 21:10:28 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wAFLAS1H063908 for fs@FreeBSD.org; Thu, 15 Nov 2018 21:10:28 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 225423] panic: softdep_deallocate_dependencies: dangling deps Date: Thu, 15 Nov 2018 21:10:28 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: vangyzen@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: E5BB27F34F X-Spamd-Result: default: False [-105.92 / 200.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; ALLOW_DOMAIN_WHITELIST(-100.00)[freebsd.org]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; SPF_FAIL_FORWARDING(0.00)[]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; XAW_SERVICE_ACCT(1.00)[]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx66.freebsd.org]; NEURAL_HAM_SHORT(-1.00)[-1.000,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.71)[ip: (-9.87), ipnet: 2001:1900:2254::/48(-4.81), asn: 10310(-3.75), country: US(-0.10)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_NO_DN(0.00)[]; RCVD_COUNT_SEVEN(0.00)[7] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 Nov 2018 21:10:30 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225423 --- Comment #14 from Eric van Gyzen --- I realize "umount -f /dev" is insane under normal operation. I'm wondering= if the resulting panic indicates a problem that can be hit by other, more norm= al operations. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Thu Nov 15 21:24:09 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 00554110A4B0 for ; Thu, 15 Nov 2018 21:24:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 743D07FCD9 for ; Thu, 15 Nov 2018 21:24:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 38DC2110A4AF; Thu, 15 Nov 2018 21:24:08 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2788D110A4AE for ; Thu, 15 Nov 2018 21:24:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A5BDE7FCD4 for ; Thu, 15 Nov 2018 21:24:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id DBDF91FEDD for ; Thu, 15 Nov 2018 21:24:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wAFLO6IY074383 for ; Thu, 15 Nov 2018 21:24:06 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wAFLO69f074374 for fs@FreeBSD.org; Thu, 15 Nov 2018 21:24:06 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 225423] panic: softdep_deallocate_dependencies: dangling deps Date: Thu, 15 Nov 2018 21:24:06 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: 743D07FCD9 X-Spamd-Result: default: False [-105.92 / 200.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; ALLOW_DOMAIN_WHITELIST(-100.00)[freebsd.org]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; SPF_FAIL_FORWARDING(0.00)[]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; XAW_SERVICE_ACCT(1.00)[]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx66.freebsd.org]; NEURAL_HAM_SHORT(-1.00)[-1.000,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.71)[ip: (-9.87), ipnet: 2001:1900:2254::/48(-4.81), asn: 10310(-3.75), country: US(-0.10)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_NO_DN(0.00)[]; RCVD_COUNT_SEVEN(0.00)[7] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 Nov 2018 21:24:09 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225423 --- Comment #15 from Kirk McKusick --- (In reply to Eric van Gyzen from comment #14) Indeed `umount -f /dev' is insane. The /dev filesystem does not use UFS or = soft updates, so I assume that you are getting the panic because of interaction = with /dev/gpt/scratch which is a UFS filesystem. To the extent that the problem = is with /dev/gpt/scratch then yes, the hardening work that we are doing should resolve that panic. The hardening work is proceeding, albeit slowly... --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Thu Nov 15 22:05:03 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F0EC5110BA51 for ; Thu, 15 Nov 2018 22:05:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 5F0A681865 for ; Thu, 15 Nov 2018 22:05:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 2076F110BA4D; Thu, 15 Nov 2018 22:05:02 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0F200110BA4C for ; Thu, 15 Nov 2018 22:05:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8ACF781861 for ; Thu, 15 Nov 2018 22:05:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id B500C4DE for ; Thu, 15 Nov 2018 22:05:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wAFM501a026239 for ; Thu, 15 Nov 2018 22:05:00 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wAFM50hO026238 for fs@FreeBSD.org; Thu, 15 Nov 2018 22:05:00 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 233245] [UFS] Softupdates fails to track dependency between appended data and i_size Date: Thu, 15 Nov 2018 22:05:00 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: cem@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: 5F0A681865 X-Spamd-Result: default: False [-105.91 / 40.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; ALLOW_DOMAIN_WHITELIST(-100.00)[freebsd.org]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; SPF_FAIL_FORWARDING(0.00)[]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; XAW_SERVICE_ACCT(1.00)[]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx66.freebsd.org]; NEURAL_HAM_SHORT(-1.00)[-0.997,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.71)[ip: (-9.87), ipnet: 2001:1900:2254::/48(-4.81), asn: 10310(-3.75), country: US(-0.10)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_NO_DN(0.00)[]; RCVD_COUNT_SEVEN(0.00)[7] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 Nov 2018 22:05:03 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D233245 Conrad Meyer changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Fri Nov 16 01:24:29 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E082B1121C4A for ; Fri, 16 Nov 2018 01:24:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 54CBC6ABA2 for ; Fri, 16 Nov 2018 01:24:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 19CC61121C49; Fri, 16 Nov 2018 01:24:28 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EC11C1121C48 for ; Fri, 16 Nov 2018 01:24:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 71C1B6AB99 for ; Fri, 16 Nov 2018 01:24:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id B1021201A for ; Fri, 16 Nov 2018 01:24:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wAG1OQm2055503 for ; Fri, 16 Nov 2018 01:24:26 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wAG1OQQ5055502 for fs@FreeBSD.org; Fri, 16 Nov 2018 01:24:26 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 233245] [UFS] Softupdates fails to track dependency between appended data and i_size Date: Fri, 16 Nov 2018 01:24:26 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: 54CBC6ABA2 X-Spamd-Result: default: False [-105.92 / 40.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; ALLOW_DOMAIN_WHITELIST(-100.00)[freebsd.org]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; SPF_FAIL_FORWARDING(0.00)[]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; XAW_SERVICE_ACCT(1.00)[]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx66.freebsd.org]; NEURAL_HAM_SHORT(-1.00)[-1.000,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.71)[ip: (-9.87), ipnet: 2001:1900:2254::/48(-4.82), asn: 10310(-3.75), country: US(-0.10)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_NO_DN(0.00)[]; RCVD_COUNT_SEVEN(0.00)[7] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 Nov 2018 01:24:29 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D233245 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |mckusick@FreeBSD.org --- Comment #1 from Kirk McKusick --- As you note, soft updates does not currently consider it necessary to ensure that the new contents of the block be written before increasing the file si= ze if it knows that the exposed contents will be zero (as opposed to the random data that was in a previously used block where it does ensure that the bloc= k is written before it can be accessed). It would be possible to add a requireme= nt that the new data be written before the size could be updated, but it is not clear to me that adding this extra overhead is worthwhile. Also, this case includes overwriting data in the middle of an earlier block in the file for which there is nothing that we can do. Note that you cannot put the test into ffs_write() in the way that you have done (which makes the call for any growth in size). It can only be done when the growth is such that it does not go out of an existing block allocation = or is overwriting an earlier part of the file. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Fri Nov 16 02:58:14 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D76001123E2D for ; Fri, 16 Nov 2018 02:58:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 537306D96E for ; Fri, 16 Nov 2018 02:58:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 154DD1123E2C; Fri, 16 Nov 2018 02:58:13 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E778A1123E2B for ; Fri, 16 Nov 2018 02:58:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 56E0F6D96A for ; Fri, 16 Nov 2018 02:58:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 6F9C42C8B for ; Fri, 16 Nov 2018 02:58:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wAG2wBZk033253 for ; Fri, 16 Nov 2018 02:58:11 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wAG2wBdJ033251 for fs@FreeBSD.org; Fri, 16 Nov 2018 02:58:11 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 233245] [UFS] Softupdates fails to track dependency between appended data and i_size Date: Fri, 16 Nov 2018 02:58:11 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: cem@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: 537306D96E X-Spamd-Result: default: False [-105.92 / 40.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; ALLOW_DOMAIN_WHITELIST(-100.00)[freebsd.org]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; SPF_FAIL_FORWARDING(0.00)[]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; XAW_SERVICE_ACCT(1.00)[]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx66.freebsd.org]; NEURAL_HAM_SHORT(-1.00)[-1.000,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.71)[ip: (-9.87), ipnet: 2001:1900:2254::/48(-4.82), asn: 10310(-3.75), country: US(-0.10)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_NO_DN(0.00)[]; RCVD_COUNT_SEVEN(0.00)[7] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 Nov 2018 02:58:14 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D233245 --- Comment #2 from Conrad Meyer --- Hi Kirk, Thanks for your prompt reply. (In reply to Kirk McKusick from comment #1) > As you note, soft updates does not currently consider it necessary to ens= ure > that the new contents of the block be written before increasing the file = size > if it knows that the exposed contents will be zero (as opposed to the ran= dom > data that was in a previously used block where it does ensure that the bl= ock is > written before it can be accessed). Yep, understood. > It would be possible to add a requirement that the new data be written be= fore > the size could be updated, That is the proposal. :-) > but it is not clear to me that adding this extra overhead is worthwhile. Overhead in which sense? I can imagine a few objections (it makes the code more complicated; there is some minor additional memory burden; SU dependen= cy graphs get a little deeper) but maybe you have others in mind I hadn't thou= ght of. I don't think there is any additional IO cost (perhaps longer fsync ti= me on appended files due to the additional ordering barrier?), but I might wel= l be missing something. As far as whether any runtime overhead is worthwhile, I think there are two relevant dimensions. One, what is the measurable overhead, if any? (We ca= n't really answer this one until we have a proof of concept implementation.) A= nd two, what is the user willing to accept, both in terms of overhead and appe= nd data fidelity? I think it's likely a trade-off we might not want to make unilaterally, but instead leave to the end user. It should be pretty easy to add it as a mount option or something like that= ; in the same vein as "noatime" allows users to disable a feature with too much overhead. I don't see any significant barriers to enabling or disabling it on-the-fly for existing mounts at runtime, either. > Also, this case includes overwriting data in the middle of an earlier blo= ck in the file for which there is nothing that we can do. Understood =E2=80=94 append is /the/ special case of write where this is po= ssible. But it is also a fairly common case, and given that we can do it safely, I thin= k we should aim to do it safely. (For middle-of-file partial overwrites, we could order data block flushing = with inode mtime update, if we do not already. That would be a pretty minimal protection and would not save us from torn writes. I think we might also be able to allocate data blocks out-of-place and order full block writes with their corresponding block pointer or indirect block pointer updates, but th= at has significant downsides, such as file fragmentation, and isn't something = I'm interested in right now.) > Note that you cannot put the test into ffs_write() in the way that you ha= ve > done (which makes the call for any growth in size). It can only be done w= hen > the growth is such that it does not go out of an existing block allocatio= n or > is overwriting an earlier part of the file. The elided portion of ffs_write() between lines 756 and 781 invokes UFS_BALLOC() to allocate any blocks needed -- so I believe the suggested location in ffs_write() would be within an existing block allocation. But maybe I am mistaken. I am not attached to the location, it just seemed lik= e a plausible spot to me. (There is a smaller separate concern, which is that any full block append is already fully tracked with allocdirect or allocindirect =E2=80=94 we only w= ant the proposed partial append dependency for the last iteration of the loop in ffs_write.) --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Fri Nov 16 08:27:38 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AA4C7112B46A for ; Fri, 16 Nov 2018 08:27:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 27130762BC for ; Fri, 16 Nov 2018 08:27:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id DEB2E112B469; Fri, 16 Nov 2018 08:27:37 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A2E2F112B468 for ; Fri, 16 Nov 2018 08:27:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2D378762B8 for ; Fri, 16 Nov 2018 08:27:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 43BD95CC4 for ; Fri, 16 Nov 2018 08:27:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wAG8Ra4U099543 for ; Fri, 16 Nov 2018 08:27:36 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wAG8Rabw099542 for fs@FreeBSD.org; Fri, 16 Nov 2018 08:27:36 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 233245] [UFS] Softupdates fails to track dependency between appended data and i_size Date: Fri, 16 Nov 2018 08:27:35 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: kib@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: 27130762BC X-Spamd-Result: default: False [-105.92 / 40.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; ALLOW_DOMAIN_WHITELIST(-100.00)[freebsd.org]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; SPF_FAIL_FORWARDING(0.00)[]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; XAW_SERVICE_ACCT(1.00)[]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx66.freebsd.org]; NEURAL_HAM_SHORT(-1.00)[-0.999,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.71)[ip: (-9.87), ipnet: 2001:1900:2254::/48(-4.82), asn: 10310(-3.76), country: US(-0.10)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_NO_DN(0.00)[]; RCVD_COUNT_SEVEN(0.00)[7] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 Nov 2018 08:27:38 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D233245 Konstantin Belousov changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |kib@FreeBSD.org --- Comment #3 from Konstantin Belousov --- Of course I sympathize the idea of improving the user experience, but IMO t= he cost of the code complexity is more important there. SU, from my prospective, were never supposed to provide the user data consistency guarantees. The goal was/is only the metadata sanity, even not = the guarantee that on-disk metadata actually matches some state during the syst= em operation. We never track user data block writes ordering, so whatever sta= te user data is left after the crash, is the user issue. >From this PoV, file size increase by hole vs. increase by the actual conten= t is not under the SU scope. Again, to make my opinion clear: I would not objec= t, but SU are already insanely complex and we must not increase the complexity just because we can. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Fri Nov 16 08:55:28 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4F4E5112BF31 for ; Fri, 16 Nov 2018 08:55:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id C352876F46 for ; Fri, 16 Nov 2018 08:55:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 846A8112BF29; Fri, 16 Nov 2018 08:55:27 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 49B02112BF27 for ; Fri, 16 Nov 2018 08:55:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C466476F3E for ; Fri, 16 Nov 2018 08:55:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id D881F60DA for ; Fri, 16 Nov 2018 08:55:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wAG8tPFo054014 for ; Fri, 16 Nov 2018 08:55:25 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wAG8tPVh054013 for fs@FreeBSD.org; Fri, 16 Nov 2018 08:55:25 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 225423] panic: softdep_deallocate_dependencies: dangling deps Date: Fri, 16 Nov 2018 08:55:25 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: kib@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: C352876F46 X-Spamd-Result: default: False [-105.92 / 40.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; ALLOW_DOMAIN_WHITELIST(-100.00)[freebsd.org]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; SPF_FAIL_FORWARDING(0.00)[]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; XAW_SERVICE_ACCT(1.00)[]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx66.freebsd.org]; NEURAL_HAM_SHORT(-1.00)[-1.000,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.71)[ip: (-9.87), ipnet: 2001:1900:2254::/48(-4.82), asn: 10310(-3.76), country: US(-0.10)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_NO_DN(0.00)[]; RCVD_COUNT_SEVEN(0.00)[7] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 Nov 2018 08:55:28 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225423 Konstantin Belousov changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |kib@FreeBSD.org --- Comment #16 from Konstantin Belousov --- (In reply to Kirk McKusick from comment #15) Unmounting /dev reclaims the devfs vnodes, in particular, the devvp which is referenced by the mount. Currently most of the UFS io bypasses devfs vnode layer, but this is not an architectural property. We cannot guarantee that= UFS operations would not require a VOP call into devfs which is not grounded by= a panic (see vfs_default.c). --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Fri Nov 16 09:03:03 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EE143112C57E for ; Fri, 16 Nov 2018 09:03:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 6BCC177418 for ; Fri, 16 Nov 2018 09:03:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 2FE02112C57D; Fri, 16 Nov 2018 09:03:02 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1E96B112C57C for ; Fri, 16 Nov 2018 09:03:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 99AEE7740F for ; Fri, 16 Nov 2018 09:03:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id BFAA1624D for ; Fri, 16 Nov 2018 09:03:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wAG930i4002857 for ; Fri, 16 Nov 2018 09:03:00 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wAG930KG002856 for fs@FreeBSD.org; Fri, 16 Nov 2018 09:03:00 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 225423] panic: softdep_deallocate_dependencies: dangling deps Date: Fri, 16 Nov 2018 09:03:00 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: 6BCC177418 X-Spamd-Result: default: False [-105.92 / 40.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; ALLOW_DOMAIN_WHITELIST(-100.00)[freebsd.org]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; SPF_FAIL_FORWARDING(0.00)[]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; XAW_SERVICE_ACCT(1.00)[]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx66.freebsd.org]; NEURAL_HAM_SHORT(-1.00)[-1.000,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.71)[ip: (-9.87), ipnet: 2001:1900:2254::/48(-4.82), asn: 10310(-3.76), country: US(-0.10)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_NO_DN(0.00)[]; RCVD_COUNT_SEVEN(0.00)[7] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 Nov 2018 09:03:03 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225423 --- Comment #17 from Kirk McKusick --- (In reply to Konstantin Belousov from comment #16) Given that a successful unmount of /dev makes the system all but unusable, would it be sensible to have the /dev at the root simply return EINVAL if i= t is asked to be unmounted? Obviously copies of it in jails can and should be unmountable, but it seems to me that the original /dev from which all other /dev's are derived should not be. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Fri Nov 16 09:17:40 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 45655112CB60 for ; Fri, 16 Nov 2018 09:17:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id B9AEC779AC for ; Fri, 16 Nov 2018 09:17:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 7DF22112CB5F; Fri, 16 Nov 2018 09:17:39 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6CBCF112CB5D for ; Fri, 16 Nov 2018 09:17:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id EBCBE779A4 for ; Fri, 16 Nov 2018 09:17:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 635ED63D4 for ; Fri, 16 Nov 2018 09:17:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wAG9HbNG024288 for ; Fri, 16 Nov 2018 09:17:37 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wAG9HblN024280 for fs@FreeBSD.org; Fri, 16 Nov 2018 09:17:37 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 225423] panic: softdep_deallocate_dependencies: dangling deps Date: Fri, 16 Nov 2018 09:17:36 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: kib@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: B9AEC779AC X-Spamd-Result: default: False [-105.92 / 40.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; ALLOW_DOMAIN_WHITELIST(-100.00)[freebsd.org]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; SPF_FAIL_FORWARDING(0.00)[]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; XAW_SERVICE_ACCT(1.00)[]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx66.freebsd.org]; NEURAL_HAM_SHORT(-1.00)[-1.000,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.71)[ip: (-9.87), ipnet: 2001:1900:2254::/48(-4.82), asn: 10310(-3.76), country: US(-0.10)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_NO_DN(0.00)[]; RCVD_COUNT_SEVEN(0.00)[7] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 Nov 2018 09:17:40 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225423 --- Comment #18 from Konstantin Belousov --- (In reply to Kirk McKusick from comment #17) Only when you use root on UFS then /dev unmount is fatal. If you boot over NFS, or e.g. boot from UFS but then re-root into tmpfs, /dev is not that significant. Also, I do not think that it is worth so much hand-holding of user as to im= ply the policy at the mount points. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Fri Nov 16 09:25:14 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 505F6112D00F for ; Fri, 16 Nov 2018 09:25:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id C48C377F07 for ; Fri, 16 Nov 2018 09:25:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 89264112D00E; Fri, 16 Nov 2018 09:25:13 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 67421112D00D for ; Fri, 16 Nov 2018 09:25:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E094577EFD for ; Fri, 16 Nov 2018 09:25:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 047A5652D for ; Fri, 16 Nov 2018 09:25:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wAG9PBxG055128 for ; Fri, 16 Nov 2018 09:25:11 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wAG9PBYT055119 for fs@FreeBSD.org; Fri, 16 Nov 2018 09:25:11 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 233245] [UFS] Softupdates fails to track dependency between appended data and i_size Date: Fri, 16 Nov 2018 09:25:11 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: C48C377F07 X-Spamd-Result: default: False [-105.92 / 40.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; ALLOW_DOMAIN_WHITELIST(-100.00)[freebsd.org]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; SPF_FAIL_FORWARDING(0.00)[]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; XAW_SERVICE_ACCT(1.00)[]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx66.freebsd.org]; NEURAL_HAM_SHORT(-1.00)[-0.998,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.71)[ip: (-9.87), ipnet: 2001:1900:2254::/48(-4.82), asn: 10310(-3.76), country: US(-0.10)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_NO_DN(0.00)[]; RCVD_COUNT_SEVEN(0.00)[7] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 Nov 2018 09:25:14 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D233245 --- Comment #4 from Kirk McKusick --- I concur with Kostik on what we are trying to show to the user. Specifically the filesystem metadata is always correct and we never expose previous cont= ents of blocks to a user. We have no problem presenting them with zeroed data wh= ere we do not have properly written data available. Consider that the user has a large file that has a hole at logical blocks 1, 2, and 3. Now suppose the application fills in this hole by writing logical blocks 1, 2, and 3. Suppo= se the kernel has managed to get blocks 1 and 3 written to disk but not block 2 when the inode gets written. Here we `roll back' the inode putting a hole in the file at block 2, then put the block pointer back before we unlock it and allow it to be viewed by a read operation. So as long as the system stays u= p, the applications always see all the written data. But if the system crashes, then when it comes back up block 2 will read back as zeroed (e.g., a hole in the file) rather than seeing the unwritten data. So, having some extra zero= s at the end of a file really seems no worse. I am presently working on hardening the filesystem. Putting check-hashes on= the metadata, and working to handle disk failures by forcibly unmounting the filesystem rather than having the kernel panic. I think these are more usef= ul than avoiding zeros at the end of files after a crash. That said, I would be happy to assist you if you want to develop the code to extend soft updates = to add this semantic. You would need to add a new dependency type (or possibly extend allocdirect) to track when an existing block is extended with new da= ta. When the inode is written, you need to roll back the length to the old size, then restore the length when the write completes. This of course only works= at the end of a file, not when data is added in the middle of a file as in my example above. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Fri Nov 16 09:35:04 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E46DD112D5BB for ; Fri, 16 Nov 2018 09:35:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 42607785FB for ; Fri, 16 Nov 2018 09:35:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 070FF112D5B8; Fri, 16 Nov 2018 09:35:03 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D9704112D5B6 for ; Fri, 16 Nov 2018 09:35:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6538B785F6 for ; Fri, 16 Nov 2018 09:35:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 5941B668E for ; Fri, 16 Nov 2018 09:35:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wAG9Z1SG007940 for ; Fri, 16 Nov 2018 09:35:01 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wAG9Z1qA007939 for fs@FreeBSD.org; Fri, 16 Nov 2018 09:35:01 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 225423] panic: softdep_deallocate_dependencies: dangling deps Date: Fri, 16 Nov 2018 09:35:00 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: 42607785FB X-Spamd-Result: default: False [-105.92 / 40.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; ALLOW_DOMAIN_WHITELIST(-100.00)[freebsd.org]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; SPF_FAIL_FORWARDING(0.00)[]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; XAW_SERVICE_ACCT(1.00)[]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx66.freebsd.org]; NEURAL_HAM_SHORT(-1.00)[-0.998,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.71)[ip: (-9.87), ipnet: 2001:1900:2254::/48(-4.82), asn: 10310(-3.76), country: US(-0.10)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_NO_DN(0.00)[]; RCVD_COUNT_SEVEN(0.00)[7] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 Nov 2018 09:35:04 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225423 --- Comment #19 from Kirk McKusick --- (In reply to Konstantin Belousov from comment #18) If you unmount /dev you lose your console, /dev/null, /dev/zero, /dev/rando= m, etc. A system without these fails to work pretty quickly (as I discovered w= hen I created a jail and forgot to put a /dev in it). I expect a system running with any local filesystem (e.g., UFS, ZFS, ext2fs) would crash and burn pre= tty quickly if its access to disk was removed. Of course, in insecure mode (whi= ch is what we run in by default) we allow root to scribble all over kernel mem= ory through /dev/kmem so unmounting /dev is no worse than that. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Fri Nov 16 09:46:00 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CCA3D112D942 for ; Fri, 16 Nov 2018 09:46:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 371B078E70 for ; Fri, 16 Nov 2018 09:46:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id EFCDB112D93A; Fri, 16 Nov 2018 09:45:59 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DE820112D936 for ; Fri, 16 Nov 2018 09:45:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 59BAC78E6A for ; Fri, 16 Nov 2018 09:45:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 917926801 for ; Fri, 16 Nov 2018 09:45:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wAG9jwae029138 for ; Fri, 16 Nov 2018 09:45:58 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wAG9jwr7029137 for fs@FreeBSD.org; Fri, 16 Nov 2018 09:45:58 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 225423] panic: softdep_deallocate_dependencies: dangling deps Date: Fri, 16 Nov 2018 09:45:58 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: kib@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: 371B078E70 X-Spamd-Result: default: False [-105.92 / 40.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; ALLOW_DOMAIN_WHITELIST(-100.00)[freebsd.org]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; SPF_FAIL_FORWARDING(0.00)[]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; XAW_SERVICE_ACCT(1.00)[]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx66.freebsd.org]; NEURAL_HAM_SHORT(-1.00)[-0.998,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.71)[ip: (-9.87), ipnet: 2001:1900:2254::/48(-4.82), asn: 10310(-3.76), country: US(-0.10)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_NO_DN(0.00)[]; RCVD_COUNT_SEVEN(0.00)[7] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 Nov 2018 09:46:01 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225423 --- Comment #20 from Konstantin Belousov --- (In reply to Kirk McKusick from comment #19) You only loose usermode access to the console. Imagine that somebody want to unmount and then mount /dev again, for whatev= er reasons, e.g. as part of more involved re-rooting. I do not see why should= we prevent this. For the same reason, we do not prevent ifconfig down the interface which was used for nfs boot. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Fri Nov 16 09:57:54 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 67423112DD4D for ; Fri, 16 Nov 2018 09:57:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id C07DA795A9 for ; Fri, 16 Nov 2018 09:57:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 7E8C2112DD4C; Fri, 16 Nov 2018 09:57:53 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6D522112DD4B for ; Fri, 16 Nov 2018 09:57:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id EA73C795A4 for ; Fri, 16 Nov 2018 09:57:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id A0DDD6962 for ; Fri, 16 Nov 2018 09:57:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wAG9vpbI050117 for ; Fri, 16 Nov 2018 09:57:51 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wAG9vpAQ050116 for fs@FreeBSD.org; Fri, 16 Nov 2018 09:57:51 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 225423] panic: softdep_deallocate_dependencies: dangling deps Date: Fri, 16 Nov 2018 09:57:50 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: C07DA795A9 X-Spamd-Result: default: False [-105.92 / 40.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; ALLOW_DOMAIN_WHITELIST(-100.00)[freebsd.org]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; SPF_FAIL_FORWARDING(0.00)[]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; XAW_SERVICE_ACCT(1.00)[]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx66.freebsd.org]; NEURAL_HAM_SHORT(-1.00)[-0.998,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.71)[ip: (-9.87), ipnet: 2001:1900:2254::/48(-4.82), asn: 10310(-3.76), country: US(-0.10)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_NO_DN(0.00)[]; RCVD_COUNT_SEVEN(0.00)[7] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 Nov 2018 09:57:54 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225423 --- Comment #21 from Kirk McKusick --- (In reply to Konstantin Belousov from comment #20) We can always fall back to the analogy that purveyors of Unix are like purveyors of rope. It is dangerous stuff and if you are not careful, you wi= ll hang yourself. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Fri Nov 16 18:04:57 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 64CD21100B28 for ; Fri, 16 Nov 2018 18:04:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id D36908996E for ; Fri, 16 Nov 2018 18:04:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 948391100B23; Fri, 16 Nov 2018 18:04:56 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 72D1F1100B22 for ; Fri, 16 Nov 2018 18:04:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id EDE8589966 for ; Fri, 16 Nov 2018 18:04:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 20CD3AC6F for ; Fri, 16 Nov 2018 18:04:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wAGI4tV0050325 for ; Fri, 16 Nov 2018 18:04:55 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wAGI4t7Y050324 for fs@FreeBSD.org; Fri, 16 Nov 2018 18:04:55 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 233245] [UFS] [enhancement] Softupdates fails to track dependency between appended data and i_size Date: Fri, 16 Nov 2018 18:04:54 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: cem@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: short_desc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: D36908996E X-Spamd-Result: default: False [-105.91 / 40.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; ALLOW_DOMAIN_WHITELIST(-100.00)[freebsd.org]; FORWARDED(0.00)[fs@mailman.ysv.freebsd.org]; SPF_FAIL_FORWARDING(0.00)[]; TO_DN_NONE(0.00)[]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; XAW_SERVICE_ACCT(1.00)[]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: mx66.freebsd.org]; NEURAL_HAM_SHORT(-0.99)[-0.995,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.71)[ip: (-9.87), ipnet: 2001:1900:2254::/48(-4.82), asn: 10310(-3.76), country: US(-0.10)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[fs@FreeBSD.org,freebsd-fs@freebsd.org]; TO_DOM_EQ_FROM_DOM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_NO_DN(0.00)[]; RCVD_COUNT_SEVEN(0.00)[7] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 Nov 2018 18:04:57 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D233245 Conrad Meyer changed: What |Removed |Added ---------------------------------------------------------------------------- Summary|[UFS] Softupdates fails to |[UFS] [enhancement] |track dependency between |Softupdates fails to track |appended data and i_size |dependency between appended | |data and i_size --- Comment #5 from Conrad Meyer --- Hi Kirk, (In reply to Kirk McKusick from comment #4) > I concur with Kostik on what we are trying to show to the user. Specifica= lly > the filesystem metadata is always correct and we never expose previous > contents of blocks to a user. We have no problem presenting them with zer= oed > data where we do not have properly written data available. Consider that = the > user has a large file that has a hole at logical blocks 1, 2, and 3. Now > suppose the application fills in this hole by writing logical blocks 1, 2, > and 3. Suppose the kernel has managed to get blocks 1 and 3 written to di= sk > but not block 2 when the inode gets written. Here we `roll back' the inode > putting a hole in the file at block 2, then put the block pointer back be= fore > we unlock it and allow it to be viewed by a read operation. So as long as= the > system stays up, the applications always see all the written data. But if= the > system crashes, then when it comes back up block 2 will read back as zero= ed > (e.g., a hole in the file) rather than seeing the unwritten data. So, hav= ing > some extra zeros at the end of a file really seems no worse. I fully agree =E2=80=94 the status quo treatment of partial block appends i= s no worse than the overwrite treatment, and that SU does a good job of ensuring the metadata is correct in the face of power failure / crash. What I am propos= ing is definitely an enhancement. I've marked the summary as such to be clear = to anyone who stumbles upon this PR. I filed this in bugzilla to track it as a potential work item for myself, but the discussion that has taken place is useful to me too. > I am presently working on hardening the filesystem. Putting check-hashes = on > the metadata, and working to handle disk failures by forcibly unmounting = the > filesystem rather than having the kernel panic. I think these are more us= eful > than avoiding zeros at the end of files after a crash. I agree. These are more important enhancements to UFS than my proposal. I certainly appreciate the work you are doing and trust you to prioritize the work you think is valuable. I did not expect anyone else to work on this enhancement, so perhaps the freebsd-fs@ "assignee" is bogus. I would be ha= ppy to assign it to myself to take it off the fs@ list, if that seems most reasonable to everybody. > That said, I would be happy to assist you if you want to develop the code= to > extend soft updates to add this semantic. I appreciate the offer =E2=80=94 thank you. > You would need to add a new dependency type (or possibly > extend allocdirect) to track when an existing block is extended with new > data. When the inode is written, you need to roll back the length to the = old > size, then restore the length when the write completes. This of course on= ly > works at the end of a file, not when data is added in the middle of a fil= e as > in my example above. Yes, it does seem quite similar to allocdirect (minus the block pointer manipulations, and block-centric i_size math). Do you know of any addition= al good resources I can read for the specific dependency graph behavior / roll= back semantics of SU? I have the FreeBSD D&I 2e book of course, and the source = code is the final word. But if you have any additional references you can share= , I would appreciate it. (Tangential to this enhancement, I might take a pass cleaning up the plain English of the ffs_softdep.c comment blocks. They are thorough, but tend to lack visual separation and thus do not scan easily. Additionally, some references to specific objects are quoted, while others are not. It might = help me understand SU better to do a pass making an attempt to help others understand SU better. :-)) --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Sat Nov 17 01:43:45 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 39F99110C8DE for ; Sat, 17 Nov 2018 01:43:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id C0F907411C for ; Sat, 17 Nov 2018 01:43:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 80896110C8D2; Sat, 17 Nov 2018 01:43:44 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5C025110C8D1 for ; Sat, 17 Nov 2018 01:43:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id EBB297411A for ; Sat, 17 Nov 2018 01:43:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 09C47EC90 for ; Sat, 17 Nov 2018 01:43:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wAH1hgBU093684 for ; Sat, 17 Nov 2018 01:43:42 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wAH1hg8c093683 for fs@FreeBSD.org; Sat, 17 Nov 2018 01:43:42 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 233245] [UFS] [enhancement] Softupdates fails to track dependency between appended data and i_size Date: Sat, 17 Nov 2018 01:43:41 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: C0F907411C X-Spamd-Result: default: False [0.70 / 15.00]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; local_wl_from(0.00)[freebsd.org]; NEURAL_SPAM_SHORT(0.70)[0.701,0] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 17 Nov 2018 01:43:45 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D233245 --- Comment #6 from Kirk McKusick --- (In reply to Conrad Meyer from comment #5) > I would be happy to assign it to myself to take it off the fs@ list, if t= hat > seems most reasonable to everybody. I have no objection to it being on the fs@ list. That way I see any dialog = that happens on it. But if you decide to take it off the fs@ list, then please a= dd me explicitly. > Do you know of any additional good resources I can read for the specific > dependency graph behavior / rollback semantics of SU? I have the FreeBSD > D&I 2e book of course, and the source code is the final word. But if you > have any additional references you can share, I would appreciate it. In about 2000 I used the `special topics' lecture of my advanced code readi= ng class to do a walk-through of the soft updates code. It is a 2.5 hour video= of me going through softdep.h and ffs_softdep.c. It predates the addition of t= he journaling support, so reflects a simpler time, but is probably still usefu= l to get a general understanding. I would be willing to make the video available= to you if you want to watch it. > (Tangential to this enhancement, I might take a pass cleaning up the plain > English of the ffs_softdep.c comment blocks. They are thorough, but tend= to > lack visual separation and thus do not scan easily. Additionally, some > references to specific objects are quoted, while others are not. It might > help me understand SU better to do a pass making an attempt to help others > understand SU better. :-)) I believe that commenting code is very important and have tried to do a good job of it in the soft updates code. So I strongly encourage you to work to improve it. Often the original author overlooks things that seem obvious to them but in fact are confusing to those that are not intimately familiar wi= th the code. So filling in those gaps is a valuable addition. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Sat Nov 17 05:21:17 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 10CD51125E06 for ; Sat, 17 Nov 2018 05:21:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 820F37ADEB for ; Sat, 17 Nov 2018 05:21:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 410821125E05; Sat, 17 Nov 2018 05:21:16 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 037131125E04 for ; Sat, 17 Nov 2018 05:21:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8D5D57ADE0 for ; Sat, 17 Nov 2018 05:21:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id AAF9D10B39 for ; Sat, 17 Nov 2018 05:21:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wAH5LE7s090298 for ; Sat, 17 Nov 2018 05:21:14 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wAH5LEhJ090281 for fs@FreeBSD.org; Sat, 17 Nov 2018 05:21:14 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 233245] [UFS] [enhancement] Softupdates fails to track dependency between appended data and i_size Date: Sat, 17 Nov 2018 05:21:14 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: cem@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: 820F37ADEB X-Spamd-Result: default: False [0.65 / 15.00]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; local_wl_from(0.00)[freebsd.org]; NEURAL_SPAM_SHORT(0.65)[0.651,0] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 17 Nov 2018 05:21:17 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D233245 --- Comment #7 from Conrad Meyer --- (In reply to Kirk McKusick from comment #6) Ok, I will leave it on the fs list then. > In about 2000 I used the `special topics' lecture of my advanced code rea= ding > class to do a walk-through of the soft updates code. It is a 2.5 hour vid= eo of > me going through softdep.h and ffs_softdep.c. It predates the addition of= the > journaling support, so reflects a simpler time, but is probably still use= ful to > get a general understanding. I would be willing to make the video availab= le to > you if you want to watch it. I think my employer has licensed some of your video series, but none specifically annotated as around 2000. I see a 2006 "data structures" seri= es where #6 covers UFS, including SU, and a 2009 "intensive code walkthrough" series where #15 is a "special topics," including soft updates. I don't suppose you're referring to one of those? If not, I would certainly apprec= iate a copy of the video. > I believe that commenting code is very important and have tried to do a g= ood > job of it in the soft updates code. So I strongly encourage you to work to > improve it. Often the original author overlooks things that seem obvious = to > them but in fact are confusing to those that are not intimately familiar = with > the code. Absolutely! > So filling in those gaps is a valuable addition. Ok, great. Sounds like I have plenty of direction in how to proceed. :-) --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Sat Nov 17 21:29:25 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B4C4311067E0 for ; Sat, 17 Nov 2018 21:29:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 4E9FE80941 for ; Sat, 17 Nov 2018 21:29:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 13D8F11067DC; Sat, 17 Nov 2018 21:29:25 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 027A911067DB for ; Sat, 17 Nov 2018 21:29:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 819E38093D for ; Sat, 17 Nov 2018 21:29:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id B9E7518EB9 for ; Sat, 17 Nov 2018 21:29:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wAHLTN23021673 for ; Sat, 17 Nov 2018 21:29:23 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wAHLTNfR021672 for fs@FreeBSD.org; Sat, 17 Nov 2018 21:29:23 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 233277] Panic when receiving incremental ZFS send (solaris assert: db->db_buf == ((void *)0)) Date: Sat, 17 Nov 2018 21:29:23 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: delphij@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: 4E9FE80941 X-Spamd-Result: default: False [0.55 / 15.00]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; local_wl_from(0.00)[freebsd.org]; NEURAL_SPAM_SHORT(0.55)[0.548,0] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 17 Nov 2018 21:29:25 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D233277 Xin LI changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.=