From owner-freebsd-hackers@freebsd.org Sat Jul 6 23:14:51 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BA1E915D5C62 for ; Sat, 6 Jul 2019 23:14:51 +0000 (UTC) (envelope-from me@yadavpratyush.com) Received: from relay2-d.mail.gandi.net (relay2-d.mail.gandi.net [217.70.183.194]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B03E685E1A for ; Sat, 6 Jul 2019 23:14:49 +0000 (UTC) (envelope-from me@yadavpratyush.com) X-Originating-IP: 209.85.208.45 Received: from mail-ed1-f45.google.com (mail-ed1-f45.google.com [209.85.208.45]) (Authenticated sender: me@yadavpratyush.com) by relay2-d.mail.gandi.net (Postfix) with ESMTPSA id 4910840006 for ; Sat, 6 Jul 2019 23:14:16 +0000 (UTC) Received: by mail-ed1-f45.google.com with SMTP id w13so11080603eds.4 for ; Sat, 06 Jul 2019 16:14:16 -0700 (PDT) X-Gm-Message-State: APjAAAVO4+aqY6bQV0XhkVUnMsfBFwaret4w8VE/pdJHetEM7fIviTHx 46sK17Vr6b5KoxifQP3ZyGw+aOa85A8foBafXog= X-Google-Smtp-Source: APXvYqyopkkhnnUDCqjbG4/mpa+0asC7wsSYKPmx4/zN2MmHMmrWL2atmXmgEMkWQYaiRXI6ukcUmOiAPqw4BZlWyKk= X-Received: by 2002:a50:b13b:: with SMTP id k56mr12377174edd.192.1562454856713; Sat, 06 Jul 2019 16:14:16 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Pratyush Yadav Date: Sun, 7 Jul 2019 04:43:40 +0530 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Secure urls in kernel? To: Unidef Cc: Hackers freeBSD Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: B03E685E1A X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of me@yadavpratyush.com designates 217.70.183.194 as permitted sender) smtp.mailfrom=me@yadavpratyush.com X-Spamd-Result: default: False [-2.81 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:217.70.183.192/28]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; DMARC_NA(0.00)[yadavpratyush.com]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[spool.mail.gandi.net,fb.mail.gandi.net]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.56)[-0.564,0]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; RCVD_TLS_LAST(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[194.183.70.217.list.dnswl.org : 127.0.5.1]; R_DKIM_NA(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:29169, ipnet:217.70.176.0/20, country:FR]; MIME_TRACE(0.00)[0:+]; IP_SCORE(-0.84)[ip: (-2.15), ipnet: 217.70.176.0/20(-1.12), asn: 29169(-0.91), country: FR(-0.01)]; FROM_EQ_ENVFROM(0.00)[] X-Mailman-Approved-At: Sun, 07 Jul 2019 00:16:21 +0000 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 06 Jul 2019 23:14:51 -0000 On Sat, 6 Jul 2019 at 10:57, Unidef wrote: > > I was thinking about embedding encrypted JavaScript in a :a h ref ; tag and thought about an injection hack, so is it hard to implement some kind of pointer function exception handling in the kernel? I have to read the FreeBSD kernel book :( Does this make any sense to any of you folks? Because all I read is gibberish. This person's last post was similarly full of this kind of gibberish. > Sent from my iPhone > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" -- Regards, Pratyush Yadav From owner-freebsd-hackers@freebsd.org Sun Jul 7 00:43:31 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 54DA615D7A34 for ; Sun, 7 Jul 2019 00:43:31 +0000 (UTC) (envelope-from yuri@rawbw.com) Received: from shell1.rawbw.com (shell1.rawbw.com [198.144.192.42]) by mx1.freebsd.org (Postfix) with ESMTP id F127289000 for ; Sun, 7 Jul 2019 00:43:29 +0000 (UTC) (envelope-from yuri@rawbw.com) Received: from yv.noip.me (c-67-180-169-236.hsd1.ca.comcast.net [67.180.169.236]) (authenticated bits=0) by shell1.rawbw.com (8.15.1/8.15.1) with ESMTPSA id x670hRn8081384 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO) for ; Sat, 6 Jul 2019 17:43:28 -0700 (PDT) (envelope-from yuri@rawbw.com) X-Authentication-Warning: shell1.rawbw.com: Host c-67-180-169-236.hsd1.ca.comcast.net [67.180.169.236] claimed to be yv.noip.me To: Freebsd hackers list From: Yuri Subject: What is the best way for the process to determine that it runs in jail? Message-ID: Date: Sat, 6 Jul 2019 17:43:26 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.6.1 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US X-Rspamd-Queue-Id: F127289000 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of yuri@rawbw.com designates 198.144.192.42 as permitted sender) smtp.mailfrom=yuri@rawbw.com X-Spamd-Result: default: False [-4.55 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:198.144.192.32/27]; HAS_XAW(0.00)[]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: mx.rawbw.net]; NEURAL_HAM_SHORT(-0.81)[-0.805,0]; RCVD_NO_TLS_LAST(0.10)[]; RECEIVED_SPAMHAUS_PBL(0.00)[236.169.180.67.zen.spamhaus.org : 127.0.0.10]; MIME_TRACE(0.00)[0:+]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:7961, ipnet:198.144.192.0/20, country:US]; SUBJECT_ENDS_QUESTION(1.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; DMARC_NA(0.00)[rawbw.com]; RCPT_COUNT_ONE(0.00)[1]; IP_SCORE(-2.54)[ip: (-5.76), ipnet: 198.144.192.0/20(-3.17), asn: 7961(-3.71), country: US(-0.06)]; RCVD_IN_DNSWL_NONE(0.00)[42.192.144.198.list.dnswl.org : 127.0.10.0]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 07 Jul 2019 00:43:31 -0000 I found online that it is possible to stat the root folder and find its inode number. The inode number is 2 when the root is on UFS, and 4 if the root is on ZFS. This looks pretty hackish to me. Is this reliable? Is there a better/best way? Thank you, Yuri From owner-freebsd-hackers@freebsd.org Sun Jul 7 01:05:32 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8C6E115D81B3 for ; Sun, 7 Jul 2019 01:05:32 +0000 (UTC) (envelope-from SRS0=IBcZ=VE=vega.codepro.be=kp@codepro.be) Received: from mercury.codepro.be (mercury.codepro.be [IPv6:2001:4b98:dc0:41:216:3eff:fe31:eda8]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "monitoring.codepro.be", Issuer "Let's Encrypt Authority X3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id EAD1789D91 for ; Sun, 7 Jul 2019 01:05:31 +0000 (UTC) (envelope-from SRS0=IBcZ=VE=vega.codepro.be=kp@codepro.be) Received: from venus.codepro.be (venus.codepro.be [5.9.86.228]) by mercury.codepro.be (Postfix) with ESMTPS id C649290486; Sun, 7 Jul 2019 01:03:56 +0000 (UTC) Received: from vega.codepro.be (unknown [172.16.1.3]) by venus.codepro.be (Postfix) with ESMTP id 3656317609; Sun, 7 Jul 2019 03:05:28 +0200 (CEST) Received: by vega.codepro.be (Postfix, from userid 1001) id EA83127844; Sun, 7 Jul 2019 03:05:27 +0200 (CEST) Date: Sun, 7 Jul 2019 03:05:27 +0200 From: Kristof Provost To: Yuri Cc: Freebsd hackers list Subject: Re: What is the best way for the process to determine that it runs in jail? Message-ID: <20190707010526.GD10541@vega.codepro.be> References: MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline In-Reply-To: X-Checked-By-NSA: Probably User-Agent: Mutt/1.11.4 (2019-03-13) X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 07 Jul 2019 01:05:32 -0000 On 2019-07-06 17:43:26 (-0700), Yuri wrote: > I found online that it is possible to stat the root folder and find its > inode number. > > The inode number is 2 when the root is on UFS, and 4 if the root is on ZFS. > > This looks pretty hackish to me. Is this reliable? > It's possible for a jail to use the root file system, so no. > Is there a better/best way? > sysctl security.jail.jailed Kristof From owner-freebsd-hackers@freebsd.org Mon Jul 8 18:12:33 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E3F0C15E5856 for ; Mon, 8 Jul 2019 18:12:32 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [IPv6:2a01:4f8:c2c:26d8::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id CF74983692 for ; Mon, 8 Jul 2019 18:12:31 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (eg.sd.rdtc.ru [IPv6:2a03:3100:c:13:0:0:0:5]) by hz.grosbein.net (8.15.2/8.15.2) with ESMTPS id x68ICRCm042369 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 8 Jul 2019 18:12:28 GMT (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: yuri@rawbw.com Received: from [10.58.0.4] ([10.58.0.4]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTPS id x68ICOel091899 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT); Tue, 9 Jul 2019 01:12:24 +0700 (+07) (envelope-from eugen@grosbein.net) Subject: Re: What is the best way for the process to determine that it runs in jail? To: Yuri , Freebsd hackers list References: From: Eugene Grosbein Message-ID: Date: Tue, 9 Jul 2019 01:12:18 +0700 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM, SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 0.0 SPF_HELO_NONE SPF: HELO does not publish an SPF Record * -0.0 SPF_PASS SPF: sender matches SPF record * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on hz.grosbein.net X-Rspamd-Queue-Id: CF74983692 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; spf=permerror (mx1.freebsd.org: domain of eugen@grosbein.net uses mechanism not recognized by this client) smtp.mailfrom=eugen@grosbein.net X-Spamd-Result: default: False [-1.69 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.995,0]; MX_INVALID(0.50)[cached]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-0.999,0]; MIME_GOOD(-0.10)[text/plain]; MIME_TRACE(0.00)[0:+]; DMARC_NA(0.00)[grosbein.net]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; R_SPF_PERMFAIL(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.34)[-0.344,0]; IP_SCORE(-0.75)[ipnet: 2a01:4f8::/29(-1.95), asn: 24940(-1.79), country: DE(-0.01)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Jul 2019 18:12:33 -0000 07.07.2019 7:43, Yuri wrote: > I found online that it is possible to stat the root folder and find its inode number. > > The inode number is 2 when the root is on UFS, and 4 if the root is on ZFS. > > This looks pretty hackish to me. Is this reliable? > > Is there a better/best way? We have check_jail subroutine in the /etc/rc.subr that is supposed to be called with single "jailed" argument so it just checks if sysctl security.jail.jailed exists and set to 1. We have sysctlbyname(3) function of out libc to do same in C. From owner-freebsd-hackers@freebsd.org Mon Jul 8 18:22:52 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2CA8E15E5BFF for ; Mon, 8 Jul 2019 18:22:52 +0000 (UTC) (envelope-from p3tharris@rediffmail.com) Received: from f5mail-147-106.rediffmail.com (f5mail-147-106.rediffmail.com [119.252.147.106]) by mx1.freebsd.org (Postfix) with ESMTP id 815B883E86 for ; Mon, 8 Jul 2019 18:22:49 +0000 (UTC) (envelope-from p3tharris@rediffmail.com) Received: from rediffmail.com (unknown [10.50.252.5]) by f5mail-147-106.rediffmail.com (Postfix) with SMTP id AE5BF14480E for ; Mon, 8 Jul 2019 23:54:27 +0530 (IST) Received: (qmail 4700 invoked by uid 510); 8 Jul 2019 18:22:32 -0000 x-m-msg: asd54ad564ad7aa6sd5as6d5; a6da7d6asas6dasd77; 5dad65ad5sd; X-OUT-VDRT-SpamState: 0\LEGIT X-OUT-VDRT-SpamScore: 0 X-OUT-VDRT-SpamCause: gggruggvucftvghtrhhoucdtuddrgeduvddrgedtgdduvdejucetufdoteggodetrfdotffvucfrrhhofhhilhgvmecutffgfffkhffhpdfqfgfvnecuuegrihhlohhuthemuceftddtnecunecujfgurhepfffkggfvshfuhfgtsegrtddvredttdejnecuhfhrohhmpedfrfgvthgvrhcujfgrrhhrihhsfdcuoehpfehthhgrrhhrihhssehrvgguihhffhhmrghilhdrtghomheqnecukfhppedvvdefrddvfeefrdeliedrvdduvdenucfrrghrrghmpehmohguvgepshhmthhpohhuthenucevlhhushhtvghrufhiiigvpedt X-Remote-IP: 223.233.96.212 X-REDF-OSEN: p3tharris@rediffmail.com Date: 8 Jul 2019 18:22:32 -0000 Message-ID: <20190708182232.4685.qmail@f5mail-224-122.rediffmail.com> MIME-Version: 1.0 To: Received: from unknown 223.233.96.212 by rediffmail.com via HTTP; 08 Jul 2019 18:22:32 -0000 X-Senderscore: D=0&S=0 Sender: p3tharris@rediffmail.com Subject: =?utf-8?B?dGVzdCBtb2RpZmllZCBmcmVlYnNkIHNvdXJjZQ==?= From: "Peter Harris" X-Rspamd-Queue-Id: 815B883E86 X-Spamd-Bar: +++ X-Spamd-Result: default: False [3.82 / 15.00]; SUBJ_EXCESS_BASE64(1.50)[]; R_SPF_ALLOW(-0.20)[+ip4:119.252.144.0/20]; FREEMAIL_FROM(0.00)[rediffmail.com]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[rediffmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[rediffmail.com,quarantine]; MX_GOOD(-0.01)[mx.rediffmail.rediff.akadns.net]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; FREEMAIL_ENVFROM(0.00)[rediffmail.com]; ASN(0.00)[asn:38224, ipnet:119.252.147.0/24, country:IN]; IP_SCORE(0.55)[asn: 38224(2.69), country: IN(0.05)]; DWL_DNSWL_NONE(0.00)[rediffmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[rediffmail.com:s=mail]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.99)[0.993,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; NEURAL_SPAM_MEDIUM(0.99)[0.990,0]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_SPAM_LONG(0.70)[0.703,0]; RCVD_IN_DNSWL_NONE(0.00)[106.147.252.119.list.dnswl.org : 127.0.5.0] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Jul 2019 18:22:52 -0000 Hi guys, I am currently pursuing my internship and new to freebsd (switched from Ubuntu). Its gonna get used at my work. I have the responsibility to make some modifications and customise source tree as per the demands.Can i get some suggestions on what would be the best way to test the changes i make? Majorly I need to make changes to the current commands and some minor changes to the kernal. I haven't done such a task before (like building a complete OS) so i am pretty much clueless. Would really appreciate getting some help. Kind regards, Peter From owner-freebsd-hackers@freebsd.org Mon Jul 8 19:04:06 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7092F15E6D49 for ; Mon, 8 Jul 2019 19:04:06 +0000 (UTC) (envelope-from reichert@numachi.com) Received: from away.numachi.com (away.numachi.com [66.228.38.138]) by mx1.freebsd.org (Postfix) with SMTP id D1E9F86422 for ; Mon, 8 Jul 2019 19:03:55 +0000 (UTC) (envelope-from reichert@numachi.com) Received: (qmail 3267 invoked from network); 8 Jul 2019 18:57:13 -0000 Received: from unknown (HELO meisai.numachi.com) (72.71.251.201) by away.numachi.com with SMTP; 8 Jul 2019 18:57:13 -0000 Received: (qmail 10439 invoked by uid 1001); 8 Jul 2019 18:57:13 -0000 Date: Mon, 8 Jul 2019 14:57:13 -0400 From: Brian Reichert To: Peter Harris Cc: freebsd-hackers@freebsd.org Subject: Re: test modified freebsd source Message-ID: <20190708185713.GS49325@numachi.com> References: <20190708182232.4685.qmail@f5mail-224-122.rediffmail.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20190708182232.4685.qmail@f5mail-224-122.rediffmail.com> User-Agent: Mutt/1.5.9i X-Rspamd-Queue-Id: D1E9F86422 X-Spamd-Bar: +++++ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [5.24 / 15.00]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; NEURAL_SPAM_SHORT(0.98)[0.984,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[numachi.com]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(1.00)[1.000,0]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[back.numachi.com]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_SPAM_LONG(1.00)[1.000,0]; R_SPF_NA(0.00)[]; FREEMAIL_TO(0.00)[rediffmail.com]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:63949, ipnet:66.228.32.0/20, country:US]; MID_RHS_MATCH_FROM(0.00)[]; IP_SCORE(0.77)[ipnet: 66.228.32.0/20(4.69), asn: 63949(-0.80), country: US(-0.06)] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Jul 2019 19:04:06 -0000 On Mon, Jul 08, 2019 at 06:22:32PM -0000, Peter Harris via freebsd-hackers wrote: > Hi guys, I am currently pursuing my internship and new to freebsd (switched from Ubuntu). Its gonna get used at my work. I have the responsibility to make some modifications and customise source tree as per the demands.Can i get some suggestions on what would be the best way to test the changes i make? Majorly I need to make changes to the current commands and some minor changes to the kernal. I haven't done such a task before (like building a complete OS) so i am pretty much clueless. Would really appreciate getting some help. Kind regards, Peter How extensive are your changes? You can build an entire release: https://www.freebsd.org/doc/en_US.ISO8859-1/articles/releng/release-build.html You can build everything other than the kernel, or the kernel itself: https://www.freebsd.org/doc/handbook/makeworld.html Without knowing what your changes will be, describing testing is a challenge. > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" -- Brian Reichert BSD admin/developer at large From owner-freebsd-hackers@freebsd.org Mon Jul 8 19:21:08 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 40AC415E7794 for ; Mon, 8 Jul 2019 19:21:08 +0000 (UTC) (envelope-from p3tharris@rediffmail.com) Received: from f5mail-147-105.rediffmail.com (f5mail-147-105.rediffmail.com [119.252.147.105]) by mx1.freebsd.org (Postfix) with ESMTP id EC55887354 for ; Mon, 8 Jul 2019 19:21:06 +0000 (UTC) (envelope-from p3tharris@rediffmail.com) Received: from rediffmail.com (unknown [10.50.252.5]) by f5mail-147-105.rediffmail.com (Postfix) with SMTP id 27B7F584198 for ; Tue, 9 Jul 2019 00:52:57 +0530 (IST) Received: (qmail 7829 invoked by uid 510); 8 Jul 2019 19:20:49 -0000 x-m-msg: asd54ad564ad7aa6sd5as6d5; a6da7d6asas6dasd77; 5dad65ad5sd; X-OUT-VDRT-SpamState: 0\LEGIT X-OUT-VDRT-SpamScore: -100 X-OUT-VDRT-SpamCause: gggruggvucftvghtrhhoucdtuddrgeduvddrgedtgddugedtucetufdoteggodetrfdotffvucfrrhhofhhilhgvmecutffgfffkhffhpdfqfgfvnecuuegrihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnthhsucdlqddutddtmdenucfjughrpeffggfvkfhsuffhtgesrgdtreertddtjeenucfhrhhomhepfdfrvghtvghrucfjrghrrhhishdfuceophefthhhrghrrhhishesrhgvughifhhfmhgrihhlrdgtohhmqeenucffohhmrghinhepfhhrvggvsghsugdrohhrghenucfkphepvddvfedrvdeffedrleeirddvuddvnecurfgrrhgrmhepmhhouggvpehsmhhtphhouhhtnecuvehluhhsthgvrhfuihiivgeptd X-Remote-IP: 223.233.96.212 X-REDF-OSEN: p3tharris@rediffmail.com Date: 8 Jul 2019 19:20:49 -0000 MIME-Version: 1.0 To: "Brian Reichert" Received: from unknown 223.233.96.212 by rediffmail.com via HTTP; 08 Jul 2019 19:20:49 -0000 X-Senderscore: D=0&S=0 Message-ID: <1562613206.S.11643.autosave.drafts.1562613649.7797@webmail.rediffmail.com> Sender: p3tharris@rediffmail.com Subject: =?utf-8?B?UmU6IHRlc3QgbW9kaWZpZWQgZnJlZWJzZCBzb3VyY2U=?= From: "Peter Harris" Cc: "freebsd-hackers@freebsd.org" X-Rspamd-Queue-Id: EC55887354 X-Spamd-Bar: ++++ X-Spamd-Result: default: False [4.90 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; SUBJ_EXCESS_BASE64(1.50)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:119.252.144.0/20]; FREEMAIL_FROM(0.00)[rediffmail.com]; RCVD_COUNT_THREE(0.00)[4]; MX_GOOD(-0.01)[cached: mx.rediffmail.rediff.akadns.net]; DKIM_TRACE(0.00)[rediffmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[rediffmail.com,quarantine]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; FREEMAIL_ENVFROM(0.00)[rediffmail.com]; ASN(0.00)[asn:38224, ipnet:119.252.147.0/24, country:IN]; IP_SCORE(0.51)[asn: 38224(2.52), country: IN(0.05)]; DWL_DNSWL_NONE(0.00)[rediffmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; FAKE_REPLY(1.00)[]; R_DKIM_ALLOW(-0.20)[rediffmail.com:s=mail]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.88)[0.878,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; NEURAL_SPAM_MEDIUM(0.98)[0.978,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_SPAM_LONG(0.94)[0.938,0]; RCVD_IN_DNSWL_NONE(0.00)[105.147.252.119.list.dnswl.org : 127.0.5.0] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Jul 2019 19:21:08 -0000 I need to make changes to commands like chmod, arp, chown etc. which reside in /usr/bin, /usr/sbin, /bin and /sbin. I need to make minor changes in kernal too, but that's for later. The only way I see as of now is to make a freebsd install and test sources after changes within it. Is there a better way around? Thanks for the support,Peter From: Brian Reichert <reichert@numachi.com> Sent: Tue, 9 Jul 2019 00:27:35 GMT+0530 To: Peter Harris <p3tharris@rediffmail.com> Subject: Re: test modified freebsd source On Mon, Jul 08, 2019 at 06:22:32PM -0000, Peter Harris via freebsd-hackers wrote: > Hi guys, I am currently pursuing my internship and new to freebsd (switched from Ubuntu). Its gonna get used at my work. I have the responsibility to make some modifications and customise source tree as per the demands.Can i get some suggestions on what would be the best way to test the changes i make? Majorly I need to make changes to the current commands and some minor changes to the kernal. I haven&#x27;t done such a task before (like building a complete OS) so i am pretty much clueless. Would really appreciate getting some help. Kind regards, Peter How extensive are your changes? You can build an entire release:  https://www.freebsd.org/doc/en_US.ISO8859-1/articles/releng/release-build.html You can build everything other than the kernel, or the kernel itself:  https://www.freebsd.org/doc/handbook/makeworld.html Without knowing what your changes will be, describing testing is a challenge. > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" -- Brian Reichert            <reichert@numachi.com> BSD admin/developer at large    From owner-freebsd-hackers@freebsd.org Mon Jul 8 19:32:53 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 775AE15E7DF0 for ; Mon, 8 Jul 2019 19:32:53 +0000 (UTC) (envelope-from lwhsu.freebsd@gmail.com) Received: from mail-yb1-f173.google.com (mail-yb1-f173.google.com [209.85.219.173]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 823E388076 for ; Mon, 8 Jul 2019 19:32:52 +0000 (UTC) (envelope-from lwhsu.freebsd@gmail.com) Received: by mail-yb1-f173.google.com with SMTP id p85so5115336yba.2 for ; Mon, 08 Jul 2019 12:32:52 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=o1DyccncjZU6wq/UplgDBkG5FM5q7bu+ocSuHTYZZz8=; b=brSiLO7jkvQuCmdd7GQUHyqmpC7Me+5iYCqeGrjDnUEd3XoS1jvmHIKSo36BznSbKU xCMazXW2fkNgmLleMe9ybRHVw29ST7AQi4bj24tHPEAvFjBhqYMvYJ7z4bRFe3eKMJ8m /e/CTmR28yPuX9qRPKBmqWkEBGZ1sIPleGTSVvlu725qVAtkA86SHwz2rmKFB3wHHZez DSuKp11xH0SzUMC19ln9eBXq29f4L0Q5cQI3eRvLTw00isSb62ii86CLe4c2JG6XVSFd 9NuYX2s7HdY2GbLupW2YQ2gDAwRc/nl1gmezPbQsiRpIBMfpOoP2yra9L4j465Qq+0kH C8Gg== X-Gm-Message-State: APjAAAXU7o9nH24idPeFTMPmlS84ylkZ+0jYEND3ivTodZA0jecqHsiZ pX11wxOwTvvMjiVYoSNzvTRODHp5qT7RYhZ7Oi8H+Ign X-Google-Smtp-Source: APXvYqyXXpma62LJzbk2Jy40baP4drAt40jqwFg5jia34rxW7K0md1lwvxgiT7Y5Mu0BLO1rLcvXFc90idreag7+JVA= X-Received: by 2002:a25:a265:: with SMTP id b92mr11339187ybi.451.1562614365699; Mon, 08 Jul 2019 12:32:45 -0700 (PDT) MIME-Version: 1.0 References: <1562613206.S.11643.autosave.drafts.1562613649.7797@webmail.rediffmail.com> In-Reply-To: <1562613206.S.11643.autosave.drafts.1562613649.7797@webmail.rediffmail.com> From: Li-Wen Hsu Date: Tue, 9 Jul 2019 03:32:33 +0800 Message-ID: Subject: Re: test modified freebsd source To: Peter Harris Cc: Brian Reichert , "freebsd-hackers@freebsd.org" Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 823E388076 X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of lwhsufreebsd@gmail.com designates 209.85.219.173 as permitted sender) smtp.mailfrom=lwhsufreebsd@gmail.com X-Spamd-Result: default: False [-5.85 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.85)[-0.845,0]; FORGED_SENDER(0.30)[lwhsu@freebsd.org,lwhsufreebsd@gmail.com]; FREEMAIL_TO(0.00)[rediffmail.com]; IP_SCORE(-3.00)[ip: (-9.06), ipnet: 209.85.128.0/17(-3.46), asn: 15169(-2.40), country: US(-0.06)]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; TAGGED_FROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; FROM_NEQ_ENVFROM(0.00)[lwhsu@freebsd.org,lwhsufreebsd@gmail.com]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; MIME_TRACE(0.00)[0:+]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[173.219.85.209.list.dnswl.org : 127.0.5.0]; RCVD_TLS_LAST(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Jul 2019 19:32:53 -0000 You can try to run the test suite https://wiki.freebsd.org/TestSuite and compare the results of the latest build at https://ci.freebsd.org There is a mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-testing for discussing testing related topics. Li-Wen On Tue, Jul 9, 2019 at 3:22 AM Peter Harris via freebsd-hackers wrote: > > I need to make changes to commands like chmod, arp, chown etc. which resi= de in /usr/bin, /usr/sbin, /bin and /sbin. I = need to make minor changes in kernal too, but that's for later. The on= ly way I see as of now is to make a freebsd install and test sources after = changes within it. Is there a better way around? Thanks for the support,Pet= er > > > > From: Brian Reichert <reichert@numachi.com> > Sent: Tue, 9 Jul 2019 00:27:35 GMT+0530 > To: Peter Harris <p3tharris@rediffmail.com> > Subject: Re: test modified freebsd source > > On Mon, Jul 08, 2019 at 06:22:32PM -0000, Peter Harris via freebsd-hacker= s wrote: > > > Hi guys, I am currently pursuing my internship and new to freebsd (s= witched from Ubuntu). Its gonna get used at my work. I have the responsibil= ity to make some modifications and customise source tree as per the demands= .Can i get some suggestions on what would be the best way to test the chang= es i make? Majorly I need to make changes to the current commands and some = minor changes to the kernal. I haven&#x27;t done such a task before (li= ke building a complete OS) so i am pretty much clueless. Would really appre= ciate getting some help. Kind regards, Peter > > > > How extensive are your changes? > > > > You can build an entire release: > > > >  https://www.freebsd.org/doc/en_US.ISO8859-1/articles/releng/releas= e-build.html > > > > You can build everything other than the kernel, or the kernel itself: > > > >  https://www.freebsd.org/doc/handbook/makeworld.html > > > > Without knowing what your changes will be, describing testing is a > > challenge. > > > > > > > > > > > _______________________________________________ > > > freebsd-hackers@freebsd.org mailing list > > > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > > > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebs= d.org" > > > > -- > > Brian Reichert          = ;  <reichert@numachi.com> > > BSD admin/developer at large    > > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org= " From owner-freebsd-hackers@freebsd.org Tue Jul 9 23:35:02 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7EF8F15E87D5 for ; Tue, 9 Jul 2019 23:35:02 +0000 (UTC) (envelope-from john@kozubik.com) Received: from kozubik.com (kozubik.com [216.218.240.130]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 7A4608C3EA for ; Tue, 9 Jul 2019 23:35:01 +0000 (UTC) (envelope-from john@kozubik.com) Received: from kozubik.com (localhost [127.0.0.1]) by kozubik.com (8.14.3/8.14.3) with ESMTP id x69NTnlM062019 for ; Tue, 9 Jul 2019 16:29:49 -0700 (PDT) (envelope-from john@kozubik.com) Received: from localhost (john@localhost) by kozubik.com (8.14.3/8.14.3/Submit) with ESMTP id x69NTitS062016 for ; Tue, 9 Jul 2019 16:29:44 -0700 (PDT) (envelope-from john@kozubik.com) Date: Tue, 9 Jul 2019 16:29:44 -0700 (PDT) From: John Kozubik To: freebsd-hackers@freebsd.org Subject: How many "production" releases will FreeBSD have when the ZoL merge comes in ? Message-ID: User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; format=flowed; charset=US-ASCII X-Rspamd-Queue-Id: 7A4608C3EA X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of john@kozubik.com designates 216.218.240.130 as permitted sender) smtp.mailfrom=john@kozubik.com X-Spamd-Result: default: False [-2.68 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.91)[-0.911,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; MIME_TRACE(0.00)[0:+]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_NONE(0.00)[]; RCVD_IN_DNSWL_MED(-0.20)[130.240.218.216.list.dnswl.org : 127.0.6.2]; MX_GOOD(-0.01)[kozubik.com]; DMARC_NA(0.00)[kozubik.com]; NEURAL_HAM_SHORT(-0.70)[-0.704,0]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:6939, ipnet:216.218.128.0/17, country:US]; MID_RHS_MATCH_FROM(0.00)[]; IP_SCORE(-0.55)[ipnet: 216.218.128.0/17(0.40), asn: 6939(-3.12), country: US(-0.06)] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Jul 2019 23:35:02 -0000 Friends, I am confused as to how the ZFS On Linux merge will be available before 2022. The current supported release lifecycle page states: "11.4-RELEASE + 3 months (or September 30, 2021)" ... and I have heard very pessimistic responses about the ZoL merge going into the 12 branch. So I *think* that one of the following must be true: - We will, at some point, have *three* production branches with -RELEASE distributions: 11, 12 and 13. - ZoL will actually come into the 12 branch, despite recent pessimism. - Neither of the above: ZoL comes in the 13 branch, which will not overlap with the 11 branch, which means (basically) 2022 as the earliest production (-RELEASE) version of FreeBSD with ZoL. Some background ... We at rsync.net, which runs exclusively on FreeBSD, are *dying* to get native encryption and raw send. As you can imagine, we can only run -RELEASE versions of FreeBSD. We really want to give Linux users the ability to 'zfs send' to their rsync.net accounts like FreeBSD users do, but 13.1-RELEASE[1] is a *long* way off - perhaps over three years from now. Three simultaneous "production" releases seems silly. So that leaves ZoL coming in the 12 branch as the only outcome that isn't terrible news. I wonder if there is any of the above that I am mistaken about, or some news I have missed ? Thanks, John Kozubik [1] In practice, we also don't run x.0 releases in production which sounds bigoted and superstitious but I can point to 5.0-RELEASE and you need no further explanation. From owner-freebsd-hackers@freebsd.org Wed Jul 10 07:07:09 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6FFA815CCB75 for ; Wed, 10 Jul 2019 07:07:09 +0000 (UTC) (envelope-from damian@damianek.be) Received: from mail-io1-xd30.google.com (mail-io1-xd30.google.com [IPv6:2607:f8b0:4864:20::d30]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 14B7474721 for ; Wed, 10 Jul 2019 07:07:07 +0000 (UTC) (envelope-from damian@damianek.be) Received: by mail-io1-xd30.google.com with SMTP id k8so2532098iot.1 for ; Wed, 10 Jul 2019 00:07:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=damianek-be.20150623.gappssmtp.com; s=20150623; h=mime-version:from:date:message-id:subject:to; bh=MKjlOTufMk193dZ80Y6psYbUiqKfKSbmbNVhtZHVoJ0=; b=GbUBUk4NfCoWYUMwMm+av8C6JcAkPa3AgS9syeajArnAbLkbBLStTACuy5/ooqWoGU yhPgc2iSQUAUeAKXhYhJPkp/KljxkeIBgQi9PY+7psvZ35Bvf1+xxADDrKiA6u/U1zEJ OGX446cGlkepBKU8xC67JwIcp9Brt80dhSvep3SG+prxTwPgAVcONJrSZTKWmOuxUn9m sqtcROAZZBY8haLGWbUd7XRKBogsDNjr1+1isbCOkRBsLR+mLBPjtDK+KlQ/iaEp6UbG CgxuBVSMPAQ5jP73VB4rGvJVjbwWtdEOXJmrPeC/MIE6Aiu+xppV7iAxZFP40lrRn+de xoMA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=MKjlOTufMk193dZ80Y6psYbUiqKfKSbmbNVhtZHVoJ0=; b=TVivp+Oqx5e5MylQpRxkFP+YxJftOgRrTzsHTiWhB0EtBn/roquB6IrZHRv060wZ9m tciYmUfeai+VU6dJIRoJeLpjKzVL33UvMqVm1SOeY6Nwtxx7/qh41ZAFOg0zEvRQZLee 1HcspXVxeDWJCSjSmAdG1JdwC5LhdoOLipmv2Wpy2cD4siNflwnEheOfMu5wj0RgT+qi k5vwGdgqUy1kDYO8EojXELGIWAtgwM5JFXKR+9A3PyfAha1kwJ/JheMQBBb++tQcA7DT iBcWJQchqznCbeE+lP+VPAsoei5qVowPXhq1y6LK6nbbVqJgM+kvdxvSc8aHPdVVrn3U nR1Q== X-Gm-Message-State: APjAAAUGT5VWZipomYqt3rPGLUMMzWo7syTSVpqe6fgG7WJ9nLeER4Af UqYy63sB3xr2kYuY5Src9gmHAY8egok7s+85dSOTETKzwd8= X-Google-Smtp-Source: APXvYqyhfbNU1HvLZCWpoHKmmGVr79YbrYr7g3Umex+cuFyn345XJCaMF/sUzYbNoRSn/qrUJIVdZTbvmuLSyGOeGHM= X-Received: by 2002:a5d:87c6:: with SMTP id q6mr30467910ios.115.1562742427028; Wed, 10 Jul 2019 00:07:07 -0700 (PDT) MIME-Version: 1.0 From: "damian@damianek.be" Date: Wed, 10 Jul 2019 09:06:31 +0200 Message-ID: Subject: FreeBSD mds mitigation. To: freebsd-hackers@freebsd.org, freebsd-security@freebsd.org X-Rspamd-Queue-Id: 14B7474721 X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=damianek-be.20150623.gappssmtp.com header.s=20150623 header.b=GbUBUk4N; spf=pass (mx1.freebsd.org: domain of damian@damianek.be designates 2607:f8b0:4864:20::d30 as permitted sender) smtp.mailfrom=damian@damianek.be X-Spamd-Result: default: False [-5.37 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.995,0]; R_DKIM_ALLOW(-0.20)[damianek-be.20150623.gappssmtp.com:s=20150623]; FROM_DN_EQ_ADDR(1.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[damianek.be]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[damianek-be.20150623.gappssmtp.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[0.3.d.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; MX_GOOD(-0.01)[alt1.aspmx.l.google.com,aspmx.l.google.com,aspmx3.googlemail.com,alt2.aspmx.l.google.com,aspmx2.googlemail.com]; IP_SCORE(-2.95)[ip: (-9.13), ipnet: 2607:f8b0::/32(-3.17), asn: 15169(-2.42), country: US(-0.06)]; NEURAL_HAM_SHORT(-0.91)[-0.907,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Jul 2019 07:07:09 -0000 Hello FreeBSD 11.2-RELEASE-p11 CPU: Intel(R) Xeon(R) CPU E5-2640 v3 @ 2.60GHz (2594.05-MHz K8-class CPU) sysctl hw.mds_disable was set to 3 (Automatic VERW or Software selection), HT disabled in BIOS, and i install manually latest CPU microcode from https://github.com/intel/Intel-Linux-Processor-Microcode-Data-Files/ I wonder why hw.mds_disable_state shows hw.mds_disable_state: software Broadwell instead VERW? sysctl hw.mds_disable=1 causes hw.mds_disable_state: VERW These automatic selection works correctly? -- dsk damian@damianek.be From owner-freebsd-hackers@freebsd.org Wed Jul 10 09:52:58 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F22A115D155D; Wed, 10 Jul 2019 09:52:57 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E17B28380A; Wed, 10 Jul 2019 09:52:56 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.15.2/8.15.2) with ESMTPS id x6A9qlS6089249 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Wed, 10 Jul 2019 12:52:51 +0300 (EEST) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua x6A9qlS6089249 Received: (from kostik@localhost) by tom.home (8.15.2/8.15.2/Submit) id x6A9ql3D089248; Wed, 10 Jul 2019 12:52:47 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Wed, 10 Jul 2019 12:52:47 +0300 From: Konstantin Belousov To: "damian@damianek.be" Cc: freebsd-hackers@freebsd.org, freebsd-security@freebsd.org Subject: Re: FreeBSD mds mitigation. Message-ID: <20190710095247.GC47193@kib.kiev.ua> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.12.1 (2019-06-15) X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FORGED_GMAIL_RCVD,FREEMAIL_FROM, NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on tom.home X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Jul 2019 09:52:58 -0000 On Wed, Jul 10, 2019 at 09:06:31AM +0200, damian@damianek.be wrote: > Hello > > FreeBSD 11.2-RELEASE-p11 > CPU: Intel(R) Xeon(R) CPU E5-2640 v3 @ 2.60GHz (2594.05-MHz K8-class CPU) > > sysctl hw.mds_disable was set to 3 (Automatic VERW or Software selection), > HT disabled in BIOS, and i install manually latest CPU microcode from > https://github.com/intel/Intel-Linux-Processor-Microcode-Data-Files/ > > I wonder why hw.mds_disable_state shows > hw.mds_disable_state: software Broadwell > instead VERW? > > sysctl hw.mds_disable=1 causes hw.mds_disable_state: VERW > > These automatic selection works correctly? No idea. How did you installed the microcode ? Was it loaded ? Show the dmesg output after the 'cpucontrol -e /dev/cpuctl0'. From owner-freebsd-hackers@freebsd.org Wed Jul 10 10:16:29 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A4DF815D1E8E for ; Wed, 10 Jul 2019 10:16:29 +0000 (UTC) (envelope-from damian@damianek.be) Received: from mail-io1-xd34.google.com (mail-io1-xd34.google.com [IPv6:2607:f8b0:4864:20::d34]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3DC80845B2 for ; Wed, 10 Jul 2019 10:16:28 +0000 (UTC) (envelope-from damian@damianek.be) Received: by mail-io1-xd34.google.com with SMTP id i10so3429189iol.13 for ; Wed, 10 Jul 2019 03:16:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=damianek-be.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=h15zdIDQ0BZGFFpRP03EJfxNhKANu2h7gH+4fzg9qhk=; b=jTtBnH+g+iBwdr+Wckj+ZkzCOspcUyRb3P7tSaQWIhPcxDsAcDz+FTSJj/5y8sj9OK k1VRXCeByEmJcyVZPh0pYhiA3fXrSlcwlQkoIqcBQC+WvOEgUiX3IM4a06atzfePJmmd 2yisDJ09HbIHJ6EHh4u9ivAwQyraI5ti14SnC+YD8d9B9WNzwTjytciVmFsnbPZJakNd Ojay33FCokoYTGEcdN2pFdcYVTLN9nTAqsGpfpS0YXfjfwqZ+nWGx+H2238gJe5bjQOP sy3qM07wcsUMM8TR/rik4kaifO3Fz06fxmKwvV1fpYW3bDJ8T8wHjF4t85M/gt2RDmFG 5caw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=h15zdIDQ0BZGFFpRP03EJfxNhKANu2h7gH+4fzg9qhk=; b=e+vuMQa7zMFssda4GdpkxieWxyXagMwrw8ToFFasXGgAeoVAZN372AjnqT9oqDoNo4 hd/y4noXHSU5tFavvT+VfzJpJwI/NYo0KStbgAHwsmpdgIcap8KCAWhmueq3xiHgEStu mdE7M5MlKtw7xUS0Ui8RNZm0154ZPFIY/3vYBdVVKcjKgkRhuAdZzJl6aOHq6fIwhIBO QEBbGalE6Em0/jjofKmF5JikBZXqs20e9BGJpxKUVILFwM+uiihj2y/icVQ+aBA2AI7x 5tAIqcO1Pvxh853j3UqFDHmTI3OX8hKOFh24UCVJtCfO8CvwW4CZyH7URDG0hH16cAfX S1Dw== X-Gm-Message-State: APjAAAV4N9xM6QetWXKeIAJY8cuSqZeylWpr22a9OAthfVBzFjZQC3IP YZ/FK7MB24oqBBfajRAyui23mdXHSudjTvOK5zLz6OU5XRQ= X-Google-Smtp-Source: APXvYqyPSN6nivbnyYYG331g7S/j7xaW4GR8Ph/Nw0TI7Ak+NLy8JYKVV6h8YRvmSHI6Be7mNQAlz5rgQZQ0niyDxoU= X-Received: by 2002:a6b:90c1:: with SMTP id s184mr29990513iod.244.1562753786642; Wed, 10 Jul 2019 03:16:26 -0700 (PDT) MIME-Version: 1.0 References: <20190710095247.GC47193@kib.kiev.ua> In-Reply-To: <20190710095247.GC47193@kib.kiev.ua> From: "damian@damianek.be" Date: Wed, 10 Jul 2019 12:15:51 +0200 Message-ID: Subject: Re: FreeBSD mds mitigation. To: freebsd-hackers@freebsd.org X-Rspamd-Queue-Id: 3DC80845B2 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.99 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.99)[-0.986,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; REPLY(-4.00)[] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Jul 2019 10:16:29 -0000 =C5=9Br., 10 lip 2019 o 11:52 Konstantin Belousov napisa=C5=82(a): > On Wed, Jul 10, 2019 at 09:06:31AM +0200, damian@damianek.be wrote: > > Hello > > > > FreeBSD 11.2-RELEASE-p11 > > CPU: Intel(R) Xeon(R) CPU E5-2640 v3 @ 2.60GHz (2594.05-MHz K8-class CP= U) > > > > sysctl hw.mds_disable was set to 3 (Automatic VERW or Software > selection), > > HT disabled in BIOS, and i install manually latest CPU microcode from > > https://github.com/intel/Intel-Linux-Processor-Microcode-Data-Files/ > > > > I wonder why hw.mds_disable_state shows > > hw.mds_disable_state: software Broadwell > > instead VERW? > > > > sysctl hw.mds_disable=3D1 causes hw.mds_disable_state: VERW > > > > These automatic selection works correctly? > No idea. > > How did you installed the microcode ? Was it loaded ? > Show the dmesg output after the 'cpucontrol -e /dev/cpuctl0'. > I install microcode in /usr/local/share/cpucontrol, load at boot. cpucontrol output: CPU: Intel(R) Xeon(R) CPU E5-2640 v3 @ 2.60GHz (2594.05-MHz K8-class CPU) Origin=3D"GenuineIntel" Id=3D0x306f2 Family=3D0x6 Model=3D0x3f Steppi= ng=3D2 Features=3D0xbfebfbff Features2=3D0x7ffefbff AMD Features=3D0x2c100800 AMD Features2=3D0x21 Structured Extended Features=3D0x37ab Structured Extended Features3=3D0x9c000400 XSAVE Features=3D0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics --=20 damian@damianek.be From owner-freebsd-hackers@freebsd.org Wed Jul 10 08:53:56 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5101315CFCF4 for ; Wed, 10 Jul 2019 08:53:56 +0000 (UTC) (envelope-from Alexander@Leidinger.net) Received: from mailgate.Leidinger.net (bastille.leidinger.net [89.238.82.207]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B45E980D6C for ; Wed, 10 Jul 2019 08:53:52 +0000 (UTC) (envelope-from Alexander@Leidinger.net) Received: from outgoing.leidinger.net (p508D5E85.dip0.t-ipconnect.de [80.141.94.133]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (Client did not present a certificate) by mailgate.Leidinger.net (Postfix) with ESMTPSA id D6CCA64E; Wed, 10 Jul 2019 10:53:48 +0200 (CEST) Received: from [10.8.242.239] (unknown [194.154.203.181]) (using TLSv1.2 with cipher ECDHE-RSA-CHACHA20-POLY1305 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: Alexander@Leidinger.net) by outgoing.leidinger.net (Postfix) with ESMTPSA id 2C1E930B1; Wed, 10 Jul 2019 10:53:46 +0200 (CEST) From: Alexander Leidinger To: John Kozubik , Date: Wed, 10 Jul 2019 10:53:45 +0200 Message-ID: <16bdb16ada8.27fa.fa4b1493b064008fe79f0f905b8e5741@Leidinger.net> In-Reply-To: References: Subject: Re: How many "production" releases will FreeBSD have when the ZoL merge comes in ? MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="us-ascii" Content-Transfer-Encoding: 8bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=leidinger.net; s=outgoing-alex; t=1562748829; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=/jCQPt6OnQOrW5ynhTfq/OYny3ZlGhh0q0bTtKbB6UA=; b=PHVZIV93s9iHcbwEKTRVUjXjMwSoHsAhZQlJ1dxQPmr472sIWxMI/BWi4luv1kScKD5QAQ /NzIWagVDHX6ukZxrG+mnGPfBLNxYO+wms5+jFIO6RkQniUGq8LlSoc+z/BKkS/Y/GJzdm LZqoJxjzIdJTh1EUCds+Rzd1rrxPiD0nt8MmWf1YPpK5mj+7OzxMxlMadliOK3W9e6YgMo T35GzYBw89bmMkMZVJHtAMUIKv6mNtVhm+S8avqlcbOTE+kaJJ7XmWr05nOPegKqKF/pUr qqvSwaMk1Pr4Oe0K1X9nrk9Y2Pkpr3/mJIpKBP3Y92cQ1PxGeR9DkxXPLPDA4w== ARC-Seal: i=1; s=outgoing-alex; d=leidinger.net; t=1562748829; a=rsa-sha256; cv=none; b=1zyDRzjPvc/v1JA20upoM1EuCJ54AEkjQh7yrgA9K3ghHb2LaO4Ph5FznyNTj41hj02Qdz 6wDukzDpAMPZfDJNw1B4MnQMObfOmLhpSlGk/sAXCGyJ+cWIljLfwQLV5WklWDQQ5A7vi1 UJ4HI8h5l1YLhKLETt8Qb61JAMkiy0GON50KalZOAR/cDq14kV5kWins+j0pimrumEMYSN jLUauKAasUaAlsJFG1UQQSr6z26eT0+pE+Uv6YKS8sG2aj62VP4xPJ7MJ1/4So40Ujd9Jy VXbggJLz1zZaQKNMt7UQS/MGjX5dQCMCgeQYCsyXgZQmorJRgoIS5emTkKgo8Q== ARC-Authentication-Results: i=1; mailgate.Leidinger.net; auth=pass smtp.auth=netchild@leidinger.net smtp.mailfrom=Alexander@Leidinger.net X-Rspamd-Queue-Id: B45E980D6C X-Spamd-Bar: ------- X-Spamd-Result: default: False [-7.64 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[leidinger.net:s=outgoing-alex]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(-3.64)[ip: (-9.56), ipnet: 89.238.64.0/18(-4.78), asn: 34240(-3.87), country: DE(-0.01)]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[leidinger.net:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[Leidinger.net,quarantine]; MX_GOOD(-0.01)[mailgate.Leidinger.net]; NEURAL_HAM_SHORT(-0.99)[-0.988,0]; FROM_EQ_ENVFROM(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:34240, ipnet:89.238.64.0/18, country:DE]; ARC_ALLOW(-1.00)[i=1]; MID_RHS_MATCH_FROM(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[133.94.141.80.zen.spamhaus.org : 127.0.0.10] X-Mailman-Approved-At: Wed, 10 Jul 2019 10:25:21 +0000 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Jul 2019 08:53:56 -0000 Hi, is using ZoL from ports an option for you? Bye, Alexander. -- Send from a mobile device, please forgive brevity and misspellings. Am 10. Juli 2019 01:36:02 schrieb John Kozubik : > Friends, > > I am confused as to how the ZFS On Linux merge will be available before > 2022. The current supported release lifecycle page states: > > "11.4-RELEASE + 3 months (or September 30, 2021)" > > ... and I have heard very pessimistic responses about the ZoL merge going > into the 12 branch. > > So I *think* that one of the following must be true: > > > - We will, at some point, have *three* production branches with -RELEASE > distributions: 11, 12 and 13. > > - ZoL will actually come into the 12 branch, despite recent pessimism. > > - Neither of the above: ZoL comes in the 13 branch, which will not overlap > with the 11 branch, which means (basically) 2022 as the earliest > production (-RELEASE) version of FreeBSD with ZoL. > > > Some background ... > > > We at rsync.net, which runs exclusively on FreeBSD, are *dying* to get > native encryption and raw send. As you can imagine, we can only run > -RELEASE versions of FreeBSD. > > We really want to give Linux users the ability to 'zfs send' to their > rsync.net accounts like FreeBSD users do, but 13.1-RELEASE[1] is a *long* > way off - perhaps over three years from now. > > Three simultaneous "production" releases seems silly. > > So that leaves ZoL coming in the 12 branch as the only outcome that isn't > terrible news. > > > I wonder if there is any of the above that I am mistaken about, or some > news I have missed ? > > > Thanks, > > John Kozubik > > > > [1] In practice, we also don't run x.0 releases in production which sounds > bigoted and superstitious but I can point to 5.0-RELEASE and you need no > further explanation. > > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" From owner-freebsd-hackers@freebsd.org Wed Jul 10 10:32:48 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D481115D2623 for ; Wed, 10 Jul 2019 10:32:47 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 0D9098502C for ; Wed, 10 Jul 2019 10:32:46 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.15.2/8.15.2) with ESMTPS id x6AAWc8w080830 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Wed, 10 Jul 2019 13:32:41 +0300 (EEST) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua x6AAWc8w080830 Received: (from kostik@localhost) by tom.home (8.15.2/8.15.2/Submit) id x6AAWcoa080827; Wed, 10 Jul 2019 13:32:38 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Wed, 10 Jul 2019 13:32:38 +0300 From: Konstantin Belousov To: "damian@damianek.be" Cc: freebsd-hackers@freebsd.org Subject: Re: FreeBSD mds mitigation. Message-ID: <20190710103238.GD47193@kib.kiev.ua> References: <20190710095247.GC47193@kib.kiev.ua> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: Mutt/1.12.1 (2019-06-15) X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FORGED_GMAIL_RCVD,FREEMAIL_FROM, NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on tom.home X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Jul 2019 10:32:48 -0000 On Wed, Jul 10, 2019 at 12:15:51PM +0200, damian@damianek.be wrote: > śr., 10 lip 2019 o 11:52 Konstantin Belousov > napisał(a): > > > On Wed, Jul 10, 2019 at 09:06:31AM +0200, damian@damianek.be wrote: > > > Hello > > > > > > FreeBSD 11.2-RELEASE-p11 > > > CPU: Intel(R) Xeon(R) CPU E5-2640 v3 @ 2.60GHz (2594.05-MHz K8-class CPU) > > > > > > sysctl hw.mds_disable was set to 3 (Automatic VERW or Software > > selection), > > > HT disabled in BIOS, and i install manually latest CPU microcode from > > > https://github.com/intel/Intel-Linux-Processor-Microcode-Data-Files/ > > > > > > I wonder why hw.mds_disable_state shows > > > hw.mds_disable_state: software Broadwell > > > instead VERW? > > > > > > sysctl hw.mds_disable=1 causes hw.mds_disable_state: VERW > > > > > > These automatic selection works correctly? > > No idea. > > > > How did you installed the microcode ? Was it loaded ? > > Show the dmesg output after the 'cpucontrol -e /dev/cpuctl0'. > > > > I install microcode in /usr/local/share/cpucontrol, > load at boot. > > cpucontrol output: > > CPU: Intel(R) Xeon(R) CPU E5-2640 v3 @ 2.60GHz (2594.05-MHz K8-class CPU) > Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 > > Features=0xbfebfbff > > Features2=0x7ffefbff > AMD Features=0x2c100800 > AMD Features2=0x21 > Structured Extended > Features=0x37ab > Structured Extended Features3=0x9c000400 You clearly did not loaded microcode which implements MDS mitigation assist. If you did, MD_CLEAR cap would be listed. More, your microcode does not contain L1 data flush mitigation as well, which predated MDS. > XSAVE Features=0x1 > VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr > TSC: P-state invariant, performance statistics > > > -- > damian@damianek.be > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" From owner-freebsd-hackers@freebsd.org Wed Jul 10 14:48:51 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8056315D8D4C for ; Wed, 10 Jul 2019 14:48:51 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id CA9118EDB1 for ; Wed, 10 Jul 2019 14:48:50 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: by mailman.ysv.freebsd.org (Postfix) id 85BCC15D8D48; Wed, 10 Jul 2019 14:48:50 +0000 (UTC) Delivered-To: hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6345015D8D47 for ; Wed, 10 Jul 2019 14:48:50 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from kabab.cs.huji.ac.il (kabab.cs.huji.ac.il [132.65.116.210]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4DD438EDA7 for ; Wed, 10 Jul 2019 14:48:42 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=cs.huji.ac.il; s=57791128; h=To:Date:Message-Id:Subject:Mime-Version:Content-Type:From; bh=ATF8RRf6dBpbdTvcFyhRtC3CM4d7jMQdZAbu5A0ia48=; b=stkhiLf9NKQtCHKpUY6V/DMTKySLu5L5tU+t1dQDtb63C6ZA9jw7hF5XTHAl3dZR0FGHBVkb/UBlIbDbSSHWbmwWmOprlxyO8Ny96MQUuDUk33pEANQMNFCF1s68t/LnPhBa/qJT0x9GgyASr+Cejl5bEjpH0wgleDpmi8w8BLNq+hN+WryfpRC9ibr3Hd4M2StVGpikbFIGaULhp2wjCgde5fDi6rBF+5uZyEYYs1GCWSKEf2wiRU9UH2dj44wiaIWVDzHi048gyOP5JZ+3ZzyZndWH8myrH45RMNSsXSV7qCTjkZuyYASa2MzIl+em2BCCFs5HokZxMxmrGmeCpA==; Received: from macmini.bk.cs.huji.ac.il ([132.65.179.19]) by kabab.cs.huji.ac.il with esmtp id 1hlDtR-000HDW-2s for hackers@freebsd.org; Wed, 10 Jul 2019 17:48:25 +0300 From: Daniel Braniss Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.11\)) Subject: zpool errors Message-Id: <52CE32B1-7E01-4C35-A2AB-84D3D5BD4E2F@cs.huji.ac.il> Date: Wed, 10 Jul 2019 17:48:24 +0300 To: hackers@freebsd.org X-Mailer: Apple Mail (2.3445.104.11) X-Rspamd-Queue-Id: 4DD438EDA7 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=pass header.d=cs.huji.ac.il header.s=57791128 header.b=stkhiLf9 X-Spamd-Result: default: False [-0.67 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.55)[-0.555,0]; R_DKIM_ALLOW(-0.20)[cs.huji.ac.il:s=57791128]; NEURAL_HAM_LONG(-0.99)[-0.993,0]; FROM_HAS_DN(0.00)[]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[huji.ac.il]; URI_COUNT_ODD(1.00)[3]; RCPT_COUNT_ONE(0.00)[1]; IP_SCORE(-0.46)[ipnet: 132.64.0.0/13(-1.30), asn: 378(-1.04), country: IL(0.05)]; NEURAL_SPAM_SHORT(0.15)[0.146,0]; DKIM_TRACE(0.00)[cs.huji.ac.il:+]; MX_GOOD(-0.01)[kabab.cs.huji.ac.il,post.cs.huji.ac.il]; RCVD_IN_DNSWL_NONE(0.00)[210.116.65.132.list.dnswl.org : 127.0.10.0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:378, ipnet:132.64.0.0/13, country:IL]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Jul 2019 14:48:51 -0000 hi, i got a degraded pool, but can=E2=80=99t make sense of the file name: protonew-2# zpool status -vx pool: h state: ONLINE status: One or more devices has experienced an error resulting in data corruption. Applications may be affected. action: Restore the file in question if possible. Otherwise restore the entire pool from backup. see: http://illumos.org/msg/ZFS-8000-8A = scan: scrub repaired 6.50K in 17h30m with 0 errors on Wed Jul 10 = 12:06:14 2019 config: NAME STATE READ WRITE CKSUM h ONLINE 0 0 14.4M gpt/r5/zfs ONLINE 0 0 57.5M errors: Permanent errors have been detected in the following files: <0x102>:<0x30723> <0x102>:<0x30726> <0x102>:<0x3062a> =E2=80=A6 <0x281>:<0x0> <0x6aa>:<0x305cd> <0xffffffffffffffff>:<0x305cd> any hints as how I can identify third files? thanks, danny From owner-freebsd-hackers@freebsd.org Wed Jul 10 14:57:34 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 42C6615D92C9 for ; Wed, 10 Jul 2019 14:57:34 +0000 (UTC) (envelope-from kris@ixsystems.com) Received: from mail-yw1-xc30.google.com (mail-yw1-xc30.google.com [IPv6:2607:f8b0:4864:20::c30]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2AD3A8F6DE for ; Wed, 10 Jul 2019 14:57:33 +0000 (UTC) (envelope-from kris@ixsystems.com) Received: by mail-yw1-xc30.google.com with SMTP id m16so882748ywh.12 for ; Wed, 10 Jul 2019 07:57:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ixsystems-com.20150623.gappssmtp.com; s=20150623; h=from:to:references:in-reply-to:subject:date:message-id:mime-version :content-transfer-encoding:thread-index:content-language; bh=3v5v7+F6xf3iqHpDmlJs6SfMzXNps3a6AJZIbjgwg/g=; b=qb1nZqKWN10SqOvGRQvTHhc2fnGKuhuxK4z9+fe2TyP3vWj6gosRrODtVJ3PQlfEC5 U6H1gWdkyNJV1UnvGhhGboGZUVy9KqA2fObHWiR1IOZPULAdyqGhhuJReKAAOpZ5rdi1 T8BgtlLYssQuNmpVVACU9pWb7mMonRDO3PvisJ6fC4Jvn33RhJjOoj0VdpJjt/PEGiXG CmwDQ4Zavtz5AbeJw/DT/7586I7kE/5P7C9YFOhwWTp0+iIrtyluVqYwjlCyDnUTEFc2 Oiqgea7mDPlFGzKVg1nmK/8K2jiZp9Jp+7TKkdimRocxvt2hY/kC5nXKp099geHnGf5e lJ3A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:references:in-reply-to:subject:date :message-id:mime-version:content-transfer-encoding:thread-index :content-language; bh=3v5v7+F6xf3iqHpDmlJs6SfMzXNps3a6AJZIbjgwg/g=; b=cZpGzaOeE1i1PHmfC5sHRzjcXbKwH8deIwtvUzghd7SQNFSQiS+jVvEOtisFGcyuFp Z+hcYX42oRAkssHwKiYvdYLFIc5ohmwfTusBkNlM8YIjmv5M9b2e41UhGqg562adOeAH 2NHqgGjH2a/w8y+CNPS6Z75oPQ/42621uIZt784mqNfeTVfh5u3YtTh7Jndp8ZThFrZu oH2Z/grtr/nj6VpqBQj9cRB20LZljMexa9/YyUvpDkyFo0D4Rk7QqnpFXZsQtXboeaZg /4SfZ4oWH7LHh9/BbkZ1hnZ2mq7DlMs31lgjXEKnv4ddMqbIvUM2tSHnhwqiNz+Z32sm k5XA== X-Gm-Message-State: APjAAAVdztNHeKDrIMdK9wWsySsFN/tFv41gP/j59+WiqOPtMCd69YNn VLkpFxz4U4OQAnpAHva1P+hYLWYuOyaKDg== X-Google-Smtp-Source: APXvYqwdcCtkfdQ3skOlQGjq0VtpfNXcN6ByFHUpFgJ/wByuTUrs7ZaP0L0A+bJ/kDNjqGmZdukd8w== X-Received: by 2002:a0d:eb89:: with SMTP id u131mr18811609ywe.417.1562770652145; Wed, 10 Jul 2019 07:57:32 -0700 (PDT) Received: from KrisYogaC930 ([12.189.233.129]) by smtp.gmail.com with ESMTPSA id r19sm640307ywa.109.2019.07.10.07.57.31 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 10 Jul 2019 07:57:31 -0700 (PDT) From: To: "'Alexander Leidinger'" , "'John Kozubik'" , References: <16bdb16ada8.27fa.fa4b1493b064008fe79f0f905b8e5741@Leidinger.net> In-Reply-To: <16bdb16ada8.27fa.fa4b1493b064008fe79f0f905b8e5741@Leidinger.net> Subject: RE: How many "production" releases will FreeBSD have when the ZoL merge comes in ? Date: Wed, 10 Jul 2019 10:57:30 -0400 Message-ID: <2e0401d5372f$ccbc9800$6635c800$@ixsystems.com> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Outlook 16.0 Thread-Index: AQJWFIEFoFMVwZy5WoQYCdHHc8VrkwHCH5IrpbQlPVA= Content-Language: en-us X-Rspamd-Queue-Id: 2AD3A8F6DE X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=ixsystems-com.20150623.gappssmtp.com header.s=20150623 header.b=qb1nZqKW; dmarc=pass (policy=none) header.from=ixsystems.com; spf=pass (mx1.freebsd.org: domain of kris@ixsystems.com designates 2607:f8b0:4864:20::c30 as permitted sender) smtp.mailfrom=kris@ixsystems.com X-Spamd-Result: default: False [-5.95 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[ixsystems-com.20150623.gappssmtp.com:s=20150623]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[ixsystems-com.20150623.gappssmtp.com:+]; MX_GOOD(-0.01)[cached: ALT3.ASPMX.L.GOOGLE.com]; FROM_NO_DN(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[0.3.c.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; DMARC_POLICY_ALLOW(-0.50)[ixsystems.com,none]; RCVD_TLS_LAST(0.00)[]; NEURAL_HAM_SHORT(-0.96)[-0.962,0]; FROM_EQ_ENVFROM(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; IP_SCORE(-2.98)[ip: (-9.25), ipnet: 2607:f8b0::/32(-3.17), asn: 15169(-2.42), country: US(-0.06)] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Jul 2019 14:57:34 -0000 I'm keeping the port pretty updated for exactly this reason. We intend to use it for FreeBSD 12 here at iX, so far it seems to work pretty well. You'll just need to build world without ZFS so you don't end up with conflicts on zfs/zpool and libzfs. -- Kris Moore -----Original Message----- From: owner-freebsd-hackers@freebsd.org On Behalf Of Alexander Leidinger via freebsd-hackers Sent: Wednesday, July 10, 2019 4:54 AM To: John Kozubik ; freebsd-hackers@freebsd.org Subject: Re: How many "production" releases will FreeBSD have when the ZoL merge comes in ? Hi, is using ZoL from ports an option for you? Bye, Alexander. -- Send from a mobile device, please forgive brevity and misspellings. Am 10. Juli 2019 01:36:02 schrieb John Kozubik : > Friends, > > I am confused as to how the ZFS On Linux merge will be available > before 2022. The current supported release lifecycle page states: > > "11.4-RELEASE + 3 months (or September 30, 2021)" > > ... and I have heard very pessimistic responses about the ZoL merge > going into the 12 branch. > > So I *think* that one of the following must be true: > > > - We will, at some point, have *three* production branches with > -RELEASE > distributions: 11, 12 and 13. > > - ZoL will actually come into the 12 branch, despite recent pessimism. > > - Neither of the above: ZoL comes in the 13 branch, which will not > overlap with the 11 branch, which means (basically) 2022 as the > earliest production (-RELEASE) version of FreeBSD with ZoL. > > > Some background ... > > > We at rsync.net, which runs exclusively on FreeBSD, are *dying* to get > native encryption and raw send. As you can imagine, we can only run > -RELEASE versions of FreeBSD. > > We really want to give Linux users the ability to 'zfs send' to their > rsync.net accounts like FreeBSD users do, but 13.1-RELEASE[1] is a > *long* way off - perhaps over three years from now. > > Three simultaneous "production" releases seems silly. > > So that leaves ZoL coming in the 12 branch as the only outcome that > isn't terrible news. > > > I wonder if there is any of the above that I am mistaken about, or > some news I have missed ? > > > Thanks, > > John Kozubik > > > > [1] In practice, we also don't run x.0 releases in production which > sounds bigoted and superstitious but I can point to 5.0-RELEASE and > you need no further explanation. > > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" _______________________________________________ freebsd-hackers@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" From owner-freebsd-hackers@freebsd.org Wed Jul 10 15:02:59 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DBF9715D9656 for ; Wed, 10 Jul 2019 15:02:59 +0000 (UTC) (envelope-from john@kozubik.com) Received: from kozubik.com (kozubik.com [216.218.240.130]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id CFF858FDEA for ; Wed, 10 Jul 2019 15:02:58 +0000 (UTC) (envelope-from john@kozubik.com) Received: from kozubik.com (localhost [127.0.0.1]) by kozubik.com (8.14.3/8.14.3) with ESMTP id x6AF2s5U074007; Wed, 10 Jul 2019 08:02:54 -0700 (PDT) (envelope-from john@kozubik.com) Received: from localhost (john@localhost) by kozubik.com (8.14.3/8.14.3/Submit) with ESMTP id x6AF2nDF074004; Wed, 10 Jul 2019 08:02:49 -0700 (PDT) (envelope-from john@kozubik.com) Date: Wed, 10 Jul 2019 08:02:49 -0700 (PDT) From: John Kozubik To: kris@ixsystems.com cc: "'Alexander Leidinger'" , freebsd-hackers@freebsd.org Subject: RE: How many "production" releases will FreeBSD have when the ZoL merge comes in ? In-Reply-To: <2e0401d5372f$ccbc9800$6635c800$@ixsystems.com> Message-ID: References: <16bdb16ada8.27fa.fa4b1493b064008fe79f0f905b8e5741@Leidinger.net> <2e0401d5372f$ccbc9800$6635c800$@ixsystems.com> User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed X-Rspamd-Queue-Id: CFF858FDEA X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of john@kozubik.com designates 216.218.240.130 as permitted sender) smtp.mailfrom=john@kozubik.com X-Spamd-Result: default: False [-2.37 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.96)[-0.965,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; MIME_TRACE(0.00)[0:+]; DMARC_NA(0.00)[kozubik.com]; TO_DN_SOME(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_MED(-0.20)[130.240.218.216.list.dnswl.org : 127.0.6.2]; MX_GOOD(-0.01)[cached: kozubik.com]; NEURAL_HAM_SHORT(-0.34)[-0.343,0]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:6939, ipnet:216.218.128.0/17, country:US]; MID_RHS_MATCH_FROM(0.00)[]; IP_SCORE(-0.56)[ipnet: 216.218.128.0/17(0.39), asn: 6939(-3.11), country: US(-0.06)] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Jul 2019 15:03:00 -0000 Kris, On Wed, 10 Jul 2019, kris@ixsystems.com wrote: > I'm keeping the port pretty updated for exactly this reason. We intend to > use it for FreeBSD 12 here at iX, so far it seems to work pretty well. > You'll just need to build world without ZFS so you don't end up with > conflicts on zfs/zpool and libzfs. Are you currently using ZoL in production for customers ? Pardon my ignorance, but is ZoL in use anywhere in FreeNAS/TrueNAS ? I am pretty sure that we *cannot* run stock/standard ZFS in the base world and give someone in a jail ZoL (with a module) correct ? Thanks. From owner-freebsd-hackers@freebsd.org Wed Jul 10 15:07:15 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 55B4515D983C for ; Wed, 10 Jul 2019 15:07:15 +0000 (UTC) (envelope-from kris@ixsystems.com) Received: from mail-yw1-xc34.google.com (mail-yw1-xc34.google.com [IPv6:2607:f8b0:4864:20::c34]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 747349010B for ; Wed, 10 Jul 2019 15:07:14 +0000 (UTC) (envelope-from kris@ixsystems.com) Received: by mail-yw1-xc34.google.com with SMTP id x140so915253ywg.3 for ; Wed, 10 Jul 2019 08:07:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ixsystems-com.20150623.gappssmtp.com; s=20150623; h=from:to:cc:references:in-reply-to:subject:date:message-id :mime-version:content-transfer-encoding:thread-index :content-language; bh=cvGmLgaNe4ELZk7FTJrnAqRzQmaTsyM11UH4ci/rWeM=; b=o2bwgkzubysajGy6rqBB0MM5/WVt2ewDsYc+Or7dfy+8IpLMqsGSxs7fwHN5M8bhGb ewEJkJjc/lZN+Lf7y2wzCJHwX5tuw3S2lXsWT/CYog5npt8oMbTUMeT/bpUWmXwTkNMd 2a0EupeAat+BPt47f3St8ngci9b8ZEDmUqhdOcr9Y5oH2owYnHaDVefqiJhNNkMProql c7EwrslReqR88onLIK38JsDPs5Gc7gLKpQuXgj113UW1Qd1sMVrCdFN3j6NxDE5tXGUI wFyONzzAedJtaUhrOsyfC9wz5q3ZzbpFh6RTCB8G2ODnt7wa3RjVfU3/r7KGKS1+3YkT IhbA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:references:in-reply-to:subject:date :message-id:mime-version:content-transfer-encoding:thread-index :content-language; bh=cvGmLgaNe4ELZk7FTJrnAqRzQmaTsyM11UH4ci/rWeM=; b=o3s91oIF9eRsVxHNFSkvRHb1gHQtk4OICn1v53egQeeVv+qN3VENcCwk2GAOfROrt5 YoVWsLwK+xYli5RTTisJCQFXVw8HcBha8esMtUhzMjmRHJZolhr2jrakACAZ3YQWexxm TRRRc7MRYpVBT4RcwkFGAGcwyiGH7Rxftp0MIzcaFRj9+4EifsiVL+xECye+bCWcJSY1 rfS0yZuDLjAiCUInGNt2j+c1aInrPPyjJLvSKJIjv4LDTkleTzfJCiuSc9PGUhd4LWxA dQEIalqF3XwyZCbayakWAxK14rpSznGmH3kIyrapHe+6O/tpVZft2AAioE91xLoW02Yl NhmQ== X-Gm-Message-State: APjAAAWzFplYyejSSlOMtiur4++rn/uDo3yohK4oQOj1mWrC1GY9QmCK J0UyC4BGkNLj0AzqApjh2E1PdVWh4lOxwQ== X-Google-Smtp-Source: APXvYqz/dJsQmkA27VFlJ8mFStl0OWyLpk1vG+CxeKLK43zpCZITG78lNkXY+4XYf0H/vQlvc1Zl+A== X-Received: by 2002:a81:9205:: with SMTP id j5mr17726252ywg.477.1562771233581; Wed, 10 Jul 2019 08:07:13 -0700 (PDT) Received: from KrisYogaC930 ([12.189.233.129]) by smtp.gmail.com with ESMTPSA id t63sm543252ywf.92.2019.07.10.08.07.12 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 10 Jul 2019 08:07:13 -0700 (PDT) From: To: "'John Kozubik'" Cc: "'Alexander Leidinger'" , References: <16bdb16ada8.27fa.fa4b1493b064008fe79f0f905b8e5741@Leidinger.net> <2e0401d5372f$ccbc9800$6635c800$@ixsystems.com> In-Reply-To: Subject: RE: How many "production" releases will FreeBSD have when the ZoL merge comes in ? Date: Wed, 10 Jul 2019 11:07:12 -0400 Message-ID: <2e2501d53731$274cafc0$75e60f40$@ixsystems.com> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Outlook 16.0 Thread-Index: AQJWFIEFoFMVwZy5WoQYCdHHc8VrkwHCH5IrAguh77EA+wR06KWb8guQ Content-Language: en-us X-Rspamd-Queue-Id: 747349010B X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=ixsystems-com.20150623.gappssmtp.com header.s=20150623 header.b=o2bwgkzu; dmarc=pass (policy=none) header.from=ixsystems.com; spf=pass (mx1.freebsd.org: domain of kris@ixsystems.com designates 2607:f8b0:4864:20::c34 as permitted sender) smtp.mailfrom=kris@ixsystems.com X-Spamd-Result: default: False [-5.75 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[ixsystems-com.20150623.gappssmtp.com:s=20150623]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[ixsystems-com.20150623.gappssmtp.com:+]; MX_GOOD(-0.01)[cached: ALT3.ASPMX.L.GOOGLE.com]; FROM_NO_DN(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[4.3.c.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; DMARC_POLICY_ALLOW(-0.50)[ixsystems.com,none]; RCVD_TLS_LAST(0.00)[]; NEURAL_HAM_SHORT(-0.96)[-0.959,0]; FROM_EQ_ENVFROM(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; IP_SCORE(-2.78)[ip: (-8.24), ipnet: 2607:f8b0::/32(-3.17), asn: 15169(-2.42), country: US(-0.06)] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Jul 2019 15:07:15 -0000 This is internal only right now. FreeNAS 12 is still in the lab. We are using the newer ZoL internally on other infrastructure though (On FreeBSD HEAD as well). You'd need to run it through your normal qual process to ensure its up to par on your end though. And that's a no on being able to use it in a jail. You can't have the old base-system ZFS kernel module loaded and then load the newer ZoL/OpenZFS kernel module. -- Kris Moore -----Original Message----- From: John Kozubik Sent: Wednesday, July 10, 2019 11:03 AM To: kris@ixsystems.com Cc: 'Alexander Leidinger' ; freebsd-hackers@freebsd.org Subject: RE: How many "production" releases will FreeBSD have when the ZoL merge comes in ? Kris, On Wed, 10 Jul 2019, kris@ixsystems.com wrote: > I'm keeping the port pretty updated for exactly this reason. We intend > to use it for FreeBSD 12 here at iX, so far it seems to work pretty well. > You'll just need to build world without ZFS so you don't end up with > conflicts on zfs/zpool and libzfs. Are you currently using ZoL in production for customers ? Pardon my ignorance, but is ZoL in use anywhere in FreeNAS/TrueNAS ? I am pretty sure that we *cannot* run stock/standard ZFS in the base world and give someone in a jail ZoL (with a module) correct ? Thanks. From owner-freebsd-hackers@freebsd.org Wed Jul 10 15:25:02 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8BFCB15DA114 for ; Wed, 10 Jul 2019 15:25:02 +0000 (UTC) (envelope-from allanjude@freebsd.org) Received: from mx1.scaleengine.net (mx1.scaleengine.net [209.51.186.6]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 2296B90E03 for ; Wed, 10 Jul 2019 15:25:01 +0000 (UTC) (envelope-from allanjude@freebsd.org) Received: from [10.1.1.2] (Seawolf.HML3.ScaleEngine.net [209.51.186.28]) (Authenticated sender: allanjude.freebsd@scaleengine.com) by mx1.scaleengine.net (Postfix) with ESMTPSA id 924491CC1E for ; Wed, 10 Jul 2019 15:24:55 +0000 (UTC) To: freebsd-hackers@freebsd.org References: <52CE32B1-7E01-4C35-A2AB-84D3D5BD4E2F@cs.huji.ac.il> From: Allan Jude Openpgp: preference=signencrypt Autocrypt: addr=allanjude@freebsd.org; prefer-encrypt=mutual; keydata= mQINBFVwZcYBEADwrZDH0xe0ZVjc9ORCc6PcBLwS/RTXA6NkvpD6ea02pZ8lPOVgteuuugFc D34LdDbiWr+479vfrKBh+Y38GL0oZ0/13j10tIlDMHSa5BU0y6ACtnhupFvVlQ57+XaJAb/q 7qkfSiuxVwQ3FY3PL3cl1RrIP5eGHLA9hu4eVbu+FOX/q/XVKz49HaeIaxzo2Q54572VzIo6 C28McX9m65UL5fXMUGJDDLCItLmehZlHsQQ+uBxvODLFpVV2lUgDR/0rDa0B9zHZX8jY8qQ7 ZdCSy7CwClXI054CkXZCaBzgxYh/CotdI8ezmaw7NLs5vWNTxaDEFXaFMQtMVhvqQBpHkfOD 7rjjOmFw00nJL4FuPE5Yut0CPyx8vLjVmNJSt/Y8WxxmhutsqJYFgYfWl/vaWkrFLur/Zcmz IklwLw35HLsCZytCN5A3rGKdRbQjD6QPXOTJu0JPrJF6t2xFkWAT7oxnSV0ELhl2g+JfMMz2 Z1PDmS3NRnyEdqEm7NoRGXJJ7bgxDbN+9SXTyOletqGNXj/bSrBvhvZ0RQrzdHAPwQUfVSU2 qBhQEi2apSZstgVNMan0GUPqCdbE2zpysg+zT7Yhvf9EUQbzPL4LpdK1llT9fZbrdMzEXvEF oSvwJFdV3sqKmZc7b+E3PuxK6GTsKqaukd/3Cj8aLHG1T1im1QARAQABtCJBbGxhbiBKdWRl IDxhbGxhbmp1ZGVAZnJlZWJzZC5vcmc+iQI/BBMBAgApBQJVcGXGAhsjBQkSzAMABwsJCAcD AgEGFQgCCQoLBBYCAwECHgECF4AACgkQGZU1PhKYC34Muw/+JOKpSfhhysWFYiRXynGRDe07 Z6pVsn7DzrPUMRNZfHu8Uujmmy3p2nx9FelIY9yjd2UKHhug+whM54MiIFs90eCRVa4XEsPR 4FFAm0DAWrrb7qhZFcE/GhHdRWpZ341WAElWf6Puj2devtRjfYbikvj5+1V1QmDbju7cEw5D mEET44pTuD2VMRJpu2yZZzkM0i+wKFuPxlhqreufA1VNkZXI/rIfkYWK+nkXd9Efw3YdCyCQ zUgTUCb88ttSqcyhik/li1CDbXBpkzDCKI6I/8fAb7jjOC9LAtrZJrdgONywcVFoyK9ZN7EN AVA+xvYCmuYhR/3zHWH1g4hAm1v1+gIsufhajhfo8/wY1SetlzPaYkSkVQLqD8T6zZyhf+AN bC7ci44UsiKGAplB3phAXrtSPUEqM86kbnHg3fSx37kWKUiYNOnx4AC2VXvEiKsOBlpyt3dw WQbOtOYM+vkfbBwDtoGOOPYAKxc4LOIt9r+J8aD+gTooi9Eo5tvphATf9WkCpl9+aaGbSixB tUpvQMRnSMqTqq4Z7DeiG6VMRQIjsXDSLJEUqcfhnLFo0Ko/RiaHd5xyAQ4DhQ9QpkyQjjNf /3f/dYG7JAtoD30txaQ5V8uHrz210/77DRRX+HJjEj6xCxWUGvQgvEZf5XXyxeePvqZ+zQyT DX61bYw6w6a5Ag0EVXBlxgEQAMy7YVnCCLN4oAOBVLZ5nUbVPvpUhsdA94/0/P+uqCIh28Cz ar56OCX0X19N/nAWecxL4H32zFbIRyDB2V/MEh4p9Qvyu/j4i1r3Ex5GhOT2hnit43Ng46z5 29Es4TijrHJP4/l/rB2VOqMKBS7Cq8zk1cWqaI9XZ59imxDNjtLLPPM+zQ1yE3OAMb475QwN UgWxTMw8rkA7CEaqeIn4sqpTSD5C7kT1Bh26+rbgJDZ77D6Uv1LaCZZOaW52okW3bFbdozV8 yM2u+xz2Qs8bHz67p+s+BlygryiOyYytpkiK6Iy4N7FTolyj5EIwCuqzfk0SaRHeOKX2ZRjC qatkgoD/t13PNT38V9tw3qZVOJDS0W6WM8VSg+F+bkM9LgJ8CmKV+Hj0k3pfGfYPOZJ/v18i +SmZmL/Uw2RghnwDWGAsPCKu4uZR777iw7n9Io6Vfxndw2dcS0e9klvFYoaGS6H2F13Asygr WBzFNGFQscN4mUW+ZYBzpTOcHkdT7w8WS55BmXYLna+dYer9/HaAuUrONjujukN4SPS1fMJ2 /CS/idAUKyyVVX5vozoNK2JVC1h1zUAVsdnmhEzNPsvBoqcVNfyqBFROEVLIPwq+lQMGNVjH ekLTKRWf59MEhUC2ztjSKkGmwdg73d6xSXMuq45EgIJV2wPvOgWQonoHH/kxABEBAAGJAiUE GAECAA8FAlVwZcYCGwwFCRLMAwAACgkQGZU1PhKYC34w5A//YViBtZyDV5O+SJT9FFO3lb9x Zdxf0trA3ooCt7gdBkdnBM6T5EmjgVZ3KYYyFfwXZVkteuCCycMF/zVw5eE9FL1+zz9gg663 nY9q2F77TZTKXVWOLlOV2bY+xaK94U4ytogOGhh9b4UnQ/Ct3+6aviCF78Go608BXbmF/GVT 7uhddemk7ItxM1gE5Hscx3saxGKlayaOsdPKeGTVJCDEtHDuOc7/+jGh5Zxpk/Hpi+DUt1ot 8e6hPYLIQa4uVx4f1xxxV858PQ7QysSLr9pTV7FAQ18JclCaMc7JWIa3homZQL/MNKOfST0S 2e+msuRwQo7AnnfFKBUtb02KwpA4GhWryhkjUh/kbVc1wmGxaU3DgXYQ5GV5+Zf4kk/wqr/7 KG0dkTz6NLCVLyDlmAzuFhf66DJ3zzz4yIo3pbDYi3HB/BwJXVSKB3Ko0oUo+6/qMrOIS02L s++QE/z7K12CCcs7WwOjfCYHK7VtE0Sr/PfybBdTbuDncOuAyAIeIKxdI2nmQHzl035hhvQX s4CSghsP319jAOQiIolCeSbTMD4QWMK8RL/Pe1FI1jC3Nw9s+jq8Dudtbcj2UwAP/STUEbJ9 5rznzuuhPjE0e++EU/RpWmcaIMK/z1zZDMN+ce2v1qzgV936ZhJ3iaVzyqbEE81gDxg3P+IM kiYh4ZtPB4Q= Subject: Re: zpool errors Message-ID: <27c3e59a-07ea-5df3-9de2-302d5290a477@freebsd.org> Date: Wed, 10 Jul 2019 11:24:51 -0400 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.7.2 MIME-Version: 1.0 In-Reply-To: <52CE32B1-7E01-4C35-A2AB-84D3D5BD4E2F@cs.huji.ac.il> Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="H2wbIQJb56P9f8FdAt4qGFe56VyrD5I4C" X-Rspamd-Queue-Id: 2296B90E03 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.99 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.99)[-0.986,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; REPLY(-4.00)[] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Jul 2019 15:25:02 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --H2wbIQJb56P9f8FdAt4qGFe56VyrD5I4C Content-Type: multipart/mixed; boundary="I0MibhzUQk1GY3naeMu84iVtbB995MSRI"; protected-headers="v1" From: Allan Jude To: freebsd-hackers@freebsd.org Message-ID: <27c3e59a-07ea-5df3-9de2-302d5290a477@freebsd.org> Subject: Re: zpool errors References: <52CE32B1-7E01-4C35-A2AB-84D3D5BD4E2F@cs.huji.ac.il> In-Reply-To: <52CE32B1-7E01-4C35-A2AB-84D3D5BD4E2F@cs.huji.ac.il> --I0MibhzUQk1GY3naeMu84iVtbB995MSRI Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable On 2019-07-10 10:48, Daniel Braniss wrote: > hi, > i got a degraded pool, but can=E2=80=99t make sense of the file name: >=20 > protonew-2# zpool status -vx > pool: h > state: ONLINE > status: One or more devices has experienced an error resulting in data > corruption. Applications may be affected. > action: Restore the file in question if possible. Otherwise restore th= e > entire pool from backup. > see: http://illumos.org/msg/ZFS-8000-8A > scan: scrub repaired 6.50K in 17h30m with 0 errors on Wed Jul 10 12:06= :14 2019 > config: >=20 > NAME STATE READ WRITE CKSUM > h ONLINE 0 0 14.4M > gpt/r5/zfs ONLINE 0 0 57.5M >=20 > errors: Permanent errors have been detected in the following files: >=20 > <0x102>:<0x30723> > <0x102>:<0x30726> > <0x102>:<0x3062a> > =E2=80=A6 > <0x281>:<0x0> > <0x6aa>:<0x305cd> > <0xffffffffffffffff>:<0x305cd> >=20 >=20 > any hints as how I can identify third files? >=20 > thanks, > danny >=20 > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.o= rg" >=20 Once a file has been deleted, ZFS can have a hard time determining its filename. It is inode 198186 (0x3062a) on dataset 0x102. The file has been deleted, but still exists in at least one snapshot. Although, 57 million checksum errors seems like there may be some other problem. You might look for and resolve the problem with what appears to be a raid5 you have built your ZFS pool on top of it? Then do 'zpool clear' to reset the counters to zero, and 'zpool scrub' to try to read everything again. --=20 Allan Jude --I0MibhzUQk1GY3naeMu84iVtbB995MSRI-- --H2wbIQJb56P9f8FdAt4qGFe56VyrD5I4C Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (MingW32) iQIcBAEBAgAGBQJdJgNGAAoJEBmVNT4SmAt+wpMP/3pUnxJjCKMICLp6TyIfUEOF z2uYg1ELnC/LZ1O9/IE/X3h4qTO4etp03m7wyttXhwMg8YselvJ4w1zvgySR9d+e QSfxZL5ed5qoljkHSILROmkidzyeLzidSR6m65yrcPQ8+CUD7SsuW/58K8DRYQWq 2W0dKJtQBu0zfb0B2Q9UPBgPOhdyV/EYWzY+1/fSmE7s+/j9cJQD2uNCsr6eLBND Y32h42xlVU6YwTZa7wLvk7N8CMAhbVjNJ7MQZ6ffGdYnYgAQVMjB4uyVM3ee+iiv pY0dqJRqVcr5+adgdN6LKtVwmKktRfucp8nfD30wVy6KXkOkbaDBZTFF0gYjdLWI nqlnod6KclP1/6xtfAuUudQ3yziMSgCEbnQrtoolReojIQNuNBI+I5TB7pwKc/Lh VH/MA4fqUkmPobRFT4FODUrAjOlV1MnpyLwWbZIv69pqidP7KnULvz4YGsSE65AX 5saaS4Oqaj8qO8tAFqV2AaD+KDRhIF1Rof2Wg0tSxq8PgG7O9VVCnxeMm1jZdkRR cWf903sBTRw0FwrF+oFyIMuAx680IIj6mgR+384/dywvJ/dQyZimEQX1ruGTkdeV 5n3eOXBefHSkHqjuW1r4eWd/w/EW3QTzCr3NPZGqib2do6E9wlT7y+DQ5GrnctHG oHCcFuLC5qsuqyNQWhaQ =V2sz -----END PGP SIGNATURE----- --H2wbIQJb56P9f8FdAt4qGFe56VyrD5I4C-- From owner-freebsd-hackers@freebsd.org Wed Jul 10 15:37:15 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8998715DA56F for ; Wed, 10 Jul 2019 15:37:15 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from kabab.cs.huji.ac.il (kabab.cs.huji.ac.il [132.65.116.210]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id EC65391537; Wed, 10 Jul 2019 15:37:13 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=cs.huji.ac.il; s=57791128; h=To:References:Message-Id:Content-Transfer-Encoding:Cc:Date:In-Reply-To:From:Subject:Mime-Version:Content-Type; bh=uI8xZg7T/ej9sM9K1XYn7TNVDjfhUU5EyubaKAw8d4E=; b=NL2nVo1XsRVWAlZ4aKPA4lCf2Je5Qph+mkI0kJX/iAY1p/kvkPzHMVrHEjwLWA2R7pHw0O7B+AHXJAxw30KFxhFVL8eJmTgXwGilIj3cHKGAjagn+Y4Exgkc2ljhMFoXLv/hkeMGbVuBYfa2KkXn+ZiJ71Ffh5dX9CN2lQXJjZqhAmAOyiQaMLjmyDGN8zCmmNvQGlUQyHaCr0LuxFWsqYSTPxy0oCwqEjr6f0TAai7Rc57+iiMmc0kMyx9+9sH0xyw28DEtH21KHFJtRdrc3oh+JyL65RlVGGY790gTg1Mn5aTouTtEo/21AuSmlQxCvNAJS9hNcTlrRbvuE+ImQg==; Received: from macmini.bk.cs.huji.ac.il ([132.65.179.19]) by kabab.cs.huji.ac.il with esmtp id 1hlEeZ-000KK9-Od; Wed, 10 Jul 2019 18:37:07 +0300 Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.11\)) Subject: Re: zpool errors From: Daniel Braniss In-Reply-To: <27c3e59a-07ea-5df3-9de2-302d5290a477@freebsd.org> Date: Wed, 10 Jul 2019 18:37:07 +0300 Cc: freebsd-hackers@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <831204B6-3F3B-4736-89FA-1207C4C46A7E@cs.huji.ac.il> References: <52CE32B1-7E01-4C35-A2AB-84D3D5BD4E2F@cs.huji.ac.il> <27c3e59a-07ea-5df3-9de2-302d5290a477@freebsd.org> To: Allan Jude X-Mailer: Apple Mail (2.3445.104.11) X-Rspamd-Queue-Id: EC65391537 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=cs.huji.ac.il header.s=57791128 header.b=NL2nVo1X X-Spamd-Result: default: False [-2.05 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.57)[-0.573,0]; R_DKIM_ALLOW(-0.20)[cs.huji.ac.il:s=57791128]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[huji.ac.il]; NEURAL_HAM_LONG(-1.00)[-0.999,0]; IP_SCORE(-0.43)[ipnet: 132.64.0.0/13(-1.24), asn: 378(-0.99), country: IL(0.05)]; DKIM_TRACE(0.00)[cs.huji.ac.il:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[210.116.65.132.list.dnswl.org : 127.0.10.0]; MX_GOOD(-0.01)[cached: kabab.cs.huji.ac.il]; R_SPF_NA(0.00)[]; NEURAL_HAM_SHORT(-0.23)[-0.235,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:378, ipnet:132.64.0.0/13, country:IL]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Jul 2019 15:37:15 -0000 > On 10 Jul 2019, at 18:24, Allan Jude wrote: >=20 > On 2019-07-10 10:48, Daniel Braniss wrote: >> hi, >> i got a degraded pool, but can=E2=80=99t make sense of the file = name: >>=20 >> protonew-2# zpool status -vx >> pool: h >> state: ONLINE >> status: One or more devices has experienced an error resulting in = data >> corruption. Applications may be affected. >> action: Restore the file in question if possible. Otherwise restore = the >> entire pool from backup. >> see: http://illumos.org/msg/ZFS-8000-8A = >> scan: scrub repaired 6.50K in 17h30m with 0 errors on Wed Jul 10 = 12:06:14 2019 >> config: >>=20 >> NAME STATE READ WRITE CKSUM >> h ONLINE 0 0 14.4M >> gpt/r5/zfs ONLINE 0 0 57.5M >>=20 >> errors: Permanent errors have been detected in the following files: >>=20 >> <0x102>:<0x30723> >> <0x102>:<0x30726> >> <0x102>:<0x3062a> >> =E2=80=A6 >> <0x281>:<0x0> >> <0x6aa>:<0x305cd> >> <0xffffffffffffffff>:<0x305cd> >>=20 >>=20 >> any hints as how I can identify third files? >>=20 >> thanks, >> danny >>=20 >> _______________________________________________ >> freebsd-hackers@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-hackers >> To unsubscribe, send any mail to = "freebsd-hackers-unsubscribe@freebsd.org" >>=20 >=20 > Once a file has been deleted, ZFS can have a hard time determining its > filename. >=20 > It is inode 198186 (0x3062a) on dataset 0x102. The file has been > deleted, but still exists in at least one snapshot. >=20 > Although, 57 million checksum errors seems like there may be some = other > problem. You might look for and resolve the problem with what appears = to > be a raid5 you have built your ZFS pool on top of it? Then do 'zpool > clear' to reset the counters to zero, and 'zpool scrub' to try to read > everything again. >=20 > --=20 > Allan Jude >=20 I don=E2=80=99t know when the first error was detected, and this host = has been up for 367 days! I did a scrub but no change. i will remove old snapshots and see if it helps. is it possible to know at least which volume? thanks, danny From owner-freebsd-hackers@freebsd.org Wed Jul 10 16:56:31 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6E65D15DC8FE for ; Wed, 10 Jul 2019 16:56:31 +0000 (UTC) (envelope-from mike@sentex.net) Received: from pyroxene.sentex.ca (unknown [IPv6:2607:f3e0:0:3::18]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "pyroxene.sentex.ca", Issuer "Let's Encrypt Authority X3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 5B51B94D82 for ; Wed, 10 Jul 2019 16:56:30 +0000 (UTC) (envelope-from mike@sentex.net) Received: from [192.168.43.26] ([192.168.43.26]) by pyroxene.sentex.ca (8.15.2/8.15.2) with ESMTP id x6AGuQwB031960; Wed, 10 Jul 2019 12:56:27 -0400 (EDT) (envelope-from mike@sentex.net) Subject: Re: FreeBSD mds mitigation. To: "damian@damianek.be" , freebsd-hackers@freebsd.org References: <20190710095247.GC47193@kib.kiev.ua> From: Mike Tancsa Openpgp: preference=signencrypt Autocrypt: addr=mike@sentex.net; prefer-encrypt=mutual; keydata= mQENBEzcA24BCACpwI/iqOrs0GfQSfhA1v6Z8AcXVeGsRyKEKUpxoOYxXWc2z3vndbYlIP6E YJeifzKhS/9E+VjhhICaepLHfw865TDTUPr5D0Ed+edSsKjlnDtb6hfNJC00P7eoiuvi85TW F/gAxRY269A5d856bYrzLbkWp2lKUR3Bg6NnORtflGzx9ZWAltZbjYjjRqegPv0EQNYcHqWo eRpXilEo1ahT6nmOU8V7yEvT2j4wlLcQ6qg7w+N/vcBvyd/weiwHU+vTQ9mT61x5/wUrQhdw 2gJHeQXeDGMJV49RT2EEz+QVxaf477eyWsdQzPVjAKRMT3BVdK8WvpYAEfBAbXmkboOxABEB AAG0HG1pa2UgdGFuY3NhIDxtaWtlQHNlbnRleC5jYT6JATgEEwECACIFAkzcA24CGwMGCwkI BwMCBhUIAgkKCwQWAgMBAh4BAheAAAoJEJXHwM2kc8rX+sMH/2V6pTBKsQ5mpWWLgs6wVP2k BC+6r/YKNXv9Rw/PrC6+9hTbgA+sSjJ+8gxsCbJsOQXZrxF0x3l9oYdYfuKcwdwXFX1/FS8p HfBeDkmlH+dI709xT9wgrR4dS5aMmKp0scPrXPIAKiYVOHjOlNItcLYTEEWEFBepheEVsgmk GrNbcrHwOx/u4igUQ8vcpyXPyUki+BsftPw8ZQvBU887igh0OxaCR8AurJppQ5UQd63r81cX E1ZjoFoWCaGK/SjPb/OhpYpu5swoZIhOxQbn7OtakYPsDd5t2A5KhvjI8BMTnd5Go+2xsCmr jlIEq8Bi29gCcfQUvNiClevi13ifmnm5AQ0ETNwDbgEIALWGNJHRAhpd0A4vtd3G0oRqMBcM FGThQr3qORmEBTPPEomTdBaHcn+Xl+3YUvTBD/67/mutWBwgp2R5gQOSqcM7axvgMSHbKqBL 9sd1LsLw0UT2O5AYxv3EwzhG84pwRg3XcUqvWA4lA8tIj/1q4Jzi5qOkg1zxq4W9qr9oiYK5 bBR638JUvr3eHMaz/Nz+sDVFgwHmXZj3M6aE5Ce9reCGbvrae7H5D5PPvtT3r22X8SqfVAiO TFKedCf/6jbSOedPN931FJQYopj9P6b3m0nI3ZiCDVSqeyOAIBLzm+RBUIU3brzoxDhYR8pz CJc2sK8l6YjqivPakrD86bFDff8AEQEAAYkBHwQYAQIACQUCTNwDbgIbDAAKCRCVx8DNpHPK 1+iQB/99aqNtez9ZTBWELj269La8ntuRx6gCpzfPXfn6SDIfTItDxTh1hrdRVP5QNGGF5wus N4EMwXouskva1hbFX3Pv72csYSxxEJXjW16oV8WK4KjKXoskLg2RyRP4uXqL7Mp2ezNtVY5F 9nu3fj4ydpHCSaqKy5xd70A8D50PfZsFgkrsa5gdQhPiGGEdxhq/XSeAAnZ4uVLJKarH+mj5 MEhgZPEBWkGrbDZpezl9qbFcUem/uT9x8FYT/JIztMVh9qDcdP5tzANW5J7nvgXjska+VFGY ryZK4SPDczh74mn6GI/+RBi7OUzXXPgpPBrhS5FByjwCqjjsSpTjTds+NGIY Organization: Sentex Communications Message-ID: Date: Wed, 10 Jul 2019 12:56:26 -0400 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.7.2 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Content-Language: en-US X-Rspamd-Queue-Id: 5B51B94D82 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of mike@sentex.net designates 2607:f3e0:0:3::18 as permitted sender) smtp.mailfrom=mike@sentex.net X-Spamd-Result: default: False [-1.08 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; RDNS_NONE(1.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f3e0::/32]; NEURAL_HAM_LONG(-0.98)[-0.980,0]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[sentex.net]; HAS_ORG_HEADER(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: smtp.sentex.ca]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.85)[-0.849,0]; NEURAL_HAM_MEDIUM(-0.72)[-0.718,0]; IP_SCORE(-1.72)[ipnet: 2607:f3e0::/32(-4.94), asn: 11647(-3.58), country: CA(-0.09)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA]; HFILTER_HOSTNAME_UNKNOWN(2.50)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Jul 2019 16:56:31 -0000 On 7/10/2019 6:15 AM, damian@damianek.be wrote: > >> How did you installed the microcode ? Was it loaded ? >> Show the dmesg output after the 'cpucontrol -e /dev/cpuctl0'. >> > I install microcode in /usr/local/share/cpucontrol, > load at boot. > Try the port sysutils/devcpu-data/ and install the firmware from the bootloader.  You do need a more recent RELENG_11 or 11.3R in /boot/loader.conf cpu_microcode_load="YES" cpu_microcode_name="/boot/firmware/intel-ucode.bin" At bootup time you will see something like CPU microcode: updated from 0x1d to 0x27 CPU: Intel(R) Xeon(R) CPU E3-1226 v3 @ 3.30GHz (3300.07-MHz K8-class CPU)   Origin="GenuineIntel"  Id=0x306c3  Family=0x6  Model=0x3c  Stepping=3   Features=0xbfebfbff   Features2=0x7ffafbff   AMD Features=0x2c100800   AMD Features2=0x21   Structured Extended Features=0x27ab   Structured Extended Features3=0x9c000400   XSAVE Features=0x1   VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID   TSC: P-state invariant, performance statistics     ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 x203 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada From owner-freebsd-hackers@freebsd.org Wed Jul 10 17:21:34 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D45C315DD7AA for ; Wed, 10 Jul 2019 17:21:33 +0000 (UTC) (envelope-from rank1seeker@gmail.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 4706B96821 for ; Wed, 10 Jul 2019 17:21:33 +0000 (UTC) (envelope-from rank1seeker@gmail.com) Received: by mailman.ysv.freebsd.org (Postfix) id 0A4B515DD7A8; Wed, 10 Jul 2019 17:21:33 +0000 (UTC) Delivered-To: hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C0B4315DD7A7 for ; Wed, 10 Jul 2019 17:21:32 +0000 (UTC) (envelope-from rank1seeker@gmail.com) Received: from mail-wr1-x443.google.com (mail-wr1-x443.google.com [IPv6:2a00:1450:4864:20::443]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6DFF096819 for ; Wed, 10 Jul 2019 17:21:31 +0000 (UTC) (envelope-from rank1seeker@gmail.com) Received: by mail-wr1-x443.google.com with SMTP id g17so3314862wrr.5 for ; Wed, 10 Jul 2019 10:21:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=date:from:to:subject:message-id:mime-version :content-transfer-encoding; bh=YZbIxUSganpnez3uHtVLP9rROKdM56YeZ5murk+OdmU=; b=RKOu6WPyRPiGlpAoZ+WT/mTfSkboYhbHgbNTRw+ziYqoYUeh4AxYF1ovkYKRudZ3g0 zFvGuULvjvwe6bjJMIKhL9IW05ojfe3iY50uxZa9k40N7IHnNKlOrLntjYRAGemjFKe5 hVWHcgEZgWnUvVkFshBHZ3dLvh5ipago8q7+nlxnF0UmW/8SmtXK3i+Onhe10Op9MVA5 8YQ4v2pqe8FOq+z3ZuEuUL1k19qAQ/392mdjmPjctfXbKpI7ZeNLzf3d4/cHucl5QGaC Fgn3/yBb0G3n3GMsueNy69NCYa+K0ScgtYg2g/npQvWGqjGD0F/63VqcRYrFCAP3y5o9 Wp9Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:subject:message-id:mime-version :content-transfer-encoding; bh=YZbIxUSganpnez3uHtVLP9rROKdM56YeZ5murk+OdmU=; b=Eu6lj9zRQOaBNlR1mB/UozWAVsHDTJ5IAh9v4IERCu38uA8i5LoYm/1G2NYv703a6F O0bqCaNP4cN1w1xgeG7KjSLmWlDoU9wKFJO/e8v3zFfdp2meJ7njb3U9eCJLX2QeCE5I Km8kkgUAEIxKpp+EwtWqUfhnMlGPgQAqAAAVEGmx9kzR5k+JP41JiigDG2N3QSgnLL/Z nwMMR3Cig7mPZ525FQol3agSWPxdwUQ47colr2NELtMdhspwUm2+Y5WzHSnVVyA+mixE rak+B77XrwdecBeKGgrbTkLN8H6wEDkMgvzhM25d21bJte+BbpUTrvrRP8sPAZBSe2px T6Vw== X-Gm-Message-State: APjAAAWEXBDdA43cgQDnehZ1avi7TQyraYC+rf6xWpEem3DOH4TvEe19 KYw07jRURNLjbwdSkxWEbBGq7Thp X-Google-Smtp-Source: APXvYqwUel2/5tlSXfMDLq6QgNwo25lvwAx6EcxTZFYZTJQY/cx6ZvOYMLo3zKwEoNkwtKE6bDTnWQ== X-Received: by 2002:adf:cd90:: with SMTP id q16mr32780124wrj.118.1562779290297; Wed, 10 Jul 2019 10:21:30 -0700 (PDT) Received: from localhost ([188.252.166.37]) by smtp.gmail.com with ESMTPSA id r14sm2949146wrx.57.2019.07.10.10.21.29 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Wed, 10 Jul 2019 10:21:29 -0700 (PDT) Date: Wed, 10 Jul 2019 19:20:48 +0200 From: Domagoj =?UTF-8?Q?Smol=C4=8Di=C4=87?= To: hackers@freebsd.org, freebsd@dussan.org, ntfs-3g-devel@lists.sf.net Subject: mkntfs doesn't install NTFS's bootcode during formatting Message-ID: <20190710192048.00001ca2@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 6DFF096819 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=RKOu6WPy; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of rank1seeker@gmail.com designates 2a00:1450:4864:20::443 as permitted sender) smtp.mailfrom=rank1seeker@gmail.com X-Spamd-Result: default: False [-4.58 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.82)[-0.820,0]; RECEIVED_SPAMHAUS_PBL(0.00)[37.166.252.188.zen.spamhaus.org : 127.0.0.11]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; IP_SCORE(-0.75)[ip: (1.60), ipnet: 2a00:1450::/32(-2.85), asn: 15169(-2.43), country: US(-0.06)]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[hackers@freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[3.4.4.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; RCVD_TLS_LAST(0.00)[] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Jul 2019 17:21:34 -0000 FreeBSD 11.2-RELEASE-p9 fusefs-ntfs-2017.3.23 When slice/partition is being formatted, bootcode('; containsMicrosoft Wind= ows XP/VISTA bootloader BOOTMGR') isn't applied, thus rendering it unbootab= le. Under Win, after 'bootsect /nt60 ...' has been used on NTFS created with mk= ntfs, THEN it becomes bootable. When slice/partition is being formatted directly under Win, bootcode IS als= o being applied. So, if you need a bootable NTFS, why to bother in a first place with mkntfs= , then transferring device to Win machine and using command line under Win = to run 'bootsect' tool, when you can simply click 'Format...' & Start?!? Domagoj Smol=C4=8Di=C4=87 From owner-freebsd-hackers@freebsd.org Wed Jul 10 17:21:56 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8A79915DD7E1 for ; Wed, 10 Jul 2019 17:21:56 +0000 (UTC) (envelope-from damian@damianek.be) Received: from mail-io1-xd32.google.com (mail-io1-xd32.google.com [IPv6:2607:f8b0:4864:20::d32]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D5260968AF for ; Wed, 10 Jul 2019 17:21:54 +0000 (UTC) (envelope-from damian@damianek.be) Received: by mail-io1-xd32.google.com with SMTP id z3so6484067iog.0 for ; Wed, 10 Jul 2019 10:21:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=damianek-be.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=aJzn/rmH7TVBf1KdVnYsT+vPO0UTr7WpN7OP3A/H3FU=; b=PvNduwOIesG99LBrOmz9t1GNofl9lA4KNNP8wdy92E5BxdA4oWHyhQKRKuRqmh21aq 7eYQv3EBkqZebqK3ko6F7cl90ObhXUlZhg4fioYmFgHZzJap29iHbANZRZSo8mWnG2o/ LGlDJk5SXqUnxw/fNoi7qcBIQXcfurqve9rKZ916rrFdLq/vdsIB2x1Kk1T5QAGraFTn RL8VnYql/7bSf2O4rAiCbz7Ugg2Ef5pWI4znuHtprqnmWpmKCA/IcuDcgq2XP7UEE00c ybT7wEMpZ50L8bP1ztQEqNoLXXpcDll7WZRpOUcbjpyLxGXRzfW7UZLUfDlgay1tVF64 XGHQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=aJzn/rmH7TVBf1KdVnYsT+vPO0UTr7WpN7OP3A/H3FU=; b=GjoaOm/ih6KRxmXJ6Vi+Gb3v50WbF7PG/LqkN9IxtryUIxDpA1TgZRb9icrGfceMj3 4eSyk1UgZ0omIs6/XD5feLcB4MiaCvAcqarkrmWKpymSI9JXqCTbOj8GpvD9G043zmYI 2MqSNq7+8CLpaRfStwhw7wJtfdZvFAnsSAc203KTc/asWV85eDlRGGr5TCyW85/ilYQx Ot01SDA5fLtf/JHR5L9dpP39QFhXJesWBEB055Hn9oN+JXHHqae3ZoHUwpodO+6bRbrw IwVu0OlE9AayKYuD3unBAteVHEnL9nWNc7j6MOxoQpWs7rUlpaNAYY17wwfFPmildfdl yyyA== X-Gm-Message-State: APjAAAUZqli9M5ylvuxyruSzR2r53IMn50mXDp9K0kAuOZks2nze0dua CDjZFgRRkHaRU5TWRKiO+Vma8/T7RalyOJCCao4rIZh+pIc= X-Google-Smtp-Source: APXvYqyUZSwrnxVJaX5JQq39IsWVWn5ovT/+XGeh90ZNUI9HN1ojRwxVlpXj4SnJkaZzkwAGWEaWKtNe7QPtz9P2YM8= X-Received: by 2002:a6b:f114:: with SMTP id e20mr15834300iog.169.1562779313998; Wed, 10 Jul 2019 10:21:53 -0700 (PDT) MIME-Version: 1.0 References: <20190710095247.GC47193@kib.kiev.ua> In-Reply-To: From: "damian@damianek.be" Date: Wed, 10 Jul 2019 19:21:18 +0200 Message-ID: Subject: Re: FreeBSD mds mitigation. To: freebsd-hackers@freebsd.org X-Rspamd-Queue-Id: D5260968AF X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=damianek-be.20150623.gappssmtp.com header.s=20150623 header.b=PvNduwOI; spf=pass (mx1.freebsd.org: domain of damian@damianek.be designates 2607:f8b0:4864:20::d32 as permitted sender) smtp.mailfrom=damian@damianek.be X-Spamd-Result: default: False [-5.08 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.995,0]; R_DKIM_ALLOW(-0.20)[damianek-be.20150623.gappssmtp.com:s=20150623]; FROM_DN_EQ_ADDR(1.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; DMARC_NA(0.00)[damianek.be]; MX_GOOD(-0.01)[cached: alt1.aspmx.l.google.com]; DKIM_TRACE(0.00)[damianek-be.20150623.gappssmtp.com:+]; RCVD_IN_DNSWL_NONE(0.00)[2.3.d.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; NEURAL_HAM_SHORT(-0.79)[-0.786,0]; IP_SCORE(-2.79)[ip: (-8.30), ipnet: 2607:f8b0::/32(-3.17), asn: 15169(-2.43), country: US(-0.06)]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Jul 2019 17:21:56 -0000 =C5=9Br., 10 lip 2019 o 18:56 Mike Tancsa napisa=C5=82(a)= : > Try the port > > sysutils/devcpu-data/ > > FreeBSD port is stale, does not contain the latest microcodes. --=20 damian@damianek.be From owner-freebsd-hackers@freebsd.org Wed Jul 10 17:23:56 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EF92315DDA40 for ; Wed, 10 Jul 2019 17:23:55 +0000 (UTC) (envelope-from allanjude@freebsd.org) Received: from mx1.scaleengine.net (mx1.scaleengine.net [209.51.186.6]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 7234D96D1B for ; Wed, 10 Jul 2019 17:23:55 +0000 (UTC) (envelope-from allanjude@freebsd.org) Received: from [10.1.1.2] (Seawolf.HML3.ScaleEngine.net [209.51.186.28]) (Authenticated sender: allanjude.freebsd@scaleengine.com) by mx1.scaleengine.net (Postfix) with ESMTPSA id 5B7541CE37 for ; Wed, 10 Jul 2019 17:23:54 +0000 (UTC) Subject: Re: zpool errors To: freebsd-hackers@freebsd.org References: <52CE32B1-7E01-4C35-A2AB-84D3D5BD4E2F@cs.huji.ac.il> <27c3e59a-07ea-5df3-9de2-302d5290a477@freebsd.org> <831204B6-3F3B-4736-89FA-1207C4C46A7E@cs.huji.ac.il> From: Allan Jude Openpgp: preference=signencrypt Autocrypt: addr=allanjude@freebsd.org; prefer-encrypt=mutual; keydata= mQINBFVwZcYBEADwrZDH0xe0ZVjc9ORCc6PcBLwS/RTXA6NkvpD6ea02pZ8lPOVgteuuugFc D34LdDbiWr+479vfrKBh+Y38GL0oZ0/13j10tIlDMHSa5BU0y6ACtnhupFvVlQ57+XaJAb/q 7qkfSiuxVwQ3FY3PL3cl1RrIP5eGHLA9hu4eVbu+FOX/q/XVKz49HaeIaxzo2Q54572VzIo6 C28McX9m65UL5fXMUGJDDLCItLmehZlHsQQ+uBxvODLFpVV2lUgDR/0rDa0B9zHZX8jY8qQ7 ZdCSy7CwClXI054CkXZCaBzgxYh/CotdI8ezmaw7NLs5vWNTxaDEFXaFMQtMVhvqQBpHkfOD 7rjjOmFw00nJL4FuPE5Yut0CPyx8vLjVmNJSt/Y8WxxmhutsqJYFgYfWl/vaWkrFLur/Zcmz IklwLw35HLsCZytCN5A3rGKdRbQjD6QPXOTJu0JPrJF6t2xFkWAT7oxnSV0ELhl2g+JfMMz2 Z1PDmS3NRnyEdqEm7NoRGXJJ7bgxDbN+9SXTyOletqGNXj/bSrBvhvZ0RQrzdHAPwQUfVSU2 qBhQEi2apSZstgVNMan0GUPqCdbE2zpysg+zT7Yhvf9EUQbzPL4LpdK1llT9fZbrdMzEXvEF oSvwJFdV3sqKmZc7b+E3PuxK6GTsKqaukd/3Cj8aLHG1T1im1QARAQABtCJBbGxhbiBKdWRl IDxhbGxhbmp1ZGVAZnJlZWJzZC5vcmc+iQI/BBMBAgApBQJVcGXGAhsjBQkSzAMABwsJCAcD AgEGFQgCCQoLBBYCAwECHgECF4AACgkQGZU1PhKYC34Muw/+JOKpSfhhysWFYiRXynGRDe07 Z6pVsn7DzrPUMRNZfHu8Uujmmy3p2nx9FelIY9yjd2UKHhug+whM54MiIFs90eCRVa4XEsPR 4FFAm0DAWrrb7qhZFcE/GhHdRWpZ341WAElWf6Puj2devtRjfYbikvj5+1V1QmDbju7cEw5D mEET44pTuD2VMRJpu2yZZzkM0i+wKFuPxlhqreufA1VNkZXI/rIfkYWK+nkXd9Efw3YdCyCQ zUgTUCb88ttSqcyhik/li1CDbXBpkzDCKI6I/8fAb7jjOC9LAtrZJrdgONywcVFoyK9ZN7EN AVA+xvYCmuYhR/3zHWH1g4hAm1v1+gIsufhajhfo8/wY1SetlzPaYkSkVQLqD8T6zZyhf+AN bC7ci44UsiKGAplB3phAXrtSPUEqM86kbnHg3fSx37kWKUiYNOnx4AC2VXvEiKsOBlpyt3dw WQbOtOYM+vkfbBwDtoGOOPYAKxc4LOIt9r+J8aD+gTooi9Eo5tvphATf9WkCpl9+aaGbSixB tUpvQMRnSMqTqq4Z7DeiG6VMRQIjsXDSLJEUqcfhnLFo0Ko/RiaHd5xyAQ4DhQ9QpkyQjjNf /3f/dYG7JAtoD30txaQ5V8uHrz210/77DRRX+HJjEj6xCxWUGvQgvEZf5XXyxeePvqZ+zQyT DX61bYw6w6a5Ag0EVXBlxgEQAMy7YVnCCLN4oAOBVLZ5nUbVPvpUhsdA94/0/P+uqCIh28Cz ar56OCX0X19N/nAWecxL4H32zFbIRyDB2V/MEh4p9Qvyu/j4i1r3Ex5GhOT2hnit43Ng46z5 29Es4TijrHJP4/l/rB2VOqMKBS7Cq8zk1cWqaI9XZ59imxDNjtLLPPM+zQ1yE3OAMb475QwN UgWxTMw8rkA7CEaqeIn4sqpTSD5C7kT1Bh26+rbgJDZ77D6Uv1LaCZZOaW52okW3bFbdozV8 yM2u+xz2Qs8bHz67p+s+BlygryiOyYytpkiK6Iy4N7FTolyj5EIwCuqzfk0SaRHeOKX2ZRjC qatkgoD/t13PNT38V9tw3qZVOJDS0W6WM8VSg+F+bkM9LgJ8CmKV+Hj0k3pfGfYPOZJ/v18i +SmZmL/Uw2RghnwDWGAsPCKu4uZR777iw7n9Io6Vfxndw2dcS0e9klvFYoaGS6H2F13Asygr WBzFNGFQscN4mUW+ZYBzpTOcHkdT7w8WS55BmXYLna+dYer9/HaAuUrONjujukN4SPS1fMJ2 /CS/idAUKyyVVX5vozoNK2JVC1h1zUAVsdnmhEzNPsvBoqcVNfyqBFROEVLIPwq+lQMGNVjH ekLTKRWf59MEhUC2ztjSKkGmwdg73d6xSXMuq45EgIJV2wPvOgWQonoHH/kxABEBAAGJAiUE GAECAA8FAlVwZcYCGwwFCRLMAwAACgkQGZU1PhKYC34w5A//YViBtZyDV5O+SJT9FFO3lb9x Zdxf0trA3ooCt7gdBkdnBM6T5EmjgVZ3KYYyFfwXZVkteuCCycMF/zVw5eE9FL1+zz9gg663 nY9q2F77TZTKXVWOLlOV2bY+xaK94U4ytogOGhh9b4UnQ/Ct3+6aviCF78Go608BXbmF/GVT 7uhddemk7ItxM1gE5Hscx3saxGKlayaOsdPKeGTVJCDEtHDuOc7/+jGh5Zxpk/Hpi+DUt1ot 8e6hPYLIQa4uVx4f1xxxV858PQ7QysSLr9pTV7FAQ18JclCaMc7JWIa3homZQL/MNKOfST0S 2e+msuRwQo7AnnfFKBUtb02KwpA4GhWryhkjUh/kbVc1wmGxaU3DgXYQ5GV5+Zf4kk/wqr/7 KG0dkTz6NLCVLyDlmAzuFhf66DJ3zzz4yIo3pbDYi3HB/BwJXVSKB3Ko0oUo+6/qMrOIS02L s++QE/z7K12CCcs7WwOjfCYHK7VtE0Sr/PfybBdTbuDncOuAyAIeIKxdI2nmQHzl035hhvQX s4CSghsP319jAOQiIolCeSbTMD4QWMK8RL/Pe1FI1jC3Nw9s+jq8Dudtbcj2UwAP/STUEbJ9 5rznzuuhPjE0e++EU/RpWmcaIMK/z1zZDMN+ce2v1qzgV936ZhJ3iaVzyqbEE81gDxg3P+IM kiYh4ZtPB4Q= Message-ID: <70f1be10-e37a-de20-e188-6155fda2d06a@freebsd.org> Date: Wed, 10 Jul 2019 13:23:48 -0400 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.7.2 MIME-Version: 1.0 In-Reply-To: <831204B6-3F3B-4736-89FA-1207C4C46A7E@cs.huji.ac.il> Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="cSLVop16jjz4EyS98zY5lSArhI0tAd7Gn" X-Rspamd-Queue-Id: 7234D96D1B X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-2.98 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.98)[-0.981,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; ASN(0.00)[asn:6939, ipnet:209.51.160.0/19, country:US] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Jul 2019 17:23:56 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --cSLVop16jjz4EyS98zY5lSArhI0tAd7Gn Content-Type: multipart/mixed; boundary="3juXn4CmZuvoQmL2WPzxjRyfJ3EUVwj59"; protected-headers="v1" From: Allan Jude To: freebsd-hackers@freebsd.org Message-ID: <70f1be10-e37a-de20-e188-6155fda2d06a@freebsd.org> Subject: Re: zpool errors References: <52CE32B1-7E01-4C35-A2AB-84D3D5BD4E2F@cs.huji.ac.il> <27c3e59a-07ea-5df3-9de2-302d5290a477@freebsd.org> <831204B6-3F3B-4736-89FA-1207C4C46A7E@cs.huji.ac.il> In-Reply-To: <831204B6-3F3B-4736-89FA-1207C4C46A7E@cs.huji.ac.il> --3juXn4CmZuvoQmL2WPzxjRyfJ3EUVwj59 Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable On 2019-07-10 11:37, Daniel Braniss wrote: >=20 >=20 >> On 10 Jul 2019, at 18:24, Allan Jude wrote: >> >> On 2019-07-10 10:48, Daniel Braniss wrote: >>> hi, >>> i got a degraded pool, but can=E2=80=99t make sense of the file name= : >>> >>> protonew-2# zpool status -vx >>> pool: h >>> state: ONLINE >>> status: One or more devices has experienced an error resulting in dat= a >>> corruption. Applications may be affected. >>> action: Restore the file in question if possible. Otherwise restore = the >>> entire pool from backup. >>> see: http://illumos.org/msg/ZFS-8000-8A >>> scan: scrub repaired 6.50K in 17h30m with 0 errors on Wed Jul 10 12:0= 6:14 2019 >>> config: >>> >>> NAME STATE READ WRITE CKSUM >>> h ONLINE 0 0 14.4M >>> gpt/r5/zfs ONLINE 0 0 57.5M >>> >>> errors: Permanent errors have been detected in the following files: >>> >>> <0x102>:<0x30723> >>> <0x102>:<0x30726> >>> <0x102>:<0x3062a> >>> =E2=80=A6 >>> <0x281>:<0x0> >>> <0x6aa>:<0x305cd> >>> <0xffffffffffffffff>:<0x305cd> >>> >>> >>> any hints as how I can identify third files? >>> >>> thanks, >>> danny >>> >>> _______________________________________________ >>> freebsd-hackers@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-hackers >>> To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd= =2Eorg" >>> >> >> Once a file has been deleted, ZFS can have a hard time determining its= >> filename. >> >> It is inode 198186 (0x3062a) on dataset 0x102. The file has been >> deleted, but still exists in at least one snapshot. >> >> Although, 57 million checksum errors seems like there may be some othe= r >> problem. You might look for and resolve the problem with what appears = to >> be a raid5 you have built your ZFS pool on top of it? Then do 'zpool >> clear' to reset the counters to zero, and 'zpool scrub' to try to read= >> everything again. >> >> --=20 >> Allan Jude >> > I don=E2=80=99t know when the first error was detected, and this host h= as been up for 367 days! > I did a scrub but no change. > i will remove old snapshots and see if it helps. >=20 > is it possible to know at least which volume? >=20 > thanks, > danny >=20 >=20 > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.o= rg" >=20 zdb -ddddd h 0x102 Should tell you about which dataset that is --=20 Allan Jude --3juXn4CmZuvoQmL2WPzxjRyfJ3EUVwj59-- --cSLVop16jjz4EyS98zY5lSArhI0tAd7Gn Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (MingW32) iQIcBAEBAgAGBQJdJh8nAAoJEBmVNT4SmAt+tbgP/2YayvOpt7aNMPTUB20KkiOl nzU/KngyHy/ruLT5+SRx3dzTKDXoEbsaVS2wbczHlBaTwfaD8fjzNoMCC1XRe0uF cbO4/MI+B2QSSfFGcPfW5U/gltJ2hbhsZu8uKvZwzWd8tsBjWwLypRY2TO2/J+V0 ri1+Y79hqaiJWxjFTdjS+FsDXy4JRUP3T4tnS0i+llC70BGfSbymqEHr+I2yNCNR Xz4D5CCzzzLH8eiq6TUL/dj5K58jSow45WDBc7wTYqWil1IStHdS1AIKGiGohtOg 5JoAoTpH1pIUO88ndzdq8MHcroIs7uG/yxmM8wQCF7OS9ClH3bVczaMJUuyM+nJc Nr331AmraDqUfAckWMX1+hysI3/aLuGEpcyR3ycnmpt0jPk7KMWpu1OhG09423Tw g/h8jnma72nVQdBLPdLUyBEXQGG1RbeivnFX7bANJ5i8/PcWg86L3kXPn39/LSj8 FXUay81UnFFIj0aAAMGhMQ9Bf5UeT6ImalRthBM4CStBbyS7ucTsDZOCSj5RhNVy jO1OzMXjtloWuWkA9VzY85UmCuQpWBGVabY0YmUO3cD9mLBJ3pPoF/HN/PjxxZ3e 4ywxs0M2yNQoDt5LC702gLvTBLTMHc4yVCk3Qom9CJdReUYfdcm+Z/mw1Bg+OTK8 HVykq0IlJlWlFPAkIa/o =c3Wj -----END PGP SIGNATURE----- --cSLVop16jjz4EyS98zY5lSArhI0tAd7Gn-- From owner-freebsd-hackers@freebsd.org Wed Jul 10 18:17:32 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 51D7915DF465 for ; Wed, 10 Jul 2019 18:17:32 +0000 (UTC) (envelope-from mike@sentex.net) Received: from pyroxene.sentex.ca (unknown [IPv6:2607:f3e0:0:3::18]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "pyroxene.sentex.ca", Issuer "Let's Encrypt Authority X3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 6B90B6AA3D; Wed, 10 Jul 2019 18:17:31 +0000 (UTC) (envelope-from mike@sentex.net) Received: from [192.168.43.29] ([192.168.43.29]) by pyroxene.sentex.ca (8.15.2/8.15.2) with ESMTPS id x6AIHRe3037260 (version=TLSv1.2 cipher=AES128-SHA bits=128 verify=NO); Wed, 10 Jul 2019 14:17:28 -0400 (EDT) (envelope-from mike@sentex.net) Subject: Re: FreeBSD mds mitigation. To: "damian@damianek.be" , freebsd-hackers@freebsd.org References: <20190710095247.GC47193@kib.kiev.ua> From: mike tancsa Message-ID: <71f9d553-7880-eb1d-3bb0-847e5693c599@sentex.net> Date: Wed, 10 Jul 2019 14:17:28 -0400 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.7.2 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Content-Language: en-US X-Rspamd-Queue-Id: 6B90B6AA3D X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of mike@sentex.net designates 2607:f3e0:0:3::18 as permitted sender) smtp.mailfrom=mike@sentex.net X-Spamd-Result: default: False [-0.65 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f3e0::/32]; NEURAL_HAM_LONG(-0.99)[-0.994,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[sentex.net]; RDNS_NONE(1.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: smtp.sentex.ca]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.18)[-0.180,0]; NEURAL_HAM_MEDIUM(-0.94)[-0.942,0]; IP_SCORE(-1.72)[ipnet: 2607:f3e0::/32(-4.94), asn: 11647(-3.58), country: CA(-0.09)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA]; HFILTER_HOSTNAME_UNKNOWN(2.50)[]; MID_RHS_MATCH_FROM(0.00)[]; FORGED_RECIPIENTS(0.00)[damian@damianek.be .., freebsd-hackers@freebsd.org ...] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Jul 2019 18:17:32 -0000 On 7/10/2019 1:21 PM, damian@damianek.be wrote: > śr., 10 lip 2019 o 18:56 Mike Tancsa napisał(a): > >> Try the port >> >> sysutils/devcpu-data/ >> >> > FreeBSD port is stale, does not contain the latest microcodes. Looking at the port it seems like you can grab the versions newer than May. There does not seem to be too many transformations going on. 0{backup4}# make extract ===>  License EULA accepted by the user ===>   devcpu-data-1.22 depends on file: /usr/local/sbin/pkg - found ===> Fetching all distfiles required by devcpu-data-1.22 for building ===>  Extracting for devcpu-data-1.22 => SHA256 Checksum OK for amd64-microcode.20181214.tar.xz. => SHA256 Checksum OK for intel-Intel-Linux-Processor-Microcode-Data-Files-1.22-microcode-20190514_GH0.tar.gz. cp -f -p /usr/ports/sysutils/devcpu-data/files/Makefile /usr/ports/sysutils/devcpu-data/files/ucode-split.c /usr/ports/sysutils/devcpu-data/work/Intel-Linux-Processor-Microcode-Data-Files-microcode-20190514 /usr/bin/sed -i.bak 's|%%GH_TAGNAME%%|microcode-20190514|g' /usr/ports/sysutils/devcpu-data/work/Intel-Linux-Processor-Microcode-Data-Files-microcode-20190514/Makefile /bin/cat /usr/ports/sysutils/devcpu-data/work/Intel-Linux-Processor-Microcode-Data-Files-microcode-20190514/Intel-Linux-Processor-Microcode-Data-Files-microcode-20190514/intel-ucode/* /usr/ports/sysutils/devcpu-data/work/Intel-Linux-Processor-Microcode-Data-Files-microcode-20190514/Intel-Linux-Processor-Microcode-Data-Files-microcode-20190514/intel-ucode-with-caveats/* > /usr/ports/sysutils/devcpu-data/work/Intel-Linux-Processor-Microcode-Data-Files-microcode-20190514/intel-ucode.bin 0{backup4}# 0{backup4}# 0{backup4}# make ===>  Patching for devcpu-data-1.22 ===>  Configuring for devcpu-data-1.22 ===>  Building for devcpu-data-1.22 --- ucode-split --- cc ucode-split.c -o ucode-split --- ucode --- mkdir -p mcodes cd mcodes &&  for file in  ../Intel-Linux-Processor-Microcode-Data-Files-microcode-20190514/intel-ucode/[0-9,a-f][0-9,a-f]-[0-9,a-f][0-9,a-f]-[0-9,a-f][0-9,a-f]; do  ../ucode-split $file;  done ===>  Staging for devcpu-data-1.22 ===>   Generating temporary packing list /bin/mkdir -p /usr/ports/sysutils/devcpu-data/work/stage/usr/local/share/cpucontrol/ install  -m 0644 /usr/ports/sysutils/devcpu-data/work/Intel-Linux-Processor-Microcode-Data-Files-microcode-20190514/microcode_amd.bin /usr/ports/sysutils/devcpu-data/work/stage/usr/local/share/cpucontrol/ install  -m 0644 /usr/ports/sysutils/devcpu-data/work/Intel-Linux-Processor-Microcode-Data-Files-microcode-20190514/microcode_amd_fam15h.bin /usr/ports/sysutils/devcpu-data/work/stage/usr/local/share/cpucontrol/ install  -m 0644 /usr/ports/sysutils/devcpu-data/work/Intel-Linux-Processor-Microcode-Data-Files-microcode-20190514/microcode_amd_fam16h.bin /usr/ports/sysutils/devcpu-data/work/stage/usr/local/share/cpucontrol/ install  -m 0644 /usr/ports/sysutils/devcpu-data/work/Intel-Linux-Processor-Microcode-Data-Files-microcode-20190514/microcode_amd_fam17h.bin /usr/ports/sysutils/devcpu-data/work/stage/usr/local/share/cpucontrol/ install  -m 0644 /usr/ports/sysutils/devcpu-data/work/Intel-Linux-Processor-Microcode-Data-Files-microcode-20190514/mcodes/* /usr/ports/sysutils/devcpu-data/work/stage/usr/local/share/cpucontrol/ /bin/mkdir -p /usr/ports/sysutils/devcpu-data/work/stage/boot/firmware install  -m 0644 /usr/ports/sysutils/devcpu-data/work/Intel-Linux-Processor-Microcode-Data-Files-microcode-20190514/intel-ucode.bin /usr/ports/sysutils/devcpu-data/work/stage/boot/firmware/ ====> Compressing man pages (compress-man) ===> Staging rc.d startup script(s) 0{backup4}# From owner-freebsd-hackers@freebsd.org Wed Jul 10 20:10:22 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 928CA15E277B for ; Wed, 10 Jul 2019 20:10:22 +0000 (UTC) (envelope-from amvandemore@gmail.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id D0A0D6FE24 for ; Wed, 10 Jul 2019 20:10:21 +0000 (UTC) (envelope-from amvandemore@gmail.com) Received: by mailman.ysv.freebsd.org (Postfix) id 87C9A15E277A; Wed, 10 Jul 2019 20:10:21 +0000 (UTC) Delivered-To: hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4A29E15E2779 for ; Wed, 10 Jul 2019 20:10:21 +0000 (UTC) (envelope-from amvandemore@gmail.com) Received: from mail-io1-xd2f.google.com (mail-io1-xd2f.google.com [IPv6:2607:f8b0:4864:20::d2f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id BB9F56FE1E for ; Wed, 10 Jul 2019 20:10:20 +0000 (UTC) (envelope-from amvandemore@gmail.com) Received: by mail-io1-xd2f.google.com with SMTP id i10so7438613iol.13 for ; Wed, 10 Jul 2019 13:10:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=towxSUlZIQ1sM7CGkpnlxUYSnQSm78y7NqJWxrfO9RU=; b=LNkod40ILY7PxSlIQW5Yla+t4ZPO9fYnqd/RrPi5q9fAku52V0oZg+6EdD0YT7PMKG OO6qStLdKS9SPnmyhVezxZdsBviC9SL6ar6Ka4qCmIir/P6mSwuiRLT/XziEZex4v9Jx V0VDWvgMf7P4tspm//u69uLbwxEYxJRt1fqGJFRzbL28RwIqgOTaY4leBEgewfnl+TVX W07KLobd6uxX1i6hH5nuDb/Cdo14UoTIC84TI9M3xOuyymSJfFXdRZkU0jwkELGRlLkU kjzAPXCET8QUI7jwJ0F2TLGTbH2csxNh4qUdmhWzS11wa2/cihuxYwJ+W9zYzFSh6X2K xJ9A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=towxSUlZIQ1sM7CGkpnlxUYSnQSm78y7NqJWxrfO9RU=; b=buS7M8ZosvKrDvQ6KFX3gV9u6UCJo6aheFEnCsgneZP7SnLw36nshQqIldApabcjfu q7mw2STJcm5D/lHRi4KbpSZNA8Z0YrudOyyt2Hl8aUZzqjZ5YKfaiIShv0U2nn64dw/F c3YNeFkT01djGwACc1DkkmuJpPSnjDhcGDsYEk+Mq1QDA7k3xSI6hmXh4PossktFwmS0 P2R2bKf95oW5GspO6vkyjzmaNpnFIK3U1pHh+qWdJkeVK4shu8wdc62c7h8ndjqNBjuh PFk4dwohpCJPbQXAt/thd8pHP24FikW4a4yQdZbA4kYnQS7T9mpPv1cOrZokOUcKIpvS JQCw== X-Gm-Message-State: APjAAAVt8/KgJd6xWgSqzQ8g5L1ZZucW0UoakfWtmlFsCHdHa/1kk1d5 hm5mmxyDng8q9ACa89DvJ8IN9E0PYBAn4r3kwOAldoK3BE0= X-Google-Smtp-Source: APXvYqyWJ8X6UUab0AQMotEbFDSyn1zllSMTqAPbF3QkDulHoKnP0tOS1VIa33Paq21bdWz0t3ggQ+8W6wlt96VoD1Y= X-Received: by 2002:a6b:bf01:: with SMTP id p1mr3481897iof.181.1562789419290; Wed, 10 Jul 2019 13:10:19 -0700 (PDT) MIME-Version: 1.0 References: <52CE32B1-7E01-4C35-A2AB-84D3D5BD4E2F@cs.huji.ac.il> In-Reply-To: <52CE32B1-7E01-4C35-A2AB-84D3D5BD4E2F@cs.huji.ac.il> From: Adam Date: Wed, 10 Jul 2019 15:10:07 -0500 Message-ID: Subject: Re: zpool errors To: Daniel Braniss Cc: hackers@freebsd.org X-Rspamd-Queue-Id: BB9F56FE1E X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.97 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.97)[-0.970,0]; REPLY(-4.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Jul 2019 20:10:22 -0000 On Wed, Jul 10, 2019 at 9:50 AM Daniel Braniss wrote: > hi, > i got a degraded pool, but can=E2=80=99t make sense of the file name: > > protonew-2# zpool status -vx > pool: h > state: ONLINE > status: One or more devices has experienced an error resulting in data > corruption. Applications may be affected. > action: Restore the file in question if possible. Otherwise restore the > entire pool from backup. > see: http://illumos.org/msg/ZFS-8000-8A < > http://illumos.org/msg/ZFS-8000-8A> > scan: scrub repaired 6.50K in 17h30m with 0 errors on Wed Jul 10 12:06:1= 4 > 2019 > config: > > NAME STATE READ WRITE CKSUM > h ONLINE 0 0 14.4M > gpt/r5/zfs ONLINE 0 0 57.5M > > errors: Permanent errors have been detected in the following files: > > <0x102>:<0x30723> > <0x102>:<0x30726> > <0x102>:<0x3062a> > =E2=80=A6 > <0x281>:<0x0> > <0x6aa>:<0x305cd> > <0xffffffffffffffff>:<0x305cd> > > > any hints as how I can identify third files? > > thanks, > danny > You can brute force it like this: find /data -type file -exec sh -c 'dd if=3D"$0" bs=3D1m status=3Dprogress of=3D/dev/null' {} \; to check each file for readability, but it's a hack that has diminishing usefulness for larger file systems. --=20 Adam From owner-freebsd-hackers@freebsd.org Wed Jul 10 23:48:16 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C654315E64DC for ; Wed, 10 Jul 2019 23:48:16 +0000 (UTC) (envelope-from leres@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2E2BB80087 for ; Wed, 10 Jul 2019 23:48:16 +0000 (UTC) (envelope-from leres@freebsd.org) Received: from ice.alameda.xse.com (unknown [IPv6:2001:558:6045:10:3521:9d26:314a:fa8e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: leres) by smtp.freebsd.org (Postfix) with ESMTPSA id C98B410B22 for ; Wed, 10 Jul 2019 23:48:15 +0000 (UTC) (envelope-from leres@freebsd.org) To: FreeBSD Hackers From: Craig Leres Subject: update4.freebsd.org does not have 11.2-RELEASE-p11 Message-ID: Date: Wed, 10 Jul 2019 16:48:13 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.8.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 2E2BB80087 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-3.00 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-1.00)[-0.996,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; ASN(0.00)[asn:11403, ipnet:96.47.64.0/20, country:US] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Jul 2019 23:48:16 -0000 (Is this expected?) Craig From owner-freebsd-hackers@freebsd.org Thu Jul 11 00:12:27 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A64DB15E6F82 for ; Thu, 11 Jul 2019 00:12:27 +0000 (UTC) (envelope-from lwhsu.freebsd@gmail.com) Received: from mail-yb1-f179.google.com (mail-yb1-f179.google.com [209.85.219.179]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D74E781065; Thu, 11 Jul 2019 00:12:26 +0000 (UTC) (envelope-from lwhsu.freebsd@gmail.com) Received: by mail-yb1-f179.google.com with SMTP id a14so1401417ybm.11; Wed, 10 Jul 2019 17:12:26 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=urI9BfC4JTOeIcs7kcA0xluSpTU6cLY39dOgYvn1+BA=; b=aUfysy4zs7TxJHJyuXLwO01L3bfBgOwi8IHt9IsiBzovSj22AFkkrMRfi7VdHLJRgB LyW/PvIyxuUgLrB5Z21WKYM5M370TiLq78JxsvbYXlTEQxOHgFGTP+2cmYqPg8jdjPFd Ia0B5TIJQSKV9+Fan696uYiqMlEZe5wgig70bKGw1A+kMZyfxUxSoSJH+9ybK7HEkKeE iP8KLHxOOF6ecfNhwo9FOKJRJCcwAIB/n7LH1D1jWugBU8FRaORp5kB5/c/F4ftfKEwh K+eGC78KadN/7IgBIidItBXr5lyWEtjRo+s5dddeZCBtktGCFD9UMD1TS3/6FnmmDVdi Zvtw== X-Gm-Message-State: APjAAAUVe8i3UPJfqbESvBc3KViyQAsLxQ2BN0V7wOp9o4D77250dPnI FdlhvpQoKfiFennVfKXZsJBHWCdmpbuBkRBvuQmZ3nL+ X-Google-Smtp-Source: APXvYqyzC3lIDI7LBbWfSTYCtIzVCNVqJ6/gV6IW8MtWSjGsLhllUUas757wdqrZCnHmltOBVQVO2PtuaQ53b85ewGc= X-Received: by 2002:a25:30d4:: with SMTP id w203mr414826ybw.405.1562803939295; Wed, 10 Jul 2019 17:12:19 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Li-Wen Hsu Date: Thu, 11 Jul 2019 08:12:05 +0800 Message-ID: Subject: Re: update4.freebsd.org does not have 11.2-RELEASE-p11 To: Craig Leres Cc: FreeBSD Hackers Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: D74E781065 X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of lwhsufreebsd@gmail.com designates 209.85.219.179 as permitted sender) smtp.mailfrom=lwhsufreebsd@gmail.com X-Spamd-Result: default: False [-5.44 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; URL_IN_SUBJECT(0.40)[update4.freebsd.org]; TAGGED_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; IP_SCORE(-3.06)[ip: (-9.34), ipnet: 209.85.128.0/17(-3.46), asn: 15169(-2.44), country: US(-0.06)]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[179.219.85.209.list.dnswl.org : 127.0.5.0]; NEURAL_HAM_SHORT(-0.78)[-0.777,0]; FORGED_SENDER(0.30)[lwhsu@freebsd.org,lwhsufreebsd@gmail.com]; MIME_TRACE(0.00)[0:+]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[lwhsu@freebsd.org,lwhsufreebsd@gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Jul 2019 00:12:27 -0000 On Thu, Jul 11, 2019 at 7:50 AM Craig Leres wrote: > > (Is this expected?) > No, but it has been removed out of SRV pool. How were you redirected to it? Li-Wen From owner-freebsd-hackers@freebsd.org Thu Jul 11 00:22:04 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1B12115E7338 for ; Thu, 11 Jul 2019 00:22:04 +0000 (UTC) (envelope-from leres@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A180581913; Thu, 11 Jul 2019 00:22:03 +0000 (UTC) (envelope-from leres@freebsd.org) Received: from ice.alameda.xse.com (unknown [IPv6:2001:558:6045:10:3521:9d26:314a:fa8e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: leres) by smtp.freebsd.org (Postfix) with ESMTPSA id 3FC6010FD8; Thu, 11 Jul 2019 00:22:03 +0000 (UTC) (envelope-from leres@freebsd.org) Subject: Re: update4.freebsd.org does not have 11.2-RELEASE-p11 To: Li-Wen Hsu References: Cc: FreeBSD Hackers From: Craig Leres Message-ID: <6186b42d-21b2-f5e4-237f-2765ee091685@freebsd.org> Date: Wed, 10 Jul 2019 17:22:02 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: A180581913 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-2.99 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.99)[-0.994,0]; ASN(0.00)[asn:11403, ipnet:2610:1c1:1::/48, country:US]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Jul 2019 00:22:04 -0000 On 2019-07-10 15:12, Li-Wen Hsu wrote: > No, but it has been removed out of SRV pool. How were you redirected to it? I had picked it manually a few years back when I was getting poor performance from the default update server. Craig From owner-freebsd-hackers@freebsd.org Thu Jul 11 07:39:45 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3527C15EEB54 for ; Thu, 11 Jul 2019 07:39:45 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from kabab.cs.huji.ac.il (kabab.cs.huji.ac.il [132.65.116.210]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9B4B26A572; Thu, 11 Jul 2019 07:39:42 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=cs.huji.ac.il; s=57791128; h=To:References:Message-Id:Content-Transfer-Encoding:Cc:Date:In-Reply-To:From:Subject:Mime-Version:Content-Type; bh=VsvUJmje+zRMyj8ne5WJr98VWP+SaKYV5+45HFk2HFQ=; b=vcfHsUbGS0m6scJ5CRLwK6BJPS5Ri7e1t7rCeH4heRX6BYLK/gbAMfcTNCZj9MKDWQ4hAvQFDfXzCEyMH/3+E+3xjCuNwrkl/oRaHYft4gd5EZ7LB9zqPiM8lG1hu/qhp2P0mZCGsTwLYMK06lMcV8ujrEz6VI9CLvwfYf9/toTBaBFXJfIJi10F+NZQ1aHKiVTG1fT/tVsw+4QBs3Xu+ZMAnmjfs9CUqstX62LEVOIG7xgIA3CelrfB29IPsahaBRSgefNwx1lo/VlS12iOFef4ZbKlCICHYhcUPGbRyjApSFXYTOzG8WplUQA948ORo72pRHHKBvDvpIU3qG4Fzw==; Received: from bach.cs.huji.ac.il ([132.65.80.20]) by kabab.cs.huji.ac.il with esmtp id 1hlTfz-000Fql-1C; Thu, 11 Jul 2019 10:39:35 +0300 Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 11.5 \(3445.9.1\)) Subject: Re: zpool errors From: Daniel Braniss In-Reply-To: <70f1be10-e37a-de20-e188-6155fda2d06a@freebsd.org> Date: Thu, 11 Jul 2019 10:39:34 +0300 Cc: freebsd-hackers@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <05D8BD75-78B4-4336-8A8A-C84A901CB3D4@cs.huji.ac.il> References: <52CE32B1-7E01-4C35-A2AB-84D3D5BD4E2F@cs.huji.ac.il> <27c3e59a-07ea-5df3-9de2-302d5290a477@freebsd.org> <831204B6-3F3B-4736-89FA-1207C4C46A7E@cs.huji.ac.il> <70f1be10-e37a-de20-e188-6155fda2d06a@freebsd.org> To: Allan Jude X-Mailer: Apple Mail (2.3445.9.1) X-Rspamd-Queue-Id: 9B4B26A572 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=cs.huji.ac.il header.s=57791128 header.b=vcfHsUbG X-Spamd-Result: default: False [-2.38 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.88)[-0.884,0]; R_DKIM_ALLOW(-0.20)[cs.huji.ac.il:s=57791128]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[huji.ac.il]; NEURAL_HAM_LONG(-1.00)[-0.996,0]; IP_SCORE(-0.41)[ipnet: 132.64.0.0/13(-1.18), asn: 378(-0.94), country: IL(0.05)]; MX_GOOD(-0.01)[cached: kabab.cs.huji.ac.il]; DKIM_TRACE(0.00)[cs.huji.ac.il:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[210.116.65.132.list.dnswl.org : 127.0.10.0]; R_SPF_NA(0.00)[]; NEURAL_HAM_SHORT(-0.28)[-0.280,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:378, ipnet:132.64.0.0/13, country:IL]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Jul 2019 07:39:45 -0000 > On 10 Jul 2019, at 20:23, Allan Jude wrote: >=20 > On 2019-07-10 11:37, Daniel Braniss wrote: >>=20 >>=20 >>> On 10 Jul 2019, at 18:24, Allan Jude wrote: >>>=20 >>> On 2019-07-10 10:48, Daniel Braniss wrote: >>>> hi, >>>> i got a degraded pool, but can=E2=80=99t make sense of the file = name: >>>>=20 >>>> protonew-2# zpool status -vx >>>> pool: h >>>> state: ONLINE >>>> status: One or more devices has experienced an error resulting in = data >>>> corruption. Applications may be affected. >>>> action: Restore the file in question if possible. Otherwise = restore the >>>> entire pool from backup. >>>> see: http://illumos.org/msg/ZFS-8000-8A = >>>> scan: scrub repaired 6.50K in 17h30m with 0 errors on Wed Jul 10 = 12:06:14 2019 >>>> config: >>>>=20 >>>> NAME STATE READ WRITE CKSUM >>>> h ONLINE 0 0 14.4M >>>> gpt/r5/zfs ONLINE 0 0 57.5M >>>>=20 >>>> errors: Permanent errors have been detected in the following files: >>>>=20 >>>> <0x102>:<0x30723> >>>> <0x102>:<0x30726> >>>> <0x102>:<0x3062a> >>>> =E2=80=A6 >>>> <0x281>:<0x0> >>>> <0x6aa>:<0x305cd> >>>> <0xffffffffffffffff>:<0x305cd> >>>>=20 >>>>=20 >>>> any hints as how I can identify third files? >>>>=20 >>>> thanks, >>>> danny >>>>=20 >>>> _______________________________________________ >>>> freebsd-hackers@freebsd.org mailing list >>>> https://lists.freebsd.org/mailman/listinfo/freebsd-hackers >>>> To unsubscribe, send any mail to = "freebsd-hackers-unsubscribe@freebsd.org" >>>>=20 >>>=20 >>> Once a file has been deleted, ZFS can have a hard time determining = its >>> filename. >>>=20 >>> It is inode 198186 (0x3062a) on dataset 0x102. The file has been >>> deleted, but still exists in at least one snapshot. >>>=20 >>> Although, 57 million checksum errors seems like there may be some = other >>> problem. You might look for and resolve the problem with what = appears to >>> be a raid5 you have built your ZFS pool on top of it? Then do 'zpool >>> clear' to reset the counters to zero, and 'zpool scrub' to try to = read >>> everything again. >>>=20 >>> --=20 >>> Allan Jude >>>=20 >> I don=E2=80=99t know when the first error was detected, and this host = has been up for 367 days! >> I did a scrub but no change. >> i will remove old snapshots and see if it helps. >>=20 >> is it possible to know at least which volume? >>=20 >> thanks, >> danny >>=20 >>=20 >> _______________________________________________ >> freebsd-hackers@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-hackers >> To unsubscribe, send any mail to = "freebsd-hackers-unsubscribe@freebsd.org" >>=20 >=20 > zdb -ddddd h 0x102 >=20 > Should tell you about which dataset that is >=20 > --=20 > Allan Jude >=20 firstly, thanks for your help! now, after doing a zpool clear, I notice that the CHKSUM is growing, the pool is on a raid controller raid5 (PERC from dell) which is showing it=E2=80=99s correcting the errors (=E2=80=98Corrected medium error = during recovery on PD =E2=80=A6). so what can be the cause? btw, the FreeBSD is 10.3-stable. From owner-freebsd-hackers@freebsd.org Thu Jul 11 07:57:46 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9748F15CA5FA for ; Thu, 11 Jul 2019 07:57:46 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: from mail-wr1-x436.google.com (mail-wr1-x436.google.com [IPv6:2a00:1450:4864:20::436]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6E5B66B42A for ; Thu, 11 Jul 2019 07:57:45 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: by mail-wr1-x436.google.com with SMTP id r1so5144979wrl.7 for ; Thu, 11 Jul 2019 00:57:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=multiplay-co-uk.20150623.gappssmtp.com; s=20150623; h=subject:to:cc:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-transfer-encoding:content-language; bh=bMYqj0nVh5X34ApjaJTEMZSANeQ7dBLWY/zpmIhoRY8=; b=Y3R2AjpY2THDeqY401s8tWEv8lqZEtGPf8XQ9QCPIMxiVTLqXP+Ux8scVO81o+BMLq wx4/df3NzRktCvyywbSuCJahPQMpItWrqmhtRnlnt0YGva8Iyc1mzOLZufoCdFmJrMSM HJZjOpw5bST8bf2eiZPxd3xFp19c1P0lmhbkLE7/L3KrPJb4ySvr0A8X/9/qCNszACP3 HO/oNYUX6gt1Q13VzAqCPjj9elUemYNMbEurC/kXsaIzdARrxwcLAAG6cL+qdIIWKx1W 7MgHDVBImM1UrEJzuFWVnWCcgPfw5ciwNNCWG24k60Y3y1Qpcz5TQDVU8T/N6gGS3Y0l LeHQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding :content-language; bh=bMYqj0nVh5X34ApjaJTEMZSANeQ7dBLWY/zpmIhoRY8=; b=beVe4307dqCdMH178uf3WzAWecP1bqOUMmgPn5449PFX3PpQR2dOiwIBUe+3sDUVQD XhmigAieqEeQj4kW/B93EqrqLwUPnhHts9FZyJKwr/TvL6Bi/8WPmhCG8MVP/p2BBwzb 7TfAiHsYOf6TkhYbB+XGzhexNuaa2EbRunFF6aEtdYK/tl1kcNsacAfnIlV5VqtFmXsd MmdvekHEFUZuR0yCfe7WFNB9kiNZWuoQZOD1IPUjcWrCD4OG7blqE7snrGFMxJ7GbuZG r9R180s7zmjItzlHX7P0sOmVDjuarrhIIHGg3gTw1N6CIEgsUh9i1ryAkS1q7EttUWmB pE8w== X-Gm-Message-State: APjAAAWpAZTCoD1dGK102xOcb3a5HZc9GBpWgWCbt7TUZcCf+h5SRerZ BmmouGQRfHitCM+dK/lMKRUAgJipY4tRAg== X-Google-Smtp-Source: APXvYqw+ZFwnqZBjrg8Tqhw4LB9VOWDbx1f0Eo8NRjjVdq1A3eyGBSYq9/9YWt2o+YxJ8UDLTiLlBg== X-Received: by 2002:a05:6000:1186:: with SMTP id g6mr3318995wrx.17.1562831863119; Thu, 11 Jul 2019 00:57:43 -0700 (PDT) Received: from [10.44.128.75] ([193.117.175.106]) by smtp.gmail.com with ESMTPSA id o24sm9498277wmh.2.2019.07.11.00.57.41 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 11 Jul 2019 00:57:42 -0700 (PDT) Subject: Re: zpool errors To: Daniel Braniss , Allan Jude Cc: freebsd-hackers@freebsd.org References: <52CE32B1-7E01-4C35-A2AB-84D3D5BD4E2F@cs.huji.ac.il> <27c3e59a-07ea-5df3-9de2-302d5290a477@freebsd.org> <831204B6-3F3B-4736-89FA-1207C4C46A7E@cs.huji.ac.il> <70f1be10-e37a-de20-e188-6155fda2d06a@freebsd.org> <05D8BD75-78B4-4336-8A8A-C84A901CB3D4@cs.huji.ac.il> From: Steven Hartland Message-ID: <36d1b3b2-083a-7521-f6a1-f441fc72def8@multiplay.co.uk> Date: Thu, 11 Jul 2019 08:57:42 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.7.2 MIME-Version: 1.0 In-Reply-To: <05D8BD75-78B4-4336-8A8A-C84A901CB3D4@cs.huji.ac.il> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-Rspamd-Queue-Id: 6E5B66B42A X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=multiplay-co-uk.20150623.gappssmtp.com header.s=20150623 header.b=Y3R2AjpY; spf=pass (mx1.freebsd.org: domain of killing@multiplay.co.uk designates 2a00:1450:4864:20::436 as permitted sender) smtp.mailfrom=killing@multiplay.co.uk X-Spamd-Result: default: False [-6.42 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[multiplay-co-uk.20150623.gappssmtp.com:s=20150623]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; DMARC_NA(0.00)[multiplay.co.uk]; TO_DN_SOME(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: ASPMX.L.GOOGLE.COM]; DKIM_TRACE(0.00)[multiplay-co-uk.20150623.gappssmtp.com:+]; RCVD_IN_DNSWL_NONE(0.00)[6.3.4.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; NEURAL_HAM_SHORT(-0.97)[-0.965,0]; IP_SCORE(-2.95)[ip: (-9.37), ipnet: 2a00:1450::/32(-2.87), asn: 15169(-2.44), country: US(-0.06)]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Jul 2019 07:57:46 -0000 Sounds like you have a failing disk (most likely), controller or cable. On 11/07/2019 08:39, Daniel Braniss wrote: > firstly, thanks for your help! > now, after doing a zpool clear, I notice that the CHKSUM is growing, > the pool is on a raid controller raid5 (PERC from dell) which is showing > it’s correcting the errors (‘Corrected medium error during recovery on PD …). > > so what can be the cause? btw, the FreeBSD is 10.3-stable. > > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" From owner-freebsd-hackers@freebsd.org Thu Jul 11 11:50:13 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D2D9415CFC59 for ; Thu, 11 Jul 2019 11:50:13 +0000 (UTC) (envelope-from freebsd-hackers@m.gmane.org) Received: from blaine.gmane.org (195-159-176-226.customer.powertech.no [195.159.176.226]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 71B8B735E7 for ; Thu, 11 Jul 2019 11:50:12 +0000 (UTC) (envelope-from freebsd-hackers@m.gmane.org) Received: from list by blaine.gmane.org with local (Exim 4.89) (envelope-from ) id 1hlXaM-000H86-9u for freebsd-hackers@freebsd.org; Thu, 11 Jul 2019 13:50:02 +0200 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-hackers@freebsd.org From: =?UTF-8?Q?Jean-Pierre_Andr=c3=a9?= Subject: Re: mkntfs doesn't install NTFS's bootcode during formatting Date: Thu, 11 Jul 2019 12:11:32 +0200 Message-ID: References: <20190710192048.00001ca2@gmail.com> Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Firefox/52.0 SeaMonkey/2.49.4 In-Reply-To: <20190710192048.00001ca2@gmail.com> Cc: ntfs-3g-devel@lists.sf.net X-Rspamd-Queue-Id: 71B8B735E7 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.93 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.93)[-0.931,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; REPLY(-4.00)[] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Jul 2019 11:50:14 -0000 Domagoj Smol=C4=8Di=C4=87 wrote: > FreeBSD 11.2-RELEASE-p9 > fusefs-ntfs-2017.3.23 > > When slice/partition is being formatted, bootcode(';=20 containsMicrosoft Windows XP/VISTA bootloader BOOTMGR') isn't applied,=20 thus rendering it unbootable. > Under Win, after 'bootsect /nt60 ...' has been used on NTFS created=20 with mkntfs, THEN it becomes bootable. This BOOTMGR bootcode is proprietary, and it depends on the targeted Windows version, hence mkntfs cannot insert it. However mkntfs creates the boot sector of the partition, which is part of the ntfs file system structure. Nevertheless can you explain in what circumstances this would be useful. On several occasions, I have formatted an ntfs partition before installing Window 7 or Windows 10, and these installers insert the boot code they want without formatting the partition. I do not have XP or Vista any more, but I would be very surprised if they do not insert their own boot code as well (possibly while reformatting the partition). > > When slice/partition is being formatted directly under Win, bootcode=20 IS also being applied. No, this is not done while formatting. The Windows formatting is limited, and the full formatting occurs when the partition is mounted the first time. So, when upgrading Windows, you can format with the old version before installing the new one. > So, if you need a bootable NTFS, why to bother in a first place with=20 mkntfs, then transferring device to Win machine and using command line=20 under Win to run 'bootsect' tool, when you can simply click 'Format...'=20 & Start?!? Can you explain what you want to boot into ? Jean-Pierre From owner-freebsd-hackers@freebsd.org Thu Jul 11 13:18:11 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7AFEF15D242F for ; Thu, 11 Jul 2019 13:18:11 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from kabab.cs.huji.ac.il (kabab.cs.huji.ac.il [132.65.116.210]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E35477688B; Thu, 11 Jul 2019 13:18:09 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=cs.huji.ac.il; s=57791128; h=To:References:Message-Id:Content-Transfer-Encoding:Cc:Date:In-Reply-To:From:Subject:Mime-Version:Content-Type; bh=mpgsTtLaBjyWeYtdbOac0I4mspLt4bOw8de7noS3tfk=; b=f3QtQRdCeEUXwEQpCBA4a4QE+wKazAhmlPtWJdiSr93nPt/WuHlFGBT1ErhelgO5bQFERwz/J/rX8/Q8yF6nzu6DQDqKi9yiQlIYRTsM6nzxR9V5/HQ1W71YjuwwHAQnfpfmMSE31ylc6qZTbpAfAD1+DRup16bgwp+4VlE7FBdZr2mGkaAYmjPmCrL/eba3H1+KOpOS+qMn11CZLMadNEAQhY8lNtNK+XXMq2swkwftJiPKDqjqHbkQLzIKI13Y+dXUPCvHxUMeCfOFkb4T33OXXugyWTQJzT46Erx4alowtuRRRdonjwhvgf3g8dkRwG1ExfvoRVAtK47BrLwt1w==; Received: from macmini.bk.cs.huji.ac.il ([132.65.179.19]) by kabab.cs.huji.ac.il with esmtp id 1hlYxV-0006qX-3Z; Thu, 11 Jul 2019 16:18:01 +0300 Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.11\)) Subject: Re: zpool errors From: Daniel Braniss In-Reply-To: <05D8BD75-78B4-4336-8A8A-C84A901CB3D4@cs.huji.ac.il> Date: Thu, 11 Jul 2019 16:18:00 +0300 Cc: freebsd-hackers@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <88CFC175-8275-4C4E-B7BE-110E07C0A31C@cs.huji.ac.il> References: <52CE32B1-7E01-4C35-A2AB-84D3D5BD4E2F@cs.huji.ac.il> <27c3e59a-07ea-5df3-9de2-302d5290a477@freebsd.org> <831204B6-3F3B-4736-89FA-1207C4C46A7E@cs.huji.ac.il> <70f1be10-e37a-de20-e188-6155fda2d06a@freebsd.org> <05D8BD75-78B4-4336-8A8A-C84A901CB3D4@cs.huji.ac.il> To: Allan Jude X-Mailer: Apple Mail (2.3445.104.11) X-Rspamd-Queue-Id: E35477688B X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=cs.huji.ac.il header.s=57791128 header.b=f3QtQRdC X-Spamd-Result: default: False [-2.13 / 15.00]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; MX_GOOD(-0.01)[cached: kabab.cs.huji.ac.il]; DKIM_TRACE(0.00)[cs.huji.ac.il:+]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.05)[-0.049,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:378, ipnet:132.64.0.0/13, country:IL]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.88)[-0.879,0]; R_DKIM_ALLOW(-0.20)[cs.huji.ac.il:s=57791128]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-0.99)[-0.994,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[huji.ac.il]; IP_SCORE(-0.39)[ipnet: 132.64.0.0/13(-1.12), asn: 378(-0.90), country: IL(0.05)]; RCVD_IN_DNSWL_NONE(0.00)[210.116.65.132.list.dnswl.org : 127.0.10.0]; R_SPF_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Jul 2019 13:18:11 -0000 > On 11 Jul 2019, at 10:39, Daniel Braniss wrote: >=20 >=20 >=20 >> On 10 Jul 2019, at 20:23, Allan Jude wrote: >>=20 >> On 2019-07-10 11:37, Daniel Braniss wrote: >>>=20 >>>=20 >>>> On 10 Jul 2019, at 18:24, Allan Jude wrote: >>>>=20 >>>> On 2019-07-10 10:48, Daniel Braniss wrote: >>>>> hi, >>>>> i got a degraded pool, but can=E2=80=99t make sense of the file = name: >>>>>=20 >>>>> protonew-2# zpool status -vx >>>>> pool: h >>>>> state: ONLINE >>>>> status: One or more devices has experienced an error resulting in = data >>>>> corruption. Applications may be affected. >>>>> action: Restore the file in question if possible. Otherwise = restore the >>>>> entire pool from backup. >>>>> see: http://illumos.org/msg/ZFS-8000-8A = >>>>> scan: scrub repaired 6.50K in 17h30m with 0 errors on Wed Jul 10 = 12:06:14 2019 >>>>> config: >>>>>=20 >>>>> NAME STATE READ WRITE CKSUM >>>>> h ONLINE 0 0 14.4M >>>>> gpt/r5/zfs ONLINE 0 0 57.5M >>>>>=20 >>>>> errors: Permanent errors have been detected in the following = files: >>>>>=20 >>>>> <0x102>:<0x30723> >>>>> <0x102>:<0x30726> >>>>> <0x102>:<0x3062a> >>>>> =E2=80=A6 >>>>> <0x281>:<0x0> >>>>> <0x6aa>:<0x305cd> >>>>> <0xffffffffffffffff>:<0x305cd> >>>>>=20 >>>>>=20 >>>>> any hints as how I can identify third files? >>>>>=20 >>>>> thanks, >>>>> danny >>>>>=20 >>>>> _______________________________________________ >>>>> freebsd-hackers@freebsd.org mailing list >>>>> https://lists.freebsd.org/mailman/listinfo/freebsd-hackers >>>>> To unsubscribe, send any mail to = "freebsd-hackers-unsubscribe@freebsd.org" >>>>>=20 >>>>=20 >>>> Once a file has been deleted, ZFS can have a hard time determining = its >>>> filename. >>>>=20 >>>> It is inode 198186 (0x3062a) on dataset 0x102. The file has been >>>> deleted, but still exists in at least one snapshot. >>>>=20 >>>> Although, 57 million checksum errors seems like there may be some = other >>>> problem. You might look for and resolve the problem with what = appears to >>>> be a raid5 you have built your ZFS pool on top of it? Then do = 'zpool >>>> clear' to reset the counters to zero, and 'zpool scrub' to try to = read >>>> everything again. >>>>=20 >>>> --=20 >>>> Allan Jude >>>>=20 >>> I don=E2=80=99t know when the first error was detected, and this = host has been up for 367 days! >>> I did a scrub but no change. >>> i will remove old snapshots and see if it helps. >>>=20 >>> is it possible to know at least which volume? >>>=20 >>> thanks, >>> danny >>>=20 >>>=20 >>> _______________________________________________ >>> freebsd-hackers@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-hackers >>> To unsubscribe, send any mail to = "freebsd-hackers-unsubscribe@freebsd.org" >>>=20 >>=20 >> zdb -ddddd h 0x102 >>=20 >> Should tell you about which dataset that is >>=20 >> --=20 >> Allan Jude >>=20 >=20 the above did=E2=80=99t work for me, but, after removing old snapshots I reduced the problematic files to 1! <0xffffffffffffffff>:<0x305cd> which seems very odd -1? so now I removed more old snapshots, and started a a new zpool scrub. what still worries me is the fast growing checksum count, thanks, danny > firstly, thanks for your help! > now, after doing a zpool clear, I notice that the CHKSUM is growing, > the pool is on a raid controller raid5 (PERC from dell) which is = showing > it=E2=80=99s correcting the errors (=E2=80=98Corrected medium error = during recovery on PD =E2=80=A6). >=20 > so what can be the cause? btw, the FreeBSD is 10.3-stable. >=20 > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to = "freebsd-hackers-unsubscribe@freebsd.org" From owner-freebsd-hackers@freebsd.org Fri Jul 12 12:45:12 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 41D7115EEE9E for ; Fri, 12 Jul 2019 12:45:12 +0000 (UTC) (envelope-from rank1seeker@gmail.com) Received: from mail-ed1-x543.google.com (mail-ed1-x543.google.com [IPv6:2a00:1450:4864:20::543]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 11C326F084 for ; Fri, 12 Jul 2019 12:45:11 +0000 (UTC) (envelope-from rank1seeker@gmail.com) Received: by mail-ed1-x543.google.com with SMTP id k21so9107972edq.3 for ; Fri, 12 Jul 2019 05:45:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=date:from:to:cc:subject:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=ns6sy4Yax6ON/BYRDgk1uPSK3kqQMfOyRxUlC5GugeQ=; b=TmQTZDafsY6gheJPeUn7R7iYXPcvy9YM4TpmIo+YpQvjrLanRUgtAi2MSBV6X5eIaP irpcb6Fpimk6iwdIdUaeRYWgUn4MvpOPpUpjZ0Wxlb2o/NFUVrg/anivSQVztwOG/418 F7yxonVVmyXyIKGA7EUul3ZNGOP4SZPfdLjDt4rHmY4JHtsE9HIz2QykVUUxi9jRq2+B j7BQ7Xk/ra7zET+AHH/YRBNtQ8gjw891D4RbnvjjSdqYOTFa4SlcmWuto+/EW+CFUyJM 94zPWqj//ruShcfpCodXFy+xBEWl2cU0fBACEqMnUcv8kyBY7YQaD4sobRGMixD82jNm EKIQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=ns6sy4Yax6ON/BYRDgk1uPSK3kqQMfOyRxUlC5GugeQ=; b=S7sZ+gkR+pVcrw3SJD7mGJVuTZW3kyalihNW/e9w7UdNvPoZtHfkbwHSPoGX9aqrzL 6YV7MdFHeqo8tPVfQHGNqrpzYFgdzXfXpMMfs4GbHZSuF1llE8jnDb88pwOaGCDgj2XD 0s7X8raEWjP2pYqQJD5vQPFrcpEtne6puOv5au6ohOx5V2NfcCUSjgdFRGtctVwnZm5S zylKsnDTFsJoUgqGwukVqyXLftEPzDvqUwZwurWITlrxshPS+GHB5isHZLVqziu635sR W8Og8nXCjkx6ra3OCtjKRaIx8jOaxqumIcC6xbO6wHgxKuWaJLchjUZsm5FPOfWFh7JQ f4MA== X-Gm-Message-State: APjAAAVUQ6KxTQryu+moWZQRie2w+3vVZjVCAoYwQUN6TiQfQ2w4Zu9o g7sVP96+5AnhJcRn89dLcraaX/HIVn0= X-Google-Smtp-Source: APXvYqy3qHQtLbXF2Egt5ZHZuXWn8r5IfUA/hf1yqcXSV5fTOexYt551N1+RItk1yxBMs9I7KjjrAw== X-Received: by 2002:a17:906:4d89:: with SMTP id s9mr7969422eju.160.1562935509928; Fri, 12 Jul 2019 05:45:09 -0700 (PDT) Received: from localhost ([213.149.55.215]) by smtp.gmail.com with ESMTPSA id k10sm2532300eda.9.2019.07.12.05.45.09 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Fri, 12 Jul 2019 05:45:09 -0700 (PDT) Date: Fri, 12 Jul 2019 14:44:29 +0200 From: Domagoj =?UTF-8?Q?Smol=C4=8Di=C4=87?= To: freebsd-hackers@freebsd.org, Jean-Pierre =?UTF-8?Q?Andr=C3=A9?= Cc: freebsd@dussan.org, ntfs-3g-devel@lists.sf.net Subject: Re: mkntfs doesn't install NTFS's bootcode during formatting Message-ID: <20190712144429.00000776@gmail.com> In-Reply-To: References: <20190710192048.00001ca2@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 11C326F084 X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=TmQTZDaf; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of rank1seeker@gmail.com designates 2a00:1450:4864:20::543 as permitted sender) smtp.mailfrom=rank1seeker@gmail.com X-Spamd-Result: default: False [-5.04 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; RCVD_COUNT_THREE(0.00)[3]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.94)[-0.944,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[3.4.5.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; IP_SCORE(-1.09)[ip: (-0.07), ipnet: 2a00:1450::/32(-2.89), asn: 15169(-2.44), country: US(-0.06)] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 12 Jul 2019 12:45:12 -0000 On Thu, 11 Jul 2019 12:11:32 +0200 Jean-Pierre Andr=C3=A9 wrote: > Domagoj Smol=C4=8Di=C4=87 wrote: > > FreeBSD 11.2-RELEASE-p9 > > fusefs-ntfs-2017.3.23 > > > > When slice/partition is being formatted, bootcode('; =20 > containsMicrosoft Windows XP/VISTA bootloader BOOTMGR') isn't > applied, thus rendering it unbootable. > > Under Win, after 'bootsect /nt60 ...' has been used on NTFS > > created =20 > with mkntfs, THEN it becomes bootable. > This BOOTMGR bootcode is proprietary, and it depends on the > targeted Windows version, hence mkntfs cannot insert it. > However mkntfs creates the boot sector of the partition, which > is part of the ntfs file system structure. I believe you talk about volume boot record (VBR) being installed. Yes, but it doesn't install it's part: volume boot code(VBC) whic targets B= OOTMGR(stage 2) > Nevertheless can you explain in what circumstances this would > be useful. On several occasions, I have formatted an ntfs > partition before installing Window 7 or Windows 10, and these > installers insert the boot code they want without formatting > the partition. I do not have XP or Vista any more, but I > would be very surprised if they do not insert their own boot > code as well (possibly while reformatting the partition). Installers are out of scope here. Goal is to start installer itself, residing on NTFS I'm talking about lowest level of boot procedure, JUST after BIOS "hits" NT= FS. > > > > When slice/partition is being formatted directly under Win, > > bootcode =20 > IS also being applied. > No, this is not done while formatting. The Windows formatting > is limited, and the full formatting occurs when the partition > is mounted the first time. So, when upgrading Windows, you can > format with the old version before installing the new one. You are wrong. I've tested it's presence with hex. After mkntfs, I copy files(install procedure for Win7) and device won't boo= t. It does after after 'bootsect /nt60 ...' is executed under Win7. (anoying p= art) If I do ONLY formating under Win7, then plug it back into FreeBSD, copy men= tioned files and boot decvice, Win7 installation starts. > > So, if you need a bootable NTFS, why to bother in a first place > > with =20 > mkntfs, then transferring device to Win machine and using command > line under Win to run 'bootsect' tool, when you can simply click > 'Format...' & Start?!? > Can you explain what you want to boot into ? >=20 > Jean-Pierre I want to use ONLY FreeBSD to create custom bootable Win7 install media. Only obstacle left is NTFS's stage 1 bootcode =3D> VBC. I believe I've located it's position and size in slice (7k or 8k, can't rem= ember) So I'll attempt to extract it with dd tool and later apply it just after mk= ntfs. But then again, I believe (searching at a first glance) that this functiona= lity exited and was removed because of a "proprietary issues". So versions older than ntfs-3g-2016.2.22-2, should be used. I believe it was about "ntfsprogs/boot.c". Can anyone confirm this? How about updating FreeBSD's license by keeping it BSD, but adding EXCEPTIO= NS for Microsoft and other big corporations with same "proprietary issues". In life, it is important to be equal in justice to each other. If they claim it's ok and normal, just do the same to them. If they complai= n ... everything is clear. ;) Domagoj Smol=C4=8Di=C4=87 From owner-freebsd-hackers@freebsd.org Fri Jul 12 23:33:36 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5CE2C15D9AF0 for ; Fri, 12 Jul 2019 23:33:36 +0000 (UTC) (envelope-from zbeeble@gmail.com) Received: from mail-io1-xd31.google.com (mail-io1-xd31.google.com [IPv6:2607:f8b0:4864:20::d31]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6ACC291587 for ; Fri, 12 Jul 2019 23:33:35 +0000 (UTC) (envelope-from zbeeble@gmail.com) Received: by mail-io1-xd31.google.com with SMTP id s7so23927823iob.11 for ; Fri, 12 Jul 2019 16:33:35 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=cODSSI3CTTbg1Y2e+YNGYrQ9gLiNzg9v5HKFcn6xKr0=; b=WQ9sjzvxqQt+lIXB8DasyFX3HpddhHP+UFkxDcj/FBH9Z3hkXqu9mtcLD6l21D9sCh S1IsW5E7aPOyqkcMZb3Ll96NOpqgQ0jpHDyfVbhVuC3aENJK8kNV4bpeUpO5EV9FEr3e 5jUUsxzX6Gp8rqwr0B7TKZMu2dsye4yzZz7S3UPr11BdPYEns7WvXkh74xRaVpxkyy4Z TFBnUAb9tZqOg7leZTdARgtW2NXlxwN5YvJHNkz9poSINBJ4x676qdehjD0QgUnrjw+i 8G7k31MeAzO4XhiT/AtAVcVjgJqhi71Tx9VMcRGY3885rmxUopMo0UmWiXHttkqqLJwM kEIA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=cODSSI3CTTbg1Y2e+YNGYrQ9gLiNzg9v5HKFcn6xKr0=; b=VOqH4J7xRQaJkWGjVaRfspFBC/n+jZ6tcSU5asjHmZ4s0zlUCDhPfifZk7WcZFXTjQ dT36+JSG5z+dPqFBBxySZ6RwEq9OsEOSumipaPOfxxpBPPJmH+UI8tOuK/xxy9Y7XXJ+ 943cLWA/GOYBLtZl4BdEGEq9aYNurg4fGknjms2VSFcjQggecs101wzIdOtRGRaRyQyJ 0aGpIh4/laWOy6xqyyFSS7sV/jA5WQ6E1PCkB2aICIZ8d12W0ARD00IEyiaGKVdtAbX3 lFeNbksylpiiDCUi4fgqZPuj7ttrXHaof9H7P05gFvo5ocrHLbWNDMW4qzlxnaUZTZJO Zx4A== X-Gm-Message-State: APjAAAUvZiiKR8VTwTkG7xBrjhuROgjwCQyServ3dH3HX3tSq4HCDH5S mrcmXhfx7/fxgCz046qI2477DdoD4VKdplnhD7O2 X-Google-Smtp-Source: APXvYqwRGVpEKeOdNcgqUhTvNMXHJ2zD6efrhGUqLB52Gb1pERIuXjiCRNuVozaaSmsw+Ss5EuWptL0IrheOmwiWX6s= X-Received: by 2002:a5e:cb06:: with SMTP id p6mr13452003iom.79.1562974414388; Fri, 12 Jul 2019 16:33:34 -0700 (PDT) MIME-Version: 1.0 From: Zaphod Beeblebrox Date: Fri, 12 Jul 2019 19:33:22 -0400 Message-ID: Subject: 4k sector support (not good?) To: FreeBSD Hackers X-Rspamd-Queue-Id: 6ACC291587 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=WQ9sjzvx; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of zbeeble@gmail.com designates 2607:f8b0:4864:20::d31 as permitted sender) smtp.mailfrom=zbeeble@gmail.com X-Spamd-Result: default: False [-6.23 / 15.00]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.20)[-0.196,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; SUBJECT_HAS_QUESTION(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; IP_SCORE(-3.02)[ip: (-9.43), ipnet: 2607:f8b0::/32(-3.18), asn: 15169(-2.45), country: US(-0.06)]; RCVD_IN_DNSWL_NONE(0.00)[1.3.d.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 12 Jul 2019 23:33:36 -0000 So I have 6 drives that have 4k sectors. They are: ST2000NX0243 I first tried talking to them with an old MFI passthru controller. I think that is not FreeBSD's fault --- the MFI didn't want them. Now on the motherboard, I have ahci2: port 0xa050-0xa057,0xa040-0xa043,0xa030-0xa037,0xa020-0xa023,0xa000-0xa01f mem 0xfe610000-0xfe6107ff irq 40 at device 0.0 on pci7 ahci2: AHCI v1.20 with 8 6Gbps ports, Port Multiplier not supported ... which will attach the drives, but kick out all kinds of probe errors. Smartctl can read the drives on this controller. In a PCIe slot I have: ahci3@pci0:0:17:0: class=0x010601 card=0x84dd1043 chip=0x43911002 rev=0x40 hdr=0x00 vendor = 'Advanced Micro Devices, Inc. [AMD/ATI]' device = 'SB7x0/SB8x0/SB9x0 SATA Controller [AHCI mode]' which attaches the devices, kicks out a lot of errors and smartctl can't read the drives on this controller. now... on the motherboard controller, I can say: [1:16:316]root@run:~> gpart show ada7 gpart: No such geom: ada7. [1:17:317]root@run:~> gpart create -s GPT ada7 gpart: Input/output error [1:18:318]root@run:~> dmesg | tail -40 (ada7:ahcich16:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 01 00 00 00 40 00 00 00 00 00 00 (ada7:ahcich16:0:0:0): CAM status: ATA Status Error (ada7:ahcich16:0:0:0): ATA status: 41 (DRDY ERR), error: 04 (ABRT ) (ada7:ahcich16:0:0:0): RES: 41 04 00 00 00 00 00 00 00 01 00 (ada7:ahcich16:0:0:0): Retrying command, 3 more tries remain (ada7:ahcich16:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 01 00 00 00 40 00 00 00 00 00 00 (ada7:ahcich16:0:0:0): CAM status: ATA Status Error (ada7:ahcich16:0:0:0): ATA status: 41 (DRDY ERR), error: 04 (ABRT ) (ada7:ahcich16:0:0:0): RES: 41 04 00 00 00 00 00 00 00 01 00 (ada7:ahcich16:0:0:0): Retrying command, 2 more tries remain (ada7:ahcich16:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 01 00 00 00 40 00 00 00 00 00 00 (ada7:ahcich16:0:0:0): CAM status: ATA Status Error (ada7:ahcich16:0:0:0): ATA status: 41 (DRDY ERR), error: 04 (ABRT ) (ada7:ahcich16:0:0:0): RES: 41 04 00 00 00 00 00 00 00 01 00 (ada7:ahcich16:0:0:0): Retrying command, 1 more tries remain (ada7:ahcich16:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 01 00 00 00 40 00 00 00 00 00 00 (ada7:ahcich16:0:0:0): CAM status: ATA Status Error (ada7:ahcich16:0:0:0): ATA status: 41 (DRDY ERR), error: 04 (ABRT ) (ada7:ahcich16:0:0:0): RES: 41 04 00 00 00 00 00 00 00 01 00 (ada7:ahcich16:0:0:0): Retrying command, 0 more tries remain (ada7:ahcich16:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 01 00 00 00 40 00 00 00 00 00 00 (ada7:ahcich16:0:0:0): CAM status: ATA Status Error (ada7:ahcich16:0:0:0): ATA status: 41 (DRDY ERR), error: 04 (ABRT ) (ada7:ahcich16:0:0:0): RES: 41 04 00 00 00 00 00 00 00 01 00 (ada7:ahcich16:0:0:0): Error 5, Retries exhausted From owner-freebsd-hackers@freebsd.org Sat Jul 13 04:56:45 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5D15215DFD34 for ; Sat, 13 Jul 2019 04:56:45 +0000 (UTC) (envelope-from zbeeble@gmail.com) Received: from mail-io1-xd2a.google.com (mail-io1-xd2a.google.com [IPv6:2607:f8b0:4864:20::d2a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 812136D7D7 for ; Sat, 13 Jul 2019 04:56:44 +0000 (UTC) (envelope-from zbeeble@gmail.com) Received: by mail-io1-xd2a.google.com with SMTP id f4so24917408ioh.6 for ; Fri, 12 Jul 2019 21:56:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=wxgGdnmOhL2WjMZYOtEZD3GH5K7mPUxiXvDwogMuheE=; b=cjmy8hftomKGIk823CyiQco7GbxzKFX1RoawiuZ+Amjx08DqcdMJIAQJ6iNEAMKgMs 5kbbAi/sXuPZTsMdkumvTePjLd69pnf5yoP4GKzNdZ+JHeMsYn5s3EFZFvbkFnyb2qiQ oVD4rIC5fuyFUzWxxQACzDOIAWExL68lStlKpp61eyMZmr2FIWC3dAJ5hd2Syvx4fyf+ ulnZL+JSOSUQYXHvrnMS6sU3Xz9R4EeC7moX4OlgaWVchyqNgzTCbjIfkCqcd/a3OGhi pMd7KPt1QwNpdeYJteBs9vjw0B9aHt4UaNQahC7T4RLGO+ii3bsUjbz1kHoVt9NEYa2W vRDg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=wxgGdnmOhL2WjMZYOtEZD3GH5K7mPUxiXvDwogMuheE=; b=HAh+6I74VX8XYaqpqiKYM1stj47TwjGBVBHV7wBP7vBt8MtmJCaiI/cXp1TVOTTpQ1 aiMhUVlAQ7kVkeLTebb+PflHY5v+qmV0SeCCfLpsKryMDh3Ufzk+hNoyGsOEeunHfwaa WTy1Ax8dXU0Gdv2K09RPiXKekaeqUo4MvlF4IigvOlu1tcAfndR/MM8LxxJGQ8oIILJW u/fVdMUe6Snc4CW0Q1rYLkMUhuNRtWtOz+eQi2O6MWJSUlB8/nT7OLHTqJhHfd+s0yYl thTjlV6NLTLzRBM3b4iqTMu8jN9v/Vk0wBFWW1APOYRAk5uMgWYy+4IQXJJ9mypbitnR DK4A== X-Gm-Message-State: APjAAAX/QqCM5qM9fzLDJhY17HJhCcESpzyw4jBrY+3zxHCX+n7qeAps 67TPy8m8AW8apHoNGcGIf6PB4S23qMmHTBIth2JfWEE= X-Google-Smtp-Source: APXvYqyfza/cTuQfyc84xKjc7PgrR/PjWtAOMWSxYm/cws4JMp0RhLkSlVjhh5NTtPtKXyDbkBKejsxFXMnXmyfY6YU= X-Received: by 2002:a5e:cb06:: with SMTP id p6mr14359086iom.79.1562993803290; Fri, 12 Jul 2019 21:56:43 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Zaphod Beeblebrox Date: Sat, 13 Jul 2019 00:56:30 -0400 Message-ID: Subject: Re: 4k sector support (not good?) To: FreeBSD Hackers X-Rspamd-Queue-Id: 812136D7D7 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=cjmy8hft; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of zbeeble@gmail.com designates 2607:f8b0:4864:20::d2a as permitted sender) smtp.mailfrom=zbeeble@gmail.com X-Spamd-Result: default: False [-6.86 / 15.00]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.92)[-0.921,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; SUBJECT_HAS_QUESTION(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; IP_SCORE(-2.93)[ip: (-8.95), ipnet: 2607:f8b0::/32(-3.18), asn: 15169(-2.45), country: US(-0.06)]; RCVD_IN_DNSWL_NONE(0.00)[a.2.d.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 13 Jul 2019 04:56:45 -0000 Replying to my own message to add data. Attaching the drives to a SAS controller that probes up with mps, they attach without complaint, but read and write give: (da1:mps0:0:12:0): SCSI status: Check Condition (da1:mps0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:74,79 (Security conflict in translated device) (da1:mps0:0:12:0): Error 13, Unretryable error (da1:mps0:0:12:0): READ(10). CDB: 28 00 00 00 00 00 00 00 01 00 (da1:mps0:0:12:0): CAM status: SCSI Status Error (da1:mps0:0:12:0): SCSI status: Check Condition (da1:mps0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:74,79 (Security conflict in translated device) (da1:mps0:0:12:0): Error 13, Unretryable error (da1:mps0:0:12:0): WRITE(10). CDB: 2a 00 00 00 00 00 00 00 01 00 (da1:mps0:0:12:0): CAM status: SCSI Status Error (da1:mps0:0:12:0): SCSI status: Check Condition (da1:mps0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:74,79 (Security conflict in translated device) (da1:mps0:0:12:0): Error 13, Unretryable error ... now this drive is a ST2000NX0243. The ST2000NX0248 is an encrypted drive, but the 243 is not. ... so what's this error. Also... I'm no SCSI speaker, but reading the manual for the drive, 28 and 2a are not commands it lists. 20 and 24 (for read and read extended) and 30 and 34 (for write and write extended). Help? On Fri, Jul 12, 2019 at 7:33 PM Zaphod Beeblebrox wrote: > So I have 6 drives that have 4k sectors. They are: > > ST2000NX0243 > > I first tried talking to them with an old MFI passthru controller. I > think that is not FreeBSD's fault --- the MFI didn't want them. > > Now on the motherboard, I have > > ahci2: port > 0xa050-0xa057,0xa040-0xa043,0xa030-0xa037,0xa020-0xa023,0xa000-0xa01f mem > 0xfe610000-0xfe6107ff irq 40 at device 0.0 on pci7 > ahci2: AHCI v1.20 with 8 6Gbps ports, Port Multiplier not supported > > ... which will attach the drives, but kick out all kinds of probe errors. > Smartctl can read the drives on this controller. > > In a PCIe slot I have: > > ahci3@pci0:0:17:0: class=0x010601 card=0x84dd1043 chip=0x43911002 > rev=0x40 hdr=0x00 > vendor = 'Advanced Micro Devices, Inc. [AMD/ATI]' > device = 'SB7x0/SB8x0/SB9x0 SATA Controller [AHCI mode]' > > which attaches the devices, kicks out a lot of errors and smartctl can't > read the drives on this controller. > > now... on the motherboard controller, I can say: > > [1:16:316]root@run:~> gpart show ada7 > gpart: No such geom: ada7. > [1:17:317]root@run:~> gpart create -s GPT ada7 > gpart: Input/output error > [1:18:318]root@run:~> dmesg | tail -40 > (ada7:ahcich16:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 01 00 00 00 40 00 00 00 > 00 00 00 > (ada7:ahcich16:0:0:0): CAM status: ATA Status Error > (ada7:ahcich16:0:0:0): ATA status: 41 (DRDY ERR), error: 04 (ABRT ) > (ada7:ahcich16:0:0:0): RES: 41 04 00 00 00 00 00 00 00 01 00 > (ada7:ahcich16:0:0:0): Retrying command, 3 more tries remain > (ada7:ahcich16:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 01 00 00 00 40 00 00 00 > 00 00 00 > (ada7:ahcich16:0:0:0): CAM status: ATA Status Error > (ada7:ahcich16:0:0:0): ATA status: 41 (DRDY ERR), error: 04 (ABRT ) > (ada7:ahcich16:0:0:0): RES: 41 04 00 00 00 00 00 00 00 01 00 > (ada7:ahcich16:0:0:0): Retrying command, 2 more tries remain > (ada7:ahcich16:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 01 00 00 00 40 00 00 00 > 00 00 00 > (ada7:ahcich16:0:0:0): CAM status: ATA Status Error > (ada7:ahcich16:0:0:0): ATA status: 41 (DRDY ERR), error: 04 (ABRT ) > (ada7:ahcich16:0:0:0): RES: 41 04 00 00 00 00 00 00 00 01 00 > (ada7:ahcich16:0:0:0): Retrying command, 1 more tries remain > (ada7:ahcich16:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 01 00 00 00 40 00 00 00 > 00 00 00 > (ada7:ahcich16:0:0:0): CAM status: ATA Status Error > (ada7:ahcich16:0:0:0): ATA status: 41 (DRDY ERR), error: 04 (ABRT ) > (ada7:ahcich16:0:0:0): RES: 41 04 00 00 00 00 00 00 00 01 00 > (ada7:ahcich16:0:0:0): Retrying command, 0 more tries remain > (ada7:ahcich16:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 01 00 00 00 40 00 00 00 > 00 00 00 > (ada7:ahcich16:0:0:0): CAM status: ATA Status Error > (ada7:ahcich16:0:0:0): ATA status: 41 (DRDY ERR), error: 04 (ABRT ) > (ada7:ahcich16:0:0:0): RES: 41 04 00 00 00 00 00 00 00 01 00 > (ada7:ahcich16:0:0:0): Error 5, Retries exhausted > From owner-freebsd-hackers@freebsd.org Sat Jul 13 06:36:40 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7BE9115E15EB for ; Sat, 13 Jul 2019 06:36:40 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mail.turbocat.net (turbocat.net [88.99.82.50]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8ACEA7096B for ; Sat, 13 Jul 2019 06:36:39 +0000 (UTC) (envelope-from hps@selasky.org) Received: from hps2016.home.selasky.org (unknown [62.141.129.235]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits)) (No client certificate requested) by mail.turbocat.net (Postfix) with ESMTPSA id 30CE52602EB; Sat, 13 Jul 2019 08:36:29 +0200 (CEST) Subject: Re: 4k sector support (not good?) To: Zaphod Beeblebrox , FreeBSD Hackers References: From: Hans Petter Selasky Message-ID: <13de3cde-185b-a986-cbce-6ad984792952@selasky.org> Date: Sat, 13 Jul 2019 08:35:50 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.6.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 8ACEA7096B X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of hps@selasky.org designates 88.99.82.50 as permitted sender) smtp.mailfrom=hps@selasky.org X-Spamd-Result: default: False [-6.28 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+a:mail.turbocat.net]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[selasky.org]; SUBJECT_HAS_QUESTION(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: mail.turbocat.net]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.78)[-0.780,0]; IP_SCORE(-3.19)[ip: (-9.39), ipnet: 88.99.0.0/16(-4.74), asn: 24940(-1.80), country: DE(-0.01)]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:88.99.0.0/16, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 13 Jul 2019 06:36:40 -0000 On 2019-07-13 06:56, Zaphod Beeblebrox wrote: > Replying to my own message to add data. Attaching the drives to a SAS > controller that probes up with mps, they attach without complaint, but read > and write give: > > (da1:mps0:0:12:0): SCSI status: Check Condition > (da1:mps0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:74,79 (Security conflict > in translated device) > (da1:mps0:0:12:0): Error 13, Unretryable error > (da1:mps0:0:12:0): READ(10). CDB: 28 00 00 00 00 00 00 00 01 00 > (da1:mps0:0:12:0): CAM status: SCSI Status Error > (da1:mps0:0:12:0): SCSI status: Check Condition > (da1:mps0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:74,79 (Security conflict > in translated device) > (da1:mps0:0:12:0): Error 13, Unretryable error > (da1:mps0:0:12:0): WRITE(10). CDB: 2a 00 00 00 00 00 00 00 01 00 > (da1:mps0:0:12:0): CAM status: SCSI Status Error > (da1:mps0:0:12:0): SCSI status: Check Condition > (da1:mps0:0:12:0): SCSI sense: ILLEGAL REQUEST asc:74,79 (Security conflict > in translated device) > (da1:mps0:0:12:0): Error 13, Unretryable error > > ... now this drive is a ST2000NX0243. The ST2000NX0248 is an encrypted > drive, but the 243 is not. > > ... so what's this error. Also... I'm no SCSI speaker, but reading the > manual for the drive, 28 and 2a are not commands it lists. 20 and 24 (for > read and read extended) and 30 and 34 (for write and write extended). > > Help? > > > On Fri, Jul 12, 2019 at 7:33 PM Zaphod Beeblebrox wrote: > >> So I have 6 drives that have 4k sectors. They are: >> >> ST2000NX0243 >> >> I first tried talking to them with an old MFI passthru controller. I >> think that is not FreeBSD's fault --- the MFI didn't want them. >> >> Now on the motherboard, I have >> >> ahci2: port >> 0xa050-0xa057,0xa040-0xa043,0xa030-0xa037,0xa020-0xa023,0xa000-0xa01f mem >> 0xfe610000-0xfe6107ff irq 40 at device 0.0 on pci7 >> ahci2: AHCI v1.20 with 8 6Gbps ports, Port Multiplier not supported >> >> ... which will attach the drives, but kick out all kinds of probe errors. >> Smartctl can read the drives on this controller. >> >> In a PCIe slot I have: >> >> ahci3@pci0:0:17:0: class=0x010601 card=0x84dd1043 chip=0x43911002 >> rev=0x40 hdr=0x00 >> vendor = 'Advanced Micro Devices, Inc. [AMD/ATI]' >> device = 'SB7x0/SB8x0/SB9x0 SATA Controller [AHCI mode]' >> >> which attaches the devices, kicks out a lot of errors and smartctl can't >> read the drives on this controller. >> >> now... on the motherboard controller, I can say: >> If you want to boot from a 4K disk you need this patch at least: https://reviews.freebsd.org/D19245 --HPS From owner-freebsd-hackers@freebsd.org Sat Jul 13 06:55:23 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E8E5115E1C99 for ; Sat, 13 Jul 2019 06:55:22 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mail.turbocat.net (turbocat.net [IPv6:2a01:4f8:c17:6c4b::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E4D6D7138C for ; Sat, 13 Jul 2019 06:55:21 +0000 (UTC) (envelope-from hps@selasky.org) Received: from hps2016.home.selasky.org (unknown [62.141.129.235]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits)) (No client certificate requested) by mail.turbocat.net (Postfix) with ESMTPSA id 1B28026024E; Sat, 13 Jul 2019 08:55:16 +0200 (CEST) Subject: Re: 4k sector support (not good?) From: Hans Petter Selasky To: Zaphod Beeblebrox , FreeBSD Hackers References: <13de3cde-185b-a986-cbce-6ad984792952@selasky.org> Message-ID: <883fbfcf-cac6-99a9-cb6f-43e413be9bb0@selasky.org> Date: Sat, 13 Jul 2019 08:54:38 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.6.1 MIME-Version: 1.0 In-Reply-To: <13de3cde-185b-a986-cbce-6ad984792952@selasky.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: E4D6D7138C X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of hps@selasky.org designates 2a01:4f8:c17:6c4b::2 as permitted sender) smtp.mailfrom=hps@selasky.org X-Spamd-Result: default: False [-5.56 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+a:mail.turbocat.net]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[selasky.org]; SUBJECT_HAS_QUESTION(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: mail.turbocat.net]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.67)[-0.672,0]; IP_SCORE(-2.58)[ip: (-9.12), ipnet: 2a01:4f8::/29(-1.96), asn: 24940(-1.80), country: DE(-0.01)]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 13 Jul 2019 06:55:23 -0000 On 2019-07-13 08:35, Hans Petter Selasky wrote: > If you want to boot from a 4K disk you need this patch at least: > https://reviews.freebsd.org/D19245 Note that this patch must also be installed before trying to create the 4K bootable disk! --HPS From owner-freebsd-hackers@freebsd.org Sat Jul 13 19:19:13 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0F12E15EEE3D for ; Sat, 13 Jul 2019 19:19:13 +0000 (UTC) (envelope-from dan@langille.org) Received: from out2-smtp.messagingengine.com (out2-smtp.messagingengine.com [66.111.4.26]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E3ABB6A77B for ; Sat, 13 Jul 2019 19:19:10 +0000 (UTC) (envelope-from dan@langille.org) Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id B7CB521B62 for ; Sat, 13 Jul 2019 15:19:09 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute4.internal (MEProxy); Sat, 13 Jul 2019 15:19:09 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=langille.org; h= from:content-type:content-transfer-encoding:mime-version:subject :message-id:date:to; s=fm1; bh=Hl2W9MVizGCAc5GmINmDrga6ymvDzHWDK RxWSNjn/Cc=; b=KrF5ruf1hHLkePv/4VXZs78f3nci32RjcFKsgrfDJQmaFbDg5 MCO4ai8UXzUcZvxpX1G6KHrtuvP5e4vlNnZ0VoDN4TtSKRA4VOOL1jd9aYtOS0bb 8vkziSjJwIKysXXE9C7cPi0SSLnLFI/SEIpDAj5kMFG1vXRGrafI/gBMFxRuZjSM XIngs1Rt1Qz2uV7kKtLwg74XVSgIs2xRhLcpx3jxN9irFp6oj5JFlWoN66M3+Wnx ZmB1z1WIprhZpfp4HBDns02a6QQ7vjY99xiI+ncSwtCIp3uyxU0g1FlfYmeLesUv IDLsK9hSH/ihhqfdeo/7M+CRPTKzZXZ+cYaXg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-transfer-encoding:content-type :date:from:message-id:mime-version:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm3; bh=Hl2W9M VizGCAc5GmINmDrga6ymvDzHWDKRxWSNjn/Cc=; b=J/Rr3PJHuN0zEuiUQm1XCl cSDOYvwKpC//re7QUXtohMMphhsn6DZwsFeNP21Q88bqF+Db4FhTl48g8tisnHtx 67uLrom7I4g4fGfxN8bnI6liG0ctK/XouPiie4JbDAjaN8nfN27theAJ5tzcFs1E C0HDtT1RLYEd/DH0BWoiFGjzYKGTVn3lQdYSq0ESqok19klXTdwM6us9kuPgQES2 x77tnJi9EYTsk30vQu0YYQG3sp3jt+r5Chcg4LQEMIxUobzOlWuyAah9Ebzep3JK miFOQKfkk/Ue4Vd8QUrif2GkU/wREYIfZhCn00o8+ZGPxM3mjLBJiLbYHhDJIBXQ == X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduvddrheefucetufdoteggodetrfdotffvucfrrh hofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgenuceurghi lhhouhhtmecufedttdenucenucfjughrpefhtgfgggfukfffvffosehtqhhmtdhhtdejne cuhfhrohhmpeffrghnucfnrghnghhilhhlvgcuoegurghnsehlrghnghhilhhlvgdrohhr gheqnecuffhomhgrihhnpehlrghnghhilhhlvgdrohhrghdpvhgsshgutghonhdrtghomh enucfkphepudejfedrudehvddrvddtkedrudefheenucfrrghrrghmpehmrghilhhfrhho mhepuggrnheslhgrnhhgihhllhgvrdhorhhgnecuvehluhhsthgvrhfuihiivgeptd X-ME-Proxy: Received: from [192.168.128.11] (ip-173-152-208-135.ekrgmd.spcsdns.net [173.152.208.135]) by mail.messagingengine.com (Postfix) with ESMTPA id 2B7CA8005B for ; Sat, 13 Jul 2019 15:19:09 -0400 (EDT) From: Dan Langille Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.11\)) Subject: vBSDCon 2019 CFP Message-Id: <0B84F855-7BE1-47CA-B9D8-63E17DAE08E4@langille.org> Date: Sat, 13 Jul 2019 15:19:07 -0400 To: freebsd-hackers@freebsd.org X-Mailer: Apple Mail (2.3445.104.11) X-Rspamd-Queue-Id: E3ABB6A77B X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=langille.org header.s=fm1 header.b=KrF5ruf1; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=J/Rr3PJH; dmarc=pass (policy=none) header.from=langille.org; spf=pass (mx1.freebsd.org: domain of dan@langille.org designates 66.111.4.26 as permitted sender) smtp.mailfrom=dan@langille.org X-Spamd-Result: default: False [-6.99 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[langille.org:s=fm1,messagingengine.com:s=fm3]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.26]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_COUNT_THREE(0.00)[4]; IP_SCORE(-3.48)[ip: (-9.56), ipnet: 66.111.4.0/24(-4.77), asn: 11403(-3.00), country: US(-0.06)]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[langille.org:+,messagingengine.com:+]; DMARC_POLICY_ALLOW(-0.50)[langille.org,none]; MX_GOOD(-0.01)[in2-smtp.messagingengine.com,in1-smtp.messagingengine.com,in2-smtp.messagingengine.com,in1-smtp.messagingengine.com,in2-smtp.messagingengine.com,in1-smtp.messagingengine.com,in2-smtp.messagingengine.com,in1-smtp.messagingengine.com,in2-smtp.messagingengine.com,in1-smtp.messagingengine.com,in2-smtp.messagingengine.com,in1-smtp.messagingengine.com,in2-smtp.messagingengine.com,in1-smtp.messagingengine.com]; NEURAL_HAM_SHORT(-0.90)[-0.901,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:11403, ipnet:66.111.4.0/24, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[26.4.111.66.list.dnswl.org : 127.0.5.1] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 13 Jul 2019 19:19:13 -0000 vBSDCon 2019 is September 5-7 at the Hyatt Regency in Reston, VA This year, the conference is organized by Mark Felder, Ryan Steinmetz, = and myself. The CFP closes on July 19. Details at https://vbsdcon.com Thank you. =E2=80=94=20 Dan Langille http://langille.org/