From owner-freebsd-fs@freebsd.org Sun Mar 25 21:00:12 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 307E6F6CBB9 for ; Sun, 25 Mar 2018 21:00:12 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id BE5D177FF6 for ; Sun, 25 Mar 2018 21:00:11 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id E52DC14B0A for ; Sun, 25 Mar 2018 21:00:10 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w2PL0ARe056738 for ; Sun, 25 Mar 2018 21:00:10 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w2PL0AHW056737 for freebsd-fs@FreeBSD.org; Sun, 25 Mar 2018 21:00:10 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <201803252100.w2PL0AHW056737@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: freebsd-fs@FreeBSD.org Subject: Problem reports for freebsd-fs@FreeBSD.org that need special attention Date: Sun, 25 Mar 2018 21:00:10 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 25 Mar 2018 21:00:12 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- New | 203492 | mount_unionfs -o below causes panic New | 217062 | for file systems mounted with -o noexec, exec=off New | 221909 | [ZFS] Add a sysctl to toggle send_corrupt_data Open | 136470 | [nfs] Cannot mount / in read-only, over NFS Open | 139651 | [nfs] mount(8): read-only remount of NFS volume d Open | 140068 | [smbfs] [patch] smbfs does not allow semicolon in Open | 144447 | [zfs] sharenfs fsunshare() & fsshare_main() non f Open | 211491 | System hangs after "Uptime" on reboot with ZFS 8 problems total for which you should take action. From owner-freebsd-fs@freebsd.org Mon Mar 26 18:52:11 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2A0CEF6054B for ; Mon, 26 Mar 2018 18:52:11 +0000 (UTC) (envelope-from editor@callfortesting.org) Received: from mail-pl0-x22a.google.com (mail-pl0-x22a.google.com [IPv6:2607:f8b0:400e:c01::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A93A16D0B9 for ; Mon, 26 Mar 2018 18:52:10 +0000 (UTC) (envelope-from editor@callfortesting.org) Received: by mail-pl0-x22a.google.com with SMTP id g20-v6so1227588plo.9 for ; Mon, 26 Mar 2018 11:52:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=callfortesting-org.20150623.gappssmtp.com; s=20150623; h=to:from:subject:message-id:date:user-agent:mime-version :content-language:content-transfer-encoding; bh=K3sS2Yc0yyD44uASInzkYilT2cV3gZdP2+3mimOSa7s=; b=DkLb58Bb8hAaZqZYjD4q0LO543ZdVa+oJMalZe4iEEuobhZbxEAqLGjXjHhRygh5MS PVvgj3ZZemNZLaPKMDQKpSAP7GpU9S1bD9Rj/kMvF5ZqzxRu9nZ8HoS5XCkh1YS4oGPU imlB8O+OXHaVD0LZbiACpA5/MrUL5uBMgzUs+znAaSiu0gn2e2U0hMed5WD2CehBlUAM cCclBk1BimtsscHuEyoxspUUegKirDZY46HWM6l7RB23jrC2OamQA1GjZfu0/cf9N8L4 O2k+U4qDLF4yITeWgjtuGr9tVFPU/EmjsZFRKZRNSQ5NqUPDA4XU+BAForPPKBQgeS8m Cy0w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:to:from:subject:message-id:date:user-agent :mime-version:content-language:content-transfer-encoding; bh=K3sS2Yc0yyD44uASInzkYilT2cV3gZdP2+3mimOSa7s=; b=B85+mCFb+vwlCyfzvbiwieiOyRTmsZhCXMv5IjqH2ti2ZQfO3TzJxf395aoINgFOMM FamBcfXVevnitBwZFpB3X44mInvqIXzpbKEzvdbJrDyxD7VmKC6nKJ3HaCHKS3/J5JLE sE08M8ds2YyOP9ky1fqrhNtZywHbbBeadhIFWV1S4rC4JHUkbGxHkGrSoakWtwwtrxuv YV/mpiGbM3Dk4crUoBVClTBgDY9hT8e6fPaMljAhtnCs1IIF2EhJwPFFUaliIPO4YMMi ba0Cd6ZbKyQHEoPPj48eHZo0bJ8QTzuBJKj72zumu+WlVPSysRAISOyze6ylGfQqm+eU ZzqA== X-Gm-Message-State: AElRT7GhgrcKNIKlxBDCKP43S7rNEp8IQLjYeZO6QE73o03OgH0TcpSk fKntto5WVbj3byrHNfjoELUWW9J0 X-Google-Smtp-Source: AIpwx48qGcD5REoTRCSx5MoqIzIeQc9dJtX3dEpJMTd5QxUJh1ISwvx3TwyG4y62BzjAUpZQ9Ja84Q== X-Received: by 2002:a17:902:9a86:: with SMTP id w6-v6mr5778920plp.175.1522090329853; Mon, 26 Mar 2018 11:52:09 -0700 (PDT) Received: from macbook-2.local (c-67-170-143-17.hsd1.or.comcast.net. [67.170.143.17]) by smtp.gmail.com with ESMTPSA id a4sm1484159pfj.107.2018.03.26.11.52.08 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 26 Mar 2018 11:52:08 -0700 (PDT) To: freebsd-fs@freebsd.org, Chuck Tuffli From: Michael Dexter Subject: smart(8) Call for Testing Message-ID: <4754cb2f-76bb-a69b-0cf5-eff4d621eb29@callfortesting.org> Date: Mon, 26 Mar 2018 11:52:07 -0700 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Mar 2018 18:52:11 -0000 Hello all, As you may or may not know, Chuck Tuffli has developed a simple, scripting-friendly S.M.A.R.T. utility for FreeBSD that is designed to be included in base once proven. To that end, smart(8) is ready for testing on the broadest selection of disk and controller combinations possible. smart(8) is available in ports and packages today in sysutils/smart Quick start: pkg install smart smart ada0 (That's it!) You should see a list of raw SMART values in the format of (See the GitHub readme for an explanation of the Log Page ID. Usage: smart [-htxi] [-a ] -h, --help -t, --threshold : also print out the threshold values -x, --hex : print the values out in hexadecimal -a, --attribute : print a specific attribute -i, --info : print general device information -v, --version : print the version and copyright Repos: https://bitbucket.org/ctuffli/smart https://github.com/ctuffli/smart IF you should encounter an errors such as no output for your device, please submit a ticket at either of the above sites with the output of: uname -a camcontrol devlist -v camcontrol identify smartctl -a /dev/ Should Chuck say, "I think I've fixed it, please rebuild it!", run: $ hg clone https://ctuffli@bitbucket.org/ctuffli/smart $ cd smart && make $ sudo ./smart Thank you! Michael Dexter From owner-freebsd-fs@freebsd.org Mon Mar 26 20:25:57 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 11D7EF68960 for ; Mon, 26 Mar 2018 20:25:57 +0000 (UTC) (envelope-from nonesuch@longcount.org) Received: from mail-wm0-x236.google.com (mail-wm0-x236.google.com [IPv6:2a00:1450:400c:c09::236]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8E1A372135 for ; Mon, 26 Mar 2018 20:25:56 +0000 (UTC) (envelope-from nonesuch@longcount.org) Received: by mail-wm0-x236.google.com with SMTP id x4so5447050wmh.5 for ; Mon, 26 Mar 2018 13:25:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=longcount-org.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=evCB5bW4xwLQtR137AKwM41BJKlL/h+XQ5HLLKM8C/4=; b=eal6WYisyzb9nA08kil6JAc7AtoBxgaYtIZQ+4JcZmBpyMJp2WMif38mdRymsJRcVJ X0glFwmUxBkUUvkN4HhbEzSRfdSe7bA9fI3snxSduxHewbxpZi8zZnD5Qm4P2Rp0WKFg jGD0DDcKMjtfCysavMgtUyk/0sPW9ZEoffddvA+xby8A+nG5SfnyfhFxRVZRPkZp5+lu hiGHNcA8JYR+iN7Fq12ZYq2+qzSq++hz4WcrngEcAwyYhezYXUuGKnLM/+ArqK2nZAAP GBq3LwMY/EDUodk+TjYRnitzmO15RSMEF1CR7DOrc1keUtqJH6mF/DGvvyU68YLAGJfG nGPg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=evCB5bW4xwLQtR137AKwM41BJKlL/h+XQ5HLLKM8C/4=; b=VkND1nJ+5CJJKrBvRaRblceY9Ml7RGWPSazN4YwiUHbTklTZXFUn/FPL6dfEGv4pEs B919aDcK/o6TqvMWqxIcF2RxIRkoDs224J+Hg0WM6Mb/gnk89ESfVmxQfnQ6TS3lqp9N sZTeighxdu0gc9hHU7gV0QBBh4TX7CbofyCoQQt+0Cb23nA/aGPCXdIMrcGe+1dKPDKP Lf6mIG9Ww6bYYoAcbW32GZJU061Nm8qOB1Bb8Ibhf1+z9Us90I4O54DxDF2UmtLw/XtZ g2cxfVq9L2QiItScE8xi/UlBtb9KXMS+NmsK8cqXUcZa0cn10L/w5iYnZGyu61hxYaNO ITMg== X-Gm-Message-State: AElRT7F0GrJ7B+bHOaR63Q0G2NebV+YYUqZpEINoOM1YG7yRGwQT1JJs govSIUekU3McVjcINQwj0TG5l6Zb2hRiMhLuN2VnYQ== X-Google-Smtp-Source: AIpwx4/CYgqAGbwETWCkdbvRoDjsqEs5VjRXOpPeVr/Nf/62k3gOZEiDAt6q5TYj8bCTe8YUY/G35lGGPv+K+XrmVSM= X-Received: by 10.80.200.204 with SMTP id k12mr6234635edh.38.1522095955173; Mon, 26 Mar 2018 13:25:55 -0700 (PDT) MIME-Version: 1.0 Received: by 10.80.140.35 with HTTP; Mon, 26 Mar 2018 13:25:54 -0700 (PDT) X-Originating-IP: [38.104.68.66] In-Reply-To: <4754cb2f-76bb-a69b-0cf5-eff4d621eb29@callfortesting.org> References: <4754cb2f-76bb-a69b-0cf5-eff4d621eb29@callfortesting.org> From: Mark Saad Date: Mon, 26 Mar 2018 16:25:54 -0400 Message-ID: Subject: Re: smart(8) Call for Testing To: Michael Dexter Cc: freebsd-fs@freebsd.org, Chuck Tuffli Content-Type: text/plain; charset="UTF-8" X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Mar 2018 20:25:57 -0000 Mike / Chuck Silly question , how does it handle a failed disk ? On Mon, Mar 26, 2018 at 2:52 PM, Michael Dexter wrote: > > Hello all, > > As you may or may not know, Chuck Tuffli has developed a simple, > scripting-friendly S.M.A.R.T. utility for FreeBSD that is designed to be > included in base once proven. To that end, smart(8) is ready for testing on > the broadest selection of disk and controller combinations possible. > > smart(8) is available in ports and packages today in sysutils/smart > > Quick start: > > pkg install smart > smart ada0 > > (That's it!) > > You should see a list of raw SMART values in the format of > (See the GitHub readme for an explanation > of the Log Page ID. > > > Usage: smart [-htxi] [-a ] > -h, --help > -t, --threshold : also print out the threshold values > -x, --hex : print the values out in hexadecimal > -a, --attribute : print a specific attribute > -i, --info : print general device information > -v, --version : print the version and copyright > > > Repos: > > https://bitbucket.org/ctuffli/smart > https://github.com/ctuffli/smart > > IF you should encounter an errors such as no output for your device, please > submit a ticket at either of the above sites with the output of: > > uname -a > camcontrol devlist -v > camcontrol identify > smartctl -a /dev/ > > Should Chuck say, "I think I've fixed it, please rebuild it!", run: > > $ hg clone https://ctuffli@bitbucket.org/ctuffli/smart > $ cd smart && make > $ sudo ./smart > > Thank you! > > Michael Dexter > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" -- mark saad | nonesuch@longcount.org From owner-freebsd-fs@freebsd.org Mon Mar 26 20:39:51 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B2791F69E09 for ; Mon, 26 Mar 2018 20:39:51 +0000 (UTC) (envelope-from chuck@tuffli.net) Received: from mail-io0-x22c.google.com (mail-io0-x22c.google.com [IPv6:2607:f8b0:4001:c06::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5109472DFB for ; Mon, 26 Mar 2018 20:39:51 +0000 (UTC) (envelope-from chuck@tuffli.net) Received: by mail-io0-x22c.google.com with SMTP id d7so9508112ioc.11 for ; Mon, 26 Mar 2018 13:39:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=tuffli-net.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=fzEkmAiBh5DiwlwTjTNXVesVUNA5TT4TvEBeT28AVVY=; b=sN72lSXPUapeD0BgwH4K44cHT/nAmdEECl3SQeGTqnRjqpgutDuErkDUcaOQ0TayYU Ef1uc4qdb7xAG1rYXvDFHPyZDLBD75v43PcLWvyhVChOtD8Wv2YmNt3cZ+xEN1qP4kiD Tp7/0MLs9pZKFhYjYSdBjj4ZFFcSyWyem6r2NlICfP4QOMtxl2W1cXEAwFmnvFSS37lb ufOShMwL8do4JdPnUyfzsvI2NLXAEMljxm/FxyWFIkwyLyqVjtV2lmonjRqC+DfIWM5f XS892AA9pJH1vZmOFqTqa9CwwhntIh74HV4Qs1m7p0dX7/rXI7lbRFn/XR2aQSuyDI6H sOEg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=fzEkmAiBh5DiwlwTjTNXVesVUNA5TT4TvEBeT28AVVY=; b=oW4TvIHFz47US6gY8edXwLSnPscShpg77qIDu5XpNCYggIAt90mAErBiAYIrZt2q/A bXdi9axDSyyBydAR8R1a6bxLARxVObBTuGQM3or17RjFWMeiuONA3eQtlByI3cwm9Rwm pOM+Oy3XPPWnMebXAZO38mLNpeWblr7U3oa/SJz+4l73qhhPZ6vt7+VXHaMvw875fhtH uGLQtoyUyN58tx3dgsC3JHPXzpj35KGcTYmo/AM6ycxNW2uWaUq35Vwww7i5aDDduC+z uC0arkl0IsW0j98a10i99L3uAyDrCr6g1SIiSobaqU4b35mEC8EgCeK0dAmhuWKcexeG WtyQ== X-Gm-Message-State: AElRT7G2tmC7vAJ3G8tNQGcWFILqU/MjpDL77teGGYO1JKY2mJFvc6RR NwrpAptz/Cq2na/fAF6YAU396pHpqoG1jnFZK9j37Uqc X-Google-Smtp-Source: AIpwx49fhyHVnHCEjzN0/VyxumkLfH/O8GlkwIlU/GaWRVfoaUGHlWeURf0zLSc6u7P+5QDrBMHlTQz5F9mVPFDzhc4= X-Received: by 10.107.183.65 with SMTP id h62mr13274723iof.204.1522096790394; Mon, 26 Mar 2018 13:39:50 -0700 (PDT) MIME-Version: 1.0 Received: by 10.2.6.10 with HTTP; Mon, 26 Mar 2018 13:39:50 -0700 (PDT) In-Reply-To: References: <4754cb2f-76bb-a69b-0cf5-eff4d621eb29@callfortesting.org> From: Chuck Tuffli Date: Mon, 26 Mar 2018 13:39:50 -0700 Message-ID: Subject: Re: smart(8) Call for Testing To: Mark Saad Cc: Michael Dexter , freebsd-fs@freebsd.org Content-Type: text/plain; charset="UTF-8" X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Mar 2018 20:39:51 -0000 On Mon, Mar 26, 2018 at 1:25 PM, Mark Saad wrote: > Mike / Chuck > Silly question , how does it handle a failed disk ? It depends on how failed the device is. The application uses CAM to send pass-through commands. So, if the device doesn't appear in camcontrol devlist, you'd get "no such device" or a message from CAM indicating you might need to load a module. If the device is still registered with the system but not processing commands, I'd expect (hope?) the commands to timeout. In either case, there may not be any out put, but the exit status should be non-zero. On the other hand, if the disk is in some sort of Monty Python-eske "I'm not dead" state and responds to SMART / admin commands, you could see the output. --chuck From owner-freebsd-fs@freebsd.org Mon Mar 26 20:59:30 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8DEC1F6B4BA for ; Mon, 26 Mar 2018 20:59:30 +0000 (UTC) (envelope-from nonesuch@longcount.org) Received: from mail-wm0-x22b.google.com (mail-wm0-x22b.google.com [IPv6:2a00:1450:400c:c09::22b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 068A473D10 for ; Mon, 26 Mar 2018 20:59:30 +0000 (UTC) (envelope-from nonesuch@longcount.org) Received: by mail-wm0-x22b.google.com with SMTP id x4so5585149wmh.5 for ; Mon, 26 Mar 2018 13:59:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=longcount-org.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=eYd3R1RCJ4BjjQlOTGJLtRmpU53h8k1nOxkXMYsEOVA=; b=qXjJ2MjEAzTih7W9lM4athBUJSKZheTMISG3F59JV91EthSWhIH2NJCzlYLIffGi6M WreHIpYRNP2zcXiGBGamd7T4Bqe/x5dFhiLdbj7LFHlqHEDaWIyxM1iF21eJvgPofd/t dGOGSsmJBwvi8LyLYDrrRXr2ahvUmEpHvEpu5O9UsNjwCBJOXYfZ68yLK/0LGOkR9TRf dXPCTTuBIsqP/isZXnwceAILMLwlZcc2/bVQ/CncHScDmMpyEL/olpmhlvXLB3dVZvCA CiIyhKdgkThW4x3LoPxC9oGwqq/Vi1FlBc7WlVJSJamwHmMNvWHzdPZhS8e/G1SAj1Tr 2J/g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=eYd3R1RCJ4BjjQlOTGJLtRmpU53h8k1nOxkXMYsEOVA=; b=en+n81nuWTbpWwNnXVp00z692put1GqLS9obxxcMdHSPbGTyAnvEv6OM/D8aOh8HXG a5JquIzjsTloIYZE1VfOtKMrh1updchbEIqwbhvD46RzgPbjOs5VM0ZQ9TsMmi2qKOba uUkj95nnNA9F5LKWkQ3EKNiAgKgv7rDZljAFdJDaTdxAcF6MfrC9We1380NZHojdsyRy hwHxkCzoPfzELapKbkaq2WMd0oZEMED7JqNs9n6ZARKRhSvjhpExo1FGbIq71ik3YoGz 8fsjAst6cMfcq2tbQ/onUPRQguNlNifroKoFH5U7QQolmsVvqcXVPyW4ecgWNVgehRPo +t0g== X-Gm-Message-State: AElRT7ElvXxjcVzYTJZt/nOmfaF39ZVYLzkizw1OFEHFmOr8h+iMRXiB C1SK0t1XdIbYnurnCD5msvp9cfhz8NpW24pZTwQSyg== X-Google-Smtp-Source: AG47ELvdWOib77/7DUQ6DpvCLrd6e10hGo7vYuhLFqYSEUTKri8DulnpVm4c/JmfQISjVP8jQpUuRQYqj8Kx46wzegg= X-Received: by 10.80.146.170 with SMTP id k39mr37618031eda.110.1522097968959; Mon, 26 Mar 2018 13:59:28 -0700 (PDT) MIME-Version: 1.0 Received: by 10.80.140.35 with HTTP; Mon, 26 Mar 2018 13:59:28 -0700 (PDT) X-Originating-IP: [38.104.68.66] In-Reply-To: References: <4754cb2f-76bb-a69b-0cf5-eff4d621eb29@callfortesting.org> From: Mark Saad Date: Mon, 26 Mar 2018 16:59:28 -0400 Message-ID: Subject: Re: smart(8) Call for Testing To: Chuck Tuffli Cc: Michael Dexter , freebsd-fs@freebsd.org Content-Type: text/plain; charset="UTF-8" X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Mar 2018 20:59:30 -0000 On Mon, Mar 26, 2018 at 4:39 PM, Chuck Tuffli wrote: > On Mon, Mar 26, 2018 at 1:25 PM, Mark Saad wrote: >> Mike / Chuck >> Silly question , how does it handle a failed disk ? > > It depends on how failed the device is. The application uses CAM to > send pass-through commands. So, if the device doesn't appear in > camcontrol devlist, you'd get "no such device" or a message from CAM > indicating you might need to load a module. If the device is still > registered with the system but not processing commands, I'd expect > (hope?) the commands to timeout. In either case, there may not be any > out put, but the exit status should be non-zero. > > On the other hand, if the disk is in some sort of Monty Python-eske > "I'm not dead" state and responds to SMART / admin commands, you could > see the output. > > --chuck I was thinking more along the lines of when smartctl reports the overall-health which is always a good time to read; and very Monty Python-eske SMART overall-health self-assessment test result: FAILED! Drive failure expected in less than 24 hours. SAVE ALL DATA. https://serverfault.com/questions/114196/smart-warns-me-but-i-dont-trust-it -- mark saad | nonesuch@longcount.org From owner-freebsd-fs@freebsd.org Tue Mar 27 09:22:58 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 45D03F64302 for ; Tue, 27 Mar 2018 09:22:58 +0000 (UTC) (envelope-from se@freebsd.org) Received: from mailout07.t-online.de (mailout07.t-online.de [194.25.134.83]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mailout00.t-online.de", Issuer "TeleSec ServerPass DE-2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C51C278CEE for ; Tue, 27 Mar 2018 09:22:57 +0000 (UTC) (envelope-from se@freebsd.org) Received: from fwd19.aul.t-online.de (fwd19.aul.t-online.de [172.20.27.65]) by mailout07.t-online.de (Postfix) with SMTP id E2E9C427541A; Tue, 27 Mar 2018 11:22:49 +0200 (CEST) Received: from Stefans-MBP-7.fritz.box (bjcJb4ZCghhJPAD9xmef7tjJvWBjgkderO6QRDj2-EWDyxmxWQbmdSjoxg4rfj4g+5@[87.151.209.250]) by fwd19.t-online.de with (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384 encrypted) esmtp id 1f0koa-45D1Ae0; Tue, 27 Mar 2018 11:22:48 +0200 Subject: Re: smart(8) Call for Testing To: Michael Dexter , Chuck Tuffli References: <4754cb2f-76bb-a69b-0cf5-eff4d621eb29@callfortesting.org> From: Stefan Esser Cc: FreeBSD File-Systems Message-ID: Date: Tue, 27 Mar 2018 11:22:47 +0200 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.13; rv:52.0) Gecko/20100101 Thunderbird/52.7.0 MIME-Version: 1.0 In-Reply-To: <4754cb2f-76bb-a69b-0cf5-eff4d621eb29@callfortesting.org> Content-Type: text/plain; charset=windows-1252 Content-Language: en-US Content-Transfer-Encoding: 7bit X-ID: bjcJb4ZCghhJPAD9xmef7tjJvWBjgkderO6QRDj2-EWDyxmxWQbmdSjoxg4rfj4g+5 X-TOI-MSGID: 0a762016-6caf-4013-8edc-b52f72ebe3ff X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Mar 2018 09:22:58 -0000 Am 26.03.18 um 20:52 schrieb Michael Dexter: > As you may or may not know, Chuck Tuffli has developed a simple, > scripting-friendly S.M.A.R.T. utility for FreeBSD that is designed to be > included in base once proven. To that end, smart(8) is ready for testing on > the broadest selection of disk and controller combinations possible. > > IF you should encounter an errors such as no output for your device, please > submit a ticket at either of the above sites with the output of: > > uname -a > camcontrol devlist -v > camcontrol identify > smartctl -a /dev/ Hi Michael and Chuck, not sure, whether this is a problem, but I get a surprising result for my 6GB WD-Red SATA drives: # smart -it /dev/ada0 Device WDC WD60EFRX-68TGBN1 Revision 82.00A82 Serial WD-WX21DC42E411 208 1 47 0 200 200 0 208 3 39 0 213 196 8333 208 4 50 0 100 100 35 208 5 51 0 200 200 0 208 7 46 0 200 200 0 208 9 50 0 68 68 23695 208 10 50 0 100 253 0 208 11 50 0 100 253 0 208 12 50 0 100 100 33 208 192 50 0 200 200 26 208 193 50 0 200 200 758 208 194 34 0 109 101 43 208 196 50 0 200 200 0 208 197 50 0 200 200 0 208 198 48 0 100 253 0 208 199 50 0 200 200 0 208 200 8 0 100 253 0 208 5 197 2 0 0 0 208 1 10 0 0 0 0 The last two rows re-use attribute IDs seen before, are out of order and do not report the values I'd expect. These rows are missing from the smartctl -a output: ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE 1 Raw_Read_Error_Rate 0x002f 200 200 051 Pre-fail Always - 0 3 Spin_Up_Time 0x0027 213 196 021 Pre-fail Always - 8333 4 Start_Stop_Count 0x0032 100 100 000 Old_age Always - 35 5 Reallocated_Sector_Ct 0x0033 200 200 140 Pre-fail Always - 0 7 Seek_Error_Rate 0x002e 200 200 000 Old_age Always - 0 9 Power_On_Hours 0x0032 068 068 000 Old_age Always - 23695 10 Spin_Retry_Count 0x0032 100 253 000 Old_age Always - 0 11 Calibration_Retry_Count 0x0032 100 253 000 Old_age Always - 0 12 Power_Cycle_Count 0x0032 100 100 000 Old_age Always - 33 192 Power-Off_Retract_Count 0x0032 200 200 000 Old_age Always - 26 193 Load_Cycle_Count 0x0032 200 200 000 Old_age Always - 758 194 Temperature_Celsius 0x0022 109 101 000 Old_age Always - 43 196 Reallocated_Event_Count 0x0032 200 200 000 Old_age Always - 0 197 Current_Pending_Sector 0x0032 200 200 000 Old_age Always - 0 198 Offline_Uncorrectable 0x0030 100 253 000 Old_age Offline - 0 199 UDMA_CRC_Error_Count 0x0032 200 200 000 Old_age Always - 0 200 Multi_Zone_Error_Rate 0x0008 100 253 000 Old_age Offline - 0 Should the last two lines of smart output be omitted (e.g. by filtering based on their flag value?). BTW: an option to print fixed width columns with headings or CSV format with header line (or e.g. JSON) might be useful. And: While the first three columns are documented, the -t output is not. Regards, STefan From owner-freebsd-fs@freebsd.org Tue Mar 27 14:33:01 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B6458F5A7C4 for ; Tue, 27 Mar 2018 14:33:01 +0000 (UTC) (envelope-from chuck@tuffli.net) Received: from mail-it0-x22e.google.com (mail-it0-x22e.google.com [IPv6:2607:f8b0:4001:c0b::22e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 52A9768A9C for ; Tue, 27 Mar 2018 14:33:00 +0000 (UTC) (envelope-from chuck@tuffli.net) Received: by mail-it0-x22e.google.com with SMTP id r19-v6so2092128itc.0 for ; Tue, 27 Mar 2018 07:33:00 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=tuffli-net.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=jQ6DL2hCjp68jWG6AaUTBYbJkZmWmzpfgJ/mG2W1gPc=; b=XcNAFjTqK/srEVtkpP7Olvj32XurSEKAMjzwAto83O5QM5zWj4zfBXXwpkPh+lhzby vOAFtDAy7ni6ZIloytQvhaGhyTHpOVnApBZ/BZk/a+K/2hDtjVyI+3iM8ud8oC0PNcKj NjS5G406CgiEWNPTs6tV45L62X0sPSRrZpoxuQRsd5rc0tA/IsvZfzwf1HcHsDrmif5Q satI0n3YU9wcjFUFCOTESIA1oP0IPpsLuNLdI8KgaI4Xvsc0Kq/kt4ZnruyoMxuXn93V dJZXa/Y44evQkpD0fu9BujoMVIHcwBJ901FpXpggnsgjfkU2y4HjswxEV7NmRfHggElk CI4g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=jQ6DL2hCjp68jWG6AaUTBYbJkZmWmzpfgJ/mG2W1gPc=; b=EUlfmT2zw/stIEm2eF89Hcvc0Xk4ROq2WYOHxrBKBJjjRvnz74wX9Q1zqDRnDW4j4S 8FQ+D9z5tzPGvXzdisJTGkbx3h5jujJD47037AG90/PKhQ0JhUZyx3ohsfGtVBZOsboF 5azpcfqa4ysx/gEpyWzSFjeGaucaM9iiedxZ7bzXE8lrao9mzMgrYoSLtJ1JRdAqicHs 0D+oUh55kLdyEoZ+eQVRu6idvlhMo1elGrJBldP4b/hCr1CmBd3SsXYQlQeLWDGZt+l4 PhrAUz56Xy4f5MNmWXDmFTD5RbpFGYS6CqUt+5cg8FBLt9Y1M+EdP1rG1oLoGLewHLmC PuVQ== X-Gm-Message-State: AElRT7H1rdtXleaJodV7dCNDqWgfnie3XxKx/OADrsCdK+gnVWKrImJd 8UteOJVFBv4uAYTZxboBHqYYiHok9jS0wOjwcpa7C3zkj60NKw== X-Google-Smtp-Source: AIpwx4+NlSfte0azkKYI6IEa4Q+0HECziXo3846pHjJgE2pu6o+F0hPxnOAVdpEqbVjy2AEWUFnFWjbJFTMCZv0X8m0= X-Received: by 2002:a24:130e:: with SMTP id 14-v6mr5777231itz.151.1522161180159; Tue, 27 Mar 2018 07:33:00 -0700 (PDT) MIME-Version: 1.0 Received: by 10.2.6.10 with HTTP; Tue, 27 Mar 2018 07:32:59 -0700 (PDT) In-Reply-To: References: <4754cb2f-76bb-a69b-0cf5-eff4d621eb29@callfortesting.org> From: Chuck Tuffli Date: Tue, 27 Mar 2018 07:32:59 -0700 Message-ID: Subject: Re: smart(8) Call for Testing To: Mark Saad Cc: Michael Dexter , freebsd-fs@freebsd.org Content-Type: text/plain; charset="UTF-8" X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Mar 2018 14:33:01 -0000 On Mon, Mar 26, 2018 at 1:59 PM, Mark Saad wrote: ... > I was thinking more along the lines of when smartctl reports the overall-health > which is always a good time to read; and very Monty Python-eske > > SMART overall-health self-assessment test result: FAILED! > Drive failure expected in less than 24 hours. SAVE ALL DATA. > > https://serverfault.com/questions/114196/smart-warns-me-but-i-dont-trust-it This app is different from others in that it only reports the values; it is up to the user / script / etc. to provide analysis. In the serverfault example, spin-up time is attribute ID 3. One of my drives shows: $ smart -t da0 | grep "208 3" 208 3 39 0 100 100 1029 smartctl shows it as follows $ smartctl -A /dev/da0 ... 3 Spin_Up_Time 0x0027 100 100 001 Pre-fail Always - 1029 It would be up to the user or script to decide at what point this might indicate an imminent failure. --chuck From owner-freebsd-fs@freebsd.org Tue Mar 27 16:46:12 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 42774F69535 for ; Tue, 27 Mar 2018 16:46:12 +0000 (UTC) (envelope-from SRS0=jCOG=GR=quip.cz=000.fbsd@elsa.codelab.cz) Received: from elsa.codelab.cz (elsa.codelab.cz [94.124.105.4]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id CFEC1710A6 for ; Tue, 27 Mar 2018 16:46:11 +0000 (UTC) (envelope-from SRS0=jCOG=GR=quip.cz=000.fbsd@elsa.codelab.cz) Received: from elsa.codelab.cz (localhost [127.0.0.1]) by elsa.codelab.cz (Postfix) with ESMTP id E52E828412; Tue, 27 Mar 2018 18:46:03 +0200 (CEST) Received: from illbsd.quip.test (ip-86-49-16-209.net.upcbroadband.cz [86.49.16.209]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by elsa.codelab.cz (Postfix) with ESMTPSA id E3FA528422; Tue, 27 Mar 2018 18:45:50 +0200 (CEST) Subject: Re: smart(8) Call for Testing To: Chuck Tuffli , Mark Saad Cc: freebsd-fs@freebsd.org References: <4754cb2f-76bb-a69b-0cf5-eff4d621eb29@callfortesting.org> From: Miroslav Lachman <000.fbsd@quip.cz> Message-ID: <1d3f2cef-4c37-782e-7938-e0a2eebc8842@quip.cz> Date: Tue, 27 Mar 2018 18:45:50 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Firefox/52.0 SeaMonkey/2.49.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Mar 2018 16:46:12 -0000 Chuck Tuffli wrote on 2018/03/27 16:32: > On Mon, Mar 26, 2018 at 1:59 PM, Mark Saad wrote: > ... >> I was thinking more along the lines of when smartctl reports the overall-health >> which is always a good time to read; and very Monty Python-eske >> >> SMART overall-health self-assessment test result: FAILED! >> Drive failure expected in less than 24 hours. SAVE ALL DATA. >> >> https://serverfault.com/questions/114196/smart-warns-me-but-i-dont-trust-it > > This app is different from others in that it only reports the values; > it is up to the user / script / etc. to provide analysis. In the > serverfault example, spin-up time is attribute ID 3. One of my drives > shows: > > $ smart -t da0 | grep "208 3" > 208 3 39 0 100 100 1029 > > smartctl shows it as follows > > $ smartctl -A /dev/da0 > ... > 3 Spin_Up_Time 0x0027 100 100 001 Pre-fail > Always - 1029 > > It would be up to the user or script to decide at what point this > might indicate an imminent failure. What is the purpose of this utility and why it should be in base if almost everyone will need to write something to do the "real job" or "pkg install smartmontools". Maybe I just don't see something... Miroslav Lachman From owner-freebsd-fs@freebsd.org Tue Mar 27 16:52:19 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 75343F6A207 for ; Tue, 27 Mar 2018 16:52:19 +0000 (UTC) (envelope-from chuck@tuffli.net) Received: from mail-it0-x22c.google.com (mail-it0-x22c.google.com [IPv6:2607:f8b0:4001:c0b::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 13A9C71A51 for ; Tue, 27 Mar 2018 16:52:18 +0000 (UTC) (envelope-from chuck@tuffli.net) Received: by mail-it0-x22c.google.com with SMTP id r19-v6so95831itc.0 for ; Tue, 27 Mar 2018 09:52:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=tuffli-net.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=QI/Ld7mAlPyaqy8iPUoxPUGwa/WILMF8IinJUkJvMsk=; b=zDb84SMNAzzCDb4w52wRcMmI8mPgIbK/52s7wAXOaptwOqiinrraXzkL5B+XJrWS0Z UYin98O9eZTcXyJW/hElZw49X/MZk8jH8+0AvP69NsJ3XkDOdlKAeuiyDB3FjkVPQFql d0DpI8dpGBILeFk6UJasPjy7zJDikP0xrfDZWGaEmFZc01hZKoHTfp27f7+RNT7B4Ra8 1xq2Ptdwp3Pdb7V2CkjFn95Zzw18GiB0rBVGLgRv5Zn1mleCvdvfsdFMw1pb7i/pP9LZ QtKDHEl/25BpwhHrWAIwhr5rm953UJd4H8OYNQpGwybcxPmkCwztuq+/a3E8zUnDXBMi Hj8Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=QI/Ld7mAlPyaqy8iPUoxPUGwa/WILMF8IinJUkJvMsk=; b=Z0RnZxple6Gwfa+Uq6xpetzM+Q89BGbPZQopT1JbdrAxzzHrH+YSoiDENjX0aHf1Hh /4FRtu7U9Jj/z4eWA+3ov2M5vuX9ATJsBIb4IEKs4aYPsDOjp+tq4i+UgK0RxDYIBQia qgDKDnFv0otpJDaNOg3BxQFk3V88NGyzASOX1Baq2npDPHmiyhDiiNnn31Vbs/2MECxF WVXzxrVxyE7YupfpGEiSFTKmxPIseQWGlqWTnDUGVU1zfjPEnjbnDxdgchigyn/8FY18 m6V/to3nzTfv5CwldgyzHy/Ea9mOcn9naoBBq2U5fg02b+EyPuiHULncAzmXvaT4HZL0 ZFPQ== X-Gm-Message-State: AElRT7HTxdIHYbE3YnwRirGNUwNr+FATVZB7DOGurWYeyOMjNOIjEf76 8s8amRKYDu/+n92gJjDkQ2h3rLwUkP7wpc0ANQFqoA== X-Google-Smtp-Source: AIpwx4/FZkYXo9eW/sywTvVlDAtapFNq9Voxf+e1hZQ0rg0o2D6z48eBjDcU88ck/dGrXBeokFoeq7abfxZNaZXVTgM= X-Received: by 2002:a24:33c3:: with SMTP id k186-v6mr32641itk.5.1522169537788; Tue, 27 Mar 2018 09:52:17 -0700 (PDT) MIME-Version: 1.0 Received: by 10.2.6.10 with HTTP; Tue, 27 Mar 2018 09:52:17 -0700 (PDT) In-Reply-To: References: <4754cb2f-76bb-a69b-0cf5-eff4d621eb29@callfortesting.org> From: Chuck Tuffli Date: Tue, 27 Mar 2018 09:52:17 -0700 Message-ID: Subject: Re: smart(8) Call for Testing To: Stefan Esser Cc: Michael Dexter , FreeBSD File-Systems Content-Type: text/plain; charset="UTF-8" X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Mar 2018 16:52:19 -0000 On Tue, Mar 27, 2018 at 2:22 AM, Stefan Esser wrote: ... > not sure, whether this is a problem, but I get a surprising result for my 6GB > WD-Red SATA drives: ... > 208 5 197 2 0 0 0 > 208 1 10 0 0 0 0 > > The last two rows re-use attribute IDs seen before, are out of order and do > not report the values I'd expect. These rows are missing from the smartctl -a > output: Best I can tell, smartctl won't print an attribute if: - the ID == 0 - user requests only currently failed with the pre-fail flag set - user requests only failed with/without the pre-fail flag set The ID isn't zero, so perhaps, it's one of the other conditions. Off list, can you send me the output from smartctl -a? > BTW: an option to print fixed width columns with headings or CSV format > with header line (or e.g. JSON) might be useful. > > And: While the first three columns are documented, the -t output is not. Noted. Thanks! --chuck From owner-freebsd-fs@freebsd.org Tue Mar 27 17:01:38 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C22BFF6B008 for ; Tue, 27 Mar 2018 17:01:37 +0000 (UTC) (envelope-from spork@bway.net) Received: from smtp1.bway.net (smtp1.v6.bway.net [IPv6:2607:d300:1::27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 6ACBF721B4 for ; Tue, 27 Mar 2018 17:01:37 +0000 (UTC) (envelope-from spork@bway.net) Received: from frankentosh.sporklab.com (pool-71-187-162-242.nwrknj.fios.verizon.net [71.187.162.242]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) (Authenticated sender: spork@bway.net) by smtp1.bway.net (Postfix) with ESMTPSA id 13B6195868; Tue, 27 Mar 2018 13:01:29 -0400 (EDT) From: Charles Sprickman Message-Id: Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: Re: smart(8) Call for Testing Date: Tue, 27 Mar 2018 13:01:28 -0400 In-Reply-To: <1d3f2cef-4c37-782e-7938-e0a2eebc8842@quip.cz> Cc: Chuck Tuffli , Mark Saad , freebsd-fs@freebsd.org To: Miroslav Lachman <000.fbsd@quip.cz> References: <4754cb2f-76bb-a69b-0cf5-eff4d621eb29@callfortesting.org> <1d3f2cef-4c37-782e-7938-e0a2eebc8842@quip.cz> X-Mailer: Apple Mail (2.3273) Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Mar 2018 17:01:38 -0000 > On Mar 27, 2018, at 12:45 PM, Miroslav Lachman <000.fbsd@quip.cz> = wrote: >=20 > Chuck Tuffli wrote on 2018/03/27 16:32: >> On Mon, Mar 26, 2018 at 1:59 PM, Mark Saad = wrote: >> ... >>> I was thinking more along the lines of when smartctl reports the = overall-health >>> which is always a good time to read; and very Monty Python-eske >>>=20 >>> SMART overall-health self-assessment test result: FAILED! >>> Drive failure expected in less than 24 hours. SAVE ALL DATA. >>>=20 >>> = https://serverfault.com/questions/114196/smart-warns-me-but-i-dont-trust-i= t >> This app is different from others in that it only reports the values; >> it is up to the user / script / etc. to provide analysis. In the >> serverfault example, spin-up time is attribute ID 3. One of my drives >> shows: >> $ smart -t da0 | grep "208 3" >> 208 3 39 0 100 100 1029 >> smartctl shows it as follows >> $ smartctl -A /dev/da0 >> ... >> 3 Spin_Up_Time 0x0027 100 100 001 Pre-fail >> Always - 1029 >> It would be up to the user or script to decide at what point this >> might indicate an imminent failure. >=20 > What is the purpose of this utility and why it should be in base if = almost everyone will need to write something to do the "real job" or = "pkg install smartmontools=E2=80=9D. I have to agree - this is kind of a prior-century tool as far as user = friendliness it seems. What is the goal of this tool? The main use for smartmontools seems to = be to pluck information about the drive and act on some very specific = items (for example, polling the =E2=80=9Cmedia wearout indicator=E2=80=9D = on SSDs is very useful, or read error rates on HDs. But the = smartmontools folks seem to spend a fair amount of time with putting = drive data in their tool so that meaningful data is presented to the = user. Without that level of functionality out of the box, what=E2=80=99s = the argument for this being in base vs. being a 3rd party tool that = lives in the ports tree? Think of the people that answer mailing list = and forum questions when considering adding something like this to = base=E2=80=A6 Again, maybe I=E2=80=99m just missing something or maybe this is here = for a particular vendor that needs it or something. Charles >=20 > Maybe I just don't see something... >=20 > Miroslav Lachman >=20 > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs = > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org = " From owner-freebsd-fs@freebsd.org Tue Mar 27 19:07:06 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 29BFFF4FB8F for ; Tue, 27 Mar 2018 19:07:06 +0000 (UTC) (envelope-from julian@freebsd.org) Received: from vps1.elischer.org (vps1.elischer.org [204.109.63.16]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "vps1.elischer.org", Issuer "CA Cert Signing Authority" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id BA5A77ADF3 for ; Tue, 27 Mar 2018 19:07:05 +0000 (UTC) (envelope-from julian@freebsd.org) Received: from Julian-MBP3.local (115-166-20-68.dyn.iinet.net.au [115.166.20.68]) (authenticated bits=0) by vps1.elischer.org (8.15.2/8.15.2) with ESMTPSA id w2RJ6tj5018611 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO) for ; Tue, 27 Mar 2018 12:06:57 -0700 (PDT) (envelope-from julian@freebsd.org) Subject: Re: smart(8) Call for Testing To: freebsd-fs@freebsd.org References: <4754cb2f-76bb-a69b-0cf5-eff4d621eb29@callfortesting.org> From: Julian Elischer Message-ID: <3695e5d7-0e16-20af-0659-5548eb855a6f@freebsd.org> Date: Wed, 28 Mar 2018 03:06:49 +0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.13; rv:52.0) Gecko/20100101 Thunderbird/52.7.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Mar 2018 19:07:06 -0000 On 27/3/18 10:32 pm, Chuck Tuffli wrote: > On Mon, Mar 26, 2018 at 1:59 PM, Mark Saad wrote: > ... > This app is different from others in that it only reports the values; so you could say that this is the D.U.M.B  S.M.A.R.T  program? > it is up to the user / script / etc. to provide analysis. In the > serverfault example, spin-up time is attribute ID 3. One of my drives > shows: From owner-freebsd-fs@freebsd.org Tue Mar 27 19:13:42 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5CBD0F5070B for ; Tue, 27 Mar 2018 19:13:42 +0000 (UTC) (envelope-from rainer@ultra-secure.de) Received: from connect.ultra-secure.de (connect.ultra-secure.de [88.198.71.201]) by mx1.freebsd.org (Postfix) with ESMTP id CB7737B4C5 for ; Tue, 27 Mar 2018 19:13:41 +0000 (UTC) (envelope-from rainer@ultra-secure.de) Received: (Haraka outbound); Tue, 27 Mar 2018 21:13:16 +0200 Authentication-Results: connect.ultra-secure.de; iprev=temperror; auth=pass (plain); spf=none smtp.mailfrom=ultra-secure.de Received-SPF: None (connect.ultra-secure.de: domain of ultra-secure.de does not designate 217.71.83.52 as permitted sender) receiver=connect.ultra-secure.de; identity=mailfrom; client-ip=217.71.83.52; helo=[192.168.1.200]; envelope-from= Received: from [192.168.1.200] (217-071-083-052.ip-tech.ch [217.71.83.52]) by connect.ultra-secure.de (Haraka/2.6.2-toaster) with ESMTPSA id D75029A3-989A-45CE-BE0B-809CE0FA96D5.1 envelope-from (authenticated bits=0); Tue, 27 Mar 2018 21:13:14 +0200 From: Rainer Duffner Message-Id: <7ED27465-1BC2-4522-873E-9ECE192EB7A2@ultra-secure.de> Mime-Version: 1.0 (Mac OS X Mail 11.2 \(3445.5.20\)) Subject: Re: smart(8) Call for Testing Date: Tue, 27 Mar 2018 21:13:28 +0200 In-Reply-To: Cc: Miroslav Lachman <000.fbsd@quip.cz>, Tom Evans via freebsd-fs , Chuck Tuffli To: Charles Sprickman References: <4754cb2f-76bb-a69b-0cf5-eff4d621eb29@callfortesting.org> <1d3f2cef-4c37-782e-7938-e0a2eebc8842@quip.cz> X-Mailer: Apple Mail (2.3445.5.20) X-Haraka-GeoIP: EU, CH, 451km X-Haraka-ASN: 24951 X-Haraka-GeoIP-Received: X-Haraka-ASN: 24951 217.71.80.0/20 X-Haraka-ASN-CYMRU: asn=24951 net=217.71.80.0/20 country=CH assignor=ripencc date=2003-08-07 X-Haraka-p0f: os="Mac OS X " link_type="DSL" distance=12 total_conn=4 shared_ip=N X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on spamassassin X-Spam-Level: X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00, HTML_MESSAGE autolearn=ham autolearn_force=no version=3.4.1 X-Haraka-Karma: score: 6, good: 5254, bad: 2, connections: 5756, history: 5252, asn_score: 211, asn_connections: 223, asn_good: 211, asn_bad: 0, pass:asn, asn_all_good, relaying Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Mar 2018 19:13:42 -0000 > Am 27.03.2018 um 19:01 schrieb Charles Sprickman via freebsd-fs = : >=20 > What is the goal of this tool? Maybe to have a BSD-licensed version of a tool with sort-of the = functionality of smartmontools? Assuming that the later is GPLx-licensed. Maybe one of the vendors who sells FreeBSD as part of an appliance has = shown some interest in this? If you=E2=80=99re hardware is well-defined and thus the output is = consistent, I could imagine it=E2=80=99s not too difficult to parse = this. I admit I haven=E2=80=99t tried it and I don=E2=80=99t really have time = to do that.= From owner-freebsd-fs@freebsd.org Tue Mar 27 19:22:26 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 445EAF514EF for ; Tue, 27 Mar 2018 19:22:26 +0000 (UTC) (envelope-from editor@callfortesting.org) Received: from mail-pg0-x232.google.com (mail-pg0-x232.google.com [IPv6:2607:f8b0:400e:c05::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C1DDD7BB71 for ; Tue, 27 Mar 2018 19:22:25 +0000 (UTC) (envelope-from editor@callfortesting.org) Received: by mail-pg0-x232.google.com with SMTP id i194so10176pgd.0 for ; Tue, 27 Mar 2018 12:22:25 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=callfortesting-org.20150623.gappssmtp.com; s=20150623; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to:content-language:content-transfer-encoding; bh=jAVpets/WC/hG6vUqSXAMEjIM6JDhEFw2iij2FwvzDc=; b=1uCYDGIoiGv2UT+jLUfUv+vWrp1uqOyEe4ZSzy2ikXjt71IYHzSDpZ1/tpNILlzhTZ YtkxIG8AAFcjT5TXz6QA7TsV4llL5FrfIEH15+UdSCvglZ6e8vvoL+3ZeEiM+AX9FQ19 7mlezBtfSvWwEFRA3MQc2/y8QcwsWDE2xbC9LDiMWH2pyotS2x+kDghvK6lob+G1ouOK SrmwM48jXP+/NiAtzGOT1fa7thUln4tU6Lq3W8iLykXErgAF0VesqcmgJ4rXHZo4CpVt hsGVvnHnjrVfUUmpnnIbOqEVfmul5y7mSfzb2D3N1ipYyIf554IRtpUQzZerPosLDaie aFCg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=jAVpets/WC/hG6vUqSXAMEjIM6JDhEFw2iij2FwvzDc=; b=olCesjsqhatRbPTBD9eLB8tFy93StOwRJrEgPoTWYC6Okv2UvZPSAk1Oj+1iszAdQc 6y/+UgmWxb4FPKhUIOdUX8IegI8ed+3KJmAteukFm+U1COQJwSARQU7HBtbBQFc/DUtD leTVtrxrNY2R2AYmn4r9MKziTbGX2kg+TtCi46ojPXG6YCg3I+cJXLwvrQR4HQ8M2dkq 8qAES5FgSKN6WR6o4tShjW4CDOqa9JyNJjBaUfh8HLopOqkyM2Mmis/rVA7pSDtAVvC8 /L+dAl7ORsNBgJD8Kq5PvRLtmrtf6NTa8csDWHh03PTIDUwn+LWjYiqfrFGX/xf+jxxD cRQw== X-Gm-Message-State: AElRT7Gtwr36/twZMd7CJZH0PTCjVimhelcmMkE79xzJS587FaGemj4+ Moqmwa7mDoWHK0Ehd8xAKhipAVPj X-Google-Smtp-Source: AIpwx4/XQA9dxC/GHrNXG1mp7R9gCrF8QlWEsTCYyq7w5jUVRmZIn+57Ky4gj1gB4Jcejk2uVEifcw== X-Received: by 10.101.81.8 with SMTP id f8mr388918pgq.13.1522178544453; Tue, 27 Mar 2018 12:22:24 -0700 (PDT) Received: from macbook-2.local (c-67-170-143-17.hsd1.or.comcast.net. [67.170.143.17]) by smtp.gmail.com with ESMTPSA id a3sm3621439pgv.14.2018.03.27.12.22.23 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 27 Mar 2018 12:22:23 -0700 (PDT) Subject: Re: smart(8) Call for Testing To: freebsd-fs@freebsd.org References: <4754cb2f-76bb-a69b-0cf5-eff4d621eb29@callfortesting.org> <1d3f2cef-4c37-782e-7938-e0a2eebc8842@quip.cz> From: Michael Dexter Message-ID: <7f9d7848-e584-6d75-baab-99cd19f5bcd3@callfortesting.org> Date: Tue, 27 Mar 2018 12:22:20 -0700 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <1d3f2cef-4c37-782e-7938-e0a2eebc8842@quip.cz> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Mar 2018 19:22:26 -0000 On 3/27/18 9:45 AM, Miroslav Lachman wrote: > What is the purpose of this utility and why it should be in base if > almost everyone will need to write something to do the "real job" or > "pkg install smartmontools". > > Maybe I just don't see something... Scriptability. smartmontools output is not parsing-friendly and generally, an operatory only wants four or so key values such as hours, temperature and a variation on reallocated sectors. This facilitates that and with a license that would allow its inclusion in base. Michael From owner-freebsd-fs@freebsd.org Tue Mar 27 19:39:46 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 54F68F52C8B for ; Tue, 27 Mar 2018 19:39:46 +0000 (UTC) (envelope-from editor@callfortesting.org) Received: from mail-pl0-x22e.google.com (mail-pl0-x22e.google.com [IPv6:2607:f8b0:400e:c01::22e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D46807C59D for ; Tue, 27 Mar 2018 19:39:45 +0000 (UTC) (envelope-from editor@callfortesting.org) Received: by mail-pl0-x22e.google.com with SMTP id x4-v6so37022pln.7 for ; Tue, 27 Mar 2018 12:39:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=callfortesting-org.20150623.gappssmtp.com; s=20150623; h=subject:to:cc:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=Miys3jWortPeR50wo1WIJ6CT575VhWr1xnZRCTgT7k0=; b=hlU/ZBHFQEp1dq+Q0Nuqt3uf+6hR82cuwqPos+Hl50QwEvlxhSD78YW/BLOlg2c6df T0klEYClExy9/hv0eu68mPA6kBZRKdgJJCdo4v1gSySlgQhKszVsDrvP52xsj6mjh4Iq 04NuLztRLV8jRE1cNNtdZ9e9weqOeVDbsTHn6aIqQIn0fQ6jWJvCxka6DaPx5WSHGugr zX+rDXDghYvL/kvTM9/vBN9UuwV9FFjHs7Sw5UOoQYt/PnZIsg/DO74YtSQkqdYFkkJV r5UVYn3FcG9Wkaa7lrhd02r6Gt+EoH/BNav7Ki4KDxqygMJjiVjjPrRNllhexhaLowJ2 cFfQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=Miys3jWortPeR50wo1WIJ6CT575VhWr1xnZRCTgT7k0=; b=LYuZW7wAlIu1D7c246LSZpN9jcNXeRTHQJcLyyCFLxlvaNEB0pH7hP8+Xkw2wOHH8o +crWEyFap2DAMogkECI9xsvrd66m8UmTgwey9YfIYTAKD4iYquLhx8aEOzTZA8nX/WW9 7r8ALBafItCFJdud4hunG+jnN01wUHJIVh4ZJW5jDX/Qfs0o5ZJJ/h1BAR8mS5tnmIhD izHpwCu7V19ZyTnDjlu5b1mhUrMvhKb09BAgMQDFmOY0+jkVPJRHOJG27T0rE82W88CJ 28Vpf+0Ab2AUs5HIELMLO0d1G+AENZDpx1NFRt4BLcknWj7TYtnDOuRhBlhvGR9DU7Qo ibJw== X-Gm-Message-State: AElRT7FcRQw5w8fd2jv/Y4L5p56U2HKz5nqpXoEg6jtYyW5QGYJtfb0c AonFQkQCoQqIvTabPRj7G7fGH91H X-Google-Smtp-Source: AIpwx4+AS+tOMxU3VWwKMTFqb3xIFR5wH9iANgRIztV5eSxP8Hnl2wm9AL/UUkYN6H6BXl1VCLsVWw== X-Received: by 2002:a17:902:f24:: with SMTP id 33-v6mr646939ply.242.1522179584924; Tue, 27 Mar 2018 12:39:44 -0700 (PDT) Received: from macbook-2.local (c-67-170-143-17.hsd1.or.comcast.net. [67.170.143.17]) by smtp.gmail.com with ESMTPSA id i86sm4893975pfi.28.2018.03.27.12.39.44 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 27 Mar 2018 12:39:44 -0700 (PDT) Subject: Re: smart(8) Call for Testing To: Charles Sprickman , Miroslav Lachman <000.fbsd@quip.cz> Cc: freebsd-fs@freebsd.org, Chuck Tuffli References: <4754cb2f-76bb-a69b-0cf5-eff4d621eb29@callfortesting.org> <1d3f2cef-4c37-782e-7938-e0a2eebc8842@quip.cz> From: Michael Dexter Message-ID: Date: Tue, 27 Mar 2018 12:39:43 -0700 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Mar 2018 19:39:46 -0000 On 3/27/18 10:01 AM, Charles Sprickman via freebsd-fs wrote: > Again, maybe I’m just missing something or maybe this is here for a particular vendor that needs it or something. You are all welcome to watch the AsiaBSDCon and BSDCan talks on the rationale but here are a few: 1. Ability to use it in-base. Chuck has done the "hard part" and more can be built on top of it. With an in-base utility or library, the installer could check disk health before installation as could zpool(8) (proposed elsewhere with the optimal implementation TBD). 2. Scriptability as per my last post. Most administrators have relatively homogeneous selections of disks and seek four to five key SMART values. 3. Usability. You CAN obtain even raw-er values with a camcontrol inquiry but that truly is a pain and as I recall, they land in hex values, making scripting even more a pain. For what it's worth, I believe smart(8) had NVMe support before smartmontools did. smart(8) is not the work of a vendor but rather is based on my personal experience with hundreds of ZFS-based storage systems in the wild. I made several public calls for input on the design prior to Chuck writing any code. May I kindly request that you rephraise your criticisms as feature requests? Michael From owner-freebsd-fs@freebsd.org Tue Mar 27 20:04:26 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 73956F54CF5 for ; Tue, 27 Mar 2018 20:04:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0ED5E7D535 for ; Tue, 27 Mar 2018 20:04:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 28A855D6B for ; Tue, 27 Mar 2018 20:04:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w2RK4PMi026571 for ; Tue, 27 Mar 2018 20:04:25 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w2RK4Ph1026569 for freebsd-fs@FreeBSD.org; Tue, 27 Mar 2018 20:04:25 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 227008] [ZFS] zfs add -n misses l2arc changes Date: Tue, 27 Mar 2018 20:04:25 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Mar 2018 20:04:26 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D227008 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|freebsd-bugs@FreeBSD.org |freebsd-fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue Mar 27 20:11:43 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7300FF55792 for ; Tue, 27 Mar 2018 20:11:43 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-it0-x22c.google.com (mail-it0-x22c.google.com [IPv6:2607:f8b0:4001:c0b::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 069307DA8C for ; Tue, 27 Mar 2018 20:11:43 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-it0-x22c.google.com with SMTP id r19-v6so838120itc.0 for ; Tue, 27 Mar 2018 13:11:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc; bh=+Ib5c6o2rehwu968e6R5Y95O3nlWE2ocDfbjFVjLgis=; b=mKuW5eSGD9fWporlmVUAFklwpz/y3xpjTfF7PVy6kqHF0jUomvmMDelg6oNfsNs2Aw 8m+O3MHo+pBqydKVz9y0rIveHn6DroEZTwb3xnHtLsYWyuzCZclKQoqCv538bX+n/PcN a5RXsCJbKcI+8G4j/3NZ3MXXy8jOGtZh2n8+NERN1phDW140niBMbyN+SFSOQYYFWJe8 P7dtY2yzdJJEcbWvodKlDI1ufCuO+q6cxu5HWB3BhKmY1pRhXIaFG3VQkTZ3Aa/GEkxw /WefMF5LGrSE2jnXkAIMg4RkJhw7+dPhXqTz1xew+lCKLKhhSuvogKOuz9oGyY+TadV4 KLAg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc; bh=+Ib5c6o2rehwu968e6R5Y95O3nlWE2ocDfbjFVjLgis=; b=bjnwrthlquP/6C+lMY240jijAcNf15EyijhZtzSF6t05cJb0pjN36qmnEPSm8a0N0n Wdk30bRgjBFj+8POE1bcawnIqyMpx5H21QmnPn/RMt3vISEAZuwL0mGQM7kecUMWrDUR 2FzX5obhAHm21U7SoOQMTUyzQu9UHD1ccPWNqJhFkfaFQdxubcQauixcSKDCWcNCLcHt jbLkkch7jR0ZJ++wk547Its75UksCUpYHO3Iu0JrVUHiQLv6zCLMrxwCn8G+DLUJxXiK UU21/L+2Nv8qC+nDUbiwclrPKNd5sQqunZkYeRMqawq0jm4o38qBkQt+6OECqbWhsaR1 q2Ag== X-Gm-Message-State: AElRT7HIqcbbSUPRzwd+Nnv4wvz3eGbSwQIF8gL9vDk0UIuOqw3OjCgr mnC+3nGVXML22M6DE5mkgednmlN6vnFFgQ5POsi1KA== X-Google-Smtp-Source: AIpwx4/LQwgDcGDymFV9pn6ebkmcTbcBWWg5H6LBuFZ6Sw22fHyg3GC+g/nH8dfzcw7XI/etAObMVQxVcRdrzBXtuxw= X-Received: by 2002:a24:b649:: with SMTP id d9-v6mr731115itj.51.1522181502292; Tue, 27 Mar 2018 13:11:42 -0700 (PDT) MIME-Version: 1.0 Sender: wlosh@bsdimp.com Received: by 10.79.203.196 with HTTP; Tue, 27 Mar 2018 13:11:41 -0700 (PDT) X-Originating-IP: [192.173.67.1] Received: by 10.79.203.196 with HTTP; Tue, 27 Mar 2018 13:11:41 -0700 (PDT) In-Reply-To: <7f9d7848-e584-6d75-baab-99cd19f5bcd3@callfortesting.org> References: <4754cb2f-76bb-a69b-0cf5-eff4d621eb29@callfortesting.org> <1d3f2cef-4c37-782e-7938-e0a2eebc8842@quip.cz> <7f9d7848-e584-6d75-baab-99cd19f5bcd3@callfortesting.org> From: Warner Losh Date: Tue, 27 Mar 2018 13:11:41 -0700 X-Google-Sender-Auth: rbC2o3HDtlxSFKHMggYFcM7P0TY Message-ID: Subject: Re: smart(8) Call for Testing To: Michael Dexter Cc: FreeBSD FS Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Mar 2018 20:11:43 -0000 On Mar 27, 2018 12:23 PM, "Michael Dexter" wrote: On 3/27/18 9:45 AM, Miroslav Lachman wrote: > What is the purpose of this utility and why it should be in base if almost > everyone will need to write something to do the "real job" or "pkg install > smartmontools". > > Maybe I just don't see something... > Scriptability. smartmontools output is not parsing-friendly and generally, an operatory only wants four or so key values such as hours, temperature and a variation on reallocated sectors. This facilitates that and with a license that would allow its inclusion in At $WORK we grab all the attributes daily to do heard studies on the drives. We need little more than what's here for that. But we have thousands of machines and nobody ever logs into them unless there is a problem. Doing heard studies is the only way we found to predict failure and even then it's only weakly so... smartmontools is overkillfor that... Warner From owner-freebsd-fs@freebsd.org Tue Mar 27 21:38:11 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E85CEF5FA1A for ; Tue, 27 Mar 2018 21:38:10 +0000 (UTC) (envelope-from editor@callfortesting.org) Received: from mail-pl0-x22c.google.com (mail-pl0-x22c.google.com [IPv6:2607:f8b0:400e:c01::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id CA74183CC2 for ; Tue, 27 Mar 2018 21:38:09 +0000 (UTC) (envelope-from editor@callfortesting.org) Received: by mail-pl0-x22c.google.com with SMTP id c11-v6so248946plo.0 for ; Tue, 27 Mar 2018 14:38:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=callfortesting-org.20150623.gappssmtp.com; s=20150623; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to:content-language:content-transfer-encoding; bh=N4IftJ6ywXUBwcvjsmghEH3KXhIRuaOcSgBE5/Zai/w=; b=c1M32CCZGujdHKUF2kd5h9wRBG3KdQ8QClVG3ikNHPDj7SASgBbgEYGtaIOXeuPF/J T25k2dUCSwnXbzR64JjE3mTktQdiUZtA7cmRB3+8P1IMi2Jw/CSGK9A1Mi9D+1aDRNkd OqqjC5OlUO1NXvqWJEa+Lvw6TJioeynajrneCRfc7nOjiJ2sIEpxiyF/7zVCHLLpmedD 74hRt5WpdXXqZ6+QJSeqXUKVXrvGb1aBTNGH1OEEZdpgqz0pOI3ox3LvWGoPcETPWvuE 14UBYygRIwuiKDV17U8YNhlgxJ5jlIJFaj9hXqcNPLRVzXgNoLZuIYWqcfHt7V4+1vlw hTYg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=N4IftJ6ywXUBwcvjsmghEH3KXhIRuaOcSgBE5/Zai/w=; b=T577MEHm3Y5u/n67+o/W5ms9CJ4IrKpQOJjRWS03zulQxvqH7RP6/oJLIImOGLnVJ7 KWlgFJ3InXqn6quefxGv9gHRToxwIfnYvoI8Ral8NNq3cRYJRT/m+1fYsjFtpi2VcTeM pi3LPmvBfz3uuHkQ8XodTqG4/jVI8qPArq4vqFrElqt4l380aNDKtPw+6snEAUv0sEVi K45U7DPlieG3cKI7Iq5qVfGlYxe8Ku2N8fnKRHGy94FSApuHWFFtftsyjLKuxVdXef0U YvroUXQqFyDzEI3byj8Xkv8YMZy+wg0aWP2MqqK46oOKqgmkJQlsGkYsdfPylrT9cgi6 yfwA== X-Gm-Message-State: AElRT7Gs7dt08WJni6tZjVgWPuHCVDlNyNorgIo1bNZjhO0e+kRb1PzM FWMXr+kWQ3A5zGve72v5EoE3g7vL X-Google-Smtp-Source: AIpwx48CDsfMLclATNXC1Rn+I4B4PMLH22ROWm6oVb9ggsD31qJg9kcyfEaPfyO5T6eFhAH2KJeKxw== X-Received: by 2002:a17:902:4481:: with SMTP id l1-v6mr958213pld.43.1522186688652; Tue, 27 Mar 2018 14:38:08 -0700 (PDT) Received: from macbook-2.local (c-67-170-143-17.hsd1.or.comcast.net. [67.170.143.17]) by smtp.gmail.com with ESMTPSA id z14sm3648472pgv.26.2018.03.27.14.38.07 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 27 Mar 2018 14:38:07 -0700 (PDT) Subject: Re: smart(8) Call for Testing To: freebsd-fs@freebsd.org References: <4754cb2f-76bb-a69b-0cf5-eff4d621eb29@callfortesting.org> <3695e5d7-0e16-20af-0659-5548eb855a6f@freebsd.org> From: Michael Dexter Message-ID: <70259f94-9f26-3539-5086-fe3c7eaa21ee@callfortesting.org> Date: Tue, 27 Mar 2018 14:38:06 -0700 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <3695e5d7-0e16-20af-0659-5548eb855a6f@freebsd.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Mar 2018 21:38:11 -0000 On 3/27/18 12:06 PM, Julian Elischer wrote: > so you could say that this is the D.U.M.B  S.M.A.R.T  program? :-) FWIW: I have *never* once found the S.M.A.R.T. pass/fail to be of any use because the drive is usually toast before you see it[1]. Following the individual values is much more useful, especially if you have a stack of same-model drives and know that a few are new and a few old. Michael [1] "You don't need a weatherperson to know which way the wind blows." From owner-freebsd-fs@freebsd.org Wed Mar 28 18:14:49 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F2C10F6EAA5 for ; Wed, 28 Mar 2018 18:14:48 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [IPv6:2a01:4f8:201:6350::2]) by mx1.freebsd.org (Postfix) with ESMTP id 915267B39C for ; Wed, 28 Mar 2018 18:14:48 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from [192.168.23.186] (unknown [89.113.128.32]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id 824DCE63; Wed, 28 Mar 2018 21:14:47 +0300 (MSK) Reply-To: lev@FreeBSD.org Subject: Re: smart(8) Call for Testing To: Rainer Duffner , Charles Sprickman Cc: Tom Evans via freebsd-fs , Chuck Tuffli References: <4754cb2f-76bb-a69b-0cf5-eff4d621eb29@callfortesting.org> <1d3f2cef-4c37-782e-7938-e0a2eebc8842@quip.cz> <7ED27465-1BC2-4522-873E-9ECE192EB7A2@ultra-secure.de> From: Lev Serebryakov Organization: FreeBSD Message-ID: Date: Wed, 28 Mar 2018 21:14:46 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <7ED27465-1BC2-4522-873E-9ECE192EB7A2@ultra-secure.de> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 Mar 2018 18:14:49 -0000 On 27.03.2018 22:13, Rainer Duffner wrote: > Maybe one of the vendors who sells FreeBSD as part of an appliance has shown some interest in this? > > If you’re hardware is well-defined and thus the output is consistent, I could imagine it’s not too difficult to parse this. smartd is very important part of smartmontools, smartctl is not so. And periodic self-test triggering & check is most important feature of smartd, IMHO. Modern HDDs are liers in SMART. And only regular self-test discover real errors on surfaces in my experience. So, tool without support for HDD self-tests is of little usage for appliances, IMHO. -- // Lev Serebryakov From owner-freebsd-fs@freebsd.org Thu Mar 29 02:07:29 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4F182F65277 for ; Thu, 29 Mar 2018 02:07:29 +0000 (UTC) (envelope-from daveb@spectralogic.com) Received: from mail1.bemta8.messagelabs.com (mail1.bemta8.messagelabs.com [216.82.243.201]) by mx1.freebsd.org (Postfix) with ESMTP id EA01E70EDD for ; Thu, 29 Mar 2018 02:07:28 +0000 (UTC) (envelope-from daveb@spectralogic.com) Received: from [216.82.242.33] (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384 (256 bits)) by server-9.bemta-8.messagelabs.com id 09/C7-15733-15A4CBA5; Thu, 29 Mar 2018 02:07:13 +0000 X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFrrKIsWRWlGSWpSXmKPExsVyQG6fiG6A154 og/YPNhbHHv9kc2D0mPFpPksAYxRrZl5SfkUCa8bWNxeZCiZ1MVb07L7A1sC4poOxi5GTg01A S6JnyWEWEFtEwFTi178FbCC2sIC3xOcPr6HigRLX9n9kg7D1JC6fXwnUy8HBIqAqMalHDyTMK +As8WLhRHYQm1FATOL7qTVMIDazgLjErSfzwWwJAQGJJXvOM0PYohIvH/9jBRnDLKApsX6XPo RpL/F0lQJEp6LElO6H7BDTBSVOznzCMoGRfxaSobMQmmchNM9C0jwLSfMCRtZVjOrFqUVlqUW 6ZnpJRZnpGSW5iZk5uoYGFnq5qcXFiempOYlJxXrJ+bmbGIHBygAEOxg/9TsfYpTkYFIS5W10 2xMlxJeUn1KZkVicEV9UmpNafIhRhoNDSYK3yhMoJ1iUmp5akZaZA4wbmLQEB4+SCK8oSJq3u CAxtzgzHSJ1itGSo+P9lB5mjilLpgHJJ5eBpBBLXn5eqpQ4bzBIgwBIQ0ZpHtw4WGxfYpSVEu ZlBDpQiKcgtSg3swRV/hWjOAejkjBvPcgUnsy8Eritr4AOYgI6aFvTDpCDShIRUlINjHHLunc /kY3M1Zp0nOOsg4nvVJVJ714e+lggtWX/b7XVDto5O5jPyf6Wsr/qdZvnvWG0k5lqstEF07Jb p+1i5q0U6dux2nbrzGetLmqKD5uc+1vDFFW+hCzcM+f1c4ejN6d+lI5xeVycck32wuE9t94f/ mTCz+lwTjHVMinv0q6C3Kl3VdasqVJiKc5INNRiLipOBAA1pwiY6AIAAA== X-Env-Sender: daveb@spectralogic.com X-Msg-Ref: server-11.tower-55.messagelabs.com!1522289232!126757547!1 X-Originating-IP: [192.30.190.20] X-SYMC-ESS-Client-Auth: outbound-route-from=pass X-StarScan-Received: X-StarScan-Version: 9.9.15; banners=-,-,- X-VirusChecked: Checked Received: (qmail 29968 invoked from network); 29 Mar 2018 02:07:12 -0000 Received: from outmx2.spectralogic.com (HELO mail.spectralogic.com) (192.30.190.20) by server-11.tower-55.messagelabs.com with AES256-GCM-SHA384 encrypted SMTP; 29 Mar 2018 02:07:12 -0000 From: Dave Baukus To: "freebsd-fs@freebsd.org" Subject: ZFS, Vnode cache, and poor directory listing performance via Samba Thread-Topic: ZFS, Vnode cache, and poor directory listing performance via Samba Thread-Index: AQHTxwKm8Y8KtZTBXUOxWVyyjppo8Q== Date: Thu, 29 Mar 2018 02:07:12 +0000 Message-ID: <67aadb01-70c2-0454-2e3f-74bed67fb330@spectralogic.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: Content-Type: text/plain; charset="utf-8" Content-ID: Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Mar 2018 02:07:29 -0000 QmVsb3fCoGlzIG5hcnJhdGl2ZSBhbmdzdCBhbmQgd29lIGZvcsKgd2hpY2jCoEnCoGhhdmXCoHRo ZcKgdGhlwqBmb2xsb3dpbmfCoG9ic2VydmF0aW9ucy9xdWVzdGlvbnM6DQoNCi3CoEluY3JlYXNp bmfCoGtlcm4ubWF4dm5vZGVzwqBmcm9twqA2MDAsMDAwwqB0b8KgMiwwMDAsMDAwwqBhcHBhcmVu dGx5wqBzb2x2ZXPCoHRoZcKgInByb2JsZW0iDQotwqBUaGlzwqBkZWNyZWFzZXPCoHRoZcKgbnVt YmVywqBvZsKgbG9va3Vwc8KgaW7CoHRoZcKgc2NlbmFyaW/CoGJlbG93wqBmcm9twqA0MDcxOcKg KHNvbWXCoG9mwqB3aGljaMKgdGFrZcKgb3ZlcsKgYcKgc2Vjb25kKcKgdG/CoDQNCi3CoDIsMDAw LDAwwqBtYXnCoGJlwqBleHRyZW1lLMKgYnV0wqBJwqB3YXPCoGhvcGluZ8KgZm9ywqBhbsKgYXV0 aG9yaXRhdGl2ZcKgY29tbWVudMKgb27CoHdoeS9ob3fCoHRoaXPCoGltcHJvdmVzwqB0aGXCoHNj ZW5hcmlvwqBhbmQNCiDCoMKgdGhlbsKgcGVyaGFwc8KgScKgY2FuwqBjb21lwqB1cMKgd2l0aMKg c29tZcKgcmVhc29uYWJsZcKgdHVuaW5nwqBvcHRpb25zLg0KLcKgaXPCoHRoaXPCoGFuwqBhcnRp ZmFjdMKgb2bCoHRoZcKgRnJlZWJzZMKgMTEtaXNowqByZWZhY3RvcmluZ8Kgb2bCoHRoZcKgWkZT L0ZyZWVic2TCoFZOT1DCoGludGVyZmFjZcKgKD8pDQoNCi0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tDQpJwqBoYXZlwqB0aGXCoGZvbGxvd2luZ8Kg c2NlbmFyaW/CoG9uwqBGcmVlQlNEwqBTdGFibGXCoDExLjA6DQoNCkHCoFpGU8Kgd2l0aMKgYcKg ZGlyZWN0b3J5wqBjb250YWluaW5nwqAxLDAwMCwwMDDCoGZpbGVzO8KgdGhlwqByb290wqBvZsKg dGhpc8KgWkZTwqBpcw0KZXhwb3J0ZWTCoHZpYcKgU0FNQkHCoHVzaW5nwqBORlN2NMKgQUNMwqBw bHVnaW7CoGFuZMKgRE9TwqBhdHRyaWJ1dGVzIHdpdGggdGhlICg8Z2V0fHNldD5leHRhdHRyKcKg aW1wbGVtZW50YXRpb24uDQoNCkHCoGxvY2FswqBmdWxswqBsaXN0aW5nwqBvZsKgdGhpc8KgZGly ZWN0b3J5wqAobHPCoC1swqA+wqAvZGV2L251bGwpwqBjb21wbGV0ZXPCoGluwqBhYm91dMKgNDDC oHNlY29uZHMuDQpBwqBmdWxswqBsaXN0aW5nwqBmcm9twqBhwqBTYW1iYcKgY2xpZW50wqAobHPC oC1sKcKgY29tcGxldGVzwqBpbsKgYWJvdXTCoDPCoG1pbnV0ZXMuDQoNClVzaW5nwqB3aW5kb3dz wqBleHBsb3JlcsKgZnJvbcKgYcKgV2luMjAwOMKgY2xpZW50wqBpc8Kgd2hlcmXCoHRoZcKgc3Ry YW5nZW5lc3PCoGJlZ2luczvCoGl0DQp0YWtlc8KgYmV0d2VlbsKgOMKgdG/CoDEywqBtaW51dGVz wqBiZWZvcmXCoGNvbnRyb2zCoGlzwqByZXR1cm5lZMKgdG/CoHdpbi1leHBsb3Jlci4NCg0KVHJh Y2luZ8KgdGhpc8Kgd2l0aMKgd2lyZXNoYXJrwqBJwqBub3RpY2VkwqB0aGF0wqAiU01CMl9GSU5E X0lEX0JPVEhfRElSRUNUT1JZX0lORk/CoFBhdHRlcm46wqAqIg0KcmVxdWVzdHPCoGZyb23CoHRo ZcKgV2luMjAwOMKgY2xpZW50wqBzdGFydMKgb2ZmwqBmdW5jdGlvbmluZ8Kgd2VsbMKgKGNsaWVu dMKgcmVxdWVzdHMNCjY0a8Kgb2bCoGRhdGHCoGFuZMKgc2FtYmHCoHJlc3BvbmRzwqB3aXRowqA2 NGvCoG9mwqBkaXJlY3RvcnnCoGRhdGEpLsKgQWZ0ZXLCoGFib3V0wqAxNTDCoHNlY29uZHPCoG9m wqB0aGlzDQppbnRlcmFjdGlvbsKgdGhlwqBjbGllbnTCoG1ha2VzwqBhwqAiU01CMl9GSU5EX0lE X0JPVEhfRElSRUNUT1JZX0lORk/CoFBhdHRlcm46wqAqIsKgcmVxdWVzdMKgdGhhdMKgaXPCoG5v dA0KcmVzcG9uZGVkwqB0b8KgZm9ywqBvdmVywqA2MMKgc2Vjb25kcy7CoFRoZcKgd2luZG93c8Kg Y2xpZW50wqBjbG9zZXPCoHRoZcKgY29ubmVjdGlvbizCoHN0YXJ0c8KgYcKgbmV3DQpjb25uZWN0 aW9uLMKgYW5kwqBiZWdpbnPCoGRpcmVjdG9yecKgbGlzdGluZ8KgZnJvbcKgZ3JvdW5kwqB6ZXJv LsKgVGhpc8KgcGF0dGVybsKgY29udGludWVzwqBmb3INCjbCoHRvwqAxMMKgbWludXRlczvCoEnC oG5ldmVywqBzZWXCoGZpbmFswqByZXF1ZXN0L3Jlc3BvbnNlwqB3aGVyZcKgdGhlwqBzZXJ2ZXLC oGluZGljYXRlc8KgdGhhdMKgdGhlDQpsaXN0aW5nwqBpc8KgY29tcGxldGU7wqBJwqBiZWxpZXZl wqB3aW4tZXhwbG9yZXLCoGp1c3TCoGdpdmVzwqB1cC4NCg0KTWVhbndoaWxlLMKgYmFja8Kgb27C oEZyZWVCU0QvWkZTwqBJJ23CoHJ1bm5pbmcgYcKgZHRyYWNlwqBzY3JpcHTCoHRoYXTCoHRpbWVz wqB0aGXCoGZvbGxvd2luZw0KWkZTwqBWTk9Qc8KgZm9ywqB0aGXCoGNvbm5lY3RlZMKgU2FtYmHC oHNlcnZlcsKgaW5zdGFuY2U6DQoNCi3CoGZidDp6ZnM6emZzXypleHRhdHRyOmVudHJ5wqBhbmTC oHJldHVybsKgKGdldHxzZXR8ZGVsZXRlfGxpc3QpZXh0YXR0cg0KLcKgZmJ0Onpmczp6ZnNfZnJl ZWJzZF9sb29rdXA6ZW50cnnCoGFuZMKgcmV0dXJuDQotwqBmYnQ6emZzOnpmc19mcmVlYnNkX3Jl YWRkaXI6ZW50cnnCoGFuZMKgcmV0dXJuDQotwqBmYnQ6emZzOnpmc19mcmVlYnNkX2dldGF0dHI6 ZW50cnnCoGFuZMKgcmV0dXJuDQoNClRoaXPCoHN0YXJ0c8Kgb2ZmwqBsb29raW5nwqBsaWtlOg0K IMKgMTLCoMKgMjc3NzfCoMKgwqDCoMKgwqDCoMKgemZzX2ZyZWVic2RfbG9va3VwOnJldHVybsKg emZzX2ZyZWVic2RfbG9va3VwwqA6OsKgMTk5MzENCiDCoDEywqDCoDI3NzY1wqDCoMKgwqDCoMKg wqB6ZnNfZnJlZWJzZF9nZXRhdHRyOnJldHVybsKgemZzX2ZyZWVic2RfZ2V0YXR0csKgOjrCoDM5 NzUNCiDCoDEywqDCoDI3NzY1wqDCoMKgwqDCoMKgwqB6ZnNfZnJlZWJzZF9nZXRhdHRyOnJldHVy bsKgemZzX2ZyZWVic2RfZ2V0YXR0csKgOjrCoDI2NjINCiDCoDEywqDCoDI3NzY1wqDCoMKgwqDC oMKgwqB6ZnNfZnJlZWJzZF9nZXRhdHRyOnJldHVybsKgemZzX2ZyZWVic2RfZ2V0YXR0csKgOjrC oDE3MTENCiDCoDEywqDCoDI3NzY1wqDCoMKgwqDCoMKgwqB6ZnNfZnJlZWJzZF9nZXRhdHRyOnJl dHVybsKgemZzX2ZyZWVic2RfZ2V0YXR0csKgOjrCoDE3NjgNCiDCoDEywqDCoDI3NzY1wqDCoMKg wqDCoMKgwqB6ZnNfZnJlZWJzZF9nZXRhdHRyOnJldHVybsKgemZzX2ZyZWVic2RfZ2V0YXR0csKg OjrCoDE0MTENCiDCoDEywqDCoDI3Nzg3wqDCoMKgwqDCoMKgwqB6ZnNfZnJlZWJzZF9yZWFkZGly OnJldHVybsKgemZzX2ZyZWVic2RfcmVhZGRpcsKgOjrCoDQ0MzI1DQogwqAxMsKgwqAyNzc4N8Kg wqDCoMKgwqDCoMKgemZzX2ZyZWVic2RfcmVhZGRpcjpyZXR1cm7CoHpmc19mcmVlYnNkX3JlYWRk aXLCoDo6wqAzODA1NA0KIMKgMTLCoMKgMjc3ODfCoMKgwqDCoMKgwqDCoHpmc19mcmVlYnNkX3Jl YWRkaXI6cmV0dXJuwqB6ZnNfZnJlZWJzZF9yZWFkZGlywqA6OsKgMzYxMzcNCi4uLg0KLi4uwqBs aW5lwqAxMSw4MDANCiDCoDE2wqDCoDI3NzYzwqDCoMKgwqDCoMKgwqDCoHpmc19mcmVlYnNkX2dl dGFjbDpyZXR1cm7CoHpmc19mcmVlYnNkX2dldGFjbMKgOjrCoDI3MDkNCiDCoDE2wqDCoDI3NzYz wqDCoMKgwqDCoMKgwqDCoHpmc19mcmVlYnNkX2dldGFjbDpyZXR1cm7CoHpmc19mcmVlYnNkX2dl dGFjbMKgOjrCoDIwNDYNCiDCoDE2wqDCoDI3NzY1wqDCoMKgwqDCoMKgwqB6ZnNfZnJlZWJzZF9n ZXRhdHRyOnJldHVybsKgemZzX2ZyZWVic2RfZ2V0YXR0csKgOjrCoDIyMzgNCiDCoDE2wqDCoDI3 NzY1wqDCoMKgwqDCoMKgwqB6ZnNfZnJlZWJzZF9nZXRhdHRyOnJldHVybsKgemZzX2ZyZWVic2Rf Z2V0YXR0csKgOjrCoDE0NTINCiDCoDE2wqDCoDI3NzY1wqDCoMKgwqDCoMKgwqB6ZnNfZnJlZWJz ZF9nZXRhdHRyOnJldHVybsKgemZzX2ZyZWVic2RfZ2V0YXR0csKgOjrCoDE1NzANCiDCoDE2wqDC oDI3NzY1wqDCoMKgwqDCoMKgwqB6ZnNfZnJlZWJzZF9nZXRhdHRyOnJldHVybsKgemZzX2ZyZWVi c2RfZ2V0YXR0csKgOjrCoDE2MDgNCiDCoDE2wqDCoDI3NzY1wqDCoMKgwqDCoMKgwqB6ZnNfZnJl ZWJzZF9nZXRhdHRyOnJldHVybsKgemZzX2ZyZWVic2RfZ2V0YXR0csKgOjrCoDE1NzENCiDCoDE2 wqDCoDI3NzY1wqDCoMKgwqDCoMKgwqB6ZnNfZnJlZWJzZF9nZXRhdHRyOnJldHVybsKgemZzX2Zy ZWVic2RfZ2V0YXR0csKgOjrCoDE0MzENCiDCoDE2wqDCoDI3NzY1wqDCoMKgwqDCoMKgwqB6ZnNf ZnJlZWJzZF9nZXRhdHRyOnJldHVybsKgemZzX2ZyZWVic2RfZ2V0YXR0csKgOjrCoDE0MzENCiDC oDE2wqDCoDI3NzYzwqDCoMKgwqDCoMKgwqDCoHpmc19mcmVlYnNkX2dldGFjbDpyZXR1cm7CoHpm c19mcmVlYnNkX2dldGFjbMKgOjrCoDI4NTYNCiDCoDE2wqDCoDI3NzYzwqDCoMKgwqDCoMKgwqDC oHpmc19mcmVlYnNkX2dldGFjbDpyZXR1cm7CoHpmc19mcmVlYnNkX2dldGFjbMKgOjrCoDE5MDcN CiDCoDE2wqDCoDI3ODA5wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgemZzX2dldGV4dGF0dHI6cmV0 dXJuwqB6ZnNfZ2V0ZXh0YXR0csKgOjrCoDM1MzcNCiDCoDE2wqDCoDI3Nzg3wqDCoMKgwqDCoMKg wqB6ZnNfZnJlZWJzZF9yZWFkZGlyOnJldHVybsKgemZzX2ZyZWVic2RfcmVhZGRpcsKgOjrCoDQ1 MTM1DQogwqAxNsKgwqAyNzc2NcKgwqDCoMKgwqDCoMKgemZzX2ZyZWVic2RfZ2V0YXR0cjpyZXR1 cm7CoHpmc19mcmVlYnNkX2dldGF0dHLCoDo6wqAyNzQ0DQogwqAxNsKgwqAyNzgwOcKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoHpmc19nZXRleHRhdHRyOnJldHVybsKgemZzX2dldGV4dGF0dHLCoDo6 wqAzMjIxDQogwqAxNsKgwqAyNzgxMcKgwqDCoMKgwqDCoMKgwqDCoMKgwqB6ZnNfbGlzdGV4dGF0 dHI6cmV0dXJuwqB6ZnNfbGlzdGV4dGF0dHLCoDo6wqAzNzYyDQogwqAxNsKgwqAyNzc2NcKgwqDC oMKgwqDCoMKgemZzX2ZyZWVic2RfZ2V0YXR0cjpyZXR1cm7CoHpmc19mcmVlYnNkX2dldGF0dHLC oDo6wqAyMDkwDQogwqAxNsKgwqAyNzc2NcKgwqDCoMKgwqDCoMKgemZzX2ZyZWVic2RfZ2V0YXR0 cjpyZXR1cm7CoHpmc19mcmVlYnNkX2dldGF0dHLCoDo6wqAyMjE0DQogwqAxNsKgwqAyNzgwOcKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoHpmc19nZXRleHRhdHRyOnJldHVybsKgemZzX2dldGV4dGF0 dHLCoDo6wqAyMDExMg0KIMKgMTbCoMKgMjc4MDnCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqB6ZnNf Z2V0ZXh0YXR0cjpyZXR1cm7CoHpmc19nZXRleHRhdHRywqA6OsKgMTQ5ODkNCiDCoDE2wqDCoDI3 Nzg3wqDCoMKgwqDCoMKgwqB6ZnNfZnJlZWJzZF9yZWFkZGlyOnJldHVybsKgemZzX2ZyZWVic2Rf cmVhZGRpcsKgOjrCoDM1OTQ2DQogwqAxNsKgwqAyNzgxMcKgwqDCoMKgwqDCoMKgwqDCoMKgwqB6 ZnNfbGlzdGV4dGF0dHI6cmV0dXJuwqB6ZnNfbGlzdGV4dGF0dHLCoDo6wqA0NjkwMA0KIMKgMTbC oMKgMjc3NjXCoMKgwqDCoMKgwqDCoHpmc19mcmVlYnNkX2dldGF0dHI6cmV0dXJuwqB6ZnNfZnJl ZWJzZF9nZXRhdHRywqA6OsKgMjExNQ0KIMKgMTbCoMKgMjc3NjXCoMKgwqDCoMKgwqDCoHpmc19m cmVlYnNkX2dldGF0dHI6cmV0dXJuwqB6ZnNfZnJlZWJzZF9nZXRhdHRywqA6OsKgMTQzOQ0KIMKg MTbCoMKgMjc3NzfCoMKgwqDCoMKgwqDCoMKgemZzX2ZyZWVic2RfbG9va3VwOnJldHVybsKgemZz X2ZyZWVic2RfbG9va3VwwqA6OsKgMjI4ODYNCiDCoDE2wqDCoDI3NzY1wqDCoMKgwqDCoMKgwqB6 ZnNfZnJlZWJzZF9nZXRhdHRyOnJldHVybsKgemZzX2ZyZWVic2RfZ2V0YXR0csKgOjrCoDE0NDkN CiDCoDE2wqDCoDI3ODA5wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgemZzX2dldGV4dGF0dHI6cmV0 dXJuwqB6ZnNfZ2V0ZXh0YXR0csKgOjrCoDQwNDYNCiDCoDE2wqDCoDI3ODExwqDCoMKgwqDCoMKg wqDCoMKgwqDCoHpmc19saXN0ZXh0YXR0cjpyZXR1cm7CoHpmc19saXN0ZXh0YXR0csKgOjrCoDIy MzkNCiDCoDE2wqDCoDI3Nzc3wqDCoMKgwqDCoMKgwqDCoHpmc19mcmVlYnNkX2xvb2t1cDpyZXR1 cm7CoHpmc19mcmVlYnNkX2xvb2t1cMKgOjrCoDE1MTI4DQogwqAxNsKgwqAyNzc2NcKgwqDCoMKg wqDCoMKgemZzX2ZyZWVic2RfZ2V0YXR0cjpyZXR1cm7CoHpmc19mcmVlYnNkX2dldGF0dHLCoDo6 wqAxNjQwDQouLi4NCi4uLsKgbGluZcKgMTc1LDAwMA0KIMKgMTLCoMKgMjc3NzfCoMKgwqDCoMKg wqDCoMKgemZzX2ZyZWVic2RfbG9va3VwOnJldHVybsKgemZzX2ZyZWVic2RfbG9va3VwwqA6OsKg ODU3NjA3MzQNCiDCoDEywqDCoDI3NzY1wqDCoMKgwqDCoMKgwqB6ZnNfZnJlZWJzZF9nZXRhdHRy OnJldHVybsKgemZzX2ZyZWVic2RfZ2V0YXR0csKgOjrCoDM2MTcNCiDCoDEywqDCoDI3ODA5wqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgemZzX2dldGV4dGF0dHI6cmV0dXJuwqB6ZnNfZ2V0ZXh0YXR0 csKgOjrCoDE0MDY0DQogwqAxMsKgwqAyNzgxMcKgwqDCoMKgwqDCoMKgwqDCoMKgwqB6ZnNfbGlz dGV4dGF0dHI6cmV0dXJuwqB6ZnNfbGlzdGV4dGF0dHLCoDo6wqA0MDg4DQogwqAxMsKgwqAyNzc3 N8KgwqDCoMKgwqDCoMKgwqB6ZnNfZnJlZWJzZF9sb29rdXA6cmV0dXJuwqB6ZnNfZnJlZWJzZF9s b29rdXDCoDo6wqA4NTU4NjU0MQ0KIMKgMTLCoMKgMjc3NjXCoMKgwqDCoMKgwqDCoHpmc19mcmVl YnNkX2dldGF0dHI6cmV0dXJuwqB6ZnNfZnJlZWJzZF9nZXRhdHRywqA6OsKgMjk4Mw0KIMKgMTLC oMKgMjc4MDnCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqB6ZnNfZ2V0ZXh0YXR0cjpyZXR1cm7CoHpm c19nZXRleHRhdHRywqA6OsKgMTE0MTYNCiDCoDEywqDCoDI3ODExwqDCoMKgwqDCoMKgwqDCoMKg wqDCoHpmc19saXN0ZXh0YXR0cjpyZXR1cm7CoHpmc19saXN0ZXh0YXR0csKgOjrCoDMyMzANCiDC oDEywqDCoDI3Nzc3wqDCoMKgwqDCoMKgwqDCoHpmc19mcmVlYnNkX2xvb2t1cDpyZXR1cm7CoHpm c19mcmVlYnNkX2xvb2t1cMKgOjrCoDg1NzU4MDI3DQogwqAxMsKgwqAyNzc2NcKgwqDCoMKgwqDC oMKgemZzX2ZyZWVic2RfZ2V0YXR0cjpyZXR1cm7CoHpmc19mcmVlYnNkX2dldGF0dHLCoDo6wqAz MTI0DQouLi4NCi4uLsKgbGluZcKgMTc2LDAwMDANCiDCoMKgMcKgwqAyNzc3N8KgwqDCoMKgwqDC oMKgwqB6ZnNfZnJlZWJzZF9sb29rdXA6cmV0dXJuwqB6ZnNfZnJlZWJzZF9sb29rdXDCoDo6wqAx MTEzMzk3OTAzDQogwqDCoDHCoMKgMjc3NjXCoMKgwqDCoMKgwqDCoHpmc19mcmVlYnNkX2dldGF0 dHI6cmV0dXJuwqB6ZnNfZnJlZWJzZF9nZXRhdHRywqA6OsKgMzE4OQ0KIMKgwqAxwqDCoDI3ODA5 wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgemZzX2dldGV4dGF0dHI6cmV0dXJuwqB6ZnNfZ2V0ZXh0 YXR0csKgOjrCoDY0MjMNCiDCoMKgMcKgwqAyNzgxMcKgwqDCoMKgwqDCoMKgwqDCoMKgwqB6ZnNf bGlzdGV4dGF0dHI6cmV0dXJuwqB6ZnNfbGlzdGV4dGF0dHLCoDo6wqAzMDkwDQogwqDCoDHCoMKg Mjc3NzfCoMKgwqDCoMKgwqDCoMKgemZzX2ZyZWVic2RfbG9va3VwOnJldHVybsKgemZzX2ZyZWVi c2RfbG9va3VwwqA6OsKgMTEwODE4MTc0MA0KIMKgwqAxwqDCoDI3NzY1wqDCoMKgwqDCoMKgwqB6 ZnNfZnJlZWJzZF9nZXRhdHRyOnJldHVybsKgemZzX2ZyZWVic2RfZ2V0YXR0csKgOjrCoDMyNjcN CiDCoMKgMcKgwqAyNzgwOcKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoHpmc19nZXRleHRhdHRyOnJl dHVybsKgemZzX2dldGV4dGF0dHLCoDo6wqA1NDg2DQogwqDCoDHCoMKgMjc4MTHCoMKgwqDCoMKg wqDCoMKgwqDCoMKgemZzX2xpc3RleHRhdHRyOnJldHVybsKgemZzX2xpc3RleHRhdHRywqA6OsKg MzExMQ0KIMKgwqAxwqDCoDI3Nzc3wqDCoMKgwqDCoMKgwqDCoHpmc19mcmVlYnNkX2xvb2t1cDpy ZXR1cm7CoHpmc19mcmVlYnNkX2xvb2t1cMKgOjrCoDEwOTIwNjE3NTYNCiDCoMKgMcKgwqAyNzc2 NcKgwqDCoMKgwqDCoMKgemZzX2ZyZWVic2RfZ2V0YXR0cjpyZXR1cm7CoHpmc19mcmVlYnNkX2dl dGF0dHLCoDo6wqAzMTEzDQogwqDCoDHCoMKgMjc4MDnCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqB6 ZnNfZ2V0ZXh0YXR0cjpyZXR1cm7CoHpmc19nZXRleHRhdHRywqA6OsKgNTY5MQ0KIMKgwqAxwqDC oDI3ODExwqDCoMKgwqDCoMKgwqDCoMKgwqDCoHpmc19saXN0ZXh0YXR0cjpyZXR1cm7CoHpmc19s aXN0ZXh0YXR0csKgOjrCoDMwNzMNCiDCoMKgMcKgwqAyNzc3N8KgwqDCoMKgwqDCoMKgwqB6ZnNf ZnJlZWJzZF9sb29rdXA6cmV0dXJuwqB6ZnNfZnJlZWJzZF9sb29rdXDCoDo6wqAxMTAyMjM2NzU1 DQogwqDCoDHCoMKgMjc3NjXCoMKgwqDCoMKgwqDCoHpmc19mcmVlYnNkX2dldGF0dHI6cmV0dXJu wqB6ZnNfZnJlZWJzZF9nZXRhdHRywqA6OsKgMzQzNQ0KIMKgwqAxwqDCoDI3ODA5wqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgemZzX2dldGV4dGF0dHI6cmV0dXJuwqB6ZnNfZ2V0ZXh0YXR0csKgOjrC oDU4NjINCiDCoMKgMcKgwqAyNzgxMcKgwqDCoMKgwqDCoMKgwqDCoMKgwqB6ZnNfbGlzdGV4dGF0 dHI6cmV0dXJuwqB6ZnNfbGlzdGV4dGF0dHLCoDo6wqAzNzcxDQogwqDCoDHCoMKgMjc3NzfCoMKg wqDCoMKgwqDCoMKgemZzX2ZyZWVic2RfbG9va3VwOnJldHVybsKgemZzX2ZyZWVic2RfbG9va3Vw wqA6OsKgMTEwMTY2ODIzMQ0KIMKgwqAxwqDCoDI3NzY1wqDCoMKgwqDCoMKgwqB6ZnNfZnJlZWJz ZF9nZXRhdHRyOnJldHVybsKgemZzX2ZyZWVic2RfZ2V0YXR0csKgOjrCoDMxODkNCiDCoMKgMcKg wqAyNzgwOcKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoHpmc19nZXRleHRhdHRyOnJldHVybsKgemZz X2dldGV4dGF0dHLCoDo6wqA2NjcxDQogwqAxNcKgwqAyNzgxMcKgwqDCoMKgwqDCoMKgwqDCoMKg wqB6ZnNfbGlzdGV4dGF0dHI6cmV0dXJuwqB6ZnNfbGlzdGV4dGF0dHLCoDo6wqAxMjk1MQ0KIMKg MTXCoMKgMjc3NzfCoMKgwqDCoMKgwqDCoMKgemZzX2ZyZWVic2RfbG9va3VwOnJldHVybsKgemZz X2ZyZWVic2RfbG9va3VwwqA6OsKgMTA2MTY0ODExNw0KIMKgMTXCoMKgMjc3NjXCoMKgwqDCoMKg wqDCoHpmc19mcmVlYnNkX2dldGF0dHI6cmV0dXJuwqB6ZnNfZnJlZWJzZF9nZXRhdHRywqA6OsKg NTM2NQ0KIMKgMTXCoMKgMjc4MDnCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqB6ZnNfZ2V0ZXh0YXR0 cjpyZXR1cm7CoHpmc19nZXRleHRhdHRywqA6OsKgNTczMQ0KIMKgMjHCoMKgMjc4MTHCoMKgwqDC oMKgwqDCoMKgwqDCoMKgemZzX2xpc3RleHRhdHRyOnJldHVybsKgemZzX2xpc3RleHRhdHRywqA6 OsKgODE3OA0KIMKgMjHCoMKgMjc3NzfCoMKgwqDCoMKgwqDCoMKgemZzX2ZyZWVic2RfbG9va3Vw OnJldHVybsKgemZzX2ZyZWVic2RfbG9va3VwwqA6OsKgNjQ0Mjk0MzANCiDCoDIxwqDCoDI3NzY1 wqDCoMKgwqDCoMKgwqB6ZnNfZnJlZWJzZF9nZXRhdHRyOnJldHVybsKgemZzX2ZyZWVic2RfZ2V0 YXR0csKgOjrCoDI5MTINCiDCoDIxwqDCoDI3ODA5wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgemZz X2dldGV4dGF0dHI6cmV0dXJuwqB6ZnNfZ2V0ZXh0YXR0csKgOjrCoDU1NjYNCiDCoDIxwqDCoDI3 ODExwqDCoMKgwqDCoMKgwqDCoMKgwqDCoHpmc19saXN0ZXh0YXR0cjpyZXR1cm7CoHpmc19saXN0 ZXh0YXR0csKgOjrCoDI0NTQNCiDCoDE5wqDCoDI3Nzc3wqDCoMKgwqDCoMKgwqDCoHpmc19mcmVl YnNkX2xvb2t1cDpyZXR1cm7CoHpmc19mcmVlYnNkX2xvb2t1cMKgOjrCoDEwMTcxNzYyMzQNCiDC oDE5wqDCoDI3NzY1wqDCoMKgwqDCoMKgwqB6ZnNfZnJlZWJzZF9nZXRhdHRyOnJldHVybsKgemZz X2ZyZWVic2RfZ2V0YXR0csKgOjrCoDI5NzYNCiDCoDE5wqDCoDI3ODA5wqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgemZzX2dldGV4dGF0dHI6cmV0dXJuwqB6ZnNfZ2V0ZXh0YXR0csKgOjrCoDYyMzAN CiDCoDE5wqDCoDI3ODExwqDCoMKgwqDCoMKgwqDCoMKgwqDCoHpmc19saXN0ZXh0YXR0cjpyZXR1 cm7CoHpmc19saXN0ZXh0YXR0csKgOjrCoDI3MTANCiDCoDE5wqDCoDI3Nzc3wqDCoMKgwqDCoMKg wqDCoHpmc19mcmVlYnNkX2xvb2t1cDpyZXR1cm7CoHpmc19mcmVlYnNkX2xvb2t1cMKgOjrCoDY0 MjExMDE1DQogwqAxOcKgwqAyNzc2NcKgwqDCoMKgwqDCoMKgemZzX2ZyZWVic2RfZ2V0YXR0cjpy ZXR1cm7CoHpmc19mcmVlYnNkX2dldGF0dHLCoDo6wqAxODc2DQogwqAxOcKgwqAyNzgwOcKgwqDC oMKgwqDCoMKgwqDCoMKgwqDCoHpmc19nZXRleHRhdHRyOnJldHVybsKgemZzX2dldGV4dGF0dHLC oDo6wqAzNjkwDQogwqAxOcKgwqAyNzgxMcKgwqDCoMKgwqDCoMKgwqDCoMKgwqB6ZnNfbGlzdGV4 dGF0dHI6cmV0dXJuwqB6ZnNfbGlzdGV4dGF0dHLCoDo6wqAyMjkyDQogwqAxOcKgwqAyNzc3N8Kg wqDCoMKgwqDCoMKgwqB6ZnNfZnJlZWJzZF9sb29rdXA6cmV0dXJuwqB6ZnNfZnJlZWJzZF9sb29r dXDCoDo6wqAxNzAwNw0KIMKgMTnCoMKgMjc3NjXCoMKgwqDCoMKgwqDCoHpmc19mcmVlYnNkX2dl dGF0dHI6cmV0dXJuwqB6ZnNfZnJlZWJzZF9nZXRhdHRywqA6OsKgMTc2Ng0KIMKgMTnCoMKgMjc4 MDnCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqB6ZnNfZ2V0ZXh0YXR0cjpyZXR1cm7CoHpmc19nZXRl eHRhdHRywqA6OsKgMzM1Nw0KIMKgMTnCoMKgMjc4MTHCoMKgwqDCoMKgwqDCoMKgwqDCoMKgemZz X2xpc3RleHRhdHRyOnJldHVybsKgemZzX2xpc3RleHRhdHRywqA6OsKgMjMzMQ0KIMKgMTnCoMKg Mjc3NzfCoMKgwqDCoMKgwqDCoMKgemZzX2ZyZWVic2RfbG9va3VwOnJldHVybsKgemZzX2ZyZWVi c2RfbG9va3VwwqA6OsKgNjM4MTc0MzYNCiDCoDE5wqDCoDI3NzY1wqDCoMKgwqDCoMKgwqB6ZnNf ZnJlZWJzZF9nZXRhdHRyOnJldHVybsKgemZzX2ZyZWVic2RfZ2V0YXR0csKgOjrCoDE4MjcNCiDC oDE5wqDCoDI3ODA5wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgemZzX2dldGV4dGF0dHI6cmV0dXJu wqB6ZnNfZ2V0ZXh0YXR0csKgOjrCoDEyMjMxDQogwqAxMsKgwqAyNzgxMcKgwqDCoMKgwqDCoMKg wqDCoMKgwqB6ZnNfbGlzdGV4dGF0dHI6cmV0dXJuwqB6ZnNfbGlzdGV4dGF0dHLCoDo6wqA4NjU4 DQogwqAxMsKgwqAyNzc3N8KgwqDCoMKgwqDCoMKgwqB6ZnNfZnJlZWJzZF9sb29rdXA6cmV0dXJu wqB6ZnNfZnJlZWJzZF9sb29rdXDCoDo6wqA2NDg1OTcwMg0KIMKgMTLCoMKgMjc3NjXCoMKgwqDC oMKgwqDCoHpmc19mcmVlYnNkX2dldGF0dHI6cmV0dXJuwqB6ZnNfZnJlZWJzZF9nZXRhdHRywqA6 OsKgMzI5Ng0KIMKgMTLCoMKgMjc4MDnCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqB6ZnNfZ2V0ZXh0 YXR0cjpyZXR1cm7CoHpmc19nZXRleHRhdHRywqA6OsKgNjExOA0KIMKgMTLCoMKgMjc4MTHCoMKg wqDCoMKgwqDCoMKgwqDCoMKgemZzX2xpc3RleHRhdHRyOnJldHVybsKgemZzX2xpc3RleHRhdHRy wqA6OsKgMjQ1NA0KIMKgMTLCoMKgMjc3NzfCoMKgwqDCoMKgwqDCoMKgemZzX2ZyZWVic2RfbG9v a3VwOnJldHVybsKgemZzX2ZyZWVic2RfbG9va3VwwqA6OsKgMTc0NDINCiDCoDEywqDCoDI3NzY1 wqDCoMKgwqDCoMKgwqB6ZnNfZnJlZWJzZF9nZXRhdHRyOnJldHVybsKgemZzX2ZyZWVic2RfZ2V0 YXR0csKgOjrCoDE2NzYNCiDCoDEywqDCoDI3ODA5wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgemZz X2dldGV4dGF0dHI6cmV0dXJuwqB6ZnNfZ2V0ZXh0YXR0csKgOjrCoDM2NDkNCiDCoDEywqDCoDI3 ODExwqDCoMKgwqDCoMKgwqDCoMKgwqDCoHpmc19saXN0ZXh0YXR0cjpyZXR1cm7CoHpmc19saXN0 ZXh0YXR0csKgOjrCoDIzNjMNCiDCoMKgMMKgwqAyNzc3N8KgwqDCoMKgwqDCoMKgwqB6ZnNfZnJl ZWJzZF9sb29rdXA6cmV0dXJuwqB6ZnNfZnJlZWJzZF9sb29rdXDCoDo6wqAxMDEzNDcxMTQxDQog wqDCoDDCoMKgMjc3NjXCoMKgwqDCoMKgwqDCoHpmc19mcmVlYnNkX2dldGF0dHI6cmV0dXJuwqB6 ZnNfZnJlZWJzZF9nZXRhdHRywqA6OsKgNTk5NQ0KIMKgwqAwwqDCoDI3ODA5wqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgemZzX2dldGV4dGF0dHI6cmV0dXJuwqB6ZnNfZ2V0ZXh0YXR0csKgOjrCoDky ODANCiDCoMKgMMKgwqAyNzgxMcKgwqDCoMKgwqDCoMKgwqDCoMKgwqB6ZnNfbGlzdGV4dGF0dHI6 cmV0dXJuwqB6ZnNfbGlzdGV4dGF0dHLCoDo6wqAzMjE5DQogwqDCoDDCoMKgMjc3NzfCoMKgwqDC oMKgwqDCoMKgemZzX2ZyZWVic2RfbG9va3VwOnJldHVybsKgemZzX2ZyZWVic2RfbG9va3VwwqA6 OsKgNjQyODYxOTYNCiDCoMKgMMKgwqAyNzc2NcKgwqDCoMKgwqDCoMKgemZzX2ZyZWVic2RfZ2V0 YXR0cjpyZXR1cm7CoHpmc19mcmVlYnNkX2dldGF0dHLCoDo6wqA1NjE4DQogwqDCoDDCoMKgMjc4 MDnCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqB6ZnNfZ2V0ZXh0YXR0cjpyZXR1cm7CoHpmc19nZXRl eHRhdHRywqA6OsKgODkxOQ0KIMKgwqAwwqDCoDI3ODExwqDCoMKgwqDCoMKgwqDCoMKgwqDCoHpm c19saXN0ZXh0YXR0cjpyZXR1cm7CoHpmc19saXN0ZXh0YXR0csKgOjrCoDMxMTcNCiDCoDEzwqDC oDI3Nzc3wqDCoMKgwqDCoMKgwqDCoHpmc19mcmVlYnNkX2xvb2t1cDpyZXR1cm7CoHpmc19mcmVl YnNkX2xvb2t1cMKgOjrCoDk5OTQzMTk1Mw0KIMKgMTPCoMKgMjc3NzfCoMKgwqDCoMKgwqDCoMKg emZzX2ZyZWVic2RfbG9va3VwOnJldHVybsKgemZzX2ZyZWVic2RfbG9va3VwwqA6OsKgMTA2MjMy MjgwOA0KIMKgwqA5wqDCoDI3Nzc3wqDCoMKgwqDCoMKgwqDCoHpmc19mcmVlYnNkX2xvb2t1cDpy ZXR1cm7CoHpmc19mcmVlYnNkX2xvb2t1cMKgOjrCoDEwNjE4ODU1NzgNCiDCoMKgOcKgwqAyNzc3 N8KgwqDCoMKgwqDCoMKgwqB6ZnNfZnJlZWJzZF9sb29rdXA6cmV0dXJuwqB6ZnNfZnJlZWJzZF9s b29rdXDCoDo6wqAxMTI4Mw0KDQpBdMKgdGhpc8KgcG9pbnTCoHRoZcKgY2xpZW50wqBjbG9zZXPC oHRoZcKgY29ubmVjdGlvbsKgYW5kwqB0aGXCoGNvbm5lY3RlZCzCoHNhbWJhwqBzZXJ2ZXLCoHBy b2Nlc3PCoGV4aXRzLg0KDQpBZnRlcsKgaW5jcmVhc2luZ8KgdGhlwqB2bm9kZXPCoHRvwqAyTSzC oHRoZcKgd2lyZcKgdHJhbnNmZXLCoG9mwqB0aGXCoGRpcmVjdG95wqBsaXN0aW5nwqBjb21wbGV0 ZXMNCmluwqBhYm91dMKgNjDCoHNlY29uZHMgd2l0aCB0aGUgZmluYWwgIm5vIG1vcmUgZmlsZXMi IHJlc3BvbnNlIHN0YXR1cyBvYnNlcnZlZCwNCmFuZMKgd2luLWV4cGxvcmVywqBjb2dpdGF0ZXPC oG9uwqB0aGXCoGRhdGHCoGZvcsKgYWJvdXTCoGFub3RoZXLCoDLCoG1pbnV0ZXMNCmJlZm9yZcKg Y29udHJvbMKgaXPCoHJldHVybmVkwqB0b8Kgd2luLWV4cGxvcmVyLg0KDQpUaGFua3MgZm9yIGFu eSBmZWVkIGJhY2suDQoNCi0tIA0KRGF2ZSBCYXVrdXMNCg== From owner-freebsd-fs@freebsd.org Thu Mar 29 03:25:25 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 66DBBF6E10E for ; Thu, 29 Mar 2018 03:25:25 +0000 (UTC) (envelope-from cse.cem@gmail.com) Received: from mail-io0-f175.google.com (mail-io0-f175.google.com [209.85.223.175]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 012AE75F40 for ; Thu, 29 Mar 2018 03:25:24 +0000 (UTC) (envelope-from cse.cem@gmail.com) Received: by mail-io0-f175.google.com with SMTP id y128so5981396iod.4 for ; Wed, 28 Mar 2018 20:25:24 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:reply-to:in-reply-to:references :from:date:message-id:subject:to:cc; bh=30bbxUkQCIbm/r69Td+ZZsE/RzzgiStFd6SkANbRPcQ=; b=DOTkvYFlcWDGMJizxBTmWSOYGefsgopREH9OVeJNK9okraZeNz9ThRVSxqXaXQmUsJ j/UJ8rolTy6ThDh4WHtk5RP8a6PjV6cn+OAQgX2x5/+54LP7uxlg7DswBQSW90McDJ3t INj7/nTQS98yytOvc7HtCfOQHLDznkpfpM8wpt4dWdqSvggtKtK5NDBeFrTbKmtza84K dlfELr198LeNPX5I4qPhzGxtrRTRut3bfLb6drv2MFFMlE+pLBe9tPevvrHMkV+CcNnz ZoxIi95ZJOyIC6vFD9OYXiqeA4r7YYG0nZobs0JFC/vWQ3XqhOkjbBnwjR76rbl6ECP+ buLA== X-Gm-Message-State: AElRT7HCTvDYow93HCx0WoYPbqs1PVSGhXOpFtdA6gsVRkv5Q3T2eZwu jRoqCLC6gVZcR2FGSc0AltgP0zZ9 X-Google-Smtp-Source: AG47ELtvBP/XpTakIE96MnDERzDSB6ASS/bRkj7XmVdFhnkgIERKNwFLt8ca7O1JEiIyrSZrgaK71w== X-Received: by 10.107.168.78 with SMTP id r75mr50528097ioe.143.1522290914119; Wed, 28 Mar 2018 19:35:14 -0700 (PDT) Received: from mail-it0-f48.google.com (mail-it0-f48.google.com. [209.85.214.48]) by smtp.gmail.com with ESMTPSA id k199-v6sm477121itb.35.2018.03.28.19.35.13 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 28 Mar 2018 19:35:13 -0700 (PDT) Received: by mail-it0-f48.google.com with SMTP id e98-v6so6059062itd.4 for ; Wed, 28 Mar 2018 19:35:13 -0700 (PDT) X-Received: by 2002:a24:c101:: with SMTP id e1-v6mr5887820itg.46.1522290913346; Wed, 28 Mar 2018 19:35:13 -0700 (PDT) MIME-Version: 1.0 Reply-To: cem@freebsd.org Received: by 10.2.62.19 with HTTP; Wed, 28 Mar 2018 19:35:12 -0700 (PDT) In-Reply-To: <67aadb01-70c2-0454-2e3f-74bed67fb330@spectralogic.com> References: <67aadb01-70c2-0454-2e3f-74bed67fb330@spectralogic.com> From: Conrad Meyer Date: Wed, 28 Mar 2018 19:35:12 -0700 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: ZFS, Vnode cache, and poor directory listing performance via Samba To: Dave Baukus Cc: "freebsd-fs@freebsd.org" Content-Type: text/plain; charset="UTF-8" X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Mar 2018 03:25:25 -0000 Hi Dave, Full scans are the worst case for an LRU cache. In particular, you are full-scanning an *extremely* large directory, which evicts your entire vnode cache. Then you suffer the (presumably) entirely serialized penalty of refetching every single inode from disk again after the first scan. Here are some solutions in order of preference: 1. Organize your files better. 1 million in a single directory is absurd. Can windows explorer meaningfully navigate a 1mil file directory? I doubt it. 2. Continue to bump maxvnodes to compensate for poor file organization + naive clients doing full scans. 3. Enhance samba to signal something like DONTNEED on "SMB2_FIND_ID_BOTH_DIRECTORY_INFO Pattern: *" requests to the OS. 3.a. Enhance samba to parallelize or otherwise asynchronously process the above requests on huge directories (improve the uncached case). I don't think this has much to do with ZFS, other than that ZFS performance on your hardware appears to be quite bad without the VFS cache sitting in front to absorb most of the requests. Best, Conrad On Wed, Mar 28, 2018 at 7:07 PM, Dave Baukus wrote: > Below is narrative angst and woe for which I have the the following observations/questions: > > - Increasing kern.maxvnodes from 600,000 to 2,000,000 apparently solves the "problem" > - This decreases the number of lookups in the scenario below from 40719 (some of which take over a second) to 4 > - 2,000,00 may be extreme, but I was hoping for an authoritative comment on why/how this improves the scenario and > then perhaps I can come up with some reasonable tuning options. > - is this an artifact of the Freebsd 11-ish refactoring of the ZFS/Freebsd VNOP interface (?) > > ----------------------------------------------------- > I have the following scenario on FreeBSD Stable 11.0: > > A ZFS with a directory containing 1,000,000 files; the root of this ZFS is > exported via SAMBA using NFSv4 ACL plugin and DOS attributes with the (extattr) implementation. > > A local full listing of this directory (ls -l > /dev/null) completes in about 40 seconds. > A full listing from a Samba client (ls -l) completes in about 3 minutes. > > Using windows explorer from a Win2008 client is where the strangeness begins; it > takes between 8 to 12 minutes before control is returned to win-explorer. > > Tracing this with wireshark I noticed that "SMB2_FIND_ID_BOTH_DIRECTORY_INFO Pattern: *" > requests from the Win2008 client start off functioning well (client requests > 64k of data and samba responds with 64k of directory data). After about 150 seconds of this > interaction the client makes a "SMB2_FIND_ID_BOTH_DIRECTORY_INFO Pattern: *" request that is not > responded to for over 60 seconds. The windows client closes the connection, starts a new > connection, and begins directory listing from ground zero. This pattern continues for > 6 to 10 minutes; I never see final request/response where the server indicates that the > listing is complete; I believe win-explorer just gives up. > > Meanwhile, back on FreeBSD/ZFS I'm running a dtrace script that times the following > ZFS VNOPs for the connected Samba server instance: > > - fbt:zfs:zfs_*extattr:entry and return (get|set|delete|list)extattr > - fbt:zfs:zfs_freebsd_lookup:entry and return > - fbt:zfs:zfs_freebsd_readdir:entry and return > - fbt:zfs:zfs_freebsd_getattr:entry and return > > This starts off looking like: > 12 27777 zfs_freebsd_lookup:return zfs_freebsd_lookup :: 19931 > 12 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 3975 > 12 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 2662 > 12 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 1711 > 12 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 1768 > 12 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 1411 > 12 27787 zfs_freebsd_readdir:return zfs_freebsd_readdir :: 44325 > 12 27787 zfs_freebsd_readdir:return zfs_freebsd_readdir :: 38054 > 12 27787 zfs_freebsd_readdir:return zfs_freebsd_readdir :: 36137 > ... > ... line 11,800 > 16 27763 zfs_freebsd_getacl:return zfs_freebsd_getacl :: 2709 > 16 27763 zfs_freebsd_getacl:return zfs_freebsd_getacl :: 2046 > 16 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 2238 > 16 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 1452 > 16 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 1570 > 16 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 1608 > 16 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 1571 > 16 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 1431 > 16 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 1431 > 16 27763 zfs_freebsd_getacl:return zfs_freebsd_getacl :: 2856 > 16 27763 zfs_freebsd_getacl:return zfs_freebsd_getacl :: 1907 > 16 27809 zfs_getextattr:return zfs_getextattr :: 3537 > 16 27787 zfs_freebsd_readdir:return zfs_freebsd_readdir :: 45135 > 16 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 2744 > 16 27809 zfs_getextattr:return zfs_getextattr :: 3221 > 16 27811 zfs_listextattr:return zfs_listextattr :: 3762 > 16 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 2090 > 16 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 2214 > 16 27809 zfs_getextattr:return zfs_getextattr :: 20112 > 16 27809 zfs_getextattr:return zfs_getextattr :: 14989 > 16 27787 zfs_freebsd_readdir:return zfs_freebsd_readdir :: 35946 > 16 27811 zfs_listextattr:return zfs_listextattr :: 46900 > 16 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 2115 > 16 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 1439 > 16 27777 zfs_freebsd_lookup:return zfs_freebsd_lookup :: 22886 > 16 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 1449 > 16 27809 zfs_getextattr:return zfs_getextattr :: 4046 > 16 27811 zfs_listextattr:return zfs_listextattr :: 2239 > 16 27777 zfs_freebsd_lookup:return zfs_freebsd_lookup :: 15128 > 16 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 1640 > ... > ... line 175,000 > 12 27777 zfs_freebsd_lookup:return zfs_freebsd_lookup :: 85760734 > 12 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 3617 > 12 27809 zfs_getextattr:return zfs_getextattr :: 14064 > 12 27811 zfs_listextattr:return zfs_listextattr :: 4088 > 12 27777 zfs_freebsd_lookup:return zfs_freebsd_lookup :: 85586541 > 12 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 2983 > 12 27809 zfs_getextattr:return zfs_getextattr :: 11416 > 12 27811 zfs_listextattr:return zfs_listextattr :: 3230 > 12 27777 zfs_freebsd_lookup:return zfs_freebsd_lookup :: 85758027 > 12 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 3124 > ... > ... line 176,0000 > 1 27777 zfs_freebsd_lookup:return zfs_freebsd_lookup :: 1113397903 > 1 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 3189 > 1 27809 zfs_getextattr:return zfs_getextattr :: 6423 > 1 27811 zfs_listextattr:return zfs_listextattr :: 3090 > 1 27777 zfs_freebsd_lookup:return zfs_freebsd_lookup :: 1108181740 > 1 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 3267 > 1 27809 zfs_getextattr:return zfs_getextattr :: 5486 > 1 27811 zfs_listextattr:return zfs_listextattr :: 3111 > 1 27777 zfs_freebsd_lookup:return zfs_freebsd_lookup :: 1092061756 > 1 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 3113 > 1 27809 zfs_getextattr:return zfs_getextattr :: 5691 > 1 27811 zfs_listextattr:return zfs_listextattr :: 3073 > 1 27777 zfs_freebsd_lookup:return zfs_freebsd_lookup :: 1102236755 > 1 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 3435 > 1 27809 zfs_getextattr:return zfs_getextattr :: 5862 > 1 27811 zfs_listextattr:return zfs_listextattr :: 3771 > 1 27777 zfs_freebsd_lookup:return zfs_freebsd_lookup :: 1101668231 > 1 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 3189 > 1 27809 zfs_getextattr:return zfs_getextattr :: 6671 > 15 27811 zfs_listextattr:return zfs_listextattr :: 12951 > 15 27777 zfs_freebsd_lookup:return zfs_freebsd_lookup :: 1061648117 > 15 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 5365 > 15 27809 zfs_getextattr:return zfs_getextattr :: 5731 > 21 27811 zfs_listextattr:return zfs_listextattr :: 8178 > 21 27777 zfs_freebsd_lookup:return zfs_freebsd_lookup :: 64429430 > 21 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 2912 > 21 27809 zfs_getextattr:return zfs_getextattr :: 5566 > 21 27811 zfs_listextattr:return zfs_listextattr :: 2454 > 19 27777 zfs_freebsd_lookup:return zfs_freebsd_lookup :: 1017176234 > 19 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 2976 > 19 27809 zfs_getextattr:return zfs_getextattr :: 6230 > 19 27811 zfs_listextattr:return zfs_listextattr :: 2710 > 19 27777 zfs_freebsd_lookup:return zfs_freebsd_lookup :: 64211015 > 19 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 1876 > 19 27809 zfs_getextattr:return zfs_getextattr :: 3690 > 19 27811 zfs_listextattr:return zfs_listextattr :: 2292 > 19 27777 zfs_freebsd_lookup:return zfs_freebsd_lookup :: 17007 > 19 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 1766 > 19 27809 zfs_getextattr:return zfs_getextattr :: 3357 > 19 27811 zfs_listextattr:return zfs_listextattr :: 2331 > 19 27777 zfs_freebsd_lookup:return zfs_freebsd_lookup :: 63817436 > 19 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 1827 > 19 27809 zfs_getextattr:return zfs_getextattr :: 12231 > 12 27811 zfs_listextattr:return zfs_listextattr :: 8658 > 12 27777 zfs_freebsd_lookup:return zfs_freebsd_lookup :: 64859702 > 12 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 3296 > 12 27809 zfs_getextattr:return zfs_getextattr :: 6118 > 12 27811 zfs_listextattr:return zfs_listextattr :: 2454 > 12 27777 zfs_freebsd_lookup:return zfs_freebsd_lookup :: 17442 > 12 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 1676 > 12 27809 zfs_getextattr:return zfs_getextattr :: 3649 > 12 27811 zfs_listextattr:return zfs_listextattr :: 2363 > 0 27777 zfs_freebsd_lookup:return zfs_freebsd_lookup :: 1013471141 > 0 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 5995 > 0 27809 zfs_getextattr:return zfs_getextattr :: 9280 > 0 27811 zfs_listextattr:return zfs_listextattr :: 3219 > 0 27777 zfs_freebsd_lookup:return zfs_freebsd_lookup :: 64286196 > 0 27765 zfs_freebsd_getattr:return zfs_freebsd_getattr :: 5618 > 0 27809 zfs_getextattr:return zfs_getextattr :: 8919 > 0 27811 zfs_listextattr:return zfs_listextattr :: 3117 > 13 27777 zfs_freebsd_lookup:return zfs_freebsd_lookup :: 999431953 > 13 27777 zfs_freebsd_lookup:return zfs_freebsd_lookup :: 1062322808 > 9 27777 zfs_freebsd_lookup:return zfs_freebsd_lookup :: 1061885578 > 9 27777 zfs_freebsd_lookup:return zfs_freebsd_lookup :: 11283 > > At this point the client closes the connection and the connected, samba server process exits. > > After increasing the vnodes to 2M, the wire transfer of the directoy listing completes > in about 60 seconds with the final "no more files" response status observed, > and win-explorer cogitates on the data for about another 2 minutes > before control is returned to win-explorer. > > Thanks for any feed back. > > -- > Dave Baukus > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" From owner-freebsd-fs@freebsd.org Thu Mar 29 12:46:21 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 81067F73357 for ; Thu, 29 Mar 2018 12:46:21 +0000 (UTC) (envelope-from chuck@tuffli.net) Received: from mail-it0-x22a.google.com (mail-it0-x22a.google.com [IPv6:2607:f8b0:4001:c0b::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1C1956BC71 for ; Thu, 29 Mar 2018 12:46:20 +0000 (UTC) (envelope-from chuck@tuffli.net) Received: by mail-it0-x22a.google.com with SMTP id j137-v6so8038590ita.1 for ; Thu, 29 Mar 2018 05:46:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=tuffli-net.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=Yd4tAkwHhfxMAOsDBV+R2LmxU/H5sqWFUZJ+otehEvA=; b=s/UenwvZmXdq/WGJQFqk2fHmE8qEgVkq4NJWgLyx1MGpIY4+2npvrcsGtFi1/0Hn7x tDrP/9op4E+AIyiGgcvAJFs2F13iaUQNtwMe9rUY+SNRGA/xUQjOlATkwmMhxUJACgJS 1dBdcgMilr3tbwFEkSQBKm5VoRyLTewPudBzxkPAmE7SfHxsXpwX75zEhp0wqPtgBPOw 3xkf2RZxxxFWE9yl7NhPvZr1Onqmfo1ruIIJkLKjRRb+D7Nv4lHmaH2spwnATBKC82Qs NWW1/OPcGetcVnHs2dApP9/IZR0yf7clOxgX/8VAAkTjqxgDDnD8yRPnbLNMxrt+Q1o3 8eoA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=Yd4tAkwHhfxMAOsDBV+R2LmxU/H5sqWFUZJ+otehEvA=; b=fH+28Y2FXMkwIB2InZnQPDAbflY5riTnWBIZNngMQn2bOubC3zFbvAXquu5zks+5S3 2HDW7gE+RFBQUUaHqASoDohG9F0L3sURUHZFuxNoPbQJ2eDLGAey2ftLYlJK1c4YtH6s Ykeh95tUZncK03GWq/H9ele7bCjtCXuU8p9v1P7nFdJBlnKZ7OOwJMfa++WTqHgJkZ1W P61jymxIJaKNFKiKOj7A106Fpk+cQG7ZCkZwCojZtIAs8J0/PypTM++BPjObRROVyUJ2 QC8VmJ/YtxW3Af/tZCNIcHF91hcSJUOZ3wKhbVdb4VSz0FeOQ5oLWjUaw+hfj75rchha F6WA== X-Gm-Message-State: AElRT7ERIAVZGyI5BmEhVEIjsoNu9wy5sCa6Xk+IdWehI5RHIhKLcbAz WIAU/q1uEzM+OCk/XhSHyWnUI7j6Q4wGXDWDcdPwYAUUgjI= X-Google-Smtp-Source: AIpwx4/B2QwVSoiy3Va+DUEH6aAvadL8r52KWxfulJLcNDWHH+IL9BpI0p/0NzUx2CEjMxvrr0BlXsXIYfRreV48T6E= X-Received: by 2002:a24:7d14:: with SMTP id b20-v6mr7805084itc.82.1522327580223; Thu, 29 Mar 2018 05:46:20 -0700 (PDT) MIME-Version: 1.0 Received: by 10.2.6.10 with HTTP; Thu, 29 Mar 2018 05:46:19 -0700 (PDT) In-Reply-To: References: <4754cb2f-76bb-a69b-0cf5-eff4d621eb29@callfortesting.org> <1d3f2cef-4c37-782e-7938-e0a2eebc8842@quip.cz> From: Chuck Tuffli Date: Thu, 29 Mar 2018 05:46:19 -0700 Message-ID: Subject: Re: smart(8) Call for Testing To: Charles Sprickman Cc: Miroslav Lachman <000.fbsd@quip.cz>, Mark Saad , FreeBSD File-Systems Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Mar 2018 12:46:21 -0000 On Tue, Mar 27, 2018 at 10:01 AM, Charles Sprickman wrote: ... > I have to agree - this is kind of a prior-century tool as far as user > friendliness it seems. > > What is the goal of this tool? The main use for smartmontools seems to b= e > to pluck information about the drive and act on some very specific items > (for example, polling the =E2=80=9Cmedia wearout indicator=E2=80=9D on SS= Ds is very useful, > or read error rates on HDs. But the smartmontools folks seem to spend a > fair amount of time with putting drive data in their tool so that meaning= ful > data is presented to the user. Without that level of functionality out o= f > the box, what=E2=80=99s the argument for this being in base vs. being a 3= rd party > tool that lives in the ports tree? Think of the people that answer maili= ng > list and forum questions when considering adding something like this to > base=E2=80=A6 > > Again, maybe I=E2=80=99m just missing something or maybe this is here for= a > particular vendor that needs it or something. After watching Michael's talk on diskctl and knowing a bit about the differences between NVMe and ATA SMART data, I was curious how something like the libsmart proposed in the talk could possibly work. This tool was initially a test bed for those experiments, but it's been cleaned up a bit and enhanced based on Michael's feedback. The application works with the limited number of drive types we have, and the hope was both to see how it fared on other folks drives as well as get some feedback. This work wasn't done for any particular vendor. The only hope was to address a need voiced by someone in the *BSD community. Namely, providing SMART values to other scripts and or applications. As far as adding this to base, if the collective 'you' want it, awesome. If it doesn't make sense, that's OK too. --chuck From owner-freebsd-fs@freebsd.org Thu Mar 29 13:27:53 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BB1C2F7641B for ; Thu, 29 Mar 2018 13:27:53 +0000 (UTC) (envelope-from chuck@tuffli.net) Received: from mail-it0-x22d.google.com (mail-it0-x22d.google.com [IPv6:2607:f8b0:4001:c0b::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 42CC06DF41 for ; Thu, 29 Mar 2018 13:27:53 +0000 (UTC) (envelope-from chuck@tuffli.net) Received: by mail-it0-x22d.google.com with SMTP id m134-v6so8174205itb.3 for ; Thu, 29 Mar 2018 06:27:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=tuffli-net.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=4c2csGjDJecCEmEuQW3F6RBAN5CLKOwHD1bUKHuDlqI=; b=Ev0/T28tDFgnRiHuehUuMswjtuTHoL2UdQ8tvbSNTSmYEeVSuW8NMdkWTJUjqL4jS2 2FgA5GIus37hSvgjrcATQj+AGUlncOcqTSxmUNf8oFgqjwA3p5iQ2zwp3rEtSg6bT139 /divFFsw/hX6SX+MXi1X0FPE1Qm6Ze8Yw8eF+wcP51f5H33nXvYXWl1soXrTw4ip9Ei9 zuTnUjLbUB5lR38IA54J14DV7OBKHLBWqftqPdE98YvKoExo72JY9w/a+CEjoFPmmlai yHmMM7dtxXP9nDzcBtfJDa6wnFst67Tqg8qfGwYpNuhksd/3T9jFeGI+TNgNuZlYXvQ4 NXjg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=4c2csGjDJecCEmEuQW3F6RBAN5CLKOwHD1bUKHuDlqI=; b=HnM6PTQzoqNyU/Y0cnNDKEuNhG8eYlm4iYb9b+Ny0pbscjUGvywu2owbPkmFL2hEbH aWoO0kGulKo9UKCIz0m7YxgmIdVYDoK0z+BeOXFkJ4bMqA1mW18xXT7GAusOCdZPmzA9 QrzbEXx5J1QuNAANLfqABhMsL+Tif1+zTcLFJafrD78yBZL29Eb9A4DRrZxy5EWjveCZ SbV4GSt3G5YI576UKuklS+QlZpdIcsNBpFSsmhFvy5/K9j8NAYtrEMCFLLBzxp1gYV7Z PmzjPnt/i8yS53qZt5L3v9n4ywAnyEhO2p/pvnX4o4WLHWKpkw4lTooR9oFPhFMyxGpo E3JQ== X-Gm-Message-State: AElRT7H1Fq6Okv4qis76tS5iBvYpT8YcXSXvzxcO5M9WDTNQQNHlwaOx hQaaXWGicU6pRzsUAr4O1THAKE6MAAiX4b5g8a/RxA== X-Google-Smtp-Source: AIpwx4+3FRUJWAtaYDhMS2h08bERj2N9iuWTqL/04hYasW1cNpsrnhGIaamoaDirDTkV2E4dju45QF404l489LYxdew= X-Received: by 2002:a24:33c3:: with SMTP id k186-v6mr8022476itk.5.1522330072514; Thu, 29 Mar 2018 06:27:52 -0700 (PDT) MIME-Version: 1.0 Received: by 10.2.6.10 with HTTP; Thu, 29 Mar 2018 06:27:52 -0700 (PDT) In-Reply-To: References: <4754cb2f-76bb-a69b-0cf5-eff4d621eb29@callfortesting.org> <1d3f2cef-4c37-782e-7938-e0a2eebc8842@quip.cz> <7ED27465-1BC2-4522-873E-9ECE192EB7A2@ultra-secure.de> From: Chuck Tuffli Date: Thu, 29 Mar 2018 06:27:52 -0700 Message-ID: Subject: Re: smart(8) Call for Testing To: lev@freebsd.org Cc: Rainer Duffner , Charles Sprickman , Tom Evans via freebsd-fs Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Mar 2018 13:27:54 -0000 On Wed, Mar 28, 2018 at 11:14 AM, Lev Serebryakov wrote: > On 27.03.2018 22:13, Rainer Duffner wrote: > >> Maybe one of the vendors who sells FreeBSD as part of an appliance has s= hown some interest in this? >> >> If you=E2=80=99re hardware is well-defined and thus the output is consis= tent, I could imagine it=E2=80=99s not too difficult to parse this. > smartd is very important part of smartmontools, smartctl is not so. > > And periodic self-test triggering & check is most important feature of > smartd, IMHO. > > Modern HDDs are liers in SMART. And only regular self-test discover > real errors on surfaces in my experience. > > So, tool without support for HDD self-tests is of little usage for > appliances, IMHO. Thank you for the feedback! As I don't have any experience with smartd, can you help me better understand which parts of it are most useful to you? Is it just periodically triggering the self test or are there other features as well? For example, logging the SMART values, emailing / triggering notifications when certain criteria are met, monitoring the self tests, reading the error logs, etc.? --chuck From owner-freebsd-fs@freebsd.org Thu Mar 29 13:40:21 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E1F2EF770EA for ; Thu, 29 Mar 2018 13:40:20 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: from mail-wr0-x235.google.com (mail-wr0-x235.google.com [IPv6:2a00:1450:400c:c0c::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 52C9B6E6C3; Thu, 29 Mar 2018 13:40:20 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: by mail-wr0-x235.google.com with SMTP id l49so5461181wrl.4; Thu, 29 Mar 2018 06:40:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=BVQwSp7Uop+wYA00Q2eX6iXtyUtc8upix7cmLxeaSMI=; b=hNwLI1H7Yf43/BFq/WRpkNdwTJZTx0JSGDBfDZpe7pZl1xxpoaQY29+Lu5WmU8elcC 3C17RLZYRxglk3YVMsMbUfVQZB1dARmAZJz6YvJOm9ddd48vj9qKWecDpRBZKtpaULqI N+s1s1YL663pEZh+aYcAJ6N/ecHWleibUahupgfXsw1kAr+9xsU4aV1QohgbbhX55CYC eXTsX+qgcnZSVvZx7BXK5Cu1WLHI2rVYfarm4gjeybzjVVtNe9p8htkJWQmEfccZ++9C PdlqKrO19OCvBzm89en6FLPXDxR062Vp+/UGvMYNpDRVECwBtW0bPXlr4Ni8FyCBUJAA XjfA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=BVQwSp7Uop+wYA00Q2eX6iXtyUtc8upix7cmLxeaSMI=; b=UMxOqxhjrQe60OEDvXFA/eYqUjwl38gIplClRxxBe6gnp6xeJ3FTV5td6i/T6n7Ite 8OXNfs8bTeS6TW9GQCw60AfAOolt1h/R7m3jp5aBVF4eHcSYcSI/xuljEu0FVpBrptP2 g5kJZXkqUpR1YmW9thbd34aaswUxcCIn7eCONPM1fol55AaVU/KXAJWgUpuHsL8ZGqDC dLK/Hmq04gxMM9c69pjP6/xyP7bTVm8xC+0aeDotiME4zlImU15Yi0dKY/7BeoyPW4Lf 13J6aJ0YCZ4JDLf0dA3jQX/jH3dKfld+eq1+XJ01pV0WMBE6SbnNQRcbd8W6EpqAI/pD UVUw== X-Gm-Message-State: AElRT7FzHS8rGAWgUwKzAWN1UMPx0tU76nTH8XTywkgLq4eAQDisCAEB rTZwcitn2v8Y7pXcNWRJLzvaJ4ac X-Google-Smtp-Source: AIpwx49Z67B6oHRWpFqK6kPcj2XFt6a+bnvrHt3YpqbCHyZ6ckcOQyK0fGVJ0gL75+NFLbmnCy84+Q== X-Received: by 10.223.143.7 with SMTP id p7mr6295036wrb.207.1522330819335; Thu, 29 Mar 2018 06:40:19 -0700 (PDT) Received: from bens-mac.home (LFbn-NIC-1-211-113.w2-15.abo.wanadoo.fr. [2.15.58.113]) by smtp.gmail.com with ESMTPSA id 43sm7296883wru.40.2018.03.29.06.40.18 (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Thu, 29 Mar 2018 06:40:18 -0700 (PDT) Content-Type: text/plain; charset=utf-8; delsp=yes; format=flowed Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Subject: Re: smart(8) Call for Testing From: Ben RUBSON In-Reply-To: Date: Thu, 29 Mar 2018 15:40:16 +0200 Cc: lev@freebsd.org, Tom Evans via freebsd-fs Content-Transfer-Encoding: 8bit Message-Id: <05EE6839-C5A1-4AF9-A4DC-D01210F715C1@gmail.com> References: <4754cb2f-76bb-a69b-0cf5-eff4d621eb29@callfortesting.org> <1d3f2cef-4c37-782e-7938-e0a2eebc8842@quip.cz> <7ED27465-1BC2-4522-873E-9ECE192EB7A2@ultra-secure.de> To: Chuck Tuffli X-Mailer: Apple Mail (2.3124) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Mar 2018 13:40:21 -0000 On 29 Mar 2018 15:27, Chuck Tuffli wrote: > On Wed, Mar 28, 2018 at 11:14 AM, Lev Serebryakov wrote: >> On 27.03.2018 22:13, Rainer Duffner wrote: >> >>> Maybe one of the vendors who sells FreeBSD as part of an appliance has >>> shown some interest in this? >>> >>> If you’re hardware is well-defined and thus the output is consistent, I >>> could imagine it’s not too difficult to parse this. >> smartd is very important part of smartmontools, smartctl is not so. >> >> And periodic self-test triggering & check is most important feature of >> smartd, IMHO. >> >> Modern HDDs are liers in SMART. And only regular self-test discover >> real errors on surfaces in my experience. >> >> So, tool without support for HDD self-tests is of little usage for >> appliances, IMHO. > > Thank you for the feedback! As I don't have any experience with > smartd, can you help me better understand which parts of it are most > useful to you? Is it just periodically triggering the self test or > are there other features as well? For example, logging the SMART > values, emailing / triggering notifications when certain criteria are > met, monitoring the self tests, reading the error logs, etc.? This is actually the job of smartd : scheduling / testing / monitoring / alerting :) Ben From owner-freebsd-fs@freebsd.org Thu Mar 29 13:43:36 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8D39EF7754F for ; Thu, 29 Mar 2018 13:43:36 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [IPv6:2a01:4f8:201:6350::2]) by mx1.freebsd.org (Postfix) with ESMTP id 2D56A6EADE for ; Thu, 29 Mar 2018 13:43:36 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from [192.168.23.186] (unknown [89.113.128.32]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id 37E54FAB; Thu, 29 Mar 2018 16:43:29 +0300 (MSK) Reply-To: lev@FreeBSD.org Subject: Re: smart(8) Call for Testing To: Chuck Tuffli Cc: Rainer Duffner , Charles Sprickman , Tom Evans via freebsd-fs References: <4754cb2f-76bb-a69b-0cf5-eff4d621eb29@callfortesting.org> <1d3f2cef-4c37-782e-7938-e0a2eebc8842@quip.cz> <7ED27465-1BC2-4522-873E-9ECE192EB7A2@ultra-secure.de> From: Lev Serebryakov Organization: FreeBSD Message-ID: Date: Thu, 29 Mar 2018 16:43:28 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Mar 2018 13:43:36 -0000 On 29.03.2018 16:27, Chuck Tuffli wrote: >>> Maybe one of the vendors who sells FreeBSD as part of an appliance has shown some interest in this? >>> >>> If you’re hardware is well-defined and thus the output is consistent, I could imagine it’s not too difficult to parse this. >> smartd is very important part of smartmontools, smartctl is not so. >> >> And periodic self-test triggering & check is most important feature of >> smartd, IMHO. >> >> Modern HDDs are liers in SMART. And only regular self-test discover >> real errors on surfaces in my experience. >> >> So, tool without support for HDD self-tests is of little usage for >> appliances, IMHO. > Thank you for the feedback! As I don't have any experience with > smartd, can you help me better understand which parts of it are most > useful to you? Is it just periodically triggering the self test or > are there other features as well? For example, logging the SMART > values, emailing / triggering notifications when certain criteria are > met, monitoring the self tests, reading the error logs, etc.? Triggering of short and full self-tests and alerting (via e-mail) when test failed. Monitoring of values and alerting is VERY important (number of Relocations is main indicator of spinning HDD health and when it raises it must be known ASAP), but it could be implemented with simple smart(8) utility and some scripting, so this is not problem. But all my dead HDDs were replaced on self-test fail — it is what allows me to replace them BEFORE data were lost. -- // Lev Serebryakov From owner-freebsd-fs@freebsd.org Thu Mar 29 13:48:26 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EEEB7F77AE1 for ; Thu, 29 Mar 2018 13:48:25 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [148.251.9.81]) by mx1.freebsd.org (Postfix) with ESMTP id 8F78F6EEA8 for ; Thu, 29 Mar 2018 13:48:25 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from [192.168.23.186] (unknown [89.113.128.32]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id 2B078FAF; Thu, 29 Mar 2018 16:48:24 +0300 (MSK) Reply-To: lev@FreeBSD.org Subject: Re: smart(8) Call for Testing To: Ben RUBSON , Chuck Tuffli Cc: Tom Evans via freebsd-fs References: <4754cb2f-76bb-a69b-0cf5-eff4d621eb29@callfortesting.org> <1d3f2cef-4c37-782e-7938-e0a2eebc8842@quip.cz> <7ED27465-1BC2-4522-873E-9ECE192EB7A2@ultra-secure.de> <05EE6839-C5A1-4AF9-A4DC-D01210F715C1@gmail.com> From: Lev Serebryakov Organization: FreeBSD Message-ID: <3ad14ec0-f9a9-4da0-f6ba-25a93c7e9df0@FreeBSD.org> Date: Thu, 29 Mar 2018 16:48:23 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <05EE6839-C5A1-4AF9-A4DC-D01210F715C1@gmail.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Mar 2018 13:48:26 -0000 On 29.03.2018 16:40, Ben RUBSON wrote: > This is actually the job of smartd : > scheduling / testing / monitoring / alerting :) This could be implemented with cron + sh + smart(8), but not HDD self-test and its results analysis. -- // Lev Serebryakov From owner-freebsd-fs@freebsd.org Thu Mar 29 14:32:11 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EA671F4F527 for ; Thu, 29 Mar 2018 14:32:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 84A847127A for ; Thu, 29 Mar 2018 14:32:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id C269023F59 for ; Thu, 29 Mar 2018 14:32:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w2TEW9pO056097 for ; Thu, 29 Mar 2018 14:32:09 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w2TEW9T0056096 for freebsd-fs@FreeBSD.org; Thu, 29 Mar 2018 14:32:09 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 196799] Lock order reversal after shutting down ZFS root system. Date: Thu, 29 Mar 2018 14:32:09 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: dom@itsallbroken.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Mar 2018 14:32:11 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D196799 Dom changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |dom@itsallbroken.com --- Comment #1 from Dom --- I'm still seeing this with a ZFS root volume on a GENERIC kernel, with the addition of INVARIANT_SUPPORT+INVARIANTS+WITNESS. The line numbers have cha= nged slightly, I assume it's the same bug but the files have been modified in the last 3 years. FreeBSD box 11.1-RELEASE-p8 FreeBSD 11.1-RELEASE-p8 #1: Thu Mar 29 12:02:06= UTC 2018 root@box:/usr/obj/usr/src/sys/WITNESS amd64 /usr/src/sys/kern/vfs_mount.c:1271 /usr/src/sys/kern/vfs_subr.c:2533 --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Thu Mar 29 14:38:44 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 71404F4FE74 for ; Thu, 29 Mar 2018 14:38:44 +0000 (UTC) (envelope-from daveb@spectralogic.com) Received: from mail1.bemta8.messagelabs.com (mail1.bemta8.messagelabs.com [216.82.243.198]) by mx1.freebsd.org (Postfix) with ESMTP id 152997167A; Thu, 29 Mar 2018 14:38:43 +0000 (UTC) (envelope-from daveb@spectralogic.com) Received: from [216.82.242.33] (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384 (256 bits)) by server-6.bemta-8.messagelabs.com id F5/F4-28268-46AFCBA5; Thu, 29 Mar 2018 14:38:28 +0000 X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFvrDIsWRWlGSWpSXmKPExsVyQG6fiG7Krz1 RBi8+MVm8m/uB2eLY459sDkweMz7NZwlgjGLNzEvKr0hgzZg5dydLwb4exorWoxNYGhivdDF2 MXJysAloSfQsOczSxcjBISKgLvH5nBZImFnAVOLopg6wEmGBAImzkx+ygNgiAoES1/Z/ZIOwr SRWvD0NVsMioCoxYfc1sDivgLPE7B0PmLoYuTiEBDoZJabu3MsEkuAEar466yCYzSggJvH91B omiGXiEreezAezJQQEJJbsOc8MYYtKvHz8jxXkNmYBTYn1u/Qhyu0lzvw7wwZhK0pM6X7IDrF XUOLkzCcsExiFZiGZOguhexaS7llIumch6V7AyLqKUaM4tagstUjX2FAvqSgzPaMkNzEzR9fQ wEIvN7W4ODE9NScxqVgvOT93EyMwDuoZGBh3MH5fFn2IUZKDSUmUN+XcnighvqT8lMqMxOKM+ KLSnNTiQ4wyHBxKErylP4FygkWp6akVaZk5wIiESUtw8CiJ8J7+AZTmLS5IzC3OTIdInWI05u h4P6WHmePJ5Wk9zEIsefl5qVLivO4gkwRASjNK8+AGwRLFJUZZKWFeRgYGBiGegtSi3MwSVPl XjOIcjErCvBUgU3gy80rg9r0COoUJ6BSRGrBTShIRUlINjJxaGyOSrSc+N7+g1db5/Ir9nONb eU8dtH/ItsZdZHVSM59GZnXe2o3SJz7Yt85b9Ocjy47tNlr7GlZd5O1Me/zq2cOvkfqLly+zy VtWV9Qjdl9lip/15OvMfGbNfVOkv7Q/n9lUd7vd40nC+09BJfrCqY5cprVNf/is1I8t+ZQ6J6 HN0CLqkBJLcUaioRZzUXEiAEjla8UPAwAA X-Env-Sender: daveb@spectralogic.com X-Msg-Ref: server-8.tower-55.messagelabs.com!1522334307!126796273!1 X-Originating-IP: [192.30.190.20] X-SYMC-ESS-Client-Auth: outbound-route-from=pass X-StarScan-Received: X-StarScan-Version: 9.9.15; banners=-,-,- X-VirusChecked: Checked Received: (qmail 22047 invoked from network); 29 Mar 2018 14:38:27 -0000 Received: from outmx2.spectralogic.com (HELO mail.spectralogic.com) (192.30.190.20) by server-8.tower-55.messagelabs.com with AES256-GCM-SHA384 encrypted SMTP; 29 Mar 2018 14:38:27 -0000 From: Dave Baukus To: "cem@freebsd.org" CC: "freebsd-fs@freebsd.org" Subject: Re: ZFS, Vnode cache, and poor directory listing performance via Samba Thread-Topic: ZFS, Vnode cache, and poor directory listing performance via Samba Thread-Index: AQHTxwKm8Y8KtZTBXUOxWVyyjppo8aPm468AgADKFYA= Date: Thu, 29 Mar 2018 14:38:27 +0000 Message-ID: <9f3c98c0-e5b1-9e3e-fc1e-e2362e12c98c@spectralogic.com> References: <67aadb01-70c2-0454-2e3f-74bed67fb330@spectralogic.com> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: Content-Type: text/plain; charset="utf-8" Content-ID: <6A38C25E26E3FA48961930062436BAE9@spectralogic.com> Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Mar 2018 14:38:44 -0000 VGhhbmsgeW91IGZvciB0aGUgZXhwbGFuYXRpb24gYW5kIHN1Z2dlc3Rpb25zIENvbnJhZC4NClVu Zm9ydHVuYXRlbHkgdGhpcyBhYnN1cmQgZGlyZWN0b3J5IGlzIGF0IGEgY3VzdG9tZXIgc2l0ZSBn ZW5lcmF0ZWQgYnkgc29tZSBpbGwtZGVzaWduZWQgYXBwbGljYXRpb24uDQoNCkRhdmUgQmF1a3Vz DQoNCk9uIDAzLzI4LzIwMTggMDg6MzUgUE0sIENvbnJhZCBNZXllciB3cm90ZToNCj4gSGkgRGF2 ZSwNCj4NCj4gRnVsbCBzY2FucyBhcmUgdGhlIHdvcnN0IGNhc2UgZm9yIGFuIExSVSBjYWNoZS4g IEluIHBhcnRpY3VsYXIsIHlvdQ0KPiBhcmUgZnVsbC1zY2FubmluZyBhbiAqZXh0cmVtZWx5KiBs YXJnZSBkaXJlY3RvcnksIHdoaWNoIGV2aWN0cyB5b3VyDQo+IGVudGlyZSB2bm9kZSBjYWNoZS4g IFRoZW4geW91IHN1ZmZlciB0aGUgKHByZXN1bWFibHkpIGVudGlyZWx5DQo+IHNlcmlhbGl6ZWQg cGVuYWx0eSBvZiByZWZldGNoaW5nIGV2ZXJ5IHNpbmdsZSBpbm9kZSBmcm9tIGRpc2sgYWdhaW4N Cj4gYWZ0ZXIgdGhlIGZpcnN0IHNjYW4uDQo+DQo+IEhlcmUgYXJlIHNvbWUgc29sdXRpb25zIGlu IG9yZGVyIG9mIHByZWZlcmVuY2U6DQo+IDEuIE9yZ2FuaXplIHlvdXIgZmlsZXMgYmV0dGVyLiAg MSBtaWxsaW9uIGluIGEgc2luZ2xlIGRpcmVjdG9yeSBpcw0KPiBhYnN1cmQuICBDYW4gd2luZG93 cyBleHBsb3JlciBtZWFuaW5nZnVsbHkgbmF2aWdhdGUgYSAxbWlsIGZpbGUNCj4gZGlyZWN0b3J5 PyAgSSBkb3VidCBpdC4NCj4gMi4gQ29udGludWUgdG8gYnVtcCBtYXh2bm9kZXMgdG8gY29tcGVu c2F0ZSBmb3IgcG9vciBmaWxlIG9yZ2FuaXphdGlvbg0KPiArIG5haXZlIGNsaWVudHMgZG9pbmcg ZnVsbCBzY2Fucy4NCj4gMy4gRW5oYW5jZSBzYW1iYSB0byBzaWduYWwgc29tZXRoaW5nIGxpa2Ug RE9OVE5FRUQgb24NCj4gIlNNQjJfRklORF9JRF9CT1RIX0RJUkVDVE9SWV9JTkZPIFBhdHRlcm46 ICoiIHJlcXVlc3RzIHRvIHRoZSBPUy4NCj4gMy5hLiBFbmhhbmNlIHNhbWJhIHRvIHBhcmFsbGVs aXplIG9yIG90aGVyd2lzZSBhc3luY2hyb25vdXNseSBwcm9jZXNzDQo+IHRoZSBhYm92ZSByZXF1 ZXN0cyBvbiBodWdlIGRpcmVjdG9yaWVzIChpbXByb3ZlIHRoZSB1bmNhY2hlZCBjYXNlKS4NCj4N Cj4gSSBkb24ndCB0aGluayB0aGlzIGhhcyBtdWNoIHRvIGRvIHdpdGggWkZTLCBvdGhlciB0aGFu IHRoYXQgWkZTDQo+IHBlcmZvcm1hbmNlIG9uIHlvdXIgaGFyZHdhcmUgYXBwZWFycyB0byBiZSBx dWl0ZSBiYWQgd2l0aG91dCB0aGUgVkZTDQo+IGNhY2hlIHNpdHRpbmcgaW4gZnJvbnQgdG8gYWJz b3JiIG1vc3Qgb2YgdGhlIHJlcXVlc3RzLg0KPg0KPiBCZXN0LA0KPiBDb25yYWQNCj4NCj4NCj4g T24gV2VkLCBNYXIgMjgsIDIwMTggYXQgNzowNyBQTSwgRGF2ZSBCYXVrdXMgPGRhdmViQHNwZWN0 cmFsb2dpYy5jb20+IHdyb3RlOg0KPj4gQmVsb3cgaXMgbmFycmF0aXZlIGFuZ3N0IGFuZCB3b2Ug Zm9yIHdoaWNoIEkgaGF2ZSB0aGUgdGhlIGZvbGxvd2luZyBvYnNlcnZhdGlvbnMvcXVlc3Rpb25z Og0KPj4NCj4+IC0gSW5jcmVhc2luZyBrZXJuLm1heHZub2RlcyBmcm9tIDYwMCwwMDAgdG8gMiww MDAsMDAwIGFwcGFyZW50bHkgc29sdmVzIHRoZSAicHJvYmxlbSINCj4+IC0gVGhpcyBkZWNyZWFz ZXMgdGhlIG51bWJlciBvZiBsb29rdXBzIGluIHRoZSBzY2VuYXJpbyBiZWxvdyBmcm9tIDQwNzE5 IChzb21lIG9mIHdoaWNoIHRha2Ugb3ZlciBhIHNlY29uZCkgdG8gNA0KPj4gLSAyLDAwMCwwMCBt YXkgYmUgZXh0cmVtZSwgYnV0IEkgd2FzIGhvcGluZyBmb3IgYW4gYXV0aG9yaXRhdGl2ZSBjb21t ZW50IG9uIHdoeS9ob3cgdGhpcyBpbXByb3ZlcyB0aGUgc2NlbmFyaW8gYW5kDQo+PiAgICAgdGhl biBwZXJoYXBzIEkgY2FuIGNvbWUgdXAgd2l0aCBzb21lIHJlYXNvbmFibGUgdHVuaW5nIG9wdGlv bnMuDQo+PiAtIGlzIHRoaXMgYW4gYXJ0aWZhY3Qgb2YgdGhlIEZyZWVic2QgMTEtaXNoIHJlZmFj dG9yaW5nIG9mIHRoZSBaRlMvRnJlZWJzZCBWTk9QIGludGVyZmFjZSAoPykNCj4+DQo+PiAtLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLQ0KPj4gSSBo YXZlIHRoZSBmb2xsb3dpbmcgc2NlbmFyaW8gb24gRnJlZUJTRCBTdGFibGUgMTEuMDoNCj4+DQo+ PiBBIFpGUyB3aXRoIGEgZGlyZWN0b3J5IGNvbnRhaW5pbmcgMSwwMDAsMDAwIGZpbGVzOyB0aGUg cm9vdCBvZiB0aGlzIFpGUyBpcw0KPj4gZXhwb3J0ZWQgdmlhIFNBTUJBIHVzaW5nIE5GU3Y0IEFD TCBwbHVnaW4gYW5kIERPUyBhdHRyaWJ1dGVzIHdpdGggdGhlICg8Z2V0fHNldD5leHRhdHRyKSBp bXBsZW1lbnRhdGlvbi4NCj4+DQo+PiBBIGxvY2FsIGZ1bGwgbGlzdGluZyBvZiB0aGlzIGRpcmVj dG9yeSAobHMgLWwgPiAvZGV2L251bGwpIGNvbXBsZXRlcyBpbiBhYm91dCA0MCBzZWNvbmRzLg0K Pj4gQSBmdWxsIGxpc3RpbmcgZnJvbSBhIFNhbWJhIGNsaWVudCAobHMgLWwpIGNvbXBsZXRlcyBp biBhYm91dCAzIG1pbnV0ZXMuDQo+Pg0KPj4gVXNpbmcgd2luZG93cyBleHBsb3JlciBmcm9tIGEg V2luMjAwOCBjbGllbnQgaXMgd2hlcmUgdGhlIHN0cmFuZ2VuZXNzIGJlZ2luczsgaXQNCj4+IHRh a2VzIGJldHdlZW4gOCB0byAxMiBtaW51dGVzIGJlZm9yZSBjb250cm9sIGlzIHJldHVybmVkIHRv IHdpbi1leHBsb3Jlci4NCj4+DQo+PiBUcmFjaW5nIHRoaXMgd2l0aCB3aXJlc2hhcmsgSSBub3Rp Y2VkIHRoYXQgIlNNQjJfRklORF9JRF9CT1RIX0RJUkVDVE9SWV9JTkZPIFBhdHRlcm46ICoiDQo+ PiByZXF1ZXN0cyBmcm9tIHRoZSBXaW4yMDA4IGNsaWVudCBzdGFydCBvZmYgZnVuY3Rpb25pbmcg d2VsbCAoY2xpZW50IHJlcXVlc3RzDQo+PiA2NGsgb2YgZGF0YSBhbmQgc2FtYmEgcmVzcG9uZHMg d2l0aCA2NGsgb2YgZGlyZWN0b3J5IGRhdGEpLiBBZnRlciBhYm91dCAxNTAgc2Vjb25kcyBvZiB0 aGlzDQo+PiBpbnRlcmFjdGlvbiB0aGUgY2xpZW50IG1ha2VzIGEgIlNNQjJfRklORF9JRF9CT1RI X0RJUkVDVE9SWV9JTkZPIFBhdHRlcm46ICoiIHJlcXVlc3QgdGhhdCBpcyBub3QNCj4+IHJlc3Bv bmRlZCB0byBmb3Igb3ZlciA2MCBzZWNvbmRzLiBUaGUgd2luZG93cyBjbGllbnQgY2xvc2VzIHRo ZSBjb25uZWN0aW9uLCBzdGFydHMgYSBuZXcNCj4+IGNvbm5lY3Rpb24sIGFuZCBiZWdpbnMgZGly ZWN0b3J5IGxpc3RpbmcgZnJvbSBncm91bmQgemVyby4gVGhpcyBwYXR0ZXJuIGNvbnRpbnVlcyBm b3INCj4+IDYgdG8gMTAgbWludXRlczsgSSBuZXZlciBzZWUgZmluYWwgcmVxdWVzdC9yZXNwb25z ZSB3aGVyZSB0aGUgc2VydmVyIGluZGljYXRlcyB0aGF0IHRoZQ0KPj4gbGlzdGluZyBpcyBjb21w bGV0ZTsgSSBiZWxpZXZlIHdpbi1leHBsb3JlciBqdXN0IGdpdmVzIHVwLg0KPj4NCj4+IE1lYW53 aGlsZSwgYmFjayBvbiBGcmVlQlNEL1pGUyBJJ20gcnVubmluZyBhIGR0cmFjZSBzY3JpcHQgdGhh dCB0aW1lcyB0aGUgZm9sbG93aW5nDQo+PiBaRlMgVk5PUHMgZm9yIHRoZSBjb25uZWN0ZWQgU2Ft YmEgc2VydmVyIGluc3RhbmNlOg0KPj4NCj4+IC0gZmJ0Onpmczp6ZnNfKmV4dGF0dHI6ZW50cnkg YW5kIHJldHVybiAoZ2V0fHNldHxkZWxldGV8bGlzdClleHRhdHRyDQo+PiAtIGZidDp6ZnM6emZz X2ZyZWVic2RfbG9va3VwOmVudHJ5IGFuZCByZXR1cm4NCj4+IC0gZmJ0Onpmczp6ZnNfZnJlZWJz ZF9yZWFkZGlyOmVudHJ5IGFuZCByZXR1cm4NCj4+IC0gZmJ0Onpmczp6ZnNfZnJlZWJzZF9nZXRh dHRyOmVudHJ5IGFuZCByZXR1cm4NCj4+DQo+PiBUaGlzIHN0YXJ0cyBvZmYgbG9va2luZyBsaWtl Og0KPj4gICAgMTIgIDI3Nzc3ICAgICAgICB6ZnNfZnJlZWJzZF9sb29rdXA6cmV0dXJuIHpmc19m cmVlYnNkX2xvb2t1cCA6OiAxOTkzMQ0KPj4gICAgMTIgIDI3NzY1ICAgICAgIHpmc19mcmVlYnNk X2dldGF0dHI6cmV0dXJuIHpmc19mcmVlYnNkX2dldGF0dHIgOjogMzk3NQ0KPj4gICAgMTIgIDI3 NzY1ICAgICAgIHpmc19mcmVlYnNkX2dldGF0dHI6cmV0dXJuIHpmc19mcmVlYnNkX2dldGF0dHIg OjogMjY2Mg0KPj4gICAgMTIgIDI3NzY1ICAgICAgIHpmc19mcmVlYnNkX2dldGF0dHI6cmV0dXJu IHpmc19mcmVlYnNkX2dldGF0dHIgOjogMTcxMQ0KPj4gICAgMTIgIDI3NzY1ICAgICAgIHpmc19m cmVlYnNkX2dldGF0dHI6cmV0dXJuIHpmc19mcmVlYnNkX2dldGF0dHIgOjogMTc2OA0KPj4gICAg MTIgIDI3NzY1ICAgICAgIHpmc19mcmVlYnNkX2dldGF0dHI6cmV0dXJuIHpmc19mcmVlYnNkX2dl dGF0dHIgOjogMTQxMQ0KPj4gICAgMTIgIDI3Nzg3ICAgICAgIHpmc19mcmVlYnNkX3JlYWRkaXI6 cmV0dXJuIHpmc19mcmVlYnNkX3JlYWRkaXIgOjogNDQzMjUNCj4+ICAgIDEyICAyNzc4NyAgICAg ICB6ZnNfZnJlZWJzZF9yZWFkZGlyOnJldHVybiB6ZnNfZnJlZWJzZF9yZWFkZGlyIDo6IDM4MDU0 DQo+PiAgICAxMiAgMjc3ODcgICAgICAgemZzX2ZyZWVic2RfcmVhZGRpcjpyZXR1cm4gemZzX2Zy ZWVic2RfcmVhZGRpciA6OiAzNjEzNw0KPj4gLi4uDQo+PiAuLi4gbGluZSAxMSw4MDANCj4+ICAg IDE2ICAyNzc2MyAgICAgICAgemZzX2ZyZWVic2RfZ2V0YWNsOnJldHVybiB6ZnNfZnJlZWJzZF9n ZXRhY2wgOjogMjcwOQ0KPj4gICAgMTYgIDI3NzYzICAgICAgICB6ZnNfZnJlZWJzZF9nZXRhY2w6 cmV0dXJuIHpmc19mcmVlYnNkX2dldGFjbCA6OiAyMDQ2DQo+PiAgICAxNiAgMjc3NjUgICAgICAg emZzX2ZyZWVic2RfZ2V0YXR0cjpyZXR1cm4gemZzX2ZyZWVic2RfZ2V0YXR0ciA6OiAyMjM4DQo+ PiAgICAxNiAgMjc3NjUgICAgICAgemZzX2ZyZWVic2RfZ2V0YXR0cjpyZXR1cm4gemZzX2ZyZWVi c2RfZ2V0YXR0ciA6OiAxNDUyDQo+PiAgICAxNiAgMjc3NjUgICAgICAgemZzX2ZyZWVic2RfZ2V0 YXR0cjpyZXR1cm4gemZzX2ZyZWVic2RfZ2V0YXR0ciA6OiAxNTcwDQo+PiAgICAxNiAgMjc3NjUg ICAgICAgemZzX2ZyZWVic2RfZ2V0YXR0cjpyZXR1cm4gemZzX2ZyZWVic2RfZ2V0YXR0ciA6OiAx NjA4DQo+PiAgICAxNiAgMjc3NjUgICAgICAgemZzX2ZyZWVic2RfZ2V0YXR0cjpyZXR1cm4gemZz X2ZyZWVic2RfZ2V0YXR0ciA6OiAxNTcxDQo+PiAgICAxNiAgMjc3NjUgICAgICAgemZzX2ZyZWVi c2RfZ2V0YXR0cjpyZXR1cm4gemZzX2ZyZWVic2RfZ2V0YXR0ciA6OiAxNDMxDQo+PiAgICAxNiAg Mjc3NjUgICAgICAgemZzX2ZyZWVic2RfZ2V0YXR0cjpyZXR1cm4gemZzX2ZyZWVic2RfZ2V0YXR0 ciA6OiAxNDMxDQo+PiAgICAxNiAgMjc3NjMgICAgICAgIHpmc19mcmVlYnNkX2dldGFjbDpyZXR1 cm4gemZzX2ZyZWVic2RfZ2V0YWNsIDo6IDI4NTYNCj4+ICAgIDE2ICAyNzc2MyAgICAgICAgemZz X2ZyZWVic2RfZ2V0YWNsOnJldHVybiB6ZnNfZnJlZWJzZF9nZXRhY2wgOjogMTkwNw0KPj4gICAg MTYgIDI3ODA5ICAgICAgICAgICAgemZzX2dldGV4dGF0dHI6cmV0dXJuIHpmc19nZXRleHRhdHRy IDo6IDM1MzcNCj4+ICAgIDE2ICAyNzc4NyAgICAgICB6ZnNfZnJlZWJzZF9yZWFkZGlyOnJldHVy biB6ZnNfZnJlZWJzZF9yZWFkZGlyIDo6IDQ1MTM1DQo+PiAgICAxNiAgMjc3NjUgICAgICAgemZz X2ZyZWVic2RfZ2V0YXR0cjpyZXR1cm4gemZzX2ZyZWVic2RfZ2V0YXR0ciA6OiAyNzQ0DQo+PiAg ICAxNiAgMjc4MDkgICAgICAgICAgICB6ZnNfZ2V0ZXh0YXR0cjpyZXR1cm4gemZzX2dldGV4dGF0 dHIgOjogMzIyMQ0KPj4gICAgMTYgIDI3ODExICAgICAgICAgICB6ZnNfbGlzdGV4dGF0dHI6cmV0 dXJuIHpmc19saXN0ZXh0YXR0ciA6OiAzNzYyDQo+PiAgICAxNiAgMjc3NjUgICAgICAgemZzX2Zy ZWVic2RfZ2V0YXR0cjpyZXR1cm4gemZzX2ZyZWVic2RfZ2V0YXR0ciA6OiAyMDkwDQo+PiAgICAx NiAgMjc3NjUgICAgICAgemZzX2ZyZWVic2RfZ2V0YXR0cjpyZXR1cm4gemZzX2ZyZWVic2RfZ2V0 YXR0ciA6OiAyMjE0DQo+PiAgICAxNiAgMjc4MDkgICAgICAgICAgICB6ZnNfZ2V0ZXh0YXR0cjpy ZXR1cm4gemZzX2dldGV4dGF0dHIgOjogMjAxMTINCj4+ICAgIDE2ICAyNzgwOSAgICAgICAgICAg IHpmc19nZXRleHRhdHRyOnJldHVybiB6ZnNfZ2V0ZXh0YXR0ciA6OiAxNDk4OQ0KPj4gICAgMTYg IDI3Nzg3ICAgICAgIHpmc19mcmVlYnNkX3JlYWRkaXI6cmV0dXJuIHpmc19mcmVlYnNkX3JlYWRk aXIgOjogMzU5NDYNCj4+ICAgIDE2ICAyNzgxMSAgICAgICAgICAgemZzX2xpc3RleHRhdHRyOnJl dHVybiB6ZnNfbGlzdGV4dGF0dHIgOjogNDY5MDANCj4+ICAgIDE2ICAyNzc2NSAgICAgICB6ZnNf ZnJlZWJzZF9nZXRhdHRyOnJldHVybiB6ZnNfZnJlZWJzZF9nZXRhdHRyIDo6IDIxMTUNCj4+ICAg IDE2ICAyNzc2NSAgICAgICB6ZnNfZnJlZWJzZF9nZXRhdHRyOnJldHVybiB6ZnNfZnJlZWJzZF9n ZXRhdHRyIDo6IDE0MzkNCj4+ICAgIDE2ICAyNzc3NyAgICAgICAgemZzX2ZyZWVic2RfbG9va3Vw OnJldHVybiB6ZnNfZnJlZWJzZF9sb29rdXAgOjogMjI4ODYNCj4+ICAgIDE2ICAyNzc2NSAgICAg ICB6ZnNfZnJlZWJzZF9nZXRhdHRyOnJldHVybiB6ZnNfZnJlZWJzZF9nZXRhdHRyIDo6IDE0NDkN Cj4+ICAgIDE2ICAyNzgwOSAgICAgICAgICAgIHpmc19nZXRleHRhdHRyOnJldHVybiB6ZnNfZ2V0 ZXh0YXR0ciA6OiA0MDQ2DQo+PiAgICAxNiAgMjc4MTEgICAgICAgICAgIHpmc19saXN0ZXh0YXR0 cjpyZXR1cm4gemZzX2xpc3RleHRhdHRyIDo6IDIyMzkNCj4+ICAgIDE2ICAyNzc3NyAgICAgICAg emZzX2ZyZWVic2RfbG9va3VwOnJldHVybiB6ZnNfZnJlZWJzZF9sb29rdXAgOjogMTUxMjgNCj4+ ICAgIDE2ICAyNzc2NSAgICAgICB6ZnNfZnJlZWJzZF9nZXRhdHRyOnJldHVybiB6ZnNfZnJlZWJz ZF9nZXRhdHRyIDo6IDE2NDANCj4+IC4uLg0KPj4gLi4uIGxpbmUgMTc1LDAwMA0KPj4gICAgMTIg IDI3Nzc3ICAgICAgICB6ZnNfZnJlZWJzZF9sb29rdXA6cmV0dXJuIHpmc19mcmVlYnNkX2xvb2t1 cCA6OiA4NTc2MDczNA0KPj4gICAgMTIgIDI3NzY1ICAgICAgIHpmc19mcmVlYnNkX2dldGF0dHI6 cmV0dXJuIHpmc19mcmVlYnNkX2dldGF0dHIgOjogMzYxNw0KPj4gICAgMTIgIDI3ODA5ICAgICAg ICAgICAgemZzX2dldGV4dGF0dHI6cmV0dXJuIHpmc19nZXRleHRhdHRyIDo6IDE0MDY0DQo+PiAg ICAxMiAgMjc4MTEgICAgICAgICAgIHpmc19saXN0ZXh0YXR0cjpyZXR1cm4gemZzX2xpc3RleHRh dHRyIDo6IDQwODgNCj4+ICAgIDEyICAyNzc3NyAgICAgICAgemZzX2ZyZWVic2RfbG9va3VwOnJl dHVybiB6ZnNfZnJlZWJzZF9sb29rdXAgOjogODU1ODY1NDENCj4+ICAgIDEyICAyNzc2NSAgICAg ICB6ZnNfZnJlZWJzZF9nZXRhdHRyOnJldHVybiB6ZnNfZnJlZWJzZF9nZXRhdHRyIDo6IDI5ODMN Cj4+ICAgIDEyICAyNzgwOSAgICAgICAgICAgIHpmc19nZXRleHRhdHRyOnJldHVybiB6ZnNfZ2V0 ZXh0YXR0ciA6OiAxMTQxNg0KPj4gICAgMTIgIDI3ODExICAgICAgICAgICB6ZnNfbGlzdGV4dGF0 dHI6cmV0dXJuIHpmc19saXN0ZXh0YXR0ciA6OiAzMjMwDQo+PiAgICAxMiAgMjc3NzcgICAgICAg IHpmc19mcmVlYnNkX2xvb2t1cDpyZXR1cm4gemZzX2ZyZWVic2RfbG9va3VwIDo6IDg1NzU4MDI3 DQo+PiAgICAxMiAgMjc3NjUgICAgICAgemZzX2ZyZWVic2RfZ2V0YXR0cjpyZXR1cm4gemZzX2Zy ZWVic2RfZ2V0YXR0ciA6OiAzMTI0DQo+PiAuLi4NCj4+IC4uLiBsaW5lIDE3NiwwMDAwDQo+PiAg ICAgMSAgMjc3NzcgICAgICAgIHpmc19mcmVlYnNkX2xvb2t1cDpyZXR1cm4gemZzX2ZyZWVic2Rf bG9va3VwIDo6IDExMTMzOTc5MDMNCj4+ICAgICAxICAyNzc2NSAgICAgICB6ZnNfZnJlZWJzZF9n ZXRhdHRyOnJldHVybiB6ZnNfZnJlZWJzZF9nZXRhdHRyIDo6IDMxODkNCj4+ICAgICAxICAyNzgw OSAgICAgICAgICAgIHpmc19nZXRleHRhdHRyOnJldHVybiB6ZnNfZ2V0ZXh0YXR0ciA6OiA2NDIz DQo+PiAgICAgMSAgMjc4MTEgICAgICAgICAgIHpmc19saXN0ZXh0YXR0cjpyZXR1cm4gemZzX2xp c3RleHRhdHRyIDo6IDMwOTANCj4+ICAgICAxICAyNzc3NyAgICAgICAgemZzX2ZyZWVic2RfbG9v a3VwOnJldHVybiB6ZnNfZnJlZWJzZF9sb29rdXAgOjogMTEwODE4MTc0MA0KPj4gICAgIDEgIDI3 NzY1ICAgICAgIHpmc19mcmVlYnNkX2dldGF0dHI6cmV0dXJuIHpmc19mcmVlYnNkX2dldGF0dHIg OjogMzI2Nw0KPj4gICAgIDEgIDI3ODA5ICAgICAgICAgICAgemZzX2dldGV4dGF0dHI6cmV0dXJu IHpmc19nZXRleHRhdHRyIDo6IDU0ODYNCj4+ICAgICAxICAyNzgxMSAgICAgICAgICAgemZzX2xp c3RleHRhdHRyOnJldHVybiB6ZnNfbGlzdGV4dGF0dHIgOjogMzExMQ0KPj4gICAgIDEgIDI3Nzc3 ICAgICAgICB6ZnNfZnJlZWJzZF9sb29rdXA6cmV0dXJuIHpmc19mcmVlYnNkX2xvb2t1cCA6OiAx MDkyMDYxNzU2DQo+PiAgICAgMSAgMjc3NjUgICAgICAgemZzX2ZyZWVic2RfZ2V0YXR0cjpyZXR1 cm4gemZzX2ZyZWVic2RfZ2V0YXR0ciA6OiAzMTEzDQo+PiAgICAgMSAgMjc4MDkgICAgICAgICAg ICB6ZnNfZ2V0ZXh0YXR0cjpyZXR1cm4gemZzX2dldGV4dGF0dHIgOjogNTY5MQ0KPj4gICAgIDEg IDI3ODExICAgICAgICAgICB6ZnNfbGlzdGV4dGF0dHI6cmV0dXJuIHpmc19saXN0ZXh0YXR0ciA6 OiAzMDczDQo+PiAgICAgMSAgMjc3NzcgICAgICAgIHpmc19mcmVlYnNkX2xvb2t1cDpyZXR1cm4g emZzX2ZyZWVic2RfbG9va3VwIDo6IDExMDIyMzY3NTUNCj4+ICAgICAxICAyNzc2NSAgICAgICB6 ZnNfZnJlZWJzZF9nZXRhdHRyOnJldHVybiB6ZnNfZnJlZWJzZF9nZXRhdHRyIDo6IDM0MzUNCj4+ ICAgICAxICAyNzgwOSAgICAgICAgICAgIHpmc19nZXRleHRhdHRyOnJldHVybiB6ZnNfZ2V0ZXh0 YXR0ciA6OiA1ODYyDQo+PiAgICAgMSAgMjc4MTEgICAgICAgICAgIHpmc19saXN0ZXh0YXR0cjpy ZXR1cm4gemZzX2xpc3RleHRhdHRyIDo6IDM3NzENCj4+ICAgICAxICAyNzc3NyAgICAgICAgemZz X2ZyZWVic2RfbG9va3VwOnJldHVybiB6ZnNfZnJlZWJzZF9sb29rdXAgOjogMTEwMTY2ODIzMQ0K Pj4gICAgIDEgIDI3NzY1ICAgICAgIHpmc19mcmVlYnNkX2dldGF0dHI6cmV0dXJuIHpmc19mcmVl YnNkX2dldGF0dHIgOjogMzE4OQ0KPj4gICAgIDEgIDI3ODA5ICAgICAgICAgICAgemZzX2dldGV4 dGF0dHI6cmV0dXJuIHpmc19nZXRleHRhdHRyIDo6IDY2NzENCj4+ICAgIDE1ICAyNzgxMSAgICAg ICAgICAgemZzX2xpc3RleHRhdHRyOnJldHVybiB6ZnNfbGlzdGV4dGF0dHIgOjogMTI5NTENCj4+ ICAgIDE1ICAyNzc3NyAgICAgICAgemZzX2ZyZWVic2RfbG9va3VwOnJldHVybiB6ZnNfZnJlZWJz ZF9sb29rdXAgOjogMTA2MTY0ODExNw0KPj4gICAgMTUgIDI3NzY1ICAgICAgIHpmc19mcmVlYnNk X2dldGF0dHI6cmV0dXJuIHpmc19mcmVlYnNkX2dldGF0dHIgOjogNTM2NQ0KPj4gICAgMTUgIDI3 ODA5ICAgICAgICAgICAgemZzX2dldGV4dGF0dHI6cmV0dXJuIHpmc19nZXRleHRhdHRyIDo6IDU3 MzENCj4+ICAgIDIxICAyNzgxMSAgICAgICAgICAgemZzX2xpc3RleHRhdHRyOnJldHVybiB6ZnNf bGlzdGV4dGF0dHIgOjogODE3OA0KPj4gICAgMjEgIDI3Nzc3ICAgICAgICB6ZnNfZnJlZWJzZF9s b29rdXA6cmV0dXJuIHpmc19mcmVlYnNkX2xvb2t1cCA6OiA2NDQyOTQzMA0KPj4gICAgMjEgIDI3 NzY1ICAgICAgIHpmc19mcmVlYnNkX2dldGF0dHI6cmV0dXJuIHpmc19mcmVlYnNkX2dldGF0dHIg OjogMjkxMg0KPj4gICAgMjEgIDI3ODA5ICAgICAgICAgICAgemZzX2dldGV4dGF0dHI6cmV0dXJu IHpmc19nZXRleHRhdHRyIDo6IDU1NjYNCj4+ICAgIDIxICAyNzgxMSAgICAgICAgICAgemZzX2xp c3RleHRhdHRyOnJldHVybiB6ZnNfbGlzdGV4dGF0dHIgOjogMjQ1NA0KPj4gICAgMTkgIDI3Nzc3 ICAgICAgICB6ZnNfZnJlZWJzZF9sb29rdXA6cmV0dXJuIHpmc19mcmVlYnNkX2xvb2t1cCA6OiAx MDE3MTc2MjM0DQo+PiAgICAxOSAgMjc3NjUgICAgICAgemZzX2ZyZWVic2RfZ2V0YXR0cjpyZXR1 cm4gemZzX2ZyZWVic2RfZ2V0YXR0ciA6OiAyOTc2DQo+PiAgICAxOSAgMjc4MDkgICAgICAgICAg ICB6ZnNfZ2V0ZXh0YXR0cjpyZXR1cm4gemZzX2dldGV4dGF0dHIgOjogNjIzMA0KPj4gICAgMTkg IDI3ODExICAgICAgICAgICB6ZnNfbGlzdGV4dGF0dHI6cmV0dXJuIHpmc19saXN0ZXh0YXR0ciA6 OiAyNzEwDQo+PiAgICAxOSAgMjc3NzcgICAgICAgIHpmc19mcmVlYnNkX2xvb2t1cDpyZXR1cm4g emZzX2ZyZWVic2RfbG9va3VwIDo6IDY0MjExMDE1DQo+PiAgICAxOSAgMjc3NjUgICAgICAgemZz X2ZyZWVic2RfZ2V0YXR0cjpyZXR1cm4gemZzX2ZyZWVic2RfZ2V0YXR0ciA6OiAxODc2DQo+PiAg ICAxOSAgMjc4MDkgICAgICAgICAgICB6ZnNfZ2V0ZXh0YXR0cjpyZXR1cm4gemZzX2dldGV4dGF0 dHIgOjogMzY5MA0KPj4gICAgMTkgIDI3ODExICAgICAgICAgICB6ZnNfbGlzdGV4dGF0dHI6cmV0 dXJuIHpmc19saXN0ZXh0YXR0ciA6OiAyMjkyDQo+PiAgICAxOSAgMjc3NzcgICAgICAgIHpmc19m cmVlYnNkX2xvb2t1cDpyZXR1cm4gemZzX2ZyZWVic2RfbG9va3VwIDo6IDE3MDA3DQo+PiAgICAx OSAgMjc3NjUgICAgICAgemZzX2ZyZWVic2RfZ2V0YXR0cjpyZXR1cm4gemZzX2ZyZWVic2RfZ2V0 YXR0ciA6OiAxNzY2DQo+PiAgICAxOSAgMjc4MDkgICAgICAgICAgICB6ZnNfZ2V0ZXh0YXR0cjpy ZXR1cm4gemZzX2dldGV4dGF0dHIgOjogMzM1Nw0KPj4gICAgMTkgIDI3ODExICAgICAgICAgICB6 ZnNfbGlzdGV4dGF0dHI6cmV0dXJuIHpmc19saXN0ZXh0YXR0ciA6OiAyMzMxDQo+PiAgICAxOSAg Mjc3NzcgICAgICAgIHpmc19mcmVlYnNkX2xvb2t1cDpyZXR1cm4gemZzX2ZyZWVic2RfbG9va3Vw IDo6IDYzODE3NDM2DQo+PiAgICAxOSAgMjc3NjUgICAgICAgemZzX2ZyZWVic2RfZ2V0YXR0cjpy ZXR1cm4gemZzX2ZyZWVic2RfZ2V0YXR0ciA6OiAxODI3DQo+PiAgICAxOSAgMjc4MDkgICAgICAg ICAgICB6ZnNfZ2V0ZXh0YXR0cjpyZXR1cm4gemZzX2dldGV4dGF0dHIgOjogMTIyMzENCj4+ICAg IDEyICAyNzgxMSAgICAgICAgICAgemZzX2xpc3RleHRhdHRyOnJldHVybiB6ZnNfbGlzdGV4dGF0 dHIgOjogODY1OA0KPj4gICAgMTIgIDI3Nzc3ICAgICAgICB6ZnNfZnJlZWJzZF9sb29rdXA6cmV0 dXJuIHpmc19mcmVlYnNkX2xvb2t1cCA6OiA2NDg1OTcwMg0KPj4gICAgMTIgIDI3NzY1ICAgICAg IHpmc19mcmVlYnNkX2dldGF0dHI6cmV0dXJuIHpmc19mcmVlYnNkX2dldGF0dHIgOjogMzI5Ng0K Pj4gICAgMTIgIDI3ODA5ICAgICAgICAgICAgemZzX2dldGV4dGF0dHI6cmV0dXJuIHpmc19nZXRl eHRhdHRyIDo6IDYxMTgNCj4+ICAgIDEyICAyNzgxMSAgICAgICAgICAgemZzX2xpc3RleHRhdHRy OnJldHVybiB6ZnNfbGlzdGV4dGF0dHIgOjogMjQ1NA0KPj4gICAgMTIgIDI3Nzc3ICAgICAgICB6 ZnNfZnJlZWJzZF9sb29rdXA6cmV0dXJuIHpmc19mcmVlYnNkX2xvb2t1cCA6OiAxNzQ0Mg0KPj4g ICAgMTIgIDI3NzY1ICAgICAgIHpmc19mcmVlYnNkX2dldGF0dHI6cmV0dXJuIHpmc19mcmVlYnNk X2dldGF0dHIgOjogMTY3Ng0KPj4gICAgMTIgIDI3ODA5ICAgICAgICAgICAgemZzX2dldGV4dGF0 dHI6cmV0dXJuIHpmc19nZXRleHRhdHRyIDo6IDM2NDkNCj4+ICAgIDEyICAyNzgxMSAgICAgICAg ICAgemZzX2xpc3RleHRhdHRyOnJldHVybiB6ZnNfbGlzdGV4dGF0dHIgOjogMjM2Mw0KPj4gICAg IDAgIDI3Nzc3ICAgICAgICB6ZnNfZnJlZWJzZF9sb29rdXA6cmV0dXJuIHpmc19mcmVlYnNkX2xv b2t1cCA6OiAxMDEzNDcxMTQxDQo+PiAgICAgMCAgMjc3NjUgICAgICAgemZzX2ZyZWVic2RfZ2V0 YXR0cjpyZXR1cm4gemZzX2ZyZWVic2RfZ2V0YXR0ciA6OiA1OTk1DQo+PiAgICAgMCAgMjc4MDkg ICAgICAgICAgICB6ZnNfZ2V0ZXh0YXR0cjpyZXR1cm4gemZzX2dldGV4dGF0dHIgOjogOTI4MA0K Pj4gICAgIDAgIDI3ODExICAgICAgICAgICB6ZnNfbGlzdGV4dGF0dHI6cmV0dXJuIHpmc19saXN0 ZXh0YXR0ciA6OiAzMjE5DQo+PiAgICAgMCAgMjc3NzcgICAgICAgIHpmc19mcmVlYnNkX2xvb2t1 cDpyZXR1cm4gemZzX2ZyZWVic2RfbG9va3VwIDo6IDY0Mjg2MTk2DQo+PiAgICAgMCAgMjc3NjUg ICAgICAgemZzX2ZyZWVic2RfZ2V0YXR0cjpyZXR1cm4gemZzX2ZyZWVic2RfZ2V0YXR0ciA6OiA1 NjE4DQo+PiAgICAgMCAgMjc4MDkgICAgICAgICAgICB6ZnNfZ2V0ZXh0YXR0cjpyZXR1cm4gemZz X2dldGV4dGF0dHIgOjogODkxOQ0KPj4gICAgIDAgIDI3ODExICAgICAgICAgICB6ZnNfbGlzdGV4 dGF0dHI6cmV0dXJuIHpmc19saXN0ZXh0YXR0ciA6OiAzMTE3DQo+PiAgICAxMyAgMjc3NzcgICAg ICAgIHpmc19mcmVlYnNkX2xvb2t1cDpyZXR1cm4gemZzX2ZyZWVic2RfbG9va3VwIDo6IDk5OTQz MTk1Mw0KPj4gICAgMTMgIDI3Nzc3ICAgICAgICB6ZnNfZnJlZWJzZF9sb29rdXA6cmV0dXJuIHpm c19mcmVlYnNkX2xvb2t1cCA6OiAxMDYyMzIyODA4DQo+PiAgICAgOSAgMjc3NzcgICAgICAgIHpm c19mcmVlYnNkX2xvb2t1cDpyZXR1cm4gemZzX2ZyZWVic2RfbG9va3VwIDo6IDEwNjE4ODU1NzgN Cj4+ICAgICA5ICAyNzc3NyAgICAgICAgemZzX2ZyZWVic2RfbG9va3VwOnJldHVybiB6ZnNfZnJl ZWJzZF9sb29rdXAgOjogMTEyODMNCj4+DQo+PiBBdCB0aGlzIHBvaW50IHRoZSBjbGllbnQgY2xv c2VzIHRoZSBjb25uZWN0aW9uIGFuZCB0aGUgY29ubmVjdGVkLCBzYW1iYSBzZXJ2ZXIgcHJvY2Vz cyBleGl0cy4NCj4+DQo+PiBBZnRlciBpbmNyZWFzaW5nIHRoZSB2bm9kZXMgdG8gMk0sIHRoZSB3 aXJlIHRyYW5zZmVyIG9mIHRoZSBkaXJlY3RveSBsaXN0aW5nIGNvbXBsZXRlcw0KPj4gaW4gYWJv dXQgNjAgc2Vjb25kcyB3aXRoIHRoZSBmaW5hbCAibm8gbW9yZSBmaWxlcyIgcmVzcG9uc2Ugc3Rh dHVzIG9ic2VydmVkLA0KPj4gYW5kIHdpbi1leHBsb3JlciBjb2dpdGF0ZXMgb24gdGhlIGRhdGEg Zm9yIGFib3V0IGFub3RoZXIgMiBtaW51dGVzDQo+PiBiZWZvcmUgY29udHJvbCBpcyByZXR1cm5l ZCB0byB3aW4tZXhwbG9yZXIuDQo+Pg0KPj4gVGhhbmtzIGZvciBhbnkgZmVlZCBiYWNrLg0KPj4N Cj4+IC0tDQo+PiBEYXZlIEJhdWt1cw0KPj4gX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX18NCj4+IGZyZWVic2QtZnNAZnJlZWJzZC5vcmcgbWFpbGluZyBsaXN0 DQo+PiBodHRwczovL2xpc3RzLmZyZWVic2Qub3JnL21haWxtYW4vbGlzdGluZm8vZnJlZWJzZC1m cw0KPj4gVG8gdW5zdWJzY3JpYmUsIHNlbmQgYW55IG1haWwgdG8gImZyZWVic2QtZnMtdW5zdWJz Y3JpYmVAZnJlZWJzZC5vcmciDQo+IC4NCj4NCg== From owner-freebsd-fs@freebsd.org Thu Mar 29 15:35:47 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AC687F5508E for ; Thu, 29 Mar 2018 15:35:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4A9FA74302 for ; Thu, 29 Mar 2018 15:35:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 8E13C247A9 for ; Thu, 29 Mar 2018 15:35:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w2TFZkU3093570 for ; Thu, 29 Mar 2018 15:35:46 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w2TFZkc6093569 for freebsd-fs@FreeBSD.org; Thu, 29 Mar 2018 15:35:46 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 196799] Lock order reversal after shutting down ZFS root system. Date: Thu, 29 Mar 2018 15:35:07 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Mar 2018 15:35:47 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D196799 --- Comment #2 from Andriy Gapon --- (In reply to Dom from comment #1) Diagnostic messages don't necessarily imply a bug. If you see the message but do not ever see any problem related to it, then = you can ignore it. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Thu Mar 29 17:38:02 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A2DC0F66394 for ; Thu, 29 Mar 2018 17:38:02 +0000 (UTC) (envelope-from spork@bway.net) Received: from smtp1.bway.net (smtp1.bway.net [216.220.96.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 50D207A422; Thu, 29 Mar 2018 17:38:02 +0000 (UTC) (envelope-from spork@bway.net) Received: from frankentosh.sporklab.com (pool-71-187-162-242.nwrknj.fios.verizon.net [71.187.162.242]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) (Authenticated sender: spork@bway.net) by smtp1.bway.net (Postfix) with ESMTPSA id DEAC395855; Thu, 29 Mar 2018 13:37:55 -0400 (EDT) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: Re: smart(8) Call for Testing From: Charles Sprickman In-Reply-To: Date: Thu, 29 Mar 2018 13:37:55 -0400 Cc: Chuck Tuffli , Rainer Duffner , Tom Evans via freebsd-fs Content-Transfer-Encoding: quoted-printable Message-Id: <21F62A27-17F2-4791-BFD5-99057D197E68@bway.net> References: <4754cb2f-76bb-a69b-0cf5-eff4d621eb29@callfortesting.org> <1d3f2cef-4c37-782e-7938-e0a2eebc8842@quip.cz> <7ED27465-1BC2-4522-873E-9ECE192EB7A2@ultra-secure.de> To: lev@FreeBSD.org X-Mailer: Apple Mail (2.3273) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Mar 2018 17:38:02 -0000 --=20 Charles Sprickman NetEng/SysAdmin Bway.net - New York's Best Internet www.bway.net spork@bway.net - 212.982.9800 > On Mar 29, 2018, at 9:43 AM, Lev Serebryakov wrote: >=20 > On 29.03.2018 16:27, Chuck Tuffli wrote: >=20 >>>> Maybe one of the vendors who sells FreeBSD as part of an appliance = has shown some interest in this? >>>>=20 >>>> If you=E2=80=99re hardware is well-defined and thus the output is = consistent, I could imagine it=E2=80=99s not too difficult to parse = this. >>> smartd is very important part of smartmontools, smartctl is not so. >>>=20 >>> And periodic self-test triggering & check is most important feature = of >>> smartd, IMHO. >>>=20 >>> Modern HDDs are liers in SMART. And only regular self-test discover >>> real errors on surfaces in my experience. >>>=20 >>> So, tool without support for HDD self-tests is of little usage for >>> appliances, IMHO. >=20 >> Thank you for the feedback! As I don't have any experience with >> smartd, can you help me better understand which parts of it are most >> useful to you? Is it just periodically triggering the self test or >> are there other features as well? For example, logging the SMART >> values, emailing / triggering notifications when certain criteria are >> met, monitoring the self tests, reading the error logs, etc.? >=20 > Triggering of short and full self-tests and alerting (via e-mail) = when > test failed. >=20 > Monitoring of values and alerting is VERY important (number of > Relocations is main indicator of spinning HDD health and when it = raises > it must be known ASAP), but it could be implemented with simple = smart(8) > utility and some scripting, so this is not problem. It would be nice if we could grab these values via snmp=E2=80=A6 Right = now I use either nrpe or check_by_ssh in nagios to run scripts to parse smartctl = output and it would be weird to have SMART functions in base but not have that tied to the stock snmpd. =20 > But all my dead HDDs were replaced on self-test fail =E2=80=94 it is = what > allows me to replace them BEFORE data were lost. Yep, lots of folks claim the data is useless, but generally I see some = signs of failure before the drive dies, and sometimes those signs are spotted = because smartd is triggering regular self-tests. And on SSDs, watching the MWI = seems=20 to work very well - these drives are much smarter (no pun intended) than = spinny=20 disks. Charles >=20 > --=20 > // Lev Serebryakov From owner-freebsd-fs@freebsd.org Thu Mar 29 17:49:21 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BC896F6739F for ; Thu, 29 Mar 2018 17:49:21 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-it0-x22e.google.com (mail-it0-x22e.google.com [IPv6:2607:f8b0:4001:c0b::22e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 449747ACE3 for ; Thu, 29 Mar 2018 17:49:21 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-it0-x22e.google.com with SMTP id r19-v6so9179997itc.0 for ; Thu, 29 Mar 2018 10:49:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc; bh=eB1mgsp1sun/EQ2JVDwrniEKfhqrBiXUgclACkkkyjg=; b=qtq1VfszFFmRqRa2tqS+HgzkTnRYHe4lM8twoL3/skb7g2wzGreQA56ngxvONtsW+G XtyGvVFq6F3KQbttfSx8qfNOEdZUojWlSVdiZyV93/R+o4Guw03SM4okwj6e9So0oovv m7oRMyeQTNAddeWcRhJOJNZl1KoKkHcbSFpP14dqQR9EZkem6RhyTzgjfDo2NmqshfHL cUaBqlghkuUCEj6itaA71H9ixdujz58tL+lzd2M36Wft+M9gwAhwZZ+S5vHhPNwKbQQ1 om8y1zFW6MTuRXgJADO2hPlk/L3KzL07S2R6D/QJsZ/9coUfnX9clwADteeJCk1cwbkS GU3g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc; bh=eB1mgsp1sun/EQ2JVDwrniEKfhqrBiXUgclACkkkyjg=; b=CjMtS/34RCTIlcevCLkZIFGDp0+Cgg/Xz6pRTGmqgCFsfCW/hGMhTDqcyLnWyI/WIB xJiHrBXGQepwMiRP5CukcuJF9RoCec89/sNtBfhoUuu3aegByJzZvpGtuFXMWoR6dAQY /jd21OaiDdNY4NoR79A1USO8QWwQxn4LS3X3iAk0/375UnjzBPfF4BckqOlb/q3Nehxw 2pPpePAqn1BBd8pt9aBE0jHX/0Jz742SASlOrrEzVXJkDKPMe64ziju8xztRBoroNwQd OBUhhrTByk+kQoGDzoxFtagqWICfubYK0NxFND/P+XPWQTS7lafu21wjmUGvHhE2EHEQ GC+g== X-Gm-Message-State: AElRT7GkJ01hs/tIBKj1XQANUD5Lr/KKL0sUsIB4hm+F416kt+nEBg9L js3ElJqmGsNGs/8/gvm9gtvuddTHoFhg7idjAdjlzw== X-Google-Smtp-Source: AIpwx4/MlyJDYqHe9p4ERX6fzh6ydGKLoDV3FPvYkpdo+7wXJ1t2bAgjfRGZx7aPiOuoW7VGI3pkVDP0B1ZbVPUq4zk= X-Received: by 2002:a24:b649:: with SMTP id d9-v6mr8847921itj.51.1522345760497; Thu, 29 Mar 2018 10:49:20 -0700 (PDT) MIME-Version: 1.0 Sender: wlosh@bsdimp.com Received: by 10.79.203.196 with HTTP; Thu, 29 Mar 2018 10:49:19 -0700 (PDT) X-Originating-IP: [2603:300b:6:5100:1052:acc7:f9de:2b6d] In-Reply-To: <21F62A27-17F2-4791-BFD5-99057D197E68@bway.net> References: <4754cb2f-76bb-a69b-0cf5-eff4d621eb29@callfortesting.org> <1d3f2cef-4c37-782e-7938-e0a2eebc8842@quip.cz> <7ED27465-1BC2-4522-873E-9ECE192EB7A2@ultra-secure.de> <21F62A27-17F2-4791-BFD5-99057D197E68@bway.net> From: Warner Losh Date: Thu, 29 Mar 2018 11:49:19 -0600 X-Google-Sender-Auth: YZHFGWB3m5l-9ZFd1jOxeLgSypo Message-ID: Subject: Re: smart(8) Call for Testing To: Charles Sprickman Cc: Lev Serebryakov , Tom Evans via freebsd-fs Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Mar 2018 17:49:22 -0000 On Thu, Mar 29, 2018 at 11:37 AM, Charles Sprickman via freebsd-fs < freebsd-fs@freebsd.org> wrote: > > > But all my dead HDDs were replaced on self-test fail =E2=80=94 it is wh= at > > allows me to replace them BEFORE data were lost. > > Yep, lots of folks claim the data is useless, but generally I see some > signs of > failure before the drive dies, and sometimes those signs are spotted > because > smartd is triggering regular self-tests. And on SSDs, watching the MWI > seems > to work very well - these drives are much smarter (no pun intended) than > spinny > disks. SMART lives in that area between "not reliably useful" and "sometimes interesting". It's a kinda good enough system that kinda sorta signals things, sometimes, if you are luck. We've found at $WORK that many of the metrics are suggestive and help us monitor overall storage health, but only because we look at specific ones, and look for trends and outliers form the rest of the herd. For that it can be mildly useful. For example, we found that the %life used jumped suddenly on some systems that had new firmware deployed and discovered a overly aggressive writing bug in our control software (to be fair, it was in the database back end rebalancing tables for each row insert due to bugs in it, so a 100MB table wound up generating 100GB in writes). We've also used it to identify certain machines with excessively high write amp which turned out to be a different issue that was easily fixed. If you know what to look for, and have a lot of experience with the drives, the SMART data can be quite useful. So it's useful, but not without some experience and a very large sample to use to find outliers. We don't bother to use it for drive failure. While scanning is nice, it's too invasive to do on a regular basis. Sometimes we use it to force errors on drives we already suspect of being bad, but usually we run the drive until it fails then throw the data that was on it away (Work is Netflix Open Connect caching servers, so we lose nothing if we dump the data since it's just copies of copies). Once the drive fails (or becomes too unreliable short of total failure), we fail it in place and just ignore it from that point forward and suffer from reduced capacity. But failures are driven by actual I/O errors, not by SMART data. Warner From owner-freebsd-fs@freebsd.org Thu Mar 29 20:26:16 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0EE0FF743C4 for ; Thu, 29 Mar 2018 20:26:16 +0000 (UTC) (envelope-from alexvpetrov@gmail.com) Received: from mail-lf0-x231.google.com (mail-lf0-x231.google.com [IPv6:2a00:1450:4010:c07::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6AA8B8336A for ; Thu, 29 Mar 2018 20:26:15 +0000 (UTC) (envelope-from alexvpetrov@gmail.com) Received: by mail-lf0-x231.google.com with SMTP id p142-v6so10069057lfd.6 for ; Thu, 29 Mar 2018 13:26:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=to:from:subject:openpgp:message-id:date:user-agent:mime-version :content-language:content-transfer-encoding; bh=YjLZR7eMPyamEZEJUtf0w7spTJMK3TXgyYSZwPV+DkY=; b=JZ30M06YDM52D9jDmJ+muQxOHiD/utJ0k9tE3jDF1IAwJqCeZ0qxKlIaH4H0tC3NyI lPIcBJDMS9RbX2EGCH0V8HRn0H/vf1sXg5CukzqaQvwCLWIYm2kVLJh0gAUtpGH4lFU+ VAkawtMNm0/z+Zj9uo4zMdB7gomr/Z9UwENfbq8XOf5uWFCVm83PxJ5o0Ogq2DKZW+sL PSQqbolwvUo0DmiVLSR5tOcYyn62BGcIywmFLPezNPgh59xkg7UvKUlacTX5LKsb2Xv5 xcCUJLAXSu9a87x+h3xLI2QggTnN/NyoMcx6a7agROtu4CYd2gYR3ywpoWC8C/CRKdpq Ns9w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:to:from:subject:openpgp:message-id:date :user-agent:mime-version:content-language:content-transfer-encoding; bh=YjLZR7eMPyamEZEJUtf0w7spTJMK3TXgyYSZwPV+DkY=; b=GkB8X2hRW2wbj+KWZ2mF52phORjhtPC4XP57yUvtqMYr7kKT4Wd8ioNOH4LvINI/n0 5H7SsfqmXqip8/FqVfJFj/LCerF/LoWfHc5Gkcz4CA3EF2ZSbth3gKtd5VR129zH2OQY fK0l4OkcFQqckfz5N7o9g2Hkaur9jhtK6aq8xgS38Ld+aQ3DOETVQm5ttloC3frKh9fX 6xhk7nn3ePoCqQWOBRf7/M0cQCVc62MItaDk/4DwU7dsohOzKDiTWc1BsArn6FZqAur4 f7/kcEzWYhZPVe675kxSHf3agIirQnt+kyJWhZfPkKHEWumSqt+X+7wIpJerdEn+Kx15 aGRQ== X-Gm-Message-State: ALQs6tCf18+AkEWfbpFGfD8zRtrtC11tj74mLFs6YHj0uTHQKSeRP42C ZqLrwXGlch95yiGyAUeKTL+ATA== X-Google-Smtp-Source: AIpwx4/Z1n595Hz8nVagJNFdzMDvLVsWDUU6e8MAfb6HYi0AVk5FsmPK2GyumHWGWjnyjd355QTjMg== X-Received: by 2002:a19:1758:: with SMTP id n85-v6mr2974823lfi.131.1522355173944; Thu, 29 Mar 2018 13:26:13 -0700 (PDT) Received: from alex.super (stone.g-service.ru. [84.22.141.217]) by smtp.googlemail.com with ESMTPSA id t5sm1170359lji.33.2018.03.29.13.26.12 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 29 Mar 2018 13:26:12 -0700 (PDT) To: freebsd-fs@freebsd.org From: "Alex V. Petrov" Subject: Need help for stupid: restotre efi boot Openpgp: preference=signencrypt Message-ID: Date: Fri, 30 Mar 2018 03:26:11 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.7.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Mar 2018 20:26:16 -0000 How restore efi boot, after command: gpart bootcode -b /boot/pmbr -p /boot/gptzfsboot -i 1 ada0 FreeBSD 12, installing defaultly to zfsroot. -- ----- Alex. From owner-freebsd-fs@freebsd.org Fri Mar 30 18:15:42 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9B4A8F5340D for ; Fri, 30 Mar 2018 18:15:42 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mx0.gentlemail.de (mx0.gentlemail.de [IPv6:2a00:e10:2800::a130]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 2771074086 for ; Fri, 30 Mar 2018 18:15:42 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mh0.gentlemail.de (ezra.dcm1.omnilan.net [78.138.80.135]) by mx0.gentlemail.de (8.14.5/8.14.5) with ESMTP id w2UIFfZa002497; Fri, 30 Mar 2018 20:15:41 +0200 (CEST) (envelope-from freebsd@omnilan.de) Received: from titan.inop.mo1.omnilan.net (s1.omnilan.de [217.91.127.234]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mh0.gentlemail.de (Postfix) with ESMTPSA id C6538DD4; Fri, 30 Mar 2018 20:15:40 +0200 (CEST) Message-ID: <5ABE7ECC.9070109@omnilan.de> Date: Fri, 30 Mar 2018 20:15:40 +0200 From: Harry Schmalzbauer Organization: OmniLAN User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; de-DE; rv:1.9.2.8) Gecko/20100906 Lightning/1.0b2 Thunderbird/3.1.2 MIME-Version: 1.0 To: "Alex V. Petrov" CC: freebsd-fs@freebsd.org Subject: Re: Need help for stupid: restotre efi boot References: In-Reply-To: Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 8bit X-Greylist: ACL 130 matched, not delayed by milter-greylist-4.2.7 (mx0.gentlemail.de [78.138.80.130]); Fri, 30 Mar 2018 20:15:41 +0200 (CEST) X-Milter: Spamilter (Reciever: mx0.gentlemail.de; Sender-ip: 78.138.80.135; Sender-helo: mh0.gentlemail.de; ) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 30 Mar 2018 18:15:42 -0000 Bezüglich Alex V. Petrov's Nachricht vom 29.03.2018 22:26 (localtime): > How restore efi boot, after command: > gpart bootcode -b /boot/pmbr -p /boot/gptzfsboot -i 1 ada0 Hmm, I'm not sure I understand your problem, but I guess ada0p1 might have been your "efi" partition before you corrupted it with the command you quoted. If so, just do: newfs_msdos /dev/ada0p1 mount_msdosfs /dev/ada0p1 /mnt mkdir -p /mnt/EFI/BOOT cp /boot/boot1.efi /mnt/EFI/BOOT/BOOTx64.efi echo "BOOTx64.efi" > /mnt/EFI/BOOT/startup.nsh The latter is optinal for most UEFI implementations, likewise is the partition type (which should be "!c12a7328-f81f-11d2-ba4b-00a0c93ec93b" – gpart knows it under the alias "efi"). I'd suggest you check with "gaprt show ada0" and "gpart modify -t efi -i 1 ada0" before the newfs! Hope this helps, -harry From owner-freebsd-fs@freebsd.org Fri Mar 30 20:53:41 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7E30CF682E5 for ; Fri, 30 Mar 2018 20:53:41 +0000 (UTC) (envelope-from alexvpetrov@gmail.com) Received: from mail-lf0-x234.google.com (mail-lf0-x234.google.com [IPv6:2a00:1450:4010:c07::234]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id CFD247F610 for ; Fri, 30 Mar 2018 20:53:40 +0000 (UTC) (envelope-from alexvpetrov@gmail.com) Received: by mail-lf0-x234.google.com with SMTP id z143-v6so13862237lff.3 for ; Fri, 30 Mar 2018 13:53:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:to:cc:references:from:openpgp:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=Jd7nOz9f553rC/UX156ppV4nPmSeNrDj8Q7vrJzH8PQ=; b=jylrcweyHfQ6/MZTuwjoDVqmV4Mq6McSHlmuUhZSF7z2mNYcxFqwmryK9lRQtgcGp4 A8N3fIMEw4dqcn4JoK+o5pui867CRxA48Vu4S4XdoX7R50nFmJvQnb9rgKRhhNTkYya4 JTeAWaw6bL5P9r201IMtX9grAVeD0X8YnFMm1/rDScNn9WjmTJkA9ZH2r1i/zHFGjZqo nRZ1zxpsMIm0UU96AJXJnTrck/SfxG+uNLsnnJmZ1O/kz42U66VGqyaJUiFBt0nt5MQG zX9EM44ibVbr5osOoGn5RujXzrQ+9cqi4v4rIOLxiLo+ev/GNRtTL+a4gMUpplR3keMN jxEw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:openpgp:message-id :date:user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=Jd7nOz9f553rC/UX156ppV4nPmSeNrDj8Q7vrJzH8PQ=; b=qrYsd1q4AjA2TenO8/czKDoywgWMk9kT8Z0r8ChnGKkHWhvmIOcKKYimiUvoGsGcVa 4NcrAj/a8VActfIOJqm37QA3JwLz3Cjz+YyZ9PJVvujN+rL1pdN2G3ag+CaqGumdKxVB RzLXYUiqvFZt2WGBgmVebdFUGu8SA/S5Llv7vysdEWkpSwBOE9UfKE1fSxnCCWO5qq1p zFv4/Nile1FrSY8AlhF9jM7NiSWJLnWoPDAtDvQfmPmshafRPbcu6ahiPcZiD4f/Jl3c 1ZmS+59ysK17U6iKdu5ZG7alVnu8fqLJs9Ey43SIejb95tY5he+fS246GdVge53yAdOV FYdw== X-Gm-Message-State: ALQs6tCSW48owj786OBI6AopPzT5VLTckNR/sEjmP2ExGgJVa9QP/juV oeWWExWVcQsvisK1XoAe5fodQA== X-Google-Smtp-Source: AIpwx48un57TFBI74QDQGMbDGweIPa0whDeyEnDy9SXWNhNG0sT41SDgbpmE50wBhbo02XFL+3qJpg== X-Received: by 10.46.91.21 with SMTP id p21mr279648ljb.38.1522443218895; Fri, 30 Mar 2018 13:53:38 -0700 (PDT) Received: from alex.super (stone.g-service.ru. [84.22.141.217]) by smtp.googlemail.com with ESMTPSA id q18sm1612556ljg.35.2018.03.30.13.53.36 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 30 Mar 2018 13:53:37 -0700 (PDT) Subject: Re: Need help for stupid: restotre efi boot To: Harry Schmalzbauer Cc: freebsd-fs@freebsd.org References: <5ABE7ECC.9070109@omnilan.de> From: "Alex V. Petrov" Openpgp: preference=signencrypt Message-ID: Date: Sat, 31 Mar 2018 03:53:35 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.7.0 MIME-Version: 1.0 In-Reply-To: <5ABE7ECC.9070109@omnilan.de> Content-Type: text/plain; charset=UTF-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 30 Mar 2018 20:53:41 -0000 31.03.2018 01:15, Harry Schmalzbauer пишет: > Bezüglich Alex V. Petrov's Nachricht vom 29.03.2018 22:26 (localtime): >> How restore efi boot, after command: >> gpart bootcode -b /boot/pmbr -p /boot/gptzfsboot -i 1 ada0 > > Hmm, I'm not sure I understand your problem, but I guess ada0p1 might > have been your "efi" partition before you corrupted it with the command > you quoted. > If so, just do: > newfs_msdos /dev/ada0p1 > mount_msdosfs /dev/ada0p1 /mnt > mkdir -p /mnt/EFI/BOOT > cp /boot/boot1.efi /mnt/EFI/BOOT/BOOTx64.efi > echo "BOOTx64.efi" > /mnt/EFI/BOOT/startup.nsh > > The latter is optinal for most UEFI implementations, likewise is the > partition type (which should be "!c12a7328-f81f-11d2-ba4b-00a0c93ec93b" > – gpart knows it under the alias "efi"). > I'd suggest you check with "gaprt show ada0" and "gpart modify -t efi -i > 1 ada0" before the newfs! > > Hope this helps, > > -harry Thanks for the answer. For me, the solution was: dd if=/boot/boot1.efifat of=/dev/ada0p1 -- ----- Alex. From owner-freebsd-fs@freebsd.org Fri Mar 30 21:07:22 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 97577F6A1E3 for ; Fri, 30 Mar 2018 21:07:22 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mx0.gentlemail.de (mx0.gentlemail.de [IPv6:2a00:e10:2800::a130]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1E9A07FE50 for ; Fri, 30 Mar 2018 21:07:22 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mh0.gentlemail.de (mh0.gentlemail.de [IPv6:2a00:e10:2800::a135]) by mx0.gentlemail.de (8.14.5/8.14.5) with ESMTP id w2UL7LSH004212; Fri, 30 Mar 2018 23:07:21 +0200 (CEST) (envelope-from freebsd@omnilan.de) Received: from titan.inop.mo1.omnilan.net (s1.omnilan.de [217.91.127.234]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mh0.gentlemail.de (Postfix) with ESMTPSA id D324EE41; Fri, 30 Mar 2018 23:07:20 +0200 (CEST) Message-ID: <5ABEA704.9050004@omnilan.de> Date: Fri, 30 Mar 2018 23:07:16 +0200 From: Harry Schmalzbauer Organization: OmniLAN User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; de-DE; rv:1.9.2.8) Gecko/20100906 Lightning/1.0b2 Thunderbird/3.1.2 MIME-Version: 1.0 To: "Alex V. Petrov" CC: freebsd-fs@freebsd.org Subject: Re: Need help for stupid: restotre efi boot References: <5ABE7ECC.9070109@omnilan.de> In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.7 (mx0.gentlemail.de [IPv6:2a00:e10:2800::a130]); Fri, 30 Mar 2018 23:07:21 +0200 (CEST) X-Milter: Spamilter (Reciever: mx0.gentlemail.de; Sender-ip: ; Sender-helo: mh0.gentlemail.de; ) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 30 Mar 2018 21:07:22 -0000 Bezüglich Alex V. Petrov's Nachricht vom 30.03.2018 22:53 (localtime): > 31.03.2018 01:15, Harry Schmalzbauer пишет: >> Bezüglich Alex V. Petrov's Nachricht vom 29.03.2018 22:26 (localtime): >>> How restore efi boot, after command: >>> gpart bootcode -b /boot/pmbr -p /boot/gptzfsboot -i 1 ada0 >> >> Hmm, I'm not sure I understand your problem, but I guess ada0p1 might >> have been your "efi" partition before you corrupted it with the command >> you quoted. >> If so, just do: >> newfs_msdos /dev/ada0p1 >> mount_msdosfs /dev/ada0p1 /mnt >> mkdir -p /mnt/EFI/BOOT >> cp /boot/boot1.efi /mnt/EFI/BOOT/BOOTx64.efi >> echo "BOOTx64.efi" > /mnt/EFI/BOOT/startup.nsh >> >> The latter is optinal for most UEFI implementations, likewise is the >> partition type (which should be "!c12a7328-f81f-11d2-ba4b-00a0c93ec93b" >> – gpart knows it under the alias "efi"). >> I'd suggest you check with "gaprt show ada0" and "gpart modify -t efi -i >> 1 ada0" before the newfs! >> >> Hope this helps, >> >> -harry > > > Thanks for the answer. > For me, the solution was: > dd if=/boot/boot1.efifat of=/dev/ada0p1 mount_msdosfs -o ro /dev/`mdconfig -a -t vnode -o readonly -f /boot/boot1.efifat` /mnt ls -lR /mnt/ The result is essentially the same. But the pre-imaged /boot/boot1.efifat most likely doesn't match your partition size. Not a real problem, but I always prefere the clean way – and for understanding. Likewise this post-note is meant for anybody else who stumbles across this thread and isn't ware about /boot/loader1.efifat. -harry From owner-freebsd-fs@freebsd.org Fri Mar 30 21:31:25 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E5725F6BAB8 for ; Fri, 30 Mar 2018 21:31:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 80A8780D49 for ; Fri, 30 Mar 2018 21:31:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id B2BA9142A7 for ; Fri, 30 Mar 2018 21:31:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w2ULVNLe053110 for ; Fri, 30 Mar 2018 21:31:23 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w2ULVNWl053109 for freebsd-fs@FreeBSD.org; Fri, 30 Mar 2018 21:31:23 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 219972] Unable to zpool export following some zfs recv Date: Fri, 30 Mar 2018 21:31:23 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: pfribeiro@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 30 Mar 2018 21:31:25 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D219972 --- Comment #11 from pfribeiro@gmail.com --- (In reply to Matthias Pfaller from comment #10) I just installed a fresh 11.1-RELEASE (r321309) and can see that the issue I reported is still there. I don't seem to recall having had a problem with reboot getting stuck. It's just that rebooting is necessary to get the pool unstuck. Following the next boot it is in some kind of dormant state, (UNAVAIL?) but can be exported successfully. I would like to add that in my `dtrace` output the call trace is exactly li= ke that of Matthias. I've tried playing with cpuset to change the cores available to the schedul= er, as well as on a per process basis, but couldn't work around the problem with zfs export. For the lack of a better workaround, I've added 'dd if=3D/dev/z= ero of=3Ddev/null' around my usage of zpool export as follows: dd if=3D/dev/zero of=3D/dev/null bs=3D1024k & PIDDD=3D$! zpool export -f backup kill -9 $PIDDD First I spawn a concurrent dd, and then once the export terminates I kill i= t. In this way I don't seem to get a busy pool even when doing zfs import/expo= rt many, many times after the zfs recv. Perhaps this can give someone a hint of where the problem may lie. Would be nice to get a bug fix, though :) --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Sat Mar 31 05:16:15 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CFA73F5A3FE for ; Sat, 31 Mar 2018 05:16:14 +0000 (UTC) (envelope-from editor@callfortesting.org) Received: from mail-pg0-x22c.google.com (mail-pg0-x22c.google.com [IPv6:2607:f8b0:400e:c05::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4C9CF720BF for ; Sat, 31 Mar 2018 05:16:14 +0000 (UTC) (envelope-from editor@callfortesting.org) Received: by mail-pg0-x22c.google.com with SMTP id t12so6178617pgp.13 for ; Fri, 30 Mar 2018 22:16:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=callfortesting-org.20150623.gappssmtp.com; s=20150623; h=subject:to:cc:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=9wiIW24jfaCWHvT2Ww7yQFOI58Tar4qEO64BYuuNf+c=; b=Y7MotsVQKXUGsIK45uGaIumepvwCaj6pVyWBmE1yiOwtIkap286EBKBYc6hbDzUZpN 2DytAL8yJYzJzzArtreN6+WUz2Ai2LG9FMVSnB5zvAABl1hJa5vH0Dmt97yxAWJED+ih jXwAzZe6TxPcs1MWKcGB76O4ULYo/5lf2UaAbN83MsmvJwkh4D8ixD56lSckUVgZVama D2aGKEkcqJo63X5903k2wfboL97diOlLPGrwSB5O0VReEIg2of+u/TFf1VAT7EUIadhF r5SfU9Ly7B3vMXe53PLA7488xzS1SzKjUbqt8Qmf4VHFNel5p6qW4SRnrYH9rzBYYEa4 qVCQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=9wiIW24jfaCWHvT2Ww7yQFOI58Tar4qEO64BYuuNf+c=; b=pfuSwKf12sEFGY0VtAHQZ1MbORSc0oQC7YOhslwQmE5EbBbXQofpwxZH7AgZFxhaxM 3f9cGBB+yu4KHpgMlmq+lCRdrJa3AF/AYWwLzmWDkdrtK37/4aDc9lApjzb2VpLR1lZ7 +/6bi13QyUvAmzx//EX14+U/6Nz622nqOZrAKLtuUz+J7z8HrHNO+ieKO9BywXMWCmxJ PgSVI+dNAuoEqo4sN+NHtpgJFbKZ3NusairUAGik6iAjqTm6lvwJAit7ZoJRSzFXlUQ+ sDgx+2zPF3/qH4flpHCkEnBP4nwMspY4jR6oyC9hS5VakqIbqX/P+9o4r//PotwrWH43 WN5w== X-Gm-Message-State: AElRT7Fg+4m8JK8QAGS2ZSuNRQU4QzTg83zXktGxIdis+2Eu5nmfa58U rSuHoTUcO6Uz6niouDXe6xuJiGis X-Google-Smtp-Source: AIpwx4/CL0VGyVQP4Igcj+aqDKeIOBb2nvwxFIq/DCtePlJI/C5KJUDPn3BgSYOxtl+ECnj+sfs6bg== X-Received: by 2002:a17:902:8545:: with SMTP id d5-v6mr1795296plo.20.1522473372706; Fri, 30 Mar 2018 22:16:12 -0700 (PDT) Received: from macbook-2.local (c-67-170-143-17.hsd1.or.comcast.net. [67.170.143.17]) by smtp.gmail.com with ESMTPSA id z9sm18560016pfg.183.2018.03.30.22.16.11 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 30 Mar 2018 22:16:11 -0700 (PDT) Subject: Re: smart(8) Call for Testing To: lev@FreeBSD.org, Chuck Tuffli Cc: Tom Evans via freebsd-fs References: <4754cb2f-76bb-a69b-0cf5-eff4d621eb29@callfortesting.org> <1d3f2cef-4c37-782e-7938-e0a2eebc8842@quip.cz> <7ED27465-1BC2-4522-873E-9ECE192EB7A2@ultra-secure.de> From: Michael Dexter Message-ID: <4ac57e03-f5c5-d6f1-d7a8-595398f49015@callfortesting.org> Date: Fri, 30 Mar 2018 22:16:09 -0700 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 Mar 2018 05:16:15 -0000 On 3/29/18 6:43 AM, Lev Serebryakov wrote: > Monitoring of values and alerting is VERY important (number of > Relocations is main indicator of spinning HDD health and when it raises > it must be known ASAP) Another metric that frequently came up during outreach was any sudden increase in disk latency, usually indicating that you have between one and 24 hours to replace the device. I am curious what people are doing now to determine such changes in latency and where they feel such monitoring should exist in the stack. As for SNMP and friends, I consider those way up the stack with tools like smart(8) simply providing a building block. Michael From owner-freebsd-fs@freebsd.org Sat Mar 31 15:13:26 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CC09DF6892E for ; Sat, 31 Mar 2018 15:13:25 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-it0-x22b.google.com (mail-it0-x22b.google.com [IPv6:2607:f8b0:4001:c0b::22b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5B57987AD7 for ; Sat, 31 Mar 2018 15:13:25 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-it0-x22b.google.com with SMTP id r19-v6so14580620itc.0 for ; Sat, 31 Mar 2018 08:13:25 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc; bh=HPyL6nsIDJPeHhtB57aDL5g5inwhi/gMnxxzdD+E8n0=; b=Vzch5tZmSV4rmAa6fifQI/sPFRH2ybCpOWXO9WRjuJzZHocC4xK0UOpifhe39KBVCW qlpwQQ2c4S9rUjgEsVYVL35OZz2LSFwzM5SlFgeaPNLhoPFJjKg+ftAX5PHJfV69s4aO sN0F4se6H9qSU9BauYxsM0RNvfS4Ki4MMln9Hkzje5vQPRvm59qVvNMlVtDDqOYF/fjD WwGZiJs8fBmqQzcDIXl9GFusaEc4bVa/dpM3MvMA55vsbANvTmQbRlcL3urmyBkBf/dt KfncgeQNeo++j3EV0ifU+HS3/Aq8/vPGUg/GPTSFDbd/IIpggCXLzzibDmeeJG2dAgpU BReg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc; bh=HPyL6nsIDJPeHhtB57aDL5g5inwhi/gMnxxzdD+E8n0=; b=eV0D52JRkI7xTxy/p6Q32k/6jAgzAkiFL7jAxUKgwjpbUooDhkbK3uCjXKn4oqfzJm X32Hv2/KcfcxJsO+lXjjPMWE5RYsDfxxC/uSAkdKO41tdUF2Cf/Ss/SvE9xv3Y6gy2jf OO8ZXs/pTrvnan/BebDSwgaQT8c3u84KuFdFGLsJKETKDiRSz1ARL7SfTK1R2FGDNmih W58+03gCxvtRrU9jaPvT63LG4SFfMQuQPpkbnerwR3vCVUkdY4plp6esF/YGAAiF+Ic+ VZiKX/I/uHN6G7p/kPKfU4ZvzaRrPQvfE/lPk2cjkLThYjvce/Aw1Z4hweHJ67BsszQ2 xGCw== X-Gm-Message-State: ALQs6tCIQBaFaa1VNnkFmIYgcagopRzYShvyDWbJ99V6A1wX25pF+3fO JwvBA0A/TquJ4seWHc3o4AbKVbzQGbT+tXtWb4ilqw== X-Google-Smtp-Source: AIpwx4+fpoHiBEgoYZw3JA2VMMeGLPqLctA76UeEcRJIhRgy2ZdI4ECf55QSgaOhMgD+5iI93zYr78y0szkMPJPJ4QY= X-Received: by 2002:a24:19c9:: with SMTP id b192-v6mr6656343itb.1.1522509204499; Sat, 31 Mar 2018 08:13:24 -0700 (PDT) MIME-Version: 1.0 Sender: wlosh@bsdimp.com Received: by 10.79.203.196 with HTTP; Sat, 31 Mar 2018 08:13:23 -0700 (PDT) X-Originating-IP: [2603:300b:6:5100:1052:acc7:f9de:2b6d] In-Reply-To: <4ac57e03-f5c5-d6f1-d7a8-595398f49015@callfortesting.org> References: <4754cb2f-76bb-a69b-0cf5-eff4d621eb29@callfortesting.org> <1d3f2cef-4c37-782e-7938-e0a2eebc8842@quip.cz> <7ED27465-1BC2-4522-873E-9ECE192EB7A2@ultra-secure.de> <4ac57e03-f5c5-d6f1-d7a8-595398f49015@callfortesting.org> From: Warner Losh Date: Sat, 31 Mar 2018 09:13:23 -0600 X-Google-Sender-Auth: DZ8VQ67s3CNSMZE3cqosFzosr44 Message-ID: Subject: Re: smart(8) Call for Testing To: Michael Dexter Cc: Lev Serebryakov , Chuck Tuffli , Tom Evans via freebsd-fs Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 Mar 2018 15:13:26 -0000 On Fri, Mar 30, 2018 at 11:16 PM, Michael Dexter wrote: > On 3/29/18 6:43 AM, Lev Serebryakov wrote: > >> Monitoring of values and alerting is VERY important (number of >> Relocations is main indicator of spinning HDD health and when it raises >> it must be known ASAP) >> > > Another metric that frequently came up during outreach was any sudden > increase in disk latency, usually indicating that you have between one and > 24 hours to replace the device. I am curious what people are doing now to > determine such changes in latency and where they feel such monitoring > should exist in the stack. > Netflix has a monitoring program that uses gstat to gather average latency stats and send them to our centralized data collection data store. It's really only by looking at the long-term trend that you'll see the spike in retries that manifests itself as bigger latencies. One problem with gstat, though, is that it includes software queueing time which for many things is fine, but when you are trying to determine if the spike is due to extra load on the device or some hardware thing, then it becomes bothersome. The CAM I/O scheduler, when the dynamic scheduler is enabled, keeps all kinds of stats about device latency, including a cumulative latency histogram. Those are also useful things to look at. At Netflix, though, we let the disk fail and then mark it as disabled. We don't look for trends to predict possible failure because we have a fail in place model that doesn't care if there's data loss because all the data on the machine is replicated from a central source of truth and can easily be replaced. > As for SNMP and friends, I consider those way up the stack with tools like > smart(8) simply providing a building block. In many ways, our data collection thing at work is an alternative to SNMP. Warner From owner-freebsd-fs@freebsd.org Sat Mar 31 18:40:40 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 98E63F76EF3 for ; Sat, 31 Mar 2018 18:40:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 34D3D707B2 for ; Sat, 31 Mar 2018 18:40:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 7D53A1F1A7 for ; Sat, 31 Mar 2018 18:40:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w2VIedeV074287 for ; Sat, 31 Mar 2018 18:40:39 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w2VIed4n074284 for freebsd-fs@FreeBSD.org; Sat, 31 Mar 2018 18:40:39 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 225663] FreeBSD 11.1-STABLE on root zfs panics on boot Date: Sat, 31 Mar 2018 18:40:38 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-STABLE X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: roger@wilcis.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 Mar 2018 18:40:40 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225663 Roger changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |roger@wilcis.com --- Comment #4 from Roger --- I can confirm I'm seeing this same issue with checkout in STABLE today r331= 842.=20 Unfortunately the screen only shows the error for less than a second and th= en triggers a reboot. All I can see is some hex dump codes flash by in what s= eems to be exactly the same manner as dog@virtual.org.ua has mentioned. --=20 You are receiving this mail because: You are the assignee for the bug.=