From owner-freebsd-fs@freebsd.org Sun Nov 12 00:07:59 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C5A5CE50CF0 for ; Sun, 12 Nov 2017 00:07:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B3C94746A0 for ; Sun, 12 Nov 2017 00:07:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id vAC07xIb014901 for ; Sun, 12 Nov 2017 00:07:59 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 223612] zfs panic when importing zpool from USB key while system under heavy load Date: Sun, 12 Nov 2017 00:07:59 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 12 Nov 2017 00:07:59 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D223612 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|freebsd-bugs@FreeBSD.org |freebsd-fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Mon Nov 13 02:08:40 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 58322CFC3F0 for ; Mon, 13 Nov 2017 02:08:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 461947D0D7 for ; Mon, 13 Nov 2017 02:08:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id vAD28dnw031841 for ; Mon, 13 Nov 2017 02:08:40 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 222929] ZFS ARC stats have wrong count Date: Mon, 13 Nov 2017 02:08:40 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: allanjude@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 13 Nov 2017 02:08:40 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D222929 --- Comment #1 from Allan Jude --- As discussed at BSDTW, please do the following: zfs-stats -a zfs-stats -a --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Mon Nov 13 04:28:25 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E7EF2CFEA27 for ; Mon, 13 Nov 2017 04:28:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D66E41054 for ; Mon, 13 Nov 2017 04:28:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id vAD4SPdY002645 for ; Mon, 13 Nov 2017 04:28:25 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 222929] ZFS ARC stats have wrong count Date: Mon, 13 Nov 2017 04:28:26 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: naito.yuichiro@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 13 Nov 2017 04:28:26 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D222929 --- Comment #2 from naito.yuichiro@gmail.com --- OK, I will do it when I return to Japan, it will be 2 days later. I=E2=80=99m traveling Taiwan now. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Mon Nov 13 15:03:06 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BC1FFDBCD12; Mon, 13 Nov 2017 15:03:06 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: from mail-it0-x230.google.com (mail-it0-x230.google.com [IPv6:2607:f8b0:4001:c0b::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 81BC9716E4; Mon, 13 Nov 2017 15:03:06 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: by mail-it0-x230.google.com with SMTP id n134so6057897itg.1; Mon, 13 Nov 2017 07:03:06 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc; bh=Iz4CGKm75ZrWfee/fudrzOYV0LehDmQgRkbAY6uYKAE=; b=bPU9HuN4RUhcTzzWUmlluqKX41exsBwuuYSyn9Qw3yFu/Amc8Rxgr484a7N16UaLLL Ia2wMMmpcJA5R49plqz66YSbr22pua7Gq9oiUOBU8DzGc2gi1ScQzxLBismj1Hn+kxgC gQI5M0ziWOnajD6cOcMGOzT4e9Cux1piHhbQoXB1hTS2b038N5Ei8rsWfiT9XNWpCA1f KwmclXKq79UkLGKM2lLFTDXw4VNj2dfuYn0awBBOdLxSIeXgGbeoVxp1p+/lVW2W0lEg NR0aa1vt9ilhcBWPOWqu/OZSvjmYgkq7kn7CJzQ3UhWIAwQ7fG6pZ/EM7pT19qbX2CWZ g2/w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc; bh=Iz4CGKm75ZrWfee/fudrzOYV0LehDmQgRkbAY6uYKAE=; b=m8lguAEtX+t+TnwYySmqUwsw1Cq2qWOPhkMIS7i9DU7VUVP2cO8OjDhLT3+BXLhMrb zh3LTlF9twQsfEQv1VLlbGEZYaqSsPmdgruUL+ep3rdklYLBCg1nn3ErGyqPB4sqoULO s88I768g0VAoB4MFNvrXEKE+hDfLdXV8wWB4meCFntlEPQsL5O9om6hzlbMVajFwqTA4 DRFFxFrU/CGnY4d4ZM8nTCcdkXo3NWWqqLhV9Z9aUcLV6q2NxFg8hs/ZqUSm7Xjviujw BgQFm3uqrTWI90Hy2rwxSSa7Sl/kAdwMuMhO2A1aOHEtEJEcLTnfFDU4xIryQw8woRwv QOAg== X-Gm-Message-State: AJaThX7U6GSDVc/m5WoJpdIfKfMz5wG/KivZP0BZKQYB44XKZSIh8PLC Vg5JEseHe+/afjptUskp4zSyjwv8mP+1TltfUVc9ZQ== X-Google-Smtp-Source: AGs4zMYZZqR0QULXx1ePrAYpwOw+QICKO+ndBV6DvZLwnNHmTgTL8Q7TN0u2y+tyZtyoN5ZYj8C5r6Jo7l8Om18cw5w= X-Received: by 10.36.22.13 with SMTP id a13mr11792564ita.69.1510585385654; Mon, 13 Nov 2017 07:03:05 -0800 (PST) MIME-Version: 1.0 Sender: carpeddiem@gmail.com Received: by 10.107.14.208 with HTTP; Mon, 13 Nov 2017 07:02:45 -0800 (PST) In-Reply-To: <153bfe2b-e65e-2036-3391-984c6ba00ffe@FreeBSD.org> References: <7e5599e4-2faa-29b6-4fb2-a0744a12681a@FreeBSD.org> <1509989176.99235.79.camel@freebsd.org> <153bfe2b-e65e-2036-3391-984c6ba00ffe@FreeBSD.org> From: Ed Maste Date: Mon, 13 Nov 2017 10:02:45 -0500 X-Google-Sender-Auth: nyQsmrCX2r8pVVn2JTRKfcFQzps Message-ID: Subject: Re: [HEADS UP] posix_fallocate support removed from ZFS, lld affected To: Andriy Gapon Cc: Ian Lepore , FreeBSD Current , freebsd-fs@freebsd.org Content-Type: text/plain; charset="UTF-8" X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 13 Nov 2017 15:03:06 -0000 On 7 November 2017 at 13:12, Andriy Gapon wrote: > > I hope that lld is not that widely used now. > But I admit that I put the cart before the horse. > I didn't expect that posix_fallocate is used in the development toolchain and I > didn't try to check for it. For amd64 it is probably not a very large problem; it's not used by default and those who have enabled it can likely adapt. However, it is used by arm64 and is the default linker in FreeBSD 11.1, so we'll need to go with either an errata fix or Kostik's p_osrel suggestion to avoid breaking the package builds. From owner-freebsd-fs@freebsd.org Tue Nov 14 19:34:56 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EDA58DDBDC7 for ; Tue, 14 Nov 2017 19:34:56 +0000 (UTC) (envelope-from SRS0=p6JT=CM=quip.cz=000.fbsd@elsa.codelab.cz) Received: from elsa.codelab.cz (elsa.codelab.cz [94.124.105.4]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B62386C8A4 for ; Tue, 14 Nov 2017 19:34:56 +0000 (UTC) (envelope-from SRS0=p6JT=CM=quip.cz=000.fbsd@elsa.codelab.cz) Received: from elsa.codelab.cz (localhost [127.0.0.1]) by elsa.codelab.cz (Postfix) with ESMTP id 39FCD28412 for ; Tue, 14 Nov 2017 20:34:53 +0100 (CET) Received: from illbsd.quip.test (ip-86-49-16-209.net.upcbroadband.cz [86.49.16.209]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by elsa.codelab.cz (Postfix) with ESMTPSA id 8AC5A2840C for ; Tue, 14 Nov 2017 20:34:52 +0100 (CET) To: freebsd-fs@freebsd.org From: Miroslav Lachman <000.fbsd@quip.cz> Subject: zfs diff: Unable to determine path or stats for object Message-ID: <5A0B455C.1070002@quip.cz> Date: Tue, 14 Nov 2017 20:34:52 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:42.0) Gecko/20100101 Firefox/42.0 SeaMonkey/2.39 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 14 Nov 2017 19:34:57 -0000 Hi, I have a problem with zfs diff on our backup storage. I want to find some details about differencies but it almost always ends with error: # zfs diff tank0/vol0/remote_backup/edith@autodel-2017-11-13_13-48 tank0/vol0/remote_backup/edith@autodel-2017-11-14_13-48 > /tmp/zfs_diff_edith_13_14 Unable to determine path or stats for object 34939 in tank0/vol0/remote_backup/edith@autodel-2017-11-13_13-48: Invalid argument Another two examples of error messages: Unable to determine path or stats for object 108311 in tank0/vol0/remote_backup/elsa@autodel-2017-11-13_13-48: Invalid argument Unable to determine path or stats for object 22061 in tank0/vol0/remote_backup/edith@autodel-2017-11-12_13-48: Invalid argument What this error means? How can I debug and fix this issues? Kind regards Miroslav Lachman From owner-freebsd-fs@freebsd.org Wed Nov 15 01:17:33 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5B27BDBB091 for ; Wed, 15 Nov 2017 01:17:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3F29077A4B for ; Wed, 15 Nov 2017 01:17:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id vAF1HWe8063616 for ; Wed, 15 Nov 2017 01:17:33 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 222929] ZFS ARC stats have wrong count Date: Wed, 15 Nov 2017 01:17:33 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: naito.yuichiro@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 15 Nov 2017 01:17:33 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D222929 --- Comment #3 from naito.yuichiro@gmail.com --- I changed my script as follows. File.stat() loops 5 times, and print `zfs-stats -a` message at first and in end of each loop. ``` puts "#{Time.now} start" puts `zfs-stats -a` 5.times do |c| Dir.glob("ports-head/**/*").each do |file| File.stat(file) end puts "#{Time.now} loop count : #{c}" puts `zfs-stats -a` end ``` The result is shown in attached 'zfs-stat.log' file. Attached `top.log` shows `top` header of before and after running this scri= pt. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed Nov 15 01:18:14 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D8EC5DBB0DF for ; Wed, 15 Nov 2017 01:18:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id C0BE777AD0 for ; Wed, 15 Nov 2017 01:18:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id vAF1IE1B064567 for ; Wed, 15 Nov 2017 01:18:14 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 222929] ZFS ARC stats have wrong count Date: Wed, 15 Nov 2017 01:18:14 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: naito.yuichiro@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 15 Nov 2017 01:18:14 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D222929 --- Comment #4 from naito.yuichiro@gmail.com --- Created attachment 188004 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D188004&action= =3Dedit zfs-stat.log --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed Nov 15 01:18:39 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C05BFDBB123 for ; Wed, 15 Nov 2017 01:18:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id AF1DC77B70 for ; Wed, 15 Nov 2017 01:18:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id vAF1IdjR065148 for ; Wed, 15 Nov 2017 01:18:39 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 222929] ZFS ARC stats have wrong count Date: Wed, 15 Nov 2017 01:18:39 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: naito.yuichiro@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 15 Nov 2017 01:18:39 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D222929 --- Comment #5 from naito.yuichiro@gmail.com --- Created attachment 188005 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D188005&action= =3Dedit top.log --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed Nov 15 01:52:02 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A65E7DBC1AD for ; Wed, 15 Nov 2017 01:52:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9511F78FFD for ; Wed, 15 Nov 2017 01:52:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id vAF1q2i2044013 for ; Wed, 15 Nov 2017 01:52:02 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 222929] ZFS ARC stats have wrong count Date: Wed, 15 Nov 2017 01:52:02 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: allanjude@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 15 Nov 2017 01:52:02 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D222929 --- Comment #6 from Allan Jude --- (In reply to naito.yuichiro from comment #4) This log shows an interesting pattern, where the 'Cache Hit Ratio' goes up during the first run (reaching 58.16k hits total, from 8.73k), but doesn't = go up on the successive runs. I will investigate this further --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed Nov 15 06:56:24 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 911D0DC1567 for ; Wed, 15 Nov 2017 06:56:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 7ECBB80646 for ; Wed, 15 Nov 2017 06:56:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id vAF6uOCp097148 for ; Wed, 15 Nov 2017 06:56:24 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 222929] ZFS ARC stats have wrong count Date: Wed, 15 Nov 2017 06:56:24 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: allanjude@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 15 Nov 2017 06:56:24 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D222929 --- Comment #7 from Allan Jude --- I have confirmed the impact you are seeing, but also confirmed that is not a major bug. If you run: zpool iostat 1 You'll see that running your ruby script will not actually result in any re= ads from the disk. There is a small issue with the stats accounting in ZFS, where if the metad= ata being read, happens to be stored in an "Embedded Block Pointer" (so instead= of being stored as a data block, the data is embedded in the parent block, to = save an entire sector, and to save an I/O to read that sector), then it is incorrectly counted as a miss. This is because to read the embedded block pointer, it has to create a read= zio and go through most of the process of doing a read, but then ends up copying the data out of the block pointer instead of from disk. Anyway, I am investigating a quick fixes to account for the cache hit correctly, instead of as a cache miss. I am also looking to see if it would be relatively simple to optimize the c= ase and return the data more directly in arc_read() instead of creating a zio a= nd going the currently more complicated path. This path mostly exists because = it makes it possible for other functions to not need to know about the embedded block pointer feature. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed Nov 15 08:30:18 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 518B2DD51F1 for ; Wed, 15 Nov 2017 08:30:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3FB4B2D1F for ; Wed, 15 Nov 2017 08:30:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id vAF8UIUf032851 for ; Wed, 15 Nov 2017 08:30:18 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 222929] ZFS ARC stats have wrong count Date: Wed, 15 Nov 2017 08:30:18 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: naito.yuichiro@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 15 Nov 2017 08:30:18 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D222929 --- Comment #8 from naito.yuichiro@gmail.com --- (In reply to Allan Jude from comment #7) Thank you very much to your investigation. My ruby script doesn't read disks actually. I thought this means all metadata is cached. I saw no problem with performance. > Anyway, I am investigating a quick fixes to account for the cache hit=20 > correctly, instead of as a cache miss. I hope your fix. > I am also looking to see if it would be relatively simple to optimize the= case > and return the data more directly in arc_read() instead of creating a zio= and > going the currently more complicated path. This path mostly exists becaus= e it makes > it possible for other functions to not need to know about the embedded bl= ock=20 > pointer feature. I don't know about zfs source codes. But if you need to test your patch in my environment, please ask me. I will test in new boot environment on my PC. I learned the feature in your session in BSDtw! --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Thu Nov 16 22:50:13 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6C761DEBFF9; Thu, 16 Nov 2017 22:50:13 +0000 (UTC) (envelope-from agapon@gmail.com) Received: from mail-lf0-f54.google.com (mail-lf0-f54.google.com [209.85.215.54]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id EF5726EF98; Thu, 16 Nov 2017 22:50:12 +0000 (UTC) (envelope-from agapon@gmail.com) Received: by mail-lf0-f54.google.com with SMTP id i14so677134lfc.1; Thu, 16 Nov 2017 14:50:12 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=VvCxy5pPrv3mkrVY/HdVa/4H6k/pf5NicmBJHO7mB+8=; b=kz9ReBUjY1tVxnyZnvijBPm4rJT2RpGT/ogip9rhUvR3WM5u0rvR5LPwfT54hN1k9e hb+PFYUYHUREiNxE2ipHn4YwoHdrc00QoMbPXF+JAbml3riRX7Cp1qokpyg1rYQh1YbC 0V5asJcpbPSw+7cXIc+OfibwruLAe59A9C+VIO6uU9ucoiWLNs8bEmeLzlMbgM62gS+F JTsUVyMnO8wOemT7AIHXupw5HPI5GG90KUZuwQ5XmWjik2MxKZacnfRREa5HgImt4wvV 0+qJej5pPgPduJ4/GxyLkF2cTGO6JcuBZzoKIce7azsnEs4eu63awHtIAFcxxmTSBfaD GUJg== X-Gm-Message-State: AJaThX4mxns2L6tT6yJDto6KQU4df+B6z1DNwi0Ojz1q2lBkWONSnnZ4 ZjwKf9rcC+EGW95dxMgAMpuy2BDoaU8= X-Google-Smtp-Source: AGs4zMa9nnan30XnIx//KjtHTw3ZKegNQqyWhG+foQcfVG1T4boqZKEf/sEIH6GJjygDNcAXWOX4pg== X-Received: by 10.46.16.76 with SMTP id j73mr1581780lje.170.1510872604723; Thu, 16 Nov 2017 14:50:04 -0800 (PST) Received: from [192.168.0.88] (east.meadow.volia.net. [93.72.151.96]) by smtp.googlemail.com with ESMTPSA id r125sm404050lfr.46.2017.11.16.14.50.02 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 16 Nov 2017 14:50:03 -0800 (PST) Subject: Re: [HEADS UP] posix_fallocate support removed from ZFS, lld affected To: Ed Maste Cc: Ian Lepore , FreeBSD Current , freebsd-fs@freebsd.org References: <7e5599e4-2faa-29b6-4fb2-a0744a12681a@FreeBSD.org> <1509989176.99235.79.camel@freebsd.org> <153bfe2b-e65e-2036-3391-984c6ba00ffe@FreeBSD.org> From: Andriy Gapon Message-ID: Date: Fri, 17 Nov 2017 00:50:01 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.4.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 16 Nov 2017 22:50:13 -0000 On 13/11/2017 17:02, Ed Maste wrote: > On 7 November 2017 at 13:12, Andriy Gapon wrote: >> >> I hope that lld is not that widely used now. >> But I admit that I put the cart before the horse. >> I didn't expect that posix_fallocate is used in the development toolchain and I >> didn't try to check for it. > > For amd64 it is probably not a very large problem; it's not used by > default and those who have enabled it can likely adapt. However, it is > used by arm64 and is the default linker in FreeBSD 11.1, so we'll need > to go with either an errata fix or Kostik's p_osrel suggestion to > avoid breaking the package builds. I agree with that proposal. I think that that is what I should have done from the very start. I need a little bit of help to implement it, though. -- Andriy Gapon