From owner-freebsd-fs@FreeBSD.ORG Mon Oct 20 18:27:28 2014 Return-Path: <owner-freebsd-fs@FreeBSD.ORG> Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 44BAD420 for <freebsd-fs@FreeBSD.org>; Mon, 20 Oct 2014 18:27:28 +0000 (UTC) Received: from citadel.icyb.net.ua (citadel.icyb.net.ua [212.40.38.140]) by mx1.freebsd.org (Postfix) with ESMTP id 9C6966A0 for <freebsd-fs@FreeBSD.org>; Mon, 20 Oct 2014 18:27:22 +0000 (UTC) Received: from porto.starpoint.kiev.ua (porto-e.starpoint.kiev.ua [212.40.38.100]) by citadel.icyb.net.ua (8.8.8p3/ICyb-2.3exp) with ESMTP id VAA25161; Mon, 20 Oct 2014 21:27:14 +0300 (EEST) (envelope-from avg@FreeBSD.org) Received: from localhost ([127.0.0.1]) by porto.starpoint.kiev.ua with esmtp (Exim 4.34 (FreeBSD)) id 1XgHfm-0000pH-De; Mon, 20 Oct 2014 21:27:14 +0300 Message-ID: <544553CA.1060406@FreeBSD.org> Date: Mon, 20 Oct 2014 21:26:18 +0300 From: Andriy Gapon <avg@FreeBSD.org> User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:31.0) Gecko/20100101 Thunderbird/31.1.2 MIME-Version: 1.0 To: Alex <alex@putnichek.ru>, freebsd-fs@FreeBSD.org Subject: Re: l2_io_error and l2_cksum_bad are not null and growing References: <54454739.1070900@putnichek.ru> In-Reply-To: <54454739.1070900@putnichek.ru> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Filesystems <freebsd-fs.freebsd.org> List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-fs>, <mailto:freebsd-fs-request@freebsd.org?subject=unsubscribe> List-Archive: <http://lists.freebsd.org/pipermail/freebsd-fs/> List-Post: <mailto:freebsd-fs@freebsd.org> List-Help: <mailto:freebsd-fs-request@freebsd.org?subject=help> List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>, <mailto:freebsd-fs-request@freebsd.org?subject=subscribe> X-List-Received-Date: Mon, 20 Oct 2014 18:27:28 -0000 On 20/10/2014 20:32, Alex wrote: > Hello. > > We seem to have a problem with l2arc on zfs system on 10.1-BETA1 FreeBSD > 10.1-BETA1 #1 r271710 server. The server has a l2arc cache configured from Intel > SSD 480G disk. The problem is that l2_io_error and l2_cksum_bad values are > constantly growing, however there are no traces of any hardware malfunctioning. > As for now, the values are > kstat.zfs.misc.arcstats.l2_io_error: 1501 > kstat.zfs.misc.arcstats.l2_cksum_bad: 19480 Please see if the following patch might help https://github.com/avg-I/freebsd/compare/review/l2arc-write-target-size.diff > Here is the output of zpool status: > pool: zpool > state: ONLINE > scan: none requested > config: > > NAME STATE READ WRITE CKSUM > zpool ONLINE 0 0 0 > mirror-0 ONLINE 0 0 0 > diskid/DISK-WD-WMC1P0DFSF47p2 ONLINE 0 0 0 > diskid/DISK-WD-WMC1P0DEFERYp2 ONLINE 0 0 0 > logs > gpt/zil0 ONLINE 0 0 0 > cache > gpt/cache0 ONLINE 0 0 0 > > errors: No known data errors > > Here is the output of zfs-stats -L: > ------------------------------------------------------------------------ > ZFS Subsystem Report Mon Oct 20 19:29:38 2014 > ------------------------------------------------------------------------ > > L2 ARC Summary: (DEGRADED) > Passed Headroom: 72.42m > Tried Lock Failures: 360.55m > IO In Progress: 65 > Low Memory Aborts: 101 > Free on Write: 7.09k > Writes While Full: 16.90k > R/W Clashes: 11 > Bad Checksums: 19.48k > IO Errors: 1.50k > SPA Mismatch: 1.18m > > L2 ARC Size: (Adaptive) 555.88 GiB > Header Size: 0.21% 1.17 GiB > > L2 ARC Evicts: > Lock Retries: 10 > Upon Reading: 0 > > L2 ARC Breakdown: 272.76m > Hit Ratio: 0.35% 949.30k > Miss Ratio: 99.65% 271.81m > Feeds: 2.19m > > L2 ARC Buffer: > Bytes Scanned: 20.45 PiB > Buffer Iterations: 2.19m > List Iterations: 139.97m > NULL List Iterations: 5.58k > > L2 ARC Writes: > Writes Sent: 100.00% 567.37k > > Any help is welcome. Best regards > -- Andriy Gapon