From owner-freebsd-fs@FreeBSD.ORG Mon Oct 20 17:32:45 2014 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 22044FF1 for ; Mon, 20 Oct 2014 17:32:45 +0000 (UTC) Received: from relay02.ioffe.ru (relay02.ioffe.ru [194.85.224.38]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8900DE20 for ; Mon, 20 Oct 2014 17:32:43 +0000 (UTC) Received: from mail.ioffe.ru (mail [194.85.224.39]) by relay02.ioffe.ru (8.14.5/8.12.6) with ESMTP id s9KHWfg4042025 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Mon, 20 Oct 2014 21:32:41 +0400 (MSK) (envelope-from alex@putnichek.ru) Received: from neptunmac.local ([194.85.230.94]) (authenticated bits=0) by mail.ioffe.ru (8.14.5/8.14.4) with ESMTP id s9KHWfn4004580 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO) for ; Mon, 20 Oct 2014 21:32:41 +0400 (MSK) (envelope-from alex@putnichek.ru) Message-ID: <54454739.1070900@putnichek.ru> Date: Mon, 20 Oct 2014 21:32:41 +0400 From: Alex User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.8; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: freebsd-fs@freebsd.org Subject: l2_io_error and l2_cksum_bad are not null and growing Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 Oct 2014 17:32:45 -0000 Hello. We seem to have a problem with l2arc on zfs system on 10.1-BETA1 FreeBSD 10.1-BETA1 #1 r271710 server. The server has a l2arc cache configured from Intel SSD 480G disk. The problem is that l2_io_error and l2_cksum_bad values are constantly growing, however there are no traces of any hardware malfunctioning. As for now, the values are kstat.zfs.misc.arcstats.l2_io_error: 1501 kstat.zfs.misc.arcstats.l2_cksum_bad: 19480 Here is the output of zpool status: pool: zpool state: ONLINE scan: none requested config: NAME STATE READ WRITE CKSUM zpool ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 diskid/DISK-WD-WMC1P0DFSF47p2 ONLINE 0 0 0 diskid/DISK-WD-WMC1P0DEFERYp2 ONLINE 0 0 0 logs gpt/zil0 ONLINE 0 0 0 cache gpt/cache0 ONLINE 0 0 0 errors: No known data errors Here is the output of zfs-stats -L: ------------------------------------------------------------------------ ZFS Subsystem Report Mon Oct 20 19:29:38 2014 ------------------------------------------------------------------------ L2 ARC Summary: (DEGRADED) Passed Headroom: 72.42m Tried Lock Failures: 360.55m IO In Progress: 65 Low Memory Aborts: 101 Free on Write: 7.09k Writes While Full: 16.90k R/W Clashes: 11 Bad Checksums: 19.48k IO Errors: 1.50k SPA Mismatch: 1.18m L2 ARC Size: (Adaptive) 555.88 GiB Header Size: 0.21% 1.17 GiB L2 ARC Evicts: Lock Retries: 10 Upon Reading: 0 L2 ARC Breakdown: 272.76m Hit Ratio: 0.35% 949.30k Miss Ratio: 99.65% 271.81m Feeds: 2.19m L2 ARC Buffer: Bytes Scanned: 20.45 PiB Buffer Iterations: 2.19m List Iterations: 139.97m NULL List Iterations: 5.58k L2 ARC Writes: Writes Sent: 100.00% 567.37k Any help is welcome. Best regards -- Alex