From owner-freebsd-fs@FreeBSD.ORG Sun Jun 24 16:40:49 2012 Return-Path: Delivered-To: fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 703241065686 for ; Sun, 24 Jun 2012 16:40:49 +0000 (UTC) (envelope-from gnn@neville-neil.com) Received: from vps.hungerhost.com (vps.hungerhost.com [216.38.53.176]) by mx1.freebsd.org (Postfix) with ESMTP id 470448FC12 for ; Sun, 24 Jun 2012 16:40:49 +0000 (UTC) Received: from [50.14.114.54] (port=52143 helo=[192.168.1.11]) by vps.hungerhost.com with esmtpsa (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1Siprk-0006n5-QZ for fs@freebsd.org; Sun, 24 Jun 2012 12:40:48 -0400 From: George Neville-Neil Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Date: Sun, 24 Jun 2012 12:40:48 -0400 Message-Id: <241106B6-DABF-4ADC-9FAF-2A12ECF8780F@neville-neil.com> To: fs@freebsd.org Mime-Version: 1.0 (Apple Message framework v1280) X-Mailer: Apple Mail (2.1280) X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - vps.hungerhost.com X-AntiAbuse: Original Domain - freebsd.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - neville-neil.com Cc: Subject: Recent FS research on FreeBSD... X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 24 Jun 2012 16:40:49 -0000 Howdy, One of the things I'm hoping to do for the foundation is to start = periodically publishing a list of papers that reference or relate to FreeBSD. Basically a set of = research highlights. I'll be asking this same question on a few of our public mailing lists but = I'm going to start here. If you know of recent (< 1 year) results published using FreeBSD please = email me off list.=20 For the purpose of this discussion "results" include: 1) Papers in journals or proceedings 2) Tech Reports (usually these are issued by companies and labs) 3) RFCs (sure, these are OS neutral but if someone here was involved = that counts) Thanks, George From owner-freebsd-fs@FreeBSD.ORG Mon Jun 25 02:03:36 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 8F8451065677; Mon, 25 Jun 2012 02:03:36 +0000 (UTC) (envelope-from kevlo@kevlo.org) Received: from ns.kevlo.org (kevlo.org [220.128.136.52]) by mx1.freebsd.org (Postfix) with ESMTP id 177AD8FC08; Mon, 25 Jun 2012 02:03:35 +0000 (UTC) Received: from [127.0.0.1] (git.kevlo.org [220.128.136.52]) by ns.kevlo.org (8.14.5/8.14.5) with ESMTP id q5P23R8V003769; Mon, 25 Jun 2012 10:03:27 +0800 (CST) (envelope-from kevlo@kevlo.org) Message-ID: <1340589808.2192.1.camel@nsl> From: Kevin Lo To: freebsd-current , freebsd-fs@freebsd.org Date: Mon, 25 Jun 2012 10:03:28 +0800 Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.3-0ubuntu6 Content-Transfer-Encoding: 7bit Mime-Version: 1.0 Cc: Subject: Tmpfs panic in -current X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 Jun 2012 02:03:36 -0000 I've observed a panic in recent -current several times but I only have a picture of the backtrace: http://people.freebsd.org/~kevlo/panic_tmpfs.jpg Does this look at all familiar to anyone? Kevin From owner-freebsd-fs@FreeBSD.ORG Mon Jun 25 06:02:35 2012 Return-Path: Delivered-To: freebsd-fs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 7EE261065677; Mon, 25 Jun 2012 06:02:35 +0000 (UTC) (envelope-from eadler@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 52B358FC15; Mon, 25 Jun 2012 06:02:35 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.5/8.14.5) with ESMTP id q5P62Znp084046; Mon, 25 Jun 2012 06:02:35 GMT (envelope-from eadler@freefall.freebsd.org) Received: (from eadler@localhost) by freefall.freebsd.org (8.14.5/8.14.5/Submit) id q5P62Zp1084042; Mon, 25 Jun 2012 06:02:35 GMT (envelope-from eadler) Date: Mon, 25 Jun 2012 06:02:35 GMT Message-Id: <201206250602.q5P62Zp1084042@freefall.freebsd.org> To: eadler@FreeBSD.org, freebsd-bugs@FreeBSD.org, freebsd-fs@FreeBSD.org From: eadler@FreeBSD.org Cc: Subject: Re: kern/169339: panic while " : > /etc/123" X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 Jun 2012 06:02:35 -0000 Synopsis: panic while " : > /etc/123" Responsible-Changed-From-To: freebsd-bugs->freebsd-fs Responsible-Changed-By: eadler Responsible-Changed-When: Mon Jun 25 06:02:14 UTC 2012 Responsible-Changed-Why: over to people that may know more http://www.freebsd.org/cgi/query-pr.cgi?pr=169339 From owner-freebsd-fs@FreeBSD.ORG Mon Jun 25 09:56:17 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id BC4461065675; Mon, 25 Jun 2012 09:56:17 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from mail.zoral.com.ua (mx0.zoral.com.ua [91.193.166.200]) by mx1.freebsd.org (Postfix) with ESMTP id 35F258FC0A; Mon, 25 Jun 2012 09:56:16 +0000 (UTC) Received: from skuns.kiev.zoral.com.ua (localhost [127.0.0.1]) by mail.zoral.com.ua (8.14.2/8.14.2) with ESMTP id q5P9tohC030514; Mon, 25 Jun 2012 12:55:50 +0300 (EEST) (envelope-from kostikbel@gmail.com) Received: from deviant.kiev.zoral.com.ua (kostik@localhost [127.0.0.1]) by deviant.kiev.zoral.com.ua (8.14.5/8.14.5) with ESMTP id q5P9togc024592; Mon, 25 Jun 2012 12:55:50 +0300 (EEST) (envelope-from kostikbel@gmail.com) Received: (from kostik@localhost) by deviant.kiev.zoral.com.ua (8.14.5/8.14.5/Submit) id q5P9tmme024591; Mon, 25 Jun 2012 12:55:48 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: deviant.kiev.zoral.com.ua: kostik set sender to kostikbel@gmail.com using -f Date: Mon, 25 Jun 2012 12:55:48 +0300 From: Konstantin Belousov To: Kevin Lo Message-ID: <20120625095548.GD2337@deviant.kiev.zoral.com.ua> References: <1340589808.2192.1.camel@nsl> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="T2hvUJ3zJitSqYsX" Content-Disposition: inline In-Reply-To: <1340589808.2192.1.camel@nsl> User-Agent: Mutt/1.4.2.3i X-Virus-Scanned: clamav-milter 0.95.2 at skuns.kiev.zoral.com.ua X-Virus-Status: Clean X-Spam-Status: No, score=-4.0 required=5.0 tests=ALL_TRUSTED,AWL,BAYES_00 autolearn=ham version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on skuns.kiev.zoral.com.ua Cc: freebsd-fs@freebsd.org, freebsd-current Subject: Re: Tmpfs panic in -current X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 Jun 2012 09:56:17 -0000 --T2hvUJ3zJitSqYsX Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Jun 25, 2012 at 10:03:28AM +0800, Kevin Lo wrote: > I've observed a panic in recent -current several times but I only > have a picture of the backtrace: > http://people.freebsd.org/~kevlo/panic_tmpfs.jpg >=20 > Does this look at all familiar to anyone? Can you look up the line corresponding to tmpfs_reg_resize + 0x627 address in your kernel ? The screenshot looks strange. The instruction on which the kernel trapped is int 0x28 which should not appear in the compiled code. --T2hvUJ3zJitSqYsX Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.12 (FreeBSD) iEYEARECAAYFAk/oNaQACgkQC3+MBN1Mb4jEoACguhbK+poJaPgsHk5VU5r6i6TK lhoAoNJir2lbjmIPOWnbpLrD06ggtfKj =arSr -----END PGP SIGNATURE----- --T2hvUJ3zJitSqYsX-- From owner-freebsd-fs@FreeBSD.ORG Mon Jun 25 10:31:23 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id A0A361065687 for ; Mon, 25 Jun 2012 10:31:23 +0000 (UTC) (envelope-from c.kworr@gmail.com) Received: from mail-bk0-f54.google.com (mail-bk0-f54.google.com [209.85.214.54]) by mx1.freebsd.org (Postfix) with ESMTP id 25CB68FC14 for ; Mon, 25 Jun 2012 10:31:22 +0000 (UTC) Received: by bkvi18 with SMTP id i18so3737526bkv.13 for ; Mon, 25 Jun 2012 03:31:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=XDJi8GKzrBXfLKq87p7vAt4euXt1O96YS8V9IOd5bG0=; b=iAoVPx2KvV0Nm854DOl4b7xOWMa571Xdv4SGdwql+YI5NGa9DkeJGiwqfrz3GA0lRM I90XR+86cAnzwfg+Bj++BgGiixIZBg4znqu6/LUVSDin86QO5IsjjyOVqO5ApfPmVfNq NP+zp+6V/ntqL6UwcSytA/cn2pS1LxgS8xYX8DHHbSnonfyLG8DTG8E+fn7FjDo234wG T1cd4jP3LXeb8kTW+lCSMUjA36EXx9po930DQq/7AL09npPTsuydgNl1iSCZaK740807 RPguOCUZIuV5qLgrZTmj6p7tIqGmZwXehH0dtEnv3CC5ozG9gAAYb0pyUNSVGr/tbSPC fUKg== Received: by 10.204.157.23 with SMTP id z23mr3906559bkw.71.1340619890023; Mon, 25 Jun 2012 03:24:50 -0700 (PDT) Received: from green.tandem.local (utwig.xim.bz. [91.216.237.46]) by mx.google.com with ESMTPS id iq16sm45863547bkc.6.2012.06.25.03.24.47 (version=SSLv3 cipher=OTHER); Mon, 25 Jun 2012 03:24:48 -0700 (PDT) Message-ID: <4FE83C6E.2030600@gmail.com> Date: Mon, 25 Jun 2012 13:24:46 +0300 From: Volodymyr Kostyrko User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:12.0) Gecko/20120605 Firefox/12.0 SeaMonkey/2.9.1 MIME-Version: 1.0 To: Gleb Kurtsou References: <20120621140149.GA59722@reks> In-Reply-To: <20120621140149.GA59722@reks> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-fs@freebsd.org Subject: Re: [RFC] tmpfs RB-Tree for directory entries X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 Jun 2012 10:31:23 -0000 Gleb Kurtsou wrote: > Here is patch for CURRENT replacing directory entry linked list with > RB-Tree in tmpfs. Performance improvement varies for different > workloads, it may be negligible for directories with small number of > files or due to VFS name caching. > > http://people.freebsd.org/~gleb/tmpfs-nrbtree.1.patch > > This patch is unrelated to similar changes recently committed to > DragonFly: > https://bugs.dragonflybsd.org/issues/2375 > http://gitweb.dragonflybsd.org/dragonfly.git/commitdiff/29ca4fd6da8bb70ae90d8e73ea3c47fda22491a7 > > My patch uses name hashes instead of comparing entries by file name, > moreover it reuses the same hash value as directory entry offset and > eliminates possible issue of duplicate directory offsets on 64-bit > archs. In other words it makes VOP_READDIR on large directories faster > for non-zero offsets. > > I'm willing to commit the patch and would appreciate if people actively > using tmpfs give it a try. I applied patch on my test machines on 9-STABLE (i386/amd64). Both use tmpfs when building ports. No regression for three days (compiling openoffice/chromium). -- Sphinx of black quartz judge my vow. From owner-freebsd-fs@FreeBSD.ORG Mon Jun 25 11:07:18 2012 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0DB99106566B for ; Mon, 25 Jun 2012 11:07:18 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id EAE078FC18 for ; Mon, 25 Jun 2012 11:07:17 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.5/8.14.5) with ESMTP id q5PB7H6g078315 for ; Mon, 25 Jun 2012 11:07:17 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.5/8.14.5/Submit) id q5PB7He1078313 for freebsd-fs@FreeBSD.org; Mon, 25 Jun 2012 11:07:17 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 25 Jun 2012 11:07:17 GMT Message-Id: <201206251107.q5PB7He1078313@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-fs@FreeBSD.org Cc: Subject: Current problem reports assigned to freebsd-fs@FreeBSD.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 Jun 2012 11:07:18 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/169339 fs panic while " : > /etc/123" o kern/169319 fs [zfs] zfs resilver can't complete o kern/168947 fs [nfs] [zfs] .zfs/snapshot directory is messed up when o kern/168942 fs [nfs] [hang] nfsd hangs after being restarted (not -HU o kern/168158 fs [zfs] incorrect parsing of sharenfs options in zfs (fs o kern/167979 fs [ufs] DIOCGDINFO ioctl does not work on 8.2 file syste o kern/167977 fs [smbfs] mount_smbfs results are differ when utf-8 or U o kern/167688 fs [fusefs] Incorrect signal handling with direct_io o kern/167685 fs [zfs] ZFS on USB drive prevents shutdown / reboot o kern/167612 fs [portalfs] The portal file system gets stuck inside po o kern/167272 fs [zfs] ZFS Disks reordering causes ZFS to pick the wron o kern/167260 fs [msdosfs] msdosfs disk was mounted the second time whe o kern/167109 fs [zfs] [panic] zfs diff kernel panic Fatal trap 9: gene o kern/167105 fs [nfs] mount_nfs can not handle source exports wiht mor o kern/167067 fs [zfs] [panic] ZFS panics the server o kern/167066 fs [zfs] ZVOLs not appearing in /dev/zvol o kern/167065 fs [zfs] boot fails when a spare is the boot disk o kern/167048 fs [nfs] [patch] RELEASE-9 crash when using ZFS+NULLFS+NF o kern/166912 fs [ufs] [panic] Panic after converting Softupdates to jo o kern/166851 fs [zfs] [hang] Copying directory from the mounted UFS di o kern/166566 fs [zfs] zfs split renders 2 disk (MBR based) mirror unbo o kern/166477 fs [nfs] NFS data corruption. o kern/165950 fs [ffs] SU+J and fsck problem o kern/165923 fs [nfs] Writing to NFS-backed mmapped files fails if flu o kern/165521 fs [zfs] [hang] livelock on 1 Gig of RAM with zfs when 31 o kern/165392 fs Multiple mkdir/rmdir fails with errno 31 o kern/165087 fs [unionfs] lock violation in unionfs o kern/164472 fs [ufs] fsck -B panics on particular data inconsistency o kern/164370 fs [zfs] zfs destroy for snapshot fails on i386 and sparc o kern/164261 fs [nullfs] [patch] fix panic with NFS served from NULLFS o kern/164256 fs [zfs] device entry for volume is not created after zfs o kern/164184 fs [ufs] [panic] Kernel panic with ufs_makeinode o kern/163801 fs [md] [request] allow mfsBSD legacy installed in 'swap' o kern/163770 fs [zfs] [hang] LOR between zfs&syncer + vnlru leading to o kern/163501 fs [nfs] NFS exporting a dir and a subdir in that dir to o kern/162944 fs [coda] Coda file system module looks broken in 9.0 o kern/162860 fs [zfs] Cannot share ZFS filesystem to hosts with a hyph o kern/162751 fs [zfs] [panic] kernel panics during file operations o kern/162591 fs [nullfs] cross-filesystem nullfs does not work as expe o kern/162519 fs [zfs] "zpool import" relies on buggy realpath() behavi o kern/162362 fs [snapshots] [panic] ufs with snapshot(s) panics when g o kern/161968 fs [zfs] [hang] renaming snapshot with -r including a zvo o kern/161897 fs [zfs] [patch] zfs partition probing causing long delay o kern/161864 fs [ufs] removing journaling from UFS partition fails on o bin/161807 fs [patch] add option for explicitly specifying metadata o kern/161579 fs [smbfs] FreeBSD sometimes panics when an smb share is o kern/161533 fs [zfs] [panic] zfs receive panic: system ioctl returnin o kern/161438 fs [zfs] [panic] recursed on non-recursive spa_namespace_ o kern/161424 fs [nullfs] __getcwd() calls fail when used on nullfs mou o kern/161280 fs [zfs] Stack overflow in gptzfsboot o kern/161205 fs [nfs] [pfsync] [regression] [build] Bug report freebsd o kern/161169 fs [zfs] [panic] ZFS causes kernel panic in dbuf_dirty o kern/161112 fs [ufs] [lor] filesystem LOR in FreeBSD 9.0-BETA3 o kern/160893 fs [zfs] [panic] 9.0-BETA2 kernel panic o kern/160860 fs [ufs] Random UFS root filesystem corruption with SU+J o kern/160801 fs [zfs] zfsboot on 8.2-RELEASE fails to boot from root-o o kern/160790 fs [fusefs] [panic] VPUTX: negative ref count with FUSE o kern/160777 fs [zfs] [hang] RAID-Z3 causes fatal hang upon scrub/impo o kern/160706 fs [zfs] zfs bootloader fails when a non-root vdev exists o kern/160591 fs [zfs] Fail to boot on zfs root with degraded raidz2 [r o kern/160410 fs [smbfs] [hang] smbfs hangs when transferring large fil o kern/160283 fs [zfs] [patch] 'zfs list' does abort in make_dataset_ha o kern/159930 fs [ufs] [panic] kernel core o kern/159402 fs [zfs][loader] symlinks cause I/O errors o kern/159357 fs [zfs] ZFS MAXNAMELEN macro has confusing name (off-by- o kern/159356 fs [zfs] [patch] ZFS NAME_ERR_DISKLIKE check is Solaris-s o kern/159351 fs [nfs] [patch] - divide by zero in mountnfs() o kern/159251 fs [zfs] [request]: add FLETCHER4 as DEDUP hash option o kern/159077 fs [zfs] Can't cd .. with latest zfs version o kern/159048 fs [smbfs] smb mount corrupts large files o kern/159045 fs [zfs] [hang] ZFS scrub freezes system o kern/158839 fs [zfs] ZFS Bootloader Fails if there is a Dead Disk o kern/158802 fs amd(8) ICMP storm and unkillable process. o kern/158231 fs [nullfs] panic on unmounting nullfs mounted over ufs o f kern/157929 fs [nfs] NFS slow read o kern/157399 fs [zfs] trouble with: mdconfig force delete && zfs strip o kern/157179 fs [zfs] zfs/dbuf.c: panic: solaris assert: arc_buf_remov o kern/156797 fs [zfs] [panic] Double panic with FreeBSD 9-CURRENT and o kern/156781 fs [zfs] zfs is losing the snapshot directory, p kern/156545 fs [ufs] mv could break UFS on SMP systems o kern/156193 fs [ufs] [hang] UFS snapshot hangs && deadlocks processes o kern/156039 fs [nullfs] [unionfs] nullfs + unionfs do not compose, re o kern/155615 fs [zfs] zfs v28 broken on sparc64 -current o kern/155587 fs [zfs] [panic] kernel panic with zfs p kern/155411 fs [regression] [8.2-release] [tmpfs]: mount: tmpfs : No o kern/155199 fs [ext2fs] ext3fs mounted as ext2fs gives I/O errors o bin/155104 fs [zfs][patch] use /dev prefix by default when importing o kern/154930 fs [zfs] cannot delete/unlink file from full volume -> EN o kern/154828 fs [msdosfs] Unable to create directories on external USB o kern/154491 fs [smbfs] smb_co_lock: recursive lock for object 1 p kern/154228 fs [md] md getting stuck in wdrain state o kern/153996 fs [zfs] zfs root mount error while kernel is not located o kern/153753 fs [zfs] ZFS v15 - grammatical error when attempting to u o kern/153716 fs [zfs] zpool scrub time remaining is incorrect o kern/153695 fs [patch] [zfs] Booting from zpool created on 4k-sector o kern/153680 fs [xfs] 8.1 failing to mount XFS partitions o kern/153520 fs [zfs] Boot from GPT ZFS root on HP BL460c G1 unstable o kern/153418 fs [zfs] [panic] Kernel Panic occurred writing to zfs vol o kern/153351 fs [zfs] locking directories/files in ZFS o bin/153258 fs [patch][zfs] creating ZVOLs requires `refreservation' s kern/153173 fs [zfs] booting from a gzip-compressed dataset doesn't w o kern/153126 fs [zfs] vdev failure, zpool=peegel type=vdev.too_small o kern/152022 fs [nfs] nfs service hangs with linux client [regression] o kern/151942 fs [zfs] panic during ls(1) zfs snapshot directory o kern/151905 fs [zfs] page fault under load in /sbin/zfs o bin/151713 fs [patch] Bug in growfs(8) with respect to 32-bit overfl o kern/151648 fs [zfs] disk wait bug o kern/151629 fs [fs] [patch] Skip empty directory entries during name o kern/151330 fs [zfs] will unshare all zfs filesystem after execute a o kern/151326 fs [nfs] nfs exports fail if netgroups contain duplicate o kern/151251 fs [ufs] Can not create files on filesystem with heavy us o kern/151226 fs [zfs] can't delete zfs snapshot o kern/151111 fs [zfs] vnodes leakage during zfs unmount o kern/150503 fs [zfs] ZFS disks are UNAVAIL and corrupted after reboot o kern/150501 fs [zfs] ZFS vdev failure vdev.bad_label on amd64 o kern/150390 fs [zfs] zfs deadlock when arcmsr reports drive faulted o kern/150336 fs [nfs] mountd/nfsd became confused; refused to reload n o kern/149208 fs mksnap_ffs(8) hang/deadlock o kern/149173 fs [patch] [zfs] make OpenSolaris installa o kern/149015 fs [zfs] [patch] misc fixes for ZFS code to build on Glib o kern/149014 fs [zfs] [patch] declarations in ZFS libraries/utilities o kern/149013 fs [zfs] [patch] make ZFS makefiles use the libraries fro o kern/148504 fs [zfs] ZFS' zpool does not allow replacing drives to be o kern/148490 fs [zfs]: zpool attach - resilver bidirectionally, and re o kern/148368 fs [zfs] ZFS hanging forever on 8.1-PRERELEASE o kern/148138 fs [zfs] zfs raidz pool commands freeze o kern/147903 fs [zfs] [panic] Kernel panics on faulty zfs device o kern/147881 fs [zfs] [patch] ZFS "sharenfs" doesn't allow different " o kern/147560 fs [zfs] [boot] Booting 8.1-PRERELEASE raidz system take o kern/147420 fs [ufs] [panic] ufs_dirbad, nullfs, jail panic (corrupt o kern/146941 fs [zfs] [panic] Kernel Double Fault - Happens constantly o kern/146786 fs [zfs] zpool import hangs with checksum errors o kern/146708 fs [ufs] [panic] Kernel panic in softdep_disk_write_compl o kern/146528 fs [zfs] Severe memory leak in ZFS on i386 o kern/146502 fs [nfs] FreeBSD 8 NFS Client Connection to Server s kern/145712 fs [zfs] cannot offline two drives in a raidz2 configurat o kern/145411 fs [xfs] [panic] Kernel panics shortly after mounting an f bin/145309 fs bsdlabel: Editing disk label invalidates the whole dev o kern/145272 fs [zfs] [panic] Panic during boot when accessing zfs on o kern/145246 fs [ufs] dirhash in 7.3 gratuitously frees hashes when it o kern/145238 fs [zfs] [panic] kernel panic on zpool clear tank o kern/145229 fs [zfs] Vast differences in ZFS ARC behavior between 8.0 o kern/145189 fs [nfs] nfsd performs abysmally under load o kern/144929 fs [ufs] [lor] vfs_bio.c + ufs_dirhash.c p kern/144447 fs [zfs] sharenfs fsunshare() & fsshare_main() non functi o kern/144416 fs [panic] Kernel panic on online filesystem optimization s kern/144415 fs [zfs] [panic] kernel panics on boot after zfs crash o kern/144234 fs [zfs] Cannot boot machine with recent gptzfsboot code o kern/143825 fs [nfs] [panic] Kernel panic on NFS client o bin/143572 fs [zfs] zpool(1): [patch] The verbose output from iostat o kern/143212 fs [nfs] NFSv4 client strange work ... o kern/143184 fs [zfs] [lor] zfs/bufwait LOR o kern/142878 fs [zfs] [vfs] lock order reversal o kern/142597 fs [ext2fs] ext2fs does not work on filesystems with real o kern/142489 fs [zfs] [lor] allproc/zfs LOR o kern/142466 fs Update 7.2 -> 8.0 on Raid 1 ends with screwed raid [re o kern/142306 fs [zfs] [panic] ZFS drive (from OSX Leopard) causes two o kern/142068 fs [ufs] BSD labels are got deleted spontaneously o kern/141897 fs [msdosfs] [panic] Kernel panic. msdofs: file name leng o kern/141463 fs [nfs] [panic] Frequent kernel panics after upgrade fro o kern/141305 fs [zfs] FreeBSD ZFS+sendfile severe performance issues ( o kern/141091 fs [patch] [nullfs] fix panics with DIAGNOSTIC enabled o kern/141086 fs [nfs] [panic] panic("nfs: bioread, not dir") on FreeBS o kern/141010 fs [zfs] "zfs scrub" fails when backed by files in UFS2 o kern/140888 fs [zfs] boot fail from zfs root while the pool resilveri o kern/140661 fs [zfs] [patch] /boot/loader fails to work on a GPT/ZFS- o kern/140640 fs [zfs] snapshot crash o kern/140068 fs [smbfs] [patch] smbfs does not allow semicolon in file o kern/139725 fs [zfs] zdb(1) dumps core on i386 when examining zpool c o kern/139715 fs [zfs] vfs.numvnodes leak on busy zfs p bin/139651 fs [nfs] mount(8): read-only remount of NFS volume does n o kern/139564 fs [zfs] [panic] 8.0-RC1 - Fatal trap 12 at end of shutdo o kern/139407 fs [smbfs] [panic] smb mount causes system crash if remot o kern/138662 fs [panic] ffs_blkfree: freeing free block o kern/138421 fs [ufs] [patch] remove UFS label limitations o kern/138202 fs mount_msdosfs(1) see only 2Gb o kern/136968 fs [ufs] [lor] ufs/bufwait/ufs (open) o kern/136945 fs [ufs] [lor] filedesc structure/ufs (poll) o kern/136944 fs [ffs] [lor] bufwait/snaplk (fsync) o kern/136873 fs [ntfs] Missing directories/files on NTFS volume o kern/136865 fs [nfs] [patch] NFS exports atomic and on-the-fly atomic p kern/136470 fs [nfs] Cannot mount / in read-only, over NFS o kern/135546 fs [zfs] zfs.ko module doesn't ignore zpool.cache filenam o kern/135469 fs [ufs] [panic] kernel crash on md operation in ufs_dirb o kern/135050 fs [zfs] ZFS clears/hides disk errors on reboot o kern/134491 fs [zfs] Hot spares are rather cold... o kern/133676 fs [smbfs] [panic] umount -f'ing a vnode-based memory dis o kern/132960 fs [ufs] [panic] panic:ffs_blkfree: freeing free frag o kern/132397 fs reboot causes filesystem corruption (failure to sync b o kern/132331 fs [ufs] [lor] LOR ufs and syncer o kern/132237 fs [msdosfs] msdosfs has problems to read MSDOS Floppy o kern/132145 fs [panic] File System Hard Crashes o kern/131441 fs [unionfs] [nullfs] unionfs and/or nullfs not combineab o kern/131360 fs [nfs] poor scaling behavior of the NFS server under lo o kern/131342 fs [nfs] mounting/unmounting of disks causes NFS to fail o bin/131341 fs makefs: error "Bad file descriptor" on the mount poin o kern/130920 fs [msdosfs] cp(1) takes 100% CPU time while copying file o kern/130210 fs [nullfs] Error by check nullfs o kern/129760 fs [nfs] after 'umount -f' of a stale NFS share FreeBSD l o kern/129488 fs [smbfs] Kernel "bug" when using smbfs in smbfs_smb.c: o kern/129231 fs [ufs] [patch] New UFS mount (norandom) option - mostly o kern/129152 fs [panic] non-userfriendly panic when trying to mount(8) o kern/127787 fs [lor] [ufs] Three LORs: vfslock/devfs/vfslock, ufs/vfs o bin/127270 fs fsck_msdosfs(8) may crash if BytesPerSec is zero o kern/127029 fs [panic] mount(8): trying to mount a write protected zi o kern/126287 fs [ufs] [panic] Kernel panics while mounting an UFS file o kern/125895 fs [ffs] [panic] kernel: panic: ffs_blkfree: freeing free s kern/125738 fs [zfs] [request] SHA256 acceleration in ZFS o kern/123939 fs [msdosfs] corrupts new files o kern/122380 fs [ffs] ffs_valloc:dup alloc (Soekris 4801/7.0/USB Flash o bin/122172 fs [fs]: amd(8) automount daemon dies on 6.3-STABLE i386, o bin/121898 fs [nullfs] pwd(1)/getcwd(2) fails with Permission denied o bin/121072 fs [smbfs] mount_smbfs(8) cannot normally convert the cha o kern/120483 fs [ntfs] [patch] NTFS filesystem locking changes o kern/120482 fs [ntfs] [patch] Sync style changes between NetBSD and F o kern/118912 fs [2tb] disk sizing/geometry problem with large array o kern/118713 fs [minidump] [patch] Display media size required for a k o kern/118318 fs [nfs] NFS server hangs under special circumstances o bin/118249 fs [ufs] mv(1): moving a directory changes its mtime o kern/118126 fs [nfs] [patch] Poor NFS server write performance o kern/118107 fs [ntfs] [panic] Kernel panic when accessing a file at N o kern/117954 fs [ufs] dirhash on very large directories blocks the mac o bin/117315 fs [smbfs] mount_smbfs(8) and related options can't mount o kern/117158 fs [zfs] zpool scrub causes panic if geli vdevs detach on o bin/116980 fs [msdosfs] [patch] mount_msdosfs(8) resets some flags f o conf/116931 fs lack of fsck_cd9660 prevents mounting iso images with o kern/116583 fs [ffs] [hang] System freezes for short time when using o bin/115361 fs [zfs] mount(8) gets into a state where it won't set/un o kern/114955 fs [cd9660] [patch] [request] support for mask,dirmask,ui o kern/114847 fs [ntfs] [patch] [request] dirmask support for NTFS ala o kern/114676 fs [ufs] snapshot creation panics: snapacct_ufs2: bad blo o bin/114468 fs [patch] [request] add -d option to umount(8) to detach o kern/113852 fs [smbfs] smbfs does not properly implement DFS referral o bin/113838 fs [patch] [request] mount(8): add support for relative p o bin/113049 fs [patch] [request] make quot(8) use getopt(3) and show o kern/112658 fs [smbfs] [patch] smbfs and caching problems (resolves b o kern/111843 fs [msdosfs] Long Names of files are incorrectly created o kern/111782 fs [ufs] dump(8) fails horribly for large filesystems s bin/111146 fs [2tb] fsck(8) fails on 6T filesystem o bin/107829 fs [2TB] fdisk(8): invalid boundary checking in fdisk / w o kern/106107 fs [ufs] left-over fsck_snapshot after unfinished backgro o kern/104406 fs [ufs] Processes get stuck in "ufs" state under persist o kern/104133 fs [ext2fs] EXT2FS module corrupts EXT2/3 filesystems o kern/103035 fs [ntfs] Directories in NTFS mounted disc images appear o kern/101324 fs [smbfs] smbfs sometimes not case sensitive when it's s o kern/99290 fs [ntfs] mount_ntfs ignorant of cluster sizes s bin/97498 fs [request] newfs(8) has no option to clear the first 12 o kern/97377 fs [ntfs] [patch] syntax cleanup for ntfs_ihash.c o kern/95222 fs [cd9660] File sections on ISO9660 level 3 CDs ignored o kern/94849 fs [ufs] rename on UFS filesystem is not atomic o bin/94810 fs fsck(8) incorrectly reports 'file system marked clean' o kern/94769 fs [ufs] Multiple file deletions on multi-snapshotted fil o kern/94733 fs [smbfs] smbfs may cause double unlock o kern/93942 fs [vfs] [patch] panic: ufs_dirbad: bad dir (patch from D o kern/92272 fs [ffs] [hang] Filling a filesystem while creating a sna o kern/91134 fs [smbfs] [patch] Preserve access and modification time a kern/90815 fs [smbfs] [patch] SMBFS with character conversions somet o kern/88657 fs [smbfs] windows client hang when browsing a samba shar o kern/88555 fs [panic] ffs_blkfree: freeing free frag on AMD 64 o kern/88266 fs [smbfs] smbfs does not implement UIO_NOCOPY and sendfi o bin/87966 fs [patch] newfs(8): introduce -A flag for newfs to enabl o kern/87859 fs [smbfs] System reboot while umount smbfs. o kern/86587 fs [msdosfs] rm -r /PATH fails with lots of small files o bin/85494 fs fsck_ffs: unchecked use of cg_inosused macro etc. o kern/80088 fs [smbfs] Incorrect file time setting on NTFS mounted vi o bin/74779 fs Background-fsck checks one filesystem twice and omits o kern/73484 fs [ntfs] Kernel panic when doing `ls` from the client si o bin/73019 fs [ufs] fsck_ufs(8) cannot alloc 607016868 bytes for ino o kern/71774 fs [ntfs] NTFS cannot "see" files on a WinXP filesystem o bin/70600 fs fsck(8) throws files away when it can't grow lost+foun o kern/68978 fs [panic] [ufs] crashes with failing hard disk, loose po o kern/65920 fs [nwfs] Mounted Netware filesystem behaves strange o kern/65901 fs [smbfs] [patch] smbfs fails fsx write/truncate-down/tr o kern/61503 fs [smbfs] mount_smbfs does not work as non-root o kern/55617 fs [smbfs] Accessing an nsmb-mounted drive via a smb expo o kern/51685 fs [hang] Unbounded inode allocation causes kernel to loc o kern/36566 fs [smbfs] System reboot with dead smb mount and umount o bin/27687 fs fsck(8) wrapper is not properly passing options to fsc o kern/18874 fs [2TB] 32bit NFS servers export wrong negative values t 279 problems total. From owner-freebsd-fs@FreeBSD.ORG Mon Jun 25 18:46:58 2012 Return-Path: Delivered-To: fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id CFD8F106564A for ; Mon, 25 Jun 2012 18:46:58 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from bigwig.baldwin.cx (bigknife-pt.tunnel.tserv9.chi1.ipv6.he.net [IPv6:2001:470:1f10:75::2]) by mx1.freebsd.org (Postfix) with ESMTP id A9ADE8FC12 for ; Mon, 25 Jun 2012 18:46:58 +0000 (UTC) Received: from jhbbsd.localnet (unknown [209.249.190.124]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id CED53B9B3 for ; Mon, 25 Jun 2012 14:46:57 -0400 (EDT) From: John Baldwin To: fs@freebsd.org Date: Mon, 25 Jun 2012 14:43:41 -0400 User-Agent: KMail/1.13.5 (FreeBSD/8.2-CBSD-20110714-p17; KDE/4.5.5; amd64; ; ) MIME-Version: 1.0 Content-Type: Text/Plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Message-Id: <201206251443.41768.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Mon, 25 Jun 2012 14:46:57 -0400 (EDT) Cc: Subject: [PATCH] Simple ARC stats in top X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 Jun 2012 18:46:58 -0000 I have some patches based on a script I got from avg@ that add some simplistic ARC stats to top so that one can see how much of wired memory is set aside for ARC, and how that memory is split up. The patch is against 8-stable: http://www.FreeBSD.org/~jhb/patches/top_arc.patch Sample output: Mem: 1245M Active, 1393M Inact, 21G Wired, 309M Buf, 23G Free ARC: 19G Total, 1381M MRU, 17G MFU, 272K Anon, 232M Header, 442M Other Swap: 8192M Total, 8192M Free Comments, etc.? -- John Baldwin From owner-freebsd-fs@FreeBSD.ORG Tue Jun 26 01:31:59 2012 Return-Path: Delivered-To: fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B47DC106568D; Tue, 26 Jun 2012 01:31:59 +0000 (UTC) (envelope-from araujobsdport@gmail.com) Received: from mail-yw0-f44.google.com (mail-yw0-f44.google.com [209.85.213.44]) by mx1.freebsd.org (Postfix) with ESMTP id 4DF668FC18; Tue, 26 Jun 2012 01:31:59 +0000 (UTC) Received: by yhq56 with SMTP id 56so3787481yhq.17 for ; Mon, 25 Jun 2012 18:31:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:reply-to:in-reply-to:references:date:message-id :subject:from:to:cc:content-type; bh=xmkK0wCEvwFWSCpbEPRjYUlh1/K2gqqdb8xoFW+yOjQ=; b=O9634i0Px22MsTvo/hh8p8/wAQgzAyTZLehxqGV6Z0I3E8L/0qCd1P7F8jfR+qfBrr oIQU/dEH24dDxQTeUHRWW7VYP7dxQKZY5I2C9m2nHuarmjtqxLNnn/+JukF4A7AWEc0a V2gJC1XiSYRuphaMuXowery/H+7xnXJpT4/zXaMH/Ek8r3CPB7eD4ef59uVO+huoiCj5 KS/MCydol+nkf3yWgFxThGZOM1JFz3ortYqNxyGjgAbX8tpKulCaXz5bqumb9yYDy/vk hq/FSJrdjXWHSs4lX2C9WuCsQCpCUeecS0fh6wyuXO+z36DRFtN7Qs8Z2lO7sLgj5tyA rB6A== MIME-Version: 1.0 Received: by 10.60.170.38 with SMTP id aj6mr14249578oec.51.1340674313175; Mon, 25 Jun 2012 18:31:53 -0700 (PDT) Received: by 10.76.68.74 with HTTP; Mon, 25 Jun 2012 18:31:53 -0700 (PDT) In-Reply-To: <201206251443.41768.jhb@freebsd.org> References: <201206251443.41768.jhb@freebsd.org> Date: Tue, 26 Jun 2012 09:31:53 +0800 Message-ID: From: Marcelo Araujo To: John Baldwin Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: fs@freebsd.org Subject: Re: [PATCH] Simple ARC stats in top X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: araujo@FreeBSD.org List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jun 2012 01:31:59 -0000 It is very useful, special when we talk about ZFS. 2012/6/26 John Baldwin > I have some patches based on a script I got from avg@ that add some > simplistic > ARC stats to top so that one can see how much of wired memory is set aside > for > ARC, and how that memory is split up. The patch is against 8-stable: > http://www.FreeBSD.org/~jhb/patches/top_arc.patch > > Sample output: > > Mem: 1245M Active, 1393M Inact, 21G Wired, 309M Buf, 23G Free > ARC: 19G Total, 1381M MRU, 17G MFU, 272K Anon, 232M Header, 442M Other > Swap: 8192M Total, 8192M Free > > Comments, etc.? > > -- > John Baldwin > _______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > -- Marcelo Araujo araujo@FreeBSD.org From owner-freebsd-fs@FreeBSD.ORG Tue Jun 26 01:38:40 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id EDBE71065672; Tue, 26 Jun 2012 01:38:40 +0000 (UTC) (envelope-from araujobsdport@gmail.com) Received: from mail-ob0-f182.google.com (mail-ob0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id A16838FC0A; Tue, 26 Jun 2012 01:38:40 +0000 (UTC) Received: by obbun3 with SMTP id un3so9330679obb.13 for ; Mon, 25 Jun 2012 18:38:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:reply-to:in-reply-to:references:date:message-id :subject:from:to:cc:content-type; bh=Q8fBzxZzGtWc3QDkkupNqvJXl59w497mRcDkkUqiUu0=; b=O97CsdzHfcTVRxL8A5DyGciO9rVtj2PQoJpIKHkHpkuww9sZf4s/Ye2IuL3jlC8M5u mFxlzwZcHHTBxhwCVPqukEdIpTPrmFxPtNxCCGwLOTuY0E9IRHkN5fX+WQk2PL6yAkTV xoyGZIO3Mqh7aNwXQCvCseUNpc12fCE1auHofcCThV7n6r7ewn9K8oZylFMjKpUVAfN2 atW1fqiicBcnJXcaxX11yjGWzDKbfEZbWMqzjpkH/8X18XSO5ktBmKq47JVvbauxQHLm Zzd821CpQuJQ7uJKu62vwO+qbUwRKehVbQwS5X8bkk3h5ecYsCXck/U7dp5N4DSSUZkK SXsg== MIME-Version: 1.0 Received: by 10.182.77.170 with SMTP id t10mr14396959obw.70.1340674719951; Mon, 25 Jun 2012 18:38:39 -0700 (PDT) Received: by 10.76.68.74 with HTTP; Mon, 25 Jun 2012 18:38:39 -0700 (PDT) In-Reply-To: <20120625095548.GD2337@deviant.kiev.zoral.com.ua> References: <1340589808.2192.1.camel@nsl> <20120625095548.GD2337@deviant.kiev.zoral.com.ua> Date: Tue, 26 Jun 2012 09:38:39 +0800 Message-ID: From: Marcelo Araujo To: Konstantin Belousov Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-fs@freebsd.org, freebsd-current Subject: Re: Tmpfs panic in -current X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: araujo@FreeBSD.org List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jun 2012 01:38:41 -0000 Hello Kevin, May you rebuild your kernel with some options that will make the dump of the crash easier to send to people? Try to follow these steps: 1) Configure KERNEL with the folowing options: options KDB options GDB options DDB 2) Configure rc.conf: dumpdev="/dev/ad0s1b" #Your swap slice. dumpdir="/var/crash" #By default. crashinfo_enable="YES" crashinfo_program="/usr/sbin/crashinfo" 3) When the FreeBSD crash, it won't rebut, but will be stop on a gdb prompt. 3.1) gdb> continue 3.2) gdb> dump 4) kgdb /boot/kernel/kernel.symbols /var/crash/vmcore.0 5) kgdb> backtrace 6) kgdb> up 4 7) kgdb> up 6 --> Up to line number 4. 7 --> Up to the next line. Best Regards, - Araujo 2012/6/25 Konstantin Belousov > On Mon, Jun 25, 2012 at 10:03:28AM +0800, Kevin Lo wrote: > > I've observed a panic in recent -current several times but I only > > have a picture of the backtrace: > > http://people.freebsd.org/~kevlo/panic_tmpfs.jpg > > > > Does this look at all familiar to anyone? > > Can you look up the line corresponding to tmpfs_reg_resize + 0x627 address > in your kernel ? > > The screenshot looks strange. The instruction on which the kernel trapped > is int 0x28 which should not appear in the compiled code. > -- Marcelo Araujo araujo@FreeBSD.org From owner-freebsd-fs@FreeBSD.ORG Tue Jun 26 04:02:39 2012 Return-Path: Delivered-To: fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 84023106566C for ; Tue, 26 Jun 2012 04:02:39 +0000 (UTC) (envelope-from jhellenthal@dataix.net) Received: from mail-gh0-f182.google.com (mail-gh0-f182.google.com [209.85.160.182]) by mx1.freebsd.org (Postfix) with ESMTP id 2A5888FC1A for ; Tue, 26 Jun 2012 04:02:39 +0000 (UTC) Received: by ghbz22 with SMTP id z22so4053255ghb.13 for ; Mon, 25 Jun 2012 21:02:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dataix.net; s=rsa; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to; bh=Oh8kn6tusBxtG24sh2R743iHwizGYdnFgfyPFhJAVaw=; b=MBlxxFr5VDbsuit6+y00ntVNkyqpFOUonUdok74sBTpjsAzfxq33aaOxICUpoKFM1c 8NcNB4jq7HVIe0iqAGTI+Jcp4kpMPTkZ33F8oG6swT9D7+j1cezy1qj6zuHMGTucMooe P/tI3tpT67ejABrSOq3l/VVKtb2HC/j9Ux9aw= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:x-gm-message-state; bh=Oh8kn6tusBxtG24sh2R743iHwizGYdnFgfyPFhJAVaw=; b=W9Z5YwaGzbKTz5mnKIMUjzTWybKIjRGowwj9wSuMkVPftowhTHM+hZ4evEid9nOpuu x945K3d3LHs1PWjPj6QGoIKUa4fPw22KHDAlRmWOKeiprEX+E0Zx0oEPz7KhzpcE463A ShD3//rqxP5UEbpM3ZKISkqlHU42+L+e0fi1MLXt2zBsz/thIVS7wMI/O3GN9K7DHFvn EXJLQHjBv+XCgxFVXnF8TEdOs1YPrAvHEIadjhk++Kx3s8I+Iy7XadUMolIZdi0BjLOD ypA721IJn+/HeanrK7O6OCPlx3JPaSOFR9SX2JAojmZVoldpKHM68AGAz5e+KgoB46sw 0M9g== Received: by 10.50.217.199 with SMTP id pa7mr9889182igc.17.1340683358368; Mon, 25 Jun 2012 21:02:38 -0700 (PDT) Received: from DataIX.net (75-128-120-86.dhcp.aldl.mi.charter.com. [75.128.120.86]) by mx.google.com with ESMTPS id pp4sm1890881igb.5.2012.06.25.21.02.37 (version=TLSv1/SSLv3 cipher=OTHER); Mon, 25 Jun 2012 21:02:37 -0700 (PDT) Received: from DataIX.net (localhost [127.0.0.1]) by DataIX.net (8.14.5/8.14.5) with ESMTP id q5Q42awl058156 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 26 Jun 2012 00:02:36 -0400 (EDT) (envelope-from jhellenthal@DataIX.net) Received: (from jh@localhost) by DataIX.net (8.14.5/8.14.5/Submit) id q5Q42a10058155; Tue, 26 Jun 2012 00:02:36 -0400 (EDT) (envelope-from jhellenthal@DataIX.net) Date: Tue, 26 Jun 2012 00:02:36 -0400 From: "J. Hellenthal" To: John Baldwin Message-ID: <20120626040235.GA57300@DataIX.net> References: <201206251443.41768.jhb@freebsd.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="gBBFr7Ir9EOA20Yy" Content-Disposition: inline In-Reply-To: <201206251443.41768.jhb@freebsd.org> X-Gm-Message-State: ALoCoQnaDIftt6ajaYgqPPMaNhEvzXdGSZqSBLxaLtFMqkU0K1sh8f1TpTJf8hi68cM5sS4gAJZf Cc: fs@freebsd.org Subject: Re: [PATCH] Simple ARC stats in top X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jun 2012 04:02:39 -0000 --gBBFr7Ir9EOA20Yy Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Jun 25, 2012 at 02:43:41PM -0400, John Baldwin wrote: > I have some patches based on a script I got from avg@ that add some simpl= istic=20 > ARC stats to top so that one can see how much of wired memory is set asid= e for=20 > ARC, and how that memory is split up. The patch is against 8-stable: > http://www.FreeBSD.org/~jhb/patches/top_arc.patch >=20 > Sample output: >=20 > Mem: 1245M Active, 1393M Inact, 21G Wired, 309M Buf, 23G Free > ARC: 19G Total, 1381M MRU, 17G MFU, 272K Anon, 232M Header, 442M Other > Swap: 8192M Total, 8192M Free >=20 > Comments, etc.? >=20 Run with it! Only question I can come up with throughout this patch is how would it act on a system that was built WITHOUT_ZFS ? I just tested it out on a machine where there is no ZFS and one where there is and its golden. I don't have the resources to test for WITHOUT_ZFS though. --=20 - (2^(N-1)) --gBBFr7Ir9EOA20Yy Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- iQEcBAEBAgAGBQJP6TRbAAoJEBSh2Dr1DU7WWiwIAISN0edWCkQTLhG4EZaMWQ5x R0KQDD/VYQPhVUTVL5GnCeug6zikJ2TAZUD6VAT0N0QfKb+/MFaUoQSmOzcTuAFA 9GJHhxzirMwFeOEpHYXsF91duLY7fXbS4HhrD3oNxe6VLxSKbovZK5FdTy01KgXh 5pTUChYnFWcFlpdUA6gSCCS9vT3GZwdoFbhTfoSLVCksowp2njqmEXJpvsTSuUkj gjjys3gkUPvfeOBQSIDABwbA4B8LHoSlcPwUKWwWXw/eB9RAvIDGwbjL9+JpvI0f bnhwIuqc8n+Pz9IC+Lk1heWeasfO3ppLosQ6Y4qH9wY6ZbEUUZsi0TuWahaGocU= =+qH5 -----END PGP SIGNATURE----- --gBBFr7Ir9EOA20Yy-- From owner-freebsd-fs@FreeBSD.ORG Tue Jun 26 04:38:34 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DB80A1065672; Tue, 26 Jun 2012 04:38:34 +0000 (UTC) (envelope-from kevlo@kevlo.org) Received: from ns.kevlo.org (kevlo.org [220.128.136.52]) by mx1.freebsd.org (Postfix) with ESMTP id 3A52F8FC12; Tue, 26 Jun 2012 04:38:33 +0000 (UTC) Received: from [127.0.0.1] (git.kevlo.org [220.128.136.52]) by ns.kevlo.org (8.14.5/8.14.5) with ESMTP id q5Q4cMTv064620; Tue, 26 Jun 2012 12:38:22 +0800 (CST) (envelope-from kevlo@kevlo.org) Message-ID: <1340685505.2170.5.camel@nsl> From: Kevin Lo To: Konstantin Belousov Date: Tue, 26 Jun 2012 12:38:25 +0800 In-Reply-To: <20120625095548.GD2337@deviant.kiev.zoral.com.ua> References: <1340589808.2192.1.camel@nsl> <20120625095548.GD2337@deviant.kiev.zoral.com.ua> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.3-0ubuntu6 Content-Transfer-Encoding: 7bit Mime-Version: 1.0 Cc: freebsd-fs@freebsd.org, freebsd-current Subject: Re: Tmpfs panic in -current X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jun 2012 04:38:34 -0000 Konstantin Belousov wrote: > On Mon, Jun 25, 2012 at 10:03:28AM +0800, Kevin Lo wrote: > > I've observed a panic in recent -current several times but I only > > have a picture of the backtrace: > > http://people.freebsd.org/~kevlo/panic_tmpfs.jpg > > > > Does this look at all familiar to anyone? > > Can you look up the line corresponding to tmpfs_reg_resize + 0x627 address > in your kernel ? Sure. > The screenshot looks strange. The instruction on which the kernel trapped > is int 0x28 which should not appear in the compiled code. # gdb tmpfs.ko (gdb) l *tmpfs_reg_resize+0x627 0xbf37 is in tmpfs_reg_resize (/usr/src/sys/modules/tmpfs/../../fs/tmpfs/tmpfs_subr.c:1005). 1000 in /usr/src/sys/modules/tmpfs/../../fs/tmpfs/tmpfs_subr.c In tmpfs_subr.c: 999 if (m != NULL) { 1000 if ((m->oflags & VPO_BUSY) != 0 || 1001 m->busy != 0) { 1002 vm_page_sleep(m, "tmfssz"); 1003 goto retry; 1004 } 1005 MPASS(m->valid == VM_PAGE_BITS_ALL); 1006 } else if (vm_pager_has_page(uobj, idx, NULL, NU LL)) { Thanks! Kevin From owner-freebsd-fs@FreeBSD.ORG Tue Jun 26 08:30:48 2012 Return-Path: Delivered-To: freebsd-fs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1941D1065677; Tue, 26 Jun 2012 08:30:48 +0000 (UTC) (envelope-from linimon@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id DF38D8FC15; Tue, 26 Jun 2012 08:30:47 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.5/8.14.5) with ESMTP id q5Q8UlXn087798; Tue, 26 Jun 2012 08:30:47 GMT (envelope-from linimon@freefall.freebsd.org) Received: (from linimon@localhost) by freefall.freebsd.org (8.14.5/8.14.5/Submit) id q5Q8UlFH087791; Tue, 26 Jun 2012 08:30:47 GMT (envelope-from linimon) Date: Tue, 26 Jun 2012 08:30:47 GMT Message-Id: <201206260830.q5Q8UlFH087791@freefall.freebsd.org> To: linimon@FreeBSD.org, freebsd-bugs@FreeBSD.org, freebsd-fs@FreeBSD.org From: linimon@FreeBSD.org Cc: Subject: Re: kern/169398: [zfs] Can't remove file with permanent error X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jun 2012 08:30:49 -0000 Old Synopsis: Can't remove file with permanent error New Synopsis: [zfs] Can't remove file with permanent error Responsible-Changed-From-To: freebsd-bugs->freebsd-fs Responsible-Changed-By: linimon Responsible-Changed-When: Tue Jun 26 08:30:35 UTC 2012 Responsible-Changed-Why: Over to maintainer(s). http://www.freebsd.org/cgi/query-pr.cgi?pr=169398 From owner-freebsd-fs@FreeBSD.ORG Tue Jun 26 10:24:43 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id C5246106566C; Tue, 26 Jun 2012 10:24:43 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from mail.zoral.com.ua (mx0.zoral.com.ua [91.193.166.200]) by mx1.freebsd.org (Postfix) with ESMTP id 3DBF38FC0C; Tue, 26 Jun 2012 10:24:42 +0000 (UTC) Received: from skuns.kiev.zoral.com.ua (localhost [127.0.0.1]) by mail.zoral.com.ua (8.14.2/8.14.2) with ESMTP id q5QAOR28042867; Tue, 26 Jun 2012 13:24:27 +0300 (EEST) (envelope-from kostikbel@gmail.com) Received: from deviant.kiev.zoral.com.ua (kostik@localhost [127.0.0.1]) by deviant.kiev.zoral.com.ua (8.14.5/8.14.5) with ESMTP id q5QAOQYx054653; Tue, 26 Jun 2012 13:24:26 +0300 (EEST) (envelope-from kostikbel@gmail.com) Received: (from kostik@localhost) by deviant.kiev.zoral.com.ua (8.14.5/8.14.5/Submit) id q5QAOPi6054652; Tue, 26 Jun 2012 13:24:25 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: deviant.kiev.zoral.com.ua: kostik set sender to kostikbel@gmail.com using -f Date: Tue, 26 Jun 2012 13:24:25 +0300 From: Konstantin Belousov To: Kevin Lo Message-ID: <20120626102424.GL2337@deviant.kiev.zoral.com.ua> References: <1340589808.2192.1.camel@nsl> <20120625095548.GD2337@deviant.kiev.zoral.com.ua> <1340685505.2170.5.camel@nsl> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="ZvISnaQ8JYKZply4" Content-Disposition: inline In-Reply-To: <1340685505.2170.5.camel@nsl> User-Agent: Mutt/1.4.2.3i X-Virus-Scanned: clamav-milter 0.95.2 at skuns.kiev.zoral.com.ua X-Virus-Status: Clean X-Spam-Status: No, score=-4.0 required=5.0 tests=ALL_TRUSTED,AWL,BAYES_00 autolearn=ham version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on skuns.kiev.zoral.com.ua Cc: freebsd-fs@freebsd.org, freebsd-current Subject: Re: Tmpfs panic in -current X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jun 2012 10:24:43 -0000 --ZvISnaQ8JYKZply4 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Jun 26, 2012 at 12:38:25PM +0800, Kevin Lo wrote: > Konstantin Belousov wrote: > > On Mon, Jun 25, 2012 at 10:03:28AM +0800, Kevin Lo wrote: > > > I've observed a panic in recent -current several times but I only > > > have a picture of the backtrace: > > > http://people.freebsd.org/~kevlo/panic_tmpfs.jpg > > >=20 > > > Does this look at all familiar to anyone? > >=20 > > Can you look up the line corresponding to tmpfs_reg_resize + 0x627 addr= ess > > in your kernel ? >=20 > Sure. >=20 > > The screenshot looks strange. The instruction on which the kernel trapp= ed > > is int 0x28 which should not appear in the compiled code. >=20 > # gdb tmpfs.ko > (gdb) l *tmpfs_reg_resize+0x627 > 0xbf37 is in tmpfs_reg_resize (/usr/src/sys/modules/tmpfs/../../fs/tmpfs/= tmpfs_subr.c:1005). > 1000 in /usr/src/sys/modules/tmpfs/../../fs/tmpfs/tmpfs_subr.c >=20 > In tmpfs_subr.c: > 999 if (m !=3D NULL) { > 1000 if ((m->oflags & VPO_BUSY) !=3D 0 || > 1001 m->busy !=3D 0) { > 1002 vm_page_sleep(m, "tmfssz"); > 1003 goto retry; > 1004 } > 1005 MPASS(m->valid =3D=3D VM_PAGE_BITS_A= LL); > 1006 } else if (vm_pager_has_page(uobj, idx, NULL= , NU > LL)) { >=20 Hm, can you get a core and - obtain backtrace in kgdb; - print the *m content for the page that triggered the assertion ? The only possible 'new size' value for the truncation from open(2) is zero, so I do not understand why the asserted block was executed at all. --ZvISnaQ8JYKZply4 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.12 (FreeBSD) iEYEARECAAYFAk/pjdgACgkQC3+MBN1Mb4hFsgCeOI3iGrL11NcdF3tnpSzitJhl c9cAoLhqZmq1SyxQR4zwqIlQdL4uEX3O =Y8sb -----END PGP SIGNATURE----- --ZvISnaQ8JYKZply4-- From owner-freebsd-fs@FreeBSD.ORG Tue Jun 26 10:50:13 2012 Return-Path: Delivered-To: freebsd-fs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CB38F1065672 for ; Tue, 26 Jun 2012 10:50:13 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 9D2268FC1A for ; Tue, 26 Jun 2012 10:50:13 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.5/8.14.5) with ESMTP id q5QAoD3s021088 for ; Tue, 26 Jun 2012 10:50:13 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.5/8.14.5/Submit) id q5QAoDrf021087; Tue, 26 Jun 2012 10:50:13 GMT (envelope-from gnats) Date: Tue, 26 Jun 2012 10:50:13 GMT Message-Id: <201206261050.q5QAoDrf021087@freefall.freebsd.org> To: freebsd-fs@FreeBSD.org From: Andriy Gapon Cc: Subject: Re: kern/166566: [zfs] zfs split renders 2 disk (MBR based) mirror unbootable X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Andriy Gapon List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jun 2012 10:50:13 -0000 The following reply was made to PR kern/166566; it has been noted by GNATS. From: Andriy Gapon To: hartzell@alerce.com, bug-followup@FreeBSD.org Cc: Subject: Re: kern/166566: [zfs] zfs split renders 2 disk (MBR based) mirror unbootable Date: Tue, 26 Jun 2012 13:47:50 +0300 [restoring bug-followup] on 25/06/2012 19:48 George Hartzell said the following: > Here are two images (more than one screen full) of the lsdev -v output > from the loader that *actually loads the system* (when it's > working...). I have a theory of what's going on. I believe that after zpool split the following items get updated with new information: - vdev label on the disk that remains in the main pool (ada3 + zroot) - vdev label on the disk that goes to the new pool (ada1 + zsplitroot) - zpool.cache file in the main/active/remaining pool (zroot) The following item still has outdated information: - zpool.cache file in the new pool (zsplitroot) This happens because the new pool gets the contents of the original pool at split start time (before any new ids are generated). The file can not be updated automatically because the new pool remains "un-imported" (exported) after the split. If it is desired that the zsplitroot's zpool.cache is updated it has to be done manually - by importing the pool, etc. I believe that what you see is a result of you always booting in such a way that the zfs boot code and zfsloader find zsplitroot pool before zroot pool. This is confirmed by the screenshot which shows that zsplitroot is listed before zroot. Because of that the stale zpool.cache file is used and as a result the ZFS code in kernel can not find disks/pools based on the stale IDs. I think that you have to change the boot order using BIOS, so that you boot from ada3 disk. You should verify at the loader prompt that that is indeed the case and zroot is found first and is used as a boot pool. If your BIOS either doesn't allow to change boot order, or lies about it or doesn't change bios disk numbering such that a boot disk is the first drive (disk0 / "BIOS drive C"), then I recommend thatyou set 'currdev' loader variable to point to zroot pool. Depending on your zfsloader version it should be done in one of the following ways: set currdev=zfs:zroot: set currdev=zfs1 You can examine default value of the variable (with 'show' command) to see which scheme should be used. Please test this. -- Andriy Gapon From owner-freebsd-fs@FreeBSD.ORG Tue Jun 26 14:03:43 2012 Return-Path: Delivered-To: freebsd-fs@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5AC321065670 for ; Tue, 26 Jun 2012 14:03:43 +0000 (UTC) (envelope-from prvs=1524ba8fc3=killing@multiplay.co.uk) Received: from mail1.multiplay.co.uk (mail1.multiplay.co.uk [85.236.96.23]) by mx1.freebsd.org (Postfix) with ESMTP id DE95C8FC1B for ; Tue, 26 Jun 2012 14:03:42 +0000 (UTC) X-Spam-Processed: mail1.multiplay.co.uk, Tue, 26 Jun 2012 15:03:33 +0100 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on mail1.multiplay.co.uk X-Spam-Level: X-Spam-Status: No, score=-5.0 required=6.0 tests=USER_IN_WHITELIST shortcircuit=ham autolearn=disabled version=3.2.5 Received: from r2d2 ([188.220.16.49]) by mail1.multiplay.co.uk (mail1.multiplay.co.uk [85.236.96.23]) (MDaemon PRO v10.0.4) with ESMTP id md50020476468.msg for ; Tue, 26 Jun 2012 15:03:32 +0100 X-MDRemoteIP: 188.220.16.49 X-Return-Path: prvs=1524ba8fc3=killing@multiplay.co.uk X-Envelope-From: killing@multiplay.co.uk X-MDaemon-Deliver-To: freebsd-fs@FreeBSD.ORG Message-ID: <2194101A4F9946B496D921940B806486@multiplay.co.uk> From: "Steven Hartland" To: Date: Tue, 26 Jun 2012 15:04:20 +0100 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="iso-8859-1"; reply-type=original Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.5931 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.6157 Cc: Subject: ZFS using sectorsize instead of stripesize for ashift X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jun 2012 14:03:43 -0000 We've been doing a lot test on ZFS with SSD's in particular around trim. During this we've added quirks for our SSD's to cam/scsi_da and was expecting this to ensure ZFS's ashift is set correctly for newly create pools, instead of having to use the gnop workaround. Unfortunately this doesn't seem to be the case as ZFS is using the geom providers sectorsize instead of stripesize as its minimum transfer size (ashift). The following patch corrects this behaviour so ZFS uses stripsize for ashift definition. So the question is this the correct thing to do? If so should any of the other usages of sectorsize be changes to stripesize as well? --- sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_geom.c.ashift 2012-06-26 13:38:55.193306961 +0000 +++ sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_geom.c 2012-06-26 13:39:22.323019022 +0000 @@ -504,7 +504,7 @@ /* * Determine the device's minimum transfer size. */ - *ashift = highbit(MAX(pp->sectorsize, SPA_MINBLOCKSIZE)) - 1; + *ashift = highbit(MAX(pp->stripesize, SPA_MINBLOCKSIZE)) - 1; /* * Clear the nowritecache settings, so that on a vdev_reopen() Regards Steve ================================================ This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337 or return the E.mail to postmaster@multiplay.co.uk. From owner-freebsd-fs@FreeBSD.ORG Tue Jun 26 14:08:10 2012 Return-Path: Delivered-To: fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 1835D1065677 for ; Tue, 26 Jun 2012 14:08:10 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from bigwig.baldwin.cx (bigknife-pt.tunnel.tserv9.chi1.ipv6.he.net [IPv6:2001:470:1f10:75::2]) by mx1.freebsd.org (Postfix) with ESMTP id E33FD8FC1E for ; Tue, 26 Jun 2012 14:08:09 +0000 (UTC) Received: from jhbbsd.localnet (unknown [209.249.190.124]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id 3EDB7B95D; Tue, 26 Jun 2012 10:08:09 -0400 (EDT) From: John Baldwin To: "J. Hellenthal" Date: Tue, 26 Jun 2012 09:55:30 -0400 User-Agent: KMail/1.13.5 (FreeBSD/8.2-CBSD-20110714-p17; KDE/4.5.5; amd64; ; ) References: <201206251443.41768.jhb@freebsd.org> <20120626040235.GA57300@DataIX.net> In-Reply-To: <20120626040235.GA57300@DataIX.net> MIME-Version: 1.0 Content-Type: Text/Plain; charset="iso-8859-15" Content-Transfer-Encoding: 7bit Message-Id: <201206260955.30935.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Tue, 26 Jun 2012 10:08:09 -0400 (EDT) Cc: fs@freebsd.org Subject: Re: [PATCH] Simple ARC stats in top X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jun 2012 14:08:10 -0000 On Tuesday, June 26, 2012 12:02:36 am J. Hellenthal wrote: > > On Mon, Jun 25, 2012 at 02:43:41PM -0400, John Baldwin wrote: > > I have some patches based on a script I got from avg@ that add some simplistic > > ARC stats to top so that one can see how much of wired memory is set aside for > > ARC, and how that memory is split up. The patch is against 8-stable: > > http://www.FreeBSD.org/~jhb/patches/top_arc.patch > > > > Sample output: > > > > Mem: 1245M Active, 1393M Inact, 21G Wired, 309M Buf, 23G Free > > ARC: 19G Total, 1381M MRU, 17G MFU, 272K Anon, 232M Header, 442M Other > > Swap: 8192M Total, 8192M Free > > > > Comments, etc.? > > > > Run with it! > > Only question I can come up with throughout this patch is how would it > act on a system that was built WITHOUT_ZFS ? > > I just tested it out on a machine where there is no ZFS and one where > there is and its golden. I don't have the resources to test for > WITHOUT_ZFS though. It should be fine. It just determines if the sysctl's are present at runtime. It doesn't use any ZFS libraries, etc. so WITHOUT_ZFS shouldn't matter. -- John Baldwin From owner-freebsd-fs@FreeBSD.ORG Tue Jun 26 14:29:27 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DB5D41065679 for ; Tue, 26 Jun 2012 14:29:27 +0000 (UTC) (envelope-from feld@feld.me) Received: from feld.me (unknown [IPv6:2607:f4e0:100:300::2]) by mx1.freebsd.org (Postfix) with ESMTP id B204B8FC18 for ; Tue, 26 Jun 2012 14:29:27 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=feld.me; s=blargle; h=In-Reply-To:Message-Id:From:Mime-Version:Date:References:Subject:To:Content-Type; bh=bJB6g+H7oy25qTHrQTVIfnjyRN0LGVZKGWO8+bVjdrw=; b=WwnqFP1oiB1DX53sUyqrfE/mrNGvhbJ7DEArWcZUnIb05WeOt2WcVcLNbp5WB/jaq4RPAoBDPnuzyCTBIhP0g8bE1CwfiTVYkKW8GVA58NHXqIdXu6efGA8l3LMHPRwL; Received: from localhost ([127.0.0.1] helo=mwi1.coffeenet.org) by feld.me with esmtp (Exim 4.77 (FreeBSD)) (envelope-from ) id 1SjWle-000Dbt-Aj for freebsd-fs@freebsd.org; Tue, 26 Jun 2012 09:29:27 -0500 Received: from feld@feld.me by mwi1.coffeenet.org (Archiveopteryx 3.1.4) with esmtpa id 1340720956-94480-94479/5/56; Tue, 26 Jun 2012 14:29:16 +0000 Content-Type: text/plain; charset=utf-8; format=flowed; delsp=yes To: freebsd-fs@freebsd.org References: <201206251443.41768.jhb@freebsd.org> Date: Tue, 26 Jun 2012 09:29:16 -0500 Mime-Version: 1.0 From: Mark Felder Message-Id: In-Reply-To: <201206251443.41768.jhb@freebsd.org> User-Agent: Opera Mail/12.00 (FreeBSD) X-SA-Score: -1.5 Subject: Re: [PATCH] Simple ARC stats in top X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jun 2012 14:29:28 -0000 On Mon, 25 Jun 2012 13:43:41 -0500, John Baldwin wrote: > > Comments, etc.? > Why do these stats differ from the ones in the zfs-stats script? CPU: 0.1% user, 0.0% nice, 0.3% system, 0.1% interrupt, 99.5% idle Mem: 81M Active, 1118M Inact, 9714M Wired, 76K Cache, 1850M Buf, 6930M Free ARC: 6026M Total, 128K MRU, 1222K MFU, 24K Anon, 9961K Header, 238K Other Swap: 18G Total, 18G Free zfs-stats output: ARC Size Breakdown: Recently Used Cache Size: 0.67% 40.11 MiB Frequently Used Cache Size: 99.33% 5.85 GiB Shouldn't your MFU be 5.85GiB and MRU be 40MiB? From owner-freebsd-fs@FreeBSD.ORG Tue Jun 26 14:49:49 2012 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 37A96106564A for ; Tue, 26 Jun 2012 14:49:49 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from citadel.icyb.net.ua (citadel.icyb.net.ua [212.40.38.140]) by mx1.freebsd.org (Postfix) with ESMTP id 7F9588FC16 for ; Tue, 26 Jun 2012 14:49:48 +0000 (UTC) Received: from odyssey.starpoint.kiev.ua (alpha-e.starpoint.kiev.ua [212.40.38.101]) by citadel.icyb.net.ua (8.8.8p3/ICyb-2.3exp) with ESMTP id RAA03058; Tue, 26 Jun 2012 17:49:37 +0300 (EEST) (envelope-from avg@FreeBSD.org) Message-ID: <4FE9CC00.9090501@FreeBSD.org> Date: Tue, 26 Jun 2012 17:49:36 +0300 From: Andriy Gapon User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:13.0) Gecko/20120610 Thunderbird/13.0 MIME-Version: 1.0 To: Mark Felder References: <201206251443.41768.jhb@freebsd.org> In-Reply-To: X-Enigmail-Version: 1.4.2 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Cc: freebsd-fs@FreeBSD.org Subject: Re: [PATCH] Simple ARC stats in top X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jun 2012 14:49:49 -0000 on 26/06/2012 17:29 Mark Felder said the following: > On Mon, 25 Jun 2012 13:43:41 -0500, John Baldwin wrote: >> >> Comments, etc.? >> > > Why do these stats differ from the ones in the zfs-stats script? > > CPU: 0.1% user, 0.0% nice, 0.3% system, 0.1% interrupt, 99.5% idle > Mem: 81M Active, 1118M Inact, 9714M Wired, 76K Cache, 1850M Buf, 6930M Free > ARC: 6026M Total, 128K MRU, 1222K MFU, 24K Anon, 9961K Header, 238K Other Hmm, the above numbers add up to about 10MB... > Swap: 18G Total, 18G Free > > zfs-stats output: > > ARC Size Breakdown: > Recently Used Cache Size: 0.67% 40.11 MiB > Frequently Used Cache Size: 99.33% 5.85 GiB > > Shouldn't your MFU be 5.85GiB and MRU be 40MiB? Please also reproduce the zfs-stats lines preceding the quoted output. Additionally, please run this script http://people.freebsd.org/~avg/arc-sizes.sh -- Andriy Gapon From owner-freebsd-fs@FreeBSD.ORG Tue Jun 26 15:02:05 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1544E106568E for ; Tue, 26 Jun 2012 15:02:05 +0000 (UTC) (envelope-from ml@my.gd) Received: from mail-ey0-f182.google.com (mail-ey0-f182.google.com [209.85.215.182]) by mx1.freebsd.org (Postfix) with ESMTP id 989028FC26 for ; Tue, 26 Jun 2012 15:02:04 +0000 (UTC) Received: by eabm6 with SMTP id m6so6562eab.13 for ; Tue, 26 Jun 2012 08:01:58 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:subject:references :in-reply-to:content-type:content-transfer-encoding :x-gm-message-state; bh=h22NK+1uNnFhinCMj8HHdoslacbu4UFIIiks81ubQtc=; b=fDeYnF9sogMTlpJXkPXab3OvXq/e0sERBca/OfDzuVV2T2n+Le+L3/OsdQSWeuPqwR p+WjA7/HmF+v7DTtAyOKOnWJOCdq3ozE+fLhMov0NWItjgtNzYPZPUejbZsJBxgR7JLE 0P/9D5so0me21ZZi9BNBE+Z3ITJx2Wcmwdwe6tMi1qH+zmPoa1uM4j9tXl35kT6QCPWK Jlj2wrEjys40Khq1OSWy6+A23Ay6T+jkmwFihIrZGY6Y0qE5vxovOKF+OQ57asveb4cn qCXp0Cc9R8r0P+QC9pVQ2OBPsZogSx/Fo+je6thlDbeQJE/pxooSfuIK+T4fiOtOoyxG iDMQ== Received: by 10.14.101.79 with SMTP id a55mr3043243eeg.32.1340722918377; Tue, 26 Jun 2012 08:01:58 -0700 (PDT) Received: from dfleuriot-at-hi-media.com ([83.167.62.196]) by mx.google.com with ESMTPS id e48sm34857463eea.12.2012.06.26.08.01.56 (version=SSLv3 cipher=OTHER); Tue, 26 Jun 2012 08:01:57 -0700 (PDT) Message-ID: <4FE9CEE3.2010000@my.gd> Date: Tue, 26 Jun 2012 17:01:55 +0200 From: Damien Fleuriot User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:12.0) Gecko/20120428 Thunderbird/12.0.1 MIME-Version: 1.0 To: freebsd-fs@freebsd.org References: <201206251443.41768.jhb@freebsd.org> In-Reply-To: <201206251443.41768.jhb@freebsd.org> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Gm-Message-State: ALoCoQnQMLK1XBux+SWlUXAC4z7BOezYvutDSa3WEa9rFmSo3A18chul5koOqWF9bkbwGpBtm1aa Subject: Re: [PATCH] Simple ARC stats in top X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jun 2012 15:02:05 -0000 On 6/25/12 8:43 PM, John Baldwin wrote: > I have some patches based on a script I got from avg@ that add some simplistic > ARC stats to top so that one can see how much of wired memory is set aside for > ARC, and how that memory is split up. The patch is against 8-stable: > http://www.FreeBSD.org/~jhb/patches/top_arc.patch > > Sample output: > > Mem: 1245M Active, 1393M Inact, 21G Wired, 309M Buf, 23G Free > ARC: 19G Total, 1381M MRU, 17G MFU, 272K Anon, 232M Header, 442M Other > Swap: 8192M Total, 8192M Free > > Comments, etc.? > Comment, sure: OH MY GOD THAT'S SO COOL And against 8-STABLE too, that's great. Will test that :) Thanks for your work John From owner-freebsd-fs@FreeBSD.ORG Tue Jun 26 15:25:47 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id A2DB3106566C for ; Tue, 26 Jun 2012 15:25:47 +0000 (UTC) (envelope-from feld@feld.me) Received: from feld.me (unknown [IPv6:2607:f4e0:100:300::2]) by mx1.freebsd.org (Postfix) with ESMTP id 773108FC1E for ; Tue, 26 Jun 2012 15:25:47 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=feld.me; s=blargle; h=In-Reply-To:Message-Id:From:Content-Transfer-Encoding:Mime-Version:Date:References:Subject:To:Content-Type; bh=FMRSAru348cexmdsm5avtJSkFD/xZpxEJBohGWi0z3U=; b=TTApWlIfbK+wxNlnPCgCrMK68OMjCMrOLzarHeSmcH9Xj2q/YyzvRM26Z7p3DMDSxeYfPADsI5USFkUTn6ZLJ/i6oms13wwQhQXyn24wS7n6Pjo+LH5uWWVnapirjB4L; Received: from localhost ([127.0.0.1] helo=mwi1.coffeenet.org) by feld.me with esmtp (Exim 4.77 (FreeBSD)) (envelope-from ) id 1SjXeE-000GIV-Bs for freebsd-fs@freebsd.org; Tue, 26 Jun 2012 10:25:47 -0500 Received: from feld@feld.me by mwi1.coffeenet.org (Archiveopteryx 3.1.4) with esmtpa id 1340724340-94480-94479/5/59; Tue, 26 Jun 2012 15:25:40 +0000 Content-Type: text/plain; charset=utf-8; format=flowed; delsp=yes To: freebsd-fs@freebsd.org References: <201206251443.41768.jhb@freebsd.org> <4FE9CC00.9090501@FreeBSD.org> Date: Tue, 26 Jun 2012 10:25:40 -0500 Mime-Version: 1.0 Content-Transfer-Encoding: quoted-printable From: Mark Felder Message-Id: In-Reply-To: <4FE9CC00.9090501@FreeBSD.org> User-Agent: Opera Mail/12.00 (FreeBSD) X-SA-Score: -1.5 Subject: Re: [PATCH] Simple ARC stats in top X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jun 2012 15:25:47 -0000 On Tue, 26 Jun 2012 09:49:36 -0500, Andriy Gapon wrote: > > Please also reproduce the zfs-stats lines preceding the quoted output. zfs2# zfs-stats -A =2D----------------------------------------------------------------------= - ZFS Subsystem Report Tue Jun 26 10:24:40 2012 =2D----------------------------------------------------------------------= - ARC Summary: (HEALTHY) Memory Throttle Count: 0 ARC Misc: Deleted: 87.09m Recycle Misses: 50.58m Mutex Misses: 299.09k Evict Skips: 5.28m ARC Size: 941.88% 5.89 GiB Target Size: (Adaptive) 100.00% 640.00 MiB Min Size (Hard Limit): 12.50% 80.00 MiB Max Size (High Water): 8:1 640.00 MiB ARC Size Breakdown: Recently Used Cache Size: 0.66% 40.00 MiB Frequently Used Cache Size: 99.34% 5.85 GiB ARC Hash Breakdown: Elements Max: 29.25m Elements Current: 100.00% 29.25m Collisions: 89.81m Chain Max: 131 Chains: 524.29k =2D----------------------------------------------------------------------= - > Additionally, please run this script =20 > http://people.freebsd.org/~avg/arc-sizes.sh > zfs2# sh arc-sizes.sh ARC top-level breakdown: size: 6319074560 hdr_size: 10166488 data_size: 1513472 other_size: 245576 ARC size vs hdr_size + data_size + other_size: 6319074560 vs 11925536 ARC Data breakdown: mfu_size: 212992 mru_size: 1251328 anon_size: 49152 Data size vs mfu_size + mru_size + anon_size: 1513472 vs 1513472 mfu breakdown: data_lsize: 0 metadata_lsize: 0 other (overhead? ghost entries?): 212992 mru breakdown: data_lsize: 0 metadata_lsize: 49152 other (overhead? ghost entries?): 1202176 anon breakdown: data_lsize: 0 metadata_lsize: 0 other (overhead? ghost entries?): 49152 From owner-freebsd-fs@FreeBSD.ORG Tue Jun 26 15:34:19 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 549011065670 for ; Tue, 26 Jun 2012 15:34:19 +0000 (UTC) (envelope-from ronald-freebsd8@klop.yi.org) Received: from smarthost1.greenhost.nl (smarthost1.greenhost.nl [195.190.28.78]) by mx1.freebsd.org (Postfix) with ESMTP id CB6848FC0A for ; Tue, 26 Jun 2012 15:34:18 +0000 (UTC) Received: from smtp.greenhost.nl ([213.108.104.138]) by smarthost1.greenhost.nl with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32) (Exim 4.69) (envelope-from ) id 1SjXmM-000187-U4 for freebsd-fs@freebsd.org; Tue, 26 Jun 2012 17:34:11 +0200 Received: from [81.21.138.17] (helo=ronaldradial.versatec.local) by smtp.greenhost.nl with esmtpsa (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.72) (envelope-from ) id 1SjXmN-0003xV-BJ for freebsd-fs@freebsd.org; Tue, 26 Jun 2012 17:34:11 +0200 Content-Type: text/plain; charset=us-ascii; format=flowed; delsp=yes To: freebsd-fs@freebsd.org References: <201206251443.41768.jhb@freebsd.org> <4FE9CC00.9090501@FreeBSD.org> Date: Tue, 26 Jun 2012 17:34:09 +0200 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit From: "Ronald Klop" Message-ID: In-Reply-To: User-Agent: Opera Mail/12.00 (Win32) X-Virus-Scanned: by clamav at smarthost1.samage.net X-Spam-Level: / X-Spam-Score: 0.8 X-Spam-Status: No, score=0.8 required=5.0 tests=BAYES_50 autolearn=disabled version=3.3.1 X-Scan-Signature: 02b201d9c048bcde4aa7ed91fc024d05 Subject: Re: [PATCH] Simple ARC stats in top X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jun 2012 15:34:19 -0000 Nr. of page vs. KB size? Ronald. On Tue, 26 Jun 2012 17:25:40 +0200, Mark Felder wrote: > On Tue, 26 Jun 2012 09:49:36 -0500, Andriy Gapon wrote: > >> >> Please also reproduce the zfs-stats lines preceding the quoted output. > > zfs2# zfs-stats -A > > ------------------------------------------------------------------------ > ZFS Subsystem Report Tue Jun 26 10:24:40 2012 > ------------------------------------------------------------------------ > > ARC Summary: (HEALTHY) > Memory Throttle Count: 0 > > ARC Misc: > Deleted: 87.09m > Recycle Misses: 50.58m > Mutex Misses: 299.09k > Evict Skips: 5.28m > > ARC Size: 941.88% 5.89 GiB > Target Size: (Adaptive) 100.00% 640.00 MiB > Min Size (Hard Limit): 12.50% 80.00 MiB > Max Size (High Water): 8:1 640.00 MiB > > ARC Size Breakdown: > Recently Used Cache Size: 0.66% 40.00 MiB > Frequently Used Cache Size: 99.34% 5.85 GiB > > ARC Hash Breakdown: > Elements Max: 29.25m > Elements Current: 100.00% 29.25m > Collisions: 89.81m > Chain Max: 131 > Chains: 524.29k > > ------------------------------------------------------------------------ > >> Additionally, please run this script >> http://people.freebsd.org/~avg/arc-sizes.sh >> > > > zfs2# sh arc-sizes.sh > ARC top-level breakdown: > size: 6319074560 > hdr_size: 10166488 > data_size: 1513472 > other_size: 245576 > > ARC size vs hdr_size + data_size + other_size: > 6319074560 vs 11925536 > > ARC Data breakdown: > mfu_size: 212992 > mru_size: 1251328 > anon_size: 49152 > > Data size vs mfu_size + mru_size + anon_size: > 1513472 vs 1513472 > > mfu breakdown: > data_lsize: 0 > metadata_lsize: 0 > > other (overhead? ghost entries?): 212992 > > mru breakdown: > data_lsize: 0 > metadata_lsize: 49152 > > other (overhead? ghost entries?): 1202176 > > anon breakdown: > data_lsize: 0 > metadata_lsize: 0 > > other (overhead? ghost entries?): 49152 > _______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" From owner-freebsd-fs@FreeBSD.ORG Tue Jun 26 15:55:23 2012 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DE6F1106564A; Tue, 26 Jun 2012 15:55:23 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from citadel.icyb.net.ua (citadel.icyb.net.ua [212.40.38.140]) by mx1.freebsd.org (Postfix) with ESMTP id 025808FC08; Tue, 26 Jun 2012 15:55:22 +0000 (UTC) Received: from odyssey.starpoint.kiev.ua (alpha-e.starpoint.kiev.ua [212.40.38.101]) by citadel.icyb.net.ua (8.8.8p3/ICyb-2.3exp) with ESMTP id SAA04051; Tue, 26 Jun 2012 18:55:12 +0300 (EEST) (envelope-from avg@FreeBSD.org) Message-ID: <4FE9DB60.1030905@FreeBSD.org> Date: Tue, 26 Jun 2012 18:55:12 +0300 From: Andriy Gapon User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:13.0) Gecko/20120610 Thunderbird/13.0 MIME-Version: 1.0 To: Mark Felder References: <201206251443.41768.jhb@freebsd.org> <4FE9CC00.9090501@FreeBSD.org> In-Reply-To: X-Enigmail-Version: 1.4.2 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Cc: freebsd-fs@FreeBSD.org, John Baldwin Subject: Re: [PATCH] Simple ARC stats in top X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jun 2012 15:55:24 -0000 on 26/06/2012 18:25 Mark Felder said the following: > On Tue, 26 Jun 2012 09:49:36 -0500, Andriy Gapon wrote: > >> >> Please also reproduce the zfs-stats lines preceding the quoted output. > > zfs2# zfs-stats -A > > ------------------------------------------------------------------------ > ZFS Subsystem Report Tue Jun 26 10:24:40 2012 > ------------------------------------------------------------------------ > > ARC Summary: (HEALTHY) > Memory Throttle Count: 0 > > ARC Misc: > Deleted: 87.09m > Recycle Misses: 50.58m > Mutex Misses: 299.09k > Evict Skips: 5.28m > > ARC Size: 941.88% 5.89 GiB > Target Size: (Adaptive) 100.00% 640.00 MiB > Min Size (Hard Limit): 12.50% 80.00 MiB > Max Size (High Water): 8:1 640.00 MiB Does your system also has L2 ARC? If so, could you please show a value of kstat.zfs.misc.arcstats.l2_hdr_size? Otherwise, it's hard for me to explain the huge difference between Max Size and ARC Size. > ARC Size Breakdown: > Recently Used Cache Size: 0.66% 40.00 MiB > Frequently Used Cache Size: 99.34% 5.85 GiB zfs-stats seems to have a bug where it treats kstat.zfs.misc.arcstats.p as current MRU size whereas it is target MRU size (similarly to how kstat.zfs.misc.arcstats.c is the target cache size). So, the logic that reports the above breakdown is flawed. I believe that the real MFU and MRU sizes are reported below (by arc-sizes.sh script). > ARC Hash Breakdown: > Elements Max: 29.25m > Elements Current: 100.00% 29.25m > Collisions: 89.81m > Chain Max: 131 > Chains: 524.29k > > ------------------------------------------------------------------------ > >> Additionally, please run this script http://people.freebsd.org/~avg/arc-sizes.sh >> > > > zfs2# sh arc-sizes.sh > ARC top-level breakdown: > size: 6319074560 > hdr_size: 10166488 > data_size: 1513472 > other_size: 245576 > > ARC size vs hdr_size + data_size + other_size: > 6319074560 vs 11925536 > > ARC Data breakdown: > mfu_size: 212992 > mru_size: 1251328 > anon_size: 49152 > > Data size vs mfu_size + mru_size + anon_size: > 1513472 vs 1513472 > > mfu breakdown: > data_lsize: 0 > metadata_lsize: 0 > > other (overhead? ghost entries?): 212992 > > mru breakdown: > data_lsize: 0 > metadata_lsize: 49152 > > other (overhead? ghost entries?): 1202176 > > anon breakdown: > data_lsize: 0 > metadata_lsize: 0 > > other (overhead? ghost entries?): 49152 Thank you. -- Andriy Gapon From owner-freebsd-fs@FreeBSD.ORG Tue Jun 26 15:57:17 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id DC2821065670; Tue, 26 Jun 2012 15:57:17 +0000 (UTC) (envelope-from feld@feld.me) Received: from feld.me (unknown [IPv6:2607:f4e0:100:300::2]) by mx1.freebsd.org (Postfix) with ESMTP id AEDE78FC17; Tue, 26 Jun 2012 15:57:17 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=feld.me; s=blargle; h=In-Reply-To:Message-Id:From:Content-Transfer-Encoding:Mime-Version:Date:References:Subject:Cc:To:Content-Type; bh=uTCGy5DyV67SEoveANSCQLpKj/etrzeERl9WzuNtL0M=; b=FsF0+L3v1G4xpCC7ZhHgPO7fxtpAIBkpzscRsUuv5VhLOUUWdlRZpFsgyGaG/PstYm5BWEGIOWSWvY04mzKudnzL1hiUOnZbgmT0iOwv8zUIXxuaeJIXBM51sUkylOtw; Received: from localhost ([127.0.0.1] helo=mwi1.coffeenet.org) by feld.me with esmtp (Exim 4.77 (FreeBSD)) (envelope-from ) id 1SjY8e-000Hhr-7l; Tue, 26 Jun 2012 10:57:17 -0500 Received: from feld@feld.me by mwi1.coffeenet.org (Archiveopteryx 3.1.4) with esmtpa id 1340726226-94480-94479/5/60; Tue, 26 Jun 2012 15:57:06 +0000 Content-Type: text/plain; charset=utf-8; format=flowed; delsp=yes To: freebsd-fs@freebsd.org References: <201206251443.41768.jhb@freebsd.org> <4FE9CC00.9090501@FreeBSD.org> <4FE9DB60.1030905@FreeBSD.org> Date: Tue, 26 Jun 2012 10:57:06 -0500 Mime-Version: 1.0 Content-Transfer-Encoding: quoted-printable From: Mark Felder Message-Id: In-Reply-To: <4FE9DB60.1030905@FreeBSD.org> User-Agent: Opera Mail/12.00 (FreeBSD) X-SA-Score: -1.5 Cc: Andriy Gapon Subject: Re: [PATCH] Simple ARC stats in top X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jun 2012 15:57:18 -0000 On Tue, 26 Jun 2012 10:55:12 -0500, Andriy Gapon wrote: > Does your system also has L2 ARC? > If so, could you please show a value of =20 > kstat.zfs.misc.arcstats.l2_hdr_size? > Otherwise, it's hard for me to explain the huge difference between Max = =20 > Size and > ARC Size. Yes, it does. zfs2# sysctl kstat.zfs.misc.arcstats.l2_hdr_size kstat.zfs.misc.arcstats.l2_hdr_size: 6775072568 zfs2# zfs-stats -L =2D----------------------------------------------------------------------= - ZFS Subsystem Report Tue Jun 26 10:56:54 2012 =2D----------------------------------------------------------------------= - L2 ARC Summary: (HEALTHY) Passed Headroom: 61 Tried Lock Failures: 252.97k IO In Progress: 0 Low Memory Aborts: 0 Free on Write: 382.20k Writes While Full: 11.08k R/W Clashes: 270 Bad Checksums: 0 IO Errors: 0 SPA Mismatch: 0 L2 ARC Size: (Adaptive) 225.09 GiB Header Size: 2.80% 6.31 GiB L2 ARC Breakdown: 25.52m Hit Ratio: 87.46% 22.32m Miss Ratio: 12.54% 3.20m Feeds: 3.99m L2 ARC Buffer: Bytes Scanned: 42.67 TiB Buffer Iterations: 3.99m List Iterations: 255.38m NULL List Iterations: 219.99m L2 ARC Writes: Writes Sent: 100.00% 913.05k =2D----------------------------------------------------------------------= - From owner-freebsd-fs@FreeBSD.ORG Tue Jun 26 16:09:08 2012 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 3D74D1065670; Tue, 26 Jun 2012 16:09:08 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from citadel.icyb.net.ua (citadel.icyb.net.ua [212.40.38.140]) by mx1.freebsd.org (Postfix) with ESMTP id 2822C8FC17; Tue, 26 Jun 2012 16:09:06 +0000 (UTC) Received: from odyssey.starpoint.kiev.ua (alpha-e.starpoint.kiev.ua [212.40.38.101]) by citadel.icyb.net.ua (8.8.8p3/ICyb-2.3exp) with ESMTP id TAA04238; Tue, 26 Jun 2012 19:08:51 +0300 (EEST) (envelope-from avg@FreeBSD.org) Message-ID: <4FE9DE92.3040700@FreeBSD.org> Date: Tue, 26 Jun 2012 19:08:50 +0300 From: Andriy Gapon User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:13.0) Gecko/20120610 Thunderbird/13.0 MIME-Version: 1.0 To: Mark Felder , John Baldwin References: <201206251443.41768.jhb@freebsd.org> <4FE9CC00.9090501@FreeBSD.org> <4FE9DB60.1030905@FreeBSD.org> In-Reply-To: X-Enigmail-Version: 1.4.2 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Cc: freebsd-fs@FreeBSD.org Subject: Re: [PATCH] Simple ARC stats in top X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jun 2012 16:09:08 -0000 on 26/06/2012 18:57 Mark Felder said the following: > On Tue, 26 Jun 2012 10:55:12 -0500, Andriy Gapon wrote: > >> Does your system also has L2 ARC? >> If so, could you please show a value of kstat.zfs.misc.arcstats.l2_hdr_size? >> Otherwise, it's hard for me to explain the huge difference between Max Size and >> ARC Size. > > Yes, it does. > > zfs2# sysctl kstat.zfs.misc.arcstats.l2_hdr_size > kstat.zfs.misc.arcstats.l2_hdr_size: 6775072568 Aha, so no mystery, those 6G in ARC are actually used by L2ARC headers. I missed the L2 headers because I haven't used L2 yet. I've updated arc-sizes.sh script now to account for these headers. So the correct ARC size breakdown is: hdr_size + data_size + other_size + l2_hdr_size, where data_size can further be broken down to mfu_size + mru_size + anon_size. I think that users of zfs-stats / arc_summary.pl could benefit from this knowledge too. (I will repeat just in case that zfs-stats mistreats kstat.zfs.misc.arcstats.p as current MRU size whereas it is actually target MRU size) > zfs2# zfs-stats -L > > ------------------------------------------------------------------------ > ZFS Subsystem Report Tue Jun 26 10:56:54 2012 > ------------------------------------------------------------------------ > > L2 ARC Summary: (HEALTHY) > Passed Headroom: 61 > Tried Lock Failures: 252.97k > IO In Progress: 0 > Low Memory Aborts: 0 > Free on Write: 382.20k > Writes While Full: 11.08k > R/W Clashes: 270 > Bad Checksums: 0 > IO Errors: 0 > SPA Mismatch: 0 > > L2 ARC Size: (Adaptive) 225.09 GiB > Header Size: 2.80% 6.31 GiB > > L2 ARC Breakdown: 25.52m > Hit Ratio: 87.46% 22.32m > Miss Ratio: 12.54% 3.20m > Feeds: 3.99m > > L2 ARC Buffer: > Bytes Scanned: 42.67 TiB > Buffer Iterations: 3.99m > List Iterations: 255.38m > NULL List Iterations: 219.99m > > L2 ARC Writes: > Writes Sent: 100.00% 913.05k > > ------------------------------------------------------------------------ -- Andriy Gapon From owner-freebsd-fs@FreeBSD.ORG Tue Jun 26 16:29:51 2012 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8314B1065670; Tue, 26 Jun 2012 16:29:51 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from citadel.icyb.net.ua (citadel.icyb.net.ua [212.40.38.140]) by mx1.freebsd.org (Postfix) with ESMTP id A04EE8FC19; Tue, 26 Jun 2012 16:29:50 +0000 (UTC) Received: from odyssey.starpoint.kiev.ua (alpha-e.starpoint.kiev.ua [212.40.38.101]) by citadel.icyb.net.ua (8.8.8p3/ICyb-2.3exp) with ESMTP id TAA04537; Tue, 26 Jun 2012 19:29:43 +0300 (EEST) (envelope-from avg@FreeBSD.org) Message-ID: <4FE9E376.8030209@FreeBSD.org> Date: Tue, 26 Jun 2012 19:29:42 +0300 From: Andriy Gapon User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:13.0) Gecko/20120610 Thunderbird/13.0 MIME-Version: 1.0 To: Mark Felder References: <201206251443.41768.jhb@freebsd.org> <4FE9CC00.9090501@FreeBSD.org> <4FE9DB60.1030905@FreeBSD.org> <4FE9DE92.3040700@FreeBSD.org> In-Reply-To: <4FE9DE92.3040700@FreeBSD.org> X-Enigmail-Version: 1.4.2 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Cc: freebsd-fs@FreeBSD.org Subject: Re: [PATCH] Simple ARC stats in top X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jun 2012 16:29:51 -0000 on 26/06/2012 19:08 Andriy Gapon said the following: > So the correct ARC size breakdown is: hdr_size + data_size + other_size + > l2_hdr_size, where data_size can further be broken down to mfu_size + mru_size + > anon_size. > > I think that users of zfs-stats / arc_summary.pl could benefit from this knowledge > too. > (I will repeat just in case that zfs-stats mistreats kstat.zfs.misc.arcstats.p as > current MRU size whereas it is actually target MRU size) Here's a quick attempt at reflecting my understanding of the stats in zfs-stats code: http://people.freebsd.org/~avg/zfs-stats I think that this variant of the script should produce results more aligned with what top shows with John's patch. -- Andriy Gapon From owner-freebsd-fs@FreeBSD.ORG Tue Jun 26 20:42:40 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 68E321065675; Tue, 26 Jun 2012 20:42:40 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from bigwig.baldwin.cx (bigknife-pt.tunnel.tserv9.chi1.ipv6.he.net [IPv6:2001:470:1f10:75::2]) by mx1.freebsd.org (Postfix) with ESMTP id 3CE098FC1E; Tue, 26 Jun 2012 20:42:40 +0000 (UTC) Received: from jhbbsd.localnet (unknown [209.249.190.124]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id A0B78B944; Tue, 26 Jun 2012 16:42:39 -0400 (EDT) From: John Baldwin To: freebsd-fs@freebsd.org Date: Tue, 26 Jun 2012 13:30:07 -0400 User-Agent: KMail/1.13.5 (FreeBSD/8.2-CBSD-20110714-p17; KDE/4.5.5; amd64; ; ) References: <201206251443.41768.jhb@freebsd.org> <4FE9DE92.3040700@FreeBSD.org> In-Reply-To: <4FE9DE92.3040700@FreeBSD.org> MIME-Version: 1.0 Content-Type: Text/Plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Message-Id: <201206261330.07997.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Tue, 26 Jun 2012 16:42:39 -0400 (EDT) Cc: Mark Felder , Andriy Gapon Subject: Re: [PATCH] Simple ARC stats in top X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jun 2012 20:42:40 -0000 On Tuesday, June 26, 2012 12:08:50 pm Andriy Gapon wrote: > on 26/06/2012 18:57 Mark Felder said the following: > > On Tue, 26 Jun 2012 10:55:12 -0500, Andriy Gapon wrote: > > > >> Does your system also has L2 ARC? > >> If so, could you please show a value of kstat.zfs.misc.arcstats.l2_hdr_size? > >> Otherwise, it's hard for me to explain the huge difference between Max Size and > >> ARC Size. > > > > Yes, it does. > > > > zfs2# sysctl kstat.zfs.misc.arcstats.l2_hdr_size > > kstat.zfs.misc.arcstats.l2_hdr_size: 6775072568 > > Aha, so no mystery, those 6G in ARC are actually used by L2ARC headers. > I missed the L2 headers because I haven't used L2 yet. > I've updated arc-sizes.sh script now to account for these headers. > > So the correct ARC size breakdown is: hdr_size + data_size + other_size + > l2_hdr_size, where data_size can further be broken down to mfu_size + mru_size + > anon_size. Hmm, I think for top I should just use hdr_size + l2_hdr_size for "Headers"? I don't think we have room for more types. I've updated top_arc.patch to take that approach. -- John Baldwin From owner-freebsd-fs@FreeBSD.ORG Tue Jun 26 21:14:20 2012 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id CDF7E1065670; Tue, 26 Jun 2012 21:14:20 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from citadel.icyb.net.ua (citadel.icyb.net.ua [212.40.38.140]) by mx1.freebsd.org (Postfix) with ESMTP id E8F688FC14; Tue, 26 Jun 2012 21:14:19 +0000 (UTC) Received: from porto.starpoint.kiev.ua (porto-e.starpoint.kiev.ua [212.40.38.100]) by citadel.icyb.net.ua (8.8.8p3/ICyb-2.3exp) with ESMTP id AAA08727; Wed, 27 Jun 2012 00:14:18 +0300 (EEST) (envelope-from avg@FreeBSD.org) Received: from localhost ([127.0.0.1]) by porto.starpoint.kiev.ua with esmtp (Exim 4.34 (FreeBSD)) id 1Sjd5W-000Iv7-8z; Wed, 27 Jun 2012 00:14:18 +0300 Message-ID: <4FEA2629.4020604@FreeBSD.org> Date: Wed, 27 Jun 2012 00:14:17 +0300 From: Andriy Gapon User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:13.0) Gecko/20120620 Thunderbird/13.0.1 MIME-Version: 1.0 To: John Baldwin References: <201206251443.41768.jhb@freebsd.org> <4FE9DE92.3040700@FreeBSD.org> <201206261330.07997.jhb@freebsd.org> In-Reply-To: <201206261330.07997.jhb@freebsd.org> X-Enigmail-Version: 1.4.2 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: freebsd-fs@FreeBSD.org, Mark Felder Subject: Re: [PATCH] Simple ARC stats in top X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jun 2012 21:14:20 -0000 on 26/06/2012 20:30 John Baldwin said the following: > Hmm, I think for top I should just use hdr_size + l2_hdr_size for "Headers"? > I don't think we have room for more types. > > I've updated top_arc.patch to take that approach. I think that this is a good approach for top with its limited real estate and very general overview of a system. ZFS-specific tools can provide more detailed views. -- Andriy Gapon From owner-freebsd-fs@FreeBSD.ORG Tue Jun 26 21:40:12 2012 Return-Path: Delivered-To: freebsd-fs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 444921065672 for ; Tue, 26 Jun 2012 21:40:12 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 2327D8FC18 for ; Tue, 26 Jun 2012 21:40:12 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.5/8.14.5) with ESMTP id q5QLeCt5025613 for ; Tue, 26 Jun 2012 21:40:12 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.5/8.14.5/Submit) id q5QLeCY2025612; Tue, 26 Jun 2012 21:40:12 GMT (envelope-from gnats) Date: Tue, 26 Jun 2012 21:40:12 GMT Message-Id: <201206262140.q5QLeCY2025612@freefall.freebsd.org> To: freebsd-fs@FreeBSD.org From: George Hartzell Cc: Subject: Re: kern/166566: [zfs] zfs split renders 2 disk (MBR based) mirror unbootable X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: George Hartzell List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jun 2012 21:40:12 -0000 The following reply was made to PR kern/166566; it has been noted by GNATS. From: George Hartzell To: Andriy Gapon Cc: hartzell@alerce.com, bug-followup@FreeBSD.org Subject: Re: kern/166566: [zfs] zfs split renders 2 disk (MBR based) mirror unbootable Date: Tue, 26 Jun 2012 14:38:17 -0700 Andriy Gapon writes: > > [restoring bug-followup] > > on 25/06/2012 19:48 George Hartzell said the following: > > Here are two images (more than one screen full) of the lsdev -v output > > from the loader that *actually loads the system* (when it's > > working...). > > I have a theory of what's going on. > > I believe that after zpool split the following items get updated with new > information: > - vdev label on the disk that remains in the main pool (ada3 + zroot) > - vdev label on the disk that goes to the new pool (ada1 + zsplitroot) > - zpool.cache file in the main/active/remaining pool (zroot) > > The following item still has outdated information: > - zpool.cache file in the new pool (zsplitroot) > > This happens because the new pool gets the contents of the original pool at > split start time (before any new ids are generated). The file can not be > updated automatically because the new pool remains "un-imported" (exported) > after the split. If it is desired that the zsplitroot's zpool.cache is updated > it has to be done manually - by importing the pool, etc. > > I believe that what you see is a result of you always booting in such a way that > the zfs boot code and zfsloader find zsplitroot pool before zroot pool. This is > confirmed by the screenshot which shows that zsplitroot is listed before zroot. > Because of that the stale zpool.cache file is used and as a result the ZFS code > in kernel can not find disks/pools based on the stale IDs. > > I think that you have to change the boot order using BIOS, so that you boot from > ada3 disk. You should verify at the loader prompt that that is indeed the case > and zroot is found first and is used as a boot pool. > > If your BIOS either doesn't allow to change boot order, or lies about it or > doesn't change bios disk numbering such that a boot disk is the first drive > (disk0 / "BIOS drive C"), then I recommend thatyou set 'currdev' loader variable > to point to zroot pool. Depending on your zfsloader version it should be done > in one of the following ways: > set currdev=zfs:zroot: > set currdev=zfs1 > You can examine default value of the variable (with 'show' command) to see which > scheme should be used. > > Please test this. We're very close. First thing, I discovered that I was wrong about its being able to boot from either disk. I don't think I ever misspoke to you (don't see it in the bug report, can't find it in our personal emails) but I certainly had it in my head that I had tried booting from both disks and neither worked. It turns out that one will boot but the other will not. Some background (for the bug trail). This is a mac pro with four internal SATA disks. When you power on with the option key held down you're presented with a graphic view of things that you can boot from. In my configuration I have two disks labeled "dinky 1" and "dinky 2" (Mac disks in a Mac OS X software raid) and two labeled "Windows" (the boot stuff considers anything with an MBR to be Windows, sigh...). Macs play fast and loose with device numbering/naming and I have no way to tell the Windows devices apart. For the rest of this discussion I'll just refer to the four drives as A, B, C, and D (dinky 1, dinky 2, Windows, Windows) in left to right order. Out of habit, I tend to boot into BSD on drive C (two hits of the right arrow key). While I was playing with setting currdev in the loader I realized that I could boot from disk D but not from disk C (no matter how I set currdev). It turns out that when I boot from drive C and do an lsdev -v at the loader prompt I get ... zsplitroot ada1s1a zroot ada3s1a but/and when I boot from drive D and do an lsdev -v at the loader prompt I get ... zroot ada3s1a zsplitroot ada1s1a Notice that the order is different (confirming your observation). When I boot off of C using vfs.zfs.debug=1 I get messages about mismatched GUID's and failure to open the device it's looking for. When I boot off of D things are fine. This is consistent with your idea that there is incorrect information in the zpool.cache file on the filesystem in the zsplitroot pool. currdev does not seem to have any effect, it looks like something else is being used to find the initial zfs pool(s). I'm not sure what there is to do to make the situation better. It's (probably) not the usual use case that zpool splilt is being used to split the pool that contains the filesystem that contains the zpool.cache file, so it would be an awfully special case to do something special to handle it. It seems like "the right thing" to do would be for the user (me) to do the zpool split with the -R option then copy the correct zpool.cache file into the split-off pool's root filesystem. I'll repair my currently broken mirror and give that a try. Thanks for all the help! g. From owner-freebsd-fs@FreeBSD.ORG Wed Jun 27 02:16:06 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C00861065670; Wed, 27 Jun 2012 02:16:06 +0000 (UTC) (envelope-from kevlo@kevlo.org) Received: from ns.kevlo.org (kevlo.org [220.128.136.52]) by mx1.freebsd.org (Postfix) with ESMTP id 562538FC0C; Wed, 27 Jun 2012 02:16:06 +0000 (UTC) Received: from [127.0.0.1] (git.kevlo.org [220.128.136.52]) by ns.kevlo.org (8.14.5/8.14.5) with ESMTP id q5R2Fxax070894; Wed, 27 Jun 2012 10:16:00 +0800 (CST) (envelope-from kevlo@kevlo.org) Message-ID: <1340763363.2147.1.camel@nsl> From: Kevin Lo To: Konstantin Belousov Date: Wed, 27 Jun 2012 10:16:03 +0800 In-Reply-To: <20120626102424.GL2337@deviant.kiev.zoral.com.ua> References: <1340589808.2192.1.camel@nsl> <20120625095548.GD2337@deviant.kiev.zoral.com.ua> <1340685505.2170.5.camel@nsl> <20120626102424.GL2337@deviant.kiev.zoral.com.ua> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.3-0ubuntu6 Content-Transfer-Encoding: 7bit Mime-Version: 1.0 Cc: freebsd-fs@freebsd.org, freebsd-current Subject: Re: Tmpfs panic in -current X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jun 2012 02:16:06 -0000 Konstantin Belousov wrote: > On Tue, Jun 26, 2012 at 12:38:25PM +0800, Kevin Lo wrote: > > Konstantin Belousov wrote: > > > On Mon, Jun 25, 2012 at 10:03:28AM +0800, Kevin Lo wrote: > > > > I've observed a panic in recent -current several times but I only > > > > have a picture of the backtrace: > > > > http://people.freebsd.org/~kevlo/panic_tmpfs.jpg > > > > > > > > Does this look at all familiar to anyone? > > > > > > Can you look up the line corresponding to tmpfs_reg_resize + 0x627 address > > > in your kernel ? > > > > Sure. > > > > > The screenshot looks strange. The instruction on which the kernel trapped > > > is int 0x28 which should not appear in the compiled code. > > > > # gdb tmpfs.ko > > (gdb) l *tmpfs_reg_resize+0x627 > > 0xbf37 is in tmpfs_reg_resize (/usr/src/sys/modules/tmpfs/../../fs/tmpfs/tmpfs_subr.c:1005). > > 1000 in /usr/src/sys/modules/tmpfs/../../fs/tmpfs/tmpfs_subr.c > > > > In tmpfs_subr.c: > > 999 if (m != NULL) { > > 1000 if ((m->oflags & VPO_BUSY) != 0 || > > 1001 m->busy != 0) { > > 1002 vm_page_sleep(m, "tmfssz"); > > 1003 goto retry; > > 1004 } > > 1005 MPASS(m->valid == VM_PAGE_BITS_ALL); > > 1006 } else if (vm_pager_has_page(uobj, idx, NULL, NU > > LL)) { > > > Hm, can you get a core and > - obtain backtrace in kgdb; > - print the *m content for the page that triggered the assertion ? > > The only possible 'new size' value for the truncation from open(2) is zero, > so I do not understand why the asserted block was executed at all. Thanks for looking into it. Unfortunately I can't get a crash dump due to lack of disk space and memory. Kevin From owner-freebsd-fs@FreeBSD.ORG Wed Jun 27 05:29:22 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7A0671065675; Wed, 27 Jun 2012 05:29:22 +0000 (UTC) (envelope-from kevlo@kevlo.org) Received: from ns.kevlo.org (kevlo.org [220.128.136.52]) by mx1.freebsd.org (Postfix) with ESMTP id E28FA8FC1B; Wed, 27 Jun 2012 05:29:21 +0000 (UTC) Received: from [127.0.0.1] (git.kevlo.org [220.128.136.52]) by ns.kevlo.org (8.14.5/8.14.5) with ESMTP id q5R5T9Um071536; Wed, 27 Jun 2012 13:29:09 +0800 (CST) (envelope-from kevlo@kevlo.org) Message-ID: <1340774954.2147.3.camel@nsl> From: Kevin Lo To: Konstantin Belousov Date: Wed, 27 Jun 2012 13:29:14 +0800 In-Reply-To: <1340763363.2147.1.camel@nsl> References: <1340589808.2192.1.camel@nsl> <20120625095548.GD2337@deviant.kiev.zoral.com.ua> <1340685505.2170.5.camel@nsl> <20120626102424.GL2337@deviant.kiev.zoral.com.ua> <1340763363.2147.1.camel@nsl> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.3-0ubuntu6 Content-Transfer-Encoding: 7bit Mime-Version: 1.0 Cc: freebsd-fs@freebsd.org, freebsd-current Subject: Re: Tmpfs panic in -current X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jun 2012 05:29:22 -0000 Kevin Lo wrote: > Konstantin Belousov wrote: > > On Tue, Jun 26, 2012 at 12:38:25PM +0800, Kevin Lo wrote: > > > Konstantin Belousov wrote: > > > > On Mon, Jun 25, 2012 at 10:03:28AM +0800, Kevin Lo wrote: > > > > > I've observed a panic in recent -current several times but I only > > > > > have a picture of the backtrace: > > > > > http://people.freebsd.org/~kevlo/panic_tmpfs.jpg > > > > > > > > > > Does this look at all familiar to anyone? > > > > > > > > Can you look up the line corresponding to tmpfs_reg_resize + 0x627 address > > > > in your kernel ? > > > > > > Sure. > > > > > > > The screenshot looks strange. The instruction on which the kernel trapped > > > > is int 0x28 which should not appear in the compiled code. > > > > > > # gdb tmpfs.ko > > > (gdb) l *tmpfs_reg_resize+0x627 > > > 0xbf37 is in tmpfs_reg_resize (/usr/src/sys/modules/tmpfs/../../fs/tmpfs/tmpfs_subr.c:1005). > > > 1000 in /usr/src/sys/modules/tmpfs/../../fs/tmpfs/tmpfs_subr.c > > > > > > In tmpfs_subr.c: > > > 999 if (m != NULL) { > > > 1000 if ((m->oflags & VPO_BUSY) != 0 || > > > 1001 m->busy != 0) { > > > 1002 vm_page_sleep(m, "tmfssz"); > > > 1003 goto retry; > > > 1004 } > > > 1005 MPASS(m->valid == VM_PAGE_BITS_ALL); > > > 1006 } else if (vm_pager_has_page(uobj, idx, NULL, NU > > > LL)) { > > > > > Hm, can you get a core and > > - obtain backtrace in kgdb; > > - print the *m content for the page that triggered the assertion ? > > > > The only possible 'new size' value for the truncation from open(2) is zero, > > so I do not understand why the asserted block was executed at all. > > Thanks for looking into it. Unfortunately I can't get a crash dump > due to lack of disk space and memory. I triggered the KASSERT on a different machine in the last hour. panic: Assertion (vp) !=NULL && (vp)->v_data != NULL failed at @/fs/tmpfs/tmpfs.h:527 The bad news is my coworker rebooted that machine after panic :-( Kevin From owner-freebsd-fs@FreeBSD.ORG Wed Jun 27 06:00:23 2012 Return-Path: Delivered-To: freebsd-fs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 48A9F106567B for ; Wed, 27 Jun 2012 06:00:23 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 1AEFB8FC22 for ; Wed, 27 Jun 2012 06:00:23 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.5/8.14.5) with ESMTP id q5R60Mxs089860 for ; Wed, 27 Jun 2012 06:00:22 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.5/8.14.5/Submit) id q5R60MFa089859; Wed, 27 Jun 2012 06:00:22 GMT (envelope-from gnats) Date: Wed, 27 Jun 2012 06:00:22 GMT Message-Id: <201206270600.q5R60MFa089859@freefall.freebsd.org> To: freebsd-fs@FreeBSD.org From: Andriy Gapon Cc: Subject: Re: kern/166566: [zfs] zfs split renders 2 disk (MBR based) mirror unbootable X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Andriy Gapon List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jun 2012 06:00:23 -0000 The following reply was made to PR kern/166566; it has been noted by GNATS. From: Andriy Gapon To: hartzell@alerce.com Cc: bug-followup@FreeBSD.org Subject: Re: kern/166566: [zfs] zfs split renders 2 disk (MBR based) mirror unbootable Date: Wed, 27 Jun 2012 08:49:44 +0300 on 27/06/2012 00:38 George Hartzell said the following: > currdev does not seem to have any effect, it looks like something else > is being used to find the initial zfs pool(s). Just a note that currdev would not affect the order of the pools in lsdev output. It should affect from which pool the zpool.cache is loaded. Ah! You probably need to issue unload command as well. I keep forgetting that in default configuration loader loads up stuff before presenting its menu. I've changed my loader.rc, so that nothing is loaded before the menu. But, yes, the best course of action seems to be to fix up zsplitroot right after splitting it off. Thank you for your persistence in testing and debugging! -- Andriy Gapon From owner-freebsd-fs@FreeBSD.ORG Wed Jun 27 09:15:11 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 25AE0106564A for ; Wed, 27 Jun 2012 09:15:11 +0000 (UTC) (envelope-from lserinol@gmail.com) Received: from mail-yw0-f44.google.com (mail-yw0-f44.google.com [209.85.213.44]) by mx1.freebsd.org (Postfix) with ESMTP id D67548FC14 for ; Wed, 27 Jun 2012 09:15:10 +0000 (UTC) Received: by yhq56 with SMTP id 56so810195yhq.17 for ; Wed, 27 Jun 2012 02:15:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=DTdF7PyaN3q6g339Toe4oHuBKYbVZPqEhYOibfjHEHQ=; b=eujHgMfUvBbOGHw21sANbbPRPekQUNUAr5VgZkY1xFWqZtXUv6omtCrVEpoNNF9k0K iio7DY1N/gPNZ5PhyO6Yq9s3HMR1quH7vzYNCoJVK4mQm3DMxMBFEX+UBxctPlddBjH7 oBDtsqbnndSXEhVy3H5VSynKNI6xfu3MxGFzbjDUnXBGgPSmjBQXXebjbX7yGOFCU/6f +TENDV7OsOrnZzuO8sqpNisTUfkMBo2jOZJlrfufOf8fe5xwoGlDygTdyBVTasNwOfdK FfNE0HemDeGdi30t3gM3svrjxXswymcrbHcKe4Z1ejHNdD0lvXBI5J6U+6w9Q8njrOnP Sw4A== MIME-Version: 1.0 Received: by 10.101.18.16 with SMTP id v16mr6679465ani.79.1340788510425; Wed, 27 Jun 2012 02:15:10 -0700 (PDT) Received: by 10.146.103.7 with HTTP; Wed, 27 Jun 2012 02:15:10 -0700 (PDT) Date: Wed, 27 Jun 2012 12:15:10 +0300 Message-ID: From: Levent Serinol To: freebsd-fs@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: ZFS stalls on Heavy I/O X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jun 2012 09:15:11 -0000 Hi, Under heavy I/O load we face freeze problems on ZFS volumes on both Freebsd 9 Release and 10 Current versions. Machines are HP servers (64bit) with HP Smart array 6400 raid controllers (with battery units). Every da device is a hardware raid5 where each one includes 9x300GB 10K SCSI hard drivers. Main of I/O pattern happens on local system except some small NFS I/O from some other servers (NFS lookup/getattr/ etc.). These servers are mail servers (qmail) with small I/O patterns (64K Read/Write). Below you can find procstat output on freeze time. write_limit is set to 200MB because of the huge amount of txg_wait_opens observed before. Every process stops on D state I think due to txg queue and other 2 queues are full. Is there any suggestion to fix the problem ? btw inject_compress is the main process injecting emails to user inboxes (databases). Also, those machines were running without problems on Linux/XFS filesystem. For a while ago, we started migration from Linux to Freebsd http://pastebin.com/raw.php?i=ic3YepWQ From owner-freebsd-fs@FreeBSD.ORG Wed Jun 27 09:42:23 2012 Return-Path: Delivered-To: freebsd-fs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D01A91065687; Wed, 27 Jun 2012 09:42:23 +0000 (UTC) (envelope-from linimon@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id A27098FC0C; Wed, 27 Jun 2012 09:42:23 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.5/8.14.5) with ESMTP id q5R9gNUi016129; Wed, 27 Jun 2012 09:42:23 GMT (envelope-from linimon@freefall.freebsd.org) Received: (from linimon@localhost) by freefall.freebsd.org (8.14.5/8.14.5/Submit) id q5R9gNv2016125; Wed, 27 Jun 2012 09:42:23 GMT (envelope-from linimon) Date: Wed, 27 Jun 2012 09:42:23 GMT Message-Id: <201206270942.q5R9gNv2016125@freefall.freebsd.org> To: linimon@FreeBSD.org, freebsd-bugs@FreeBSD.org, freebsd-fs@FreeBSD.org From: linimon@FreeBSD.org Cc: Subject: Re: kern/169480: [zfs] ZFS stalls on heavy I/O X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jun 2012 09:42:23 -0000 Old Synopsis: ZFS stalls on heavy I/O New Synopsis: [zfs] ZFS stalls on heavy I/O Responsible-Changed-From-To: freebsd-bugs->freebsd-fs Responsible-Changed-By: linimon Responsible-Changed-When: Wed Jun 27 09:42:11 UTC 2012 Responsible-Changed-Why: Over to maintainer(s). http://www.freebsd.org/cgi/query-pr.cgi?pr=169480 From owner-freebsd-fs@FreeBSD.ORG Wed Jun 27 10:25:13 2012 Return-Path: Delivered-To: fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0A95F10656D6; Wed, 27 Jun 2012 10:25:08 +0000 (UTC) (envelope-from markus.gebert@hostpoint.ch) Received: from mail.adm.hostpoint.ch (mail.adm.hostpoint.ch [IPv6:2a00:d70:0:a::e0]) by mx1.freebsd.org (Postfix) with ESMTP id B0DE88FC19; Wed, 27 Jun 2012 10:25:07 +0000 (UTC) Received: from [2001:1620:2013:1:d55a:e267:7517:1b17] (port=54536) by mail.adm.hostpoint.ch with esmtpsa (TLSv1:AES128-SHA:128) (Exim 4.69 (FreeBSD)) (envelope-from ) id 1SjpQo-0009LW-MB; Wed, 27 Jun 2012 12:25:06 +0200 Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Markus Gebert In-Reply-To: <201206251443.41768.jhb@freebsd.org> Date: Wed, 27 Jun 2012 12:24:35 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: References: <201206251443.41768.jhb@freebsd.org> To: John Baldwin X-Mailer: Apple Mail (2.1278) Cc: fs@freebsd.org Subject: Re: [PATCH] Simple ARC stats in top X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jun 2012 10:25:13 -0000 Hi John On 25.06.2012, at 20:43, John Baldwin wrote: > I have some patches based on a script I got from avg@ that add some = simplistic=20 > ARC stats to top so that one can see how much of wired memory is set = aside for=20 > ARC, and how that memory is split up. The patch is against 8-stable: > http://www.FreeBSD.org/~jhb/patches/top_arc.patch >=20 > Sample output: >=20 > Mem: 1245M Active, 1393M Inact, 21G Wired, 309M Buf, 23G Free > ARC: 19G Total, 1381M MRU, 17G MFU, 272K Anon, 232M Header, 442M Other > Swap: 8192M Total, 8192M Free >=20 > Comments, etc.? Nice feature for top, thanks! I've tested your patch on 8.3p3. When I'm using patched top to display = per-cpu statistics, the ARC line corrupts the third CPU line (CPU 2). = That seems to be exactly the line top would display ARC stats on when = running in normal (i.e. not -P) mode. It doesn't always happen = immediately after starting top, I guess some of the ARC stats actually = need to change for it to break. Example (top -S -P): ---- last pid: 18994; load averages: 0.00, 0.00, 0.00 = = up 4+19:45:05 = 12:14:33 55 processes: 2 running, 52 sleeping, 1 waiting CPU 0: 0.4% user, 0.0% nice, 0.0% system, 0.0% interrupt, 99.6% idle CPU 1: 0.0% user, 0.0% nice, 0.0% system, 40.0% interrupt, 100% idle CPU 2: 0.0% user, 0.0% nice, 0.0% s1009K Anon, 54M Header, 118M Other CPU 3: 0.0% user, 0.0% nice, 0.0% system, 0.0% interrupt, 100% idle Mem: 629M Active, 23M Inact, 2475M Wired, 1308K Cache, 748M Buf, 4786M = Free ARC: 1535M Total, 455M MRU, 906M MFU, 912K Anon, 54M Header, 118M Other Swap: 8192M Total, 8192M Free ---- Markus From owner-freebsd-fs@FreeBSD.ORG Wed Jun 27 12:22:50 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 4B5F110657B0; Wed, 27 Jun 2012 12:22:50 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from bigwig.baldwin.cx (bigknife-pt.tunnel.tserv9.chi1.ipv6.he.net [IPv6:2001:470:1f10:75::2]) by mx1.freebsd.org (Postfix) with ESMTP id 1F3B88FC15; Wed, 27 Jun 2012 12:22:50 +0000 (UTC) Received: from jhbbsd.localnet (unknown [209.249.190.124]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id 68D83B97D; Wed, 27 Jun 2012 08:22:49 -0400 (EDT) From: John Baldwin To: Andriy Gapon Date: Wed, 27 Jun 2012 08:08:05 -0400 User-Agent: KMail/1.13.5 (FreeBSD/8.2-CBSD-20110714-p17; KDE/4.5.5; amd64; ; ) References: <201206251443.41768.jhb@freebsd.org> <201206261330.07997.jhb@freebsd.org> <4FEA2629.4020604@FreeBSD.org> In-Reply-To: <4FEA2629.4020604@FreeBSD.org> MIME-Version: 1.0 Content-Type: Text/Plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Message-Id: <201206270808.05493.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Wed, 27 Jun 2012 08:22:49 -0400 (EDT) Cc: freebsd-fs@freebsd.org, Mark Felder Subject: Re: [PATCH] Simple ARC stats in top X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jun 2012 12:22:50 -0000 On Tuesday, June 26, 2012 5:14:17 pm Andriy Gapon wrote: > on 26/06/2012 20:30 John Baldwin said the following: > > Hmm, I think for top I should just use hdr_size + l2_hdr_size for "Headers"? > > I don't think we have room for more types. > > > > I've updated top_arc.patch to take that approach. > > I think that this is a good approach for top with its limited real estate and > very general overview of a system. > ZFS-specific tools can provide more detailed views. Ok. I definitely think top should just give a general overview (only 1 line). -- John Baldwin From owner-freebsd-fs@FreeBSD.ORG Wed Jun 27 12:22:50 2012 Return-Path: Delivered-To: fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D421010657B2 for ; Wed, 27 Jun 2012 12:22:50 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from bigwig.baldwin.cx (bigknife-pt.tunnel.tserv9.chi1.ipv6.he.net [IPv6:2001:470:1f10:75::2]) by mx1.freebsd.org (Postfix) with ESMTP id A7EBE8FC16 for ; Wed, 27 Jun 2012 12:22:50 +0000 (UTC) Received: from jhbbsd.localnet (unknown [209.249.190.124]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id 018B1B97F; Wed, 27 Jun 2012 08:22:50 -0400 (EDT) From: John Baldwin To: Markus Gebert Date: Wed, 27 Jun 2012 08:10:28 -0400 User-Agent: KMail/1.13.5 (FreeBSD/8.2-CBSD-20110714-p17; KDE/4.5.5; amd64; ; ) References: <201206251443.41768.jhb@freebsd.org> In-Reply-To: MIME-Version: 1.0 Content-Type: Text/Plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Message-Id: <201206270810.28589.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Wed, 27 Jun 2012 08:22:50 -0400 (EDT) Cc: fs@freebsd.org Subject: Re: [PATCH] Simple ARC stats in top X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jun 2012 12:22:50 -0000 On Wednesday, June 27, 2012 6:24:35 am Markus Gebert wrote: > Hi John > > On 25.06.2012, at 20:43, John Baldwin wrote: > > > I have some patches based on a script I got from avg@ that add some simplistic > > ARC stats to top so that one can see how much of wired memory is set aside for > > ARC, and how that memory is split up. The patch is against 8-stable: > > http://www.FreeBSD.org/~jhb/patches/top_arc.patch > > > > Sample output: > > > > Mem: 1245M Active, 1393M Inact, 21G Wired, 309M Buf, 23G Free > > ARC: 19G Total, 1381M MRU, 17G MFU, 272K Anon, 232M Header, 442M Other > > Swap: 8192M Total, 8192M Free > > > > Comments, etc.? > > Nice feature for top, thanks! > > I've tested your patch on 8.3p3. When I'm using patched top to display per- cpu statistics, the ARC line corrupts the third CPU line (CPU 2). That seems to be exactly the line top would display ARC stats on when running in normal (i.e. not -P) mode. It doesn't always happen immediately after starting top, I guess some of the ARC stats actually need to change for it to break. > > Example (top -S -P): > ---- > last pid: 18994; load averages: 0.00, 0.00, 0.00 up 4+19:45:05 12:14:33 > 55 processes: 2 running, 52 sleeping, 1 waiting > CPU 0: 0.4% user, 0.0% nice, 0.0% system, 0.0% interrupt, 99.6% idle > CPU 1: 0.0% user, 0.0% nice, 0.0% system, 40.0% interrupt, 100% idle > CPU 2: 0.0% user, 0.0% nice, 0.0% s1009K Anon, 54M Header, 118M Other > CPU 3: 0.0% user, 0.0% nice, 0.0% system, 0.0% interrupt, 100% idle > Mem: 629M Active, 23M Inact, 2475M Wired, 1308K Cache, 748M Buf, 4786M Free > ARC: 1535M Total, 455M MRU, 906M MFU, 912K Anon, 54M Header, 118M Other > Swap: 8192M Total, 8192M Free > ---- Hmmm, my patch is relative to a top that has -P backported and I can't reproduce this, the ARC lines moves around properly if 'P' is toggled at runtime as well for me. Did you have any conflicts in your patch that you had to resolve by hand? -- John Baldwin From owner-freebsd-fs@FreeBSD.ORG Wed Jun 27 15:42:50 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 638E11065673; Wed, 27 Jun 2012 15:42:50 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from mail.zoral.com.ua (mx0.zoral.com.ua [91.193.166.200]) by mx1.freebsd.org (Postfix) with ESMTP id F31338FC1E; Wed, 27 Jun 2012 15:42:48 +0000 (UTC) Received: from skuns.kiev.zoral.com.ua (localhost [127.0.0.1]) by mail.zoral.com.ua (8.14.2/8.14.2) with ESMTP id q5RFgaqf038076; Wed, 27 Jun 2012 18:42:36 +0300 (EEST) (envelope-from kostikbel@gmail.com) Received: from deviant.kiev.zoral.com.ua (kostik@localhost [127.0.0.1]) by deviant.kiev.zoral.com.ua (8.14.5/8.14.5) with ESMTP id q5RFgZVa091454; Wed, 27 Jun 2012 18:42:35 +0300 (EEST) (envelope-from kostikbel@gmail.com) Received: (from kostik@localhost) by deviant.kiev.zoral.com.ua (8.14.5/8.14.5/Submit) id q5RFgYQA091453; Wed, 27 Jun 2012 18:42:34 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: deviant.kiev.zoral.com.ua: kostik set sender to kostikbel@gmail.com using -f Date: Wed, 27 Jun 2012 18:42:33 +0300 From: Konstantin Belousov To: Kevin Lo Message-ID: <20120627154233.GO2337@deviant.kiev.zoral.com.ua> References: <1340589808.2192.1.camel@nsl> <20120625095548.GD2337@deviant.kiev.zoral.com.ua> <1340685505.2170.5.camel@nsl> <20120626102424.GL2337@deviant.kiev.zoral.com.ua> <1340763363.2147.1.camel@nsl> <1340774954.2147.3.camel@nsl> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="gZyN7ilQ5rV5bB+g" Content-Disposition: inline In-Reply-To: <1340774954.2147.3.camel@nsl> User-Agent: Mutt/1.4.2.3i X-Virus-Scanned: clamav-milter 0.95.2 at skuns.kiev.zoral.com.ua X-Virus-Status: Clean X-Spam-Status: No, score=-4.0 required=5.0 tests=ALL_TRUSTED,AWL,BAYES_00 autolearn=ham version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on skuns.kiev.zoral.com.ua Cc: freebsd-fs@freebsd.org, freebsd-current Subject: Re: Tmpfs panic in -current X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jun 2012 15:42:50 -0000 --gZyN7ilQ5rV5bB+g Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Jun 27, 2012 at 01:29:14PM +0800, Kevin Lo wrote: > Kevin Lo wrote: > > Konstantin Belousov wrote: > > > On Tue, Jun 26, 2012 at 12:38:25PM +0800, Kevin Lo wrote: > > > > Konstantin Belousov wrote: > > > > > On Mon, Jun 25, 2012 at 10:03:28AM +0800, Kevin Lo wrote: > > > > > > I've observed a panic in recent -current several times but I on= ly > > > > > > have a picture of the backtrace: > > > > > > http://people.freebsd.org/~kevlo/panic_tmpfs.jpg > > > > > >=20 > > > > > > Does this look at all familiar to anyone? > > > > >=20 > > > > > Can you look up the line corresponding to tmpfs_reg_resize + 0x62= 7 address > > > > > in your kernel ? > > > >=20 > > > > Sure. > > > >=20 > > > > > The screenshot looks strange. The instruction on which the kernel= trapped > > > > > is int 0x28 which should not appear in the compiled code. > > > >=20 > > > > # gdb tmpfs.ko > > > > (gdb) l *tmpfs_reg_resize+0x627 > > > > 0xbf37 is in tmpfs_reg_resize (/usr/src/sys/modules/tmpfs/../../fs/= tmpfs/tmpfs_subr.c:1005). > > > > 1000 in /usr/src/sys/modules/tmpfs/../../fs/tmpfs/tmpfs_subr.c > > > >=20 > > > > In tmpfs_subr.c: > > > > 999 if (m !=3D NULL) { > > > > 1000 if ((m->oflags & VPO_BUSY) != =3D 0 || > > > > 1001 m->busy !=3D 0) { > > > > 1002 vm_page_sleep(m, "tmfs= sz"); > > > > 1003 goto retry; > > > > 1004 } > > > > 1005 MPASS(m->valid =3D=3D VM_PAGE_= BITS_ALL); > > > > 1006 } else if (vm_pager_has_page(uobj, idx= , NULL, NU > > > > LL)) { > > > >=20 > > > Hm, can you get a core and > > > - obtain backtrace in kgdb; > > > - print the *m content for the page that triggered the assertion ? > > >=20 > > > The only possible 'new size' value for the truncation from open(2) is= zero, > > > so I do not understand why the asserted block was executed at all. > >=20 > > Thanks for looking into it. Unfortunately I can't get a crash dump=20 > > due to lack of disk space and memory. >=20 > I triggered the KASSERT on a different machine in the last hour. It is not 'the' KASSERT, it is something different. Are you sure that you do not have some systematic build issues on your machines ? Although I do not think that tmpfs is 'ready for production use' for arbitrary low value of this statement, there is no steady flow of similar reports from other users. This makes me somewhat suspicious that either you might have inconsistent build issues, or unrelated memory corruption problems. >=20 > panic: Assertion (vp) !=3DNULL && (vp)->v_data !=3D NULL failed at=20 > @/fs/tmpfs/tmpfs.h:527 >=20 > The bad news is my coworker rebooted that machine after panic :-( >=20 > Kevin --gZyN7ilQ5rV5bB+g Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.12 (FreeBSD) iEYEARECAAYFAk/rKekACgkQC3+MBN1Mb4hYwgCfYWOIBPD9WwnenIfhB12y4He+ uuYAoNvto31Rpl2RKFa+YaYOEpdhVsZ/ =jwy7 -----END PGP SIGNATURE----- --gZyN7ilQ5rV5bB+g-- From owner-freebsd-fs@FreeBSD.ORG Wed Jun 27 15:49:37 2012 Return-Path: Delivered-To: fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 960891065679; Wed, 27 Jun 2012 15:49:37 +0000 (UTC) (envelope-from markus.gebert@hostpoint.ch) Received: from mail.adm.hostpoint.ch (mail.adm.hostpoint.ch [IPv6:2a00:d70:0:a::e0]) by mx1.freebsd.org (Postfix) with ESMTP id 2BE058FC12; Wed, 27 Jun 2012 15:49:37 +0000 (UTC) Received: from [2001:1620:2013:1:d55a:e267:7517:1b17] (port=56876) by mail.adm.hostpoint.ch with esmtpsa (TLSv1:AES128-SHA:128) (Exim 4.69 (FreeBSD)) (envelope-from ) id 1SjuUq-000ICO-9G; Wed, 27 Jun 2012 17:49:36 +0200 Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=iso-8859-1 From: Markus Gebert In-Reply-To: <201206270810.28589.jhb@freebsd.org> Date: Wed, 27 Jun 2012 17:49:05 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: <0EF22D00-1CDB-44DA-BF3C-3AC672072C05@hostpoint.ch> References: <201206251443.41768.jhb@freebsd.org> <201206270810.28589.jhb@freebsd.org> To: John Baldwin X-Mailer: Apple Mail (2.1278) Cc: fs@freebsd.org Subject: Re: [PATCH] Simple ARC stats in top X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jun 2012 15:49:37 -0000 On 27.06.2012, at 14:10, John Baldwin wrote: > Hmmm, my patch is relative to a top that has -P backported and I can't=20= > reproduce this, the ARC lines moves around properly if 'P' is toggled > at runtime as well for me. Did you have any conflicts in your patch > that you had to resolve by hand? No, I did not merge anything by hand. But what I did, and that probably = was the cause, is only buildworld with NO_CLEAN=3D1 to save time and = just rebuild top. Now that I've done a full buildworld, the probem seems = to be gone. I'll test more and step up, if it happens again, but = consider this solved for now. Sorry for the noise. Markus From owner-freebsd-fs@FreeBSD.ORG Wed Jun 27 15:58:06 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 299CA1065670 for ; Wed, 27 Jun 2012 15:58:06 +0000 (UTC) (envelope-from dean.jones@oregonstate.edu) Received: from smtp2.oregonstate.edu (smtp2.oregonstate.edu [128.193.15.36]) by mx1.freebsd.org (Postfix) with ESMTP id F2FC08FC14 for ; Wed, 27 Jun 2012 15:58:05 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by smtp2.oregonstate.edu (Postfix) with ESMTP id B6D1B3C2BA for ; Wed, 27 Jun 2012 08:50:45 -0700 (PDT) X-Virus-Scanned: amavisd-new at oregonstate.edu Received: from smtp2.oregonstate.edu ([127.0.0.1]) by localhost (smtp.oregonstate.edu [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id BkeCes5TvBLR for ; Wed, 27 Jun 2012 08:50:45 -0700 (PDT) Received: from mail-bk0-f54.google.com (mail-bk0-f54.google.com [209.85.214.54]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (No client certificate requested) by smtp2.oregonstate.edu (Postfix) with ESMTPSA id 2775F3C2B5 for ; Wed, 27 Jun 2012 08:50:44 -0700 (PDT) Received: by bkvi18 with SMTP id i18so1305344bkv.13 for ; Wed, 27 Jun 2012 08:50:43 -0700 (PDT) Received: by 10.152.147.33 with SMTP id th1mr21486783lab.9.1340812243056; Wed, 27 Jun 2012 08:50:43 -0700 (PDT) MIME-Version: 1.0 Received: by 10.112.20.41 with HTTP; Wed, 27 Jun 2012 08:50:22 -0700 (PDT) In-Reply-To: References: From: Dean Jones Date: Wed, 27 Jun 2012 08:50:22 -0700 Message-ID: To: Levent Serinol Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: "freebsd-fs@freebsd.org" Subject: Re: ZFS stalls on Heavy I/O X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jun 2012 15:58:06 -0000 On Wed, Jun 27, 2012 at 2:15 AM, Levent Serinol wrote: > Hi, > > =A0Under heavy I/O load we face freeze problems on ZFS volumes on both > Freebsd 9 Release and 10 Current versions. Machines are HP servers (64bit= ) > with HP Smart array 6400 raid controllers (with battery units). Every da > device is a hardware raid5 where each one includes 9x300GB 10K SCSI hard > drivers. Main of I/O pattern happens on local system except some small NF= S > I/O from some other servers (NFS lookup/getattr/ etc.). These servers are > mail servers (qmail) with small I/O patterns (64K Read/Write). =A0Below y= ou > can =A0find procstat output on freeze time. write_limit is set to 200MB > because of the huge amount of txg_wait_opens observed before. Every proce= ss > stops on D state I think due to txg queue and other 2 queues are full. Is > there any suggestion to fix the problem ? > > btw inject_compress is the main process injecting emails to user inboxes > (databases). Also, those machines were running without problems on > Linux/XFS filesystem. For a while ago, we started =A0migration from Linux= to > Freebsd > > > http://pastebin.com/raw.php?i=3Dic3YepWQ > _______________________________________________ Looks like you are running dedup with only 12 gigs of ram? Dedup is very ram hungry and the dedup tables are probably no longer fitting entirely in memory and therefore the system is swapping and thrashing about during writes. Also ZFS really prefers to directly address drives instead of RAID controllers. It can not guarantee or know what the controller is doing behind the scenes. From owner-freebsd-fs@FreeBSD.ORG Wed Jun 27 16:34:14 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id E49C6106564A for ; Wed, 27 Jun 2012 16:34:14 +0000 (UTC) (envelope-from andrnils@gmail.com) Received: from mail-gg0-f182.google.com (mail-gg0-f182.google.com [209.85.161.182]) by mx1.freebsd.org (Postfix) with ESMTP id 974AC8FC12 for ; Wed, 27 Jun 2012 16:34:14 +0000 (UTC) Received: by ggnm2 with SMTP id m2so1297199ggn.13 for ; Wed, 27 Jun 2012 09:34:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=skPxLc4KPgItDfYr1lRxw9O0WIYwpqcdvUBY/TcB78c=; b=b2vlT4RZBfgppRMR98gux2SDEbzsj8OsVYlCnCoTR5SCfpEEOdPQSa/20hC6rR+j1e z9FyINHK/FJ/fJnzLgk18hiJIApuo4Y2GJoFROKqa9PWMhvap51rVHk8rx7cXkm016+r x3zRa8LeGUoCNnPBPxX06d3YWAmfY5LMBxTvKgiH/RqeemBWLevLzBNfQjqhlOz6e1Tl ObcLLfv4H2xSYJ19LPenO9lTN0wiRuCcNZYG0Bi+i9apRSYDmgicFrMCAYEUArNt+Oyh vi7zLZt9rQqNuf/KDKGuOoDQvbClbQtChDo/3PJjM8z96mIXreUb01fCqFszUaKwG9kW CDEA== MIME-Version: 1.0 Received: by 10.60.29.137 with SMTP id k9mr21501003oeh.23.1340814853778; Wed, 27 Jun 2012 09:34:13 -0700 (PDT) Received: by 10.60.80.36 with HTTP; Wed, 27 Jun 2012 09:34:13 -0700 (PDT) In-Reply-To: References: Date: Wed, 27 Jun 2012 18:34:13 +0200 Message-ID: From: Andreas Nilsson To: Dean Jones Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: "freebsd-fs@freebsd.org" Subject: Re: ZFS stalls on Heavy I/O X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jun 2012 16:34:15 -0000 On Wed, Jun 27, 2012 at 5:50 PM, Dean Jones wrote: > On Wed, Jun 27, 2012 at 2:15 AM, Levent Serinol > wrote: > > Hi, > > > > Under heavy I/O load we face freeze problems on ZFS volumes on both > > Freebsd 9 Release and 10 Current versions. Machines are HP servers > (64bit) > > with HP Smart array 6400 raid controllers (with battery units). Every da > > device is a hardware raid5 where each one includes 9x300GB 10K SCSI hard > > drivers. Main of I/O pattern happens on local system except some small > NFS > > I/O from some other servers (NFS lookup/getattr/ etc.). These servers are > > mail servers (qmail) with small I/O patterns (64K Read/Write). Below you > > can find procstat output on freeze time. write_limit is set to 200MB > > because of the huge amount of txg_wait_opens observed before. Every > process > > stops on D state I think due to txg queue and other 2 queues are full. Is > > there any suggestion to fix the problem ? > > > > btw inject_compress is the main process injecting emails to user inboxes > > (databases). Also, those machines were running without problems on > > Linux/XFS filesystem. For a while ago, we started migration from Linux > to > > Freebsd > > > > > > http://pastebin.com/raw.php?i=ic3YepWQ > > _______________________________________________ > > Looks like you are running dedup with only 12 gigs of ram? > > Dedup is very ram hungry and the dedup tables are probably no longer > fitting entirely in memory and therefore the system is swapping and > thrashing about during writes. > > Also ZFS really prefers to directly address drives instead of RAID > controllers. It can not guarantee or know what the controller is > doing behind the scenes. > You might want to read http://constantin.glez.de/blog/2011/07/zfs-dedupe-or-not-dedupe and see if you need more ram. And yes, having raid below zfs somewhat defeats the point of zfs. Regards Andreas From owner-freebsd-fs@FreeBSD.ORG Wed Jun 27 17:08:38 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 26EEC106566C for ; Wed, 27 Jun 2012 17:08:38 +0000 (UTC) (envelope-from lserinol@gmail.com) Received: from mail-wg0-f50.google.com (mail-wg0-f50.google.com [74.125.82.50]) by mx1.freebsd.org (Postfix) with ESMTP id 9B1F58FC20 for ; Wed, 27 Jun 2012 17:08:37 +0000 (UTC) Received: by wgbds11 with SMTP id ds11so1246957wgb.31 for ; Wed, 27 Jun 2012 10:08:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=references:in-reply-to:mime-version:content-transfer-encoding :content-type:message-id:cc:x-mailer:from:subject:date:to; bh=er08dUbDiLKJAma4hGK4V8JCH6RpU2dyQOoiqESgUrQ=; b=PwF08mGqSLGUJj2vLpep1/u9FwQxfoAk39Bbj3SNDIS1hRACiaAZFttjSdPVrGP/ef UsnShcrZTflUIOw4jXbgFMBwmMmKqKcZdaXhV6mvA+uMKrqNF8+vZxZpBsouUOHvZVzl 3MnulKxQMbuU7gaWxW8OF1vpE0aQiY7aG8hCrHU3R3jScWTQRL0+CFlJKtVC+RFHsNNp JMUUKz+4J281Wcm84mcfRo/D7zv0QIy0mVIaY5C15lvKPZA/RExWRz/wmf3cvlrDrgwA MDuqem1GcvFchx7dN/jHLaGhvapIqKNCf1ZrNhhJHol1o2xAs+5vXx+kwnspp2iWfUBS Djmg== Received: by 10.216.143.146 with SMTP id l18mr10206412wej.56.1340816542149; Wed, 27 Jun 2012 10:02:22 -0700 (PDT) Received: from [192.168.1.214] ([176.41.41.117]) by mx.google.com with ESMTPS id ce3sm20958283wib.11.2012.06.27.10.02.20 (version=TLSv1/SSLv3 cipher=OTHER); Wed, 27 Jun 2012 10:02:21 -0700 (PDT) References: In-Reply-To: Mime-Version: 1.0 (1.0) Message-Id: X-Mailer: iPhone Mail (9B176) From: Levent Serinol Date: Wed, 27 Jun 2012 20:02:17 +0300 To: Andreas Nilsson Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: "freebsd-fs@freebsd.org" Subject: Re: ZFS stalls on Heavy I/O X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jun 2012 17:08:38 -0000 Hi, On 27 Haz 2012, at 19:34, Andreas Nilsson wrote: >=20 >=20 > On Wed, Jun 27, 2012 at 5:50 PM, Dean Jones w= rote: > On Wed, Jun 27, 2012 at 2:15 AM, Levent Serinol wrote= : > > Hi, > > > > Under heavy I/O load we face freeze problems on ZFS volumes on both > > Freebsd 9 Release and 10 Current versions. Machines are HP servers (64bi= t) > > with HP Smart array 6400 raid controllers (with battery units). Every da= > > device is a hardware raid5 where each one includes 9x300GB 10K SCSI hard= > > drivers. Main of I/O pattern happens on local system except some small N= FS > > I/O from some other servers (NFS lookup/getattr/ etc.). These servers ar= e > > mail servers (qmail) with small I/O patterns (64K Read/Write). Below yo= u > > can find procstat output on freeze time. write_limit is set to 200MB > > because of the huge amount of txg_wait_opens observed before. Every proc= ess > > stops on D state I think due to txg queue and other 2 queues are full. I= s > > there any suggestion to fix the problem ? > > > > btw inject_compress is the main process injecting emails to user inboxes= > > (databases). Also, those machines were running without problems on > > Linux/XFS filesystem. For a while ago, we started migration from Linux t= o > > Freebsd > > > > > > http://pastebin.com/raw.php?i=3Dic3YepWQ > > _______________________________________________ >=20 > Looks like you are running dedup with only 12 gigs of ram? >=20 > Dedup is very ram hungry and the dedup tables are probably no longer > fitting entirely in memory and therefore the system is swapping and > thrashing about during writes. >=20 > Also ZFS really prefers to directly address drives instead of RAID > controllers. It can not guarantee or know what the controller is > doing behind the scenes. > You might want to read http://constantin.glez.de/blog/2011/07/zfs-dedupe-o= r-not-dedupe and see if you need more ram. >=20 > And yes, having raid below zfs somewhat defeats the point of zfs. >=20 > Regards > Andreas That was one the machines, i'm running several similar machines except few c= hanges. For examplw some of them have 50gb and 20gbs of ram and some of them= has direct access every disk itself on poil as you suggested ( pools includ= ing 24 disks) some of the machines also running p812 hp raid cards (1gb cach= e ) , every hp card has battery unit. Every machine wheter rumning on 50gb r= am or pools with lots of disks have the same stall problem except one of the= m which is using hp p6300 san with fc connection . It's running zfs without p= roblems. Do i have to suspect on ciss driver which is common on all machines= where problems occur ? Wheter they use 6400 or p812 raid cards all of them = is using same ciss driver except the one connected via fc to san. Btw when zfs stalls after 1-2 minutes later it contiunes to write and read a= s usual.=20 Do you suspect any problem in procstat ouput that i provided ? Thanks, Levent= From owner-freebsd-fs@FreeBSD.ORG Wed Jun 27 17:28:58 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6D50F1065670 for ; Wed, 27 Jun 2012 17:28:58 +0000 (UTC) (envelope-from freebsd-listen@fabiankeil.de) Received: from smtprelay03.ispgateway.de (smtprelay03.ispgateway.de [80.67.31.37]) by mx1.freebsd.org (Postfix) with ESMTP id ED1358FC0C for ; Wed, 27 Jun 2012 17:28:57 +0000 (UTC) Received: from [78.35.159.221] (helo=fabiankeil.de) by smtprelay03.ispgateway.de with esmtpsa (TLSv1:AES128-SHA:128) (Exim 4.68) (envelope-from ) id 1Sjw2s-0002ym-Fe; Wed, 27 Jun 2012 19:28:50 +0200 Date: Wed, 27 Jun 2012 19:28:43 +0200 From: Fabian Keil To: Levent Serinol Message-ID: <20120627192843.69214ea0@fabiankeil.de> In-Reply-To: References: Mime-Version: 1.0 Content-Type: multipart/signed; micalg=PGP-SHA1; boundary="Sig_/B2eUcb+W.ufrLFcX9jhdONG"; protocol="application/pgp-signature" X-Df-Sender: Nzc1MDY3 Cc: freebsd-fs@freebsd.org Subject: Re: ZFS stalls on Heavy I/O X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jun 2012 17:28:58 -0000 --Sig_/B2eUcb+W.ufrLFcX9jhdONG Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: quoted-printable Levent Serinol wrote: > On 27 Haz 2012, at 19:34, Andreas Nilsson wrote: > > On Wed, Jun 27, 2012 at 5:50 PM, Dean Jones wrote: > > On Wed, Jun 27, 2012 at 2:15 AM, Levent Serinol wr= ote: > > > Hi, > > > > > > Under heavy I/O load we face freeze problems on ZFS volumes on both > > > Freebsd 9 Release and 10 Current versions. Machines are HP servers (6= 4bit) > > > with HP Smart array 6400 raid controllers (with battery units). Every= da > > > device is a hardware raid5 where each one includes 9x300GB 10K SCSI h= ard > > > drivers. Main of I/O pattern happens on local system except some smal= l NFS > > > I/O from some other servers (NFS lookup/getattr/ etc.). These servers= are > > > mail servers (qmail) with small I/O patterns (64K Read/Write). Below= you > > > can find procstat output on freeze time. write_limit is set to 200MB > > > because of the huge amount of txg_wait_opens observed before. Every p= rocess > > > stops on D state I think due to txg queue and other 2 queues are full= . Is > > > there any suggestion to fix the problem ? > > > > > > btw inject_compress is the main process injecting emails to user inbo= xes > > > (databases). Also, those machines were running without problems on > > > Linux/XFS filesystem. For a while ago, we started migration from Lin= ux to > > > Freebsd > > > > > > > > > http://pastebin.com/raw.php?i=3Dic3YepWQ > > > _______________________________________________ > >=20 > > Looks like you are running dedup with only 12 gigs of ram? > >=20 > > Dedup is very ram hungry and the dedup tables are probably no longer > > fitting entirely in memory and therefore the system is swapping and > > thrashing about during writes. > >=20 > > Also ZFS really prefers to directly address drives instead of RAID > > controllers. It can not guarantee or know what the controller is > > doing behind the scenes. > > You might want to read http://constantin.glez.de/blog/2011/07/zfs-dedup= e-or-not-dedupe and see if you need more ram. > >=20 > > And yes, having raid below zfs somewhat defeats the point of zfs. > That was one the machines, i'm running several similar machines except fe= w changes. For examplw some of them have 50gb and 20gbs of ram and some of = them has direct access every disk itself on poil as you suggested ( pools i= ncluding 24 disks) some of the machines also running p812 hp raid cards (1g= b cache ) , every hp card has battery unit. Every machine wheter rumning on= 50gb ram or pools with lots of disks have the same stall problem except on= e of them which is using hp p6300 san with fc connection . It's running zfs= without problems. Do i have to suspect on ciss driver which is common on a= ll machines where problems occur ? Wheter they use 6400 or p812 raid cards = all of them is using same ciss driver except the one connected via fc to s= an. >=20 > Btw when zfs stalls after 1-2 minutes later it contiunes to write and rea= d as usual.=20 Do the stalls get shorter if you decrease kern.cam.da.default_timeout? Fabian --Sig_/B2eUcb+W.ufrLFcX9jhdONG Content-Type: application/pgp-signature; name=signature.asc Content-Disposition: attachment; filename=signature.asc -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.19 (FreeBSD) iEYEARECAAYFAk/rQtMACgkQBYqIVf93VJ0qxgCfXh+ehGM/nNzmQ224Fyw9D30n fuAAn26ybD5NUIPV21mmUc8jP5p8aBD0 =Mh7+ -----END PGP SIGNATURE----- --Sig_/B2eUcb+W.ufrLFcX9jhdONG-- From owner-freebsd-fs@FreeBSD.ORG Wed Jun 27 21:54:21 2012 Return-Path: Delivered-To: fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EA051106564A; Wed, 27 Jun 2012 21:54:21 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from mail-lb0-f182.google.com (mail-lb0-f182.google.com [209.85.217.182]) by mx1.freebsd.org (Postfix) with ESMTP id 3881D8FC08; Wed, 27 Jun 2012 21:54:21 +0000 (UTC) Received: by lbon10 with SMTP id n10so2731001lbo.13 for ; Wed, 27 Jun 2012 14:54:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=ePYiPocu+QOLTMl2P/0q1lE+ZTqGRGleJ2GcUUy4FeQ=; b=PQc133I1OApX9+NmA8y8M5ovvNMPTYOjMYxei3jP/gwLtbUbYY2nA2HAWp8JZWhyyS hxaF4jozCkkMkcNUCCqt9mc5oEl8d4iVVANYO8NEHXBl1xBpgVcf6L5XsyqXbHNaFY+P spSARSH1+F3vRx+wE89hqpXjAQTwrNcSwHeMr2m4Ga7IUxtz5DK5kWCqaIUAx/ee6VIM QV9pD1mvEVazscmahoMkUXhRWVLZoKbBHyP1ms5Cq8o46vxmf++s/Dlg+kGcRlSA+h/7 quoVWHA0b17d+sbec78MX0nSfw+PgLsfDmMCOTPM9EVTgxeMM3xild0aw5ZgXwzjjNzM 0jdQ== MIME-Version: 1.0 Received: by 10.152.108.144 with SMTP id hk16mr22236468lab.2.1340834059793; Wed, 27 Jun 2012 14:54:19 -0700 (PDT) Received: by 10.114.37.74 with HTTP; Wed, 27 Jun 2012 14:54:19 -0700 (PDT) In-Reply-To: <201206251443.41768.jhb@freebsd.org> References: <201206251443.41768.jhb@freebsd.org> Date: Wed, 27 Jun 2012 14:54:19 -0700 Message-ID: From: Freddie Cash To: John Baldwin Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: fs@freebsd.org Subject: Re: [PATCH] Simple ARC stats in top X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jun 2012 21:54:22 -0000 On Mon, Jun 25, 2012 at 11:43 AM, John Baldwin wrote: > I have some patches based on a script I got from avg@ that add some simpl= istic > ARC stats to top so that one can see how much of wired memory is set asid= e for > ARC, and how that memory is split up. =C2=A0The patch is against 8-stable= : > http://www.FreeBSD.org/~jhb/patches/top_arc.patch > > Sample output: > > Mem: 1245M Active, 1393M Inact, 21G Wired, 309M Buf, 23G Free > ARC: 19G Total, 1381M MRU, 17G MFU, 272K Anon, 232M Header, 442M Other > Swap: 8192M Total, 8192M Free Very nice! Have it installed on two FreeBSD 9-STABLE r236413 boxes with 24-drive pools and 32-48 GB of RAM. Hoping it will help me track down a memory issue with importing a pool. :) --=20 Freddie Cash fjwcash@gmail.com From owner-freebsd-fs@FreeBSD.ORG Wed Jun 27 22:00:25 2012 Return-Path: Delivered-To: freebsd-fs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CA84A1065677 for ; Wed, 27 Jun 2012 22:00:25 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id B51DA8FC24 for ; Wed, 27 Jun 2012 22:00:25 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.5/8.14.5) with ESMTP id q5RM0PFD099244 for ; Wed, 27 Jun 2012 22:00:25 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.5/8.14.5/Submit) id q5RM0PlR099243; Wed, 27 Jun 2012 22:00:25 GMT (envelope-from gnats) Date: Wed, 27 Jun 2012 22:00:25 GMT Message-Id: <201206272200.q5RM0PlR099243@freefall.freebsd.org> To: freebsd-fs@FreeBSD.org From: George Hartzell Cc: Subject: Re: kern/166566: [zfs] zfs split renders 2 disk (MBR based) mirror unbootable X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: George Hartzell List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jun 2012 22:00:25 -0000 The following reply was made to PR kern/166566; it has been noted by GNATS. From: George Hartzell To: Andriy Gapon Cc: hartzell@alerce.com, bug-followup@FreeBSD.org Subject: Re: kern/166566: [zfs] zfs split renders 2 disk (MBR based) mirror unbootable Date: Wed, 27 Jun 2012 14:53:21 -0700 Andriy Gapon writes: > on 27/06/2012 00:38 George Hartzell said the following: > > currdev does not seem to have any effect, it looks like something else > > is being used to find the initial zfs pool(s). > > Just a note that currdev would not affect the order of the pools in lsdev > output. It should affect from which pool the zpool.cache is loaded. > > Ah! You probably need to issue unload command as well. I keep forgetting that > in default configuration loader loads up stuff before presenting its menu. I've > changed my loader.rc, so that nothing is loaded before the menu. > > But, yes, the best course of action seems to be to fix up zsplitroot right after > splitting it off. > > Thank you for your persistence in testing and debugging! I thought the following would work, but it does not. zpool split -R /zsplitroot zroot zsplitroot zpool status # shows both pools. mount -t zfs zsplitroot /zsplitroot # my zfs stuff doesn't auto mount cp /boot/zfs/zpool.cache /zsplitroot/boot/zfs perl -pi.bak -e 's|zfs:zroot|zfs:zsplitroot|' /zsplitroot/boot/loader.conf umount /zsplitroot It fails to mount zsplitroot. Worse, setting vfs.zfs.debug=1 results in no additional output, just that the error is number 2. Any idea what I'm missing? g. From owner-freebsd-fs@FreeBSD.ORG Thu Jun 28 02:42:36 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 719D9106566B; Thu, 28 Jun 2012 02:42:36 +0000 (UTC) (envelope-from kevlo@kevlo.org) Received: from ns.kevlo.org (kevlo.org [220.128.136.52]) by mx1.freebsd.org (Postfix) with ESMTP id D5ACA8FC08; Thu, 28 Jun 2012 02:42:35 +0000 (UTC) Received: from [127.0.0.1] (git.kevlo.org [220.128.136.52]) by ns.kevlo.org (8.14.5/8.14.5) with ESMTP id q5S2gRYg077995; Thu, 28 Jun 2012 10:42:27 +0800 (CST) (envelope-from kevlo@kevlo.org) Message-ID: <1340851353.2151.7.camel@nsl> From: Kevin Lo To: Konstantin Belousov Date: Thu, 28 Jun 2012 10:42:33 +0800 In-Reply-To: <20120627154233.GO2337@deviant.kiev.zoral.com.ua> References: <1340589808.2192.1.camel@nsl> <20120625095548.GD2337@deviant.kiev.zoral.com.ua> <1340685505.2170.5.camel@nsl> <20120626102424.GL2337@deviant.kiev.zoral.com.ua> <1340763363.2147.1.camel@nsl> <1340774954.2147.3.camel@nsl> <20120627154233.GO2337@deviant.kiev.zoral.com.ua> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.3-0ubuntu6 Content-Transfer-Encoding: 7bit Mime-Version: 1.0 Cc: freebsd-fs@freebsd.org, freebsd-current Subject: Re: Tmpfs panic in -current X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Jun 2012 02:42:36 -0000 Konstantin Belousov wrote: > On Wed, Jun 27, 2012 at 01:29:14PM +0800, Kevin Lo wrote: > > Kevin Lo wrote: > > > Konstantin Belousov wrote: > > > > On Tue, Jun 26, 2012 at 12:38:25PM +0800, Kevin Lo wrote: > > > > > Konstantin Belousov wrote: > > > > > > On Mon, Jun 25, 2012 at 10:03:28AM +0800, Kevin Lo wrote: > > > > > > > I've observed a panic in recent -current several times but I only > > > > > > > have a picture of the backtrace: > > > > > > > http://people.freebsd.org/~kevlo/panic_tmpfs.jpg > > > > > > > > > > > > > > Does this look at all familiar to anyone? > > > > > > > > > > > > Can you look up the line corresponding to tmpfs_reg_resize + 0x627 address > > > > > > in your kernel ? > > > > > > > > > > Sure. > > > > > > > > > > > The screenshot looks strange. The instruction on which the kernel trapped > > > > > > is int 0x28 which should not appear in the compiled code. > > > > > > > > > > # gdb tmpfs.ko > > > > > (gdb) l *tmpfs_reg_resize+0x627 > > > > > 0xbf37 is in tmpfs_reg_resize (/usr/src/sys/modules/tmpfs/../../fs/tmpfs/tmpfs_subr.c:1005). > > > > > 1000 in /usr/src/sys/modules/tmpfs/../../fs/tmpfs/tmpfs_subr.c > > > > > > > > > > In tmpfs_subr.c: > > > > > 999 if (m != NULL) { > > > > > 1000 if ((m->oflags & VPO_BUSY) != 0 || > > > > > 1001 m->busy != 0) { > > > > > 1002 vm_page_sleep(m, "tmfssz"); > > > > > 1003 goto retry; > > > > > 1004 } > > > > > 1005 MPASS(m->valid == VM_PAGE_BITS_ALL); > > > > > 1006 } else if (vm_pager_has_page(uobj, idx, NULL, NU > > > > > LL)) { > > > > > > > > > Hm, can you get a core and > > > > - obtain backtrace in kgdb; > > > > - print the *m content for the page that triggered the assertion ? > > > > > > > > The only possible 'new size' value for the truncation from open(2) is zero, > > > > so I do not understand why the asserted block was executed at all. > > > > > > Thanks for looking into it. Unfortunately I can't get a crash dump > > > due to lack of disk space and memory. > > > > I triggered the KASSERT on a different machine in the last hour. > It is not 'the' KASSERT, it is something different. > > Are you sure that you do not have some systematic build issues on your > machines ? Although I do not think that tmpfs is 'ready for production use' > for arbitrary low value of this statement, there is no steady flow of > similar reports from other users. This makes me somewhat suspicious that > either you might have inconsistent build issues, or unrelated memory > corruption problems. As I mentioned, I'm running -CURRENT on a number of systems. I haven't seen tmpfs panics on machines running FreeBSD 9. Kevin From owner-freebsd-fs@FreeBSD.ORG Thu Jun 28 06:50:06 2012 Return-Path: Delivered-To: freebsd-fs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 51DF2106564A for ; Thu, 28 Jun 2012 06:50:06 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 380CD8FC1C for ; Thu, 28 Jun 2012 06:50:06 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.5/8.14.5) with ESMTP id q5S6o6hU098168 for ; Thu, 28 Jun 2012 06:50:06 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.5/8.14.5/Submit) id q5S6o64Q098167; Thu, 28 Jun 2012 06:50:06 GMT (envelope-from gnats) Date: Thu, 28 Jun 2012 06:50:06 GMT Message-Id: <201206280650.q5S6o64Q098167@freefall.freebsd.org> To: freebsd-fs@FreeBSD.org From: Andriy Gapon Cc: Subject: Re: kern/166566: [zfs] zfs split renders 2 disk (MBR based) mirror unbootable X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Andriy Gapon List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Jun 2012 06:50:06 -0000 The following reply was made to PR kern/166566; it has been noted by GNATS. From: Andriy Gapon To: hartzell@alerce.com Cc: bug-followup@FreeBSD.org Subject: Re: kern/166566: [zfs] zfs split renders 2 disk (MBR based) mirror unbootable Date: Thu, 28 Jun 2012 09:48:26 +0300 on 28/06/2012 00:53 George Hartzell said the following: > Andriy Gapon writes: > > on 27/06/2012 00:38 George Hartzell said the following: > > > currdev does not seem to have any effect, it looks like something else > > > is being used to find the initial zfs pool(s). > > > > Just a note that currdev would not affect the order of the pools in lsdev > > output. It should affect from which pool the zpool.cache is loaded. > > > > Ah! You probably need to issue unload command as well. I keep forgetting that > > in default configuration loader loads up stuff before presenting its menu. I've > > changed my loader.rc, so that nothing is loaded before the menu. > > > > But, yes, the best course of action seems to be to fix up zsplitroot right after > > splitting it off. > > > > Thank you for your persistence in testing and debugging! > > I thought the following would work, but it does not. > > zpool split -R /zsplitroot zroot zsplitroot > zpool status # shows both pools. > mount -t zfs zsplitroot /zsplitroot # my zfs stuff doesn't auto mount > cp /boot/zfs/zpool.cache /zsplitroot/boot/zfs > perl -pi.bak -e 's|zfs:zroot|zfs:zsplitroot|' /zsplitroot/boot/loader.conf > umount /zsplitroot > > It fails to mount zsplitroot. Worse, setting vfs.zfs.debug=1 results > in no additional output, just that the error is number 2. > > Any idea what I'm missing? /boot/zfs/zpool.cache after split contains only information about zroot. Thus it's kind of useless on zsplitroot. I think that you need to do zpool import -R ... -c ... zsplitroot and copy the proper cache file. -- Andriy Gapon From owner-freebsd-fs@FreeBSD.ORG Thu Jun 28 07:09:52 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 073F11065678; Thu, 28 Jun 2012 07:09:52 +0000 (UTC) (envelope-from gleb.kurtsou@gmail.com) Received: from mail-lb0-f182.google.com (mail-lb0-f182.google.com [209.85.217.182]) by mx1.freebsd.org (Postfix) with ESMTP id 3E32D8FC18; Thu, 28 Jun 2012 07:09:51 +0000 (UTC) Received: by lbon10 with SMTP id n10so3303179lbo.13 for ; Thu, 28 Jun 2012 00:09:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=bI1dJBTf8/KyqZCzvryNuK4a/vTuJso/G6lOXbEGbp4=; b=B+k4VbJFzzCYjlHYB2kmjqTCcROstS1TNs0DHHnl6/0ssTRxLzk7xin0S/x8/2c9af QdxoUjdUE2XEva0anSZ/vFtIwSbOafSwUexKDSL+E1twyUz4+9aosRZfWYEgA2Acaqds +OtLOLl2SRJrfUOKTgbhk0+Dm/m6gAUUOwKC4NtUSDlKN89R3OnlhW7Rk3EWXpnQTqsP hA7XkBiURR7RoXjks+DkiQxYGmaOo+FHkFCUtR4qUVTLAvVyQsZeQjdYCPfKFfdHVhhm Fd+vxeflEZgNjZimqV+YpvwuEDy/lL3/04bKnWFcle9uN4JYfIAFRj8bSuXLtwWshhNs Jndg== Received: by 10.112.30.226 with SMTP id v2mr497073lbh.103.1340867389933; Thu, 28 Jun 2012 00:09:49 -0700 (PDT) Received: from localhost ([78.157.92.5]) by mx.google.com with ESMTPS id i4sm752391lbg.17.2012.06.28.00.09.48 (version=SSLv3 cipher=OTHER); Thu, 28 Jun 2012 00:09:49 -0700 (PDT) Date: Thu, 28 Jun 2012 10:09:48 +0300 From: Gleb Kurtsou To: Kevin Lo Message-ID: <20120628070948.GA1197@reks> References: <1340589808.2192.1.camel@nsl> <20120625095548.GD2337@deviant.kiev.zoral.com.ua> <1340685505.2170.5.camel@nsl> <20120626102424.GL2337@deviant.kiev.zoral.com.ua> <1340763363.2147.1.camel@nsl> <1340774954.2147.3.camel@nsl> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline In-Reply-To: <1340774954.2147.3.camel@nsl> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-fs@freebsd.org, freebsd-current Subject: Re: Tmpfs panic in -current X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Jun 2012 07:09:52 -0000 On (27/06/2012 13:29), Kevin Lo wrote: > Kevin Lo wrote: > > Konstantin Belousov wrote: > > > On Tue, Jun 26, 2012 at 12:38:25PM +0800, Kevin Lo wrote: > > > > Konstantin Belousov wrote: > > > > > On Mon, Jun 25, 2012 at 10:03:28AM +0800, Kevin Lo wrote: > > > > > > I've observed a panic in recent -current several times but I only > > > > > > have a picture of the backtrace: > > > > > > http://people.freebsd.org/~kevlo/panic_tmpfs.jpg > > > > > > > > > > > > Does this look at all familiar to anyone? > > > > > > > > > > Can you look up the line corresponding to tmpfs_reg_resize + 0x627 address > > > > > in your kernel ? > > > > > > > > Sure. > > > > > > > > > The screenshot looks strange. The instruction on which the kernel trapped > > > > > is int 0x28 which should not appear in the compiled code. Kevin, do you have fuse modules loaded? It looks much like memmory corruption issue. From owner-freebsd-fs@FreeBSD.ORG Thu Jun 28 08:25:20 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 3F3DA1065674; Thu, 28 Jun 2012 08:25:20 +0000 (UTC) (envelope-from kevlo@kevlo.org) Received: from ns.kevlo.org (kevlo.org [220.128.136.52]) by mx1.freebsd.org (Postfix) with ESMTP id CA9EB8FC1C; Thu, 28 Jun 2012 08:25:19 +0000 (UTC) Received: from [127.0.0.1] (git.kevlo.org [220.128.136.52]) by ns.kevlo.org (8.14.5/8.14.5) with ESMTP id q5S8P5N8079387; Thu, 28 Jun 2012 16:25:06 +0800 (CST) (envelope-from kevlo@kevlo.org) Message-ID: <1340871912.2151.9.camel@nsl> From: Kevin Lo To: Gleb Kurtsou Date: Thu, 28 Jun 2012 16:25:12 +0800 In-Reply-To: <20120628070948.GA1197@reks> References: <1340589808.2192.1.camel@nsl> <20120625095548.GD2337@deviant.kiev.zoral.com.ua> <1340685505.2170.5.camel@nsl> <20120626102424.GL2337@deviant.kiev.zoral.com.ua> <1340763363.2147.1.camel@nsl> <1340774954.2147.3.camel@nsl> <20120628070948.GA1197@reks> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.3-0ubuntu6 Content-Transfer-Encoding: 8bit Mime-Version: 1.0 Cc: freebsd-fs@freebsd.org, freebsd-current Subject: Re: Tmpfs panic in -current X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Jun 2012 08:25:20 -0000 On 四, 2012-06-28 at 10:09 +0300, Gleb Kurtsou wrote: > On (27/06/2012 13:29), Kevin Lo wrote: > > Kevin Lo wrote: > > > Konstantin Belousov wrote: > > > > On Tue, Jun 26, 2012 at 12:38:25PM +0800, Kevin Lo wrote: > > > > > Konstantin Belousov wrote: > > > > > > On Mon, Jun 25, 2012 at 10:03:28AM +0800, Kevin Lo wrote: > > > > > > > I've observed a panic in recent -current several times but I only > > > > > > > have a picture of the backtrace: > > > > > > > http://people.freebsd.org/~kevlo/panic_tmpfs.jpg > > > > > > > > > > > > > > Does this look at all familiar to anyone? > > > > > > > > > > > > Can you look up the line corresponding to tmpfs_reg_resize + 0x627 address > > > > > > in your kernel ? > > > > > > > > > > Sure. > > > > > > > > > > > The screenshot looks strange. The instruction on which the kernel trapped > > > > > > is int 0x28 which should not appear in the compiled code. > > Kevin, do you have fuse modules loaded? It looks much like memmory > corruption issue. No, I don't have that module loaded. # kldstat Id Refs Address Size Name 1 14 0xc0400000 bab9e8 kernel 2 1 0xc0fac000 1d58 msdosfs_iconv.ko 3 2 0xc0fae000 67a8 libiconv.ko 4 1 0xc728e000 9000 tmpfs.ko 5 1 0xc789b000 4000 uhid.ko From owner-freebsd-fs@FreeBSD.ORG Fri Jun 29 08:57:06 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B1BA5106564A for ; Fri, 29 Jun 2012 08:57:06 +0000 (UTC) (envelope-from lserinol@gmail.com) Received: from mail-yx0-f182.google.com (mail-yx0-f182.google.com [209.85.213.182]) by mx1.freebsd.org (Postfix) with ESMTP id 614E28FC17 for ; Fri, 29 Jun 2012 08:57:06 +0000 (UTC) Received: by yenl8 with SMTP id l8so2984185yen.13 for ; Fri, 29 Jun 2012 01:57:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=3WdepfDigT5VM94qr4Ocb/4VxSj7ZKXJhIEW6XB32KE=; b=iFAwz5OdO0rEMcSGaSZajAKf8NB+m5tbCyU8Ar7X7pr0zyokIrZwkCpf4mWNcy9VEB tV+TquyoBvEauRjBsiZD6FCMZyNyghY/rqnnqrmFyvYB9FwyszmNVCbszGd76yCwEnWA LsOt5mpvQpuxpLp2IgRP4G8tMt4mB7Kk90cJmMg22Tnc8mjf2tm4MjrGEyfIDlzilKoQ ORbJneC/+Ax6jL+ZWqdSJ17BCsdPRMTQ7TYxhGPnuMQmW9DJESEK3c09NfHmEAcinZia srgLN5HficQZ+NRhUhioEtUcKG3SXCspE7S7jdlKl7vVLD8jsLgQZcNHrgLDkD+NhlkC 3IDA== MIME-Version: 1.0 Received: by 10.101.165.13 with SMTP id s13mr272020ano.1.1340960224937; Fri, 29 Jun 2012 01:57:04 -0700 (PDT) Received: by 10.146.103.7 with HTTP; Fri, 29 Jun 2012 01:57:04 -0700 (PDT) In-Reply-To: <20120627192843.69214ea0@fabiankeil.de> References: <20120627192843.69214ea0@fabiankeil.de> Date: Fri, 29 Jun 2012 11:57:04 +0300 Message-ID: From: Levent Serinol To: Fabian Keil Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-fs@freebsd.org Subject: Re: ZFS stalls on Heavy I/O X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 Jun 2012 08:57:06 -0000 Hi, On Wed, Jun 27, 2012 at 8:28 PM, Fabian Keil wrote: > Levent Serinol wrote: > > > On 27 Haz 2012, at 19:34, Andreas Nilsson wrote: > > > > On Wed, Jun 27, 2012 at 5:50 PM, Dean Jones < > dean.jones@oregonstate.edu> wrote: > > > On Wed, Jun 27, 2012 at 2:15 AM, Levent Serinol > wrote: > > > > Hi, > > > > > > > > Under heavy I/O load we face freeze problems on ZFS volumes on both > > > > Freebsd 9 Release and 10 Current versions. Machines are HP servers > (64bit) > > > > with HP Smart array 6400 raid controllers (with battery units). > Every da > > > > device is a hardware raid5 where each one includes 9x300GB 10K SCSI > hard > > > > drivers. Main of I/O pattern happens on local system except some > small NFS > > > > I/O from some other servers (NFS lookup/getattr/ etc.). These > servers are > > > > mail servers (qmail) with small I/O patterns (64K Read/Write). > Below you > > > > can find procstat output on freeze time. write_limit is set to 200MB > > > > because of the huge amount of txg_wait_opens observed before. Every > process > > > > stops on D state I think due to txg queue and other 2 queues are > full. Is > > > > there any suggestion to fix the problem ? > > > > > > > > btw inject_compress is the main process injecting emails to user > inboxes > > > > (databases). Also, those machines were running without problems on > > > > Linux/XFS filesystem. For a while ago, we started migration from > Linux to > > > > Freebsd > > > > > > > > > > > > http://pastebin.com/raw.php?i=ic3YepWQ > > > > _______________________________________________ > > > > > > Looks like you are running dedup with only 12 gigs of ram? > > > > > > Dedup is very ram hungry and the dedup tables are probably no longer > > > fitting entirely in memory and therefore the system is swapping and > > > thrashing about during writes. > > > > > > Also ZFS really prefers to directly address drives instead of RAID > > > controllers. It can not guarantee or know what the controller is > > > doing behind the scenes. > > > You might want to read > http://constantin.glez.de/blog/2011/07/zfs-dedupe-or-not-dedupe and see > if you need more ram. > > > > > > And yes, having raid below zfs somewhat defeats the point of zfs. > > > That was one the machines, i'm running several similar machines except > few changes. For examplw some of them have 50gb and 20gbs of ram and some > of them has direct access every disk itself on poil as you suggested ( > pools including 24 disks) some of the machines also running p812 hp raid > cards (1gb cache ) , every hp card has battery unit. Every machine wheter > rumning on 50gb ram or pools with lots of disks have the same stall problem > except one of them which is using hp p6300 san with fc connection . It's > running zfs without problems. Do i have to suspect on ciss driver which is > common on all machines where problems occur ? Wheter they use 6400 or p812 > raid cards all of them is using same ciss driver except the one connected > via fc to san. > > > > Btw when zfs stalls after 1-2 minutes later it contiunes to write and > read as usual. > > Do the stalls get shorter if you decrease kern.cam.da.default_timeout? > > Fabian > I set kern.cam.da.default_timeout to 30 later tried 10, nothing happened. I just tried this on a machine where there are plenty of ram (50GB) , hp p812 raid controller (1gb cache+battery) and zpool configuration as below. state: ONLINE scan: none requested config: NAME STATE READ WRITE CKSUM mail213 ONLINE 0 0 0 raidz1-0 ONLINE 0 0 0 da1 ONLINE 0 0 0 da2 ONLINE 0 0 0 da3 ONLINE 0 0 0 da4 ONLINE 0 0 0 da5 ONLINE 0 0 0 da6 ONLINE 0 0 0 da7 ONLINE 0 0 0 da8 ONLINE 0 0 0 da9 ONLINE 0 0 0 da10 ONLINE 0 0 0 da11 ONLINE 0 0 0 raidz1-1 ONLINE 0 0 0 da13 ONLINE 0 0 0 da14 ONLINE 0 0 0 da15 ONLINE 0 0 0 da16 ONLINE 0 0 0 da17 ONLINE 0 0 0 da18 ONLINE 0 0 0 da19 ONLINE 0 0 0 da20 ONLINE 0 0 0 da21 ONLINE 0 0 0 da22 ONLINE 0 0 0 da24 ONLINE 0 0 0 cache da23 ONLINE 0 0 0 spares da12 AVAIL zpool list NAME SIZE ALLOC FREE CAP DEDUP HEALTH ALTROOT mail213 6T 4.32T 1.68T 71% 2.25x ONLINE - every process where trying to write or read on this pool is in "D" state. here is a small trace of a process. Every one of them, strangely waits too long on lseek syscall. I have also replaced the lseek with pread/pwrite but same delay occures. 20338: 0.008389433 lseek(3,0x51dc00,SEEK_SET) = 5364736 (0x51dc00) 20338: 0.469858534 read(3,"\^B\0\0\0\r\0Y\0\0\0Yd\^C\M-/\^C"...,1024) = 1024 (0x400) 20338: 0.470058003 lseek(3,0xf1000,SEEK_SET) = 987136 (0xf1000) 20338: 0.492391062 read(3,"\n\0\0\0\^N\0007\0\0007\0z\0\M-B"...,1024) = 1024 (0x400) 20338: 0.492525369 lseek(4,0x2a50,SEEK_SET) = 10832 (0x2a50) 20338: 0.492680628 write(4,"\0\0\^Tx",4) = 4 (0x4) 20338: 0.492759340 lseek(4,0x2a54,SEEK_SET) = 10836 (0x2a54) 20338: 0.492950148 write(4,"\^B\0\0\0\r\0Y\0\0\0Yd\^C\M-/\^C"...,1024) = 1024 (0x400) 20338: 0.493027673 lseek(4,0x2e54,SEEK_SET) = 11860 (0x2e54) 20338: 0.493124404 write(4,"\M-&"\t\M-K",4) = 4 (0x4) 20338: 0.493204793 lseek(3,0xb3e800,SEEK_SET) = 11790336 (0xb3e800) 20338: 0.555674360 read(3,"\n\0\0\0\r\0}\0\0\M-B\^A\^F\^AV"...,1024) = 1024 (0x400) 20338: 0.555823752 lseek(3,0x2c7800,SEEK_SET) = 2914304 (0x2c7800) 20338: 0.568206547 read(3,"\n\0\0\0\r\0K\0\0\M^V\0\M-W\^A'"...,1024) = 1024 (0x400) 20338: 0.568324720 lseek(4,0x2e58,SEEK_SET) = 11864 (0x2e58) 20338: 0.568437026 write(4,"\0\0\^C\M-E",4) = 4 (0x4) 20338: 0.568511757 lseek(4,0x2e5c,SEEK_SET) = 11868 (0x2e5c) 20338: 0.568666527 write(4,"\n\0\0\0\^N\0007\0\0007\0z\0\M-B"...,1024) = 1024 (0x400) 20338: 0.568742795 lseek(4,0x325c,SEEK_SET) = 12892 (0x325c) 20338: 0.568852168 write(4,"\M-&"\no",4) = 4 (0x4) 20338: 0.568930600 lseek(4,0x3260,SEEK_SET) = 12896 (0x3260) 20338: 0.569028379 write(4,"\0\0\v\^_",4) = 4 (0x4) 20338: 0.569094659 lseek(4,0x3264,SEEK_SET) = 12900 (0x3264) 20338: 0.569235950 write(4,"\n\0\0\0\r\0K\0\0\M^V\0\M-W\^A'"...,1024) = 1024 (0x400) 20338: 0.569302439 lseek(4,0x3664,SEEK_SET) = 13924 (0x3664) 20338: 0.569390022 write(4,"\M-&"\n\^[",4) = 4 (0x4) 20338: 0.569451692 lseek(4,0x3668,SEEK_SET) = 13928 (0x3668) 20338: 0.569534176 write(4,"\0\0,\M-{",4) = 4 (0x4) 20338: 0.569594170 lseek(4,0x366c,SEEK_SET) = 13932 (0x366c) 20338: 0.569721771 write(4,"\n\0\0\0\r\0}\0\0\M-B\^A\^F\^AV"...,1024) = 1024 (0x400) 20338: 0.569782604 lseek(4,0x3a6c,SEEK_SET) = 14956 (0x3a6c) 20338: 0.569873818 write(4,"\M-&"\nW",4) = 4 (0x4) 20338: 0.569953368 lseek(3,0x9000,SEEK_SET) = 36864 (0x9000) 20338: 0.570027610 read(3,"\^B\0\0\0\^S\0\M^D\0\0\0\M-(\M-X"...,1024) = 1024 (0x400) 20338: 0.570122595 lseek(3,0x2a35c00,SEEK_SET) = 44260352 (0x2a35c00) 20338: 0.728753280 read(3,"\^B\0\0\0\^S\0\M^D\^A\0\0\M-/7"...,1024) = 1024 (0x400) 20338: 0.728882977 lseek(3,0x2bcd800,SEEK_SET) = 45930496 (0x2bcd800) 20338: 0.728959175 read(3,"\n\0\0\0\^R\0\M-~\0\0\M-~\^A)\^A"...,1024) = 1024 (0x400) 20338: 0.729059188 lseek(4,0x3a70,SEEK_SET) = 14960 (0x3a70) 20338: 0.729143278 write(4,"\0\0\M-/7",4) = 4 (0x4) 20338: 0.729203063 lseek(4,0x3a74,SEEK_SET) = 14964 (0x3a74) 20338: 0.729328011 write(4,"\n\0\0\0\^R\0\M-~\0\0\M-~\^A)\^A"...,1024) = 1024 (0x400) 20338: 0.729385351 lseek(4,0x3e74,SEEK_SET) = 15988 (0x3e74) 20338: 0.729473212 write(4,"\M-&"\t\M^T",4) = 4 (0x4) 20338: 0.729539772 lseek(3,0x9800,SEEK_SET) = 38912 (0x9800) 20338: 0.729608776 read(3,"\^B\0\0\0\^A\^C\M-G\0\0\0b\^\\^C"...,1024) = 1024 (0x400) 20338: 0.729702783 lseek(3,0x1886c00,SEEK_SET) = 25717760 (0x1886c00) 20338: 0.876752391 read(3,"\^B\^A\M^P\0\^P\09\^A\0\0.I\^A"...,1024) = 1024 (0x400) 20338: 0.876904926 lseek(3,0x2999000,SEEK_SET) = 43618304 (0x2999000) 20338: 1.088693201 read(3,"\^B\0\0\0\^O\0\M-*\0\0\0$l\0\M-*"...,1024) = 1024 (0x400) 20338: 1.088931153 lseek(3,0x2bc1400,SEEK_SET) = 45880320 (0x2bc1400) 20338: 1.089040037 read(3,"\n\0\0\0\^N\^A\^Z\0\^A\^Z\^AN\^A"...,1024) = 1024 (0x400) 20338: 1.089176648 lseek(4,0x3e78,SEEK_SET) = 15992 (0x3e78) 20338: 1.089300199 write(4,"\0\0\M-/\^F",4) = 4 (0x4) 20338: 1.089384009 lseek(4,0x3e7c,SEEK_SET) = 15996 (0x3e7c) 20338: 1.089572373 write(4,"\n\0\0\0\^N\^A\^Z\0\^A\^Z\^AN\^A"...,1024) = 1024 (0x400) 20338: 1.089654927 lseek(4,0x427c,SEEK_SET) = 17020 (0x427c) 20338: 1.089771773 write(4,"\M-&"\n\^D",4) = 4 (0x4) 20338: 1.089882891 lseek(4,0x4280,SEEK_SET) = 17024 (0x4280) 20338: 1.089998899 write(4,"\0\0\0\^A",4) = 4 (0x4) 20338: 1.090082290 lseek(4,0x4284,SEEK_SET) = 17028 (0x4284) 20338: 1.090246000 write(4,"SQLite format 3\0\^D\0\^A\^A\0@ "...,1024) = 1024 (0x400) 20338: 1.090328135 lseek(4,0x4684,SEEK_SET) = 18052 (0x4684) 20338: 1.090441349 write(4,"\M-&"\t3",4) = 4 (0x4) 20338: 1.090547439 lseek(4,0x4688,SEEK_SET) = 18056 (0x4688) 20338: 1.090660234 write(4,"\0\0\M-.'",4) = 4 (0x4) 20338: 1.090750959 lseek(4,0x468c,SEEK_SET) = 18060 (0x468c) 20338: 1.090939462 write(4,"\^E\0\0\0]\^Au\0\0\0\M-/\^?\^A"...,1024) = 1024 (0x400) 20338: 1.091030327 lseek(4,0x4a8c,SEEK_SET) = 19084 (0x4a8c) 20338: 1.091149966 write(4,"\M-&"\n1",4) = 4 (0x4) 20338: 1.091271003 lseek(4,0x4a90,SEEK_SET) = 19088 (0x4a90) 20338: 1.091398535 write(4,"\0\0\0\^F",4) = 4 (0x4) 20338: 1.091485069 lseek(4,0x4a94,SEEK_SET) = 19092 (0x4a94) 20338: 1.091673573 write(4,"\r\0\0\0\^B\^C\M-g\0\^C\M-s\^C"...,1024) = 1024 (0x400) 20338: 1.091756336 lseek(4,0x4e94,SEEK_SET) = 20116 (0x4e94) 20338: 1.091875836 write(4,"\M-&"\b\M-)",4) = 4 (0x4) 20338: 1.091975011 fcntl(3,F_SETLK,0x7fffffffcf80) = 0 (0x0) 20338: 1.092062384 fcntl(3,F_SETLK,0x7fffffffcf80) = 0 (0x0) 20338: 1.092152550 lseek(4,0x5000,SEEK_SET) = 20480 (0x5000) 20338: 1.092241040 read(4,0x7fffffffcf10,8) = 0 (0x0) 20338: 1.092337352 fsync(0x4,0x0,0x0,0x0,0x1,0x0) = 0 (0x0) Here is a stack trace on problem time http://pastebin.com/raw.php?i=T1iwhuEG Thanks, Levent -- http://lserinol.blogspot.com/ From owner-freebsd-fs@FreeBSD.ORG Fri Jun 29 20:32:17 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 497001065675; Fri, 29 Jun 2012 20:32:17 +0000 (UTC) (envelope-from asmrookie@gmail.com) Received: from mail-lb0-f182.google.com (mail-lb0-f182.google.com [209.85.217.182]) by mx1.freebsd.org (Postfix) with ESMTP id 92B728FC12; Fri, 29 Jun 2012 20:32:16 +0000 (UTC) Received: by lbon10 with SMTP id n10so6362921lbo.13 for ; Fri, 29 Jun 2012 13:32:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:x-google-sender-auth:message-id:subject :from:to:content-type; bh=ehOsrdsAjWs6A/OrckXkgYX4Cn5m5KVMI0AR5/7+JHE=; b=XAgK7XWnHhWxFzE6mde33uarSv3YHZaVtuwlnjHZJCaXhr7c4uwmwgFHe94shU4T19 SymbRfbEVnvN1XOZXLfRrdiMAcbYikIm1zUR62CRnHVSqmaTtCCZkxzqmMtU2hamyNcj z+DPyg3VwSdM8BMkNkiIAhIuDYePxIWUdEVJT0eLoFQuab1G0/0J92MxjXZ8WWlKq/Vs 7P3HbkfrZpi8faJ0fGYivX38cWzDr3jC+IAY7JSgmDqx6h/5WHDqgkfc6LACdkqbzt3I gI7x3i1rVGY3sjFaU57SyWDT9wx9QngK3F+kSliykueQFid9W3nw/0zrMuau23fyG+9i 8xsg== MIME-Version: 1.0 Received: by 10.152.46.6 with SMTP id r6mr3451911lam.7.1341001935561; Fri, 29 Jun 2012 13:32:15 -0700 (PDT) Sender: asmrookie@gmail.com Received: by 10.112.27.65 with HTTP; Fri, 29 Jun 2012 13:32:15 -0700 (PDT) Date: Fri, 29 Jun 2012 21:32:15 +0100 X-Google-Sender-Auth: 0ShlmjcXU8U5YNu43Q-N9EzqHMI Message-ID: From: Attilio Rao To: FreeBSD FS , freebsd-current@freebsd.org Content-Type: text/plain; charset=UTF-8 Cc: Subject: MPSAFE VFS -- List of upcoming actions X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 Jun 2012 20:32:17 -0000 As already published several times, according to the following plan: http://wiki.freebsd.org/NONMPSAFE_DEORBIT_VFS in 2 months the code dealing with non-MPSAFE filesystem will be removed and filesystems not yet MPSAFE will be disconnected from the tree. Their code will be however available in our official repository yet for 6 months. This leaves a total time of 8 months to do actions. Current list of unmantained filesystems is: HPFS, NWFS, PortalFS and XFS. Coda and SMBFS have current mantainership but the status of the work has still to be determined. NTFS, is being worked for the Summer of Code program. Finally, ReiserFS was successfully locked during this campaign. It is time for community members to step up and offer time and skills to lock a filesystem or test the effort of other developers willing to do so. Thanks, Attilio -- Peace can only be achieved by understanding - A. Einstein From owner-freebsd-fs@FreeBSD.ORG Fri Jun 29 23:23:46 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id B5E7E106566B; Fri, 29 Jun 2012 23:23:46 +0000 (UTC) (envelope-from imb@protected-networks.net) Received: from sarah.protected-networks.net (sarah.protected-networks.net [64.46.156.146]) by mx1.freebsd.org (Postfix) with ESMTP id 794B18FC08; Fri, 29 Jun 2012 23:23:46 +0000 (UTC) Received: from toshi.auburn.protected-networks.net (toshi.auburn.protected-networks.net [202.12.127.84]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client CN "Iain Butler", Issuer "RSA Class 2 Personal CA" (not verified)) (Authenticated sender: imb@protected-networks.net) by sarah.protected-networks.net (Postfix) with ESMTPSA id C2D8661F0; Fri, 29 Jun 2012 19:23:38 -0400 (EDT) DomainKey-Signature: a=rsa-sha1; s=200509; d=protected-networks.net; c=nofws; q=dns; h=message-id:date:from:user-agent:mime-version:to:cc:subject: references:in-reply-to:x-enigmail-version:openpgp:content-type:content-transfer-encoding; b=ZJZ+A7asYiOF/kczVyD4XUFaCAR7qUmFvb0QxB2HIZ8QY5kOIBHXTT8JQVVrVr4mu NcJLcYS0llxqRrvrsSbhfPSjFQGITJyzXQhDOf0bLcvabB/tVEUjyWQi6ITGEqu Message-ID: <4FEE38F8.2050104@protected-networks.net> Date: Fri, 29 Jun 2012 19:23:36 -0400 From: Michael Butler User-Agent: Mozilla/5.0 (X11; FreeBSD i386; rv:13.0) Gecko/20120619 Thunderbird/13.0.1 MIME-Version: 1.0 To: Attilio Rao References: In-Reply-To: X-Enigmail-Version: 1.4.2 OpenPGP: id=0442D492 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Cc: FreeBSD FS , freebsd-current@freebsd.org Subject: Re: MPSAFE VFS -- List of upcoming actions X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 Jun 2012 23:23:46 -0000 On 06/29/12 16:32, Attilio Rao wrote: > As already published several times, according to the following plan: > http://wiki.freebsd.org/NONMPSAFE_DEORBIT_VFS > > in 2 months the code dealing with non-MPSAFE filesystem will be > removed and filesystems not yet MPSAFE will be disconnected from the > tree. Their code will be however available in our official repository > yet for 6 months. This leaves a total time of 8 months to do actions. > > Current list of unmantained filesystems is: HPFS, NWFS, PortalFS and > XFS. Coda and SMBFS have current mantainership but the status of the > work has still to be determined. NTFS, is being worked for the Summer > of Code program. Finally, ReiserFS was successfully locked during this > campaign. What is to become of fusefs and friends, i.e. write-capable NTFS and truecrypt? imb From owner-freebsd-fs@FreeBSD.ORG Fri Jun 29 23:27:55 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 18AB11065670; Fri, 29 Jun 2012 23:27:55 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: from mail-wi0-f170.google.com (mail-wi0-f170.google.com [209.85.212.170]) by mx1.freebsd.org (Postfix) with ESMTP id 495248FC0A; Fri, 29 Jun 2012 23:27:54 +0000 (UTC) Received: by wibhq12 with SMTP id hq12so1295377wib.1 for ; Fri, 29 Jun 2012 16:27:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=VrOPUXCksJpl9R1LcO4j4Rn1Hczz9lZ0U4OOq0wgg6w=; b=0h2lhloe3y3oRscu70OYYEytCDByPofQ5Ybwnoekyc97H5jHoS8gITRpyW6nG0OoMB 240OI/dpbFcQyXLcoFr2+3D5sLchSPRtTtQp7e6HXsFVYTzW8zH/gM5GmG7oWgUHwxFo Iq9RWRSs8H6dcUlmzHMvWs9GLhM+7LvwNqUTU8x+vgqWZ6kVnkc7QDOPHkBAY/qhdSxD GJE16JVC/KGYi9UVRJRzxWSBA/osRpQMglcI72y4C0hl1lU1ZYzD6W0r997+AGfk6PAr jDAFhsVbW9OeFRaCRm9C4B3wBWS49rHkBel9wLi+ReLtsHn3pSwtEQr29Yhn1RYRPEuy uJ1w== MIME-Version: 1.0 Received: by 10.180.109.195 with SMTP id hu3mr1627136wib.8.1341012473120; Fri, 29 Jun 2012 16:27:53 -0700 (PDT) Received: by 10.223.155.4 with HTTP; Fri, 29 Jun 2012 16:27:53 -0700 (PDT) In-Reply-To: <4FEE38F8.2050104@protected-networks.net> References: <4FEE38F8.2050104@protected-networks.net> Date: Fri, 29 Jun 2012 16:27:53 -0700 Message-ID: From: Kevin Oberman To: Michael Butler Content-Type: text/plain; charset=UTF-8 Cc: Attilio Rao , FreeBSD FS , freebsd-current@freebsd.org Subject: Re: MPSAFE VFS -- List of upcoming actions X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 Jun 2012 23:27:55 -0000 On Fri, Jun 29, 2012 at 4:23 PM, Michael Butler wrote: > On 06/29/12 16:32, Attilio Rao wrote: >> As already published several times, according to the following plan: >> http://wiki.freebsd.org/NONMPSAFE_DEORBIT_VFS >> >> in 2 months the code dealing with non-MPSAFE filesystem will be >> removed and filesystems not yet MPSAFE will be disconnected from the >> tree. Their code will be however available in our official repository >> yet for 6 months. This leaves a total time of 8 months to do actions. >> >> Current list of unmantained filesystems is: HPFS, NWFS, PortalFS and >> XFS. Coda and SMBFS have current mantainership but the status of the >> work has still to be determined. NTFS, is being worked for the Summer >> of Code program. Finally, ReiserFS was successfully locked during this >> campaign. > > What is to become of fusefs and friends, i.e. write-capable NTFS and > truecrypt? > fusefs is not a part of the OS.It is a port. I believe gnn@ is working on it, but I have not seen any report on its status for a while. -- R. Kevin Oberman, Network Engineer E-mail: kob6558@gmail.com From owner-freebsd-fs@FreeBSD.ORG Fri Jun 29 23:40:12 2012 Return-Path: Delivered-To: freebsd-fs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 144BC1065673 for ; Fri, 29 Jun 2012 23:40:12 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id F275C8FC12 for ; Fri, 29 Jun 2012 23:40:11 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.5/8.14.5) with ESMTP id q5TNeB1M097060 for ; Fri, 29 Jun 2012 23:40:11 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.5/8.14.5/Submit) id q5TNeBam097059; Fri, 29 Jun 2012 23:40:11 GMT (envelope-from gnats) Date: Fri, 29 Jun 2012 23:40:11 GMT Message-Id: <201206292340.q5TNeBam097059@freefall.freebsd.org> To: freebsd-fs@FreeBSD.org From: George Hartzell Cc: Subject: Re: kern/166566: [zfs] zfs split renders 2 disk (MBR based) mirror unbootable X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: George Hartzell List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 Jun 2012 23:40:12 -0000 The following reply was made to PR kern/166566; it has been noted by GNATS. From: George Hartzell To: Andriy Gapon Cc: hartzell@alerce.com, bug-followup@FreeBSD.org Subject: Re: kern/166566: [zfs] zfs split renders 2 disk (MBR based) mirror unbootable Date: Fri, 29 Jun 2012 16:33:37 -0700 Andriy Gapon writes: > on 28/06/2012 00:53 George Hartzell said the following: > [...] > > I thought the following would work, but it does not. > > > > zpool split -R /zsplitroot zroot zsplitroot > > zpool status # shows both pools. > > mount -t zfs zsplitroot /zsplitroot # my zfs stuff doesn't auto mount > > cp /boot/zfs/zpool.cache /zsplitroot/boot/zfs > > perl -pi.bak -e 's|zfs:zroot|zfs:zsplitroot|' /zsplitroot/boot/loader.conf > > umount /zsplitroot > > > > It fails to mount zsplitroot. Worse, setting vfs.zfs.debug=1 results > > in no additional output, just that the error is number 2. > > > > Any idea what I'm missing? > > > /boot/zfs/zpool.cache after split contains only information about zroot. Thus > it's kind of useless on zsplitroot. > I think that you need to do zpool import -R ... -c ... zsplitroot and copy the > proper cache file. I thought that adding the "-R /zsplitroot" arg to the zpool split so that also did the import would result in a zpool.cache file that contained by. zpool status after the split shows both pool, which I didn't think was the case if you don't use -R. g. From owner-freebsd-fs@FreeBSD.ORG Sat Jun 30 04:17:35 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5DD321065672 for ; Sat, 30 Jun 2012 04:17:35 +0000 (UTC) (envelope-from mueller23@insightbb.com) Received: from mail.insightbb.com (smtp2.insight.synacor.com [208.47.185.24]) by mx1.freebsd.org (Postfix) with ESMTP id 1E9078FC17 for ; Sat, 30 Jun 2012 04:17:35 +0000 (UTC) X_CMAE_Category: 0,0 Undefined,Undefined X-CNFS-Analysis: v=1.1 cv=gf1CudfSVYh3XhyQAPGMwPFQ/4pzwPTMDeXC112K/mI= c=1 sm=0 a=190A9ldbhagA:10 a=jLN7EqiLvroA:10 a=6I5d2MoRAAAA:8 a=92czzIUlAAAA:8 a=FGtwrQyA_QvGIjOFz88A:9 a=Q/oqmR4JO1zR3vNQamCQeQ==:117 X-CM-Score: 0 X-Scanned-by: Cloudmark Authority Engine Authentication-Results: smtp02.insight.synacor.com smtp.mail=mueller23@insightbb.com; spf=softfail; sender-id=softfail Authentication-Results: smtp02.insight.synacor.com header.from=mueller23@insightbb.com; sender-id=softfail Received-SPF: softfail (smtp02.insight.synacor.com: transitional domain insightbb.com does not designate 74.134.26.53 as permitted sender) Received: from [74.134.26.53] ([74.134.26.53:41201] helo=localhost) by mail.insightbb.com (envelope-from ) (ecelerity 2.2.2.40 r(29895/29896)) with ESMTP id 43/6E-23439-7DD7EEF4; Sat, 30 Jun 2012 00:17:27 -0400 Date: Sat, 30 Jun 2012 00:17:27 -0400 Message-ID: <43.6E.23439.7DD7EEF4@smtp02.insight.synacor.com> From: "Thomas Mueller" To: freebsd-current@freebsd.org Cc: FreeBSD FS , Attilio Rao Subject: Re: MPSAFE VFS -- List of upcoming actions X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 30 Jun 2012 04:17:35 -0000 On 06/29/12 16:32, Attilio Rao wrote: > As already published several times, according to the following plan: > http://wiki.freebsd.org/NONMPSAFE_DEORBIT_VFS > in 2 months the code dealing with non-MPSAFE filesystem will be > removed and filesystems not yet MPSAFE will be disconnected from the > tree. Their code will be however available in our official repository > yet for 6 months. This leaves a total time of 8 months to do actions. > Current list of unmantained filesystems is: HPFS, NWFS, PortalFS and > XFS. Coda and SMBFS have current mantainership but the status of the > work has still to be determined. NTFS, is being worked for the Summer > of Code program. Finally, ReiserFS was successfully locked during this > campaign. I'm familiar with HPFS but not NWFS, PortalFS and SMBFS; don't really know what Coda is. I've been wondering about the status of XFS in (Free or other)BSD, know it's in ports and is usable in Linux. I think you can even run Linux on XFS instead of ext(2,3 or 4)fs, or ReiserFS, or btrfs. I remember Linux having read-only access, later also read-write, to HPFS, and I actually read HPFS partitions from Linux. That was long ago. Sometime during the single-digit days of April 2001, my OS/2 Warp 4 installation came apart when, following a crash where the file system was not cleanly dismounted, CHKDSK ran amok on reboot and trashed the entire hard disk, destroying a Linux installation as well. I was never able to boot any OS/2 again after that (trap 000c or 000d if it got that far), even from installation or other diskettes; there was no such thing as bootable CD back then, at least not for OS/2 Warp 4. Although OS/2 has continued on as eComStation (www.ecomstation.com), 32-bit i386 only, no 64-bit, eComStation has fallen far behind Linux and the BSDs. So one could say HPFS is antiquated, very few Linux or BSD users would have use for HPFS access; my last time was in April 2001. Tom From owner-freebsd-fs@FreeBSD.ORG Sat Jun 30 08:00:26 2012 Return-Path: Delivered-To: freebsd-fs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id AEE34106567A for ; Sat, 30 Jun 2012 08:00:26 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 998508FC0A for ; Sat, 30 Jun 2012 08:00:26 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.5/8.14.5) with ESMTP id q5U80QEa069732 for ; Sat, 30 Jun 2012 08:00:26 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.5/8.14.5/Submit) id q5U80QMX069724; Sat, 30 Jun 2012 08:00:26 GMT (envelope-from gnats) Date: Sat, 30 Jun 2012 08:00:26 GMT Message-Id: <201206300800.q5U80QMX069724@freefall.freebsd.org> To: freebsd-fs@FreeBSD.org From: Andriy Gapon Cc: Subject: Re: kern/166566: [zfs] zfs split renders 2 disk (MBR based) mirror unbootable X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Andriy Gapon List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 30 Jun 2012 08:00:26 -0000 The following reply was made to PR kern/166566; it has been noted by GNATS. From: Andriy Gapon To: hartzell@alerce.com Cc: bug-followup@FreeBSD.org Subject: Re: kern/166566: [zfs] zfs split renders 2 disk (MBR based) mirror unbootable Date: Sat, 30 Jun 2012 10:59:33 +0300 on 30/06/2012 02:33 George Hartzell said the following: > I thought that adding the "-R /zsplitroot" arg to the zpool split so > that also did the import would result in a zpool.cache file that > contained by. zpool status after the split shows both pool, which > I didn't think was the case if you don't use -R. With -R zplitroot is added to the main zpool.cache in /boot/zfs (on zroot). Nothing is done with zpool.cache in zplitroot as far as I understand. -- Andriy Gapon From owner-freebsd-fs@FreeBSD.ORG Sat Jun 30 08:03:58 2012 Return-Path: Delivered-To: freebsd-fs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E095A10657F9; Sat, 30 Jun 2012 08:03:58 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id B306F8FC16; Sat, 30 Jun 2012 08:03:58 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.5/8.14.5) with ESMTP id q5U83wlH070574; Sat, 30 Jun 2012 08:03:58 GMT (envelope-from avg@freefall.freebsd.org) Received: (from avg@localhost) by freefall.freebsd.org (8.14.5/8.14.5/Submit) id q5U83wvg070570; Sat, 30 Jun 2012 08:03:58 GMT (envelope-from avg) Date: Sat, 30 Jun 2012 08:03:58 GMT Message-Id: <201206300803.q5U83wvg070570@freefall.freebsd.org> To: hartzell@alerce.com, avg@FreeBSD.org, freebsd-fs@FreeBSD.org, avg@FreeBSD.org From: avg@FreeBSD.org Cc: Subject: Re: kern/166566: [zfs] zfs split renders 2 disk (MBR based) mirror unbootable X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 30 Jun 2012 08:03:59 -0000 Synopsis: [zfs] zfs split renders 2 disk (MBR based) mirror unbootable State-Changed-From-To: open->closed State-Changed-By: avg State-Changed-When: Sat Jun 30 08:01:47 UTC 2012 State-Changed-Why: Analysis has not revealed any FreeBSD ZFS bug. Responsible-Changed-From-To: freebsd-fs->avg Responsible-Changed-By: avg Responsible-Changed-When: Sat Jun 30 08:01:47 UTC 2012 Responsible-Changed-Why: Record interest in further developments on this report. http://www.freebsd.org/cgi/query-pr.cgi?pr=166566 From owner-freebsd-fs@FreeBSD.ORG Sat Jun 30 13:15:47 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AA3121065670; Sat, 30 Jun 2012 13:15:47 +0000 (UTC) (envelope-from bfriesen@simple.dallas.tx.us) Received: from blade.simplesystems.org (blade.simplesystems.org [65.66.246.74]) by mx1.freebsd.org (Postfix) with ESMTP id 66FFC8FC15; Sat, 30 Jun 2012 13:15:47 +0000 (UTC) Received: from freddy.simplesystems.org (freddy.simplesystems.org [65.66.246.65]) by blade.simplesystems.org (8.14.4+Sun/8.14.4) with ESMTP id q5UD21e1023158; Sat, 30 Jun 2012 08:02:01 -0500 (CDT) Date: Sat, 30 Jun 2012 08:02:01 -0500 (CDT) From: Bob Friesenhahn X-X-Sender: bfriesen@freddy.simplesystems.org To: Thomas Mueller In-Reply-To: <43.6E.23439.7DD7EEF4@smtp02.insight.synacor.com> Message-ID: References: <43.6E.23439.7DD7EEF4@smtp02.insight.synacor.com> User-Agent: Alpine 2.01 (GSO 1266 2009-07-14) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; format=flowed; charset=US-ASCII X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.2 (blade.simplesystems.org [65.66.246.90]); Sat, 30 Jun 2012 08:02:01 -0500 (CDT) Cc: FreeBSD FS , Attilio Rao Subject: Re: MPSAFE VFS -- List of upcoming actions X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 30 Jun 2012 13:15:47 -0000 On Sat, 30 Jun 2012, Thomas Mueller wrote: > > I've been wondering about the status of XFS in (Free or other)BSD, > know it's in ports and is usable in Linux. > > I think you can even run Linux on XFS instead of ext(2,3 or 4)fs, or ReiserFS, or btrfs. You can not only run Linux on XFS (which I do) but it is still likely the most reliable and consistently performant of the filesystems available in Linux because of its origin and its maturity. XFS did not originate in Linux (it originated in SGI's Irix) so it should not surprise that Linux core developers are proponents of filesystems originally developed under Linux. Regardless, a key value of *BSD supporting non-native filesystems is in order to be able to access filesystems created on other OSs. XFS is a major filesystem so hopefully someone will volunteer to support it. Bob -- Bob Friesenhahn bfriesen@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/ GraphicsMagick Maintainer, http://www.GraphicsMagick.org/