From owner-freebsd-fs@FreeBSD.ORG Sun Jul 29 01:37:27 2012 Return-Path: Delivered-To: freebsd-fs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AB5BF1065670; Sun, 29 Jul 2012 01:37:27 +0000 (UTC) (envelope-from linimon@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 7EB078FC08; Sun, 29 Jul 2012 01:37:27 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.5/8.14.5) with ESMTP id q6T1bRbY055810; Sun, 29 Jul 2012 01:37:27 GMT (envelope-from linimon@freefall.freebsd.org) Received: (from linimon@localhost) by freefall.freebsd.org (8.14.5/8.14.5/Submit) id q6T1bRZZ055806; Sun, 29 Jul 2012 01:37:27 GMT (envelope-from linimon) Date: Sun, 29 Jul 2012 01:37:27 GMT Message-Id: <201207290137.q6T1bRZZ055806@freefall.freebsd.org> To: linimon@FreeBSD.org, freebsd-bugs@FreeBSD.org, freebsd-fs@FreeBSD.org From: linimon@FreeBSD.org Cc: Subject: Re: kern/170238: [zfs] [panic] Panic when deleting data X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 Jul 2012 01:37:27 -0000 Old Synopsis: ZFS: Panic when deleting data New Synopsis: [zfs] [panic] Panic when deleting data Responsible-Changed-From-To: freebsd-bugs->freebsd-fs Responsible-Changed-By: linimon Responsible-Changed-When: Sun Jul 29 01:37:12 UTC 2012 Responsible-Changed-Why: Over to maintainer(s). http://www.freebsd.org/cgi/query-pr.cgi?pr=170238 From owner-freebsd-fs@FreeBSD.ORG Mon Jul 30 11:07:14 2012 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 9877C1065687 for ; Mon, 30 Jul 2012 11:07:14 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 80BB28FC15 for ; Mon, 30 Jul 2012 11:07:14 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.5/8.14.5) with ESMTP id q6UB7Exg001773 for ; Mon, 30 Jul 2012 11:07:14 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.5/8.14.5/Submit) id q6UB7DCA001771 for freebsd-fs@FreeBSD.org; Mon, 30 Jul 2012 11:07:13 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 30 Jul 2012 11:07:13 GMT Message-Id: <201207301107.q6UB7DCA001771@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-fs@FreeBSD.org Cc: Subject: Current problem reports assigned to freebsd-fs@FreeBSD.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 30 Jul 2012 11:07:14 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/170238 fs [zfs] [panic] Panic when deleting data o kern/169945 fs [zfs] [panic] Kernel panic while importing zpool (afte o kern/169813 fs [zfs] [patch] Update with Illumos gate issues: 1796, 2 o kern/169480 fs [zfs] ZFS stalls on heavy I/O o kern/169398 fs [zfs] Can't remove file with permanent error o kern/169339 fs panic while " : > /etc/123" o kern/169319 fs [zfs] zfs resilver can't complete o kern/168947 fs [nfs] [zfs] .zfs/snapshot directory is messed up when o kern/168942 fs [nfs] [hang] nfsd hangs after being restarted (not -HU o kern/168158 fs [zfs] incorrect parsing of sharenfs options in zfs (fs o kern/167979 fs [ufs] DIOCGDINFO ioctl does not work on 8.2 file syste o kern/167977 fs [smbfs] mount_smbfs results are differ when utf-8 or U o kern/167688 fs [fusefs] Incorrect signal handling with direct_io o kern/167685 fs [zfs] ZFS on USB drive prevents shutdown / reboot o kern/167612 fs [portalfs] The portal file system gets stuck inside po o kern/167272 fs [zfs] ZFS Disks reordering causes ZFS to pick the wron o kern/167260 fs [msdosfs] msdosfs disk was mounted the second time whe o kern/167109 fs [zfs] [panic] zfs diff kernel panic Fatal trap 9: gene o kern/167105 fs [nfs] mount_nfs can not handle source exports wiht mor o kern/167067 fs [zfs] [panic] ZFS panics the server o kern/167066 fs [zfs] ZVOLs not appearing in /dev/zvol o kern/167065 fs [zfs] boot fails when a spare is the boot disk o kern/167048 fs [nfs] [patch] RELEASE-9 crash when using ZFS+NULLFS+NF o kern/166912 fs [ufs] [panic] Panic after converting Softupdates to jo o kern/166851 fs [zfs] [hang] Copying directory from the mounted UFS di o kern/166477 fs [nfs] NFS data corruption. o kern/165950 fs [ffs] SU+J and fsck problem o kern/165923 fs [nfs] Writing to NFS-backed mmapped files fails if flu o kern/165521 fs [zfs] [hang] livelock on 1 Gig of RAM with zfs when 31 o kern/165392 fs Multiple mkdir/rmdir fails with errno 31 o kern/165087 fs [unionfs] lock violation in unionfs o kern/164472 fs [ufs] fsck -B panics on particular data inconsistency o kern/164370 fs [zfs] zfs destroy for snapshot fails on i386 and sparc o kern/164261 fs [nullfs] [patch] fix panic with NFS served from NULLFS o kern/164256 fs [zfs] device entry for volume is not created after zfs o kern/164184 fs [ufs] [panic] Kernel panic with ufs_makeinode o kern/163801 fs [md] [request] allow mfsBSD legacy installed in 'swap' o kern/163770 fs [zfs] [hang] LOR between zfs&syncer + vnlru leading to o kern/163501 fs [nfs] NFS exporting a dir and a subdir in that dir to o kern/162944 fs [coda] Coda file system module looks broken in 9.0 o kern/162860 fs [zfs] Cannot share ZFS filesystem to hosts with a hyph o kern/162751 fs [zfs] [panic] kernel panics during file operations o kern/162591 fs [nullfs] cross-filesystem nullfs does not work as expe o kern/162519 fs [zfs] "zpool import" relies on buggy realpath() behavi o kern/162362 fs [snapshots] [panic] ufs with snapshot(s) panics when g o kern/161968 fs [zfs] [hang] renaming snapshot with -r including a zvo o kern/161897 fs [zfs] [patch] zfs partition probing causing long delay o kern/161864 fs [ufs] removing journaling from UFS partition fails on o bin/161807 fs [patch] add option for explicitly specifying metadata o kern/161579 fs [smbfs] FreeBSD sometimes panics when an smb share is o kern/161533 fs [zfs] [panic] zfs receive panic: system ioctl returnin o kern/161438 fs [zfs] [panic] recursed on non-recursive spa_namespace_ o kern/161424 fs [nullfs] __getcwd() calls fail when used on nullfs mou o kern/161280 fs [zfs] Stack overflow in gptzfsboot o kern/161205 fs [nfs] [pfsync] [regression] [build] Bug report freebsd o kern/161169 fs [zfs] [panic] ZFS causes kernel panic in dbuf_dirty o kern/161112 fs [ufs] [lor] filesystem LOR in FreeBSD 9.0-BETA3 o kern/160893 fs [zfs] [panic] 9.0-BETA2 kernel panic o kern/160860 fs [ufs] Random UFS root filesystem corruption with SU+J o kern/160801 fs [zfs] zfsboot on 8.2-RELEASE fails to boot from root-o o kern/160790 fs [fusefs] [panic] VPUTX: negative ref count with FUSE o kern/160777 fs [zfs] [hang] RAID-Z3 causes fatal hang upon scrub/impo o kern/160706 fs [zfs] zfs bootloader fails when a non-root vdev exists o kern/160591 fs [zfs] Fail to boot on zfs root with degraded raidz2 [r o kern/160410 fs [smbfs] [hang] smbfs hangs when transferring large fil o kern/160283 fs [zfs] [patch] 'zfs list' does abort in make_dataset_ha o kern/159930 fs [ufs] [panic] kernel core o kern/159402 fs [zfs][loader] symlinks cause I/O errors o kern/159357 fs [zfs] ZFS MAXNAMELEN macro has confusing name (off-by- o kern/159356 fs [zfs] [patch] ZFS NAME_ERR_DISKLIKE check is Solaris-s o kern/159351 fs [nfs] [patch] - divide by zero in mountnfs() o kern/159251 fs [zfs] [request]: add FLETCHER4 as DEDUP hash option o kern/159077 fs [zfs] Can't cd .. with latest zfs version o kern/159048 fs [smbfs] smb mount corrupts large files o kern/159045 fs [zfs] [hang] ZFS scrub freezes system o kern/158839 fs [zfs] ZFS Bootloader Fails if there is a Dead Disk o kern/158802 fs amd(8) ICMP storm and unkillable process. o kern/158231 fs [nullfs] panic on unmounting nullfs mounted over ufs o f kern/157929 fs [nfs] NFS slow read o kern/157399 fs [zfs] trouble with: mdconfig force delete && zfs strip o kern/157179 fs [zfs] zfs/dbuf.c: panic: solaris assert: arc_buf_remov o kern/156797 fs [zfs] [panic] Double panic with FreeBSD 9-CURRENT and o kern/156781 fs [zfs] zfs is losing the snapshot directory, p kern/156545 fs [ufs] mv could break UFS on SMP systems o kern/156193 fs [ufs] [hang] UFS snapshot hangs && deadlocks processes o kern/156039 fs [nullfs] [unionfs] nullfs + unionfs do not compose, re o kern/155615 fs [zfs] zfs v28 broken on sparc64 -current o kern/155587 fs [zfs] [panic] kernel panic with zfs p kern/155411 fs [regression] [8.2-release] [tmpfs]: mount: tmpfs : No o kern/155199 fs [ext2fs] ext3fs mounted as ext2fs gives I/O errors o bin/155104 fs [zfs][patch] use /dev prefix by default when importing o kern/154930 fs [zfs] cannot delete/unlink file from full volume -> EN o kern/154828 fs [msdosfs] Unable to create directories on external USB o kern/154491 fs [smbfs] smb_co_lock: recursive lock for object 1 p kern/154228 fs [md] md getting stuck in wdrain state o kern/153996 fs [zfs] zfs root mount error while kernel is not located o kern/153753 fs [zfs] ZFS v15 - grammatical error when attempting to u o kern/153716 fs [zfs] zpool scrub time remaining is incorrect o kern/153695 fs [patch] [zfs] Booting from zpool created on 4k-sector o kern/153680 fs [xfs] 8.1 failing to mount XFS partitions o kern/153520 fs [zfs] Boot from GPT ZFS root on HP BL460c G1 unstable o kern/153418 fs [zfs] [panic] Kernel Panic occurred writing to zfs vol o kern/153351 fs [zfs] locking directories/files in ZFS o bin/153258 fs [patch][zfs] creating ZVOLs requires `refreservation' s kern/153173 fs [zfs] booting from a gzip-compressed dataset doesn't w o kern/153126 fs [zfs] vdev failure, zpool=peegel type=vdev.too_small o kern/152022 fs [nfs] nfs service hangs with linux client [regression] o kern/151942 fs [zfs] panic during ls(1) zfs snapshot directory o kern/151905 fs [zfs] page fault under load in /sbin/zfs o bin/151713 fs [patch] Bug in growfs(8) with respect to 32-bit overfl o kern/151648 fs [zfs] disk wait bug o kern/151629 fs [fs] [patch] Skip empty directory entries during name o kern/151330 fs [zfs] will unshare all zfs filesystem after execute a o kern/151326 fs [nfs] nfs exports fail if netgroups contain duplicate o kern/151251 fs [ufs] Can not create files on filesystem with heavy us o kern/151226 fs [zfs] can't delete zfs snapshot o kern/151111 fs [zfs] vnodes leakage during zfs unmount o kern/150503 fs [zfs] ZFS disks are UNAVAIL and corrupted after reboot o kern/150501 fs [zfs] ZFS vdev failure vdev.bad_label on amd64 o kern/150390 fs [zfs] zfs deadlock when arcmsr reports drive faulted o kern/150336 fs [nfs] mountd/nfsd became confused; refused to reload n o kern/149208 fs mksnap_ffs(8) hang/deadlock o kern/149173 fs [patch] [zfs] make OpenSolaris installa o kern/149015 fs [zfs] [patch] misc fixes for ZFS code to build on Glib o kern/149014 fs [zfs] [patch] declarations in ZFS libraries/utilities o kern/149013 fs [zfs] [patch] make ZFS makefiles use the libraries fro o kern/148504 fs [zfs] ZFS' zpool does not allow replacing drives to be o kern/148490 fs [zfs]: zpool attach - resilver bidirectionally, and re o kern/148368 fs [zfs] ZFS hanging forever on 8.1-PRERELEASE o kern/148138 fs [zfs] zfs raidz pool commands freeze o kern/147903 fs [zfs] [panic] Kernel panics on faulty zfs device o kern/147881 fs [zfs] [patch] ZFS "sharenfs" doesn't allow different " o kern/147560 fs [zfs] [boot] Booting 8.1-PRERELEASE raidz system take o kern/147420 fs [ufs] [panic] ufs_dirbad, nullfs, jail panic (corrupt o kern/146941 fs [zfs] [panic] Kernel Double Fault - Happens constantly o kern/146786 fs [zfs] zpool import hangs with checksum errors o kern/146708 fs [ufs] [panic] Kernel panic in softdep_disk_write_compl o kern/146528 fs [zfs] Severe memory leak in ZFS on i386 o kern/146502 fs [nfs] FreeBSD 8 NFS Client Connection to Server s kern/145712 fs [zfs] cannot offline two drives in a raidz2 configurat o kern/145411 fs [xfs] [panic] Kernel panics shortly after mounting an f bin/145309 fs bsdlabel: Editing disk label invalidates the whole dev o kern/145272 fs [zfs] [panic] Panic during boot when accessing zfs on o kern/145246 fs [ufs] dirhash in 7.3 gratuitously frees hashes when it o kern/145238 fs [zfs] [panic] kernel panic on zpool clear tank o kern/145229 fs [zfs] Vast differences in ZFS ARC behavior between 8.0 o kern/145189 fs [nfs] nfsd performs abysmally under load o kern/144929 fs [ufs] [lor] vfs_bio.c + ufs_dirhash.c p kern/144447 fs [zfs] sharenfs fsunshare() & fsshare_main() non functi o kern/144416 fs [panic] Kernel panic on online filesystem optimization s kern/144415 fs [zfs] [panic] kernel panics on boot after zfs crash o kern/144234 fs [zfs] Cannot boot machine with recent gptzfsboot code o kern/143825 fs [nfs] [panic] Kernel panic on NFS client o bin/143572 fs [zfs] zpool(1): [patch] The verbose output from iostat o kern/143212 fs [nfs] NFSv4 client strange work ... o kern/143184 fs [zfs] [lor] zfs/bufwait LOR o kern/142878 fs [zfs] [vfs] lock order reversal o kern/142597 fs [ext2fs] ext2fs does not work on filesystems with real o kern/142489 fs [zfs] [lor] allproc/zfs LOR o kern/142466 fs Update 7.2 -> 8.0 on Raid 1 ends with screwed raid [re o kern/142306 fs [zfs] [panic] ZFS drive (from OSX Leopard) causes two o kern/142068 fs [ufs] BSD labels are got deleted spontaneously o kern/141897 fs [msdosfs] [panic] Kernel panic. msdofs: file name leng o kern/141463 fs [nfs] [panic] Frequent kernel panics after upgrade fro o kern/141305 fs [zfs] FreeBSD ZFS+sendfile severe performance issues ( o kern/141091 fs [patch] [nullfs] fix panics with DIAGNOSTIC enabled o kern/141086 fs [nfs] [panic] panic("nfs: bioread, not dir") on FreeBS o kern/141010 fs [zfs] "zfs scrub" fails when backed by files in UFS2 o kern/140888 fs [zfs] boot fail from zfs root while the pool resilveri o kern/140661 fs [zfs] [patch] /boot/loader fails to work on a GPT/ZFS- o kern/140640 fs [zfs] snapshot crash o kern/140068 fs [smbfs] [patch] smbfs does not allow semicolon in file o kern/139725 fs [zfs] zdb(1) dumps core on i386 when examining zpool c o kern/139715 fs [zfs] vfs.numvnodes leak on busy zfs p bin/139651 fs [nfs] mount(8): read-only remount of NFS volume does n o kern/139564 fs [zfs] [panic] 8.0-RC1 - Fatal trap 12 at end of shutdo o kern/139407 fs [smbfs] [panic] smb mount causes system crash if remot o kern/138662 fs [panic] ffs_blkfree: freeing free block o kern/138421 fs [ufs] [patch] remove UFS label limitations o kern/138202 fs mount_msdosfs(1) see only 2Gb o kern/136968 fs [ufs] [lor] ufs/bufwait/ufs (open) o kern/136945 fs [ufs] [lor] filedesc structure/ufs (poll) o kern/136944 fs [ffs] [lor] bufwait/snaplk (fsync) o kern/136873 fs [ntfs] Missing directories/files on NTFS volume o kern/136865 fs [nfs] [patch] NFS exports atomic and on-the-fly atomic p kern/136470 fs [nfs] Cannot mount / in read-only, over NFS o kern/135546 fs [zfs] zfs.ko module doesn't ignore zpool.cache filenam o kern/135469 fs [ufs] [panic] kernel crash on md operation in ufs_dirb o kern/135050 fs [zfs] ZFS clears/hides disk errors on reboot o kern/134491 fs [zfs] Hot spares are rather cold... o kern/133676 fs [smbfs] [panic] umount -f'ing a vnode-based memory dis o kern/132960 fs [ufs] [panic] panic:ffs_blkfree: freeing free frag o kern/132397 fs reboot causes filesystem corruption (failure to sync b o kern/132331 fs [ufs] [lor] LOR ufs and syncer o kern/132237 fs [msdosfs] msdosfs has problems to read MSDOS Floppy o kern/132145 fs [panic] File System Hard Crashes o kern/131441 fs [unionfs] [nullfs] unionfs and/or nullfs not combineab o kern/131360 fs [nfs] poor scaling behavior of the NFS server under lo o kern/131342 fs [nfs] mounting/unmounting of disks causes NFS to fail o bin/131341 fs makefs: error "Bad file descriptor" on the mount poin o kern/130920 fs [msdosfs] cp(1) takes 100% CPU time while copying file o kern/130210 fs [nullfs] Error by check nullfs o kern/129760 fs [nfs] after 'umount -f' of a stale NFS share FreeBSD l o kern/129488 fs [smbfs] Kernel "bug" when using smbfs in smbfs_smb.c: o kern/129231 fs [ufs] [patch] New UFS mount (norandom) option - mostly o kern/129152 fs [panic] non-userfriendly panic when trying to mount(8) o kern/127787 fs [lor] [ufs] Three LORs: vfslock/devfs/vfslock, ufs/vfs o bin/127270 fs fsck_msdosfs(8) may crash if BytesPerSec is zero o kern/127029 fs [panic] mount(8): trying to mount a write protected zi o kern/126287 fs [ufs] [panic] Kernel panics while mounting an UFS file o kern/125895 fs [ffs] [panic] kernel: panic: ffs_blkfree: freeing free s kern/125738 fs [zfs] [request] SHA256 acceleration in ZFS o kern/123939 fs [msdosfs] corrupts new files o kern/122380 fs [ffs] ffs_valloc:dup alloc (Soekris 4801/7.0/USB Flash o bin/122172 fs [fs]: amd(8) automount daemon dies on 6.3-STABLE i386, o bin/121898 fs [nullfs] pwd(1)/getcwd(2) fails with Permission denied o bin/121072 fs [smbfs] mount_smbfs(8) cannot normally convert the cha o kern/120483 fs [ntfs] [patch] NTFS filesystem locking changes o kern/120482 fs [ntfs] [patch] Sync style changes between NetBSD and F o kern/118912 fs [2tb] disk sizing/geometry problem with large array o kern/118713 fs [minidump] [patch] Display media size required for a k o kern/118318 fs [nfs] NFS server hangs under special circumstances o bin/118249 fs [ufs] mv(1): moving a directory changes its mtime o kern/118126 fs [nfs] [patch] Poor NFS server write performance o kern/118107 fs [ntfs] [panic] Kernel panic when accessing a file at N o kern/117954 fs [ufs] dirhash on very large directories blocks the mac o bin/117315 fs [smbfs] mount_smbfs(8) and related options can't mount o kern/117158 fs [zfs] zpool scrub causes panic if geli vdevs detach on o bin/116980 fs [msdosfs] [patch] mount_msdosfs(8) resets some flags f o conf/116931 fs lack of fsck_cd9660 prevents mounting iso images with o kern/116583 fs [ffs] [hang] System freezes for short time when using o bin/115361 fs [zfs] mount(8) gets into a state where it won't set/un o kern/114955 fs [cd9660] [patch] [request] support for mask,dirmask,ui o kern/114847 fs [ntfs] [patch] [request] dirmask support for NTFS ala o kern/114676 fs [ufs] snapshot creation panics: snapacct_ufs2: bad blo o bin/114468 fs [patch] [request] add -d option to umount(8) to detach o kern/113852 fs [smbfs] smbfs does not properly implement DFS referral o bin/113838 fs [patch] [request] mount(8): add support for relative p o bin/113049 fs [patch] [request] make quot(8) use getopt(3) and show o kern/112658 fs [smbfs] [patch] smbfs and caching problems (resolves b o kern/111843 fs [msdosfs] Long Names of files are incorrectly created o kern/111782 fs [ufs] dump(8) fails horribly for large filesystems s bin/111146 fs [2tb] fsck(8) fails on 6T filesystem o bin/107829 fs [2TB] fdisk(8): invalid boundary checking in fdisk / w o kern/106107 fs [ufs] left-over fsck_snapshot after unfinished backgro o kern/104406 fs [ufs] Processes get stuck in "ufs" state under persist o kern/104133 fs [ext2fs] EXT2FS module corrupts EXT2/3 filesystems o kern/103035 fs [ntfs] Directories in NTFS mounted disc images appear o kern/101324 fs [smbfs] smbfs sometimes not case sensitive when it's s o kern/99290 fs [ntfs] mount_ntfs ignorant of cluster sizes s bin/97498 fs [request] newfs(8) has no option to clear the first 12 o kern/97377 fs [ntfs] [patch] syntax cleanup for ntfs_ihash.c o kern/95222 fs [cd9660] File sections on ISO9660 level 3 CDs ignored o kern/94849 fs [ufs] rename on UFS filesystem is not atomic o bin/94810 fs fsck(8) incorrectly reports 'file system marked clean' o kern/94769 fs [ufs] Multiple file deletions on multi-snapshotted fil o kern/94733 fs [smbfs] smbfs may cause double unlock o kern/93942 fs [vfs] [patch] panic: ufs_dirbad: bad dir (patch from D o kern/92272 fs [ffs] [hang] Filling a filesystem while creating a sna o kern/91134 fs [smbfs] [patch] Preserve access and modification time a kern/90815 fs [smbfs] [patch] SMBFS with character conversions somet o kern/88657 fs [smbfs] windows client hang when browsing a samba shar o kern/88555 fs [panic] ffs_blkfree: freeing free frag on AMD 64 o kern/88266 fs [smbfs] smbfs does not implement UIO_NOCOPY and sendfi o bin/87966 fs [patch] newfs(8): introduce -A flag for newfs to enabl o kern/87859 fs [smbfs] System reboot while umount smbfs. o kern/86587 fs [msdosfs] rm -r /PATH fails with lots of small files o bin/85494 fs fsck_ffs: unchecked use of cg_inosused macro etc. o kern/80088 fs [smbfs] Incorrect file time setting on NTFS mounted vi o bin/74779 fs Background-fsck checks one filesystem twice and omits o kern/73484 fs [ntfs] Kernel panic when doing `ls` from the client si o bin/73019 fs [ufs] fsck_ufs(8) cannot alloc 607016868 bytes for ino o kern/71774 fs [ntfs] NTFS cannot "see" files on a WinXP filesystem o bin/70600 fs fsck(8) throws files away when it can't grow lost+foun o kern/68978 fs [panic] [ufs] crashes with failing hard disk, loose po o kern/65920 fs [nwfs] Mounted Netware filesystem behaves strange o kern/65901 fs [smbfs] [patch] smbfs fails fsx write/truncate-down/tr o kern/61503 fs [smbfs] mount_smbfs does not work as non-root o kern/55617 fs [smbfs] Accessing an nsmb-mounted drive via a smb expo o kern/51685 fs [hang] Unbounded inode allocation causes kernel to loc o kern/36566 fs [smbfs] System reboot with dead smb mount and umount o bin/27687 fs fsck(8) wrapper is not properly passing options to fsc o kern/18874 fs [2TB] 32bit NFS servers export wrong negative values t 283 problems total. From owner-freebsd-fs@FreeBSD.ORG Tue Jul 31 06:32:21 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 014AD106564A for ; Tue, 31 Jul 2012 06:32:21 +0000 (UTC) (envelope-from Karli.Sjoberg@slu.se) Received: from Exchange2.ad.slu.se (exchange2.ad.slu.se [193.10.100.95]) by mx1.freebsd.org (Postfix) with ESMTP id 7CBFE8FC08 for ; Tue, 31 Jul 2012 06:32:20 +0000 (UTC) Received: from exmbx3.ad.slu.se ([193.10.100.93]) by Exchange2.ad.slu.se ([193.10.100.95]) with mapi; Tue, 31 Jul 2012 08:31:08 +0200 From: =?iso-8859-1?Q?Karli_Sj=F6berg?= To: "freebsd-fs@freebsd.org" Date: Tue, 31 Jul 2012 08:31:07 +0200 Thread-Topic: Hang when importing pool Thread-Index: Ac1u5hHOP2OmvnvyQiaBL1S9wyASGw== Message-ID: Accept-Language: sv-SE, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: sv-SE, en-US MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: Hang when importing pool X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 31 Jul 2012 06:32:21 -0000 Hi, I=B4m really struggling with this. I have had a pool with imported filesyst= ems from a Solaris system that had dedup activated. Then, when the time cam= e to erase them, it just stalled. When rebooting, it stalled again at mount= ing filesystems, and since then, I=B4ve installed two USB drives to act as = root pool with FreeBSD-9.0-RELEASE so that I could import the original pool= in recovery, but it always stalls after a couple of hours. Looking at top,= I could see that the 16GB RAM was maxed out, so I have heavily tuned down = kmem, arc, etc: vm.kmem_size_max=3D"512M" vm.kmem_size=3D"384M" vfs.zfs.arc_max=3D"256M" And then I tried importing again, but with the same result; RAM reaches 16G= Wired, 0B Free and some swap allocated as well, and then it stalls. So I t= ried updating, so currently it=B4s at FreeBSD 9.1-BETA1 #0: Fri Jul 13 22:3= 6:05 CEST 2012, but still no go, it still stalls when I try importing, even= like: # zpool import -f -F -m pool1 In the link is a screenshot of CTRL+T after it stalled the last time. http://i46.tinypic.com/jhdgrq.png There is about 4TB in there that I really need. Please help, I=B4m out of i= deas, and stupid enough not to have gotten it backed up yet. Best Regards ---------------------------------------------------------------------------= ---- Karli Sj=F6berg Swedish University of Agricultural Sciences Box 7079 (Visiting Address Kron=E5sv=E4gen 8) S-750 07 Uppsala, Sweden Phone: +46-(0)18-67 15 66 karli.sjoberg@slu.se From owner-freebsd-fs@FreeBSD.ORG Tue Jul 31 07:28:17 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 53711106566C for ; Tue, 31 Jul 2012 07:28:17 +0000 (UTC) (envelope-from peter.maloney@brockmann-consult.de) Received: from moutng.kundenserver.de (moutng.kundenserver.de [212.227.126.186]) by mx1.freebsd.org (Postfix) with ESMTP id C010E8FC15 for ; Tue, 31 Jul 2012 07:28:16 +0000 (UTC) Received: from [10.3.0.26] ([141.4.215.32]) by mrelayeu.kundenserver.de (node=mreu0) with ESMTP (Nemesis) id 0MKuxg-1Sw6sE1TdY-00019Q; Tue, 31 Jul 2012 09:28:10 +0200 Message-ID: <50178909.2020502@brockmann-consult.de> Date: Tue, 31 Jul 2012 09:28:09 +0200 From: Peter Maloney User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:12.0) Gecko/20120421 Thunderbird/12.0 MIME-Version: 1.0 To: freebsd-fs@freebsd.org References: In-Reply-To: X-Enigmail-Version: 1.4.2 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit X-Provags-ID: V02:K0:7HGDdJDvdMi6eDmFINzWENc5bOcfUvDkiK76C1Bxq75 LpnWJsgMTh4E/euKYGYh2bZMp51McPmF7WcCS92FGktZDIdczl M/m+kNIgtqSKR+jhR5J0A7oV0yrzLqZjpbwseP+B3aAByZTEKb fLaEriC0I9IZfjIte3yHOvwPrk0aiqA/S2vBilQXhFsa/qFN+l hM8ypG5J+9xkdJp2awjqRIGYLeI0wbaGHdlw/C0pStHF0v72kW Ndefx1Y6uP6chqKUpE8bRoUnzyszUtH98dyICYHUvPgvY35aTf tFN9XKfSqyEI0MjEhw0I88e6YFXsvEunqWoY7bieB4p9uS8a+F kAsWj+NyqUi6XnignFC/9KB2/b6UiKArTbls7ANTM Subject: Re: Hang when importing pool X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 31 Jul 2012 07:28:17 -0000 Does it import in Solaris? On 07/31/2012 08:31 AM, Karli Sjöberg wrote: > Hi, > > I´m really struggling with this. I have had a pool with imported filesystems from a Solaris system that had dedup activated. Then, when the time came to erase them, it just stalled. When rebooting, it stalled again at mounting filesystems, and since then, I´ve installed two USB drives to act as root pool with FreeBSD-9.0-RELEASE so that I could import the original pool in recovery, but it always stalls after a couple of hours. Looking at top, I could see that the 16GB RAM was maxed out, so I have heavily tuned down kmem, arc, etc: > > vm.kmem_size_max="512M" > vm.kmem_size="384M" > vfs.zfs.arc_max="256M" > > And then I tried importing again, but with the same result; RAM reaches 16G Wired, 0B Free and some swap allocated as well, and then it stalls. So I tried updating, so currently it´s at FreeBSD 9.1-BETA1 #0: Fri Jul 13 22:36:05 CEST 2012, but still no go, it still stalls when I try importing, even like: > > # zpool import -f -F -m pool1 > > In the link is a screenshot of CTRL+T after it stalled the last time. > http://i46.tinypic.com/jhdgrq.png > > There is about 4TB in there that I really need. Please help, I´m out of ideas, and stupid enough not to have gotten it backed up yet. > > > Best Regards > ------------------------------------------------------------------------------- > Karli Sjöberg > Swedish University of Agricultural Sciences > Box 7079 (Visiting Address Kronåsvägen 8) > S-750 07 Uppsala, Sweden > Phone: +46-(0)18-67 15 66 > karli.sjoberg@slu.se > > _______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" -- -------------------------------------------- Peter Maloney Brockmann Consult Max-Planck-Str. 2 21502 Geesthacht Germany Tel: +49 4152 889 300 Fax: +49 4152 889 333 E-mail: peter.maloney@brockmann-consult.de Internet: http://www.brockmann-consult.de -------------------------------------------- From owner-freebsd-fs@FreeBSD.ORG Tue Jul 31 13:34:39 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id A6EEE106564A for ; Tue, 31 Jul 2012 13:34:39 +0000 (UTC) (envelope-from kasper@cabo.dk) Received: from zmta01.irigo.dk (zmta01.irigo.dk [193.200.44.52]) by mx1.freebsd.org (Postfix) with ESMTP id 0A7D78FC0A for ; Tue, 31 Jul 2012 13:34:38 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by zmta01.irigo.dk (Postfix) with ESMTP id 403DE25045B9 for ; Tue, 31 Jul 2012 15:28:10 +0200 (CEST) X-Virus-Scanned: amavisd-new at zmta01.irigo.dk Received: from zmta01.irigo.dk ([127.0.0.1]) by localhost (zmta01.irigo.dk [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id HmY3CG0zo1Nh for ; Tue, 31 Jul 2012 15:27:58 +0200 (CEST) Received: from zmbox01.irigo.dk (zmbox01.cabocomm.dk [193.200.44.55]) by zmta01.irigo.dk (Postfix) with ESMTP id 638D025045B3 for ; Tue, 31 Jul 2012 15:27:58 +0200 (CEST) Date: Tue, 31 Jul 2012 15:27:57 +0200 (CEST) From: Kasper Sacharias Eenberg To: freebsd-fs@freebsd.org Message-ID: <29509988.197565.1343741277744.JavaMail.root@zmbox01> In-Reply-To: <20759432.197480.1343738543702.JavaMail.root@zmbox01> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [195.41.32.80] X-Mailer: Zimbra 6.0.10_GA_2692 (ZimbraWebClient - FF3.0 (Linux)/6.0.10_GA_2692) Subject: Kernel panick 'vm_map_entry_create' when copying to ZFS volume shared over NFS. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 31 Jul 2012 13:34:39 -0000 Problem: On copying files from vmware sphere client to a FreeBSD NFS shared ZFS volume, I get the unwanted error 'vm_map_entry_create'. A screenshot of the KVM viewer displaying the error can be found here: http://i.imgur.com/T1AnZ.jpg I can't really go into detail about how the copying is done, but it shouldn't matter. The problem is reproducible, it's happened 3 times so far. I'm about to test with and even lower vfs.zfs.arc_max, since it happens at about 14->15 GB arc_size, I've also removed the log-ssd, which is the device reset warning in the screenshot. I encountered the same error. Having to tune arc_max manually to get a working system seems quite silly. (If it works..) The harddrives are 7 OCZ Vertex4 SSD's, in raidz. The log drive is of the same type. Sorry about the length of the mail, I've added all I though might help. The system logs contain nothing. Does anyone have any input? Software: FreeBSD 9.0-RELEASE with added Intel ixgbe-2.4.4 driver module loaded (and used). ZFS volume information NAME PROPERTY VALUE pool-ssd/data001 type filesystem pool-ssd/data001 creation Tue Jun 19 10:04 2012 pool-ssd/data001 used 99.9G pool-ssd/data001 available 2.63T pool-ssd/data001 referenced 35.8G pool-ssd/data001 compressratio 1.54x pool-ssd/data001 mounted yes pool-ssd/data001 quota none pool-ssd/data001 reservation none pool-ssd/data001 recordsize 8K pool-ssd/data001 mountpoint /pool-ssd/data001 pool-ssd/data001 sharenfs -mapall=root -network -mask 255.255.255.0 pool-ssd/data001 checksum on pool-ssd/data001 compression lzjb pool-ssd/data001 atime off pool-ssd/data001 devices on pool-ssd/data001 exec on pool-ssd/data001 setuid on pool-ssd/data001 readonly off pool-ssd/data001 jailed off pool-ssd/data001 snapdir hidden pool-ssd/data001 aclmode discard pool-ssd/data001 aclinherit restricted pool-ssd/data001 canmount on pool-ssd/data001 xattr off pool-ssd/data001 copies 1 pool-ssd/data001 version 5 pool-ssd/data001 utf8only off pool-ssd/data001 normalization none pool-ssd/data001 casesensitivity sensitive pool-ssd/data001 vscan off pool-ssd/data001 nbmand off pool-ssd/data001 sharesmb off pool-ssd/data001 refquota none pool-ssd/data001 refreservation none pool-ssd/data001 primarycache all pool-ssd/data001 secondarycache all pool-ssd/data001 usedbysnapshots 64.1G pool-ssd/data001 usedbydataset 35.8G pool-ssd/data001 usedbychildren 0 pool-ssd/data001 usedbyrefreservation 0 pool-ssd/data001 logbias latency pool-ssd/data001 dedup off pool-ssd/data001 mlslabel pool-ssd/data001 sync standard pool-ssd/data001 refcompressratio 1.25x A second before the crash: ------------------------------------------------------------------------ ZFS Subsystem ReportTue Jul 31 13:58:34 2012 ------------------------------------------------------------------------ System Memory: 0.13%30.15MiB Active,0.02%5.82MiB Inact 67.53%15.69GiB Wired,0.00%520.00KiB Cache 32.31%7.51GiB Free,0.00%404.00KiB Gap Real Installed:24.00GiB Real Available:99.88%23.97GiB Real Managed:96.94%23.24GiB Logical Total:24.00GiB Logical Used:68.69%16.49GiB Logical Free:31.31%7.51GiB Kernel Memory:13.26GiB Data:99.85%13.24GiB Text:0.15%20.09MiB Kernel Memory Map:20.24GiB Size:65.31%13.22GiB Free:34.69%7.02GiB ------------------------------------------------------------------------ ARC Summary: (HEALTHY) Memory Throttle Count:0 ARC Misc: Deleted:15 Recycle Misses:0 Mutex Misses:0 Evict Skips:0 ARC Size:62.93%13.99GiB Target Size: (Adaptive)100.00%22.24GiB Min Size (Hard Limit):12.50%2.78GiB Max Size (High Water):8:122.24GiB ARC Size Breakdown: Recently Used Cache Size:58.97%13.11GiB Frequently Used Cache Size:41.03%9.12GiB ARC Hash Breakdown: Elements Max:1.70m Elements Current:100.00%1.70m Collisions:1.20m Chain Max:14 Chains:439.54k ------------------------------------------------------------------------ A second before the crash: ------------------------------------------------------------------------ ZFS Subsystem ReportTue Jul 31 14:40:26 2012 ------------------------------------------------------------------------ System Memory: 0.12%28.21MiB Active,0.02%5.27MiB Inact 69.62%16.18GiB Wired,0.00%40.00KiB Cache 30.24%7.03GiB Free,0.00%444.00KiB Gap Real Installed:24.00GiB Real Available:99.88%23.97GiB Real Managed:96.94%23.24GiB Logical Total:24.00GiB Logical Used:70.70%16.97GiB Logical Free:29.30%7.03GiB Kernel Memory:13.70GiB Data:99.86%13.69GiB Text:0.14%20.09MiB Kernel Memory Map:20.19GiB Size:67.65%13.66GiB Free:32.35%6.53GiB ------------------------------------------------------------------------ ARC Summary: (HEALTHY) Memory Throttle Count:0 ARC Misc: Deleted:15 Recycle Misses:0 Mutex Misses:0 Evict Skips:0 ARC Size:96.34%14.45GiB Target Size: (Adaptive)100.00%15.00GiB Min Size (Hard Limit):12.50%1.88GiB Max Size (High Water):8:115.00GiB ARC Size Breakdown: Recently Used Cache Size:89.54%13.43GiB Frequently Used Cache Size:10.46%1.57GiB ARC Hash Breakdown: Elements Max:1.74m Elements Current:100.00%1.74m Collisions:1.24m Chain Max:14 Chains:443.12k ------------------------------------------------------------------------ /boot/loader.conf --------------------- ahci_load="yes" zfs_load="YES" if_vlan_load="YES" vfs.root.mountfrom="zfs:zroot" ixgbe_load="YES" boot_multicons="YES" boot_serial="YES" comconsole_speed="115200" console="comconsole,vidconsole" hw.igb.rxd="4096" hw.igb.txd="4096" kern.ipc.nmbclusters="262144" kern.ipc.nmbjumbop="262144" # Disable ZFS prefetching # http://southbrain.com/south/2008/04/the-nightmare-comes-slowly-zfs.html # Increases overall speed of ZFS, but when disk flushing/writes occur, # system is less responsive (due to extreme disk I/O). # NOTE: 8.0-RC1 disables this by default on systems <= 4GB RAM anyway vfs.zfs.prefetch_disable="1" # Disable UMA (uma(9)) for ZFS; amd64 was moved to exclusively use UMA # on 2010/05/24. # http://lists.freebsd.org/pipermail/freebsd-stable/2010-June/057162.html #vfs.zfs.zio.use_uma="0" # Decrease ZFS txg timeout value from 30 (default) to 5 seconds. This # should increase throughput and decrease the "bursty" stalls that # happen during immense I/O with ZFS. # http://lists.freebsd.org/pipermail/freebsd-fs/2009-December/007343.html # http://lists.freebsd.org/pipermail/freebsd-fs/2009-December/007355.html vfs.zfs.txg.timeout="5" # Below was added to test whether limiting arc memory worked. vfs.zfs.arc_max="15G" --------------------- Kind regards / Med venlig hilsen Kasper Sacharias Eenberg Cabo A/S Klosterport 4a, 4. sal 8000 Aarhus C From owner-freebsd-fs@FreeBSD.ORG Tue Jul 31 13:41:32 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9BF8F106566B for ; Tue, 31 Jul 2012 13:41:32 +0000 (UTC) (envelope-from bfriesen@simple.dallas.tx.us) Received: from blade.simplesystems.org (blade.simplesystems.org [65.66.246.74]) by mx1.freebsd.org (Postfix) with ESMTP id 5A3738FC16 for ; Tue, 31 Jul 2012 13:41:32 +0000 (UTC) Received: from freddy.simplesystems.org (freddy.simplesystems.org [65.66.246.65]) by blade.simplesystems.org (8.14.4+Sun/8.14.4) with ESMTP id q6VDXxMZ009170; Tue, 31 Jul 2012 08:33:59 -0500 (CDT) Date: Tue, 31 Jul 2012 08:33:59 -0500 (CDT) From: Bob Friesenhahn X-X-Sender: bfriesen@freddy.simplesystems.org To: =?ISO-8859-15?Q?Karli_Sj=F6berg?= In-Reply-To: Message-ID: References: User-Agent: Alpine 2.01 (GSO 1266 2009-07-14) MIME-Version: 1.0 Content-Type: MULTIPART/MIXED; BOUNDARY="-559023410-424528793-1343741639=:27589" X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.2 (blade.simplesystems.org [65.66.246.90]); Tue, 31 Jul 2012 08:33:59 -0500 (CDT) Cc: "freebsd-fs@freebsd.org" Subject: Re: Hang when importing pool X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 31 Jul 2012 13:41:32 -0000 This message is in MIME format. The first part should be readable text, while the remaining parts are likely unreadable without MIME-aware tools. ---559023410-424528793-1343741639=:27589 Content-Type: TEXT/PLAIN; charset=iso-8859-1; format=flowed Content-Transfer-Encoding: 8BIT On Tue, 31 Jul 2012, Karli Sjöberg wrote: > Hi, > > I´m really struggling with this. I have had a pool with imported > filesystems from a Solaris system that had dedup activated. Then, > when the time came to erase them, it just stalled. When rebooting, > it stalled again at mounting filesystems, and since then, I´ve > installed two USB drives to act as root pool with > FreeBSD-9.0-RELEASE so that I could import the original pool in > recovery, but it always stalls after a couple of hours. Looking at > top, I could see that the 16GB RAM was maxed out, so I have heavily > tuned down kmem, arc, etc: I think that you will need to find some way to temporarily add a dedicated L2ARC device (preferably an SSD or maybe iSCSI to a LUN on a machine with huge memory) or to find a machine with a lot more RAM. Bob -- Bob Friesenhahn bfriesen@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/ GraphicsMagick Maintainer, http://www.GraphicsMagick.org/ ---559023410-424528793-1343741639=:27589-- From owner-freebsd-fs@FreeBSD.ORG Tue Jul 31 14:25:52 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 1194F106564A for ; Tue, 31 Jul 2012 14:25:52 +0000 (UTC) (envelope-from freebsd@knarf.de) Received: from mail.server-king.de (mail.server-king.de [IPv6:2a01:4f8:100:41a2::25]) by mx1.freebsd.org (Postfix) with ESMTP id 90F898FC08 for ; Tue, 31 Jul 2012 14:25:51 +0000 (UTC) Received: from cheese.server-king.de (localhost [127.0.0.1]) by mail.server-king.de (8.14.5/8.14.5) with ESMTP id q6VEPoSZ025606 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Tue, 31 Jul 2012 16:25:50 +0200 (CEST) (envelope-from freebsd@knarf.de) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=knarf.de; s=mail.server-king.de; t=1343744750; bh=/hmTMxf2NfFDzrF7HTwy0Yz6nc6cRLU1K9ZFMo51+fw=; h=Date:From:To:Cc:Subject:References:In-Reply-To; b=Meqz9vF3OYNAY9n6f/tx5Sl2aZFFR2eJpeTdnni4v9khVnDG4Hz1QqUV5tJSZ7G4g vs04CZ/7UK/GaCgZaYBCJrSU7OonAlySeuDS+GjdHm1FCPUpTALLKAKPf0pCvc++CX 0S439AOmW2kSL5HnjtDafKySuqb9zqrp+3Y/n4Zk= Received: (from knarf@localhost) by cheese.server-king.de (8.14.5/8.14.5/Submit) id q6VEPo7f025605; Tue, 31 Jul 2012 16:25:50 +0200 (CEST) (envelope-from freebsd@knarf.de) X-Authentication-Warning: cheese.server-king.de: knarf set sender to freebsd@knarf.de using -f Date: Tue, 31 Jul 2012 16:25:50 +0200 From: Frank Bartels To: Karli =?iso-8859-15?Q?Sj=F6berg?= Message-ID: <20120731142549.GA8138@server-king.de> References: MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-15 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.2.7 (mail.server-king.de [127.0.0.1]); Tue, 31 Jul 2012 16:25:50 +0200 (CEST) Cc: "freebsd-fs@freebsd.org" Subject: Re: Hang when importing pool X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 31 Jul 2012 14:25:52 -0000 Hi, I had a very similar problem three times before. The last time I was able to find a working solution: 0. Add more RAM. 1. Use zdb -h -e pool and find out the *last* good looking txg before the current txg. 2. zpool import -T txg -R /pool -o readonly=on pool 2.1. if this does not work, try older txg 3. Backup your data. 4. Recreate the pool (undo old mistakes, use gpt labels and proper alignment) 5. Keep dedup=off if you have only 16 GB RAM. 6. Restore your data. This is a very short description, but I think you get the idea. Hope this helps, Knarf On Tue, Jul 31, 2012 at 08:31:07 +0200, Karli Sjöberg wrote: > Hi, > > I?m really struggling with this. I have had a pool with imported filesystems from a Solaris system that had dedup activated. Then, when the time came to erase them, it just stalled. When rebooting, it stalled again at mounting filesystems, and since then, I?ve installed two USB drives to act as root pool with FreeBSD-9.0-RELEASE so that I could import the original pool in recovery, but it always stalls after a couple of hours. Looking at top, I could see that the 16GB RAM was maxed out, so I have heavily tuned down kmem, arc, etc: > > vm.kmem_size_max="512M" > vm.kmem_size="384M" > vfs.zfs.arc_max="256M" > > And then I tried importing again, but with the same result; RAM reaches 16G Wired, 0B Free and some swap allocated as well, and then it stalls. So I tried updating, so currently it?s at FreeBSD 9.1-BETA1 #0: Fri Jul 13 22:36:05 CEST 2012, but still no go, it still stalls when I try importing, even like: > > # zpool import -f -F -m pool1 > > In the link is a screenshot of CTRL+T after it stalled the last time. > http://i46.tinypic.com/jhdgrq.png > > There is about 4TB in there that I really need. Please help, I?m out of ideas, and stupid enough not to have gotten it backed up yet. > > > Best Regards > ------------------------------------------------------------------------------- > Karli Sjöberg > Swedish University of Agricultural Sciences > Box 7079 (Visiting Address Kronåsvägen 8) > S-750 07 Uppsala, Sweden > Phone: +46-(0)18-67 15 66 > karli.sjoberg@slu.se > > _______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" From owner-freebsd-fs@FreeBSD.ORG Tue Jul 31 15:31:35 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6CF941065673 for ; Tue, 31 Jul 2012 15:31:35 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from mail-lpp01m010-f54.google.com (mail-lpp01m010-f54.google.com [209.85.215.54]) by mx1.freebsd.org (Postfix) with ESMTP id 967DB8FC19 for ; Tue, 31 Jul 2012 15:31:34 +0000 (UTC) Received: by laai10 with SMTP id i10so4960424laa.13 for ; Tue, 31 Jul 2012 08:31:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=AiwsPqpLajDblmfwVZFmm4G9n6taFlr90WZyacFgnmw=; b=FSZCQVBSbSlI7725sM1i7q4945jGTSRMqkt95NspbxZE274hxxSrIRC4szJvY6uqN7 gx64/tqrGOJVHcrCqNQcZttCn16p0eQjzs0J52v9jUXcMddlRmF2qyDHdnrMNPedNltu neak7zChqv8Y9gbpGnu0GkQEkPLpIRcxWyMuon3zSHQ9br/J8Gyxwcqd7HLr5lK9TbUx Z/u+5zzWm4acvV6BgRuFejd5YWgtH6R5pWt5mrn51jwOqPHkpZSP/M1SaHY4G9EMTOXj dtIgPkPLXlMMbVYsUjWscBfd99sUoZmwQ830xQ9cc0HMPpJu8jbGrEI9uwULFWf5h6P0 CSPA== MIME-Version: 1.0 Received: by 10.112.82.165 with SMTP id j5mr6930928lby.50.1343748693354; Tue, 31 Jul 2012 08:31:33 -0700 (PDT) Received: by 10.114.37.74 with HTTP; Tue, 31 Jul 2012 08:31:33 -0700 (PDT) In-Reply-To: References: Date: Tue, 31 Jul 2012 08:31:33 -0700 Message-ID: From: Freddie Cash To: =?UTF-8?Q?Karli_Sj=C3=B6berg?= Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: "freebsd-fs@freebsd.org" Subject: Re: Hang when importing pool X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 31 Jul 2012 15:31:35 -0000 On Mon, Jul 30, 2012 at 11:31 PM, Karli Sj=C3=B6berg = wrote: > I=C2=B4m really struggling with this. I have had a pool with imported fil= esystems from a Solaris system that had dedup activated. Then, when the tim= e came to erase them, it just stalled. When rebooting, it stalled again at = mounting filesystems, and since then, I=C2=B4ve installed two USB drives to= act as root pool with FreeBSD-9.0-RELEASE so that I could import the origi= nal pool in recovery, but it always stalls after a couple of hours. Looking= at top, I could see that the 16GB RAM was maxed out, so I have heavily tun= ed down kmem, arc, etc: You're running out of RAM during the import, as it loads the DDT. Stuff a bunch more RAM into the machine (32 GB, 48 GB, even 64 GB). Then you will be able to load the full DDT into RAM, finish the aborted destroy process, and import the pool. We've run into this three or four times now on systems with dedupe enabled and only 16 GB of RAM. We've since upgraded all our boxes to a minimum of 32 GB, with one having 64 GB. ZFS dataset destruction with dedupe enabled takes *a lot* of time and RAM, as the DDT needs to be updated for every block freed. And rebooting in the middle of a "zfs destroy" operation means that the operation needs to finish at pool import time. --=20 Freddie Cash fjwcash@gmail.com From owner-freebsd-fs@FreeBSD.ORG Wed Aug 1 05:25:00 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4A2C71065672 for ; Wed, 1 Aug 2012 05:25:00 +0000 (UTC) (envelope-from Karli.Sjoberg@slu.se) Received: from Exchange1.ad.slu.se (exchange1.ad.slu.se [193.10.100.94]) by mx1.freebsd.org (Postfix) with ESMTP id BD6C58FC0C for ; Wed, 1 Aug 2012 05:24:59 +0000 (UTC) Received: from exmbx3.ad.slu.se ([193.10.100.93]) by Exchange1.ad.slu.se ([193.10.100.94]) with mapi; Wed, 1 Aug 2012 07:23:47 +0200 From: =?iso-8859-1?Q?Karli_Sj=F6berg?= To: Bob Friesenhahn Date: Wed, 1 Aug 2012 07:23:45 +0200 Thread-Topic: Hang when importing pool Thread-Index: Ac1vpdK+ByBdgswYQr2ytqlVOuu/kw== Message-ID: <17F43D74-958A-4AA7-9157-922397D80FC8@slu.se> References: In-Reply-To: Accept-Language: sv-SE, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: sv-SE, en-US MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: "freebsd-fs@freebsd.org" Subject: Re: Hang when importing pool X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Aug 2012 05:25:00 -0000 31 jul 2012 kl. 15.33 skrev Bob Friesenhahn: On Tue, 31 Jul 2012, Karli Sj=F6berg wrote: Hi, I=B4m really struggling with this. I have had a pool with imported filesystems from a Solaris system that had dedup activated. Then, when the time came to erase them, it just stalled. When rebooting, it stalled again at mounting filesystems, and since then, I=B4ve installed two USB drives to act as root pool with FreeBSD-9.0-RELEASE so that I could import the original pool in recovery, but it always stalls after a couple of hours. Looking at top, I could see that the 16GB RAM was maxed out, so I have heavily tuned down kmem, arc, etc: I think that you will need to find some way to temporarily add a dedicated L2ARC device (preferably an SSD or maybe iSCSI to a LUN on a machine with huge memory) or to find a machine with a lot more RAM. I already had a cache device added to the pool I wanted to import, but now = I understand it needed to be on the pool that was doing the actual importin= g, so I delete the one, big partition and split it into three. So the pool = I want to have imported has a 32G partition, which it has added as L2ARC. T= he pool that=B4s doing the importing has a 32G part added as swap, and the = remaining 160G added as L2ARC. From a Vertex 3 240G MLC I know performance = of the SSD isn=B4t an issue. Bob -- Bob Friesenhahn bfriesen@simple.dallas.tx.us, http://w= ww.simplesystems.org/users/bfriesen/ GraphicsMagick Maintainer, http://www.GraphicsMagick.org/ Med V=E4nliga H=E4lsningar ---------------------------------------------------------------------------= ---- Karli Sj=F6berg Swedish University of Agricultural Sciences Box 7079 (Visiting Address Kron=E5sv=E4gen 8) S-750 07 Uppsala, Sweden Phone: +46-(0)18-67 15 66 karli.sjoberg@slu.se From owner-freebsd-fs@FreeBSD.ORG Wed Aug 1 05:34:30 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1254610657BB for ; Wed, 1 Aug 2012 05:34:30 +0000 (UTC) (envelope-from Karli.Sjoberg@slu.se) Received: from Exchange1.ad.slu.se (exchange1.ad.slu.se [193.10.100.94]) by mx1.freebsd.org (Postfix) with ESMTP id 692F68FC1B for ; Wed, 1 Aug 2012 05:34:29 +0000 (UTC) Received: from exmbx3.ad.slu.se ([193.10.100.93]) by Exchange1.ad.slu.se ([193.10.100.94]) with mapi; Wed, 1 Aug 2012 07:34:28 +0200 From: =?iso-8859-1?Q?Karli_Sj=F6berg?= To: Frank Bartels Date: Wed, 1 Aug 2012 07:34:27 +0200 Thread-Topic: Hang when importing pool Thread-Index: Ac1vp1GfSw0tQIuQSS+7trQO6QavAA== Message-ID: References: <20120731142549.GA8138@server-king.de> In-Reply-To: <20120731142549.GA8138@server-king.de> Accept-Language: sv-SE, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: sv-SE, en-US MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: "freebsd-fs@freebsd.org" Subject: Re: Hang when importing pool X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Aug 2012 05:34:30 -0000 31 jul 2012 kl. 16.25 skrev Frank Bartels: Hi, I had a very similar problem three times before. The last time I was able to find a working solution: 0. Add more RAM. Can=B4t with the Core i5. Would have to scramble up a Xeon to push in 32G b= uffered. Will try leveraging with cache device before trying that. 1. Use zdb -h -e pool and find out the *last* good looking txg before the current txg. 2. zpool import -T txg -R /pool -o readonly=3Don pool Finding txg=B4s looks "scary", hadn=B4t thought about readonly though, than= ks. 2.1. if this does not work, try older txg 3. Backup your data. Oh the irony. Yes, that was actually what I was going to do just after dest= roying those datasets. Have had the backup server just waiting for them all= along:) 4. Recreate the pool (undo old mistakes, use gpt labels and proper alignmen= t) Yeah, I figure recreating and then recv=B4ing the datasets back in again. 5. Keep dedup=3Doff if you have only 16 GB RAM. Never wanted to have it active in the first place, so I agree. 6. Restore your data. This is a very short description, but I think you get the idea. Hope this helps, Knarf On Tue, Jul 31, 2012 at 08:31:07 +0200, Karli Sj=F6berg wrote: Hi, I?m really struggling with this. I have had a pool with imported filesystem= s from a Solaris system that had dedup activated. Then, when the time came = to erase them, it just stalled. When rebooting, it stalled again at mountin= g filesystems, and since then, I?ve installed two USB drives to act as root= pool with FreeBSD-9.0-RELEASE so that I could import the original pool in = recovery, but it always stalls after a couple of hours. Looking at top, I c= ould see that the 16GB RAM was maxed out, so I have heavily tuned down kmem= , arc, etc: vm.kmem_size_max=3D"512M" vm.kmem_size=3D"384M" vfs.zfs.arc_max=3D"256M" And then I tried importing again, but with the same result; RAM reaches 16G= Wired, 0B Free and some swap allocated as well, and then it stalls. So I t= ried updating, so currently it?s at FreeBSD 9.1-BETA1 #0: Fri Jul 13 22:36:= 05 CEST 2012, but still no go, it still stalls when I try importing, even l= ike: # zpool import -f -F -m pool1 In the link is a screenshot of CTRL+T after it stalled the last time. http://i46.tinypic.com/jhdgrq.png There is about 4TB in there that I really need. Please help, I?m out of ide= as, and stupid enough not to have gotten it backed up yet. Best Regards ---------------------------------------------------------------------------= ---- Karli Sj=F6berg Swedish University of Agricultural Sciences Box 7079 (Visiting Address Kron=E5sv=E4gen 8) S-750 07 Uppsala, Sweden Phone: +46-(0)18-67 15 66 karli.sjoberg@slu.se _______________________________________________ freebsd-fs@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-fs To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" Med V=E4nliga H=E4lsningar ---------------------------------------------------------------------------= ---- Karli Sj=F6berg Swedish University of Agricultural Sciences Box 7079 (Visiting Address Kron=E5sv=E4gen 8) S-750 07 Uppsala, Sweden Phone: +46-(0)18-67 15 66 karli.sjoberg@slu.se From owner-freebsd-fs@FreeBSD.ORG Wed Aug 1 08:31:11 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id DC611106564A for ; Wed, 1 Aug 2012 08:31:11 +0000 (UTC) (envelope-from freebsd@knarf.de) Received: from mail.server-king.de (mail.server-king.de [IPv6:2a01:4f8:100:41a2::25]) by mx1.freebsd.org (Postfix) with ESMTP id 1D1978FC0A for ; Wed, 1 Aug 2012 08:31:10 +0000 (UTC) Received: from cheese.server-king.de (localhost [127.0.0.1]) by mail.server-king.de (8.14.5/8.14.5) with ESMTP id q718V9fB037254 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Wed, 1 Aug 2012 10:31:09 +0200 (CEST) (envelope-from freebsd@knarf.de) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=knarf.de; s=mail.server-king.de; t=1343809869; bh=zZQrkXHibs0ETwU4tWmg4LIgYOqIqOWgmvUeUZo2Yy4=; h=Date:From:To:Cc:Subject:References:In-Reply-To; b=QYGyzv6PTZgC8WtWFS33HvP9YCOCYEYGe3xR9sYuefTXks+XSH5iUOBJDKTIUhLm9 SbkSVSQmstZ/zi9TbP1eTosVck2prwmnXLnkBUfuAXL9DsEPjl271b5eTQ4ym/Hq9P QhssOQLPe/4Hj2oz7PMs6KzY/SaoynEcE8IINYm4= Received: (from knarf@localhost) by cheese.server-king.de (8.14.5/8.14.5/Submit) id q718V9rT037250; Wed, 1 Aug 2012 10:31:09 +0200 (CEST) (envelope-from freebsd@knarf.de) X-Authentication-Warning: cheese.server-king.de: knarf set sender to freebsd@knarf.de using -f Date: Wed, 1 Aug 2012 10:31:09 +0200 From: Frank Bartels To: Karli =?iso-8859-15?Q?Sj=F6berg?= Message-ID: <20120801083108.GB24251@server-king.de> References: <20120731142549.GA8138@server-king.de> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-15 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.2.7 (mail.server-king.de [127.0.0.1]); Wed, 01 Aug 2012 10:31:09 +0200 (CEST) Cc: "freebsd-fs@freebsd.org" Subject: Re: Hang when importing pool X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Aug 2012 08:31:12 -0000 Re, [ok, switching from quote to TOFU]. 0.: i5-2400 can handle 32 GB according to ark.intel.com. 2.: Choosing the last working txg should work automatically, but it does not work all the time. Especially f you have a crash during destroying zfs'. In my case it was always a conflict of zfs-snapshot-mgmnt and zfs destroy. 3.: Was meant to be done after 2.1 was successful. You should have about 20 or more txgs to try. Just have a look at the zdb -h (history) output. I did not want to be ironic, sorry. So you did already destroy everything? Bye, Knarf On Wed, Aug 01, 2012 at 07:34:27 +0200, Karli Sjöberg wrote: > > 31 jul 2012 kl. 16.25 skrev Frank Bartels: > > Hi, > > I had a very similar problem three times before. The last time I > was able to find a working solution: > > 0. Add more RAM. > > Can?t with the Core i5. Would have to scramble up a Xeon to push in 32G buffered. Will try leveraging with cache device before trying that. > > > 1. Use zdb -h -e pool and find out the *last* good looking txg > before the current txg. > 2. zpool import -T txg -R /pool -o readonly=on pool > > Finding txg?s looks "scary", hadn?t thought about readonly though, thanks. > > > 2.1. if this does not work, try older txg > 3. Backup your data. > > Oh the irony. Yes, that was actually what I was going to do just after destroying those datasets. Have had the backup server just waiting for them all along:) > > > 4. Recreate the pool (undo old mistakes, use gpt labels and proper alignment) > > Yeah, I figure recreating and then recv?ing the datasets back in again. > > > 5. Keep dedup=off if you have only 16 GB RAM. > > Never wanted to have it active in the first place, so I agree. > > > 6. Restore your data. > > This is a very short description, but I think you get the idea. > > Hope this helps, > Knarf > > On Tue, Jul 31, 2012 at 08:31:07 +0200, Karli Sjöberg wrote: > Hi, > > I?m really struggling with this. I have had a pool with imported filesystems from a Solaris system that had dedup activated. Then, when the time came to erase them, it just stalled. When rebooting, it stalled again at mounting filesystems, and since then, I?ve installed two USB drives to act as root pool with FreeBSD-9.0-RELEASE so that I could import the original pool in recovery, but it always stalls after a couple of hours. Looking at top, I could see that the 16GB RAM was maxed out, so I have heavily tuned down kmem, arc, etc: > > vm.kmem_size_max="512M" > vm.kmem_size="384M" > vfs.zfs.arc_max="256M" > > And then I tried importing again, but with the same result; RAM reaches 16G Wired, 0B Free and some swap allocated as well, and then it stalls. So I tried updating, so currently it?s at FreeBSD 9.1-BETA1 #0: Fri Jul 13 22:36:05 CEST 2012, but still no go, it still stalls when I try importing, even like: > > # zpool import -f -F -m pool1 > > In the link is a screenshot of CTRL+T after it stalled the last time. > http://i46.tinypic.com/jhdgrq.png > > There is about 4TB in there that I really need. Please help, I?m out of ideas, and stupid enough not to have gotten it backed up yet. > > > Best Regards > ------------------------------------------------------------------------------- > Karli Sjöberg > Swedish University of Agricultural Sciences > Box 7079 (Visiting Address Kronåsvägen 8) > S-750 07 Uppsala, Sweden > Phone: +46-(0)18-67 15 66 > karli.sjoberg@slu.se > > _______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > > > > Med Vänliga Hälsningar > ------------------------------------------------------------------------------- > Karli Sjöberg > Swedish University of Agricultural Sciences > Box 7079 (Visiting Address Kronåsvägen 8) > S-750 07 Uppsala, Sweden > Phone: +46-(0)18-67 15 66 > karli.sjoberg@slu.se > From owner-freebsd-fs@FreeBSD.ORG Wed Aug 1 14:15:24 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 683DE106564A for ; Wed, 1 Aug 2012 14:15:24 +0000 (UTC) (envelope-from andrey@zonov.org) Received: from mail-ee0-f54.google.com (mail-ee0-f54.google.com [74.125.83.54]) by mx1.freebsd.org (Postfix) with ESMTP id E1D808FC12 for ; Wed, 1 Aug 2012 14:15:23 +0000 (UTC) Received: by eeke52 with SMTP id e52so2035560eek.13 for ; Wed, 01 Aug 2012 07:15:22 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:subject :content-type:content-transfer-encoding:x-gm-message-state; bh=TXrDUDEPfWg2hcoZUFm5RtDF3VTSp6+jEYlZyfjrHPo=; b=AvocCvSSXnz+8pOdbOk1skLQdCba4lQ+Buvp9EWdAnbqaeUS3eXexqja6cpF3cz9xl mWBwl7NHsKLDQDtNmhBZ8ncMG/GQIeiaGvOsIFEdFKfjm/4xwsPIH4lTWtBG6VczpPfI TVCg38ubb7sfoO0aCO0y/AyDjN1NAGwJsrgcTh6wi4qwZZMyA6pXm8cSdZV0ui0TUomv ZRE6+g8bvn6zef1Z/ZjxIsNkUiAmwBdAyOzFa8EzjE27t//0mAT4LfinEW/ru0WS6wxu 01/MegKWrly+CkBW/+1hErLJGOpnuQv/ZOxlFVceLkd+mGVZZJULwPxu0d/Q2E9YPNFV TYsQ== Received: by 10.14.210.132 with SMTP id u4mr21972392eeo.6.1343830522668; Wed, 01 Aug 2012 07:15:22 -0700 (PDT) Received: from dhcp170-243-red.yandex.net ([2a02:6b8:0:401:ac75:9216:41ce:82d3]) by mx.google.com with ESMTPS id v5sm9292770eel.6.2012.08.01.07.15.21 (version=SSLv3 cipher=OTHER); Wed, 01 Aug 2012 07:15:22 -0700 (PDT) Message-ID: <501939F8.7070006@zonov.org> Date: Wed, 01 Aug 2012 18:15:20 +0400 From: Andrey Zonov User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:14.0) Gecko/20120713 Thunderbird/14.0 MIME-Version: 1.0 To: freebsd-fs@freebsd.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Gm-Message-State: ALoCoQnJ1WLpVAfLm9emV3sKmIu7OvT8ZqsWtafIEP/Pj+3OGoiufZ1yPJpbznUqqeLow0JyYycS Subject: remove check for SUJ_MAX from fsck_ffs(8) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Aug 2012 14:15:24 -0000 Hi, It's possible to set any size for SU journal not less than 4Mb with tunefs(8), but fsck_ffs(8) reports that it could not check such FS because "Invalid size". It seems that fsck_ffs should not check maximum size of journal. I suggest that patch: Index: sbin/fsck_ffs/suj.c =================================================================== --- sbin/fsck_ffs/suj.c (revision 238945) +++ sbin/fsck_ffs/suj.c (working copy) @@ -2383,7 +2383,7 @@ suj_verifyino(union dinode *ip) return (-1); } - if (DIP(ip, di_size) < SUJ_MIN || DIP(ip, di_size) > SUJ_MAX) { + if (DIP(ip, di_size) < SUJ_MIN) { printf("Invalid size %jd for journal inode %d\n", DIP(ip, di_size), sujino); return (-1); What do you think? -- Andrey Zonov From owner-freebsd-fs@FreeBSD.ORG Wed Aug 1 14:48:01 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4AFFD106564A for ; Wed, 1 Aug 2012 14:48:01 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from mail.zoral.com.ua (mx0.zoral.com.ua [91.193.166.200]) by mx1.freebsd.org (Postfix) with ESMTP id A47648FC18 for ; Wed, 1 Aug 2012 14:48:00 +0000 (UTC) Received: from skuns.kiev.zoral.com.ua (localhost [127.0.0.1]) by mail.zoral.com.ua (8.14.2/8.14.2) with ESMTP id q71Em6B9011383; Wed, 1 Aug 2012 17:48:06 +0300 (EEST) (envelope-from kostikbel@gmail.com) Received: from deviant.kiev.zoral.com.ua (kostik@localhost [127.0.0.1]) by deviant.kiev.zoral.com.ua (8.14.5/8.14.5) with ESMTP id q71ElrUa073367; Wed, 1 Aug 2012 17:47:53 +0300 (EEST) (envelope-from kostikbel@gmail.com) Received: (from kostik@localhost) by deviant.kiev.zoral.com.ua (8.14.5/8.14.5/Submit) id q71Elrxa073366; Wed, 1 Aug 2012 17:47:53 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: deviant.kiev.zoral.com.ua: kostik set sender to kostikbel@gmail.com using -f Date: Wed, 1 Aug 2012 17:47:53 +0300 From: Konstantin Belousov To: Andrey Zonov Message-ID: <20120801144753.GL2676@deviant.kiev.zoral.com.ua> References: <501939F8.7070006@zonov.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="gj73W9rg/nxJHvOF" Content-Disposition: inline In-Reply-To: <501939F8.7070006@zonov.org> User-Agent: Mutt/1.4.2.3i X-Virus-Scanned: clamav-milter 0.95.2 at skuns.kiev.zoral.com.ua X-Virus-Status: Clean X-Spam-Status: No, score=-4.0 required=5.0 tests=ALL_TRUSTED,AWL,BAYES_00 autolearn=ham version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on skuns.kiev.zoral.com.ua Cc: freebsd-fs@freebsd.org Subject: Re: remove check for SUJ_MAX from fsck_ffs(8) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Aug 2012 14:48:01 -0000 --gj73W9rg/nxJHvOF Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Aug 01, 2012 at 06:15:20PM +0400, Andrey Zonov wrote: > Hi, >=20 > It's possible to set any size for SU journal not less than 4Mb with=20 > tunefs(8), but fsck_ffs(8) reports that it could not check such FS=20 > because "Invalid size". It seems that fsck_ffs should not check maximum= =20 > size of journal. >=20 > I suggest that patch: >=20 > Index: sbin/fsck_ffs/suj.c > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > --- sbin/fsck_ffs/suj.c (revision 238945) > +++ sbin/fsck_ffs/suj.c (working copy) > @@ -2383,7 +2383,7 @@ suj_verifyino(union dinode *ip) > return (-1); > } >=20 > - if (DIP(ip, di_size) < SUJ_MIN || DIP(ip, di_size) > SUJ_MAX) { > + if (DIP(ip, di_size) < SUJ_MIN) { > printf("Invalid size %jd for journal inode %d\n", > DIP(ip, di_size), sujino); > return (-1); >=20 > What do you think? It seems to be right. SUJ_MAX enforcement is only in place if user did not supplied desired journal size, and there it is used to provide some sane defaults, not due to the operational limits. More important is that ffs_softdep.c:journal_mount(), only the check for the minimal journal size is executed. I will commit your change in several days unless really good reason would be found not to apply it. Thanks. --gj73W9rg/nxJHvOF Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.12 (FreeBSD) iEYEARECAAYFAlAZQZkACgkQC3+MBN1Mb4gjiACfZGOyEMvCRSI4Zy8hSOwg21lE /LQAnRmHQipZKwNUowfnF1ZVjnWU+ZYl =gaM0 -----END PGP SIGNATURE----- --gj73W9rg/nxJHvOF-- From owner-freebsd-fs@FreeBSD.ORG Thu Aug 2 04:54:15 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BE7FC1065675 for ; Thu, 2 Aug 2012 04:54:15 +0000 (UTC) (envelope-from pfg@freebsd.org) Received: from nm8-vm0.bullet.mail.sp2.yahoo.com (nm8-vm0.bullet.mail.sp2.yahoo.com [98.139.91.194]) by mx1.freebsd.org (Postfix) with SMTP id 879248FC1D for ; Thu, 2 Aug 2012 04:54:15 +0000 (UTC) Received: from [98.139.91.62] by nm8.bullet.mail.sp2.yahoo.com with NNFMP; 02 Aug 2012 04:54:09 -0000 Received: from [98.139.91.13] by tm2.bullet.mail.sp2.yahoo.com with NNFMP; 02 Aug 2012 04:53:09 -0000 Received: from [127.0.0.1] by omp1013.mail.sp2.yahoo.com with NNFMP; 02 Aug 2012 04:53:09 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 911074.82208.bm@omp1013.mail.sp2.yahoo.com Received: (qmail 56963 invoked by uid 60001); 2 Aug 2012 04:53:09 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1343883189; bh=FI9RQh4GHNn+/62Il3zYd5mrlo+yhCK641uvT0YdUY4=; h=X-YMail-OSG:Received:X-RocketYMMF:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type; b=MBrJ/aTZ0Vc2dRPh8YXJnR/YHminF98Ch2ROuLsKJ7JXuUoH2i5gG3GbRUA2IcmjYdkNxGFyarIKRdZTP0IrMM0sfsDQuVac0OF8K86dh32E4Bx6Ds7k01CbmGubAk0eq6PmtlxlJM8SecSTU75LYTI78JAdl+9F5v20X0BgKYM= X-YMail-OSG: TnX2V2YVM1kRbk65L81OARfyqqpfvQEBNHGquieuG1Nin7M e3AFixVkWij.f3Y221GmTxxleo5Og9f2mw3kzs9b7Q95KyYD2H6jz2lfl3_V _V1.kuH9dyWHvbYvEAlfU8EYqOkPGivjL00jiL3PQezZF4TcS4NbQZX_wakC JL8G4KyB_s_92Cw5R4twBR66dQS.vJIgQtwQ6jqI5isX4aVP37OcgrSmPOm3 R5VoSCyjqJMwqpoz.i6uPHYyuY3Bpgr0Qn5aQmmBt9b2M5nExatRtjwIXyG7 MH.Yz4tA.upiMtEg4Sce5DQWd8EeT93wjZG_2mAucG9lhzE60BTddj2yEZuA DUuWflAKCO7zWyTagzP6iP5JmBMeZwtw8XXhNIu2dQ0TkXb_pGhIAUtZPgac 6NPLCCjGrvGUxilfAEDpQCDRG9iKFpAmICxZ9IHxI6ugly1ST8QZmp_Y727V Pn9gXXx0EgyGKFRlDYbVJN.Oy5tZvXLGAmyiMOt1TNRA0xpqskw1QRW4gTz8 QLK4uDAlQZLQ7p26ekoS0dbPyFyOaD8yzO896kIy_pn7AnkKm7Q-- Received: from [200.118.157.7] by web113510.mail.gq1.yahoo.com via HTTP; Wed, 01 Aug 2012 21:53:09 PDT X-RocketYMMF: giffunip X-Mailer: YahooMailWebService/0.8.120.356233 References: <50064FB2.3020409@entel.upc.edu> Message-ID: <1343883189.38543.YahooMailNeo@web113510.mail.gq1.yahoo.com> Date: Wed, 1 Aug 2012 21:53:09 -0700 (PDT) From: Pedro Giffuni To: "attilio@FreeBSD.org" In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: FreeBSD FS , "freebsd-current@freebsd.org" Subject: Re: MPSAFE VFS -- List of upcoming actions X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Pedro Giffuni List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 02 Aug 2012 04:54:15 -0000 Hi;=0A=0AJust thought I'd share a link for the fuse-xfs project (for MacFUS= E);=0A=0A=A0http://sourceforge.net/projects/fusexfs/=0A=0AIt's read-only so= maybe it can be considered a feature compatible=0Areplacement=A0of=A0our k= ernel driver ;).=0A=0Acheers,=0A=0APedro.=0A=0Aps. I added it to the Wanted= Ports wiki so it won't be forgotten=0Atoo soon. From owner-freebsd-fs@FreeBSD.ORG Thu Aug 2 18:48:32 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D7927106564A for ; Thu, 2 Aug 2012 18:48:32 +0000 (UTC) (envelope-from bra@fsn.hu) Received: from people.fsn.hu (people.fsn.hu [195.228.252.137]) by mx1.freebsd.org (Postfix) with ESMTP id 7C8D78FC0C for ; Thu, 2 Aug 2012 18:48:32 +0000 (UTC) Received: by people.fsn.hu (Postfix, from userid 1001) id ED70DDE2D56; Thu, 2 Aug 2012 20:41:29 +0200 (CEST) X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.2 X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MF-ACE0E1EA [pR: 14.9538] X-CRM114-CacheID: sfid-20120802_20412_00FD67CC X-CRM114-Status: Good ( pR: 14.9538 ) X-DSPAM-Result: Whitelisted X-DSPAM-Processed: Thu Aug 2 20:41:29 2012 X-DSPAM-Confidence: 0.7009 X-DSPAM-Probability: 0.0000 X-DSPAM-Signature: 501ac9d9723861388317973 X-DSPAM-Factors: 27, From*Attila Nagy , 0.00010, FreeBSD, 0.00044, FreeBSD, 0.00044, bytes, 0.00322, FreeBSD+8, 0.00497, bug, 0.00513, bug, 0.00513, this?, 0.00547, which+may, 0.00683, command, 0.00779, null, 0.00779, the+machine, 0.00779, machines, 0.00779, metadata, 0.00779, User-Agent*i686, 0.00861, User-Agent*Linux+i686, 0.00961, see+a, 0.00990, controllers, 0.01000, Subject*part, 0.99000, Date*02+Aug, 0.99000, everything+was, 0.01000, RAID, 0.01000, SCSI, 0.01000, be+relevant, 0.01000, now+that, 0.99000, on+FreeBSD, 0.01000, X-Spambayes-Classification: ham; 0.00 Received: from [192.168.3.2] (japan.t-online.co.hu [195.228.243.99]) by people.fsn.hu (Postfix) with ESMTPSA id AC6BBDE2D4A for ; Thu, 2 Aug 2012 20:41:28 +0200 (CEST) Message-ID: <501AC9D6.6080409@fsn.hu> Date: Thu, 02 Aug 2012 20:41:26 +0200 From: Attila Nagy User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.23) Gecko/20090817 Thunderbird/2.0.0.23 Mnenhy/0.7.6.0 MIME-Version: 1.0 To: "freebsd-fs@freebsd.org" Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: ZFS thinks that a newly inserted emtpy disk is part of the pool X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 02 Aug 2012 18:48:32 -0000 Hi, What I do (did always on FreeBSD 8): - wait for a disk to malfunction (its SCSI device disappears) or when I know its bad (SMART info, checksum errors etc), pull it out from the enclosure - insert a new disk, straight from the shop (has a lot of null bytes on it) - zpool replace pool daX when the device comes up again This has previously resulted in zfs to resilver the replaced disk and everything was OK. We have switched those machines to 9 sometimes in the near past (r237433) and the above has changed. The disk disappears, gets physically replaced, reappears, and zpool replace says now that the disk is already part of the pool. I can even see a zfs signature on it with dd. After rebooting the machine, I can issue the zpool replace command without any problems, and zfs starts to rebuild its contents. (I have no dd-data from this state, sorry) Additional information which may be relevant: the drives are hooked up to Smart Array (ciss) controllers, and they are RAID 0 volumes (one logical drive per physical drive). I thought about a ciss firmware bug (caching the zfs metadata even after the disk has been replaced), but this is so weird, and should affect both FreeBSD 8 and 9. So from this I guess it's a FreeBSD bug, which I couldn't see on 8. Any ideas about what could cause this? From owner-freebsd-fs@FreeBSD.ORG Fri Aug 3 00:03:10 2012 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 9590E106564A for ; Fri, 3 Aug 2012 00:03:10 +0000 (UTC) (envelope-from attila.bogar@linguamatics.com) Received: from mail.linguamatics.com (mail.linguamatics.com [188.39.80.203]) by mx1.freebsd.org (Postfix) with ESMTP id 4CF0F8FC0C for ; Fri, 3 Aug 2012 00:03:09 +0000 (UTC) Received: from secure.linguamatics.com (guardian.linguamatics.com [10.252.2.1]) by mail.linguamatics.com (Postfix) with ESMTPS id 34D5EEFB44C for ; Fri, 3 Aug 2012 01:03:07 +0100 (BST) Received: from [10.252.2.234] (vpn.abogar.linguamatics.com [10.252.2.234]) by secure.linguamatics.com (Postfix) with ESMTP id 48EB28187 for ; Fri, 3 Aug 2012 01:11:12 +0100 (BST) Message-ID: <501B153A.4060408@linguamatics.com> Date: Fri, 03 Aug 2012 01:03:06 +0100 From: =?ISO-8859-1?Q?Attila_Bog=E1r?= User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:14.0) Gecko/20120714 Thunderbird/14.0 MIME-Version: 1.0 To: freebsd-fs@FreeBSD.org Content-Type: multipart/mixed; boundary="------------000301090200080809090802" X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: Subject: NFS I/O or permission denied errors X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 03 Aug 2012 00:03:10 -0000 This is a multi-part message in MIME format. --------------000301090200080809090802 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Hi, I have an nfs server called "server" in this scenario. This server is running 9.1-PRERELEASE and exports 70+ zfs datasets over NFSv3. I sent an email a month ago, that half of the krb5i mounts fails over tcp. I noticed, that with simple krb5 sec flavour fever of the mounts are failing. I expected, that with sec=sys none will fail. Unfortunately this is not the case. I can get a failed mount with sec=sys to within 2 minutes. See the attached bash script. Within 2 minutes I always get this: mount.nfs: prog 100003, trying vers=3, prot=6 mount.nfs: trying 10.1.2.3 prog 100003 vers 3 prot TCP port 2049 mount.nfs: prog 100005, trying vers=3, prot=6 mount.nfs: trying 10.1.2.3 prog 100005 vers 3 prot TCP port 719 mount.nfs: mount(2): Input/output error mount.nfs: mount system call failed As soon as I have some time, I'll hook a wireshark and see the trace, what's going on the wire. If you have any ideas how to approach this, please do not hesitate to tell me. Thanks, Attila --------------000301090200080809090802-- From owner-freebsd-fs@FreeBSD.ORG Fri Aug 3 12:21:09 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id EC13B106564A for ; Fri, 3 Aug 2012 12:21:08 +0000 (UTC) (envelope-from attila.bogar@linguamatics.com) Received: from mail.linguamatics.com (mail.linguamatics.com [188.39.80.203]) by mx1.freebsd.org (Postfix) with ESMTP id 6CC788FC16 for ; Fri, 3 Aug 2012 12:21:08 +0000 (UTC) Received: from [10.252.10.232] (random.linguamatics.com [10.252.10.232]) by mail.linguamatics.com (Postfix) with ESMTPSA id 44F98EFB44C for ; Fri, 3 Aug 2012 13:21:07 +0100 (BST) Message-ID: <501BC236.4030607@linguamatics.com> Date: Fri, 03 Aug 2012 13:21:10 +0100 From: =?ISO-8859-1?Q?Attila_Bog=E1r?= User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:14.0) Gecko/20120714 Thunderbird/14.0 MIME-Version: 1.0 To: freebsd-fs@freebsd.org References: <501B153A.4060408@linguamatics.com> In-Reply-To: <501B153A.4060408@linguamatics.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: Re: NFS I/O or permission denied errors X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 03 Aug 2012 12:21:09 -0000 On 03/08/12 01:03, Attila Bogár wrote: > See the attached bash script. Sorry, my script has been stripped off by the list. It's nothing rocket science, takes an export list from a file (/root/fs.txt) and mounts the nfs shares in a loop. -- 8< -- #!/bin/bash sleepmount=0.33 function mount.all() { set -e j=0 while read fs do echo mounting $fs sleep $sleepmount mount -t nfs -v -o sec=sys,vers=3,proto=tcp server:$fs /mnt/$j sleep $sleepmount umount -f /mnt/$j j=$[j+1] done < /root/fs.txt set +e } function umount.all() { umount -f /mnt/* &>/dev/null } fsno="$(wc -l /root/fs.txt|cut -d' ' -f1)" umount.all i=0;while [ $i -lt $fsno ]; do echo $i; mkdir /mnt/$i ; i=$[i+1]; done i=0 while [ $i -lt 1000 ] do i=$[i+1] echo "RUN: $i" | tee /tmp/nfstest.status mount.all done -- 8< -- sec=sys,vers=3,proto=udp seems stable, tcp gets an I/O error within 2-3 minutes. I'm testing this from an up to date CentOS 6.3 nfs client. I suspicious about the network stack. I tried turning off msi and TSO on the bce card, but no change yet. I also took down my lagg interface and tried the onboard single bce, no change. This gentleman had a similar problem with nfsv4 but he got no hint from the list: http://lists.freebsd.org/pipermail/freebsd-stable/2012-June/068658.html Can someone reproduce the problem or it is specific to my hardware? Thanks, Attila From owner-freebsd-fs@FreeBSD.ORG Fri Aug 3 23:25:57 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 97BC51065670 for ; Fri, 3 Aug 2012 23:25:57 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from esa-scalar.mail.uoguelph.ca (esa-scalar.mail.uoguelph.ca [66.199.40.18]) by mx1.freebsd.org (Postfix) with ESMTP id 373968FC08 for ; Fri, 3 Aug 2012 23:25:57 +0000 (UTC) Received: from zcs3.mail.uoguelph.ca (new.mail.uoguelph.ca [131.104.93.37]) by esa-scalar.mail.uoguelph.ca (8.14.1/8.14.1) with ESMTP id q73NPpHH001235; Fri, 3 Aug 2012 19:25:52 -0400 Received: from zcs3.mail.uoguelph.ca (localhost.localdomain [127.0.0.1]) by zcs3.mail.uoguelph.ca (Postfix) with ESMTP id D202AB40B1; Fri, 3 Aug 2012 19:25:51 -0400 (EDT) Date: Fri, 3 Aug 2012 19:25:51 -0400 (EDT) From: Rick Macklem To: =?utf-8?Q?Attila_Bog=C3=A1r?= Message-ID: <1737260057.298486.1344036351816.JavaMail.root@erie.cs.uoguelph.ca> In-Reply-To: <501BC236.4030607@linguamatics.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Originating-IP: [172.17.91.201] X-Mailer: Zimbra 6.0.10_GA_2692 (ZimbraWebClient - FF3.0 (Win)/6.0.10_GA_2692) Cc: freebsd-fs@freebsd.org Subject: Re: NFS I/O or permission denied errors X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 03 Aug 2012 23:25:57 -0000 Attila Bogar wrote: > On 03/08/12 01:03, Attila Bog=C3=A1r wrote: > > See the attached bash script. > Sorry, my script has been stripped off by the list. >=20 > It's nothing rocket science, takes an export list from a file > (/root/fs.txt) and mounts the nfs shares in a loop. >=20 > -- 8< -- > #!/bin/bash >=20 > sleepmount=3D0.33 >=20 > function mount.all() { > set -e > j=3D0 > while read fs > do > echo mounting $fs > sleep $sleepmount > mount -t nfs -v -o sec=3Dsys,vers=3D3,proto=3Dtcp server:$fs /mnt/$j > sleep $sleepmount > umount -f /mnt/$j A forced dismount (-f option) is only intended to be used when a server is unresponsive and will result in I/O errors. Try running the script with "-f" on umount. > j=3D$[j+1] > done < /root/fs.txt > set +e > } >=20 > function umount.all() { > umount -f /mnt/* &>/dev/null > } >=20 > fsno=3D"$(wc -l /root/fs.txt|cut -d' ' -f1)" > umount.all > i=3D0;while [ $i -lt $fsno ]; do echo $i; mkdir /mnt/$i ; i=3D$[i+1]; don= e >=20 > i=3D0 > while [ $i -lt 1000 ] > do > i=3D$[i+1] > echo "RUN: $i" | tee /tmp/nfstest.status > mount.all > done > -- 8< -- >=20 > sec=3Dsys,vers=3D3,proto=3Dudp seems stable, tcp gets an I/O error within > 2-3 > minutes. >=20 > I'm testing this from an up to date CentOS 6.3 nfs client. >=20 > I suspicious about the network stack. I tried turning off msi and TSO > on > the bce card, but no change yet. > I also took down my lagg interface and tried the onboard single bce, > no > change. >=20 > This gentleman had a similar problem with nfsv4 but he got no hint > from > the list: > http://lists.freebsd.org/pipermail/freebsd-stable/2012-June/068658.html >=20 > Can someone reproduce the problem or it is specific to my hardware? >=20 > Thanks, > Attila >=20 > _______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" From owner-freebsd-fs@FreeBSD.ORG Fri Aug 3 23:28:11 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 7C9EE106564A for ; Fri, 3 Aug 2012 23:28:11 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from esa-scalar.mail.uoguelph.ca (esa-scalar.mail.uoguelph.ca [66.199.40.18]) by mx1.freebsd.org (Postfix) with ESMTP id 1EE1A8FC08 for ; Fri, 3 Aug 2012 23:28:10 +0000 (UTC) Received: from zcs3.mail.uoguelph.ca (new.mail.uoguelph.ca [131.104.93.37]) by esa-scalar.mail.uoguelph.ca (8.14.1/8.14.1) with ESMTP id q73NS3Z5020287; Fri, 3 Aug 2012 19:28:03 -0400 Received: from zcs3.mail.uoguelph.ca (localhost.localdomain [127.0.0.1]) by zcs3.mail.uoguelph.ca (Postfix) with ESMTP id A0C53B403E; Fri, 3 Aug 2012 19:28:03 -0400 (EDT) Date: Fri, 3 Aug 2012 19:28:03 -0400 (EDT) From: Rick Macklem To: =?utf-8?Q?Attila_Bog=C3=A1r?= Message-ID: <773317506.298535.1344036483624.JavaMail.root@erie.cs.uoguelph.ca> In-Reply-To: <501BC236.4030607@linguamatics.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Originating-IP: [172.17.91.201] X-Mailer: Zimbra 6.0.10_GA_2692 (ZimbraWebClient - FF3.0 (Win)/6.0.10_GA_2692) Cc: freebsd-fs@freebsd.org Subject: Re: NFS I/O or permission denied errors X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 03 Aug 2012 23:28:11 -0000 Attila Bogar wrote: > On 03/08/12 01:03, Attila Bog=C3=A1r wrote: > > See the attached bash script. > Sorry, my script has been stripped off by the list. >=20 > It's nothing rocket science, takes an export list from a file > (/root/fs.txt) and mounts the nfs shares in a loop. >=20 > -- 8< -- > #!/bin/bash >=20 > sleepmount=3D0.33 >=20 > function mount.all() { > set -e > j=3D0 > while read fs > do > echo mounting $fs > sleep $sleepmount > mount -t nfs -v -o sec=3Dsys,vers=3D3,proto=3Dtcp server:$fs /mnt/$j > sleep $sleepmount > umount -f /mnt/$j Oops, I didn't see that the client was a Linux one. I have no idea what the semantics of a Linux "umount -f" is, although I'd still try it without "-f" I was you. > j=3D$[j+1] > done < /root/fs.txt > set +e > } >=20 > function umount.all() { > umount -f /mnt/* &>/dev/null > } >=20 > fsno=3D"$(wc -l /root/fs.txt|cut -d' ' -f1)" > umount.all > i=3D0;while [ $i -lt $fsno ]; do echo $i; mkdir /mnt/$i ; i=3D$[i+1]; don= e >=20 > i=3D0 > while [ $i -lt 1000 ] > do > i=3D$[i+1] > echo "RUN: $i" | tee /tmp/nfstest.status > mount.all > done > -- 8< -- >=20 > sec=3Dsys,vers=3D3,proto=3Dudp seems stable, tcp gets an I/O error within > 2-3 > minutes. >=20 > I'm testing this from an up to date CentOS 6.3 nfs client. >=20 > I suspicious about the network stack. I tried turning off msi and TSO > on > the bce card, but no change yet. > I also took down my lagg interface and tried the onboard single bce, > no > change. >=20 > This gentleman had a similar problem with nfsv4 but he got no hint > from > the list: > http://lists.freebsd.org/pipermail/freebsd-stable/2012-June/068658.html >=20 > Can someone reproduce the problem or it is specific to my hardware? >=20 > Thanks, > Attila >=20 > _______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" From owner-freebsd-fs@FreeBSD.ORG Sat Aug 4 09:22:22 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 17DBD106564A for ; Sat, 4 Aug 2012 09:22:22 +0000 (UTC) (envelope-from attila.bogar@linguamatics.com) Received: from mail.linguamatics.com (mail.linguamatics.com [188.39.80.203]) by mx1.freebsd.org (Postfix) with ESMTP id C2B358FC17 for ; Sat, 4 Aug 2012 09:22:21 +0000 (UTC) Received: from secure.linguamatics.com (guardian.linguamatics.com [10.252.2.1]) by mail.linguamatics.com (Postfix) with ESMTPS id 5400DEFB44C; Sat, 4 Aug 2012 10:22:15 +0100 (BST) Received: from [10.252.2.234] (vpn.abogar.linguamatics.com [10.252.2.234]) by secure.linguamatics.com (Postfix) with ESMTP id 63E928187; Sat, 4 Aug 2012 10:30:26 +0100 (BST) Message-ID: <501CE9C6.5010507@linguamatics.com> Date: Sat, 04 Aug 2012 10:22:14 +0100 From: =?UTF-8?B?QXR0aWxhIEJvZ8Ohcg==?= User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:14.0) Gecko/20120714 Thunderbird/14.0 MIME-Version: 1.0 To: Rick Macklem References: <773317506.298535.1344036483624.JavaMail.root@erie.cs.uoguelph.ca> In-Reply-To: <773317506.298535.1344036483624.JavaMail.root@erie.cs.uoguelph.ca> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-fs@freebsd.org Subject: Re: NFS I/O or permission denied errors X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 04 Aug 2012 09:22:22 -0000 On 04/08/12 00:28, Rick Macklem wrote: > Oops, I didn't see that the client was a Linux one. I have no idea > what the semantics of a Linux "umount -f" is, although I'd still try > it without "-f" I was you. Thanks, - I tried with the force -f on the Linux and no change, I/O error within 2 mins. I captured the mount/umount requests with tshark and I can see no difference, how the FreeBSD nfs server responds to successful/failed mount requests. In fact the Linux is sending the FIN. Moreover, I could reproduce this between a CentOS 5.8 nfs server and a CentOS 6.3 nfs client. So I think this is a Linux bug - I'll try the linux-nfs@ mailing list to discuss this further. I'm not sure if this is the same bug as I get for the krb5 mounts (there the error message is permission denied), will make a tshark capture too with that. Thanks for the ideas, Attila