From owner-freebsd-fs@FreeBSD.ORG Sat Jun 20 19:32:33 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F1EBA1065670 for ; Sat, 20 Jun 2009 19:32:33 +0000 (UTC) (envelope-from mat.macy@gmail.com) Received: from mail-yx0-f200.google.com (mail-yx0-f200.google.com [209.85.210.200]) by mx1.freebsd.org (Postfix) with ESMTP id A02198FC08 for ; Sat, 20 Jun 2009 19:32:33 +0000 (UTC) (envelope-from mat.macy@gmail.com) Received: by yxe38 with SMTP id 38so831277yxe.3 for ; Sat, 20 Jun 2009 12:32:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:received:in-reply-to :references:date:x-google-sender-auth:message-id:subject:from:to:cc :content-type:content-transfer-encoding; bh=91uOkxgFVsnv8Y1/eWQeRnVgEguKc2DsXtXT01fBbSE=; b=Cso4AwOdSBPg0VuES66BFU1ykn6SqvrJEjKT4X3PWNrhgTRbBQs55dHkVf1mNmiIs0 f5vbqe6GOfUy2Wy0/5RfPN2PQSOlM/JQDMkcX1/3uxvX2L67bqzpF7R+ey5h3oTBCqTV wQf2vLwfGb8JH6rlG3+c6ais1Uk/Rix1M/VVA= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type :content-transfer-encoding; b=SxjZGBMdbXNnAfb5IWF4PzE/r+7hB9KXgZF+oelH4Ghb2YTyvSFjKfMQx7L2TOGLtJ o8Pc9WLJ+8JKaJEfaI2TvbqQkpUB5fPSuChlpUef9qR0/ooeBOHAL/oU8Jfk/yoqdZLP JBeMXBlXWA2kX3XWAW7BcAty3KKQSp/X52Plk= MIME-Version: 1.0 Sender: mat.macy@gmail.com Received: by 10.100.37.12 with SMTP id k12mr5781141ank.99.1245526352336; Sat, 20 Jun 2009 12:32:32 -0700 (PDT) In-Reply-To: <1245525965.26909.69.camel@phoenix.blechhirn.net> References: <1245519413.26909.60.camel@phoenix.blechhirn.net> <3c1674c90906201050w15e4cd5dpae76cd70d64b4e92@mail.gmail.com> <1245525965.26909.69.camel@phoenix.blechhirn.net> Date: Sat, 20 Jun 2009 12:32:32 -0700 X-Google-Sender-Auth: 68337241cd8c4ccf Message-ID: <3c1674c90906201232x63ddee19yf91aeac30f3401bb@mail.gmail.com> From: Kip Macy To: mister.olli@googlemail.com Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: freebsd-fs@freebsd.org Subject: Re: Unable to delete files on ZFS volume X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 20 Jun 2009 19:32:34 -0000 This is a a known issue with write allocate file systems and snapshots. I haven't seen this before on v13 without any snapshots. A few questions: - How many file systems? - How old are the file systems? - How much churn has there been on the file system? - Was this an upgraded v6 or created as v13? - How many files on test? ... as well as any other things that occur to you to characterize the file system. Cheers, Kip On Sat, Jun 20, 2009 at 12:26 PM, Mister Olli w= rote: > Hi, > >> Do you have snapshots or run ZFS v6? > neither one or the other. Here are my pool/ ZFS details. > > [root@template-8_CURRENT /test/data2]# zpool get all test > NAME =A0PROPERTY =A0 =A0 =A0 VALUE =A0 =A0 =A0 SOURCE > test =A0size =A0 =A0 =A0 =A0 =A0 2.98G =A0 =A0 =A0 - > test =A0used =A0 =A0 =A0 =A0 =A0 2.94G =A0 =A0 =A0 - > test =A0available =A0 =A0 =A047.9M =A0 =A0 =A0 - > test =A0capacity =A0 =A0 =A0 98% =A0 =A0 =A0 =A0 - > test =A0altroot =A0 =A0 =A0 =A0- =A0 =A0 =A0 =A0 =A0 default > test =A0health =A0 =A0 =A0 =A0 ONLINE =A0 =A0 =A0- > test =A0guid =A0 =A0 =A0 =A0 =A0 5305090209740383945 =A0- > test =A0version =A0 =A0 =A0 =A013 =A0 =A0 =A0 =A0 =A0default > test =A0bootfs =A0 =A0 =A0 =A0 - =A0 =A0 =A0 =A0 =A0 default > test =A0delegation =A0 =A0 on =A0 =A0 =A0 =A0 =A0default > test =A0autoreplace =A0 =A0off =A0 =A0 =A0 =A0 default > test =A0cachefile =A0 =A0 =A0- =A0 =A0 =A0 =A0 =A0 default > test =A0failmode =A0 =A0 =A0 wait =A0 =A0 =A0 =A0default > test =A0listsnapshots =A0off =A0 =A0 =A0 =A0 default > [root@template-8_CURRENT /test/data2]# zfs get all test > NAME =A0PROPERTY =A0 =A0 =A0 =A0 =A0 =A0 =A0VALUE =A0 =A0 =A0 =A0 =A0 =A0= =A0 =A0 =A0SOURCE > test =A0type =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0filesystem =A0 =A0 =A0 = =A0 =A0 =A0 - > test =A0creation =A0 =A0 =A0 =A0 =A0 =A0 =A0Fri Jun 19 21:01 2009 =A0- > test =A0used =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A01.96G =A0 =A0 =A0 =A0 =A0= =A0 =A0 =A0 =A0- > test =A0available =A0 =A0 =A0 =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0- > test =A0referenced =A0 =A0 =A0 =A0 =A0 =A026.6K =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0- > test =A0compressratio =A0 =A0 =A0 =A0 1.00x =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0- > test =A0mounted =A0 =A0 =A0 =A0 =A0 =A0 =A0 yes =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0- > test =A0quota =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 none =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 default > test =A0reservation =A0 =A0 =A0 =A0 =A0 none =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 default > test =A0recordsize =A0 =A0 =A0 =A0 =A0 =A0128K =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 default > test =A0mountpoint =A0 =A0 =A0 =A0 =A0 =A0/test =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0default > test =A0sharenfs =A0 =A0 =A0 =A0 =A0 =A0 =A0off =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0default > test =A0checksum =A0 =A0 =A0 =A0 =A0 =A0 =A0on =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 default > test =A0compression =A0 =A0 =A0 =A0 =A0 off =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0default > test =A0atime =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 on =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 default > test =A0devices =A0 =A0 =A0 =A0 =A0 =A0 =A0 on =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 default > test =A0exec =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0on =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 default > test =A0setuid =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0on =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 default > test =A0readonly =A0 =A0 =A0 =A0 =A0 =A0 =A0off =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0default > test =A0jailed =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0off =A0 =A0 =A0 =A0 =A0 =A0= =A0 =A0 =A0 =A0default > test =A0snapdir =A0 =A0 =A0 =A0 =A0 =A0 =A0 hidden =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 default > test =A0aclmode =A0 =A0 =A0 =A0 =A0 =A0 =A0 groupmask =A0 =A0 =A0 =A0 =A0= =A0 =A0default > test =A0aclinherit =A0 =A0 =A0 =A0 =A0 =A0restricted =A0 =A0 =A0 =A0 =A0 = =A0 default > test =A0canmount =A0 =A0 =A0 =A0 =A0 =A0 =A0on =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 default > test =A0shareiscsi =A0 =A0 =A0 =A0 =A0 =A0off =A0 =A0 =A0 =A0 =A0 =A0 =A0= =A0 =A0 =A0default > test =A0xattr =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 off =A0 =A0 =A0 =A0 =A0 =A0= =A0 =A0 =A0 =A0temporary > test =A0copies =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A01 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0default > test =A0version =A0 =A0 =A0 =A0 =A0 =A0 =A0 3 =A0 =A0 =A0 =A0 =A0 =A0 =A0= =A0 =A0 =A0 =A0- > test =A0utf8only =A0 =A0 =A0 =A0 =A0 =A0 =A0off =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0- > test =A0normalization =A0 =A0 =A0 =A0 none =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 - > test =A0casesensitivity =A0 =A0 =A0 sensitive =A0 =A0 =A0 =A0 =A0 =A0 =A0= - > test =A0vscan =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 off =A0 =A0 =A0 =A0 =A0 =A0= =A0 =A0 =A0 =A0default > test =A0nbmand =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0off =A0 =A0 =A0 =A0 =A0 =A0= =A0 =A0 =A0 =A0default > test =A0sharesmb =A0 =A0 =A0 =A0 =A0 =A0 =A0off =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0default > test =A0refquota =A0 =A0 =A0 =A0 =A0 =A0 =A0none =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 default > test =A0refreservation =A0 =A0 =A0 =A0none =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 default > test =A0primarycache =A0 =A0 =A0 =A0 =A0all =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0default > test =A0secondarycache =A0 =A0 =A0 =A0all =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0= =A0 =A0default > test =A0usedbysnapshots =A0 =A0 =A0 0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0= =A0 =A0- > test =A0usedbydataset =A0 =A0 =A0 =A0 26.6K =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0- > test =A0usedbychildren =A0 =A0 =A0 =A01.96G =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0- > test =A0usedbyrefreservation =A00 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0= =A0- > [root@template-8_CURRENT /test/data2]# zfs list -t snapshot > no datasets available > > > >> Confirm that you've deleted your snapshots and are running pool v13. >> >> Future ZFS mail should be directed to freebsd-fs@ > Sorry for that. fixed now ;-)) > > Regards, > --- > Mr. Olli > > >> >> >> On Sat, Jun 20, 2009 at 10:36 AM, Mister Olli wrote: >> > Hi, >> > >> > after filling up a ZFS volume until the last byte, I'm unable to delet= e >> > files, with error 'No space left on the device'. >> > >> > >> > >> > [root@template-8_CURRENT /test/data2]# df -h >> > Filesystem =A0 =A0 Size =A0 =A0Used =A0 Avail Capacity =A0Mounted on >> > /dev/ad0s1a =A0 =A08.7G =A0 =A05.2G =A0 =A02.8G =A0 =A065% =A0 =A0/ >> > devfs =A0 =A0 =A0 =A0 =A01.0K =A0 =A01.0K =A0 =A0 =A00B =A0 100% =A0 = =A0/dev >> > test =A0 =A0 =A0 =A0 =A0 =A0 0B =A0 =A0 =A00B =A0 =A0 =A00B =A0 100% = =A0 =A0/test >> > test/data1 =A0 =A0 1.6G =A0 =A01.6G =A0 =A0 =A00B =A0 100% =A0 =A0/tes= t/data1 >> > test/data2 =A0 =A0 341M =A0 =A0341M =A0 =A0 =A00B =A0 100% =A0 =A0/tes= t/data2 >> > [root@template-8_CURRENT /test/data2]# zfs list >> > NAME =A0 =A0 =A0 =A0 USED =A0AVAIL =A0REFER =A0MOUNTPOINT >> > test =A0 =A0 =A0 =A01.96G =A0 =A0 =A00 =A026.6K =A0/test >> > test/data1 =A01.62G =A0 =A0 =A00 =A01.62G =A0/test/data1 >> > test/data2 =A0 341M =A0 =A0 =A00 =A0 341M =A0/test/data2 >> > [root@template-8_CURRENT /test/data2]# ls -l data1 |tail -n 20 =A0 =A0= =A0 =A0 =A0<-- there are quite a lot of files, so I truncated ;-)) >> > -rw-r--r-- =A01 root =A0wheel =A0 =A0 =A03072 Jun 20 17:13 20090620165= 743 >> > -rw-r--r-- =A01 root =A0wheel =A0 9771008 Jun 20 17:11 20090620165803 >> > -rw-r--r-- =A01 root =A0wheel =A0 =A0624640 Jun 20 17:12 2009062016580= 9 >> > -rw-r--r-- =A01 root =A0wheel =A0 1777664 Jun 20 17:14 20090620165810 >> > -rw-r--r-- =A01 root =A0wheel =A0 4059136 Jun 20 17:15 20090620165817 >> > -rw-r--r-- =A01 root =A0wheel =A023778304 Jun 20 17:13 20090620165925 >> > -rw-r--r-- =A01 root =A0wheel =A020318208 Jun 20 17:13 20090620165952 >> > -rw-r--r-- =A01 root =A0wheel =A028394496 Jun 20 17:10 20090620170013 >> > -rw-r--r-- =A01 root =A0wheel =A023698432 Jun 20 17:12 20090620170021 >> > -rw-r--r-- =A01 root =A0wheel =A026476544 Jun 20 17:19 20090620170100 >> > -rw-r--r-- =A01 root =A0wheel =A019904512 Jun 20 17:15 20090620170132 >> > -rw-r--r-- =A01 root =A0wheel =A023815168 Jun 20 17:14 20090620170142 >> > -rw-r--r-- =A01 root =A0wheel =A0 6683648 Jun 20 17:11 20090620170225 >> > -rw-r--r-- =A01 root =A0wheel =A019619840 Jun 20 17:11 20090620170322 >> > -rw-r--r-- =A01 root =A0wheel =A013902848 Jun 20 17:13 20090620170331 >> > -rw-r--r-- =A01 root =A0wheel =A028981248 Jun 20 17:13 20090620170346 >> > -rw-r--r-- =A01 root =A0wheel =A018287616 Jun 20 17:11 20090620170355 >> > -rw-r--r-- =A01 root =A0wheel =A016762880 Jun 20 17:16 20090620170405 >> > -rw-r--r-- =A01 root =A0wheel =A026966016 Jun 20 17:10 20090620170429 >> > -rw-r--r-- =A01 root =A0wheel =A0 5252096 Jun 20 17:14 20090620170502 >> > [root@template-8_CURRENT /test/data2]# =A0rm -rf data1 >> > rm: data1/20090620141524: No space left on device >> > rm: data1/20090620025202: No space left on device >> > rm: data1/20090620014926: No space left on device >> > rm: data1/20090620075405: No space left on device >> > rm: data1/20090620155124: No space left on device >> > rm: data1/20090620105723: No space left on device >> > rm: data1/20090620170100: No space left on device >> > rm: data1/20090620040149: No space left on device >> > rm: data1/20090620002512: No space left on device >> > rm: data1/20090620052315: No space left on device >> > rm: data1/20090620083750: No space left on device >> > rm: data1/20090620063831: No space left on device >> > rm: data1/20090620155029: No space left on device >> > rm: data1/20090619234313: No space left on device >> > rm: data1/20090620115346: No space left on device >> > rm: data1/20090620075508: No space left on device >> > rm: data1/20090620145541: No space left on device >> > rm: data1/20090620093335: No space left on device >> > rm: data1/20090620101846: No space left on device >> > rm: data1/20090620132456: No space left on device >> > rm: data1/20090620040044: No space left on device >> > rm: data1/20090620091401: No space left on device >> > rm: data1/20090620162251: No space left on device >> > rm: data1/20090619220813: No space left on device >> > rm: data1/20090620010643: No space left on device >> > rm: data1/20090620052218: No space left on device >> > >> > >> > >> > >> > >> > Regards, >> > --- >> > Mr. Olli >> > >> > _______________________________________________ >> > freebsd-current@freebsd.org mailing list >> > http://lists.freebsd.org/mailman/listinfo/freebsd-current >> > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.= org" >> > >> >> >> > > --=20 When bad men combine, the good must associate; else they will fall one by one, an unpitied sacrifice in a contemptible struggle. Edmund Burke