From owner-freebsd-stable@FreeBSD.ORG Fri Apr 18 18:15:40 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DF7C9106566B for ; Fri, 18 Apr 2008 18:15:40 +0000 (UTC) (envelope-from jbsnyder@gmail.com) Received: from wx-out-0506.google.com (wx-out-0506.google.com [66.249.82.237]) by mx1.freebsd.org (Postfix) with ESMTP id 92FE28FC14 for ; Fri, 18 Apr 2008 18:15:40 +0000 (UTC) (envelope-from jbsnyder@gmail.com) Received: by wx-out-0506.google.com with SMTP id i29so591465wxd.7 for ; Fri, 18 Apr 2008 11:15:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=CF6bVIWwEqjSvM65x67Zwvgsl+pTR5+LTVxkhXiTRl4=; b=Krl6YlB08QleW1xcbtfzrKFOky2fYfc6hKZ3NxO/4dOUidukGVudDpfeJ2EGIN36EgMIR0u48EM6GN4tW/DHtdqjKJ56n9qsEhL0GsadhceUFp3/MgLoczY3qL3h03DDTSMEGUuAQAW+wX3peuX7zLzewfh9dx7e+jW3XQWCZkY= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=FRIxBEJACWr+S8UI0h4xfC5BDtrAK/67GxiA9Yw88Yk2E+5yVrpuXVnmEmoI+iARAPqh7v739jk0k1q3WAkn2jr6qqgTRyx+EKxG/zsM/zBkxlk7f/LHdf2GhObbVWSdEQ5Kwwy8qppoUVFWqg3BD+ANpxCG3VPHbI7815BQMuM= Received: by 10.140.180.42 with SMTP id c42mr1735715rvf.145.1208542538977; Fri, 18 Apr 2008 11:15:38 -0700 (PDT) Received: by 10.141.83.21 with HTTP; Fri, 18 Apr 2008 11:15:38 -0700 (PDT) Message-ID: <33644d3c0804181115v38611102yc48c2e46f30d0bf6@mail.gmail.com> Date: Fri, 18 Apr 2008 13:15:38 -0500 From: "James Snyder" To: "Claus Guttesen" In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <16447331.post@talk.nabble.com> <16491496.post@talk.nabble.com> <33644d3c0804151005r17095cb1n33117a8e4d8cc09b@mail.gmail.com> <16763410.post@talk.nabble.com> Cc: freebsd-stable@freebsd.org Subject: Re: ZFS & Bittorent -> Hang? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: jbsnyder@gmail.com List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Apr 2008 18:15:41 -0000 No problem. I've filed a PR: http://www.freebsd.org/cgi/query-pr.cgi?pr=122888 This doesn't seem to be a volume-of-data thing, not sure if it is related to using raidz or not. I don't have another spare disk in the machine I tested on to pare things down. Otherwise, seems to be pretty stable. I've been knocking on it for some time with no other troubles. Prefetch seems to me to be a little less than ready for prime-time. I seem to recall on a 32-bit machine as well that pkg_delete would run terribly slowly with prefetch on, and things got better when I re-enabled the zil and turned prefetch off. Not sure whether the zil just helped a lot there or if the problem was prefetch. I'm using ZFS on my Mac OS X laptop as well, that's been pretty good too. Latest build (111 on zfs.macosforge.org) has fixed mmap coherency, and a bunch of other things. On Fri, Apr 18, 2008 at 1:03 PM, Claus Guttesen wrote: > > OK. I've been able to reproduce the issue. > > > > Conditions: > > - Stock shipped kernel and modules from RELENG 7.0 > > > > loader.conf settings: > > - zfs prefetch enabled > > - zfs zil disabled > > - vm.kmem_size_max="1073741824" > > - vm.kmem_size="1073741824" > > > > AMD64 on Core 2 Duo w/ 4 GB RAM > > > > raidz across 4 disks, using root on zfs (also experienced this hang with zfs > > just on /usr) > > > > How To Reproduce > > - install transmission-daemon, run transmission-daemon (it will daemonize, > > automatically backgrounding) > > - grab a torrent, such as KNOPPIX (http://torrent.unix-ag.uni-kl.de/) > > - transmission-remote -a (add the torrent) > > - transmission-remote -s all (start all the torrents) > > > > wait hours to a day or so with whatever you want logging things running and > > active since anything that hits disk after the hang will get hung as well > > > > I've just done this twice. It doesn't seem to happen with zil enabled and > > prefetch off. > > > > Expected Behavior > > No hang. > > Thank you for spending time on this. I'm getting some jbod-storage in > a few weeks and will spend some time using various block-sizes and > share partitions across nfs. I'm somewhat confident that zfs on > FreeBSD will work fine but Solaris is (of course) also an option. This > will be approx. 7 TB to begin with and growing upwards to some two > digit TB's. > > What is the largest storage zfs on FreeBSD has been used on? I tried > it for some month on 8 TB. > > -- > > > regards > Claus > > When lenity and cruelty play for a kingdom, > the gentlest gamester is the soonest winner. > > Shakespeare > -- James Snyder Biomedical Engineering Northwestern University jbsnyder@gmail.com