From owner-freebsd-stable@FreeBSD.ORG Tue Apr 15 17:31:08 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 72BF1106566B for ; Tue, 15 Apr 2008 17:31:08 +0000 (UTC) (envelope-from jbsnyder@gmail.com) Received: from rv-out-0506.google.com (rv-out-0506.google.com [209.85.198.230]) by mx1.freebsd.org (Postfix) with ESMTP id 42A948FC21 for ; Tue, 15 Apr 2008 17:31:08 +0000 (UTC) (envelope-from jbsnyder@gmail.com) Received: by rv-out-0506.google.com with SMTP id b25so1097553rvf.43 for ; Tue, 15 Apr 2008 10:31:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=262pwJ8mg7kTSI+uBEThLkqymePf7VM5t1ItiHdyQ/w=; b=ZwD+5kReiJiokkdnnFjUz/XXBRg5e50AWB6KlV37R8B7sI3DqY0on+xOF76c10pPiRUIuMGb7KWrMG3WH8Rf+RFdKS7MW6Ibox5tOo39Si1gK8eN4Q1XprMgCMx3Y0IpmrxMzal+B3JgKrCFbMfUKqPyMjzuG9BQti3W4pcnAMA= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=tmdhdQ41oM6eU/GYJUA/DsDU1hBkVjPwwPbZHfSLia9Puue6+72jA0WDKM+843XXc0B2iAOO1JZuuFman3yge2RsBEe5Y2KZWkVjPHHvZT1lM2n1A8J7QEfSEtVc+ivNrKP2TjTcZzzSto9ebBTraC7771/a+8WtS1UkL8mhKpw= Received: by 10.140.148.3 with SMTP id v3mr4456710rvd.71.1208279141529; Tue, 15 Apr 2008 10:05:41 -0700 (PDT) Received: by 10.141.83.21 with HTTP; Tue, 15 Apr 2008 10:05:41 -0700 (PDT) Message-ID: <33644d3c0804151005r17095cb1n33117a8e4d8cc09b@mail.gmail.com> Date: Tue, 15 Apr 2008 12:05:41 -0500 From: "James Snyder" To: "Claus Guttesen" In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <16447331.post@talk.nabble.com> <16491496.post@talk.nabble.com> Cc: freebsd-stable@freebsd.org Subject: Re: ZFS & Bittorent -> Hang? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: jbsnyder@gmail.com List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Apr 2008 17:31:08 -0000 Thanks for the followup. I have not yet gotten a reliable test case to reproduce the problem. I've done a number of tests with the zil and/or prefetch on with no hangs. I will be collecting some more data later this week. If anyone knows a source of consistently slow but large torrents (I suppose I could artificially limit bandwidth, or connection states at my router which is running pfSense), that might help for testing. The process that triggered things before was about a gigabyte or two but took around 12 hours to complete. Here's the overall group of variables I'm experimenting with. Stock Kernel vs Recompiled Kerel w/ ULE (stock sources otherwise) ZIL on and off prefetch on and off Should I add or remove anything? I have no idea if ULE may or may not play a role here, but my original failing condition had the zil off, prefetch on, ule for the scheduler. I also had: vm.kmem_size_max="1073741824" (loader.conf) vm.kmem_size="1073741824" (loader.conf) Any recommendations on what to leave running to record what zfs is getting hung on, beside watching states? Since I can fire up things prior to the hang, and they'll keep running if disk isn't hit, I could leave some diagnostics running to display what's blowing up. Thanks! On Tue, Apr 15, 2008 at 4:44 AM, Claus Guttesen wrote: > > > http://wiki.freebsd.org/ZFSKnownProblems > > > > > > This looks like #1. > > > > > > > Hmm.. I don't think there's a large amount of transfer between UFS & ZFS, > > unless the client is using /tmp a lot, it should all be on ZFS. > > > > I noted #4 as well, and therefore tried disabling prefetch. I can't seem to > > get it to hang now. I queued up a bunch of different torrents (full freebsd > > 7 amd64 & i386, some other random things), and they all completed without > > leading to me being locked out or any processes waiting on zfs. > > > > I'll try some testing this weekend to see if I can reproduce the lock-up > > again by re-enabling prefetch. Perhaps we can confirm that issue? Should I > > bother with trying to run CURRENT or should any testing I do be done with > > STABLE. I don't see any indication that there might be experimental patches > > for dealing with this or related issues. > > Were you able to reproduce the lock-up by re-enabling prefetch? > > -- > regards > Claus > > When lenity and cruelty play for a kingdom, > the gentlest gamester is the soonest winner. > > Shakespeare > -- James Snyder Biomedical Engineering Northwestern University jbsnyder@gmail.com