From owner-freebsd-hackers Fri Jan 31 9:46: 2 2003 Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3FBFC37B401 for ; Fri, 31 Jan 2003 09:46:00 -0800 (PST) Received: from mail.cruzio.com (mail.cruzio.com [63.249.95.37]) by mx1.FreeBSD.org (Postfix) with ESMTP id D982743F43 for ; Fri, 31 Jan 2003 09:45:59 -0800 (PST) (envelope-from brucem@dsl3-63-249-66-35.cruzio.com) Received: from dsl3-63-249-66-35.cruzio.com (dsl3-63-249-66-35.cruzio.com [63.249.66.35]) by mail.cruzio.com with ESMTP id JAA09983 for ; Fri, 31 Jan 2003 09:45:54 -0800 (PST) Received: (from brucem@localhost) by dsl3-63-249-66-35.cruzio.com (8.11.3/8.11.3) id h0VIFrW00567 for freebsd-hackers@freebsd.org; Fri, 31 Jan 2003 10:15:53 -0800 (PST) (envelope-from brucem) Date: Fri, 31 Jan 2003 10:15:53 -0800 (PST) From: "Bruce R. Montague" Message-Id: <200301311815.h0VIFrW00567@dsl3-63-249-66-35.cruzio.com> To: freebsd-hackers@freebsd.org Subject: Re: Random disk cache expiry Sender: owner-freebsd-hackers@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.ORG For those thinking of playing with predictive caching (likely an area of considerable student endeveour/interest these days at both filesystem and "web" level): --- Matthew Dillon: > So there is no 'perfect' caching algorithm. There > are simply too many variables even in a well defined > environment for even the best system heuristics to > cover optimally. --- David Schultz: > If that proves to be infeasible, I'm sure there are > ways to approximate the same thing. The hard parts, > I think, would be teaching the VM system to use the > new information, and gathering statistics from which > you form your hints. --- Right. It's easy if you know the complete future of the total system state, which of course you never will. Someone interested in this might try to apply the latest in machine learing techniques, classifiers, etc., to the online problem. Variants of this are receiving lots of attention in areas such as gene sequence prediction. I dunno, but it seems like a lot of the math ends up pretty similar to economics, and we all know how well those models work. Kind of funny, running an economic simulation in your kernel... but actually getting possible at some level, at least for research systems with modern machines. There was a time when you would be fired for putting floating-point in an OS. ---- http://csl.cse.ucsc.edu/acme.shtml : "Many cache replacement policies have been invented and some perform better than others under certain workload and network-topological conditions. It is impossible and sub-optimal to manually choose cache replacement policies for workloads and topologies that are under continuous change. We use machine learning algorithms to automatically select the best current policy or mixtures of policies from a policy (a.k.a expert) pool to provide an "adaptive caching" service." - bruce To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hackers" in the body of the message