From owner-freebsd-hackers@FreeBSD.ORG Fri Oct 1 01:42:24 2004 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3A84316A4CE for ; Fri, 1 Oct 2004 01:42:24 +0000 (GMT) Received: from afields.ca (afields.ca [216.194.67.132]) by mx1.FreeBSD.org (Postfix) with ESMTP id E37C143D1F for ; Fri, 1 Oct 2004 01:42:23 +0000 (GMT) (envelope-from afields@afields.ca) Received: from afields.ca (localhost.afields.ca [127.0.0.1]) by afields.ca (8.12.11/8.12.11) with ESMTP id i911gEC5022912; Thu, 30 Sep 2004 21:42:14 -0400 (EDT) (envelope-from afields@afields.ca) Received: (from afields@localhost) by afields.ca (8.12.11/8.12.11/Submit) id i911gEMD022911; Thu, 30 Sep 2004 21:42:14 -0400 (EDT) (envelope-from afields) Date: Thu, 30 Sep 2004 21:42:13 -0400 From: Allan Fields To: Jo?o Carlos Mendes Lu?s Message-ID: <20041001014213.GN47410@afields.ca> References: <415BDFC2.1020304@fer.hr> <415C9967.3090309@jonny.eng.br> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <415C9967.3090309@jonny.eng.br> User-Agent: Mutt/1.4i cc: hackers@freebsd.org cc: Ivan Voras Subject: Re: GEOM (ggate) compression consumer +problem X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 01 Oct 2004 01:42:24 -0000 The funny thing is you'll run into lots of these types of similarities in solutions between the two levels (at the VFS and at the device level). The parallel solutions may differ significantly in implementation, but are layer-wise homologies (analogs). You can do compression and encryption at multiple levels in the system w/ various benefits and disadvantages. Data can pass through any of these layers on it's way to disk or over the network as the case might be. On Thu, Sep 30, 2004 at 08:40:23PM -0300, Jo?o Carlos Mendes Lu?s wrote: > Instead of block compression, wouldn't it be better (and maybe easier) > to use file compresion, in a VFS layer (and a threaded daemon)? No need to have a user-side daemon if the compression/encryption logic is implemented on the kernel side. Else you may run into bottlenecks and other implementation issues. One alternative is to implement a VFS infrastructure like DragonFly has planned to allow user-side filesystems to become practical. There are arguments about why each approach should be used. > A real useful VFS layer would have an option to compress only rarely > used files. And keep the real layer accessible, to allow dumping of > compressed backend files. > > Also, an option to encrypt the backend files could be useful. > Encrypting after compressing is always better. You're referring to capabilities that FiST (http://www.filesystems.org) can offer. Support for FreeBSD SCA isn't yet complete which is required to get compression (gzipfs) to work. > This is what I would like to see in a compressed file system. While the granularity of operation is reduced to the file level by sticking with a VFS layer implementation, it can be more complicated than device level compression/encryption at this point and there are a few issues remaining to be solved. > Ivan Voras wrote: > >I've made a GEOM compression layer daemon for ggate (compresses data > >before storing to underlying file/media). It's still early version and > >unfinished, and it's available at: > > > >http://ivoras.sharanet.org/ggcomp.tgz > > Jonny > > -- > Jo?o Carlos Mendes Lu?s - Networking Engineer - jonny@jonny.eng.br -- Allan Fields, AFRSL - http://afields.ca 2D4F 6806 D307 0889 6125 C31D F745 0D72 39B4 5541