From owner-freebsd-current@FreeBSD.ORG Fri Mar 25 16:04:26 2011 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 55E59106566B for ; Fri, 25 Mar 2011 16:04:26 +0000 (UTC) (envelope-from baptiste.daroussin@gmail.com) Received: from mail-iw0-f182.google.com (mail-iw0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id 1907A8FC0A for ; Fri, 25 Mar 2011 16:04:25 +0000 (UTC) Received: by iwn33 with SMTP id 33so1492889iwn.13 for ; Fri, 25 Mar 2011 09:04:25 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:in-reply-to:references:from :date:x-google-sender-auth:message-id:subject:to:content-type :content-transfer-encoding; bh=1r0gwWY7ay6ltCo3JPG36iVfGcT9OCmCA28a0XOYZEY=; b=MxGUtaOwUh40JnR+o5DBv/TqtTXyDfdac2pfjWCFVsvkslELwVAoUXOBMDAUy43Yye 3cAqMDl3VzRrRMNSw1giNCZKLfQJK8YYMecUuLMAZ2SVGhDxKeoR6KWtUz8nuB5isuaE JGkAoELmvNr1lgaXCDP9/p3YyzZ3lfN8fkhzk= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:from:date :x-google-sender-auth:message-id:subject:to:content-type :content-transfer-encoding; b=AmMNBXCSwlx4PCkHZHb6H261ZmqIh37uFPM7n54lnVqRFX8T2umJjksV0J74fwLi6+ F63j3pVW3ZROYGL2EKq1iejTkw06pUW4MS/PLQXn4yzvzj8J4/N3DfEm8qcOf6sgsqnD YUXyQ+j7LT9jNUhqnWJguCfsyo2Xlx/W8VWkk= Received: by 10.231.43.14 with SMTP id u14mr990904ibe.10.1301069065206; Fri, 25 Mar 2011 09:04:25 -0700 (PDT) MIME-Version: 1.0 Sender: baptiste.daroussin@gmail.com Received: by 10.231.182.76 with HTTP; Fri, 25 Mar 2011 09:04:05 -0700 (PDT) In-Reply-To: References: <20110325101111.GA36840__48943.3474642739$1301049771$gmane$org@azathoth.lan> From: Baptiste Daroussin Date: Fri, 25 Mar 2011 17:04:05 +0100 X-Google-Sender-Auth: 1R6Di4kMprgAe9xQ7y919NHne2w Message-ID: To: freebsd-current@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Subject: Re: [ECFT] pkgng 0.1-alpha1: a replacement for pkg_install X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 25 Mar 2011 16:04:26 -0000 2011/3/25 Julien Laffaye : > On Fri, Mar 25, 2011 at 11:52 AM, Ivan Voras wrote: >> On 25/03/2011 11:11, Baptiste Daroussin wrote: >> >>> =A0In term of technology we decided to use a sqlite3 database, and to >>> =A0prevent potential trolling, sqlite3 is used in it's amalgamation for= m >>> =A0which means it is incorporated in the code sources (as recommanded b= y >>> =A0sqlite developpers like a statically linked library) on build we onl= y >>> =A0activate the features we need in sqlite. >> >> I'm very glad you went with sqlite3! I've looked at pkgng source a bit a= nd >> it looks like you use transactions and foreign keys which is a huge bene= fit >> for the whole effort. >> >> At this time I'd just like to suggest you add the use of WAL journal >> (http://www.sqlite.org/pragma.html#pragma_journal_mode) on database crea= tion >> so you get the benefits of multiple-readers-single-writer concurrency mo= del. >> > > It sounds like a good idea. I'll add WAL support and if no problem > arise from that we should keep it. > >>> =A0The alpha release come with an experimental tool "pkg2ng" to convert >>> =A0an existing package database to the new pkgng database format. So on= e >>> =A0can test pkgng without rebuild all its packages. >> >> Could you change the filename of the database to have the ".sqlite" >> extension? It's not important but it indicates what it is used by and ne= wer >> software is moving to ".sqlite". >> > > Sure. Maybe rename pkg.db to local.sqlite so it will consistent with > the repo.sqlite (both in /var/db/pkg) > >>> =A0One of the thing we are thinking about pkgng is to perhaps be able t= o >>> =A0provide it only as a ports (with simple script in base to >>> =A0boostrap/install it). That would allow pkgng to live with the ports = to >>> =A0be able to easily integrate new features without having to support >>> =A0very old version of pkgng. >> >> Maybe I'm misunderstanding but won't that mean that the ports system wit= hout >> pkgng will continue to maintain their data in the current format? >> > If pkgng is not installed, the first thing the port system will do is > to install it. > >>> =A0more informations can be found here: >>> =A0http://git.etoilebsd.net/pkgng/tree/docs/GOALS, >> >> """ >> =A0 =A0 =A0 =A0 =A0the database will be a sqlite file compressed with th= e xz format. >> =A0 =A0 =A0 =A0 =A0the database will be signed so we can trust the sha25= 6 of the >> =A0 =A0 =A0 =A0 =A0packages, so if a package has the expected hash, it i= s considered >> =A0 =A0 =A0 =A0 =A0trusted. >> """ >> >> I'm not sure on what "the database" refers at this point, but is it real= ly >> necessary to compress it? I don't mean it's hard to do, just that maybe = it >> would be simpler without it. > > It is the database describing the remote repository. It is interesting > to compress it because it will be downloaded. > >> >> About this signature: hashing like this is very rudimentary. Could you >> design this to extensible, expecting real PGP-based signatures in the >> future? > > We thought that signing the repo.sqlite file would be simpler. > If we want to sign each package individually, we must have a tarball > which contains the real tarball plus the signature. > > Regards, > Julien > _______________________________________________ > freebsd-current@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org= " > if you are going to test on current please notice that make install will overwrite /usr/lib/libpkg so pkg_* tools won't work anymore. We will workaround that later by renaming our lib libpkgng for the test pha= se. But I won't be able to do that before monday. regards, Bapt