From owner-freebsd-qa@FreeBSD.ORG Sun Mar 14 21:57:39 2010 Return-Path: Delivered-To: freebsd-qa@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6C143106564A for ; Sun, 14 Mar 2010 21:57:39 +0000 (UTC) (envelope-from yanefbsd@gmail.com) Received: from mail-pv0-f182.google.com (mail-pv0-f182.google.com [74.125.83.182]) by mx1.freebsd.org (Postfix) with ESMTP id 427808FC15 for ; Sun, 14 Mar 2010 21:57:39 +0000 (UTC) Received: by pva18 with SMTP id 18so179185pva.13 for ; Sun, 14 Mar 2010 14:57:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:cc:content-type :content-transfer-encoding; bh=I4kLbFeJ4faKdf08ht6WBHMuDX1UPBLmuOawYOtyn2o=; b=brHeT+isdNmT3XWO9UWY8FqiwLANOdLOIdP/pjPY31+14v9F32xJhdmZ3rGNkOgHBq b6Dnzqf1AAUGZvkzSVofHDjtnVgc7slcq9PEimOh76M4zHdSztkdxcwYNlWF/wJIfh/i pV4FkXr6pIeNVWO8nuj/wZmujEPxDD84espv0= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; b=Gu2g1FGEKGiQVRegwsKvZUvCXMXrqz5a9mPYQc3lRUaPoyY/7fRkA/dnVfVnZEhVi3 u7x6S/nINcITysHB7/exbSvyHb10Xl3v13bSDBWGTXzLrtfIXG5CNb9aG5Al9Qtt++5R Ezn8HSputfwkFOkVH3fC94pctevhp2AGcYKlw= MIME-Version: 1.0 Received: by 10.142.1.29 with SMTP id 29mr590917wfa.337.1268602502705; Sun, 14 Mar 2010 14:35:02 -0700 (PDT) In-Reply-To: References: Date: Sun, 14 Mar 2010 14:35:02 -0700 Message-ID: <7d6fde3d1003141435s70deaba7o2d61ae4187359471@mail.gmail.com> From: Garrett Cooper To: chukharev@mail.ru Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: "freebsd-qa@freebsd.org" Subject: Re: About ports QA by 'port test' X-BeenThere: freebsd-qa@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD Quality Assurance List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 14 Mar 2010 21:57:39 -0000 2010/3/8 : > Recently I've been trying to run some additional tests during updating > the ports I have installed on my computer. That means I select a number > of oldest installed ports (using dates of directories in /var/db/pkg/), > and for each of them run 'port test' (ports-mgmt/porttools) and then > 'portupgrade -f'. > > FYI, the 'port test' uses portlint, builds in a different place, installs > into a different place, packages, then de-installs and checks for left > files. No jail, no chroot. > > =A0From what I have seen till now, about 25% of the ports do not pass the > test, either for fatal errors from portlint or due to errors exhibited > because of PREFIX and PKG_DBDIR variables. And this is done only for > the ports I have successfully installed on my system for some reason > not connected to the QA purposes. > > I do not want to trouble the port maintainers with direct e-mails. > > I've been posting the results (and the original description I'm modifying > now) to freebsd-qa@ for a while, but that turned out to be of some burden > and also I received there no feedback at all. > Therefore I set a webpage at my day-job where I will copy the results. > I hope I will not need to keep the site for long, if running 'port test' > is found useful, it should be added into QAT or tinderbox, I think. Thoug= h > without jail it is faster I guess. > > The URL: http://kemia.me.tut.fi/~chu/FreeBSD.port_tests/ > Current statistics: If the host was reachable... > Ports having fatal errors: =A0 =A0 =A0 =A0 =A0 =A0 109 (21 %) > Ports having warnings: =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 216 (43 %) > Ports without fatal errors: =A0 =A0 =A0 =A0 =A0 =A0391 (78 %) > Ports having warnings or fatal errors: 325 (65 %) > Totally tested ports: =A0 =A0 =A0 500 > > Additionally to the above stats, java/jdk16 is interactive and hangs on > input > despite of BATCH=3Dyes in /etc/make.conf. Thanks, -Garrett