From owner-freebsd-ports@FreeBSD.ORG Sun Mar 14 18:29:23 2010 Return-Path: Delivered-To: freebsd-ports@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C25A7106564A for ; Sun, 14 Mar 2010 18:29:23 +0000 (UTC) (envelope-from chukharev@mail.ru) Received: from fallback2.mail.ru (fallback2.mail.ru [94.100.176.87]) by mx1.freebsd.org (Postfix) with ESMTP id 7ACE88FC19 for ; Sun, 14 Mar 2010 18:29:23 +0000 (UTC) Received: from mx71.mail.ru (mx71.mail.ru [94.100.176.85]) by fallback2.mail.ru (mPOP.Fallback_MX) with ESMTP id B6F09171AB33 for ; Sun, 14 Mar 2010 20:53:20 +0300 (MSK) Received: from [91.155.189.108] (port=64095 helo=vova-vaio) by mx71.mail.ru with asmtp id 1Nqs06-000Muk-00 for freebsd-ports@freebsd.org; Sun, 14 Mar 2010 20:53:18 +0300 Content-Type: text/plain; charset=koi8-r; format=flowed; delsp=yes To: "freebsd-qa@freebsd.org" Date: Mon, 08 Mar 2010 20:19:15 +0200 From: chukharev@mail.ru Message-ID: User-Agent: Opera Mail/10.10 (FreeBSD) Resent-To: "freebsd-ports@freebsd.org" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Resent-From: chukharev@mail.ru Resent-Date: Sun, 14 Mar 2010 19:53:20 +0200 Resent-Message-ID: X-Spam: Not detected X-Mras: Ok Cc: Subject: About ports QA by 'port test' X-BeenThere: freebsd-ports@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Porting software to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 14 Mar 2010 18:29:23 -0000 Recently I've been trying to run some additional tests during updating the ports I have installed on my computer. That means I select a number of oldest installed ports (using dates of directories in /var/db/pkg/), and for each of them run 'port test' (ports-mgmt/porttools) and then 'portupgrade -f'. FYI, the 'port test' uses portlint, builds in a different place, installs into a different place, packages, then de-installs and checks for left files. No jail, no chroot. From what I have seen till now, about 25% of the ports do not pass the test, either for fatal errors from portlint or due to errors exhibited because of PREFIX and PKG_DBDIR variables. And this is done only for the ports I have successfully installed on my system for some reason not connected to the QA purposes. I do not want to trouble the port maintainers with direct e-mails. I've been posting the results (and the original description I'm modifying now) to freebsd-qa@ for a while, but that turned out to be of some burden and also I received there no feedback at all. Therefore I set a webpage at my day-job where I will copy the results. I hope I will not need to keep the site for long, if running 'port test' is found useful, it should be added into QAT or tinderbox, I think. Though without jail it is faster I guess. The URL: http://kemia.me.tut.fi/~chu/FreeBSD.port_tests/ Current statistics: Ports having fatal errors: 109 (21 %) Ports having warnings: 216 (43 %) Ports without fatal errors: 391 (78 %) Ports having warnings or fatal errors: 325 (65 %) Totally tested ports: 500 Additionally to the above stats, java/jdk16 is interactive and hangs on input despite of BATCH=yes in /etc/make.conf. -- Vladimir Chukharev Tampere University of Technology