Date: Sat, 3 Nov 2012 01:36:31 -0700 (PDT) From: P S <cellestial2004@yahoo.com> To: "freebsd-questions@freebsd.org" <freebsd-questions@freebsd.org> Subject: Re: poudriere amassing fetch errors Message-ID: <1351931791.9575.YahooMailNeo@web124504.mail.ne1.yahoo.com>
index | next in thread | raw e-mail
This doesn't sound like a poudriere-specific issue. There may be a general fetching issue with bsd.port.mk, that I plan to investigate further."" I believe you will find the problem is in the code related to 'make checksum'. I discovered a while back(at least a year ago) that 'make checksum' will append the the full version of a file that was only partially downloaded instead of deleting it and starting from scratch. Which means 'make checksum' will fail no matter what because the file increases by one partial/full filesize + previous file and then 'make checksum' fails and pours-it-on(re-downloads) at each invocation. It's not the only issue with 'make checksum' but I can't remember the others at the moment. The manual fix is to go to the offending port directory and do a 'make distclean', then a 'make fetch', and finally a 'make checksum'. An alternative is to delete the offending distfile and do a 'make fetch ; make checksum' or just "make checksum"(not reliable) in the offending port directory. For me 'games/el-data' always fails. The el_linux_192.zip file makes it from a different site but the sound and music files never get fully downloaded(only port with an unstable link, sound and music files should be mirrored somewhere else). Of course it didn't stop them from showing 300MB sizes for 70MB files due to 'make checksum' failing and adding on. 'Biology/finchtv' also never passes checksum as of last week. The distfile was over 100MB(normally 6MB) when I discovered the checksum problem. In my experience, 'make fetch' doesn't always check filesize just that the file is there so mis-sized or re-rolled files often fell through without being re-downloaded. 'Make checksum' would catch the filesize errors but doesn't 'delete and download' or append properly. I thought this was just my systems and connections but after seeing other people reporting similar effects I figured I better say something of what I've observed. I also haven't checked recently if the checksum problem still exists as I've just worked around the problem. I sent a PR back then but I never saw it show up anywhere. I have been downloading(using 'make fetch' and 'make checksum') all the distfiles(minus restricted, unavailable ) for the entire ports system whenever I update ports. I have most of the distfiles going back at least 5 years now. Currently, the distfile area of any ports system release is about 80GB in size(not including restricted/licensed limited or unavailable files, a couple GB extra maybe). I won't register or "sign in" for files so no restricted files(cad/systemc, biology/phred, biology/blast, java/jdk, etc) and very few manual retrievals(java/jre, astro/xephem). The distfile area as of 1 january 2012 is about 300GB having been updated every few weeks to months over the previous five years(starting before the modular Xorg release). Ports-related: mail/cvsmail downloads the same-named distfile as the mail/mailutils port but they come from different places, are different sizes, and overwrite each other when downloaded(verified last week). PR sent. From owner-freebsd-questions@FreeBSD.ORG Sat Nov 3 08:45:25 2012 Return-Path: <owner-freebsd-questions@FreeBSD.ORG> Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id F3E367E7 for <freebsd-questions@freebsd.org>; Sat, 3 Nov 2012 08:45:24 +0000 (UTC) (envelope-from mueller23@insightbb.com) Received: from mail.insightbb.com (smtp.insight.synacor.com [208.47.185.22]) by mx1.freebsd.org (Postfix) with ESMTP id B05B58FC0C for <freebsd-questions@freebsd.org>; Sat, 3 Nov 2012 08:45:23 +0000 (UTC) X_CMAE_Category: 0,0 Undefined,Undefined X-CNFS-Analysis: v=2.0 cv=ZYCfx7pA c=1 sm=0 a=Dm9TOXL4taQ+Gy1KovpL+A==:17 a=hRQNYkxG62oA:10 a=jLN7EqiLvroA:10 a=9YQ-1ebCAAAA:8 a=CsmpynpXe2MA:10 a=qlhVyoHoXNAC3UXq2AIA:9 a=Dm9TOXL4taQ+Gy1KovpL+A==:117 X-CM-Score: 0 X-Scanned-by: Cloudmark Authority Engine Authentication-Results: smtp02.insight.synacor.com smtp.mail=mueller23@insightbb.com; spf=softfail; sender-id=softfail Authentication-Results: smtp02.insight.synacor.com header.from=mueller23@insightbb.com; sender-id=softfail Received-SPF: softfail (smtp02.insight.synacor.com: transitional domain insightbb.com does not designate 74.130.198.7 as permitted sender) Received: from [74.130.198.7] ([74.130.198.7:54973] helo=localhost) by mail.insightbb.com (envelope-from <mueller23@insightbb.com>) (ecelerity 2.2.3.49 r(42060/42061)) with ESMTP id D4/33-23131-2A9D4905; Sat, 03 Nov 2012 04:45:22 -0400 Date: Sat, 03 Nov 2012 04:45:22 -0400 Message-ID: <D4.33.23131.2A9D4905@smtp02.insight.synacor.com> From: "Thomas Mueller" <mueller23@insightbb.com> To: freebsd-questions@freebsd.org Subject: Re: yelp could not be built because of libxul dependency (10.0 vs. <2) Cc: Ewald Jenisch <a@jenisch.at> X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: User questions <freebsd-questions.freebsd.org> List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-questions>, <mailto:freebsd-questions-request@freebsd.org?subject=unsubscribe> List-Archive: <http://lists.freebsd.org/pipermail/freebsd-questions>; List-Post: <mailto:freebsd-questions@freebsd.org> List-Help: <mailto:freebsd-questions-request@freebsd.org?subject=help> List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-questions>, <mailto:freebsd-questions-request@freebsd.org?subject=subscribe> X-List-Received-Date: Sat, 03 Nov 2012 08:45:25 -0000 from Ewald Jenisch <a@jenisch.at>: > I'm trying to get my system up2date using portupgrade as usual. > However during the upgrade process I ran into a problem during upgrade > of yelp: > ===> yelp-2.30.2_4 depends on package: libxul<2 - not found > ===> Found libxul-10.0.10, but you need to upgrade to libxul<2. > UPDATING has an entry for www/libxul of 20120910 that says > "...If you want to stay with 1.9.2..." > So in order to make yelp build again, does this mean I've got to > de-install libxul-10.0.10 and install /usr/ports/www/libxul19 again? > Thanks much in advance for your help, > -ewald I posted a message on this same issue with gnash and mentioned also yelp. In the case of gnash, libxul19 is supposed to install a file /usr/local/lib/libxul/xpidl but libxul-10.0.9 doesn't. Maybe the yelp port needed this file too? Just a few fours ago, I ran "portsnap fetch update", and I noticed yelp was updated to a new version. I saw no mention of libxul or libxul19 in the Makefile. When I ran make all-depends-list | more there was nothing with "xul" anywhere. Now if you update your ports tree, you will be able to build yelp? I think this thread really should be in the freebsd-ports emailing list? Tomhelp
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1351931791.9575.YahooMailNeo>