From owner-ctm-users@freebsd.org Sat Sep 5 12:39:15 2020 Return-Path: Delivered-To: ctm-users@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 929B53CB541; Sat, 5 Sep 2020 12:39:15 +0000 (UTC) (envelope-from jhs@berklix.com) Received: from slim.berklix.org (slim.berklix.org [94.185.90.68]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "slim.berklix.org", Issuer "slim.berklix.org" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BkDcy4jqPz4QNR; Sat, 5 Sep 2020 12:39:14 +0000 (UTC) (envelope-from jhs@berklix.com) Received: from mart.js.berklix.net (p4fc4c69f.dip0.t-ipconnect.de [79.196.198.159]) (authenticated bits=128) by slim.berklix.org (8.15.2/8.15.2) with ESMTPSA id 085Cd1sm003036 (version=TLSv1 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Sat, 5 Sep 2020 14:39:05 +0200 (CEST) (envelope-from jhs@berklix.com) Received: from fire.js.berklix.net (fire.js.berklix.net [192.168.91.41]) by mart.js.berklix.net (8.14.3/8.14.3) with ESMTP id 085Cd0qK093780; Sat, 5 Sep 2020 14:39:00 +0200 (CEST) (envelope-from jhs@berklix.com) Received: from fire.js.berklix.net (localhost [127.0.0.1]) by fire.js.berklix.net (8.14.7/8.14.7) with ESMTP id 085CceLk056076; Sat, 5 Sep 2020 14:38:50 +0200 (CEST) (envelope-from jhs@berklix.com) Message-Id: <202009051238.085CceLk056076@fire.js.berklix.net> To: Stefan Esser cc: current@freebsd.org, Gavin Howard cc: ctm-users@freebsd.org cc: stephen@math.missouri.edu cc: "Julian H. Stacey" Subject: Re: /usr/src/usr.bin/gh-bc don't know how to make /usr/src/contrib/bc/locales/en_US.UTF-8.msg From: "Julian H. Stacey" Organization: http://berklix.com/jhs/ User-agent: EXMH on FreeBSD http://berklix.com/free/ X-From: http://www.berklix.org/~jhs/ In-reply-to: Your message "Wed, 02 Sep 2020 19:41:46 +0200." Date: Sat, 05 Sep 2020 14:38:40 +0200 X-Rspamd-Queue-Id: 4BkDcy4jqPz4QNR X-Spamd-Bar: + Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of jhs@berklix.com has no SPF policy when checking 94.185.90.68) smtp.mailfrom=jhs@berklix.com X-Spamd-Result: default: False [1.84 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; MULTIPLE_UNIQUE_HEADERS(0.70)[Cc]; RCPT_COUNT_FIVE(0.00)[6]; HAS_ORG_HEADER(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; NEURAL_HAM_SHORT(-0.38)[-0.380]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:33824, ipnet:94.185.88.0/22, country:DE]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.10)[-0.099]; FREEFALL_USER(0.00)[jhs]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-0.78)[-0.776]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[berklix.com]; AUTH_NA(1.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_SPF_NA(0.00)[no SPF record]; FREEMAIL_CC(0.00)[freebsd.org,gmail.com]; SUSPICIOUS_RECIPS(1.50)[]; MAILMAN_DEST(0.00)[ctm-users,current] X-BeenThere: ctm-users@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: CTM User discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 05 Sep 2020 12:39:15 -0000 added cc: ctm-users@freebsd.org , stephen@math.missouri.edu Summary of this mail below: I suspect I know where the problem is, Stephen & I will probably be able to resolve it. Stefan Esser wrote: > From: Stefan Esser > To: "Julian H. Stacey" > Cc: current@freebsd.org, Gavin Howard > Subject: Re: /usr/src/usr.bin/gh-bc don't know how to make > /usr/src/contrib/bc/locales/en_US.UTF-8.msg > > Am 02.09.20 um 01:42 schrieb Julian H. Stacey: > > Hi current@freebsd.org, > >=20 > > /usr/src/usr.bin/gh-bc don't know how to make /usr/src/contrib/bc/local= > es/en_US.UTF-8.msg > > With .ctm_status src-cur 14656 .svn_revision 364986 /usr/src/usr.bin/gh= > -bc > > Hi Julian, > > since I'm building -CURRENT at least once a day with this bc > and there have been no other reports, this does appear to be > a local problem on your system (or a problem with CTM). Thanks Stefan, Yes, it seems a CTM problem. > > Avoided for now with /etc/src.conf WITHOUT_GH_BC=3DYES > > Yes, but the correct fix is to provide the missing file, which > is a symbolic link to en_US.msg. In fact, most of the message > catalogs are provided by symlinks (71 of 96 files in the locales > directory). > > My assumption is, that CTM does not correctly encode and create > symbolic links, so you miss them ... (but I did not check the > CTM sources to verify that assumption). Yes, seems to be. I find no symbolic links in my local src-cur built from CTM /pub/FreeBSD/branches/-current/src/src-cur.14600xEmpty.gz up to src-cur.14662.gz which delivers /pub/FreeBSD/branches/-current/src/ .ctm_status src-cur 14662 .svn_revision 365330 Whereas both of svn export -q file:///usr/svn/base/head svn co -q file:///usr/svn/base/head (working from a /usr/svn/ delivered by CTM /pub/FreeBSD/development/CTM/svn-cur/svn-cur.09000xEmpty.xz ... /pub/FreeBSD/development/CTM/svn-cur/svn-cur.09025.xz ) deliver 132 symbolic links of which 71 are shown by grep contrib/bc/locales/ | wc -l (& 71 also in your uuencoded thanks) The lack of symbolic links in CTM extracted trees was puzzling, as I recall CTM had a problem a few months back not delivering symbolic links, & Stephen (cc'd) solved it & issued patch deltas; (around the time CTM moved from src/ to /usr/ports/misc/ctm/ but I can't recall the order of those two events off hand, doubtless in ctm mail archive, (but I have to rush out soon)) My local @home CTM binary on my current box looks not old: ls -l `which ctm` -r-xr-xr-x 1 root wheel 39880 Aug 27 01:40 /usr/local/sbin/ctm* cd /usr/local ; find . -name ctm\* | sort | xargs ls -l Then I realised I had blundered, & been extracting CTMs localy via procmail automaticaly on an old box with -r-xr-xr-x 1 root wheel 41224 Jun 14 2017 /usr/sbin/ctm* but that was Not the solution as I still only get a single sym link FreeBSD-SVN/ports/hooks/pre-revprop-change after re-extracting all ctm trees on my current box, with these commands: cd /data/tmp/ctm/1/FreeBSD-SVN ctm -q /pub/FreeBSD/development/CTM/svn-cur/svn-cur.09000xEmpty.xz ctm -q /pub/FreeBSD/development/CTM/svn-cur/svn-cur.08[0-9][0-9][0-9].xz cd /data/tmp/ctm/1/src-cur ctm -q /pub/FreeBSD/development/CTM/src-cur/src-cur.14600xEmpty.gz ctm -q /pub/FreeBSD/development/CTM/src-cur/src-cur*.1[0-9][0-9][0-9][0-9].gz cd /data/tmp/ctm/1/ports-cur ctm -q /pub/FreeBSD/development/CTM/ports-cur/ports-cur.13600xEmpty.gz ctm -q /pub/FreeBSD/development/CTM/ports-cur/ports-cur.1[0-9][0-9][0-9][0-9].gz cd /data/tmp/ctm/1/src-12 ctm -q /pub/FreeBSD/development/CTM/src-12/src-12.0800xEmpty.gz ctm -q /pub/FreeBSD/development/CTM/src-12/src-12.[0-9][0-9][0-9][0-9].gz cd /data/tmp/ctm/1/src-11 ctm -q /pub/FreeBSD/development/CTM/src-11/src-11.1700xEmpty.gz ctm -q /pub/FreeBSD/development/CTM/src-11/src-11.[0-9][0-9][0-9][0-9].gz cd /data/tmp/ctm/1/src-10 ctm -q /pub/FreeBSD/development/CTM/src-10/src-10.2100xEmpty.gz ctm -q /pub/FreeBSD/development/CTM/src-10/src-10.[0-9][0-9][0-9][0-9].gz cd /data/tmp/ctm/1/src-9 ctm -q /pub/FreeBSD/development/CTM/src-9/src-9.1900xEmpty.gz ctm -q /pub/FreeBSD/development/CTM/src-9/src-9.[0-9][0-9][0-9][0-9].gz cd /data/tmp/ctm/1/src-8 ctm -q /pub/FreeBSD/development/CTM/src-8/src-8.1900xEmpty.gz ctm -q /pub/FreeBSD/development/CTM/src-8/src-8.[0-9][0-9][0-9][0-9].gz cd /data/tmp/ctm/1/src-7 ctm -q /pub/FreeBSD/development/CTM/src-7/src-7.1700xEmpty.gz ctm -q /pub/FreeBSD/development/CTM/src-7/src-7.[1-9][0-9][0-9][0-9].gz cd /data/tmp/ctm/1/src-6 ctm -q /pub/FreeBSD/development/CTM/src-6/src-6.1600xEmpty.gz ctm -q /pub/FreeBSD/development/CTM/src-6/src-6.1[0-9][0-9][0-9].gz cd /data/tmp/ctm/1/src-5 ctm -q /pub/FreeBSD/development/CTM/src-5/src-5.0800xEmpty.gz ctm -q /pub/FreeBSD/development/CTM/src-5/src-5.0[6-9][0-9][0-9].gz cd /data/tmp/ctm/1/src-4 ctm -q /pub/FreeBSD/development/CTM/src-4/src-4.2300xEmpty.gz ctm -q /pub/FreeBSD/development/CTM/src-4/src-4.2[0-9][0-9][0-9].gz My CTM bins on current box are modern, cd /usr/local/sbin ; ls -l ctm* | grep -v pkgsave -r-xr-xr-x 1 root wheel 39880 Aug 27 01:40 ctm* -r-xr-xr-x 1 root wheel 10968 Aug 27 01:40 ctm_dequeue* -r-xr-xr-x 1 root wheel 18032 Aug 27 01:40 ctm_rmail* -r-xr-xr-x 1 root wheel 14904 Aug 27 01:40 ctm_smail* but were from pkg install, so in case anything went wrong on pkg builder @freebsd.org, I rebuilt localy: cd /usr/ports ; cat .ctm_status ports-cur 13646 cat .svn_revision 547299 cd /usr/ports/misc/ctm ; make install cd /usr/local/sbin ; ls -l ctm* | grep -v pkgsave -r-xr-xr-x 1 root wheel 39880 Sep 5 13:07 ctm* -r-xr-xr-x 1 root wheel 10968 Sep 5 13:07 ctm_dequeue* -r-xr-xr-x 1 root wheel 18032 Sep 5 13:07 ctm_rmail* -r-xr-xr-x 1 root wheel 14904 Sep 5 13:07 ctm_smail* & re extracted with cd /data/tmp/ctm/2/src-cur ctm -q /pub/FreeBSD/development/CTM/src-cur/src-cur.14600xEmpty.gz ctm -q /pub/FreeBSD/development/CTM/src-cur/src-cur*.1[0-9][0-9][0-9][0-9].gz find . -type l -print & still no symbolic links > This ought to be fixed in CTM and then a delta should be created > that provides these missing symlinks - since you are one of very > few CTM users left, you may want to create a patch ... Yes, I haven't looked yet on host of http://ctm.berklix.org (which is the global master generator site forr FreeBSD CTM deltas. The host is mine, but it's Stephen who is the CTM generator master & knows scripts & paths where to look etc). > ... Trimmed .. > But since further symlinks will occur if more locales are added, > the problem will re-appear for CTM users, unless symlinks are > supported by CTM. Yes, symbolic links are supposed to be supported by CTM now, Stephen knows more about symlinks on CTM than me, On host ctm.berklix.org `which ctm` # /usr/sbin/ctm & I see both 44096 Mar 13 17:56 /usr/sbin/ctm* 44000 Apr 7 13:01 /usr/local/sbin/ctm* & ctm.berklix.org is a jail 12.1-p8 whose prison was recently upgraded, & its src-12 still contains ./usr.sbin/ctm ./usr.sbin/ctm/ctm ./usr.sbin/ctm/ctm_dequeue ./usr.sbin/ctm/ctm_rmail ./usr.sbin/ctm/ctm_smail I or Stephen need to check if: maybe some of the ctm generator scripts might have been till recently taking default path to ctm bins, & running a newer ctm in local/ from ports that could do sym links, & maybe I had just manually removed old /usr/sbin/ctm* ; but since the prison upgrade (or earlier) ctm.berklix.org generator might now be running from older /usr/sbin/ctm without sym link capability. I'm not familiar with paths to CTM generator scripts to trace that, & scripts names are opaque so while it would be trivial for me to remove the old /usr/sbin/ctm* to force scripts to use /usr/local or break, that will not be sufficient as we will need to regenerate some trees & deltas. That's where Stephen Montgomery-Smith's familiarity with trees & scripts is very valuable. If Stephen is not available, it will need to wait as I'm about to travel. > Regards, STefan Thanks Stefan. Cheers, Julian -- Julian Stacey, Consultant Sys. Engineer, BSD Linux http://berklix.com/jhs/ Crash Brexit Dec. 2020 paid by speculators. http://berklix.uk/brexit/#money Probe Russian Brexit Referendum https://petition.parliament.uk/petitions/332293