Skip site navigation (1)Skip section navigation (2)
Date:      Sat, 05 Sep 2020 14:38:40 +0200
From:      "Julian H. Stacey" <jhs@berklix.com>
To:        Stefan Esser <se@freebsd.org>
Cc:        "Julian H. Stacey" <jhs@berklix.com>
Subject:   Re: /usr/src/usr.bin/gh-bc don't know how to make /usr/src/contrib/bc/locales/en_US.UTF-8.msg
Message-ID:  <202009051238.085CceLk056076@fire.js.berklix.net>
In-Reply-To: Your message "Wed, 02 Sep 2020 19:41:46 %2B0200." <a584510b-c26d-e21c-5a04-624e0bf4e9d3@freebsd.org>

next in thread | previous in thread | raw e-mail | index | archive | help
added cc: ctm-users@freebsd.org , stephen@math.missouri.edu

Summary of this mail below:
  I suspect I know where the problem is, 
  Stephen & I will probably be able to resolve it.

Stefan Esser wrote:
> From: Stefan Esser <se@freebsd.org>
> To: "Julian H. Stacey" <jhs@berklix.com>
> Cc: current@freebsd.org, Gavin Howard <gavin.d.howard@gmail.com>
> Subject: Re: /usr/src/usr.bin/gh-bc don't know how to make
>  /usr/src/contrib/bc/locales/en_US.UTF-8.msg
> 
> Am 02.09.20 um 01:42 schrieb Julian H. Stacey:
> > Hi current@freebsd.org,
> >=20
> > /usr/src/usr.bin/gh-bc don't know how to make /usr/src/contrib/bc/local=
> es/en_US.UTF-8.msg
> > With .ctm_status src-cur 14656 .svn_revision 364986 /usr/src/usr.bin/gh=
> -bc
> 
> Hi Julian,
> 
> since I'm building -CURRENT at least once a day with this bc
> and there have been no other reports, this does appear to be
> a local problem on your system (or a problem with CTM).

Thanks Stefan, Yes, it seems a CTM problem.


> > Avoided for now with /etc/src.conf WITHOUT_GH_BC=3DYES
> 
> Yes, but the correct fix is to provide the missing file, which
> is a symbolic link to en_US.msg. In fact, most of the message
> catalogs are provided by symlinks (71 of 96 files in the locales
> directory).
> 
> My assumption is, that CTM does not correctly encode and create
> symbolic links, so you miss them ... (but I did not check the
> CTM sources to verify that assumption).

Yes, seems to be. I find no symbolic links in my local src-cur built
from CTM /pub/FreeBSD/branches/-current/src/src-cur.14600xEmpty.gz
up to src-cur.14662.gz which delivers /pub/FreeBSD/branches/-current/src/
.ctm_status src-cur 14662 .svn_revision 365330

Whereas both of 
	svn export -q file:///usr/svn/base/head
	svn co -q file:///usr/svn/base/head
(working from a /usr/svn/ delivered by CTM 
/pub/FreeBSD/development/CTM/svn-cur/svn-cur.09000xEmpty.xz
... /pub/FreeBSD/development/CTM/svn-cur/svn-cur.09025.xz )
deliver 132 symbolic links
of which 71 are shown by grep contrib/bc/locales/ | wc -l
(& 71 also in your uuencoded thanks)

The lack of symbolic links in CTM extracted trees was puzzling, as
I recall CTM had a problem a few months back not delivering symbolic
links, & Stephen (cc'd) solved it & issued patch deltas;
(around the time CTM moved from src/ to /usr/ports/misc/ctm/
but I can't recall the order of those two events off hand, doubtless in
ctm mail archive, (but I have to rush out soon))

My local @home CTM binary on my current box looks not old:
ls -l `which ctm`
 -r-xr-xr-x  1 root  wheel  39880 Aug 27 01:40 /usr/local/sbin/ctm*
cd /usr/local ;  find . -name ctm\* | sort | xargs ls -l

Then I realised I had blundered, & been extracting CTMs localy via
procmail automaticaly on an old box with
 -r-xr-xr-x  1 root  wheel  41224 Jun 14  2017 /usr/sbin/ctm*
but that was Not the solution as I still only get a single sym link
	FreeBSD-SVN/ports/hooks/pre-revprop-change
after re-extracting all ctm trees on my current box, with these commands:
 cd /data/tmp/ctm/1/FreeBSD-SVN
 ctm -q /pub/FreeBSD/development/CTM/svn-cur/svn-cur.09000xEmpty.xz
 ctm -q /pub/FreeBSD/development/CTM/svn-cur/svn-cur.08[0-9][0-9][0-9].xz

 cd /data/tmp/ctm/1/src-cur 
 ctm -q /pub/FreeBSD/development/CTM/src-cur/src-cur.14600xEmpty.gz 
 ctm -q /pub/FreeBSD/development/CTM/src-cur/src-cur*.1[0-9][0-9][0-9][0-9].gz
 
 cd /data/tmp/ctm/1/ports-cur 
 ctm -q /pub/FreeBSD/development/CTM/ports-cur/ports-cur.13600xEmpty.gz 
 ctm -q /pub/FreeBSD/development/CTM/ports-cur/ports-cur.1[0-9][0-9][0-9][0-9].gz
 
 cd /data/tmp/ctm/1/src-12 
 ctm -q  /pub/FreeBSD/development/CTM/src-12/src-12.0800xEmpty.gz 
 ctm -q /pub/FreeBSD/development/CTM/src-12/src-12.[0-9][0-9][0-9][0-9].gz
 
 cd /data/tmp/ctm/1/src-11 
 ctm -q /pub/FreeBSD/development/CTM/src-11/src-11.1700xEmpty.gz
 ctm -q /pub/FreeBSD/development/CTM/src-11/src-11.[0-9][0-9][0-9][0-9].gz
 
 cd /data/tmp/ctm/1/src-10
 ctm -q /pub/FreeBSD/development/CTM/src-10/src-10.2100xEmpty.gz
 ctm -q /pub/FreeBSD/development/CTM/src-10/src-10.[0-9][0-9][0-9][0-9].gz
 
 cd /data/tmp/ctm/1/src-9
 ctm -q /pub/FreeBSD/development/CTM/src-9/src-9.1900xEmpty.gz
 ctm -q /pub/FreeBSD/development/CTM/src-9/src-9.[0-9][0-9][0-9][0-9].gz
 
 cd /data/tmp/ctm/1/src-8
 ctm -q /pub/FreeBSD/development/CTM/src-8/src-8.1900xEmpty.gz
 ctm -q /pub/FreeBSD/development/CTM/src-8/src-8.[0-9][0-9][0-9][0-9].gz
 
 cd /data/tmp/ctm/1/src-7
 ctm -q /pub/FreeBSD/development/CTM/src-7/src-7.1700xEmpty.gz
 ctm -q /pub/FreeBSD/development/CTM/src-7/src-7.[1-9][0-9][0-9][0-9].gz
 
 cd /data/tmp/ctm/1/src-6
 ctm -q /pub/FreeBSD/development/CTM/src-6/src-6.1600xEmpty.gz
 ctm -q /pub/FreeBSD/development/CTM/src-6/src-6.1[0-9][0-9][0-9].gz
 
 cd /data/tmp/ctm/1/src-5
 ctm -q /pub/FreeBSD/development/CTM/src-5/src-5.0800xEmpty.gz
 ctm -q /pub/FreeBSD/development/CTM/src-5/src-5.0[6-9][0-9][0-9].gz
 
 cd /data/tmp/ctm/1/src-4
 ctm -q /pub/FreeBSD/development/CTM/src-4/src-4.2300xEmpty.gz
 ctm -q /pub/FreeBSD/development/CTM/src-4/src-4.2[0-9][0-9][0-9].gz

My CTM bins on current box are modern, 
cd /usr/local/sbin ; ls -l ctm* | grep -v pkgsave
 -r-xr-xr-x  1 root  wheel  39880 Aug 27 01:40 ctm*
 -r-xr-xr-x  1 root  wheel  10968 Aug 27 01:40 ctm_dequeue*
 -r-xr-xr-x  1 root  wheel  18032 Aug 27 01:40 ctm_rmail*
 -r-xr-xr-x  1 root  wheel  14904 Aug 27 01:40 ctm_smail*

but were from pkg install, so in case anything went wrong on pkg builder
@freebsd.org, I rebuilt localy:
 cd /usr/ports ;
 cat .ctm_status ports-cur 13646
 cat .svn_revision 547299
 cd /usr/ports/misc/ctm ; make install
 cd /usr/local/sbin ; ls -l ctm* | grep -v pkgsave
  -r-xr-xr-x  1 root  wheel  39880 Sep  5 13:07 ctm*
  -r-xr-xr-x  1 root  wheel  10968 Sep  5 13:07 ctm_dequeue*
  -r-xr-xr-x  1 root  wheel  18032 Sep  5 13:07 ctm_rmail*
  -r-xr-xr-x  1 root  wheel  14904 Sep  5 13:07 ctm_smail*

& re extracted with
 cd /data/tmp/ctm/2/src-cur 
 ctm -q /pub/FreeBSD/development/CTM/src-cur/src-cur.14600xEmpty.gz 
 ctm -q /pub/FreeBSD/development/CTM/src-cur/src-cur*.1[0-9][0-9][0-9][0-9].gz
 find . -type l -print	
& still no symbolic links
 

> This ought to be fixed in CTM and then a delta should be created
> that provides these missing symlinks - since you are one of very
> few CTM users left, you may want to create a patch ...

Yes, I haven't looked yet on host of http://ctm.berklix.org (which
is the global master generator site forr FreeBSD CTM deltas. The
host is mine, but it's Stephen who is the CTM generator master &
knows scripts & paths where to look etc).

> ... Trimmed ..
> But since further symlinks will occur if more locales are added,
> the problem will re-appear for CTM users, unless symlinks are
> supported by CTM.

Yes, symbolic links are supposed to be supported by CTM now, Stephen
knows more about symlinks on CTM than me, On host ctm.berklix.org
`which ctm` # /usr/sbin/ctm & I see both
	44096 Mar 13 17:56 /usr/sbin/ctm*
	44000 Apr  7 13:01 /usr/local/sbin/ctm*
& ctm.berklix.org is a jail 12.1-p8 whose prison was recently upgraded,
& its src-12 still contains
	./usr.sbin/ctm
	./usr.sbin/ctm/ctm
	./usr.sbin/ctm/ctm_dequeue
	./usr.sbin/ctm/ctm_rmail
	./usr.sbin/ctm/ctm_smail

I or Stephen need to check if:
  maybe some of the ctm generator scripts might have been till
  recently taking default path to ctm bins, & running a newer ctm
  in local/ from ports that could do sym links, & maybe I had just
  manually removed old /usr/sbin/ctm* ; but since the prison upgrade
  (or earlier) ctm.berklix.org generator might now be running from
  older /usr/sbin/ctm without sym link capability.

I'm not familiar with paths to CTM generator scripts to trace that,
& scripts names are opaque so while it would be trivial for me to
remove the old /usr/sbin/ctm* to force scripts to use /usr/local
or break, that will not be sufficient as we will need to regenerate
some trees & deltas. That's where Stephen Montgomery-Smith's
familiarity with trees & scripts is very valuable.  If Stephen is
not available, it will need to wait as I'm about to travel.

> Regards, STefan
Thanks Stefan.

Cheers,
Julian
-- 
Julian Stacey, Consultant Sys. Engineer, BSD Linux http://berklix.com/jhs/
Crash Brexit Dec. 2020 paid by speculators. http://berklix.uk/brexit/#money
Probe Russian Brexit Referendum https://petition.parliament.uk/petitions/332293



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?202009051238.085CceLk056076>